2024-09-12T17:22:02.954 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T17:22:02.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:22:03.192 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732 branch: wip-rgw-meta-handlers description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7902732' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOABPwTGtneWdpqfC35yx/QyovA+3Achulm6Hhs4FEaIsAvXRYP8mHPoxIzLHH8x7dxDm2ZK+AC6c09JEBmQ38= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPSf0Z/TWqvtWEo09kVa68YDSNey8Az7vx35bi1sjIwhlkNe8lz3HtdbjT6A1u7sbRaslevCOKFOHiHkxaBnays= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T17:22:03.192 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T17:22:03.193 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T17:22:03.194 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T17:22:03.195 INFO:teuthology.task.internal:Checking packages... 2024-09-12T17:22:03.218 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T17:22:03.218 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T17:22:03.218 INFO:teuthology.packaging:ref: None 2024-09-12T17:22:03.219 INFO:teuthology.packaging:tag: None 2024-09-12T17:22:03.219 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T17:22:03.219 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:22:03.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T17:22:03.380 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:22:03.382 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T17:22:03.388 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T17:22:03.388 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T17:22:03.427 INFO:teuthology.task.internal:Saving configuration 2024-09-12T17:22:03.453 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T17:22:03.461 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T17:22:03.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:16:11.872972', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILXlaJqM5GNL7Y8m8ix6m0kupIEQhhYA3n8H8ICzarFf'} 2024-09-12T17:22:03.504 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:16:11.874747', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIK5s2VqS1RUWN5Jf+nk537SPyD9R3K5i1nJfbFa7EEsz'} 2024-09-12T17:22:03.504 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T17:22:03.510 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:22:03.511 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:22:03.511 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T17:22:03.584 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa07d62f2e0>, signals=[15]) 2024-09-12T17:22:03.584 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T17:22:03.590 INFO:teuthology.task.internal:Opening connections... 2024-09-12T17:22:03.591 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T17:22:03.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:22:03.670 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T17:22:03.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:22:03.752 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T17:22:03.760 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-09-12T17:22:03.766 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-09-12T17:22:03.767 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-09-12T17:22:03.813 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:22:03.813 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2024-09-12T17:22:03.813 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04" 2024-09-12T17:22:03.813 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:22:03.813 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy 2024-09-12T17:22:03.813 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2024-09-12T17:22:03.813 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2024-09-12T17:22:03.813 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:22:03.814 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:22:03.814 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:22:03.814 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:22:03.814 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:22:03.814 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-09-12T17:22:03.836 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-12T17:22:03.841 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-12T17:22:03.841 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-12T17:22:03.891 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:22:03.891 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2024-09-12T17:22:03.891 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="22.04" 2024-09-12T17:22:03.891 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:22:03.891 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=jammy 2024-09-12T17:22:03.891 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2024-09-12T17:22:03.891 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2024-09-12T17:22:03.891 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:22:03.892 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:22:03.892 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:22:03.892 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:22:03.892 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:22:03.892 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-12T17:22:03.912 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T17:22:03.921 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T17:22:03.944 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T17:22:03.944 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:22:03.947 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:22:03.951 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T17:22:03.968 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T17:22:03.968 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:22:03.994 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:22:04.012 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T17:22:04.059 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T17:22:04.074 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T17:22:04.074 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T17:22:04.075 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:22:04.075 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:22:04.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:22:04.080 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-12T17:22:04.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:22:04.082 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-12T17:22:04.129 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-56-generic 2024-09-12T17:22:04.129 INFO:teuthology.task.kernel:Running kernel on smithi097: 5.15.0-56-generic 2024-09-12T17:22:04.129 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-09-12T17:22:04.131 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-56-generic 2024-09-12T17:22:04.131 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.15.0-56-generic 2024-09-12T17:22:04.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-09-12T17:22:04.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-09-12T17:22:04.270 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-12T17:22:04.410 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:22:04.428 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:22:04.491 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:22:04.525 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:22:04.554 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:22:04.554 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:22:04.604 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:22:04.655 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:22:04.729 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:22:04.764 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:22:04.769 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:22:04.769 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:22:04.770 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:22:04.784 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:22:04.787 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:22:04.787 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:22:04.791 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:22:04.798 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:22:04.800 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:22:04.800 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:22:04.821 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:22:04.822 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:22:04.822 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:22:04.822 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:22:04.822 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:22:04.823 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:22:04.823 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:22:04.824 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:22:04.824 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:22:04.839 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:22:04.856 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:22:04.959 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:22:05.034 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:22:05.097 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:22:05.282 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:22:05.416 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:22:05.449 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:22:05.455 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:22:05.459 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:22:05.464 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:22:05.464 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:22:05.465 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:22:05.468 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:22:05.469 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:22:05.475 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:22:05.484 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:22:05.485 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:22:05.534 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:22:05.546 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:22:05.580 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:22:05.580 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:22:05.580 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:22:05.581 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:22:05.581 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:22:05.587 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:22:05.588 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:22:05.589 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:22:05.593 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:22:05.593 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:22:05.600 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:22:05.605 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:22:05.606 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:22:05.606 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:22:05.607 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:22:05.608 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:22:05.609 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:22:05.615 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:22:05.618 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:22:05.619 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:22:05.620 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:22:05.634 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:22:05.641 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:22:05.641 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:22:05.642 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:22:05.661 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:22:05.689 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:22:05.690 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:22:05.691 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:22:05.691 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:22:05.692 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:22:05.700 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:22:05.701 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:22:05.721 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:22:05.721 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:22:05.743 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:22:05.744 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:22:05.744 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:22:10.978 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 15.8 MB in 2s (7,481 kB/s) 2024-09-12T17:22:11.690 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 15.8 MB in 3s (5,729 kB/s) 2024-09-12T17:22:12.392 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T17:22:12.408 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:22:12.460 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T17:22:12.645 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-12T17:22:12.645 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-12T17:22:12.811 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:22:12.811 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:22:12.811 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:22:12.811 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:22:12.812 INFO:teuthology.orchestra.run.smithi097.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:22:12.812 INFO:teuthology.orchestra.run.smithi097.stdout: python2.7-minimal 2024-09-12T17:22:12.812 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:22:12.812 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-09-12T17:22:12.813 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:22:12.813 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:22:12.813 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:22:12.814 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-09-12T17:22:12.814 INFO:teuthology.orchestra.run.smithi097.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:22:12.814 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-09-12T17:22:12.814 INFO:teuthology.orchestra.run.smithi097.stdout: thermald 2024-09-12T17:22:12.858 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-09-12T17:22:12.858 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:22:12.858 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:22:12.858 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:22:12.859 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-09-12T17:22:12.860 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:22:12.911 INFO:teuthology.orchestra.run.smithi097.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:22:12.912 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 113 MB of archives. 2024-09-12T17:22:12.912 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:22:12.912 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:22:13.110 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-12T17:22:13.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:22:13.189 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-12T17:22:13.284 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:22:13.373 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-12T17:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-12T17:22:13.572 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:22:13.572 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:22:13.573 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:22:13.573 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:22:13.573 INFO:teuthology.orchestra.run.smithi154.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:22:13.573 INFO:teuthology.orchestra.run.smithi154.stdout: python2.7-minimal 2024-09-12T17:22:13.573 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:22:13.574 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-12T17:22:13.574 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:22:13.574 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:22:13.575 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:22:13.576 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-12T17:22:13.576 INFO:teuthology.orchestra.run.smithi154.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:22:13.576 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-09-12T17:22:13.576 INFO:teuthology.orchestra.run.smithi154.stdout: thermald 2024-09-12T17:22:13.632 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-12T17:22:13.632 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:22:13.632 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:22:13.632 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:22:13.633 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-09-12T17:22:13.633 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:22:13.684 INFO:teuthology.orchestra.run.smithi154.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:22:13.685 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 113 MB of archives. 2024-09-12T17:22:13.685 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:22:13.685 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:22:14.109 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:22:14.145 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:22:14.145 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:22:14.145 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:22:14.203 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:22:14.263 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:22:14.359 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:22:14.770 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 113 MB in 1s (76.0 MB/s) 2024-09-12T17:22:14.955 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:22:15.021 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:22:15.021 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:22:15.021 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:22:15.152 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:22:15.174 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:22:15.646 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 113 MB in 2s (70.4 MB/s) 2024-09-12T17:22:15.831 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:22:16.991 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:22:16.995 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:22:17.345 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:17.920 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:22:17.925 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:22:18.028 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:19.605 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:22:19.627 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:22:19.725 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:20.188 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:22:20.209 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:22:20.290 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:20.367 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:22:20.388 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:22:20.425 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:20.887 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:22:20.908 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:22:20.950 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:27.352 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:22:27.503 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:22:27.878 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:22:27.992 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:22:28.007 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:22:28.120 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:22:28.310 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T17:22:28.333 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T17:22:28.377 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:22:28.469 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:22:28.590 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:22:28.885 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T17:22:28.907 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T17:22:28.960 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:22:34.851 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T17:22:34.888 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:22:34.926 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:34.998 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T17:22:35.035 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:22:35.073 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:37.717 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:22:37.748 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:22:37.842 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:22:37.888 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:22:38.192 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:22:38.255 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:22:38.330 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:38.410 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:38.456 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T17:22:38.536 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T17:22:38.585 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:38.732 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:40.006 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:22:40.006 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T17:22:40.006 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:22:40.006 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T17:22:40.165 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:22:40.165 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T17:22:40.165 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:22:40.165 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T17:22:40.887 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:40.950 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:42.305 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:42.385 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:43.706 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T17:22:43.803 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T17:22:43.832 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T17:22:43.929 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T17:22:43.958 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:44.020 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T17:22:44.020 INFO:teuthology.orchestra.run.smithi154.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:22:44.081 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:22:44.147 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T17:22:44.148 INFO:teuthology.orchestra.run.smithi097.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:22:58.366 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T17:22:58.366 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub' 2024-09-12T17:22:58.397 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:22:58.420 INFO:teuthology.orchestra.run.smithi154.stdout:Generating grub configuration file ... 2024-09-12T17:22:58.608 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T17:22:58.608 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub' 2024-09-12T17:22:58.631 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:22:58.654 INFO:teuthology.orchestra.run.smithi097.stdout:Generating grub configuration file ... 2024-09-12T17:22:58.693 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:22:58.717 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:22:58.974 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:22:59.001 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:22:59.020 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:22:59.026 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:22:59.093 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:22:59.098 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:22:59.266 INFO:teuthology.orchestra.run.smithi154.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:22:59.266 INFO:teuthology.orchestra.run.smithi154.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:22:59.266 INFO:teuthology.orchestra.run.smithi154.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:22:59.304 INFO:teuthology.orchestra.run.smithi154.stdout:done 2024-09-12T17:22:59.360 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:22:59.365 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:22:59.439 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:22:59.444 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:22:59.592 INFO:teuthology.orchestra.run.smithi097.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:22:59.593 INFO:teuthology.orchestra.run.smithi097.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:22:59.593 INFO:teuthology.orchestra.run.smithi097.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:22:59.632 INFO:teuthology.orchestra.run.smithi097.stdout:done 2024-09-12T17:22:59.781 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-09-12T17:22:59.799 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-09-12T17:22:59.799 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-09-12T17:22:59.799 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-09-12T17:22:59.799 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-09-12T17:22:59.799 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-09-12T17:22:59.799 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:22:59.800 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-09-12T17:22:59.800 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-09-12T17:22:59.800 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.119.119 2024-09-12T17:22:59.800 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:22:59.800 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:22:59.800 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-09-12T17:22:59.800 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-09-12T17:22:59.800 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:22:59.800 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-09-12T17:22:59.800 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T17:22:59.801 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:22:59.801 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:22:59.801 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T17:22:59.801 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:22:59.801 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-09-12T17:22:59.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-12T17:23:00.110 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:23:00.135 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-09-12T17:23:00.158 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-09-12T17:23:00.158 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-09-12T17:23:00.158 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-09-12T17:23:00.158 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-09-12T17:23:00.158 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-09-12T17:23:00.158 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:23:00.158 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-09-12T17:23:00.158 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-09-12T17:23:00.158 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.119.119 2024-09-12T17:23:00.158 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:23:00.159 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:23:00.159 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-09-12T17:23:00.159 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-09-12T17:23:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:23:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-09-12T17:23:00.159 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T17:23:00.159 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:23:00.159 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:23:00.159 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T17:23:00.159 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:23:00.160 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-09-12T17:23:00.231 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:23:00.313 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:23:00.347 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-09-12T17:23:00.394 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:23:00.597 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:23:00.597 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:23:00.670 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:23:01.034 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:23:01.226 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 128 kB in 1s (184 kB/s) 2024-09-12T17:23:01.546 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-12T17:23:01.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:23:01.631 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-12T17:23:01.847 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-12T17:23:01.848 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-12T17:23:02.034 INFO:teuthology.orchestra.run.smithi154.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T17:23:02.034 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:23:02.034 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:23:02.035 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:23:02.035 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:23:02.035 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:23:02.035 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:23:02.035 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:23:02.078 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-09-12T17:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-09-12T17:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-09-12T17:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-09-12T17:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-09-12T17:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-09-12T17:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-09-12T17:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-09-12T17:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.119.119 2024-09-12T17:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-09-12T17:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-09-12T17:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-09-12T17:23:02.092 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-12T17:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.O85uK9HmXj 2024-09-12T17:23:02.138 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub/grub.cfg /tmp/tmp.O85uK9HmXj 2024-09-12T17:23:02.193 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.O85uK9HmXj 2024-09-12T17:23:02.243 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T17:23:02.261 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:23:02.312 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.O85uK9HmXj is 10KB 2024-09-12T17:23:02.319 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T17:23:02.325 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.O85uK9HmXj 2024-09-12T17:23:02.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T17:23:02.385 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:23:02.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T17:23:02.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T17:23:02.459 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T17:23:02.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo update-grub 2024-09-12T17:23:02.524 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-12T17:23:02.525 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-12T17:23:02.699 INFO:teuthology.orchestra.run.smithi097.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T17:23:02.699 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:23:02.699 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:23:02.699 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:23:02.700 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:23:02.700 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:23:02.700 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:23:02.700 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:23:02.738 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:23:02.740 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-09-12T17:23:02.754 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-09-12T17:23:02.754 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.119.119 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:23:02.755 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-09-12T17:23:02.756 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-12T17:23:02.804 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.c4I1AXV4pF 2024-09-12T17:23:02.804 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub/grub.cfg /tmp/tmp.c4I1AXV4pF 2024-09-12T17:23:02.872 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.c4I1AXV4pF 2024-09-12T17:23:02.995 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.c4I1AXV4pF is 10KB 2024-09-12T17:23:03.046 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.c4I1AXV4pF 2024-09-12T17:23:03.051 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T17:23:03.104 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:23:03.104 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T17:23:03.104 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T17:23:03.181 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T17:23:03.182 DEBUG:teuthology.orchestra.run.smithi097:> sudo update-grub 2024-09-12T17:23:03.763 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2024-09-12T17:23:03.764 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:23:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-09-12T17:23:03.945 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:23:03.951 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:23:04.223 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:23:04.228 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:23:04.268 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:23:04.273 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:23:04.412 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:23:04.412 INFO:teuthology.orchestra.run.smithi154.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:23:04.412 INFO:teuthology.orchestra.run.smithi154.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:23:04.423 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-09-12T17:23:04.439 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-09-12T17:23:04.690 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2024-09-12T17:23:04.691 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:23:04.694 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2024-09-12T17:23:04.957 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:23:04.963 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:23:05.224 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:23:05.229 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:23:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:23:05.277 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:23:05.394 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:23:05.394 INFO:teuthology.orchestra.run.smithi097.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:23:05.395 INFO:teuthology.orchestra.run.smithi097.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:23:05.407 INFO:teuthology.orchestra.run.smithi097.stderr:done 2024-09-12T17:23:05.409 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2024-09-12T17:23:34.471 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T17:23:34.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-12T17:23:34.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:23:35.455 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T17:23:35.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T17:23:35.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:23:53.025 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-12T17:23:53.789 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-09-12T17:24:02.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-12T17:24:02.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:24:02.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T17:24:02.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:24:05.085 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-12T17:24:05.853 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-09-12T17:24:17.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-12T17:24:17.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:24:17.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T17:24:17.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:24:36.289 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-09-12T17:24:51.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T17:24:51.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:24:51.810 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-12T17:24:52.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T17:24:52.614 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T17:24:52.614 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-12T17:24:52.661 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-119-generic 2024-09-12T17:24:52.661 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:24:52.661 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:24:52.662 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:24:53.662 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T17:24:53.663 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:24:54.073 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2024-09-12T17:24:54.115 DEBUG:teuthology.parallel:result is None 2024-09-12T17:25:17.101 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:25:32.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-12T17:25:32.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:25:32.408 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-12T17:25:32.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-12T17:25:32.997 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T17:25:32.997 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-12T17:25:33.043 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-119-generic 2024-09-12T17:25:33.043 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:25:33.043 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:25:33.043 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:25:34.044 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T17:25:34.044 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:25:34.133 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-09-12T17:25:34.152 DEBUG:teuthology.parallel:result is None 2024-09-12T17:25:34.153 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T17:25:34.161 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T17:25:34.161 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:25:34.164 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:25:34.169 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T17:25:34.205 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T17:25:34.255 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T17:25:34.255 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:25:34.258 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:25:34.276 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T17:25:34.305 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T17:25:34.305 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:25:34.314 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:25:34.329 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:25:34.337 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:25:34.344 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:25:34.354 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:25:34.355 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T17:25:34.362 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T17:25:34.362 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:25:34.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:25:34.410 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T17:25:34.419 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T17:25:34.419 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:25:34.458 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:25:34.464 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:25:34.509 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:25:34.557 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:25:34.557 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:25:34.616 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:25:34.621 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:25:34.667 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:25:34.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:25:34.746 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2024-09-12T17:25:34.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-12T17:25:34.827 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T17:25:34.834 INFO:teuthology.task.internal:Starting timer... 2024-09-12T17:25:34.835 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T17:25:34.878 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T17:25:34.925 DEBUG:teuthology.task.selinux:Excluding smithi097: OS 'ubuntu' does not support SELinux 2024-09-12T17:25:34.925 DEBUG:teuthology.task.selinux:Excluding smithi154: OS 'ubuntu' does not support SELinux 2024-09-12T17:25:34.925 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T17:25:34.925 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T17:25:34.926 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T17:25:34.926 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T17:25:34.974 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T17:25:34.988 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T17:25:34.989 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi097.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:33:02.724 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-09-12T17:33:02.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T17:33:02.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:33:02.819 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-12T17:33:02.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T17:33:02.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-12T17:33:02.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:33:02.983 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-12T17:33:03.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-12T17:33:03.065 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:33:03.076 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:33:03.076 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:33:03.077 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:33:03.079 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:33:03.080 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:33:03.106 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:33:03.106 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: Command line: ntpd -gq 2024-09-12T17:33:03.106 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: ---------------------------------------------------- 2024-09-12T17:33:03.106 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:33:03.106 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:33:03.106 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: corporation. Support and training for ntp-4 are 2024-09-12T17:33:03.106 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: available at https://www.nwtime.org/support 2024-09-12T17:33:03.106 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: ---------------------------------------------------- 2024-09-12T17:33:03.107 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: proto: precision = 0.065 usec (-24) 2024-09-12T17:33:03.107 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: basedate set to 2022-02-04 2024-09-12T17:33:03.107 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:33:03.107 INFO:teuthology.orchestra.run.smithi097.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:33:03.108 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:33:03.108 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:33:03.108 INFO:teuthology.orchestra.run.smithi097.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:33:03.109 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:33:03.109 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:33:03.110 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:33:03.110 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: Listen normally on 3 enp3s0f1 172.21.15.97:123 2024-09-12T17:33:03.110 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: Listen normally on 4 lo [::1]:123 2024-09-12T17:33:03.110 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d805%5]:123 2024-09-12T17:33:03.110 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:03 ntpd[18465]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:33:03.137 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:33:03.137 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: Command line: ntpd -gq 2024-09-12T17:33:03.137 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: ---------------------------------------------------- 2024-09-12T17:33:03.138 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:33:03.138 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:33:03.138 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: corporation. Support and training for ntp-4 are 2024-09-12T17:33:03.138 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: available at https://www.nwtime.org/support 2024-09-12T17:33:03.138 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: ---------------------------------------------------- 2024-09-12T17:33:03.138 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: proto: precision = 0.074 usec (-24) 2024-09-12T17:33:03.138 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: basedate set to 2022-02-04 2024-09-12T17:33:03.138 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:33:03.139 INFO:teuthology.orchestra.run.smithi154.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:33:03.139 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:33:03.139 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:33:03.139 INFO:teuthology.orchestra.run.smithi154.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:33:03.140 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:33:03.140 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:33:03.140 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:33:03.141 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: Listen normally on 3 enp3s0f1 172.21.15.154:123 2024-09-12T17:33:03.141 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: Listen normally on 4 lo [::1]:123 2024-09-12T17:33:03.141 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7761%5]:123 2024-09-12T17:33:03.141 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:03 ntpd[18488]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:33:04.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:04.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:04.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:04.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:04.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:04.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:04.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:04.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:04.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:04.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:04.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:04.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:04 ntpd[18488]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:05.137 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:05 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:05.137 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:05 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:06.106 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:06 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:06.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:06 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:06.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:06 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:06.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:06 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:06.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:06 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:06.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:06 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:06.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:06.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:06.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:06.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:06.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:06.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:06 ntpd[18488]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:07.106 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:07 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:07.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:07 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:07.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:07 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:07.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:07 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:07.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:07 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:07.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:07 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:07.137 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:07 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:07.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:07 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:07.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:07 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:07.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:07 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:07.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:07 ntpd[18488]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:07.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:07 ntpd[18488]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:08.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:08.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:08.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:08.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:08.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:08.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:08.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:08.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:08.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:08.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:08.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:08.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:08.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:08.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:08 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:08.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:08.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:08.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:08.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:08.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:08.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:08.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:08.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:08.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:08.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:08.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:08.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:08 ntpd[18488]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:09.106 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:09 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:09.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:09 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:09.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:09 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:09.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:09 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:09.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:09 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:09.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:09 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:09.137 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:09 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:09.137 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:09 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:09.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:09 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:09.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:09 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:09.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:09 ntpd[18488]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:09.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:09 ntpd[18488]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:10.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:10.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:10 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:10 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:10 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:10 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:10 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:10 ntpd[18488]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:10 ntpd[18488]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:10 ntpd[18488]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:10 ntpd[18488]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:10.139 INFO:teuthology.orchestra.run.smithi154.stdout:12 Sep 17:33:10 ntpd[18488]: ntpd: time slew -0.004446 s 2024-09-12T17:33:10.139 INFO:teuthology.orchestra.run.smithi154.stdout:ntpd: time slew -0.004446s 2024-09-12T17:33:10.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:10 ntpd[18488]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:33:10.139 INFO:teuthology.orchestra.run.smithi154.stderr:12 Sep 17:33:10 ntpd[18488]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:33:10.192 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:33:10.192 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-09-12T17:33:10.192 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:33:10.192 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:33:10.192 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:33:10.192 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:33:11.106 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:11 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:11.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:11 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:11.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:11 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:11.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:11 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:11.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:11 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:11.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:11 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:12.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:12 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:12.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:12 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:12.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:12 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:12.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:12 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:12.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:12 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:33:12.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:12 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:33:12.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:12 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:33:12.107 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:12 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:33:12.108 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 17:33:12 ntpd[18465]: ntpd: time slew +0.000422 s 2024-09-12T17:33:12.108 INFO:teuthology.orchestra.run.smithi097.stdout:ntpd: time slew +0.000422s 2024-09-12T17:33:12.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:12 ntpd[18465]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:33:12.108 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 17:33:12 ntpd[18465]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:33:12.162 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:33:12.162 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-09-12T17:33:12.163 INFO:teuthology.orchestra.run.smithi097.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:33:12.163 INFO:teuthology.orchestra.run.smithi097.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:33:12.163 INFO:teuthology.orchestra.run.smithi097.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:33:12.163 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:33:12.163 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:33:12.172 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:33:12.172 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:33:12.172 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:33:12.172 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:33:12.180 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:33:12.180 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:33:12.180 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-key list | grep Ceph 2024-09-12T17:33:12.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-key list | grep Ceph 2024-09-12T17:33:12.244 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:33:12.264 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:33:12.272 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:33:12.273 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:33:12.273 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:33:12.273 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T17:33:12.274 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:33:12.292 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:33:12.292 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:33:12.293 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:33:12.293 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T17:33:12.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:33:12.413 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:33:12.413 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:33:12.435 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:33:12.435 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:33:12.527 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:33:12.527 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:33:12.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-12T17:33:12.547 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:33:12.547 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:33:12.561 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-09-12T17:33:12.705 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:33:12.716 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:33:12.727 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:33:12.728 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:33:12.733 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:33:12.738 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:33:12.755 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:33:12.761 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:33:12.782 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:33:12.784 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:33:12.803 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:33:12.805 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:33:12.825 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:33:12.826 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:33:12.832 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:33:12.846 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:33:12.853 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:33:12.873 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:33:13.044 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 28.6 kB in 0s (86.8 kB/s) 2024-09-12T17:33:13.071 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 28.6 kB in 0s (87.0 kB/s) 2024-09-12T17:33:14.027 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-12T17:33:14.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:33:14.073 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T17:33:14.088 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:33:14.108 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-12T17:33:14.152 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T17:33:14.327 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-12T17:33:14.328 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-12T17:33:14.356 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-12T17:33:14.357 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-12T17:33:14.530 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:33:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:33:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:33:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:33:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:33:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:33:14.532 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:33:14.532 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-12T17:33:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:33:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:33:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:33:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:33:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:33:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:33:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:33:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:33:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:33:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:33:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:33:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:33:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:33:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:33:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:33:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:33:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:33:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:33:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:33:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:33:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:33:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:33:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:33:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet zip 2024-09-12T17:33:14.536 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-12T17:33:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:33:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:33:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:33:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:33:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:33:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:33:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:33:14.537 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-09-12T17:33:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: btrfs-tools 2024-09-12T17:33:14.562 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:33:14.562 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:33:14.562 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:33:14.562 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:33:14.562 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:33:14.564 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:33:14.564 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:33:14.564 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-09-12T17:33:14.564 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:33:14.565 INFO:teuthology.orchestra.run.smithi097.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:33:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:33:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:33:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:33:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:33:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:33:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:33:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:33:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:33:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:33:14.566 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet zip 2024-09-12T17:33:14.567 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-09-12T17:33:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:33:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:33:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:33:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:33:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:33:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:33:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:33:14.567 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-09-12T17:33:14.567 INFO:teuthology.orchestra.run.smithi097.stdout: btrfs-tools 2024-09-12T17:33:14.639 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-12T17:33:14.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:33:14.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:33:14.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:33:14.640 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:33:14.640 INFO:teuthology.orchestra.run.smithi154.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:33:14.640 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:33:14.641 INFO:teuthology.orchestra.run.smithi154.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:33:14.641 INFO:teuthology.orchestra.run.smithi154.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:33:14.641 INFO:teuthology.orchestra.run.smithi154.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:33:14.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:33:14.643 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:33:14.643 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:33:14.643 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:33:14.643 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:33:14.643 INFO:teuthology.orchestra.run.smithi154.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:33:14.671 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-09-12T17:33:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:33:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:33:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:33:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:33:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:33:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:33:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:33:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:33:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:33:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:33:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:33:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:33:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:33:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:33:14.783 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:33:14.783 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 243 MB of archives. 2024-09-12T17:33:14.783 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:33:14.783 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:33:14.814 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:33:14.815 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 243 MB of archives. 2024-09-12T17:33:14.815 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:33:14.815 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:33:14.828 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:33:14.860 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:33:14.973 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:33:15.042 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:33:15.053 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:33:15.058 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:33:15.058 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:33:15.061 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:33:15.061 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:33:15.062 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:33:15.092 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:33:15.199 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:33:15.213 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:33:15.221 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:33:15.222 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:33:15.226 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:33:15.227 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:33:15.251 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:33:15.263 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:33:15.270 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:33:15.283 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:33:15.296 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:33:15.309 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:33:15.311 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:33:15.320 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:33:15.344 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:33:15.377 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:33:15.572 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:33:15.583 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:33:15.590 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:33:15.593 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:33:15.600 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:33:15.606 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:33:15.613 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:33:15.617 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:33:15.621 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:33:15.622 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:33:15.623 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:33:15.641 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:33:15.645 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:33:15.646 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:33:15.650 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:33:15.654 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:33:15.655 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:33:15.656 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:33:15.657 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:33:15.675 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:33:15.680 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:33:15.684 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:33:15.688 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:33:15.735 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:33:15.738 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:33:15.743 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:33:15.746 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:33:15.747 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:33:15.748 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:33:15.750 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:33:15.750 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:33:15.751 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:33:15.768 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:33:15.772 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:33:15.776 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:33:15.780 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:33:15.781 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:33:15.781 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:33:15.784 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:33:15.784 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:33:15.785 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:33:15.816 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:33:15.834 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:33:15.834 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:33:15.835 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:33:15.840 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:33:15.841 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:33:15.842 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:33:15.851 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:33:15.867 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:33:15.868 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:33:15.869 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:33:15.873 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:33:15.874 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:33:15.900 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:33:15.901 INFO:teuthology.orchestra.run.smithi154.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:33:15.933 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:33:15.933 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:33:15.935 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:33:15.936 INFO:teuthology.orchestra.run.smithi097.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:33:15.979 INFO:teuthology.orchestra.run.smithi154.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:33:15.981 INFO:teuthology.orchestra.run.smithi154.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:33:15.982 INFO:teuthology.orchestra.run.smithi154.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:33:15.983 INFO:teuthology.orchestra.run.smithi154.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:33:15.994 INFO:teuthology.orchestra.run.smithi154.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:33:15.994 INFO:teuthology.orchestra.run.smithi154.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:33:16.013 INFO:teuthology.orchestra.run.smithi097.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:33:16.015 INFO:teuthology.orchestra.run.smithi097.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:33:16.017 INFO:teuthology.orchestra.run.smithi097.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:33:16.018 INFO:teuthology.orchestra.run.smithi097.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:33:16.029 INFO:teuthology.orchestra.run.smithi097.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:33:16.060 INFO:teuthology.orchestra.run.smithi154.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:33:16.064 INFO:teuthology.orchestra.run.smithi154.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:33:16.064 INFO:teuthology.orchestra.run.smithi154.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:33:16.067 INFO:teuthology.orchestra.run.smithi154.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:33:16.095 INFO:teuthology.orchestra.run.smithi097.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:33:16.095 INFO:teuthology.orchestra.run.smithi097.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:33:16.096 INFO:teuthology.orchestra.run.smithi097.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:33:16.099 INFO:teuthology.orchestra.run.smithi097.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:33:16.103 INFO:teuthology.orchestra.run.smithi097.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:33:16.141 INFO:teuthology.orchestra.run.smithi154.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:33:16.143 INFO:teuthology.orchestra.run.smithi154.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:33:16.145 INFO:teuthology.orchestra.run.smithi154.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:33:16.150 INFO:teuthology.orchestra.run.smithi154.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:33:16.150 INFO:teuthology.orchestra.run.smithi154.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:33:16.152 INFO:teuthology.orchestra.run.smithi154.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:33:16.176 INFO:teuthology.orchestra.run.smithi097.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:33:16.178 INFO:teuthology.orchestra.run.smithi097.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:33:16.180 INFO:teuthology.orchestra.run.smithi097.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:33:16.184 INFO:teuthology.orchestra.run.smithi097.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:33:16.186 INFO:teuthology.orchestra.run.smithi097.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:33:16.222 INFO:teuthology.orchestra.run.smithi154.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:33:16.257 INFO:teuthology.orchestra.run.smithi097.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:33:16.262 INFO:teuthology.orchestra.run.smithi097.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:33:16.325 INFO:teuthology.orchestra.run.smithi154.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:33:16.340 INFO:teuthology.orchestra.run.smithi154.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:33:16.386 INFO:teuthology.orchestra.run.smithi154.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:33:16.389 INFO:teuthology.orchestra.run.smithi154.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:33:16.389 INFO:teuthology.orchestra.run.smithi154.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:33:16.391 INFO:teuthology.orchestra.run.smithi154.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:33:16.405 INFO:teuthology.orchestra.run.smithi154.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:33:16.407 INFO:teuthology.orchestra.run.smithi154.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:33:16.413 INFO:teuthology.orchestra.run.smithi154.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:33:16.424 INFO:teuthology.orchestra.run.smithi097.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:33:16.426 INFO:teuthology.orchestra.run.smithi097.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:33:16.428 INFO:teuthology.orchestra.run.smithi154.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:33:16.429 INFO:teuthology.orchestra.run.smithi097.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:33:16.429 INFO:teuthology.orchestra.run.smithi097.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:33:16.431 INFO:teuthology.orchestra.run.smithi154.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:33:16.431 INFO:teuthology.orchestra.run.smithi097.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:33:16.432 INFO:teuthology.orchestra.run.smithi154.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:33:16.462 INFO:teuthology.orchestra.run.smithi154.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:33:16.468 INFO:teuthology.orchestra.run.smithi097.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:33:16.472 INFO:teuthology.orchestra.run.smithi097.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:33:16.472 INFO:teuthology.orchestra.run.smithi097.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:33:16.488 INFO:teuthology.orchestra.run.smithi154.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:33:16.488 INFO:teuthology.orchestra.run.smithi154.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:33:16.547 INFO:teuthology.orchestra.run.smithi154.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:33:16.548 INFO:teuthology.orchestra.run.smithi154.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:33:16.548 INFO:teuthology.orchestra.run.smithi154.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:33:16.550 INFO:teuthology.orchestra.run.smithi154.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:33:16.550 INFO:teuthology.orchestra.run.smithi154.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:33:16.551 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:33:16.555 INFO:teuthology.orchestra.run.smithi097.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:33:16.556 INFO:teuthology.orchestra.run.smithi097.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:33:16.558 INFO:teuthology.orchestra.run.smithi154.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:33:16.592 INFO:teuthology.orchestra.run.smithi097.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:33:16.628 INFO:teuthology.orchestra.run.smithi154.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:33:16.631 INFO:teuthology.orchestra.run.smithi154.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:33:16.632 INFO:teuthology.orchestra.run.smithi154.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:33:16.632 INFO:teuthology.orchestra.run.smithi154.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:33:16.645 INFO:teuthology.orchestra.run.smithi097.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:33:16.646 INFO:teuthology.orchestra.run.smithi097.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:33:16.646 INFO:teuthology.orchestra.run.smithi097.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:33:16.647 INFO:teuthology.orchestra.run.smithi097.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:33:16.648 INFO:teuthology.orchestra.run.smithi097.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:33:16.649 INFO:teuthology.orchestra.run.smithi097.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:33:16.658 INFO:teuthology.orchestra.run.smithi097.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:33:16.673 INFO:teuthology.orchestra.run.smithi097.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:33:16.676 INFO:teuthology.orchestra.run.smithi097.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:33:16.677 INFO:teuthology.orchestra.run.smithi097.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:33:16.709 INFO:teuthology.orchestra.run.smithi154.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:33:16.716 INFO:teuthology.orchestra.run.smithi154.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:33:16.718 INFO:teuthology.orchestra.run.smithi154.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:33:16.719 INFO:teuthology.orchestra.run.smithi154.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:33:16.730 INFO:teuthology.orchestra.run.smithi154.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:33:16.731 INFO:teuthology.orchestra.run.smithi154.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:33:16.732 INFO:teuthology.orchestra.run.smithi097.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:33:16.735 INFO:teuthology.orchestra.run.smithi097.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:33:16.739 INFO:teuthology.orchestra.run.smithi154.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:33:16.742 INFO:teuthology.orchestra.run.smithi097.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:33:16.754 INFO:teuthology.orchestra.run.smithi097.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:33:16.760 INFO:teuthology.orchestra.run.smithi097.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:33:16.762 INFO:teuthology.orchestra.run.smithi097.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:33:16.764 INFO:teuthology.orchestra.run.smithi097.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:33:16.775 INFO:teuthology.orchestra.run.smithi097.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:33:16.776 INFO:teuthology.orchestra.run.smithi097.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:33:16.784 INFO:teuthology.orchestra.run.smithi097.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:33:16.791 INFO:teuthology.orchestra.run.smithi154.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:33:16.792 INFO:teuthology.orchestra.run.smithi154.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:33:16.793 INFO:teuthology.orchestra.run.smithi154.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:33:16.794 INFO:teuthology.orchestra.run.smithi097.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:33:16.836 INFO:teuthology.orchestra.run.smithi097.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:33:16.837 INFO:teuthology.orchestra.run.smithi097.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:33:16.838 INFO:teuthology.orchestra.run.smithi097.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:33:16.872 INFO:teuthology.orchestra.run.smithi154.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:33:16.873 INFO:teuthology.orchestra.run.smithi154.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:33:16.891 INFO:teuthology.orchestra.run.smithi154.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:33:16.892 INFO:teuthology.orchestra.run.smithi154.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:33:16.892 INFO:teuthology.orchestra.run.smithi154.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:33:16.897 INFO:teuthology.orchestra.run.smithi154.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:33:16.899 INFO:teuthology.orchestra.run.smithi154.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:33:16.917 INFO:teuthology.orchestra.run.smithi097.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:33:16.919 INFO:teuthology.orchestra.run.smithi097.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:33:16.936 INFO:teuthology.orchestra.run.smithi097.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:33:16.936 INFO:teuthology.orchestra.run.smithi097.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:33:16.937 INFO:teuthology.orchestra.run.smithi097.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:33:16.942 INFO:teuthology.orchestra.run.smithi097.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:33:16.944 INFO:teuthology.orchestra.run.smithi097.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:33:17.026 INFO:teuthology.orchestra.run.smithi097.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:33:17.397 INFO:teuthology.orchestra.run.smithi154.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:33:17.398 INFO:teuthology.orchestra.run.smithi154.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:33:17.415 INFO:teuthology.orchestra.run.smithi154.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:33:17.455 INFO:teuthology.orchestra.run.smithi154.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:33:17.470 INFO:teuthology.orchestra.run.smithi154.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:33:17.473 INFO:teuthology.orchestra.run.smithi154.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:33:17.936 INFO:teuthology.orchestra.run.smithi097.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:33:17.936 INFO:teuthology.orchestra.run.smithi097.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:33:17.953 INFO:teuthology.orchestra.run.smithi097.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:33:17.996 INFO:teuthology.orchestra.run.smithi097.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:33:18.018 INFO:teuthology.orchestra.run.smithi097.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:33:18.020 INFO:teuthology.orchestra.run.smithi097.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:33:19.558 INFO:teuthology.orchestra.run.smithi154.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:33:19.740 INFO:teuthology.orchestra.run.smithi154.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:33:19.748 INFO:teuthology.orchestra.run.smithi154.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:33:20.273 INFO:teuthology.orchestra.run.smithi097.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:33:20.500 INFO:teuthology.orchestra.run.smithi097.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:33:20.501 INFO:teuthology.orchestra.run.smithi097.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:33:21.345 INFO:teuthology.orchestra.run.smithi154.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:33:21.351 INFO:teuthology.orchestra.run.smithi154.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:33:21.354 INFO:teuthology.orchestra.run.smithi154.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:33:21.840 INFO:teuthology.orchestra.run.smithi154.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:33:22.069 INFO:teuthology.orchestra.run.smithi097.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:33:22.071 INFO:teuthology.orchestra.run.smithi097.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:33:22.072 INFO:teuthology.orchestra.run.smithi097.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:33:22.376 INFO:teuthology.orchestra.run.smithi097.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:33:22.426 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 243 MB in 7s (33.9 MB/s) 2024-09-12T17:33:22.628 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:33:22.730 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:33:22.735 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:33:22.843 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 243 MB in 8s (31.6 MB/s) 2024-09-12T17:33:23.082 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:33:23.179 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:33:23.185 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:33:23.205 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:33:23.231 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:33:23.272 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:33:23.305 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:33:23.584 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:33:23.611 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:33:23.651 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:33:23.708 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:33:23.734 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:33:23.783 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:33:23.954 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:33:23.980 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:33:24.020 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:33:24.254 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:33:24.280 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:33:24.328 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:33:24.415 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:33:24.444 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:33:24.490 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:33:24.732 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:33:24.758 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:33:24.798 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:33:24.910 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:33:24.937 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:33:24.977 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:33:25.126 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:33:25.152 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:33:25.184 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:33:25.329 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:33:25.356 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:33:25.396 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:33:25.530 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:33:25.556 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:33:25.596 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:33:25.741 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:33:25.958 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librados2. 2024-09-12T17:33:25.958 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:25.958 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:33:25.958 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:33:25.974 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:26.093 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librados2. 2024-09-12T17:33:26.108 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:26.152 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:26.427 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:33:26.453 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:26.502 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:26.546 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:33:26.573 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:26.604 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:26.996 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:33:27.022 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:27.032 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:33:27.058 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:27.063 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:27.098 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:27.340 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:33:27.355 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:27.367 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:33:27.382 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:27.407 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:27.417 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:27.726 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:33:27.737 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:33:27.753 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:33:27.763 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:33:27.793 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:27.803 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:28.046 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:33:28.055 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:33:28.061 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:28.074 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:28.096 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:28.139 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:28.398 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:33:28.425 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:33:28.450 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:33:28.465 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:28.476 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:33:28.517 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:28.793 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:33:28.819 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:33:28.836 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:33:28.860 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:33:28.862 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:33:28.903 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:33:29.180 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:33:29.197 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:33:29.206 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:33:29.224 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:33:29.246 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:33:29.264 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:33:29.465 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:33:29.480 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:29.491 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:33:29.515 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:29.517 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:29.843 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:33:29.869 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:33:29.902 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:33:29.909 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:33:29.929 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:33:29.969 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:33:30.196 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:33:30.222 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:33:30.238 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:33:30.262 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:33:30.264 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:33:30.304 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:33:30.565 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:33:30.580 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:33:30.599 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:33:30.623 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:33:30.625 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:33:30.665 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:33:30.893 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:33:30.920 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:33:30.960 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:33:30.969 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:33:30.995 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:33:31.035 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:33:31.388 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:33:31.405 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:33:31.455 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:33:31.563 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:33:31.590 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:33:31.630 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:33:31.760 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package zip. 2024-09-12T17:33:31.787 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:33:31.882 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package zip. 2024-09-12T17:33:31.897 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:33:31.933 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:33:31.941 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:33:32.211 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package unzip. 2024-09-12T17:33:32.212 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package unzip. 2024-09-12T17:33:32.226 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:33:32.242 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:33:32.265 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:33:32.271 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:33:32.653 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:33:32.656 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:33:32.675 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:33:32.682 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:33:32.715 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:33:32.723 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:33:33.064 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:33:33.091 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:33.122 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:33.130 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:33:33.157 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:33.213 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:33.725 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:33:33.740 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:33.783 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:33.799 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:33:33.814 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:33.857 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:34.128 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:33:34.154 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:33:34.169 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:33:34.194 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:33:34.195 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:33:34.235 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:33:34.481 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:33:34.505 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:33:34.507 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:34.531 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:34.547 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:34.571 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:34.943 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:33:34.969 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:34.991 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:33:35.012 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:35.017 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:35.057 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:36.582 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:33:36.608 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:36.657 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:36.788 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:33:36.814 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:36.864 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:37.210 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:33:37.236 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:33:37.277 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:33:37.467 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:33:37.493 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:33:37.533 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:33:37.563 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:33:37.589 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:33:37.629 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:33:37.844 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:33:37.871 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:33:37.911 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:33:37.941 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:33:37.967 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:33:38.008 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:33:38.189 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:33:38.204 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:33:38.239 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:33:38.310 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:33:38.337 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:33:38.377 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:33:38.525 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:33:38.551 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:33:38.591 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:33:38.655 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:33:38.670 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:33:38.705 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:33:38.886 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:33:38.912 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:33:38.952 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:33:38.983 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:33:39.009 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:33:39.049 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:33:39.213 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:33:39.229 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:33:39.263 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:33:39.372 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:33:39.395 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:33:39.444 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:33:39.566 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:33:39.592 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:33:39.633 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:33:39.705 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:33:39.732 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:33:39.772 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:33:39.944 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:33:39.970 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:33:40.010 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:33:40.075 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:33:40.101 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:33:40.141 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:33:40.280 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:33:40.295 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:33:40.330 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:33:40.495 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:33:40.521 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:33:40.561 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:33:40.650 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:33:40.665 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:33:40.700 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:33:40.840 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:33:40.855 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:33:40.889 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:33:40.986 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:33:41.013 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:33:41.053 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:33:41.176 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:33:41.202 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:33:41.242 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:33:41.355 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:33:41.382 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:33:41.422 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:33:41.554 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:33:41.580 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:33:41.620 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:33:41.725 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:33:41.751 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:33:41.791 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:33:42.102 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:33:42.118 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:33:42.123 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:33:42.150 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:33:42.152 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:33:42.190 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:33:42.397 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:33:42.412 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:33:42.449 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:33:42.459 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:33:42.475 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:33:42.509 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:33:42.733 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:33:42.759 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:33:42.799 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:33:42.821 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:33:42.847 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:33:42.887 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:33:43.169 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:33:43.196 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:33:43.239 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:33:43.240 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:33:43.267 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:33:43.310 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:33:43.514 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:33:43.540 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:33:43.572 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:33:43.610 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:33:43.636 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:33:43.676 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:33:43.841 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:33:43.868 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:33:43.899 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:33:43.979 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:33:44.006 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:33:44.046 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:33:44.219 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:33:44.246 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:33:44.286 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:33:44.357 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:33:44.373 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:33:44.416 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:33:44.547 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:33:44.562 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:33:44.597 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:33:44.718 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:33:44.745 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:33:44.777 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:33:44.883 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:33:44.909 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:33:44.949 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:33:45.072 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:33:45.098 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:33:45.138 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:33:45.219 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:33:45.245 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:33:45.286 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:33:45.449 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:33:45.476 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:33:45.516 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:33:45.615 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:33:45.642 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:33:45.681 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:33:45.881 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:33:45.908 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:33:45.948 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:33:46.001 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:33:46.028 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:33:46.067 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:33:46.379 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:33:46.405 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:33:46.445 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:33:46.774 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:33:46.800 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:33:46.840 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:33:47.018 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:33:47.045 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:33:47.085 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:33:47.151 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:33:47.178 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:33:47.217 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:33:47.396 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:33:47.422 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:33:47.462 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:33:47.506 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:33:47.521 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:33:47.556 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:47.799 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:33:47.825 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:33:47.866 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:33:47.910 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:33:47.937 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:47.977 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:48.202 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:33:48.228 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:33:48.268 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:33:48.571 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:33:48.589 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:33:48.638 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:49.010 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:33:49.022 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:33:49.036 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:49.049 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:33:49.076 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:49.088 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:33:49.350 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:33:49.376 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:33:49.379 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:33:49.405 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:33:49.416 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:33:49.445 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:33:49.732 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:33:49.752 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:33:49.758 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:33:49.779 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:49.798 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:33:49.819 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:50.110 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:33:50.136 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:50.168 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:50.222 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:33:50.249 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:50.280 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:50.504 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:33:50.531 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:50.571 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:50.833 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:33:50.860 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:50.900 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:51.175 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:33:51.201 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:51.241 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:52.128 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph. 2024-09-12T17:33:52.154 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:52.195 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:52.336 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph. 2024-09-12T17:33:52.351 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:52.394 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:52.506 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:33:52.533 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:52.572 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:52.655 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:33:52.670 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:52.722 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:52.867 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:33:52.882 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:52.925 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:53.083 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:33:53.110 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:53.150 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:53.345 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:33:53.371 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:53.411 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:53.544 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:33:53.571 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:33:53.611 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:53.722 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:33:53.749 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:33:53.789 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:33:53.930 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:33:53.957 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:33:53.997 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:33:54.100 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:33:54.127 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:33:54.158 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:33:54.299 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:33:54.315 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:33:54.358 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:33:55.146 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:33:55.173 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:33:55.212 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:33:55.321 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:33:55.348 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:33:55.387 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:33:55.532 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:33:55.559 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:33:55.599 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:33:55.707 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:33:55.734 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:33:55.774 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:33:55.926 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:33:55.942 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:33:55.985 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:56.102 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:33:56.129 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:33:56.168 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:56.313 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:33:56.340 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:33:56.379 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:33:56.547 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:33:56.574 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:33:56.613 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:33:56.691 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:33:56.718 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:33:56.757 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:33:56.875 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:33:56.901 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:33:56.932 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:33:57.094 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:33:57.121 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:33:57.160 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:57.286 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:33:57.313 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:33:57.511 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:33:59.748 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:33:59.778 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:33:59.822 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:34:00.141 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:34:00.158 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:34:00.200 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:34:00.303 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:34:00.329 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:34:00.368 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:34:00.677 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:34:00.693 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:34:00.704 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:34:00.727 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:34:00.731 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:34:00.770 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:34:01.065 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:34:01.090 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:34:01.092 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:34:01.117 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:34:01.131 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:34:01.156 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:34:01.458 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:34:01.486 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:34:01.525 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:34:01.798 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:34:01.826 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:34:01.950 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:02.167 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:34:02.195 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:34:02.319 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:03.012 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:34:03.040 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:34:03.078 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:34:03.256 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:34:03.284 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:34:03.323 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:34:03.381 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:34:03.409 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:34:03.448 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:34:03.626 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:34:03.653 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:34:03.692 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:34:03.784 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:34:03.812 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:34:03.851 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:34:04.012 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:34:04.040 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:34:04.078 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:34:04.162 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:34:04.189 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:34:04.228 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:34:04.390 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:34:04.406 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:34:04.448 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:34:04.524 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:34:04.552 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:34:04.590 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:34:04.760 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:34:04.788 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:34:04.827 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:34:04.877 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:34:04.894 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:34:04.927 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:34:05.142 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:34:05.171 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:34:05.206 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:34:05.207 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:34:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:34:05.280 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:34:05.525 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:34:05.553 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:34:05.591 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:34:05.592 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:34:05.619 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:34:05.657 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:34:05.894 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:34:05.922 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:34:05.961 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:34:06.304 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:34:06.332 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:34:06.370 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:06.625 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:34:06.641 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:34:06.666 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:34:06.683 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:06.693 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:34:06.732 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:34:07.002 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:34:07.031 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:34:07.035 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:34:07.063 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:34:07.069 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:34:07.101 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:34:07.337 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package jq. 2024-09-12T17:34:07.365 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:34:07.381 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:34:07.403 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:34:07.409 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:34:07.439 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:34:07.815 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package socat. 2024-09-12T17:34:07.831 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:34:07.873 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:34:07.958 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package jq. 2024-09-12T17:34:07.986 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:34:08.025 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:34:08.167 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:34:08.195 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:34:08.236 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:34:08.277 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package socat. 2024-09-12T17:34:08.305 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:34:08.344 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:34:08.596 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:34:08.612 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:34:08.648 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:08.673 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:34:08.700 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:34:08.747 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:34:09.077 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:34:09.105 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:34:09.143 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:10.884 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:34:10.912 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:34:10.950 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:11.212 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:34:11.241 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:34:11.279 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:11.389 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:34:11.418 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:34:11.455 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:11.598 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:34:11.627 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:34:11.665 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:34:11.726 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:34:11.743 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:34:11.784 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:12.019 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:34:12.047 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:34:12.086 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:34:12.087 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:34:12.115 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:34:12.153 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:34:12.406 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:34:12.435 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:34:12.464 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:34:12.475 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:34:12.503 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:34:12.541 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:34:12.861 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:34:12.889 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:34:12.927 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:34:12.970 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:34:12.996 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:34:13.028 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:34:13.189 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:34:13.217 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:34:13.255 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:34:13.451 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:34:13.479 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:34:13.517 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:34:13.667 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:34:13.695 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:34:13.733 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:34:13.778 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:34:13.794 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:34:13.836 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:34:14.036 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:34:14.064 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:34:14.102 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:34:14.248 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:34:14.276 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:34:14.314 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:34:14.422 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:34:14.451 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:34:14.489 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:34:14.584 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:34:14.601 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:34:14.633 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:34:14.775 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:34:14.803 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:34:14.833 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:34:14.945 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:34:14.974 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:34:15.003 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:34:15.204 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:34:15.231 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:34:15.269 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:34:15.323 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:34:15.352 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:34:15.390 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:34:15.555 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:34:15.571 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:34:15.614 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:34:15.676 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:34:15.692 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:34:15.734 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:34:16.038 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:34:16.059 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:34:16.066 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:34:16.088 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:34:16.104 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:34:16.126 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:34:16.428 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:34:16.457 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:34:16.495 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:34:16.558 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:34:16.587 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:34:16.625 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:34:16.747 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:34:16.773 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:34:16.814 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:34:16.961 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:34:16.989 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:34:17.027 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:34:17.151 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:34:17.179 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:34:17.217 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:34:17.313 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:34:17.330 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:34:17.372 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:34:17.486 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:34:17.502 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:34:17.545 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:34:17.701 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:34:17.729 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:34:17.767 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:34:18.028 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:34:18.044 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:34:18.078 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:34:18.316 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:34:18.344 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:34:18.382 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:18.815 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:34:18.844 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:34:18.881 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:19.235 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:34:19.263 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:34:19.301 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:19.580 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:34:19.776 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:34:19.793 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:34:19.831 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:34:19.834 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:19.949 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:34:20.106 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:34:20.216 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:34:20.364 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:34:20.491 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:34:20.578 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:34:20.749 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:34:21.018 INFO:teuthology.orchestra.run.smithi097.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:34:21.075 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:21.102 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:34:21.537 INFO:teuthology.orchestra.run.smithi154.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:34:21.575 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user cephadm....done 2024-09-12T17:34:21.617 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:21.732 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:34:22.008 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:34:22.168 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user cephadm....done 2024-09-12T17:34:22.250 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:34:22.333 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:34:22.352 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:34:22.586 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:34:22.819 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:34:22.837 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:34:22.963 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:34:23.069 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:34:23.282 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:34:23.304 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:34:23.642 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:34:23.713 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:34:23.893 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:34:23.965 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:34:24.099 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:34:24.152 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:34:24.401 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:34:24.404 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:34:24.680 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:34:24.745 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:34:24.939 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:34:24.996 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:34:25.198 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:25.263 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:34:25.524 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:34:25.541 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:34:25.734 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:34:25.775 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:34:25.843 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:34:25.969 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:34:26.118 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:34:26.245 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:34:26.360 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:26.594 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:34:26.606 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:34:26.635 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:34:26.698 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:34:26.729 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:34:26.824 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:34:26.855 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:34:26.989 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:34:27.167 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:34:27.249 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:34:27.276 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:34:27.553 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:34:27.710 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:34:27.748 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:34:27.802 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:34:27.812 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:34:27.911 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:34:28.121 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:34:28.247 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:34:28.262 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:34:28.388 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:34:28.758 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:34:28.941 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:34:29.026 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:34:29.200 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:34:29.310 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:34:29.327 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:34:29.419 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:34:29.445 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:34:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:34:30.080 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:34:30.096 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:34:30.331 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:34:30.347 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:34:30.457 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:34:30.591 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:34:30.725 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:34:30.893 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:34:31.027 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:34:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:34:31.370 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:34:31.503 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:34:31.621 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:34:31.747 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:31.863 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:34:32.048 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:34:32.156 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:34:32.366 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:34:32.499 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:34:32.750 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:34:32.868 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:33.211 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:34:33.528 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:34:33.696 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:34:33.965 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:34:34.099 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:34:34.375 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:34:34.485 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:34:34.602 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:34:34.734 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:34:34.904 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:34:34.961 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:34:35.095 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:34:35.163 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:34:35.363 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:34:35.414 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:34:35.489 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:34:35.540 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:34:35.615 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:34:35.850 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:34:35.916 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:34:36.084 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:34:36.176 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:34:36.325 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:34:36.410 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:34:36.520 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:34:36.573 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:34:36.821 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:34:36.821 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:34:37.080 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:34:37.088 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:34:37.214 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:34:37.340 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:34:37.490 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:34:37.608 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:34:37.616 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:34:37.867 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:34:37.893 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:34:38.143 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:34:38.177 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:34:38.261 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:34:38.436 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:34:38.529 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:34:38.563 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:34:38.655 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:34:38.689 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:34:38.777 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:34:38.941 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:34:39.032 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:34:39.158 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:34:39.249 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:34:39.516 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:34:39.534 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:34:39.642 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:34:39.760 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:34:39.794 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:34:39.841 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:34:39.920 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:34:40.078 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:34:40.179 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:34:40.204 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:34:40.305 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:34:40.598 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:34:40.631 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:34:40.874 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:34:40.932 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:34:41.000 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:34:41.200 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:34:41.259 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:34:41.301 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:34:41.393 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:34:41.569 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:34:41.711 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:34:41.862 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:34:42.012 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:34:42.225 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:34:42.288 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:34:42.414 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:34:42.600 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:34:42.699 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:34:42.860 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:34:42.967 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:34:43.195 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:34:43.303 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:34:43.321 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:43.447 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:43.573 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:34:43.672 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:34:43.893 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:43.956 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:34:44.019 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:44.145 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:34:44.284 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:34:44.394 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:44.422 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:44.495 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:44.548 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:44.621 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:34:44.674 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:44.893 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:34:44.893 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:34:44.966 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:45.092 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:45.218 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:34:45.434 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:45.494 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:45.560 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:45.620 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:45.746 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:45.957 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:34:45.957 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:34:46.003 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:46.129 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:34:46.439 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:46.565 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:46.700 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:46.826 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:34:47.399 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:47.525 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:47.627 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:47.752 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:47.878 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:47.979 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:48.105 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:48.231 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:48.366 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:48.404 INFO:teuthology.orchestra.run.smithi097.stdout:Adding group ceph....done 2024-09-12T17:34:48.492 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:48.731 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user ceph....done 2024-09-12T17:34:48.900 INFO:teuthology.orchestra.run.smithi097.stdout:Setting system user ceph properties....done 2024-09-12T17:34:48.913 INFO:teuthology.orchestra.run.smithi097.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:34:49.000 INFO:teuthology.orchestra.run.smithi154.stdout:Adding group ceph....done 2024-09-12T17:34:49.049 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:34:49.361 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:34:49.370 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user ceph....done 2024-09-12T17:34:49.563 INFO:teuthology.orchestra.run.smithi154.stdout:Setting system user ceph properties....done 2024-09-12T17:34:49.582 INFO:teuthology.orchestra.run.smithi154.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:34:49.718 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:34:49.845 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:49.960 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:50.059 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:34:50.563 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:34:50.563 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:34:50.568 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:50.694 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:51.020 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:51.157 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:34:51.157 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:34:51.368 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:34:51.604 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:51.822 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:51.954 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:34:52.049 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:34:52.049 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:34:52.422 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:52.549 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:52.648 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:34:52.648 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:34:52.761 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:34:52.761 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:34:53.116 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:53.250 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:53.333 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:34:53.334 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:34:53.513 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:34:53.513 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:34:53.842 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:54.010 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:54.113 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:34:54.113 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:34:54.144 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:54.295 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:54.521 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:34:54.521 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:34:54.552 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:54.678 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:54.829 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:55.022 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:55.039 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:34:55.039 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:34:55.172 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:55.299 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:55.458 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:55.489 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:55.640 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:55.766 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:55.828 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:34:55.917 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:34:55.928 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:34:56.081 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:34:56.279 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:34:56.396 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:34:56.548 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:34:57.173 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:34:57.608 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:34:57.834 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:34:57.837 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T17:34:57.893 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T17:34:58.081 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-12T17:34:58.082 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-12T17:34:58.256 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:34:58.256 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:34:58.256 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:34:58.256 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:34:58.257 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:34:58.257 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:34:58.257 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:34:58.258 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-09-12T17:34:58.258 INFO:teuthology.orchestra.run.smithi097.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:34:58.258 INFO:teuthology.orchestra.run.smithi097.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:34:58.258 INFO:teuthology.orchestra.run.smithi097.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:34:58.259 INFO:teuthology.orchestra.run.smithi097.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:34:58.259 INFO:teuthology.orchestra.run.smithi097.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:34:58.259 INFO:teuthology.orchestra.run.smithi097.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:34:58.259 INFO:teuthology.orchestra.run.smithi097.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:34:58.259 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:34:58.259 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:34:58.259 INFO:teuthology.orchestra.run.smithi097.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:34:58.259 INFO:teuthology.orchestra.run.smithi097.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T17:34:58.260 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-09-12T17:34:58.260 INFO:teuthology.orchestra.run.smithi097.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T17:34:58.260 INFO:teuthology.orchestra.run.smithi097.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T17:34:58.260 INFO:teuthology.orchestra.run.smithi097.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T17:34:58.260 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T17:34:58.260 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T17:34:58.278 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:34:58.281 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T17:34:58.299 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-09-12T17:34:58.299 INFO:teuthology.orchestra.run.smithi097.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:34:58.299 INFO:teuthology.orchestra.run.smithi097.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:34:58.299 INFO:teuthology.orchestra.run.smithi097.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:34:58.299 INFO:teuthology.orchestra.run.smithi097.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:34:58.299 INFO:teuthology.orchestra.run.smithi097.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:34:58.300 INFO:teuthology.orchestra.run.smithi097.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:34:58.300 INFO:teuthology.orchestra.run.smithi097.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:34:58.300 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:34:58.300 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:34:58.300 INFO:teuthology.orchestra.run.smithi097.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:34:58.300 INFO:teuthology.orchestra.run.smithi097.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T17:34:58.300 INFO:teuthology.orchestra.run.smithi097.stdout: s3cmd 2024-09-12T17:34:58.336 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-12T17:34:58.354 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:34:58.354 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 10.4 MB of archives. 2024-09-12T17:34:58.354 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T17:34:58.354 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T17:34:58.371 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T17:34:58.372 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T17:34:58.375 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T17:34:58.410 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T17:34:58.425 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T17:34:58.426 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T17:34:58.457 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T17:34:58.477 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T17:34:58.478 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T17:34:58.479 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T17:34:58.525 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T17:34:58.525 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T17:34:58.530 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-12T17:34:58.531 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-12T17:34:58.542 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T17:34:58.542 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T17:34:58.543 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T17:34:58.544 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T17:34:58.544 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T17:34:58.547 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T17:34:58.548 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T17:34:58.553 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T17:34:58.561 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T17:34:58.561 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T17:34:58.573 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T17:34:58.573 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T17:34:58.574 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T17:34:58.574 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T17:34:58.576 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T17:34:58.579 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T17:34:58.581 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T17:34:58.595 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T17:34:58.595 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T17:34:58.612 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T17:34:58.612 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T17:34:58.612 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T17:34:58.711 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:34:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:34:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:34:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:34:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:34:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:34:58.713 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:34:58.714 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-12T17:34:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:34:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:34:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:34:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:34:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:34:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:34:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:34:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:34:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:34:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:34:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T17:34:58.715 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-12T17:34:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T17:34:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T17:34:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T17:34:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T17:34:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T17:34:58.755 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-12T17:34:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:34:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:34:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:34:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:34:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:34:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:34:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:34:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:34:58.755 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:34:58.756 INFO:teuthology.orchestra.run.smithi154.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:34:58.756 INFO:teuthology.orchestra.run.smithi154.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T17:34:58.756 INFO:teuthology.orchestra.run.smithi154.stdout: s3cmd 2024-09-12T17:34:58.936 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:34:58.937 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 10.4 MB of archives. 2024-09-12T17:34:58.937 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T17:34:58.937 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T17:34:59.021 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T17:34:59.022 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T17:34:59.036 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T17:34:59.049 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 10.4 MB in 0s (34.1 MB/s) 2024-09-12T17:34:59.136 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T17:34:59.201 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T17:34:59.204 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T17:34:59.209 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T17:34:59.252 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T17:34:59.280 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T17:34:59.292 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T17:34:59.415 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T17:34:59.507 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T17:34:59.508 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T17:34:59.512 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T17:34:59.512 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T17:34:59.529 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T17:34:59.571 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:34:59.656 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T17:34:59.656 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T17:34:59.697 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T17:34:59.698 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T17:34:59.699 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T17:34:59.700 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T17:34:59.701 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T17:34:59.707 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T17:34:59.708 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T17:34:59.740 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T17:34:59.795 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T17:34:59.795 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T17:34:59.797 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T17:34:59.798 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T17:34:59.799 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T17:34:59.801 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T17:34:59.824 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T17:34:59.833 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T17:34:59.838 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T17:34:59.840 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T17:34:59.857 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T17:34:59.898 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:34:59.903 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T17:34:59.903 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T17:34:59.936 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T17:34:59.937 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T17:34:59.937 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T17:35:00.143 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T17:35:00.171 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T17:35:00.201 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T17:35:00.375 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 10.4 MB in 1s (8,822 kB/s) 2024-09-12T17:35:00.454 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T17:35:00.472 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T17:35:00.482 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T17:35:00.520 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T17:35:00.551 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T17:35:00.557 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T17:35:00.595 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T17:35:00.773 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T17:35:00.801 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T17:35:00.839 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T17:35:00.856 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T17:35:00.873 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T17:35:00.923 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:35:01.091 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T17:35:01.108 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T17:35:01.142 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T17:35:01.149 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T17:35:01.159 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T17:35:01.192 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:35:01.386 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T17:35:01.402 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T17:35:01.420 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T17:35:01.444 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T17:35:01.448 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T17:35:01.486 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T17:35:01.747 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T17:35:01.755 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T17:35:01.764 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T17:35:01.782 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T17:35:01.821 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:35:01.825 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T17:35:02.057 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T17:35:02.130 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T17:35:02.131 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:35:02.131 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T17:35:02.131 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T17:35:02.131 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T17:35:02.327 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libguava-java. 2024-09-12T17:35:02.343 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T17:35:02.378 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T17:35:02.385 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T17:35:02.394 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T17:35:02.437 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T17:35:02.680 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T17:35:02.696 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T17:35:02.738 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T17:35:02.805 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T17:35:02.832 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T17:35:02.871 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T17:35:03.024 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T17:35:03.041 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T17:35:03.082 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:35:03.123 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libguice-java. 2024-09-12T17:35:03.139 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T17:35:03.181 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T17:35:03.301 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T17:35:03.318 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T17:35:03.360 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:35:03.538 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T17:35:03.551 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T17:35:03.585 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:35:03.595 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libguava-java. 2024-09-12T17:35:03.612 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T17:35:03.654 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T17:35:03.838 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T17:35:03.866 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T17:35:03.905 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T17:35:04.081 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T17:35:04.110 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T17:35:04.157 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T17:35:04.165 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T17:35:04.193 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T17:35:04.232 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T17:35:04.484 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T17:35:04.512 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T17:35:04.551 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T17:35:04.578 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libguice-java. 2024-09-12T17:35:04.607 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T17:35:04.636 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T17:35:04.804 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T17:35:04.831 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T17:35:04.870 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:35:04.998 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T17:35:05.014 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T17:35:05.056 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:35:05.105 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T17:35:05.122 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T17:35:05.174 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:35:05.317 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T17:35:05.346 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T17:35:05.384 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T17:35:05.433 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T17:35:05.449 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T17:35:05.491 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:35:05.653 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T17:35:05.669 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T17:35:05.711 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T17:35:05.779 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T17:35:05.795 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T17:35:05.829 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:35:05.964 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T17:35:05.992 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T17:35:06.022 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T17:35:06.081 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T17:35:06.109 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T17:35:06.148 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T17:35:06.266 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T17:35:06.294 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T17:35:06.333 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:35:06.383 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T17:35:06.402 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T17:35:06.442 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:35:06.610 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T17:35:06.627 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T17:35:06.669 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:35:06.694 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T17:35:06.711 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T17:35:06.753 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:35:06.947 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T17:35:06.947 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T17:35:06.975 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T17:35:06.975 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T17:35:07.005 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:35:07.013 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:35:07.266 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T17:35:07.282 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T17:35:07.309 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T17:35:07.324 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:35:07.337 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T17:35:07.376 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:35:07.568 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T17:35:07.596 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T17:35:07.603 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T17:35:07.621 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T17:35:07.635 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T17:35:07.653 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T17:35:07.905 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T17:35:07.934 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T17:35:07.964 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T17:35:07.972 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:35:07.991 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T17:35:08.030 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:35:08.233 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T17:35:08.249 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T17:35:08.282 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T17:35:08.291 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:35:08.296 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T17:35:08.341 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:35:08.544 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T17:35:08.560 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T17:35:08.602 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:35:08.610 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T17:35:08.638 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T17:35:08.677 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:35:08.829 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T17:35:08.846 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T17:35:08.879 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:35:09.031 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T17:35:09.048 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T17:35:09.081 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T17:35:09.132 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T17:35:09.148 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T17:35:09.199 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T17:35:09.325 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T17:35:09.341 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T17:35:09.383 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:35:09.461 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T17:35:09.477 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T17:35:09.561 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:35:09.839 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T17:35:09.845 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package maven. 2024-09-12T17:35:09.867 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T17:35:09.873 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T17:35:09.906 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:35:09.911 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T17:35:10.200 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T17:35:10.217 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T17:35:10.231 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-magic. 2024-09-12T17:35:10.258 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:35:10.259 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T17:35:10.297 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T17:35:10.550 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package s3cmd. 2024-09-12T17:35:10.578 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T17:35:10.617 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T17:35:10.646 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T17:35:10.674 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T17:35:10.704 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T17:35:10.923 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T17:35:10.940 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T17:35:10.980 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T17:35:10.981 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:35:11.130 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:35:11.240 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:35:11.341 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:35:11.426 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package maven. 2024-09-12T17:35:11.442 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T17:35:11.455 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T17:35:11.493 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T17:35:11.559 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T17:35:11.685 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:35:11.811 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T17:35:11.812 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-magic. 2024-09-12T17:35:11.841 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T17:35:11.879 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T17:35:12.102 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:35:12.132 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package s3cmd. 2024-09-12T17:35:12.161 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T17:35:12.198 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T17:35:12.272 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:35:12.398 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T17:35:12.507 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:35:12.570 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T17:35:12.608 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:35:12.679 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:35:12.709 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:35:12.797 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:35:12.826 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:35:12.923 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:35:12.952 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T17:35:13.049 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T17:35:13.175 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T17:35:13.212 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T17:35:13.301 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:35:13.338 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:35:13.427 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T17:35:13.464 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:35:13.553 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:35:13.590 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T17:35:13.679 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:35:13.716 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T17:35:13.780 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T17:35:13.842 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:35:13.897 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:35:13.951 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T17:35:14.023 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:35:14.246 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:35:14.248 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:35:14.372 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:35:14.498 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T17:35:14.576 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:35:14.616 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T17:35:14.725 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T17:35:14.795 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T17:35:14.835 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T17:35:14.961 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T17:35:15.046 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T17:35:15.087 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T17:35:15.173 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:35:15.221 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T17:35:15.298 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:35:15.347 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:35:15.433 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T17:35:15.490 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:35:15.559 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T17:35:15.616 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T17:35:15.685 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:35:15.811 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T17:35:15.840 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T17:35:15.912 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:35:16.137 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:35:16.263 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:35:16.389 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T17:35:16.515 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T17:35:16.643 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T17:35:16.769 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T17:35:16.895 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T17:35:17.021 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T17:35:17.147 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T17:35:17.273 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:35:17.275 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:35:17.281 DEBUG:teuthology.parallel:result is None 2024-09-12T17:35:17.399 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:35:17.525 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T17:35:17.783 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T17:35:17.847 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:35:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:35:19.214 DEBUG:teuthology.parallel:result is None 2024-09-12T17:35:19.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:35:19.364 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:35:19.383 INFO:teuthology.orchestra.run.smithi097.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:35:19.384 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:35:19.384 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:35:19.386 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:35:19.538 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:35:19.558 INFO:teuthology.orchestra.run.smithi154.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:35:19.558 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:35:19.558 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:35:19.560 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:35:19.560 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:19.560 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:35:19.575 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:19.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:35:19.613 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:35:19.613 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:19.613 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:35:19.631 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:35:19.686 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:19.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:35:19.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:35:19.757 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:35:19.757 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:19.757 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:35:19.771 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:35:19.827 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:19.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:35:19.841 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:35:19.895 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:35:19.895 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:19.895 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:35:19.908 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:35:19.962 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:19.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:35:19.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:35:20.032 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:35:20.117 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:35:20.117 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2024-09-12T17:35:20.120 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-09-12T17:35:20.133 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:35:20.133 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:35:20.176 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:35:20.189 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:35:20.189 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:35:20.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:35:20.255 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:35:20.255 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:35:20.256 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7902732', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOABPwTGtneWdpqfC35yx/QyovA+3Achulm6Hhs4FEaIsAvXRYP8mHPoxIzLHH8x7dxDm2ZK+AC6c09JEBmQ38=', 'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPSf0Z/TWqvtWEo09kVa68YDSNey8Az7vx35bi1sjIwhlkNe8lz3HtdbjT6A1u7sbRaslevCOKFOHiHkxaBnays='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:35:20.256 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:35:20.288 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:35:20.294 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:35:20.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:35:20.349 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:20.349 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:35:20.394 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:35:20.395 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2024-09-12T17:35:20.443 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:35:20.444 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:35:20.444 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-09-12T17:35:20.444 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:35:20.444 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-12 17:29:32.036439182 +0000 2024-09-12T17:35:20.444 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-12 17:29:31.804441254 +0000 2024-09-12T17:35:20.444 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-12 17:29:31.804441254 +0000 2024-09-12T17:35:20.444 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-12T17:35:20.445 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:35:20.497 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-12T17:35:20.497 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-12T17:35:20.497 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000395215 s, 1.3 MB/s 2024-09-12T17:35:20.498 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:35:20.548 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2024-09-12T17:35:20.594 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:35:20.594 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:35:20.595 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-09-12T17:35:20.595 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:35:20.595 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-12 17:29:32.556434538 +0000 2024-09-12T17:35:20.595 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-12 17:29:32.312436717 +0000 2024-09-12T17:35:20.595 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-12 17:29:32.312436717 +0000 2024-09-12T17:35:20.595 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-12T17:35:20.595 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:35:20.649 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-12T17:35:20.649 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-12T17:35:20.649 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000412807 s, 1.2 MB/s 2024-09-12T17:35:20.650 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:35:20.699 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2024-09-12T17:35:20.746 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:35:20.746 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:35:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-12T17:35:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:35:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-12 17:29:33.028430322 +0000 2024-09-12T17:35:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-12 17:29:32.772432607 +0000 2024-09-12T17:35:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-12 17:29:32.772432607 +0000 2024-09-12T17:35:20.747 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-12T17:35:20.747 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:35:20.801 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-12T17:35:20.801 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-12T17:35:20.801 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00044227 s, 1.2 MB/s 2024-09-12T17:35:20.803 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:35:20.852 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2024-09-12T17:35:20.899 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:35:20.899 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:35:20.899 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-12T17:35:20.899 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:35:20.899 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-12 17:29:33.472426356 +0000 2024-09-12T17:35:20.899 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-12 17:29:33.244428393 +0000 2024-09-12T17:35:20.899 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-12 17:29:33.244428393 +0000 2024-09-12T17:35:20.899 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-12T17:35:20.900 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:35:20.953 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-12T17:35:20.953 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-12T17:35:20.953 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00037771 s, 1.4 MB/s 2024-09-12T17:35:20.954 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:35:21.004 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:35:21.004 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:21.004 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:35:21.010 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:35:21.011 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-12T17:35:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:35:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:35:21.057 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-09-12T17:35:21.057 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:35:21.057 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-12 17:29:32.930912219 +0000 2024-09-12T17:35:21.057 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-12 17:29:32.682914191 +0000 2024-09-12T17:35:21.057 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-12 17:29:32.682914191 +0000 2024-09-12T17:35:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-12T17:35:21.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:35:21.111 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-12T17:35:21.111 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-12T17:35:21.111 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000410422 s, 1.2 MB/s 2024-09-12T17:35:21.112 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:35:21.162 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-12T17:35:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:35:21.208 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:35:21.208 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-12T17:35:21.208 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:35:21.208 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-12 17:29:33.402908461 +0000 2024-09-12T17:35:21.209 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-12 17:29:33.134910592 +0000 2024-09-12T17:35:21.209 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-12 17:29:33.134910592 +0000 2024-09-12T17:35:21.209 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-12T17:35:21.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:35:21.263 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-12T17:35:21.263 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-12T17:35:21.263 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.00041407 s, 1.2 MB/s 2024-09-12T17:35:21.264 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:35:21.314 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-12T17:35:21.360 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:35:21.360 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:35:21.360 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-09-12T17:35:21.360 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:35:21.360 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-12 17:29:33.878904676 +0000 2024-09-12T17:35:21.361 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-12 17:29:33.650906489 +0000 2024-09-12T17:35:21.361 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-12 17:29:33.650906489 +0000 2024-09-12T17:35:21.361 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-12T17:35:21.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:35:21.414 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-12T17:35:21.414 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-12T17:35:21.415 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000377748 s, 1.4 MB/s 2024-09-12T17:35:21.416 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:35:21.465 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-12T17:35:21.512 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:35:21.513 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:35:21.513 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-09-12T17:35:21.513 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:35:21.513 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-12 17:29:34.394900572 +0000 2024-09-12T17:35:21.513 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-12 17:29:34.118902767 +0000 2024-09-12T17:35:21.513 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-12 17:29:34.118902767 +0000 2024-09-12T17:35:21.513 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-12T17:35:21.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:35:21.567 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-12T17:35:21.567 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-12T17:35:21.567 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000327103 s, 1.6 MB/s 2024-09-12T17:35:21.568 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:35:21.618 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:35:21.619 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:35:21.619 INFO:tasks.ceph:Generating config... 2024-09-12T17:35:21.620 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T17:35:21.620 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T17:35:21.620 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T17:35:21.620 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T17:35:21.620 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T17:35:21.620 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:35:21.620 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T17:35:21.620 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T17:35:21.621 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T17:35:21.621 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T17:35:21.621 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T17:35:21.621 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T17:35:21.621 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T17:35:21.621 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T17:35:21.621 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T17:35:21.621 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T17:35:21.621 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T17:35:21.621 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T17:35:21.621 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:35:21.621 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:35:21.622 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:35:21.622 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:35:21.622 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:35:21.622 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T17:35:21.622 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:35:21.622 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:35:21.622 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:35:21.622 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:35:21.622 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:35:21.622 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:35:21.622 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:35:21.622 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:35:21.622 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T17:35:21.622 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:35:21.623 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:35:21.623 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:35:21.623 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:35:21.623 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:35:21.623 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:35:21.623 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T17:35:21.623 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:35:21.623 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T17:35:21.623 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:35:21.623 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:35:21.658 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:35:21.666 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:35:21.744 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:35:21.798 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.97'), ('mon.c', '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]'), ('mon.b', '172.21.15.154')] 2024-09-12T17:35:21.798 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],172.21.15.154', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T17:35:21.799 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:21.799 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:35:21.847 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.97 --addv c '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]' --add b 172.21.15.154 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:21.937 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:21.938 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:21.938 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:21.938 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: generated fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T17:35:21.938 INFO:teuthology.orchestra.run.smithi097.stdout:setting min_mon_release = quincy 2024-09-12T17:35:21.938 INFO:teuthology.orchestra.run.smithi097.stdout:epoch 0 2024-09-12T17:35:21.939 INFO:teuthology.orchestra.run.smithi097.stdout:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T17:35:21.939 INFO:teuthology.orchestra.run.smithi097.stdout:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T17:35:21.939 INFO:teuthology.orchestra.run.smithi097.stdout:created 2024-09-12T17:35:21.940121+0000 2024-09-12T17:35:21.939 INFO:teuthology.orchestra.run.smithi097.stdout:min_mon_release 17 (quincy) 2024-09-12T17:35:21.939 INFO:teuthology.orchestra.run.smithi097.stdout:election_strategy: 1 2024-09-12T17:35:21.939 INFO:teuthology.orchestra.run.smithi097.stdout:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T17:35:21.939 INFO:teuthology.orchestra.run.smithi097.stdout:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T17:35:21.939 INFO:teuthology.orchestra.run.smithi097.stdout:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T17:35:21.939 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T17:35:21.940 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:35:21.986 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 140363d0-879c-4957-b68a-2ee681f3fbda... 2024-09-12T17:35:21.987 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:35:22.032 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:35:22.060 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-09-12T17:35:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-09-12T17:35:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:35:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-09-12T17:35:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-09-12T17:35:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-09-12T17:35:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-09-12T17:35:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-09-12T17:35:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],172.21.15.154" 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: mon client directed command retry = 5 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: ms inject socket failures = 5000 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: osd heartbeat grace = 40 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:35:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-09-12T17:35:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:35:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: bdev async discard = True 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: bdev enable discard = True 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore allocator = bitmap 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 1/20 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 1/20 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: debug objclass = 20 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-09-12T17:35:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 4/10 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: osd fast shutdown = False 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: osd shutdown pgref assert = True 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-12T17:35:22.068 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-09-12T17:35:22.069 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:35:22.070 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.071 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-09-12T17:35:22.071 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:35:22.071 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.071 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:35:22.071 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd crush smoke test = False 2024-09-12T17:35:22.071 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:35:22.071 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-09-12T17:35:22.071 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-09-12T17:35:22.071 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-09-12T17:35:22.071 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-09-12T17:35:22.071 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:35:22.072 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:35:22.072 INFO:teuthology.orchestra.run.smithi097.stdout: debug rgw = 20 2024-09-12T17:35:22.072 INFO:teuthology.orchestra.run.smithi097.stdout: debug rgw notification = 20 2024-09-12T17:35:22.072 INFO:teuthology.orchestra.run.smithi097.stdout: rgw bucket counters cache = True 2024-09-12T17:35:22.072 INFO:teuthology.orchestra.run.smithi097.stdout: rgw crypt require ssl = False 2024-09-12T17:35:22.072 INFO:teuthology.orchestra.run.smithi097.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:35:22.072 INFO:teuthology.orchestra.run.smithi097.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:35:22.072 INFO:teuthology.orchestra.run.smithi097.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:35:22.072 INFO:teuthology.orchestra.run.smithi097.stdout: rgw s3 auth use sts = True 2024-09-12T17:35:22.072 INFO:teuthology.orchestra.run.smithi097.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:35:22.072 INFO:teuthology.orchestra.run.smithi097.stdout: rgw torrent flag = True 2024-09-12T17:35:22.073 INFO:teuthology.orchestra.run.smithi097.stdout: rgw user counters cache = True 2024-09-12T17:35:22.073 INFO:teuthology.orchestra.run.smithi097.stdout: setgroup = ceph 2024-09-12T17:35:22.073 INFO:teuthology.orchestra.run.smithi097.stdout: setuser = ceph 2024-09-12T17:35:22.073 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-09-12T17:35:22.073 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2024-09-12T17:35:22.073 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2024-09-12T17:35:22.075 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-09-12T17:35:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-09-12T17:35:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:35:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-09-12T17:35:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-09-12T17:35:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-09-12T17:35:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-09-12T17:35:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-09-12T17:35:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-09-12T17:35:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-09-12T17:35:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:35:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-09-12T17:35:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:35:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:35:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-09-12T17:35:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-09-12T17:35:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-09-12T17:35:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:35:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:35:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-09-12T17:35:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:35:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-09-12T17:35:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:35:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:35:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-09-12T17:35:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:35:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-09-12T17:35:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-09-12T17:35:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-09-12T17:35:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-09-12T17:35:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-09-12T17:35:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],172.21.15.154" 2024-09-12T17:35:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: mon client directed command retry = 5 2024-09-12T17:35:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject socket failures = 5000 2024-09-12T17:35:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: osd heartbeat grace = 40 2024-09-12T17:35:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:35:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:35:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T17:35:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.079 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-09-12T17:35:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-09-12T17:35:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-09-12T17:35:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-09-12T17:35:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:35:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-09-12T17:35:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-09-12T17:35:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-09-12T17:35:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-09-12T17:35:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-09-12T17:35:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-09-12T17:35:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-09-12T17:35:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-09-12T17:35:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:35:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-09-12T17:35:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-09-12T17:35:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-12T17:35:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: debug objclass = 20 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: osd fast shutdown = False 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: osd shutdown pgref assert = True 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-09-12T17:35:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-09-12T17:35:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-09-12T17:35:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:35:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-09-12T17:35:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-09-12T17:35:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:35:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:35:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:35:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:35:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:35:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:35:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:35:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-09-12T17:35:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:35:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:35:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd crush smoke test = False 2024-09-12T17:35:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-12T17:35:22.086 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-09-12T17:35:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-09-12T17:35:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-09-12T17:35:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-09-12T17:35:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:35:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:35:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: debug rgw = 20 2024-09-12T17:35:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: debug rgw notification = 20 2024-09-12T17:35:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: rgw bucket counters cache = True 2024-09-12T17:35:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: rgw crypt require ssl = False 2024-09-12T17:35:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:35:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:35:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:35:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: rgw s3 auth use sts = True 2024-09-12T17:35:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:35:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: rgw torrent flag = True 2024-09-12T17:35:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: rgw user counters cache = True 2024-09-12T17:35:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: setgroup = ceph 2024-09-12T17:35:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: setuser = ceph 2024-09-12T17:35:22.088 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-09-12T17:35:22.088 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-09-12T17:35:22.088 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-09-12T17:35:22.088 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:35:22.089 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:35:22.167 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:35:22.167 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:22.167 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:35:22.172 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:22.173 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:35:22.218 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T17:35:22.218 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:22.218 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:35:22.218 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:35:22.283 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:22.283 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:22.331 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T17:35:22.332 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:22.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:35:22.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:35:22.354 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:22.355 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:22.400 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:35:22.401 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:35:22.401 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:35:22.447 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:35:22.450 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:35:22.493 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:35:22.507 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:35:22.507 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:35:22.507 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:35:22.541 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:35:22.551 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T17:35:22.585 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T17:35:22.596 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:35:22.596 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:35:22.596 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:35:22.608 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:35:22.608 INFO:tasks.ceph:role: osd.0 2024-09-12T17:35:22.608 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T17:35:22.608 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:35:22.670 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:35:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:35:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:35:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:35:22.671 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:35:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:35:22.671 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:35:22.671 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:35:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:35:22.671 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:35:23.152 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-12T17:35:23.175 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-12T17:35:23.175 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:35:23.270 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:35:23.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:35:23.325 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:35:23.326 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:35:23.384 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:35:23.384 INFO:tasks.ceph:role: osd.1 2024-09-12T17:35:23.384 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T17:35:23.384 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:35:23.447 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:35:23.447 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:35:23.447 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:35:23.447 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:35:23.447 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:35:23.447 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:35:23.447 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:35:23.447 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:35:23.448 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:35:23.448 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:35:23.930 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-12T17:35:23.933 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-12T17:35:23.933 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T17:35:24.093 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:35:24.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:35:24.105 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:35:24.105 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:35:24.158 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:35:24.158 INFO:tasks.ceph:role: osd.2 2024-09-12T17:35:24.158 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T17:35:24.159 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:35:24.222 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:35:24.222 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:35:24.222 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:35:24.222 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:35:24.222 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:35:24.222 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:35:24.222 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:35:24.223 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:35:24.223 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:35:24.223 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:35:24.704 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-12T17:35:24.706 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-12T17:35:24.706 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T17:35:24.841 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:35:24.851 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:35:24.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:35:24.852 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:35:24.910 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:35:24.910 INFO:tasks.ceph:role: osd.3 2024-09-12T17:35:24.910 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T17:35:24.910 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:35:24.974 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:35:24.974 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:35:24.974 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:35:24.975 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:35:24.975 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:35:24.975 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:35:24.975 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:35:24.975 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:35:24.975 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:35:24.976 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:35:25.400 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-12T17:35:25.401 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-12T17:35:25.401 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T17:35:25.492 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:35:25.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:35:25.502 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:35:25.502 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:25.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:25.610+0000 7ffb1c4857c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:35:25.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:25.610+0000 7ffb1c4857c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:35:25.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:25.610+0000 7ffb1c4857c0 -1 bdev(0x55724d615800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:35:25.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:25.610+0000 7ffb1c4857c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:35:28.768 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:35:28.781 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:28.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:28.858+0000 7fb5bb83b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:35:28.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:28.858+0000 7fb5bb83b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:35:28.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:28.858+0000 7fb5bb83b7c0 -1 bdev(0x5633c943f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:35:28.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:28.858+0000 7fb5bb83b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:35:32.012 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:35:32.067 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:32.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:32.150+0000 7f1521e737c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:35:32.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:32.154+0000 7f1521e737c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:35:32.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:32.154+0000 7f1521e737c0 -1 bdev(0x561da5a43800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:35:32.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:32.154+0000 7f1521e737c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:35:35.294 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:35:35.351 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:35.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:35.430+0000 7ff45abe77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:35:35.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:35.430+0000 7ff45abe77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:35:35.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:35.430+0000 7ff45abe77c0 -1 bdev(0x56517dfcd800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:35:35.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:35:35.430+0000 7ff45abe77c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:35:38.579 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:35:38.634 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T17:35:38.649 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:35:38.649 INFO:tasks.ceph:role: osd.4 2024-09-12T17:35:38.649 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T17:35:38.649 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:35:38.713 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:35:38.714 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:35:39.163 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-12T17:35:39.165 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-12T17:35:39.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T17:35:39.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T17:35:39.270 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:35:39.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:35:39.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T17:35:39.329 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:35:39.329 INFO:tasks.ceph:role: osd.5 2024-09-12T17:35:39.330 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T17:35:39.330 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:35:39.393 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:35:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:35:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:35:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:35:39.393 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:35:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:35:39.393 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:35:39.393 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:35:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:35:39.393 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:35:39.863 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-12T17:35:39.865 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-12T17:35:39.865 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T17:35:40.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T17:35:40.030 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:35:40.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:35:40.031 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T17:35:40.088 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:35:40.088 INFO:tasks.ceph:role: osd.6 2024-09-12T17:35:40.088 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T17:35:40.088 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:35:40.151 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:35:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:35:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:35:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:35:40.152 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:35:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:35:40.152 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:35:40.152 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:35:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:35:40.152 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:35:40.638 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-12T17:35:40.640 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-12T17:35:40.641 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T17:35:40.781 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T17:35:40.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:35:40.792 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:35:40.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T17:35:40.847 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:35:40.847 INFO:tasks.ceph:role: osd.7 2024-09-12T17:35:40.848 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T17:35:40.848 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:35:40.911 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:35:40.911 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:35:40.911 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:35:40.911 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:35:40.912 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:35:40.912 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:35:40.912 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:35:40.912 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:35:40.912 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:35:40.912 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:35:41.330 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-12T17:35:41.332 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-12T17:35:41.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T17:35:41.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T17:35:41.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:35:41.441 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:35:41.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:41.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:41.547+0000 7fab9de637c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T17:35:41.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:41.551+0000 7fab9de637c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T17:35:41.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:41.551+0000 7fab9de637c0 -1 bdev(0x5607bfc89800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T17:35:41.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:41.551+0000 7fab9de637c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T17:35:44.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T17:35:44.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:44.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:44.763+0000 7fb47d49a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T17:35:44.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:44.763+0000 7fb47d49a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T17:35:44.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:44.763+0000 7fb47d49a7c0 -1 bdev(0x559b831ad800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T17:35:44.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:44.763+0000 7fb47d49a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T17:35:47.914 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T17:35:47.969 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:48.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:48.055+0000 7feadbaf07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T17:35:48.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:48.055+0000 7feadbaf07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T17:35:48.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:48.055+0000 7feadbaf07c0 -1 bdev(0x55c3f9831800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T17:35:48.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:48.055+0000 7feadbaf07c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T17:35:51.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T17:35:51.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:51.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:51.311+0000 7f1fd26907c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T17:35:51.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:51.311+0000 7f1fd26907c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T17:35:51.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:51.311+0000 7f1fd26907c0 -1 bdev(0x5631c9211800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T17:35:51.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-12T17:35:51.311+0000 7f1fd26907c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T17:35:54.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T17:35:54.512 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:35:54.513 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:54.513 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T17:35:54.527 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:54.527 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:35:54.582 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:54.582 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:35:54.638 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:54.638 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:35:54.695 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:54.695 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:35:54.750 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:54.750 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:35:54.764 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:54.764 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T17:35:54.818 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:54.818 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T17:35:54.870 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:54.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T17:35:54.926 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:54.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T17:35:54.978 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:35:54.978 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:35:54.984 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:35:54.984 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T17:35:55.023 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:35:55.024 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:35:55.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:35:55.069 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.y] 2024-09-12T17:35:55.069 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBaJuNmlwfMGhAAdnIgZdnkFqvaQjM9iRuzfA== 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBdJuNmKvSDJBAAtCRhOSHxlhrqxTJwD0Qwcg== 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBgJuNmEJFtMxAA/QLo4LO6PhuvFNLIn/1riA== 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBkJuNmkuJGCRAA2A25FsBpHCG17jLbf1QxDA== 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBnJuNmoU3ZGRAAaahDNOPpWWBem9JLdZ4wpg== 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBaJuNmVRaNHRAAggYhXdGM+IZ+wgWxRvW3rg== 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.4] 2024-09-12T17:35:55.070 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBtJuNmI8jsIBAAnx4pu+eIBFBisky0chQabg== 2024-09-12T17:35:55.071 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.5] 2024-09-12T17:35:55.071 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBwJuNmdTbULRAAZGcUPxBjWQP/xb1YCS9+HA== 2024-09-12T17:35:55.071 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.6] 2024-09-12T17:35:55.071 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQB0JuNmwTV8AxAA/0d9G3m9/ieEuKf9Zg6Wog== 2024-09-12T17:35:55.071 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.7] 2024-09-12T17:35:55.071 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQB3JuNm3E/XEhAA0sFEJ0GBPSX41E/GC5B/wQ== 2024-09-12T17:35:55.071 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2024-09-12T17:35:55.071 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBaJuNm1fxeIBAAHK5wq7pFhWIiycsZ+wlTAQ== 2024-09-12T17:35:55.071 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2024-09-12T17:35:55.071 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBaJuNmweEMIxAAH7QGzW16v8/gy/9ntHsHpQ== 2024-09-12T17:35:55.077 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2024-09-12T17:35:55.077 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBaJuNmlwfMGhAAdnIgZdnkFqvaQjM9iRuzfA== 2024-09-12T17:35:55.077 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2024-09-12T17:35:55.077 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBdJuNmKvSDJBAAtCRhOSHxlhrqxTJwD0Qwcg== 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBgJuNmEJFtMxAA/QLo4LO6PhuvFNLIn/1riA== 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBkJuNmkuJGCRAA2A25FsBpHCG17jLbf1QxDA== 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBnJuNmoU3ZGRAAaahDNOPpWWBem9JLdZ4wpg== 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBaJuNmVRaNHRAAggYhXdGM+IZ+wgWxRvW3rg== 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBtJuNmI8jsIBAAnx4pu+eIBFBisky0chQabg== 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2024-09-12T17:35:55.078 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBwJuNmdTbULRAAZGcUPxBjWQP/xb1YCS9+HA== 2024-09-12T17:35:55.079 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2024-09-12T17:35:55.079 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB0JuNmwTV8AxAA/0d9G3m9/ieEuKf9Zg6Wog== 2024-09-12T17:35:55.079 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2024-09-12T17:35:55.079 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB3JuNm3E/XEhAA0sFEJ0GBPSX41E/GC5B/wQ== 2024-09-12T17:35:55.079 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-09-12T17:35:55.079 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBaJuNm1fxeIBAAHK5wq7pFhWIiycsZ+wlTAQ== 2024-09-12T17:35:55.079 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2024-09-12T17:35:55.079 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBaJuNmweEMIxAAH7QGzW16v8/gy/9ntHsHpQ== 2024-09-12T17:35:55.080 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:35:55.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:35:55.168 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.211 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.299 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.380 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.387 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.466 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:35:55.471 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:35:55.550 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.632 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.716 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.803 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.807 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:35:55.889 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:35:55.892 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:35:55.979 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:35:55.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:35:56.026 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:35:56.026 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:35:56.037 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:35:56.131 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:35:56.141 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T17:35:56.197 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:35:56.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T17:35:56.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T17:35:56.315 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:35:56.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T17:35:56.425 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:56.428 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:35:56.471 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:35:56.471 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:35:56.471 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:35:56.475 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:35:56.475 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T17:35:56.475 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T17:35:56.477 INFO:tasks.ceph.mon.c:Started 2024-09-12T17:35:56.478 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T17:35:56.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T17:35:56.516 INFO:tasks.ceph.mon.b:Started 2024-09-12T17:35:56.516 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:35:56.517 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T17:35:56.517 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T17:35:56.519 INFO:tasks.ceph.mgr.y:Started 2024-09-12T17:35:56.519 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:35:56.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:35:56.521 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:35:56.521 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:35:56.522 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:35:56.522 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:36:02.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:02.122+0000 7f9498f60640 0 --2- 172.21.15.97:0/1610836253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f947c0052f0 0x7f947c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:36:02.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:02.326+0000 7f9498f60640 0 --2- 172.21.15.97:0/1610836253 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f947c0039c0 0x7f947c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:36:02.409 INFO:teuthology.orchestra.run.smithi097.stderr:adjusted tunables profile to default 2024-09-12T17:36:02.426 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:36:02.426 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:36:02.427 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:36:02.427 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:36:02.437 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:36:02.437 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:36:02.487 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:36:02.488 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:36:02.540 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:36:02.540 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:36:02.593 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:36:02.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T17:36:02.609 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:36:02.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T17:36:02.663 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:36:02.663 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T17:36:02.722 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-12T17:36:02.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T17:36:02.781 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 0a9c01c8-3996-45b9-9328-cc191a45b1fc 0 2024-09-12T17:36:03.039 INFO:teuthology.orchestra.run.smithi154.stdout:0 2024-09-12T17:36:03.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 2f81d0ad-5929-4ee1-876d-08485e1aa27f 1 2024-09-12T17:36:03.257 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-09-12T17:36:03.274 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 85086976-50ca-4160-a530-d565fb79d0a8 2 2024-09-12T17:36:03.475 INFO:teuthology.orchestra.run.smithi154.stdout:2 2024-09-12T17:36:03.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new dcf75ff5-baf8-426d-a617-76a575141b8c 3 2024-09-12T17:36:03.700 INFO:teuthology.orchestra.run.smithi154.stdout:3 2024-09-12T17:36:03.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new eb42906d-fd6d-4f9c-b747-78973e5eaf6b 4 2024-09-12T17:36:03.920 INFO:teuthology.orchestra.run.smithi154.stdout:4 2024-09-12T17:36:03.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 1f595162-1674-4bb4-9e4a-ad9668dc0d90 5 2024-09-12T17:36:04.143 INFO:teuthology.orchestra.run.smithi154.stdout:5 2024-09-12T17:36:04.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 7a65a21c-542a-47b5-a103-8cbb7db1de88 6 2024-09-12T17:36:04.364 INFO:teuthology.orchestra.run.smithi154.stdout:6 2024-09-12T17:36:04.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 13feed67-5697-4e4b-83cc-0d903f25cbfc 7 2024-09-12T17:36:04.581 INFO:teuthology.orchestra.run.smithi154.stdout:7 2024-09-12T17:36:04.598 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:36:04.598 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:36:04.600 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:36:04.600 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:36:04.601 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:36:04.603 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:36:04.603 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:36:04.603 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:36:04.606 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:36:04.606 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:36:04.606 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:36:04.608 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:36:04.608 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T17:36:04.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T17:36:04.610 INFO:tasks.ceph.osd.4:Started 2024-09-12T17:36:04.610 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T17:36:04.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T17:36:04.613 INFO:tasks.ceph.osd.5:Started 2024-09-12T17:36:04.613 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T17:36:04.613 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T17:36:04.615 INFO:tasks.ceph.osd.6:Started 2024-09-12T17:36:04.615 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T17:36:04.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T17:36:04.617 INFO:tasks.ceph.osd.7:Started 2024-09-12T17:36:04.618 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:36:04.771 INFO:tasks.ceph.mgr.y.smithi097.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T17:36:04.771 INFO:tasks.ceph.mgr.y.smithi097.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T17:36:04.771 INFO:tasks.ceph.mgr.y.smithi097.stderr: from numpy import show_config as show_numpy_config 2024-09-12T17:36:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:36:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":10,"fsid":"140363d0-879c-4957-b68a-2ee681f3fbda","created":"2024-09-12T17:36:01.889308+0000","modified":"2024-09-12T17:36:04.579304+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:36:04.579304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0a9c01c8-3996-45b9-9328-cc191a45b1fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f81d0ad-5929-4ee1-876d-08485e1aa27f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"85086976-50ca-4160-a530-d565fb79d0a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dcf75ff5-baf8-426d-a617-76a575141b8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"eb42906d-fd6d-4f9c-b747-78973e5eaf6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1f595162-1674-4bb4-9e4a-ad9668dc0d90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7a65a21c-542a-47b5-a103-8cbb7db1de88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"13feed67-5697-4e4b-83cc-0d903f25cbfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:36:04.830 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:36:04.830 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:36:05.527 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T17:36:05.527 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T17:36:05.527 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2024-09-12T17:36:05.637 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:36:05.788 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-12T17:36:05.787+0000 7fe639b677c0 -1 Falling back to public interface 2024-09-12T17:36:05.815 INFO:teuthology.misc.health.smithi097.stdout: 2024-09-12T17:36:05.816 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":10,"fsid":"140363d0-879c-4957-b68a-2ee681f3fbda","created":"2024-09-12T17:36:01.889308+0000","modified":"2024-09-12T17:36:04.579304+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:36:04.579304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0a9c01c8-3996-45b9-9328-cc191a45b1fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f81d0ad-5929-4ee1-876d-08485e1aa27f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"85086976-50ca-4160-a530-d565fb79d0a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dcf75ff5-baf8-426d-a617-76a575141b8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"eb42906d-fd6d-4f9c-b747-78973e5eaf6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1f595162-1674-4bb4-9e4a-ad9668dc0d90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7a65a21c-542a-47b5-a103-8cbb7db1de88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"13feed67-5697-4e4b-83cc-0d903f25cbfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:36:05.830 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:36:05.992 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-12T17:36:05.991+0000 7f25b00287c0 -1 Falling back to public interface 2024-09-12T17:36:06.000 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-12T17:36:05.999+0000 7f5b194fa7c0 -1 Falling back to public interface 2024-09-12T17:36:06.007 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-12T17:36:06.006+0000 7fab9b4897c0 -1 Falling back to public interface 2024-09-12T17:36:06.022 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-12T17:36:06.022+0000 7fd3ecd1d7c0 -1 Falling back to public interface 2024-09-12T17:36:06.054 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-12T17:36:06.054+0000 7f9b003387c0 -1 Falling back to public interface 2024-09-12T17:36:06.062 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-12T17:36:06.062+0000 7f2db17377c0 -1 Falling back to public interface 2024-09-12T17:36:06.256 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-12T17:36:06.255+0000 7f5d2559a7c0 -1 Falling back to public interface 2024-09-12T17:36:07.727 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-09-12T17:36:07.726+0000 7f2161820640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T17:36:07.727 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-09-12T17:36:07.726+0000 7f2161820640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T17:36:09.782 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-12T17:36:09.779+0000 7fe639b677c0 -1 osd.6 0 log_to_monitors true 2024-09-12T17:36:09.988 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-12T17:36:09.986+0000 7fab9b4897c0 -1 osd.0 0 log_to_monitors true 2024-09-12T17:36:09.993 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-12T17:36:09.991+0000 7f5b194fa7c0 -1 osd.5 0 log_to_monitors true 2024-09-12T17:36:10.116 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-12T17:36:10.114+0000 7fd3ecd1d7c0 -1 osd.1 0 log_to_monitors true 2024-09-12T17:36:10.241 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-12T17:36:10.239+0000 7f25b00287c0 -1 osd.7 0 log_to_monitors true 2024-09-12T17:36:10.316 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-12T17:36:10.314+0000 7f9b003387c0 -1 osd.3 0 log_to_monitors true 2024-09-12T17:36:10.341 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-12T17:36:10.339+0000 7f5d2559a7c0 -1 osd.4 0 log_to_monitors true 2024-09-12T17:36:10.755 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-12T17:36:10.754+0000 7f2db17377c0 -1 osd.2 0 log_to_monitors true 2024-09-12T17:36:12.034 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-12T17:36:12.031+0000 7fe635b10640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T17:36:12.224 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-12T17:36:12.223+0000 7fe62d942640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:36:12.637 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:36:12.997 INFO:teuthology.misc.health.smithi097.stdout: 2024-09-12T17:36:12.997 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":13,"fsid":"140363d0-879c-4957-b68a-2ee681f3fbda","created":"2024-09-12T17:36:01.889308+0000","modified":"2024-09-12T17:36:11.939457+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:36:04.579304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0a9c01c8-3996-45b9-9328-cc191a45b1fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f81d0ad-5929-4ee1-876d-08485e1aa27f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"85086976-50ca-4160-a530-d565fb79d0a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dcf75ff5-baf8-426d-a617-76a575141b8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"eb42906d-fd6d-4f9c-b747-78973e5eaf6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1f595162-1674-4bb4-9e4a-ad9668dc0d90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7a65a21c-542a-47b5-a103-8cbb7db1de88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"13feed67-5697-4e4b-83cc-0d903f25cbfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:36:13.020 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:36:13.656 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-12T17:36:13.655+0000 7f5d21543640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T17:36:13.661 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-12T17:36:13.659+0000 7f5d21543640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T17:36:13.685 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-12T17:36:13.683+0000 7f25abfd1640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T17:36:13.687 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-12T17:36:13.687+0000 7f5d19375640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:36:13.708 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-12T17:36:13.707+0000 7f5b15cb5640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T17:36:13.719 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-12T17:36:13.719+0000 7f25a3e03640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:36:13.731 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-12T17:36:13.731+0000 7f5b0d2d5640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:36:14.058 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-12T17:36:14.058+0000 7f9afc2e1640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:36:14.086 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-12T17:36:14.086+0000 7f9af4113640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:36:14.101 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-12T17:36:14.102+0000 7fab97432640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:36:14.106 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-12T17:36:14.106+0000 7fab97432640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:36:14.118 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-12T17:36:14.118+0000 7fd3e8cc6640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:36:14.138 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-12T17:36:14.138+0000 7fab8f264640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:36:14.143 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-12T17:36:14.142+0000 7f2dad6e0640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:36:14.146 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-12T17:36:14.146+0000 7fd3e0af8640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:36:14.178 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-12T17:36:14.178+0000 7f2da5512640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:36:19.828 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:36:20.136 INFO:teuthology.misc.health.smithi097.stdout: 2024-09-12T17:36:20.136 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":18,"fsid":"140363d0-879c-4957-b68a-2ee681f3fbda","created":"2024-09-12T17:36:01.889308+0000","modified":"2024-09-12T17:36:17.717916+0000","last_up_change":"2024-09-12T17:36:14.691362+0000","last_in_change":"2024-09-12T17:36:04.579304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:36:14.750254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a9c01c8-3996-45b9-9328-cc191a45b1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6801","nonce":642959985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6803","nonce":642959985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6807","nonce":642959985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6805","nonce":642959985}]},"public_addr":"172.21.15.97:6801/642959985","cluster_addr":"172.21.15.97:6803/642959985","heartbeat_back_addr":"172.21.15.97:6807/642959985","heartbeat_front_addr":"172.21.15.97:6805/642959985","state":["exists","up"]},{"osd":1,"uuid":"2f81d0ad-5929-4ee1-876d-08485e1aa27f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6809","nonce":1696697607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6811","nonce":1696697607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6815","nonce":1696697607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6813","nonce":1696697607}]},"public_addr":"172.21.15.97:6809/1696697607","cluster_addr":"172.21.15.97:6811/1696697607","heartbeat_back_addr":"172.21.15.97:6815/1696697607","heartbeat_front_addr":"172.21.15.97:6813/1696697607","state":["exists","up"]},{"osd":2,"uuid":"85086976-50ca-4160-a530-d565fb79d0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6825","nonce":193866730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6827","nonce":193866730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6831","nonce":193866730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6829","nonce":193866730}]},"public_addr":"172.21.15.97:6825/193866730","cluster_addr":"172.21.15.97:6827/193866730","heartbeat_back_addr":"172.21.15.97:6831/193866730","heartbeat_front_addr":"172.21.15.97:6829/193866730","state":["exists","up"]},{"osd":3,"uuid":"dcf75ff5-baf8-426d-a617-76a575141b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6817","nonce":3061077368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6819","nonce":3061077368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6823","nonce":3061077368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6821","nonce":3061077368}]},"public_addr":"172.21.15.97:6817/3061077368","cluster_addr":"172.21.15.97:6819/3061077368","heartbeat_back_addr":"172.21.15.97:6823/3061077368","heartbeat_front_addr":"172.21.15.97:6821/3061077368","state":["exists","up"]},{"osd":4,"uuid":"eb42906d-fd6d-4f9c-b747-78973e5eaf6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6825","nonce":2114276410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6827","nonce":2114276410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6831","nonce":2114276410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6829","nonce":2114276410}]},"public_addr":"172.21.15.154:6825/2114276410","cluster_addr":"172.21.15.154:6827/2114276410","heartbeat_back_addr":"172.21.15.154:6831/2114276410","heartbeat_front_addr":"172.21.15.154:6829/2114276410","state":["exists","up"]},{"osd":5,"uuid":"1f595162-1674-4bb4-9e4a-ad9668dc0d90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6817","nonce":4233979797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6819","nonce":4233979797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6823","nonce":4233979797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6821","nonce":4233979797}]},"public_addr":"172.21.15.154:6817/4233979797","cluster_addr":"172.21.15.154:6819/4233979797","heartbeat_back_addr":"172.21.15.154:6823/4233979797","heartbeat_front_addr":"172.21.15.154:6821/4233979797","state":["exists","up"]},{"osd":6,"uuid":"7a65a21c-542a-47b5-a103-8cbb7db1de88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6801","nonce":2443191286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6803","nonce":2443191286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6807","nonce":2443191286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6805","nonce":2443191286}]},"public_addr":"172.21.15.154:6801/2443191286","cluster_addr":"172.21.15.154:6803/2443191286","heartbeat_back_addr":"172.21.15.154:6807/2443191286","heartbeat_front_addr":"172.21.15.154:6805/2443191286","state":["exists","up"]},{"osd":7,"uuid":"13feed67-5697-4e4b-83cc-0d903f25cbfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6809","nonce":3304684764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6811","nonce":3304684764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6815","nonce":3304684764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6813","nonce":3304684764}]},"public_addr":"172.21.15.154:6809/3304684764","cluster_addr":"172.21.15.154:6811/3304684764","heartbeat_back_addr":"172.21.15.154:6815/3304684764","heartbeat_front_addr":"172.21.15.154:6813/3304684764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.950930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.168590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.753805+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.327355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.362604+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.982481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.835104+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.232583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:36:20.154 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T17:36:20.154 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:36:20.154 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:36:20.771 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'rbd' created 2024-09-12T17:36:20.794 DEBUG:teuthology.orchestra.run.smithi097:> rbd --cluster ceph pool init rbd 2024-09-12T17:36:20.838 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:20.838 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:23.812 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:36:23.813 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:36:23.813 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:36:24.131 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:36:24.149 INFO:teuthology.orchestra.run.smithi097.stdout:[{"version":9,"timestamp":"2024-09-12T17:36:14.146750+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"4738.588784"}]}] 2024-09-12T17:36:24.149 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T17:36:24.149 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:36:24.150 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:36:24.150 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:36:24.505 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:36:24.521 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":322950205},{"type":"v1","addr":"172.21.15.97:6833","nonce":322950205}]},"active_addr":"172.21.15.97:6833/322950205","active_change":"2024-09-12T17:36:06.701461+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":376166098}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":98486549}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1499194386}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":783509614}]}]} 2024-09-12T17:36:24.526 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:36:24.526 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:36:24.526 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:36:24.806 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:36:24.806 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"140363d0-879c-4957-b68a-2ee681f3fbda","created":"2024-09-12T17:36:01.889308+0000","modified":"2024-09-12T17:36:23.779764+0000","last_up_change":"2024-09-12T17:36:14.691362+0000","last_in_change":"2024-09-12T17:36:04.579304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:36:14.750254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:36:20.516840+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a9c01c8-3996-45b9-9328-cc191a45b1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6801","nonce":642959985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6803","nonce":642959985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6807","nonce":642959985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6805","nonce":642959985}]},"public_addr":"172.21.15.97:6801/642959985","cluster_addr":"172.21.15.97:6803/642959985","heartbeat_back_addr":"172.21.15.97:6807/642959985","heartbeat_front_addr":"172.21.15.97:6805/642959985","state":["exists","up"]},{"osd":1,"uuid":"2f81d0ad-5929-4ee1-876d-08485e1aa27f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6809","nonce":1696697607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6811","nonce":1696697607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6815","nonce":1696697607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6813","nonce":1696697607}]},"public_addr":"172.21.15.97:6809/1696697607","cluster_addr":"172.21.15.97:6811/1696697607","heartbeat_back_addr":"172.21.15.97:6815/1696697607","heartbeat_front_addr":"172.21.15.97:6813/1696697607","state":["exists","up"]},{"osd":2,"uuid":"85086976-50ca-4160-a530-d565fb79d0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6825","nonce":193866730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6827","nonce":193866730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6831","nonce":193866730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6829","nonce":193866730}]},"public_addr":"172.21.15.97:6825/193866730","cluster_addr":"172.21.15.97:6827/193866730","heartbeat_back_addr":"172.21.15.97:6831/193866730","heartbeat_front_addr":"172.21.15.97:6829/193866730","state":["exists","up"]},{"osd":3,"uuid":"dcf75ff5-baf8-426d-a617-76a575141b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6817","nonce":3061077368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6819","nonce":3061077368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6823","nonce":3061077368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6821","nonce":3061077368}]},"public_addr":"172.21.15.97:6817/3061077368","cluster_addr":"172.21.15.97:6819/3061077368","heartbeat_back_addr":"172.21.15.97:6823/3061077368","heartbeat_front_addr":"172.21.15.97:6821/3061077368","state":["exists","up"]},{"osd":4,"uuid":"eb42906d-fd6d-4f9c-b747-78973e5eaf6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6825","nonce":2114276410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6827","nonce":2114276410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6831","nonce":2114276410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6829","nonce":2114276410}]},"public_addr":"172.21.15.154:6825/2114276410","cluster_addr":"172.21.15.154:6827/2114276410","heartbeat_back_addr":"172.21.15.154:6831/2114276410","heartbeat_front_addr":"172.21.15.154:6829/2114276410","state":["exists","up"]},{"osd":5,"uuid":"1f595162-1674-4bb4-9e4a-ad9668dc0d90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6817","nonce":4233979797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6819","nonce":4233979797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6823","nonce":4233979797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6821","nonce":4233979797}]},"public_addr":"172.21.15.154:6817/4233979797","cluster_addr":"172.21.15.154:6819/4233979797","heartbeat_back_addr":"172.21.15.154:6823/4233979797","heartbeat_front_addr":"172.21.15.154:6821/4233979797","state":["exists","up"]},{"osd":6,"uuid":"7a65a21c-542a-47b5-a103-8cbb7db1de88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6801","nonce":2443191286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6803","nonce":2443191286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6807","nonce":2443191286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6805","nonce":2443191286}]},"public_addr":"172.21.15.154:6801/2443191286","cluster_addr":"172.21.15.154:6803/2443191286","heartbeat_back_addr":"172.21.15.154:6807/2443191286","heartbeat_front_addr":"172.21.15.154:6805/2443191286","state":["exists","up"]},{"osd":7,"uuid":"13feed67-5697-4e4b-83cc-0d903f25cbfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6809","nonce":3304684764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6811","nonce":3304684764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6815","nonce":3304684764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6813","nonce":3304684764}]},"public_addr":"172.21.15.154:6809/3304684764","cluster_addr":"172.21.15.154:6811/3304684764","heartbeat_back_addr":"172.21.15.154:6815/3304684764","heartbeat_front_addr":"172.21.15.154:6813/3304684764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.950930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.168590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.753805+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.327355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.362604+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.982481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.835104+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.232583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:36:24.824 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:36:24.824 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:36:25.125 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:36:25.126 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"140363d0-879c-4957-b68a-2ee681f3fbda","created":"2024-09-12T17:36:01.889308+0000","modified":"2024-09-12T17:36:23.779764+0000","last_up_change":"2024-09-12T17:36:14.691362+0000","last_in_change":"2024-09-12T17:36:04.579304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:36:14.750254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:36:20.516840+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a9c01c8-3996-45b9-9328-cc191a45b1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6801","nonce":642959985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6803","nonce":642959985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6807","nonce":642959985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6805","nonce":642959985}]},"public_addr":"172.21.15.97:6801/642959985","cluster_addr":"172.21.15.97:6803/642959985","heartbeat_back_addr":"172.21.15.97:6807/642959985","heartbeat_front_addr":"172.21.15.97:6805/642959985","state":["exists","up"]},{"osd":1,"uuid":"2f81d0ad-5929-4ee1-876d-08485e1aa27f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6809","nonce":1696697607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6811","nonce":1696697607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6815","nonce":1696697607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6813","nonce":1696697607}]},"public_addr":"172.21.15.97:6809/1696697607","cluster_addr":"172.21.15.97:6811/1696697607","heartbeat_back_addr":"172.21.15.97:6815/1696697607","heartbeat_front_addr":"172.21.15.97:6813/1696697607","state":["exists","up"]},{"osd":2,"uuid":"85086976-50ca-4160-a530-d565fb79d0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6825","nonce":193866730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6827","nonce":193866730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6831","nonce":193866730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6829","nonce":193866730}]},"public_addr":"172.21.15.97:6825/193866730","cluster_addr":"172.21.15.97:6827/193866730","heartbeat_back_addr":"172.21.15.97:6831/193866730","heartbeat_front_addr":"172.21.15.97:6829/193866730","state":["exists","up"]},{"osd":3,"uuid":"dcf75ff5-baf8-426d-a617-76a575141b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6817","nonce":3061077368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6819","nonce":3061077368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6823","nonce":3061077368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6821","nonce":3061077368}]},"public_addr":"172.21.15.97:6817/3061077368","cluster_addr":"172.21.15.97:6819/3061077368","heartbeat_back_addr":"172.21.15.97:6823/3061077368","heartbeat_front_addr":"172.21.15.97:6821/3061077368","state":["exists","up"]},{"osd":4,"uuid":"eb42906d-fd6d-4f9c-b747-78973e5eaf6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6825","nonce":2114276410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6827","nonce":2114276410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6831","nonce":2114276410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6829","nonce":2114276410}]},"public_addr":"172.21.15.154:6825/2114276410","cluster_addr":"172.21.15.154:6827/2114276410","heartbeat_back_addr":"172.21.15.154:6831/2114276410","heartbeat_front_addr":"172.21.15.154:6829/2114276410","state":["exists","up"]},{"osd":5,"uuid":"1f595162-1674-4bb4-9e4a-ad9668dc0d90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6817","nonce":4233979797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6819","nonce":4233979797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6823","nonce":4233979797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6821","nonce":4233979797}]},"public_addr":"172.21.15.154:6817/4233979797","cluster_addr":"172.21.15.154:6819/4233979797","heartbeat_back_addr":"172.21.15.154:6823/4233979797","heartbeat_front_addr":"172.21.15.154:6821/4233979797","state":["exists","up"]},{"osd":6,"uuid":"7a65a21c-542a-47b5-a103-8cbb7db1de88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6801","nonce":2443191286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6803","nonce":2443191286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6807","nonce":2443191286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6805","nonce":2443191286}]},"public_addr":"172.21.15.154:6801/2443191286","cluster_addr":"172.21.15.154:6803/2443191286","heartbeat_back_addr":"172.21.15.154:6807/2443191286","heartbeat_front_addr":"172.21.15.154:6805/2443191286","state":["exists","up"]},{"osd":7,"uuid":"13feed67-5697-4e4b-83cc-0d903f25cbfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6809","nonce":3304684764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6811","nonce":3304684764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6815","nonce":3304684764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6813","nonce":3304684764}]},"public_addr":"172.21.15.154:6809/3304684764","cluster_addr":"172.21.15.154:6811/3304684764","heartbeat_back_addr":"172.21.15.154:6815/3304684764","heartbeat_front_addr":"172.21.15.154:6813/3304684764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.950930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.168590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.753805+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.327355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.362604+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.982481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.835104+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.232583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:36:25.144 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:36:25.145 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:36:25.145 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:36:25.146 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:36:25.146 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:36:25.146 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:36:25.147 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:36:25.147 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:36:25.394 INFO:teuthology.orchestra.run.smithi097.stdout:64424509446 2024-09-12T17:36:25.394 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:36:25.406 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-09-12T17:36:25.406 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-09-12T17:36:25.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:36:25.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:36:25.415 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-09-12T17:36:25.416 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:36:25.416 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-09-12T17:36:25.417 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:36:25.420 INFO:teuthology.orchestra.run.smithi097.stdout:64424509444 2024-09-12T17:36:25.420 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:36:25.421 INFO:teuthology.orchestra.run.smithi097.stdout:64424509446 2024-09-12T17:36:25.421 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:36:25.436 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-09-12T17:36:25.437 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:36:25.907 INFO:teuthology.orchestra.run.smithi097.stdout:64424509443 2024-09-12T17:36:25.909 INFO:teuthology.orchestra.run.smithi097.stdout:64424509444 2024-09-12T17:36:25.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.5 2024-09-12T17:36:25.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.1 2024-09-12T17:36:25.945 INFO:teuthology.orchestra.run.smithi097.stdout:64424509443 2024-09-12T17:36:25.947 INFO:teuthology.orchestra.run.smithi097.stdout:64424509443 2024-09-12T17:36:25.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-09-12T17:36:25.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-12T17:36:25.983 INFO:teuthology.orchestra.run.smithi097.stdout:64424509443 2024-09-12T17:36:26.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.2 2024-09-12T17:36:26.016 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2024-09-12T17:36:26.029 INFO:teuthology.orchestra.run.smithi097.stdout:64424509444 2024-09-12T17:36:26.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2024-09-12T17:36:26.036 INFO:teuthology.orchestra.run.smithi097.stdout:64424509442 2024-09-12T17:36:26.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.7 2024-09-12T17:36:26.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.4 2024-09-12T17:36:26.936 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:36:26.939 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:36:26.966 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:36:26.967 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:36:27.007 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:36:27.034 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:36:27.051 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:36:27.055 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:36:27.440 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-09-12T17:36:27.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.5 2024-09-12T17:36:27.463 DEBUG:teuthology.parallel:result is None 2024-09-12T17:36:27.467 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-09-12T17:36:27.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-09-12T17:36:27.493 DEBUG:teuthology.parallel:result is None 2024-09-12T17:36:27.507 INFO:teuthology.orchestra.run.smithi097.stdout:64424509446 2024-09-12T17:36:27.530 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-09-12T17:36:27.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-12T17:36:27.531 DEBUG:teuthology.parallel:result is None 2024-09-12T17:36:27.538 INFO:teuthology.orchestra.run.smithi097.stdout:64424509446 2024-09-12T17:36:27.542 INFO:teuthology.orchestra.run.smithi097.stdout:64424509444 2024-09-12T17:36:27.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-09-12T17:36:27.559 DEBUG:teuthology.parallel:result is None 2024-09-12T17:36:27.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.4 2024-09-12T17:36:27.562 DEBUG:teuthology.parallel:result is None 2024-09-12T17:36:27.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-09-12T17:36:27.568 DEBUG:teuthology.parallel:result is None 2024-09-12T17:36:27.584 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-09-12T17:36:27.595 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-09-12T17:36:27.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.2 2024-09-12T17:36:27.602 DEBUG:teuthology.parallel:result is None 2024-09-12T17:36:27.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-09-12T17:36:27.613 DEBUG:teuthology.parallel:result is None 2024-09-12T17:36:27.613 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:36:27.613 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:36:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:36:27.937 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-12T17:36:27.953 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T17:36:26.714367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223320,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751400,"statfs":{"total":773094113280,"available":772865433600,"internally_reserved":0,"allocated":2965504,"data_stored":1774678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.945954"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.787880+0000","last_change":"2024-09-12T17:36:23.787880+0000","last_active":"2024-09-12T17:36:23.787880+0000","last_peered":"2024-09-12T17:36:23.787880+0000","last_clean":"2024-09-12T17:36:23.787880+0000","last_became_active":"2024-09-12T17:36:22.058794+0000","last_became_peered":"2024-09-12T17:36:22.058794+0000","last_unstale":"2024-09-12T17:36:23.787880+0000","last_undegraded":"2024-09-12T17:36:23.787880+0000","last_fullsized":"2024-09-12T17:36:23.787880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:04.896637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:24.506296+0000","last_change":"2024-09-12T17:36:24.506296+0000","last_active":"2024-09-12T17:36:24.506296+0000","last_peered":"2024-09-12T17:36:24.506296+0000","last_clean":"2024-09-12T17:36:24.506296+0000","last_became_active":"2024-09-12T17:36:22.059379+0000","last_became_peered":"2024-09-12T17:36:22.059379+0000","last_unstale":"2024-09-12T17:36:24.506296+0000","last_undegraded":"2024-09-12T17:36:24.506296+0000","last_fullsized":"2024-09-12T17:36:24.506296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:24.672143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012087210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.786560+0000","last_change":"2024-09-12T17:36:23.786560+0000","last_active":"2024-09-12T17:36:23.786560+0000","last_peered":"2024-09-12T17:36:23.786560+0000","last_clean":"2024-09-12T17:36:23.786560+0000","last_became_active":"2024-09-12T17:36:21.783069+0000","last_became_peered":"2024-09-12T17:36:21.783069+0000","last_unstale":"2024-09-12T17:36:23.786560+0000","last_undegraded":"2024-09-12T17:36:23.786560+0000","last_fullsized":"2024-09-12T17:36:23.786560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:06.261529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135285,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.789441+0000","last_change":"2024-09-12T17:36:23.789441+0000","last_active":"2024-09-12T17:36:23.789441+0000","last_peered":"2024-09-12T17:36:23.789441+0000","last_clean":"2024-09-12T17:36:23.789441+0000","last_became_active":"2024-09-12T17:36:21.786429+0000","last_became_peered":"2024-09-12T17:36:21.786429+0000","last_unstale":"2024-09-12T17:36:23.789441+0000","last_undegraded":"2024-09-12T17:36:23.789441+0000","last_fullsized":"2024-09-12T17:36:23.789441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:14.667779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011387680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.792992+0000","last_change":"2024-09-12T17:36:23.787252+0000","last_active":"2024-09-12T17:36:23.792992+0000","last_peered":"2024-09-12T17:36:23.792992+0000","last_clean":"2024-09-12T17:36:23.792992+0000","last_became_active":"2024-09-12T17:36:21.777173+0000","last_became_peered":"2024-09-12T17:36:21.777173+0000","last_unstale":"2024-09-12T17:36:23.792992+0000","last_undegraded":"2024-09-12T17:36:23.792992+0000","last_fullsized":"2024-09-12T17:36:23.792992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:26.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001776889,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.789501+0000","last_change":"2024-09-12T17:36:23.789501+0000","last_active":"2024-09-12T17:36:23.789501+0000","last_peered":"2024-09-12T17:36:23.789501+0000","last_clean":"2024-09-12T17:36:23.789501+0000","last_became_active":"2024-09-12T17:36:21.786793+0000","last_became_peered":"2024-09-12T17:36:21.786793+0000","last_unstale":"2024-09-12T17:36:23.789501+0000","last_undegraded":"2024-09-12T17:36:23.789501+0000","last_fullsized":"2024-09-12T17:36:23.789501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:31.878088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011925740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.786635+0000","last_change":"2024-09-12T17:36:23.786635+0000","last_active":"2024-09-12T17:36:23.786635+0000","last_peered":"2024-09-12T17:36:23.786635+0000","last_clean":"2024-09-12T17:36:23.786635+0000","last_became_active":"2024-09-12T17:36:21.785026+0000","last_became_peered":"2024-09-12T17:36:21.785026+0000","last_unstale":"2024-09-12T17:36:23.786635+0000","last_undegraded":"2024-09-12T17:36:23.786635+0000","last_fullsized":"2024-09-12T17:36:23.786635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:07.883744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184601,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.787411+0000","last_change":"2024-09-12T17:36:23.787411+0000","last_active":"2024-09-12T17:36:23.787411+0000","last_peered":"2024-09-12T17:36:23.787411+0000","last_clean":"2024-09-12T17:36:23.787411+0000","last_became_active":"2024-09-12T17:36:21.777852+0000","last_became_peered":"2024-09-12T17:36:21.777852+0000","last_unstale":"2024-09-12T17:36:23.787411+0000","last_undegraded":"2024-09-12T17:36:23.787411+0000","last_fullsized":"2024-09-12T17:36:23.787411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:45.393945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019340550000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:24.501966+0000","last_change":"2024-09-12T17:36:16.723179+0000","last_active":"2024-09-12T17:36:24.501966+0000","last_peered":"2024-09-12T17:36:24.501966+0000","last_clean":"2024-09-12T17:36:24.501966+0000","last_became_active":"2024-09-12T17:36:16.722334+0000","last_became_peered":"2024-09-12T17:36:16.722334+0000","last_unstale":"2024-09-12T17:36:24.501966+0000","last_undegraded":"2024-09-12T17:36:24.501966+0000","last_fullsized":"2024-09-12T17:36:24.501966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_clean_scrub_stamp":"2024-09-12T17:36:15.696738+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:31.267846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:36:27.954 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:36:28.231 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:36:28.231 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-12T17:36:28.248 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T17:36:26.714367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223320,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751400,"statfs":{"total":773094113280,"available":772865433600,"internally_reserved":0,"allocated":2965504,"data_stored":1774678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.945954"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.787880+0000","last_change":"2024-09-12T17:36:23.787880+0000","last_active":"2024-09-12T17:36:23.787880+0000","last_peered":"2024-09-12T17:36:23.787880+0000","last_clean":"2024-09-12T17:36:23.787880+0000","last_became_active":"2024-09-12T17:36:22.058794+0000","last_became_peered":"2024-09-12T17:36:22.058794+0000","last_unstale":"2024-09-12T17:36:23.787880+0000","last_undegraded":"2024-09-12T17:36:23.787880+0000","last_fullsized":"2024-09-12T17:36:23.787880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:04.896637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:24.506296+0000","last_change":"2024-09-12T17:36:24.506296+0000","last_active":"2024-09-12T17:36:24.506296+0000","last_peered":"2024-09-12T17:36:24.506296+0000","last_clean":"2024-09-12T17:36:24.506296+0000","last_became_active":"2024-09-12T17:36:22.059379+0000","last_became_peered":"2024-09-12T17:36:22.059379+0000","last_unstale":"2024-09-12T17:36:24.506296+0000","last_undegraded":"2024-09-12T17:36:24.506296+0000","last_fullsized":"2024-09-12T17:36:24.506296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:24.672143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012087210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.786560+0000","last_change":"2024-09-12T17:36:23.786560+0000","last_active":"2024-09-12T17:36:23.786560+0000","last_peered":"2024-09-12T17:36:23.786560+0000","last_clean":"2024-09-12T17:36:23.786560+0000","last_became_active":"2024-09-12T17:36:21.783069+0000","last_became_peered":"2024-09-12T17:36:21.783069+0000","last_unstale":"2024-09-12T17:36:23.786560+0000","last_undegraded":"2024-09-12T17:36:23.786560+0000","last_fullsized":"2024-09-12T17:36:23.786560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:06.261529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135285,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.789441+0000","last_change":"2024-09-12T17:36:23.789441+0000","last_active":"2024-09-12T17:36:23.789441+0000","last_peered":"2024-09-12T17:36:23.789441+0000","last_clean":"2024-09-12T17:36:23.789441+0000","last_became_active":"2024-09-12T17:36:21.786429+0000","last_became_peered":"2024-09-12T17:36:21.786429+0000","last_unstale":"2024-09-12T17:36:23.789441+0000","last_undegraded":"2024-09-12T17:36:23.789441+0000","last_fullsized":"2024-09-12T17:36:23.789441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:14.667779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011387680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.792992+0000","last_change":"2024-09-12T17:36:23.787252+0000","last_active":"2024-09-12T17:36:23.792992+0000","last_peered":"2024-09-12T17:36:23.792992+0000","last_clean":"2024-09-12T17:36:23.792992+0000","last_became_active":"2024-09-12T17:36:21.777173+0000","last_became_peered":"2024-09-12T17:36:21.777173+0000","last_unstale":"2024-09-12T17:36:23.792992+0000","last_undegraded":"2024-09-12T17:36:23.792992+0000","last_fullsized":"2024-09-12T17:36:23.792992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:26.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001776889,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.789501+0000","last_change":"2024-09-12T17:36:23.789501+0000","last_active":"2024-09-12T17:36:23.789501+0000","last_peered":"2024-09-12T17:36:23.789501+0000","last_clean":"2024-09-12T17:36:23.789501+0000","last_became_active":"2024-09-12T17:36:21.786793+0000","last_became_peered":"2024-09-12T17:36:21.786793+0000","last_unstale":"2024-09-12T17:36:23.789501+0000","last_undegraded":"2024-09-12T17:36:23.789501+0000","last_fullsized":"2024-09-12T17:36:23.789501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:31.878088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011925740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.786635+0000","last_change":"2024-09-12T17:36:23.786635+0000","last_active":"2024-09-12T17:36:23.786635+0000","last_peered":"2024-09-12T17:36:23.786635+0000","last_clean":"2024-09-12T17:36:23.786635+0000","last_became_active":"2024-09-12T17:36:21.785026+0000","last_became_peered":"2024-09-12T17:36:21.785026+0000","last_unstale":"2024-09-12T17:36:23.786635+0000","last_undegraded":"2024-09-12T17:36:23.786635+0000","last_fullsized":"2024-09-12T17:36:23.786635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:07.883744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184601,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:23.787411+0000","last_change":"2024-09-12T17:36:23.787411+0000","last_active":"2024-09-12T17:36:23.787411+0000","last_peered":"2024-09-12T17:36:23.787411+0000","last_clean":"2024-09-12T17:36:23.787411+0000","last_became_active":"2024-09-12T17:36:21.777852+0000","last_became_peered":"2024-09-12T17:36:21.777852+0000","last_unstale":"2024-09-12T17:36:23.787411+0000","last_undegraded":"2024-09-12T17:36:23.787411+0000","last_fullsized":"2024-09-12T17:36:23.787411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:45.393945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019340550000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:36:24.501966+0000","last_change":"2024-09-12T17:36:16.723179+0000","last_active":"2024-09-12T17:36:24.501966+0000","last_peered":"2024-09-12T17:36:24.501966+0000","last_clean":"2024-09-12T17:36:24.501966+0000","last_became_active":"2024-09-12T17:36:16.722334+0000","last_became_peered":"2024-09-12T17:36:16.722334+0000","last_unstale":"2024-09-12T17:36:24.501966+0000","last_undegraded":"2024-09-12T17:36:24.501966+0000","last_fullsized":"2024-09-12T17:36:24.501966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_clean_scrub_stamp":"2024-09-12T17:36:15.696738+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:31.267846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:36:28.249 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:36:28.249 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:36:28.251 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:36:28.252 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:36:28.560 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:36:28.560 INFO:teuthology.orchestra.run.smithi097.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:36:28.578 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:36:28.578 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T17:36:28.810 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T17:36:28.810 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T17:36:28.816 DEBUG:teuthology.orchestra.run.smithi097:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T17:36:29.675 INFO:teuthology.orchestra.run.smithi097.stderr:....+...+.......+...........+...+......+.+..+...+............+.......+........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....................+.+.....+.........+......+..................+.......+........+..........+.....+......+..........+...+...............+...........+....+..+.+..+............+.............+......+..+............+.+............+..........................................+...+..+............+....+......+...........+....+.....+...+..................+.........+.+..+...+...+.+...+...........+............+.........+................+........+......+.+...+......+........+............+.............+........+.........+....+......+........+...+...+.........+...+...+........................+..........+...+...............+.....+...+.......+....................+...+.......+...+...........+....+......+.........+.....+............+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T17:36:30.401 INFO:teuthology.orchestra.run.smithi097.stderr:..+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.+..+....+.........+............+.......................+.+...+...............+......+.........+..................+...+.....+.+.....+.+..............+.+.....+....+...+...+..+..................+.............+....................+.......+.....+...+.........+.......+.................................+...+...+............+..............+..........+........+...+.......+..............................+..+.........+....+....................+..........+..+......+..........+..+.+..+...+.......+...+.....+.+......+...............+..+...+.......+........+...+.........+..........+..+....+..+....+...+...+........+....+.....+.+...........+....+..+...+.+...........+....+.....+.........+......+...................+......+.....................+.................+......+....+........+...+............+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T17:36:30.415 INFO:teuthology.orchestra.run.smithi097.stderr:----- 2024-09-12T17:36:30.423 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-12T17:36:30.446 DEBUG:teuthology.orchestra.run.smithi097:> sudo update-ca-certificates 2024-09-12T17:36:30.507 INFO:teuthology.orchestra.run.smithi097.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T17:36:31.055 INFO:teuthology.orchestra.run.smithi097.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-12T17:36:31.074 INFO:teuthology.orchestra.run.smithi097.stdout:1 added, 0 removed; done. 2024-09-12T17:36:31.076 INFO:teuthology.orchestra.run.smithi097.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T17:36:31.079 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:36:32.743 INFO:teuthology.orchestra.run.smithi097.stdout:Adding debian:root.pem 2024-09-12T17:36:32.758 INFO:teuthology.orchestra.run.smithi097.stdout:done. 2024-09-12T17:36:32.758 INFO:teuthology.orchestra.run.smithi097.stdout:done. 2024-09-12T17:36:32.761 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T17:36:32.810 DEBUG:teuthology.orchestra.run.smithi097:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi097.front.sepia.ceph.com 2024-09-12T17:36:33.008 INFO:teuthology.orchestra.run.smithi097.stderr:.............+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+........+...+....+...+..+.......+.........+..+...+.......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.....+.+..+......+.......+...+.....+.......+...+...............+......+........+...+.......+..+...+.+...........+...+.+......+.....+.........+.+...+.................+.+..+...+....+...+..................+........+.......+..+.+......+......+.........+........+.......+...+..+.+...+..+...............+............+.+......+..............+.......+..+.+.....+...................+...........+....+......+.....+...........................+..........+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T17:36:33.026 INFO:teuthology.orchestra.run.smithi097.stderr:.+..+..........+......+...+..+.........+.............+..+...+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.....+......+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+....+.....+.+......+.....+...............+.........+.............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T17:36:33.029 INFO:teuthology.orchestra.run.smithi097.stderr:----- 2024-09-12T17:36:33.032 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:36:33.032 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T17:36:33.078 DEBUG:teuthology.orchestra.run.smithi097:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T17:36:33.128 INFO:teuthology.orchestra.run.smithi097.stderr:Certificate request self-signature ok 2024-09-12T17:36:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:subject=CN = smithi097.front.sepia.ceph.com 2024-09-12T17:36:33.141 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T17:36:33.190 DEBUG:teuthology.orchestra.run.smithi097:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T17:36:33.243 INFO:teuthology.orchestra.run.smithi097.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T17:36:33.243 DEBUG:teuthology.orchestra.run.smithi097:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T17:36:33.291 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:36:33.306 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T17:36:33.306 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:36:33.306 INFO:tasks.rgw:Creating data pools 2024-09-12T17:36:33.306 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:36:33.307 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T17:36:33.838 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:36:33.872 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:36:34.838 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:36:34.879 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:36:35.861 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:36:35.891 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:36:36.858 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:36:36.907 DEBUG:tasks.rgw:Pools created 2024-09-12T17:36:36.907 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T17:36:36.908 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:36:36.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:36:36.908 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:36:36.950 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:36.950 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:38.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:38.953+0000 7fb1b18ac640 0 -- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558ef5b55f40 msgr2=0x558ef5b563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2024-09-12T17:36:38.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:38.957+0000 7fb1b3da69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:38.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:38.961+0000 7fb1b18ac640 0 -- 172.21.15.97:0/1869564511 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x558ef5b6e420 msgr2=0x558ef5b70870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:39.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.165+0000 7fb1b3da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:39.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.165+0000 7fb1b3da69c0 20 realm 2024-09-12T17:36:39.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.165+0000 7fb1b3da69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:39.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.165+0000 7fb1b3da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:39.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.165+0000 7fb1b3da69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:39.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.165+0000 7fb1b3da69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:39.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.165+0000 7fb1b3da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:39.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.165+0000 7fb1b3da69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:39.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.169+0000 7fb1b3da69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:39.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.169+0000 7fb1b3da69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:39.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.173+0000 7fb1b3da69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:36:39.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.173+0000 7fb1b3da69c0 20 searching for the correct realm 2024-09-12T17:36:39.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.201+0000 7fb1b3da69c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:36:39.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.201+0000 7fb1b3da69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:39.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.201+0000 7fb1b3da69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:39.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.201+0000 7fb1b3da69c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:36:39.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.201+0000 7fb1b3da69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:39.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.201+0000 7fb1b3da69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:39.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.201+0000 7fb1b3da69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:39.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.201+0000 7fb1b3da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:39.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.201+0000 7fb1b3da69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:39.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.205+0000 7fb1b3da69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:39.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.205+0000 7fb1b3da69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:39.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.205+0000 7fb1b3da69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:36:39.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.205+0000 7fb1b3da69c0 20 zone default found 2024-09-12T17:36:39.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.205+0000 7fb1b3da69c0 4 Realm: () 2024-09-12T17:36:39.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.205+0000 7fb1b3da69c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:36:39.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.205+0000 7fb1b3da69c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:36:39.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.205+0000 7fb1b3da69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:39.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.205+0000 7fb1b3da69c0 20 zonegroup default 2024-09-12T17:36:39.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.205+0000 7fb1b3da69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:39.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.209+0000 7fb1b3da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:39.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:39.209+0000 7fb1b3da69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:40.897+0000 7fb1b3da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:40.897+0000 7fb1b3da69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:40.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:40.905+0000 7fb1b3da69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:40.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:40.905+0000 7fb1b3da69c0 20 started sync module instance, tier type = 2024-09-12T17:36:40.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:40.905+0000 7fb1b3da69c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:36:42.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.961+0000 7fb1b3da69c0 20 add_watcher() i=0 2024-09-12T17:36:42.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.961+0000 7fb1b3da69c0 20 add_watcher() i=1 2024-09-12T17:36:42.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.961+0000 7fb1b3da69c0 20 add_watcher() i=2 2024-09-12T17:36:42.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.961+0000 7fb1b3da69c0 20 add_watcher() i=3 2024-09-12T17:36:42.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.961+0000 7fb1b3da69c0 20 add_watcher() i=4 2024-09-12T17:36:42.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.961+0000 7fb1b3da69c0 20 add_watcher() i=5 2024-09-12T17:36:42.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.961+0000 7fb1b3da69c0 20 add_watcher() i=6 2024-09-12T17:36:42.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.961+0000 7fb1b3da69c0 20 add_watcher() i=7 2024-09-12T17:36:42.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.961+0000 7fb1b3da69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:42.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T17:36:42.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T17:36:42.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T17:36:42.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T17:36:42.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T17:36:42.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T17:36:42.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T17:36:42.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T17:36:42.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T17:36:42.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T17:36:42.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T17:36:42.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T17:36:42.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.965+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T17:36:42.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T17:36:42.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T17:36:42.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T17:36:42.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T17:36:42.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T17:36:42.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T17:36:42.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T17:36:42.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T17:36:42.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T17:36:42.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T17:36:42.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T17:36:42.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T17:36:42.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T17:36:42.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T17:36:42.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T17:36:42.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.969+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T17:36:42.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T17:36:42.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T17:36:42.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T17:36:42.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T17:36:42.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T17:36:42.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T17:36:42.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T17:36:42.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T17:36:42.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T17:36:42.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T17:36:42.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T17:36:42.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T17:36:42.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T17:36:42.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.973+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T17:36:42.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T17:36:42.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T17:36:42.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T17:36:42.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T17:36:42.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T17:36:42.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T17:36:42.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T17:36:42.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T17:36:42.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T17:36:42.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T17:36:42.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T17:36:42.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.977+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T17:36:42.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T17:36:42.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T17:36:42.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T17:36:42.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T17:36:42.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T17:36:42.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T17:36:42.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T17:36:42.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T17:36:42.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T17:36:42.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T17:36:42.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T17:36:42.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T17:36:42.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T17:36:42.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.981+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T17:36:42.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T17:36:42.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T17:36:42.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T17:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T17:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T17:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T17:36:42.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T17:36:42.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T17:36:42.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T17:36:42.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T17:36:42.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T17:36:42.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T17:36:42.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T17:36:42.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.985+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T17:36:42.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T17:36:42.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T17:36:42.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T17:36:42.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T17:36:42.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T17:36:42.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T17:36:42.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T17:36:42.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T17:36:42.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T17:36:42.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T17:36:42.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T17:36:42.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T17:36:42.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T17:36:42.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.989+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T17:36:42.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T17:36:42.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T17:36:42.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T17:36:42.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T17:36:42.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T17:36:42.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T17:36:42.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T17:36:42.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T17:36:42.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T17:36:42.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T17:36:42.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T17:36:42.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T17:36:42.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T17:36:42.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.993+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T17:36:42.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T17:36:42.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:42.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T17:36:42.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T17:36:42.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T17:36:43.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T17:36:43.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T17:36:43.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T17:36:43.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T17:36:43.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T17:36:43.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:42.997+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T17:36:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T17:36:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T17:36:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T17:36:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T17:36:43.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T17:36:43.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T17:36:43.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T17:36:43.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T17:36:43.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T17:36:43.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T17:36:43.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T17:36:43.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.001+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T17:36:43.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T17:36:43.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T17:36:43.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T17:36:43.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T17:36:43.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T17:36:43.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T17:36:43.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T17:36:43.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T17:36:43.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T17:36:43.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T17:36:43.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T17:36:43.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.005+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T17:36:43.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T17:36:43.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T17:36:43.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T17:36:43.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T17:36:43.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T17:36:43.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T17:36:43.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T17:36:43.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T17:36:43.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T17:36:43.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T17:36:43.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T17:36:43.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.009+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T17:36:43.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T17:36:43.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T17:36:43.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T17:36:43.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T17:36:43.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T17:36:43.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T17:36:43.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T17:36:43.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T17:36:43.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T17:36:43.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T17:36:43.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T17:36:43.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.013+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T17:36:43.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T17:36:43.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T17:36:43.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T17:36:43.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T17:36:43.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T17:36:43.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T17:36:43.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T17:36:43.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T17:36:43.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T17:36:43.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T17:36:43.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T17:36:43.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T17:36:43.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T17:36:43.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.017+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T17:36:43.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T17:36:43.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T17:36:43.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T17:36:43.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T17:36:43.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T17:36:43.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T17:36:43.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T17:36:43.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T17:36:43.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T17:36:43.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T17:36:43.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T17:36:43.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T17:36:43.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T17:36:43.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.021+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T17:36:43.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T17:36:43.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T17:36:43.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T17:36:43.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T17:36:43.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T17:36:43.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T17:36:43.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T17:36:43.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T17:36:43.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T17:36:43.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T17:36:43.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T17:36:43.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.025+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T17:36:43.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T17:36:43.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T17:36:43.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T17:36:43.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T17:36:43.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T17:36:43.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T17:36:43.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T17:36:43.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T17:36:43.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T17:36:43.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T17:36:43.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T17:36:43.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.029+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T17:36:43.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T17:36:43.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T17:36:43.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T17:36:43.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T17:36:43.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T17:36:43.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T17:36:43.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T17:36:43.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T17:36:43.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T17:36:43.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T17:36:43.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T17:36:43.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.033+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T17:36:43.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T17:36:43.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T17:36:43.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T17:36:43.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T17:36:43.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T17:36:43.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T17:36:43.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T17:36:43.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T17:36:43.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T17:36:43.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T17:36:43.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T17:36:43.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T17:36:43.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T17:36:43.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T17:36:43.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T17:36:43.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.037+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T17:36:43.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T17:36:43.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T17:36:43.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T17:36:43.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T17:36:43.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T17:36:43.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T17:36:43.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T17:36:43.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T17:36:43.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.041+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T17:36:43.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.045+0000 7fb1b3da69c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:36:43.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.053+0000 7fb063fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:43.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.053+0000 7fb1b3da69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:43.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:43.053+0000 7fb1b3da69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:45.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.921+0000 7fb1b3da69c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T17:36:45.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.921+0000 7fb1b3da69c0 5 note: GC not initialized 2024-09-12T17:36:45.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.925+0000 7fb062fe5640 20 reqs_thread_entry: start 2024-09-12T17:36:45.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.925+0000 7fb1b3da69c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:45.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.925+0000 7fb1b3da69c0 20 Filter name: none 2024-09-12T17:36:45.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.925+0000 7fb060fe1640 20 reqs_thread_entry: start 2024-09-12T17:36:45.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.977+0000 7fb063fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:45.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.981+0000 7fb1b3da69c0 20 remove_watcher() i=0 2024-09-12T17:36:45.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.981+0000 7fb1b3da69c0 2 removed watcher, disabling cache 2024-09-12T17:36:45.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.985+0000 7fb1b3da69c0 20 remove_watcher() i=1 2024-09-12T17:36:45.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.989+0000 7fb1b3da69c0 20 remove_watcher() i=2 2024-09-12T17:36:45.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.989+0000 7fb1b3da69c0 20 remove_watcher() i=3 2024-09-12T17:36:45.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.993+0000 7fb1b3da69c0 20 remove_watcher() i=4 2024-09-12T17:36:45.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:45.993+0000 7fb1b3da69c0 20 remove_watcher() i=5 2024-09-12T17:36:46.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.001+0000 7fb1b3da69c0 20 remove_watcher() i=6 2024-09-12T17:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.001+0000 7fb1b3da69c0 20 remove_watcher() i=7 2024-09-12T17:36:46.025 INFO:teuthology.orchestra.run.smithi097.stdout:[] 2024-09-12T17:36:46.026 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:36:46.026 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:36:46.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:36:46.026 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T17:36:46.109 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:46.109 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:46.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.137+0000 7ff9b3ca39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:46.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.137+0000 7ff9b3ca39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:46.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.141+0000 7ff7ef7fe640 20 reqs_thread_entry: start 2024-09-12T17:36:46.168 INFO:teuthology.orchestra.run.smithi097.stdout:{"id":"98539659-fdaf-41ce-847d-239ff89323af","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:36:46.168 DEBUG:tasks.util.rgw: json result: {'id': '98539659-fdaf-41ce-847d-239ff89323af', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:36:46.169 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:36:46.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:36:46.169 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:36:46.238 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:46.238 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.273+0000 7f85674009c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.277+0000 7f85674009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.277+0000 7f85674009c0 20 realm 2024-09-12T17:36:46.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.277+0000 7f85674009c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.277+0000 7f85674009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.277+0000 7f85674009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:46.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.277+0000 7f85674009c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.277+0000 7f85674009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.277+0000 7f85674009c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.277+0000 7f85674009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:46.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.277+0000 7f85674009c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.281+0000 7f85674009c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:36:46.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.281+0000 7f85674009c0 20 searching for the correct realm 2024-09-12T17:36:46.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.285+0000 7f8564f06640 0 -- 172.21.15.97:0/1980440411 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f85540c3c60 msgr2=0x7f8554113400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:46.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.293+0000 7f8564f06640 0 -- 172.21.15.97:0/1980440411 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x5562085a1690 msgr2=0x5562085a3a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:46.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.297+0000 7f85674009c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:36:46.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.297+0000 7f85674009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:46.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.297+0000 7f85674009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:46.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.297+0000 7f85674009c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:36:46.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.297+0000 7f85674009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:46.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.297+0000 7f85674009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:46.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.297+0000 7f85674009c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.297+0000 7f85674009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.297+0000 7f85674009c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.297+0000 7f85674009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:46.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.297+0000 7f85674009c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:36:46.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 20 zone default found 2024-09-12T17:36:46.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 4 Realm: () 2024-09-12T17:36:46.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:36:46.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:36:46.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:46.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 20 zonegroup default 2024-09-12T17:36:46.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 20 started sync module instance, tier type = 2024-09-12T17:36:46.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.301+0000 7f85674009c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:36:46.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.325+0000 7f85674009c0 20 add_watcher() i=0 2024-09-12T17:36:46.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.325+0000 7f85674009c0 20 add_watcher() i=1 2024-09-12T17:36:46.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.325+0000 7f85674009c0 20 add_watcher() i=2 2024-09-12T17:36:46.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.325+0000 7f85674009c0 20 add_watcher() i=3 2024-09-12T17:36:46.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.325+0000 7f85674009c0 20 add_watcher() i=4 2024-09-12T17:36:46.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.325+0000 7f85674009c0 20 add_watcher() i=5 2024-09-12T17:36:46.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.325+0000 7f85674009c0 20 add_watcher() i=6 2024-09-12T17:36:46.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.329+0000 7f85674009c0 20 add_watcher() i=7 2024-09-12T17:36:46.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.329+0000 7f85674009c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.333+0000 7f841b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.333+0000 7f85674009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.333+0000 7f85674009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.333+0000 7f85674009c0 5 note: GC not initialized 2024-09-12T17:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.333+0000 7f841a7e4640 20 reqs_thread_entry: start 2024-09-12T17:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.333+0000 7f85674009c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.333+0000 7f85674009c0 20 Filter name: none 2024-09-12T17:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.333+0000 7f84137fe640 20 reqs_thread_entry: start 2024-09-12T17:36:46.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.353+0000 7f841b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:46.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.357+0000 7f85674009c0 20 remove_watcher() i=0 2024-09-12T17:36:46.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.357+0000 7f85674009c0 2 removed watcher, disabling cache 2024-09-12T17:36:46.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.357+0000 7f85674009c0 20 remove_watcher() i=1 2024-09-12T17:36:46.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.361+0000 7f85674009c0 20 remove_watcher() i=2 2024-09-12T17:36:46.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.361+0000 7f85674009c0 20 remove_watcher() i=3 2024-09-12T17:36:46.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.365+0000 7f85674009c0 20 remove_watcher() i=4 2024-09-12T17:36:46.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.365+0000 7f85674009c0 20 remove_watcher() i=5 2024-09-12T17:36:46.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.369+0000 7f85674009c0 20 remove_watcher() i=6 2024-09-12T17:36:46.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.373+0000 7f85674009c0 20 remove_watcher() i=7 2024-09-12T17:36:46.389 INFO:teuthology.orchestra.run.smithi097.stdout:[] 2024-09-12T17:36:46.389 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:36:46.390 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:36:46.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:36:46.390 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T17:36:46.472 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:46.472 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:46.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.497+0000 7f2bfc6289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:46.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.497+0000 7f2bfc6289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:46.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.501+0000 7f2abcfe1640 20 reqs_thread_entry: start 2024-09-12T17:36:46.528 INFO:teuthology.orchestra.run.smithi097.stdout:{"id":"98539659-fdaf-41ce-847d-239ff89323af","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:36:46.528 DEBUG:tasks.util.rgw: json result: {'id': '98539659-fdaf-41ce-847d-239ff89323af', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:36:46.528 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:36:46.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:36:46.529 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:36:46.597 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:46.598 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:46.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.633+0000 7f610b91c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.637+0000 7f610b91c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.637+0000 7f610b91c9c0 20 realm 2024-09-12T17:36:46.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.637+0000 7f610b91c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.637+0000 7f610b91c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.637+0000 7f610b91c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:46.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.637+0000 7f610b91c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.637+0000 7f610b91c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.637+0000 7f610b91c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.637+0000 7f610b91c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:46.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.637+0000 7f610b91c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.641+0000 7f610b91c9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:36:46.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.641+0000 7f610b91c9c0 20 searching for the correct realm 2024-09-12T17:36:46.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.645+0000 7f6109422640 0 -- 172.21.15.97:0/3194493613 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f610411d070 msgr2=0x7f61040baaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:46.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.649+0000 7f6109422640 0 -- 172.21.15.97:0/3194493613 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f60fc02f040 msgr2=0x7f60fc02f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.869+0000 7f610b91c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.869+0000 7f610b91c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.869+0000 7f610b91c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.869+0000 7f610b91c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.869+0000 7f610b91c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.869+0000 7f610b91c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.869+0000 7f610b91c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.869+0000 7f610b91c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.869+0000 7f610b91c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.869+0000 7f610b91c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:46.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.869+0000 7f610b91c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:36:46.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 20 zone default found 2024-09-12T17:36:46.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 4 Realm: () 2024-09-12T17:36:46.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:36:46.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:36:46.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:46.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 20 zonegroup default 2024-09-12T17:36:46.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:46.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:46.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 20 started sync module instance, tier type = 2024-09-12T17:36:46.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.873+0000 7f610b91c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:36:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.901+0000 7f610b91c9c0 20 add_watcher() i=0 2024-09-12T17:36:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.901+0000 7f610b91c9c0 20 add_watcher() i=1 2024-09-12T17:36:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.901+0000 7f610b91c9c0 20 add_watcher() i=2 2024-09-12T17:36:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.901+0000 7f610b91c9c0 20 add_watcher() i=3 2024-09-12T17:36:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.901+0000 7f610b91c9c0 20 add_watcher() i=4 2024-09-12T17:36:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.901+0000 7f610b91c9c0 20 add_watcher() i=5 2024-09-12T17:36:46.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.901+0000 7f610b91c9c0 20 add_watcher() i=6 2024-09-12T17:36:46.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.905+0000 7f610b91c9c0 20 add_watcher() i=7 2024-09-12T17:36:46.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.905+0000 7f610b91c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.909+0000 7f5fbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.909+0000 7f610b91c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.909+0000 7f610b91c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.909+0000 7f610b91c9c0 5 note: GC not initialized 2024-09-12T17:36:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.909+0000 7f5fbe7e4640 20 reqs_thread_entry: start 2024-09-12T17:36:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.909+0000 7f610b91c9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.913+0000 7f610b91c9c0 20 Filter name: none 2024-09-12T17:36:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.913+0000 7f5f2ffff640 20 reqs_thread_entry: start 2024-09-12T17:36:46.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.933+0000 7f5fbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:46.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.937+0000 7f610b91c9c0 20 remove_watcher() i=0 2024-09-12T17:36:46.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.937+0000 7f610b91c9c0 2 removed watcher, disabling cache 2024-09-12T17:36:46.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.937+0000 7f610b91c9c0 20 remove_watcher() i=1 2024-09-12T17:36:46.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.941+0000 7f610b91c9c0 20 remove_watcher() i=2 2024-09-12T17:36:46.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.945+0000 7f610b91c9c0 20 remove_watcher() i=3 2024-09-12T17:36:46.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.945+0000 7f610b91c9c0 20 remove_watcher() i=4 2024-09-12T17:36:46.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.949+0000 7f610b91c9c0 20 remove_watcher() i=5 2024-09-12T17:36:46.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.949+0000 7f610b91c9c0 20 remove_watcher() i=6 2024-09-12T17:36:46.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:46.953+0000 7f610b91c9c0 20 remove_watcher() i=7 2024-09-12T17:36:46.972 INFO:teuthology.orchestra.run.smithi097.stdout:[] 2024-09-12T17:36:46.972 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:36:46.972 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T17:36:46.972 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:36:46.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:36:46.973 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T17:36:47.056 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:47.056 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:47.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.085+0000 7f0040f619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:47.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.085+0000 7f0040f619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:47.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.089+0000 7eff017e2640 20 reqs_thread_entry: start 2024-09-12T17:36:47.111 INFO:teuthology.orchestra.run.smithi097.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T17:36:47.111 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T17:36:47.111 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:36:47.111 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:36:47.111 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T17:36:47.198 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:47.198 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:47.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.225+0000 7f835651f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:47.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.225+0000 7f835651f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:47.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.229+0000 7f81ba7fc640 20 reqs_thread_entry: start 2024-09-12T17:36:47.252 INFO:teuthology.orchestra.run.smithi097.stdout:{"id":"98539659-fdaf-41ce-847d-239ff89323af","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:36:47.253 DEBUG:tasks.util.rgw: json result: {'id': '98539659-fdaf-41ce-847d-239ff89323af', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:36:47.253 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T17:36:47.253 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:36:47.253 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:36:47.253 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T17:36:47.333 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:47.333 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:47.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.357+0000 7f8efc51f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:47.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.357+0000 7f8efc51f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:47.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.361+0000 7f8dbd7e2640 20 reqs_thread_entry: start 2024-09-12T17:36:47.384 INFO:teuthology.orchestra.run.smithi097.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T17:36:47.384 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T17:36:47.385 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:36:47.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:36:47.385 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T17:36:47.464 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:47.465 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:47.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.489+0000 7f65f99a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:47.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.489+0000 7f65f99a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:47.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:36:47.493+0000 7f64b67fc640 20 reqs_thread_entry: start 2024-09-12T17:36:47.519 INFO:teuthology.orchestra.run.smithi097.stdout:{"id":"98539659-fdaf-41ce-847d-239ff89323af","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:36:47.520 DEBUG:tasks.util.rgw: json result: {'id': '98539659-fdaf-41ce-847d-239ff89323af', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:36:47.520 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:36:47.520 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T17:36:47.520 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:36:47.520 DEBUG:teuthology.orchestra.run.smithi097:> sudo echo -n https://smithi097.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:36:47.573 INFO:teuthology.orchestra.run.smithi097.stdout:https://smithi097.front.sepia.ceph.com:443 2024-09-12T17:36:47.573 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:36:47.624 DEBUG:teuthology.orchestra.run.smithi097:> sudo keytool -import -alias smithi097.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T17:36:48.156 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T17:36:48.487 INFO:teuthology.orchestra.run.smithi097.stderr:Certificate was added to keystore 2024-09-12T17:36:48.524 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T17:36:48.525 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:36:48.525 DEBUG:teuthology.orchestra.run.smithi097:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:36:48.527 INFO:tasks.rgw.client.0:Started 2024-09-12T17:36:48.527 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi097.front.sepia.ceph.com:443/ 2024-09-12T17:36:48.528 DEBUG:teuthology.orchestra.run.smithi097:> curl https://smithi097.front.sepia.ceph.com:443/ 2024-09-12T17:36:48.549 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:36:48.549 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:36:48.549 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:36:48.550 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:36:48.550 INFO:teuthology.orchestra.run.smithi097.stderr:curl: (7) Failed to connect to smithi097.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T17:36:49.550 DEBUG:teuthology.orchestra.run.smithi097:> curl https://smithi097.front.sepia.ceph.com:443/ 2024-09-12T17:36:49.561 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:36:49.561 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:36:49.561 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:36:49.561 INFO:teuthology.orchestra.run.smithi097.stderr:curl: (7) Failed to connect to smithi097.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T17:36:49.562 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:36:51.563 DEBUG:teuthology.orchestra.run.smithi097:> curl https://smithi097.front.sepia.ceph.com:443/ 2024-09-12T17:36:51.574 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:36:51.575 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:36:51.575 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:36:51.575 INFO:teuthology.orchestra.run.smithi097.stderr:curl: (7) Failed to connect to smithi097.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T17:36:51.575 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:36:55.576 DEBUG:teuthology.orchestra.run.smithi097:> curl https://smithi097.front.sepia.ceph.com:443/ 2024-09-12T17:36:55.588 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:36:55.588 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:36:55.588 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:36:55.589 INFO:teuthology.orchestra.run.smithi097.stderr:curl: (7) Failed to connect to smithi097.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T17:36:55.589 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:37:03.590 DEBUG:teuthology.orchestra.run.smithi097:> curl https://smithi097.front.sepia.ceph.com:443/ 2024-09-12T17:37:03.601 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:37:03.601 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:37:03.601 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:37:03.601 INFO:teuthology.orchestra.run.smithi097.stderr:curl: (7) Failed to connect to smithi097.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T17:37:03.601 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:37:13.537 INFO:tasks.rgw.client.0.smithi097.stdout:2024-09-12T17:37:13.175+0000 8ed9f80 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T17:37:19.602 DEBUG:teuthology.orchestra.run.smithi097:> curl https://smithi097.front.sepia.ceph.com:443/ 2024-09-12T17:37:19.614 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:37:19.614 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:37:20.733 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 100 187 0 187 0 0 167 0 --:--:-- 0:00:01 --:--:-- 167 2024-09-12T17:37:20.739 INFO:teuthology.orchestra.run.smithi097.stdout:anonymous 2024-09-12T17:37:20.739 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T17:37:20.752 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T17:37:20.752 DEBUG:teuthology.orchestra.run.smithi097:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T17:37:23.982 DEBUG:teuthology.orchestra.run.smithi097:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T17:37:24.629 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting tox==3.15.0 2024-09-12T17:37:24.728 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T17:37:24.798 INFO:teuthology.orchestra.run.smithi097.stdout: ---------------------------------------- 82.1/82.1 KB 1.2 MB/s eta 0:00:00 2024-09-12T17:37:25.119 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T17:37:25.134 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T17:37:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: ---------------------------------------- 6.0/6.0 MB 35.0 MB/s eta 0:00:00 2024-09-12T17:37:25.412 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting six<2,>=1.14.0 2024-09-12T17:37:25.428 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:37:25.538 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T17:37:25.554 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T17:37:25.643 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting toml>=0.9.4 2024-09-12T17:37:25.660 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T17:37:25.797 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting py<2,>=1.4.17 2024-09-12T17:37:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T17:37:25.853 INFO:teuthology.orchestra.run.smithi097.stdout: ---------------------------------------- 98.7/98.7 KB 2.5 MB/s eta 0:00:00 2024-09-12T17:37:25.966 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting packaging>=14 2024-09-12T17:37:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T17:37:26.011 INFO:teuthology.orchestra.run.smithi097.stdout: ---------------------------------------- 54.0/54.0 KB 1.8 MB/s eta 0:00:00 2024-09-12T17:37:26.125 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T17:37:26.141 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T17:37:26.308 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T17:37:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T17:37:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: -------------------------------------- 468.9/468.9 KB 12.8 MB/s eta 0:00:00 2024-09-12T17:37:26.471 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T17:37:26.487 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T17:37:26.672 INFO:teuthology.orchestra.run.smithi097.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T17:37:27.665 INFO:teuthology.orchestra.run.smithi097.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T17:37:27.748 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:37:27.762 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:37:27.762 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:37:27.763 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:37:27.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:37:27.769 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:37:27.769 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:37:27.815 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:37:27.816 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:37:27.863 INFO:tasks.workunit:timeout=3h 2024-09-12T17:37:27.864 INFO:tasks.workunit:cleanup=True 2024-09-12T17:37:27.864 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:37:27.914 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:38:25.760 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:38:25.761 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:25.761 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:38:25.761 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:38:25.761 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:38:25.761 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:25.761 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:38:25.761 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:38:25.762 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:25.762 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-09-12T17:38:25.762 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:25.762 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-09-12T17:38:25.762 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:25.762 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-09-12T17:38:25.762 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:25.762 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:38:25.762 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:25.762 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:38:25.767 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:38:25.818 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:38:25.820 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:38:25.821 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:38:26.677 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:38:26.762 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:38:26.821 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:38:26.823 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:38:26.823 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:38:26.871 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:38:26.875 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:38:26.875 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:38:26.924 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T17:38:26.925 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T17:38:26.926 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:38:26.977 INFO:tasks.workunit.client.0.smithi097.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:38:26.977 INFO:tasks.workunit.client.0.smithi097.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:38:26.977 INFO:tasks.workunit.client.0.smithi097.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:38:29.875 INFO:tasks.workunit.client.0.smithi097.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:38:29.875 INFO:tasks.workunit.client.0.smithi097.stderr:++ deactivate nondestructive 2024-09-12T17:38:29.875 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T17:38:29.875 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T17:38:29.875 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:38:29.875 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-12T17:38:29.875 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T17:38:29.875 INFO:tasks.workunit.client.0.smithi097.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:38:29.875 INFO:tasks.workunit.client.0.smithi097.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:38:29.875 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ export VIRTUAL_ENV 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PATH 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -z '' ']' 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ PS1='(rgw) ' 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PS1 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:38:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-12T17:38:29.877 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install pip --upgrade 2024-09-12T17:38:30.233 INFO:tasks.workunit.client.0.smithi097.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:38:30.471 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting pip 2024-09-12T17:38:30.570 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:38:30.782 INFO:tasks.workunit.client.0.smithi097.stdout: ---------------------------------------- 1.8/1.8 MB 8.8 MB/s eta 0:00:00 2024-09-12T17:38:30.855 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: pip 2024-09-12T17:38:30.856 INFO:tasks.workunit.client.0.smithi097.stdout: Attempting uninstall: pip 2024-09-12T17:38:30.856 INFO:tasks.workunit.client.0.smithi097.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:38:31.128 INFO:tasks.workunit.client.0.smithi097.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:38:31.134 INFO:tasks.workunit.client.0.smithi097.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:38:31.867 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed pip-24.2 2024-09-12T17:38:31.927 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install boto3 2024-09-12T17:38:33.074 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting boto3 2024-09-12T17:38:33.120 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:38:33.803 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:38:33.817 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:38:33.938 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:38:33.953 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:38:34.108 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:38:34.125 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:38:34.280 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:38:34.297 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:38:34.526 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:38:34.541 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:38:34.801 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:38:34.816 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:38:34.882 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:38:34.970 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:38:35.213 INFO:tasks.workunit.client.0.smithi097.stdout: ---------------------------------------- 12.5/12.5 MB 54.5 MB/s eta 0:00:00 2024-09-12T17:38:35.230 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:38:35.296 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:38:35.364 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:38:35.429 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:38:35.497 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:38:35.644 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:38:36.771 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:38:37.198 INFO:tasks.workunit.client.0.smithi097.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T17:38:37.346 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T17:38:37.383 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:37.384 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.422+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.426+0000 7ff6da6cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.426+0000 7ff6da6cc9c0 20 realm 2024-09-12T17:38:37.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.426+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.426+0000 7ff6da6cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.426+0000 7ff6da6cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:37.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.426+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.426+0000 7ff6da6cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.426+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.426+0000 7ff6da6cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:37.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.426+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.430+0000 7ff6da6cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:37.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.430+0000 7ff6da6cc9c0 20 searching for the correct realm 2024-09-12T17:38:37.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.434+0000 7ff6d89d3640 0 -- 172.21.15.97:0/1200690689 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7ff6cc08fc20 msgr2=0x7ff6cc088a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:37.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.442+0000 7ff6d81d2640 0 -- 172.21.15.97:0/1200690689 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7ff6d0029920 msgr2=0x7ff6d0019430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:37.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:37.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:37.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:37.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:37.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:37.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:37.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:37.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 zone default found 2024-09-12T17:38:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 4 Realm: () 2024-09-12T17:38:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 zonegroup default 2024-09-12T17:38:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 started sync module instance, tier type = 2024-09-12T17:38:37.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.450+0000 7ff6da6cc9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:37.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.474+0000 7ff6da6cc9c0 20 add_watcher() i=0 2024-09-12T17:38:37.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.474+0000 7ff6da6cc9c0 20 add_watcher() i=1 2024-09-12T17:38:37.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.474+0000 7ff6da6cc9c0 20 add_watcher() i=2 2024-09-12T17:38:37.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.474+0000 7ff6da6cc9c0 20 add_watcher() i=3 2024-09-12T17:38:37.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.474+0000 7ff6da6cc9c0 20 add_watcher() i=4 2024-09-12T17:38:37.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.474+0000 7ff6da6cc9c0 20 add_watcher() i=5 2024-09-12T17:38:37.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.474+0000 7ff6da6cc9c0 20 add_watcher() i=6 2024-09-12T17:38:37.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.474+0000 7ff6da6cc9c0 20 add_watcher() i=7 2024-09-12T17:38:37.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.474+0000 7ff6da6cc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:37.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff58efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:37.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:37.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:37.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 5 note: GC not initialized 2024-09-12T17:38:37.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff58dfdb640 20 reqs_thread_entry: start 2024-09-12T17:38:37.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:37.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 20 Filter name: none 2024-09-12T17:38:37.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff4ff7fe640 20 reqs_thread_entry: start 2024-09-12T17:38:37.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T17:38:37.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T17:38:37.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:38:37.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T17:38:37.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.478+0000 7ff6da6cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.482+0000 7ff6da6cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.482+0000 7ff6da6cc9c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T17:38:37.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.482+0000 7ff6da6cc9c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:38:37.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.482+0000 7ff6da6cc9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:38:37.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.482+0000 7ff6da6cc9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:38:37.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.482+0000 7ff6da6cc9c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:38:37.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.482+0000 7ff6da6cc9c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:38:37.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.482+0000 7ff6da6cc9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T17:38:37.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.482+0000 7ff5af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 93901996248672 notifier 4659 bl.length()=593 2024-09-12T17:38:37.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.482+0000 7ff5af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:38:37.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.482+0000 7ff5af7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:38:37.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.510+0000 7ff6da6cc9c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:38:37.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.510+0000 7ff6da6cc9c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:38:37.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.510+0000 7ff6da6cc9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T17:38:37.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.510+0000 7ff5af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 93901996242608 notifier 4659 bl.length()=186 2024-09-12T17:38:37.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.510+0000 7ff5af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:38:37.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.510+0000 7ff5af7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:38:37.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.514+0000 7ff58efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:37.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.518+0000 7ff6da6cc9c0 20 remove_watcher() i=0 2024-09-12T17:38:37.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.518+0000 7ff6da6cc9c0 2 removed watcher, disabling cache 2024-09-12T17:38:37.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.522+0000 7ff6da6cc9c0 20 remove_watcher() i=1 2024-09-12T17:38:37.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.522+0000 7ff6da6cc9c0 20 remove_watcher() i=2 2024-09-12T17:38:37.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.526+0000 7ff6da6cc9c0 20 remove_watcher() i=3 2024-09-12T17:38:37.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.526+0000 7ff6da6cc9c0 20 remove_watcher() i=4 2024-09-12T17:38:37.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.530+0000 7ff6da6cc9c0 20 remove_watcher() i=5 2024-09-12T17:38:37.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.534+0000 7ff6da6cc9c0 20 remove_watcher() i=6 2024-09-12T17:38:37.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:37.534+0000 7ff6da6cc9c0 20 remove_watcher() i=7 2024-09-12T17:38:37.820 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:37.820 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:38.071 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:38.071 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:38.257 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:38.258 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:38.823 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:38.823 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:39.733 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:39.733 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:39.999 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:39.999 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:40.173 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:40.173 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:40.246 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:40.246 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:40.426 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:40.426 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:40.787 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:40.787 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:40.890 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:40.890 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:41.037 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:41.038 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:41.108 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:41.108 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:41.250 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:41.250 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:41.318 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:41.318 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:41.460 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:41.460 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:41.526 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T17:38:41.526 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:41.526 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:38:41.562 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:41.562 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.606+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.606+0000 7f14ea8229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.606+0000 7f14ea8229c0 20 realm 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.606+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.606+0000 7f14ea8229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.606+0000 7f14ea8229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.606+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.610+0000 7f14ea8229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.610+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.610+0000 7f14ea8229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.610+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.610+0000 7f14ea8229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.610+0000 7f14ea8229c0 20 searching for the correct realm 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.618+0000 7f14e8b29640 0 -- 172.21.15.97:0/1966285987 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5613590e46b0 msgr2=0x5613590e6ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.626+0000 7f14e8b29640 0 -- 172.21.15.97:0/1966285987 >> [v2:172.21.15.154:6808/3304684764,v1:172.21.15.154:6809/3304684764] conn(0x7f14d8072110 msgr2=0x7f14d8066cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 zone default found 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 4 Realm: () 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 zonegroup default 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.630+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.634+0000 7f14ea8229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.634+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.634+0000 7f14ea8229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.634+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.634+0000 7f14ea8229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.634+0000 7f14ea8229c0 20 started sync module instance, tier type = 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.634+0000 7f14ea8229c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.654+0000 7f14ea8229c0 20 add_watcher() i=0 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.654+0000 7f14ea8229c0 20 add_watcher() i=1 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.654+0000 7f14ea8229c0 20 add_watcher() i=2 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.654+0000 7f14ea8229c0 20 add_watcher() i=3 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.654+0000 7f14ea8229c0 20 add_watcher() i=4 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.654+0000 7f14ea8229c0 20 add_watcher() i=5 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.654+0000 7f14ea8229c0 20 add_watcher() i=6 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.658+0000 7f14ea8229c0 20 add_watcher() i=7 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.658+0000 7f14ea8229c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.658+0000 7f139f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 5 note: GC not initialized 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f139e7dc640 20 reqs_thread_entry: start 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 20 Filter name: none 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f13977fe640 20 reqs_thread_entry: start 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 : miss 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 info.flags=0x17 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 to cache LRU end 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.662+0000 7f14ea8229c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.666+0000 7f14ea8229c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.666+0000 7f14ea8229c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.666+0000 7f14ea8229c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.670+0000 7f14ea8229c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.670+0000 7f14ea8229c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.670+0000 7f14ea8229c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.670+0000 7f14ea8229c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.674+0000 7f14ea8229c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.674+0000 7f14ea8229c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.674+0000 7f14ea8229c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.686+0000 7f139f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.690+0000 7f14ea8229c0 20 remove_watcher() i=0 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.690+0000 7f14ea8229c0 2 removed watcher, disabling cache 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.690+0000 7f14ea8229c0 20 remove_watcher() i=1 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.694+0000 7f14ea8229c0 20 remove_watcher() i=2 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.694+0000 7f14ea8229c0 20 remove_watcher() i=3 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.698+0000 7f14ea8229c0 20 remove_watcher() i=4 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.702+0000 7f14ea8229c0 20 remove_watcher() i=5 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.702+0000 7f14ea8229c0 20 remove_watcher() i=6 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.706+0000 7f14ea8229c0 20 remove_watcher() i=7 2024-09-12T17:38:41.724 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:38:41.752 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:41.752 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:41.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.794+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 20 realm 2024-09-12T17:38:41.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:41.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:41.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.798+0000 7fba94daa9c0 20 searching for the correct realm 2024-09-12T17:38:41.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.806+0000 7fba920af640 0 -- 172.21.15.97:0/3340511533 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fba88008040 msgr2=0x7fba88063e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.810+0000 7fba928b0640 0 -- 172.21.15.97:0/3340511533 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fba8c0fba20 msgr2=0x7fba8c0fa490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:41.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:41.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:41.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:41.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:41.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:41.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:41.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 zone default found 2024-09-12T17:38:41.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 4 Realm: () 2024-09-12T17:38:41.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:41.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:41.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:41.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 zonegroup default 2024-09-12T17:38:41.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 started sync module instance, tier type = 2024-09-12T17:38:41.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.818+0000 7fba94daa9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:41.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.838+0000 7fba94daa9c0 20 add_watcher() i=0 2024-09-12T17:38:41.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.838+0000 7fba94daa9c0 20 add_watcher() i=1 2024-09-12T17:38:41.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.838+0000 7fba94daa9c0 20 add_watcher() i=2 2024-09-12T17:38:41.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.838+0000 7fba94daa9c0 20 add_watcher() i=3 2024-09-12T17:38:41.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.838+0000 7fba94daa9c0 20 add_watcher() i=4 2024-09-12T17:38:41.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.838+0000 7fba94daa9c0 20 add_watcher() i=5 2024-09-12T17:38:41.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.838+0000 7fba94daa9c0 20 add_watcher() i=6 2024-09-12T17:38:41.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.842+0000 7fba94daa9c0 20 add_watcher() i=7 2024-09-12T17:38:41.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.842+0000 7fba94daa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:41.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.846+0000 7fb9497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:41.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.846+0000 7fba94daa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:41.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.846+0000 7fba94daa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:41.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.846+0000 7fba94daa9c0 5 note: GC not initialized 2024-09-12T17:38:41.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.846+0000 7fb8c3fff640 20 reqs_thread_entry: start 2024-09-12T17:38:41.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.846+0000 7fba94daa9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:41.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.846+0000 7fba94daa9c0 20 Filter name: none 2024-09-12T17:38:41.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.846+0000 7fb8c1ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:41.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.846+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.850+0000 7fba94daa9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:41.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.850+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.850+0000 7fba94daa9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:41.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.850+0000 7fba94daa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:41.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.850+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.850+0000 7fba94daa9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:41.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.850+0000 7fba94daa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.850+0000 7fba94daa9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:41.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.850+0000 7fba94daa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:41.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.854+0000 7fb9497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:41.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.858+0000 7fba94daa9c0 20 remove_watcher() i=0 2024-09-12T17:38:41.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.858+0000 7fba94daa9c0 2 removed watcher, disabling cache 2024-09-12T17:38:41.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.862+0000 7fba94daa9c0 20 remove_watcher() i=1 2024-09-12T17:38:41.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.862+0000 7fba94daa9c0 20 remove_watcher() i=2 2024-09-12T17:38:41.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.866+0000 7fba94daa9c0 20 remove_watcher() i=3 2024-09-12T17:38:41.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.866+0000 7fba94daa9c0 20 remove_watcher() i=4 2024-09-12T17:38:41.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.870+0000 7fba94daa9c0 20 remove_watcher() i=5 2024-09-12T17:38:41.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.874+0000 7fba94daa9c0 20 remove_watcher() i=6 2024-09-12T17:38:41.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.874+0000 7fba94daa9c0 20 remove_watcher() i=7 2024-09-12T17:38:41.892 INFO:tasks.workunit.client.0.smithi097.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 109, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T17:38:41.892 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T17:38:41.892 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:41.892 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:38:41.923 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:41.923 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.966+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.966+0000 7f7d44d7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.966+0000 7f7d44d7d9c0 20 realm 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.966+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.966+0000 7f7d44d7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.966+0000 7f7d44d7d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.966+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.970+0000 7f7d44d7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.970+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.970+0000 7f7d44d7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.970+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.970+0000 7f7d44d7d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.970+0000 7f7d44d7d9c0 20 searching for the correct realm 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.978+0000 7f7d42082640 0 -- 172.21.15.97:0/1366924294 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f7d3801fbc0 msgr2=0x7f7d38010950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.982+0000 7f7d43084640 0 -- 172.21.15.97:0/1366924294 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55f6b9600610 msgr2=0x55f6b9602ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 zone default found 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 4 Realm: () 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 zonegroup default 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.990+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.994+0000 7f7d44d7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.994+0000 7f7d44d7d9c0 20 started sync module instance, tier type = 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:41.994+0000 7f7d44d7d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.010+0000 7f7d44d7d9c0 20 add_watcher() i=0 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.010+0000 7f7d44d7d9c0 20 add_watcher() i=1 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.010+0000 7f7d44d7d9c0 20 add_watcher() i=2 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.010+0000 7f7d44d7d9c0 20 add_watcher() i=3 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.010+0000 7f7d44d7d9c0 20 add_watcher() i=4 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.010+0000 7f7d44d7d9c0 20 add_watcher() i=5 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.014+0000 7f7d44d7d9c0 20 add_watcher() i=6 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.014+0000 7f7d44d7d9c0 20 add_watcher() i=7 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.014+0000 7f7d44d7d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7bf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 5 note: GC not initialized 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7b73fff640 20 reqs_thread_entry: start 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 20 Filter name: none 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7b71ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 : miss 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.018+0000 7f7d44d7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 info.flags=0x17 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 to cache LRU end 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.022+0000 7f7d44d7d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.026+0000 7f7d44d7d9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.026+0000 7f7d44d7d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.026+0000 7f7d44d7d9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.026+0000 7f7d44d7d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.026+0000 7f7d44d7d9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.026+0000 7f7d44d7d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.026+0000 7f7d44d7d9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.026+0000 7f7d44d7d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.030+0000 7f7d44d7d9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.030+0000 7f7d44d7d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.030+0000 7f7d44d7d9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.030+0000 7f7d44d7d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.030+0000 7f7d44d7d9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.030+0000 7f7d44d7d9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.030+0000 7f7bf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.038+0000 7f7d44d7d9c0 20 remove_watcher() i=0 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.038+0000 7f7d44d7d9c0 2 removed watcher, disabling cache 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.038+0000 7f7d44d7d9c0 20 remove_watcher() i=1 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.042+0000 7f7d44d7d9c0 20 remove_watcher() i=2 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.042+0000 7f7d44d7d9c0 20 remove_watcher() i=3 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.046+0000 7f7d44d7d9c0 20 remove_watcher() i=4 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.046+0000 7f7d44d7d9c0 20 remove_watcher() i=5 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.050+0000 7f7d44d7d9c0 20 remove_watcher() i=6 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:42.054+0000 7f7d44d7d9c0 20 remove_watcher() i=7 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:38:42.553 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:38:43.999 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:43.999 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:44.208 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:38:44.209 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:38:44.243 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:44.244 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:44.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.286+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.290+0000 7f94ae26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:44.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.290+0000 7f94ae26b9c0 20 realm 2024-09-12T17:38:44.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.290+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.290+0000 7f94ae26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:44.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.290+0000 7f94ae26b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:44.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.290+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.290+0000 7f94ae26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:44.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.290+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.290+0000 7f94ae26b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:44.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.290+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.294+0000 7f94ae26b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:44.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.294+0000 7f94ae26b9c0 20 searching for the correct realm 2024-09-12T17:38:44.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.298+0000 7f94ab570640 0 -- 172.21.15.97:0/499157840 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f94a00f6e80 msgr2=0x7f94a01126d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:44.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.302+0000 7f94abd71640 0 -- 172.21.15.97:0/499157840 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f94a4060f70 msgr2=0x7f94a405f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:44.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.310+0000 7f94ae26b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:44.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.310+0000 7f94ae26b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:44.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.310+0000 7f94ae26b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:44.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.310+0000 7f94ae26b9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:44.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.310+0000 7f94ae26b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:44.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.310+0000 7f94ae26b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:44.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.310+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.310+0000 7f94ae26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:44.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.310+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:44.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:44.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 zone default found 2024-09-12T17:38:44.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 4 Realm: () 2024-09-12T17:38:44.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:44.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:44.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:44.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 zonegroup default 2024-09-12T17:38:44.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:44.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:44.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:44.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 started sync module instance, tier type = 2024-09-12T17:38:44.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.314+0000 7f94ae26b9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:44.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.338+0000 7f94ae26b9c0 20 add_watcher() i=0 2024-09-12T17:38:44.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.338+0000 7f94ae26b9c0 20 add_watcher() i=1 2024-09-12T17:38:44.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.338+0000 7f94ae26b9c0 20 add_watcher() i=2 2024-09-12T17:38:44.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.338+0000 7f94ae26b9c0 20 add_watcher() i=3 2024-09-12T17:38:44.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.338+0000 7f94ae26b9c0 20 add_watcher() i=4 2024-09-12T17:38:44.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.338+0000 7f94ae26b9c0 20 add_watcher() i=5 2024-09-12T17:38:44.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.338+0000 7f94ae26b9c0 20 add_watcher() i=6 2024-09-12T17:38:44.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.342+0000 7f94ae26b9c0 20 add_watcher() i=7 2024-09-12T17:38:44.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.342+0000 7f94ae26b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:44.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f9361fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 5 note: GC not initialized 2024-09-12T17:38:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f9360fe1640 20 reqs_thread_entry: start 2024-09-12T17:38:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 Filter name: none 2024-09-12T17:38:44.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f92da7fc640 20 reqs_thread_entry: start 2024-09-12T17:38:44.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:44.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:44.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:44.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:44.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 INFO: main: starting shard=0 2024-09-12T17:38:44.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.346+0000 7f94ae26b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:44.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:44.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 INFO: main: starting shard=1 2024-09-12T17:38:44.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:44.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:44.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 INFO: main: starting shard=2 2024-09-12T17:38:44.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:44.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:44.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 INFO: main: starting shard=3 2024-09-12T17:38:44.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:44.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:44.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 INFO: main: starting shard=4 2024-09-12T17:38:44.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.350+0000 7f94ae26b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:44.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:44.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 INFO: main: starting shard=5 2024-09-12T17:38:44.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:44.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:44.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 INFO: main: starting shard=6 2024-09-12T17:38:44.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:44.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:44.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 INFO: main: starting shard=7 2024-09-12T17:38:44.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:44.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:44.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 INFO: main: starting shard=8 2024-09-12T17:38:44.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.354+0000 7f94ae26b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:44.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.358+0000 7f94ae26b9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:38:44.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.358+0000 7f94ae26b9c0 20 INFO: main: starting shard=9 2024-09-12T17:38:44.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.358+0000 7f94ae26b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:44.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.358+0000 7f94ae26b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:44.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.358+0000 7f94ae26b9c0 20 INFO: main: starting shard=10 2024-09-12T17:38:44.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.358+0000 7f94ae26b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:44.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.358+0000 7f94ae26b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:44.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.358+0000 7f94ae26b9c0 20 INFO: main: done 2024-09-12T17:38:44.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.358+0000 7f9361fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:44.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.362+0000 7f94ae26b9c0 20 remove_watcher() i=0 2024-09-12T17:38:44.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.362+0000 7f94ae26b9c0 2 removed watcher, disabling cache 2024-09-12T17:38:44.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.366+0000 7f94ae26b9c0 20 remove_watcher() i=1 2024-09-12T17:38:44.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.366+0000 7f94ae26b9c0 20 remove_watcher() i=2 2024-09-12T17:38:44.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.370+0000 7f94ae26b9c0 20 remove_watcher() i=3 2024-09-12T17:38:44.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.370+0000 7f94ae26b9c0 20 remove_watcher() i=4 2024-09-12T17:38:44.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.374+0000 7f94ae26b9c0 20 remove_watcher() i=5 2024-09-12T17:38:44.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.378+0000 7f94ae26b9c0 20 remove_watcher() i=6 2024-09-12T17:38:44.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.378+0000 7f94ae26b9c0 20 remove_watcher() i=7 2024-09-12T17:38:44.399 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:44.400 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:44.443 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:44.444 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:44.621 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:38:44.621 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:38:44.656 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:44.656 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:44.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.698+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.702+0000 7f2c139959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:44.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.702+0000 7f2c139959c0 20 realm 2024-09-12T17:38:44.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.702+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.702+0000 7f2c139959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:44.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.702+0000 7f2c139959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:44.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.702+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.702+0000 7f2c139959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:44.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.702+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.702+0000 7f2c139959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:44.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.702+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:44.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.706+0000 7f2c139959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:44.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.706+0000 7f2c139959c0 20 searching for the correct realm 2024-09-12T17:38:44.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.706+0000 7f2c1149b640 0 -- 172.21.15.97:0/2780838875 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f2bfc008070 msgr2=0x7f2bfc07e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:44.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:44.922+0000 7f2c1149b640 0 -- 172.21.15.97:0/2780838875 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f2bf4003be0 msgr2=0x7f2c0c036960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:45.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:45.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:45.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:45.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:45.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:45.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:45.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:45.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:45.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:45.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 zone default found 2024-09-12T17:38:45.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 4 Realm: () 2024-09-12T17:38:45.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:45.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:45.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:45.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 zonegroup default 2024-09-12T17:38:45.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.142+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.146+0000 7f2c139959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:45.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.146+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.146+0000 7f2c139959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:45.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.146+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.146+0000 7f2c139959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:45.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.146+0000 7f2c139959c0 20 started sync module instance, tier type = 2024-09-12T17:38:45.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.146+0000 7f2c139959c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:45.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.170+0000 7f2c139959c0 20 add_watcher() i=0 2024-09-12T17:38:45.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.170+0000 7f2c139959c0 20 add_watcher() i=1 2024-09-12T17:38:45.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.170+0000 7f2c139959c0 20 add_watcher() i=2 2024-09-12T17:38:45.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.170+0000 7f2c139959c0 20 add_watcher() i=3 2024-09-12T17:38:45.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.170+0000 7f2c139959c0 20 add_watcher() i=4 2024-09-12T17:38:45.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.170+0000 7f2c139959c0 20 add_watcher() i=5 2024-09-12T17:38:45.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.170+0000 7f2c139959c0 20 add_watcher() i=6 2024-09-12T17:38:45.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.174+0000 7f2c139959c0 20 add_watcher() i=7 2024-09-12T17:38:45.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.174+0000 7f2c139959c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:45.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.178+0000 7f2ac77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:45.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.178+0000 7f2c139959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:45.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.178+0000 7f2c139959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:45.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.178+0000 7f2c139959c0 5 note: GC not initialized 2024-09-12T17:38:45.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.178+0000 7f2ac67dc640 20 reqs_thread_entry: start 2024-09-12T17:38:45.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.178+0000 7f2c139959c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:45.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.178+0000 7f2c139959c0 20 Filter name: none 2024-09-12T17:38:45.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.178+0000 7f2abf7fe640 20 reqs_thread_entry: start 2024-09-12T17:38:45.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.178+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.178+0000 7f2c139959c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:45.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.178+0000 7f2c139959c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.182+0000 7f2c139959c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:45.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.182+0000 7f2c139959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:45.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.182+0000 7f2c139959c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:45.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.182+0000 7f2c139959c0 20 INFO: main: starting shard=0 2024-09-12T17:38:45.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.182+0000 7f2c139959c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:45.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.182+0000 7f2c139959c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:45.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.182+0000 7f2c139959c0 20 INFO: main: starting shard=1 2024-09-12T17:38:45.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.182+0000 7f2c139959c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:45.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.182+0000 7f2c139959c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:45.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.182+0000 7f2c139959c0 20 INFO: main: starting shard=2 2024-09-12T17:38:45.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.182+0000 7f2c139959c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:45.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.186+0000 7f2c139959c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:45.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.186+0000 7f2c139959c0 20 INFO: main: starting shard=3 2024-09-12T17:38:45.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.186+0000 7f2c139959c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:45.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.186+0000 7f2c139959c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:45.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.186+0000 7f2c139959c0 20 INFO: main: starting shard=4 2024-09-12T17:38:45.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.186+0000 7f2c139959c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:45.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.186+0000 7f2c139959c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:45.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.186+0000 7f2c139959c0 20 INFO: main: starting shard=5 2024-09-12T17:38:45.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.186+0000 7f2c139959c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:45.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.186+0000 7f2c139959c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:38:45.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 INFO: main: starting shard=6 2024-09-12T17:38:45.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:45.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:45.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 INFO: main: starting shard=7 2024-09-12T17:38:45.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:45.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:45.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 INFO: main: starting shard=8 2024-09-12T17:38:45.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:45.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:45.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 INFO: main: starting shard=9 2024-09-12T17:38:45.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:45.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:45.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 INFO: main: starting shard=10 2024-09-12T17:38:45.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.190+0000 7f2c139959c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:45.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.194+0000 7f2c139959c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:45.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.194+0000 7f2c139959c0 20 INFO: main: done 2024-09-12T17:38:45.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.194+0000 7f2ac77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:45.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.198+0000 7f2c139959c0 20 remove_watcher() i=0 2024-09-12T17:38:45.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.198+0000 7f2c139959c0 2 removed watcher, disabling cache 2024-09-12T17:38:45.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.202+0000 7f2c139959c0 20 remove_watcher() i=1 2024-09-12T17:38:45.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.206+0000 7f2c139959c0 20 remove_watcher() i=2 2024-09-12T17:38:45.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.206+0000 7f2c139959c0 20 remove_watcher() i=3 2024-09-12T17:38:45.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.210+0000 7f2c139959c0 20 remove_watcher() i=4 2024-09-12T17:38:45.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.210+0000 7f2c139959c0 20 remove_watcher() i=5 2024-09-12T17:38:45.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.214+0000 7f2c139959c0 20 remove_watcher() i=6 2024-09-12T17:38:45.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.218+0000 7f2c139959c0 20 remove_watcher() i=7 2024-09-12T17:38:45.246 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:45.246 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:45.277 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:45.278 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:45.306 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:45.306 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:45.436 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:38:45.437 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:38:45.472 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:45.473 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:45.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.718+0000 7f8c304f3640 0 --2- 172.21.15.97:0/1863218363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55f4cb21e7e0 0x55f4cb21dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:38:45.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.722+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.726+0000 7f8c321ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:45.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.726+0000 7f8c321ec9c0 20 realm 2024-09-12T17:38:45.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.726+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.726+0000 7f8c321ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:45.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.726+0000 7f8c321ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:45.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.726+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.726+0000 7f8c321ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:45.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.726+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.726+0000 7f8c321ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:45.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.726+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.730+0000 7f8c321ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:45.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.730+0000 7f8c321ec9c0 20 searching for the correct realm 2024-09-12T17:38:45.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.734+0000 7f8c2f4f1640 0 -- 172.21.15.97:0/1863218363 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x55f4cb245170 msgr2=0x55f4cb247560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:45.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.742+0000 7f8c2fcf2640 0 -- 172.21.15.97:0/1863218363 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f8c28018b00 msgr2=0x7f8c2805c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:45.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:45.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:45.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:45.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:45.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:45.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:45.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:45.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:45.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:45.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 zone default found 2024-09-12T17:38:45.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 4 Realm: () 2024-09-12T17:38:45.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:45.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:45.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:45.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 zonegroup default 2024-09-12T17:38:45.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:45.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.962+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.966+0000 7f8c321ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:45.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.966+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:45.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.966+0000 7f8c321ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:45.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.966+0000 7f8c321ec9c0 20 started sync module instance, tier type = 2024-09-12T17:38:45.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.966+0000 7f8c321ec9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:45.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.990+0000 7f8c321ec9c0 20 add_watcher() i=0 2024-09-12T17:38:45.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.990+0000 7f8c321ec9c0 20 add_watcher() i=1 2024-09-12T17:38:45.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.990+0000 7f8c321ec9c0 20 add_watcher() i=2 2024-09-12T17:38:45.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.990+0000 7f8c321ec9c0 20 add_watcher() i=3 2024-09-12T17:38:45.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.990+0000 7f8c321ec9c0 20 add_watcher() i=4 2024-09-12T17:38:45.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.990+0000 7f8c321ec9c0 20 add_watcher() i=5 2024-09-12T17:38:45.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.990+0000 7f8c321ec9c0 20 add_watcher() i=6 2024-09-12T17:38:45.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.994+0000 7f8c321ec9c0 20 add_watcher() i=7 2024-09-12T17:38:45.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.994+0000 7f8c321ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:46.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.998+0000 7f8ae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:46.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.998+0000 7f8c321ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:46.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.998+0000 7f8c321ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:46.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.998+0000 7f8c321ec9c0 5 note: GC not initialized 2024-09-12T17:38:46.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.998+0000 7f8ae4fe1640 20 reqs_thread_entry: start 2024-09-12T17:38:46.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.998+0000 7f8c321ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:46.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:45.998+0000 7f8c321ec9c0 20 Filter name: none 2024-09-12T17:38:46.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8a5e7fc640 20 reqs_thread_entry: start 2024-09-12T17:38:46.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8c321ec9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:46.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8c321ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8c321ec9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:46.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8c321ec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:46.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8c321ec9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:46.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8c321ec9c0 20 INFO: main: starting shard=0 2024-09-12T17:38:46.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8c321ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:46.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8c321ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8c321ec9c0 20 INFO: main: starting shard=1 2024-09-12T17:38:46.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.002+0000 7f8c321ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:46.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:38:46.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 INFO: main: starting shard=2 2024-09-12T17:38:46.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:46.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 INFO: main: starting shard=3 2024-09-12T17:38:46.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:46.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 INFO: main: starting shard=4 2024-09-12T17:38:46.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:46.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 INFO: main: starting shard=5 2024-09-12T17:38:46.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.006+0000 7f8c321ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:46.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 INFO: main: starting shard=6 2024-09-12T17:38:46.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:46.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 INFO: main: starting shard=7 2024-09-12T17:38:46.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:46.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 INFO: main: starting shard=8 2024-09-12T17:38:46.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:46.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 INFO: main: starting shard=9 2024-09-12T17:38:46.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.010+0000 7f8c321ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:46.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.014+0000 7f8c321ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.014+0000 7f8c321ec9c0 20 INFO: main: starting shard=10 2024-09-12T17:38:46.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.014+0000 7f8c321ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:46.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.014+0000 7f8c321ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.014+0000 7f8c321ec9c0 20 INFO: main: done 2024-09-12T17:38:46.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.014+0000 7f8ae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:46.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.017+0000 7f8c321ec9c0 20 remove_watcher() i=0 2024-09-12T17:38:46.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.017+0000 7f8c321ec9c0 2 removed watcher, disabling cache 2024-09-12T17:38:46.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.021+0000 7f8c321ec9c0 20 remove_watcher() i=1 2024-09-12T17:38:46.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.021+0000 7f8c321ec9c0 20 remove_watcher() i=2 2024-09-12T17:38:46.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.025+0000 7f8c321ec9c0 20 remove_watcher() i=3 2024-09-12T17:38:46.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.029+0000 7f8c321ec9c0 20 remove_watcher() i=4 2024-09-12T17:38:46.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.029+0000 7f8c321ec9c0 20 remove_watcher() i=5 2024-09-12T17:38:46.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.033+0000 7f8c321ec9c0 20 remove_watcher() i=6 2024-09-12T17:38:46.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.037+0000 7f8c321ec9c0 20 remove_watcher() i=7 2024-09-12T17:38:46.059 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:46.059 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:46.110 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:46.110 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:46.240 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:38:46.241 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:38:46.276 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:46.276 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:46.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.317+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.321+0000 7f77eb43d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:46.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.321+0000 7f77eb43d9c0 20 realm 2024-09-12T17:38:46.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.321+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.321+0000 7f77eb43d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:46.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.321+0000 7f77eb43d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:46.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.321+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.321+0000 7f77eb43d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:46.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.321+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.325+0000 7f77eb43d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:46.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.325+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.325+0000 7f77eb43d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:46.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.325+0000 7f77eb43d9c0 20 searching for the correct realm 2024-09-12T17:38:46.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.333+0000 7f77e8f43640 0 -- 172.21.15.97:0/3433241907 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f77d80e8040 msgr2=0x7f77d80e0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:46.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.337+0000 7f77e8f43640 0 -- 172.21.15.97:0/3433241907 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55f17e1c2f10 msgr2=0x55f17e1c53b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:46.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:46.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:46.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:46.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:46.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:46.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:46.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:46.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:46.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:46.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 zone default found 2024-09-12T17:38:46.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 4 Realm: () 2024-09-12T17:38:46.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:46.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:46.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:46.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 zonegroup default 2024-09-12T17:38:46.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:46.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:46.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:46.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 started sync module instance, tier type = 2024-09-12T17:38:46.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.345+0000 7f77eb43d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:46.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.365+0000 7f77eb43d9c0 20 add_watcher() i=0 2024-09-12T17:38:46.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.365+0000 7f77eb43d9c0 20 add_watcher() i=1 2024-09-12T17:38:46.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.365+0000 7f77eb43d9c0 20 add_watcher() i=2 2024-09-12T17:38:46.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.365+0000 7f77eb43d9c0 20 add_watcher() i=3 2024-09-12T17:38:46.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.365+0000 7f77eb43d9c0 20 add_watcher() i=4 2024-09-12T17:38:46.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.365+0000 7f77eb43d9c0 20 add_watcher() i=5 2024-09-12T17:38:46.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.365+0000 7f77eb43d9c0 20 add_watcher() i=6 2024-09-12T17:38:46.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.369+0000 7f77eb43d9c0 20 add_watcher() i=7 2024-09-12T17:38:46.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.369+0000 7f77eb43d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:46.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.373+0000 7f769f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:46.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.373+0000 7f77eb43d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:46.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.373+0000 7f77eb43d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:46.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.373+0000 7f77eb43d9c0 5 note: GC not initialized 2024-09-12T17:38:46.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.373+0000 7f769e7e4640 20 reqs_thread_entry: start 2024-09-12T17:38:46.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.373+0000 7f77eb43d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:46.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.373+0000 7f77eb43d9c0 20 Filter name: none 2024-09-12T17:38:46.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.373+0000 7f76977fe640 20 reqs_thread_entry: start 2024-09-12T17:38:46.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.373+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:46.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:46.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:46.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:46.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:46.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 INFO: main: starting shard=0 2024-09-12T17:38:46.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:46.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 INFO: main: starting shard=1 2024-09-12T17:38:46.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:46.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 INFO: main: starting shard=2 2024-09-12T17:38:46.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.377+0000 7f77eb43d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:46.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 INFO: main: starting shard=3 2024-09-12T17:38:46.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:46.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 INFO: main: starting shard=4 2024-09-12T17:38:46.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:46.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 INFO: main: starting shard=5 2024-09-12T17:38:46.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:46.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 INFO: main: starting shard=6 2024-09-12T17:38:46.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.381+0000 7f77eb43d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:46.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 INFO: main: starting shard=7 2024-09-12T17:38:46.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:46.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 INFO: main: starting shard=8 2024-09-12T17:38:46.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:46.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 INFO: main: starting shard=9 2024-09-12T17:38:46.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:46.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:46.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 INFO: main: starting shard=10 2024-09-12T17:38:46.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:46.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:38:46.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.385+0000 7f77eb43d9c0 20 INFO: main: done 2024-09-12T17:38:46.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.389+0000 7f769f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:46.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.393+0000 7f77eb43d9c0 20 remove_watcher() i=0 2024-09-12T17:38:46.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.393+0000 7f77eb43d9c0 2 removed watcher, disabling cache 2024-09-12T17:38:46.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.393+0000 7f77eb43d9c0 20 remove_watcher() i=1 2024-09-12T17:38:46.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.397+0000 7f77eb43d9c0 20 remove_watcher() i=2 2024-09-12T17:38:46.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.397+0000 7f77eb43d9c0 20 remove_watcher() i=3 2024-09-12T17:38:46.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.401+0000 7f77eb43d9c0 20 remove_watcher() i=4 2024-09-12T17:38:46.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.401+0000 7f77eb43d9c0 20 remove_watcher() i=5 2024-09-12T17:38:46.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.405+0000 7f77eb43d9c0 20 remove_watcher() i=6 2024-09-12T17:38:46.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:46.409+0000 7f77eb43d9c0 20 remove_watcher() i=7 2024-09-12T17:38:46.430 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:46.430 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:46.456 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:38:46.884 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:38:47.327 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T17:38:47.327 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:47.327 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:38:47.362 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:47.362 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:47.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.401+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.401+0000 7f945a9c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:47.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.401+0000 7f945a9c29c0 20 realm 2024-09-12T17:38:47.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.401+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.405+0000 7f945a9c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:47.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.405+0000 7f945a9c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:47.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.405+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.405+0000 7f945a9c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:47.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.405+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.405+0000 7f945a9c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:47.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.405+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.405+0000 7f945a9c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:47.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.405+0000 7f945a9c29c0 20 searching for the correct realm 2024-09-12T17:38:47.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.413+0000 7f9458cc9640 0 -- 172.21.15.97:0/2838132612 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5621e1e52f20 msgr2=0x5621e1e553e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:47.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.421+0000 7f9457cc7640 0 -- 172.21.15.97:0/2838132612 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x5621e1e5a9c0 msgr2=0x5621e1e5cdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:47.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:47.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:47.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:47.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:47.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:47.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:47.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:47.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:47.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:47.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 zone default found 2024-09-12T17:38:47.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 4 Realm: () 2024-09-12T17:38:47.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:47.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:47.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:47.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 zonegroup default 2024-09-12T17:38:47.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.425+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.429+0000 7f945a9c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:47.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.429+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.429+0000 7f945a9c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:47.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.429+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.429+0000 7f945a9c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:47.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.429+0000 7f945a9c29c0 20 started sync module instance, tier type = 2024-09-12T17:38:47.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.429+0000 7f945a9c29c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:47.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.449+0000 7f945a9c29c0 20 add_watcher() i=0 2024-09-12T17:38:47.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.449+0000 7f945a9c29c0 20 add_watcher() i=1 2024-09-12T17:38:47.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.449+0000 7f945a9c29c0 20 add_watcher() i=2 2024-09-12T17:38:47.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.449+0000 7f945a9c29c0 20 add_watcher() i=3 2024-09-12T17:38:47.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.449+0000 7f945a9c29c0 20 add_watcher() i=4 2024-09-12T17:38:47.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.449+0000 7f945a9c29c0 20 add_watcher() i=5 2024-09-12T17:38:47.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.449+0000 7f945a9c29c0 20 add_watcher() i=6 2024-09-12T17:38:47.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.453+0000 7f945a9c29c0 20 add_watcher() i=7 2024-09-12T17:38:47.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.453+0000 7f945a9c29c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:47.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f930efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:47.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:47.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:47.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 5 note: GC not initialized 2024-09-12T17:38:47.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f930dfdb640 20 reqs_thread_entry: start 2024-09-12T17:38:47.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:47.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 20 Filter name: none 2024-09-12T17:38:47.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f927f7fe640 20 reqs_thread_entry: start 2024-09-12T17:38:47.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:38:47.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:47.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:38:47.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:38:47.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 : miss 2024-09-12T17:38:47.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.457+0000 7f945a9c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:47.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:47.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 info.flags=0x17 2024-09-12T17:38:47.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 to cache LRU end 2024-09-12T17:38:47.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:47.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:38:47.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 2024-09-12T17:38:47.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:47.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:38:47.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:47.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:47.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:38:47.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:47.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:38:47.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.461+0000 7f945a9c29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:47.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.465+0000 7f945a9c29c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:38:47.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.465+0000 7f945a9c29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:47.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.465+0000 7f945a9c29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:47.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.465+0000 7f945a9c29c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:38:47.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.465+0000 7f945a9c29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:47.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.465+0000 7f945a9c29c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:38:47.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.465+0000 7f945a9c29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:47.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.465+0000 7f945a9c29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:47.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.469+0000 7f945a9c29c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:38:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.469+0000 7f945a9c29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.469+0000 7f945a9c29c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T17:38:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.469+0000 7f945a9c29c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:38:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.469+0000 7f945a9c29c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:38:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.469+0000 7f945a9c29c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T17:38:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.469+0000 7f945a9c29c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T17:38:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.469+0000 7f930efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:47.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.473+0000 7f945a9c29c0 20 remove_watcher() i=0 2024-09-12T17:38:47.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.473+0000 7f945a9c29c0 2 removed watcher, disabling cache 2024-09-12T17:38:47.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.477+0000 7f945a9c29c0 20 remove_watcher() i=1 2024-09-12T17:38:47.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.477+0000 7f945a9c29c0 20 remove_watcher() i=2 2024-09-12T17:38:47.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.481+0000 7f945a9c29c0 20 remove_watcher() i=3 2024-09-12T17:38:47.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.485+0000 7f945a9c29c0 20 remove_watcher() i=4 2024-09-12T17:38:47.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.485+0000 7f945a9c29c0 20 remove_watcher() i=5 2024-09-12T17:38:47.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.489+0000 7f945a9c29c0 20 remove_watcher() i=6 2024-09-12T17:38:47.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:47.493+0000 7f945a9c29c0 20 remove_watcher() i=7 2024-09-12T17:38:47.510 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: unlinked entries are not listable 2024-09-12T17:38:47.510 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:47.512 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:47.513 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:47.713 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T17:38:47.713 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:47.719 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:47.719 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:47.851 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:47.851 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:47.948 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T17:38:47.948 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:47.949 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:38:47.989 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:47.989 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:48.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.033+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.033+0000 7fa6160b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.033+0000 7fa6160b69c0 20 realm 2024-09-12T17:38:48.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.033+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.033+0000 7fa6160b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.033+0000 7fa6160b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:48.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.033+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.037+0000 7fa6160b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.037+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.037+0000 7fa6160b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:48.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.037+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.037+0000 7fa6160b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:48.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.037+0000 7fa6160b69c0 20 searching for the correct realm 2024-09-12T17:38:48.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.045+0000 7fa6143bd640 0 -- 172.21.15.97:0/2438255087 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x564f034cdc90 msgr2=0x564f034d0130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:48.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.049+0000 7fa613bbc640 0 -- 172.21.15.97:0/2438255087 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x564f034d1f00 msgr2=0x564f034d4310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:48.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.057+0000 7fa6160b69c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:48.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.057+0000 7fa6160b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:48.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.057+0000 7fa6160b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:48.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.057+0000 7fa6160b69c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:48.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.057+0000 7fa6160b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:48.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.057+0000 7fa6160b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:48.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.057+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.057+0000 7fa6160b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.057+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.057+0000 7fa6160b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:48.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.057+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 20 zone default found 2024-09-12T17:38:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 4 Realm: () 2024-09-12T17:38:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:48.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:48.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:48.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 20 zonegroup default 2024-09-12T17:38:48.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 20 started sync module instance, tier type = 2024-09-12T17:38:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.061+0000 7fa6160b69c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.093+0000 7fa6160b69c0 20 add_watcher() i=0 2024-09-12T17:38:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.093+0000 7fa6160b69c0 20 add_watcher() i=1 2024-09-12T17:38:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.093+0000 7fa6160b69c0 20 add_watcher() i=2 2024-09-12T17:38:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.093+0000 7fa6160b69c0 20 add_watcher() i=3 2024-09-12T17:38:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.093+0000 7fa6160b69c0 20 add_watcher() i=4 2024-09-12T17:38:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.093+0000 7fa6160b69c0 20 add_watcher() i=5 2024-09-12T17:38:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.093+0000 7fa6160b69c0 20 add_watcher() i=6 2024-09-12T17:38:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.097+0000 7fa6160b69c0 20 add_watcher() i=7 2024-09-12T17:38:48.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.097+0000 7fa6160b69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:48.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.101+0000 7fa4c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:48.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.101+0000 7fa6160b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:48.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.101+0000 7fa6160b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:48.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.101+0000 7fa6160b69c0 5 note: GC not initialized 2024-09-12T17:38:48.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.101+0000 7fa4c8fe1640 20 reqs_thread_entry: start 2024-09-12T17:38:48.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.101+0000 7fa6160b69c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:48.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.101+0000 7fa6160b69c0 20 Filter name: none 2024-09-12T17:38:48.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.101+0000 7fa4427fc640 20 reqs_thread_entry: start 2024-09-12T17:38:48.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.101+0000 7fa6160b69c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:38:48.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.101+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:48.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:38:48.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:38:48.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 : miss 2024-09-12T17:38:48.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:48.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 info.flags=0x17 2024-09-12T17:38:48.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 to cache LRU end 2024-09-12T17:38:48.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:48.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:38:48.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 2024-09-12T17:38:48.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:48.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:38:48.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:48.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.105+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:48.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.109+0000 7fa6160b69c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:38:48.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.109+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:48.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.109+0000 7fa6160b69c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:38:48.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.109+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:48.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.109+0000 7fa6160b69c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:38:48.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.109+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:48.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.109+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:48.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.109+0000 7fa6160b69c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:38:48.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.109+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:48.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:38:48.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:48.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:48.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:38:48.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:48.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:48.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f031cc3b0 obj=check-bucket:e state=0x564f03508628 s->prefetch_data=0 2024-09-12T17:38:48.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:48.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f032711a0 obj=check-bucket:d state=0x564f0350b048 s->prefetch_data=0 2024-09-12T17:38:48.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:48.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f035069b0 obj=check-bucket:c state=0x564f035011b8 s->prefetch_data=0 2024-09-12T17:38:48.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.113+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:48.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f0350c1a0 obj=check-bucket:f state=0x564f03503ab8 s->prefetch_data=0 2024-09-12T17:38:48.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 get_obj_state: setting s->obj_tag to 9g6alifofa65jh4y8lnkul5ie22si89o 2024-09-12T17:38:48.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 get_obj_state_impl: setting s->olh_tag to mopt354z5wehfq600t0tpak3766y113t 2024-09-12T17:38:48.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mopt354z5wehfq600t0tpak3766y113t 2024-09-12T17:38:48.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 get_obj_state: setting s->obj_tag to 3rh5wxhjlzywbr9of8zk1jbdx8vpva8l 2024-09-12T17:38:48.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 get_obj_state_impl: setting s->olh_tag to m41w8lrkf7xmto5fb3c2s6548emb2to7 2024-09-12T17:38:48.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=m41w8lrkf7xmto5fb3c2s6548emb2to7 2024-09-12T17:38:48.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 get_obj_state: setting s->obj_tag to n0399bnzupt3gkrv8sxb7o6d96ftninc 2024-09-12T17:38:48.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 get_obj_state_impl: setting s->olh_tag to 0k8qjl9054ef0jlc2l3q0wlx6au1pwd0 2024-09-12T17:38:48.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0k8qjl9054ef0jlc2l3q0wlx6au1pwd0 2024-09-12T17:38:48.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 get_obj_state: setting s->obj_tag to m03ypgx19h3e6jvp096bdp8v010lsuvz 2024-09-12T17:38:48.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 get_obj_state_impl: setting s->olh_tag to gok6j1zjbtzn03eb5wjeqv6m2yjk3crh 2024-09-12T17:38:48.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gok6j1zjbtzn03eb5wjeqv6m2yjk3crh 2024-09-12T17:38:48.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:48.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:48.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.117+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:48.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:48.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:48.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 olh_log_entry: epoch=3 op=3 key=c[-P1Ie9EoGFPE1vdUM2ZHJzWzc.w55iM] 2024-09-12T17:38:48.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f035069b0 obj=check-bucket:_:-P1Ie9EoGFPE1vdUM2ZHJzWzc.w55iM_c state=0x564f035ac488 s->prefetch_data=0 2024-09-12T17:38:48.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:48.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 olh_log_entry: epoch=3 op=3 key=d[dVZjubcRTlInRFnLnNz7ncQ1cBdS6W8] 2024-09-12T17:38:48.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f032711a0 obj=check-bucket:_:dVZjubcRTlInRFnLnNz7ncQ1cBdS6W8_d state=0x564f035b0368 s->prefetch_data=0 2024-09-12T17:38:48.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 10 manifest: total_size = 12 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.13914913218264653387 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f035069b0 obj=check-bucket:_:-P1Ie9EoGFPE1vdUM2ZHJzWzc.w55iM_c state=0x564f035ac488 s->prefetch_data=0 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 prepare_atomic_modification: state is not atomic. state=0x564f035ac488 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 10 manifest: total_size = 11 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.3072044534369181130 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f032711a0 obj=check-bucket:_:dVZjubcRTlInRFnLnNz7ncQ1cBdS6W8_d state=0x564f035b0368 s->prefetch_data=0 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 prepare_atomic_modification: state is not atomic. state=0x564f035b0368 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:38:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 olh_log_entry: epoch=2 op=3 key=e[PCWQR4DbCV0ugRUq-Hk2Ijv.KrYU6Z6] 2024-09-12T17:38:48.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.121+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f031cc3b0 obj=check-bucket:_:PCWQR4DbCV0ugRUq-Hk2Ijv.KrYU6Z6_e state=0x564f03594848 s->prefetch_data=0 2024-09-12T17:38:48.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 10 manifest: total_size = 22 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.2988856886626244220 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f031cc3b0 obj=check-bucket:_:PCWQR4DbCV0ugRUq-Hk2Ijv.KrYU6Z6_e state=0x564f03594848 s->prefetch_data=0 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 prepare_atomic_modification: state is not atomic. state=0x564f03594848 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 olh_log_entry: epoch=2 op=3 key=f[lOc8DQrBAXOMFGUwl6b4qaKD4YwtKd6] 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f0350c1a0 obj=check-bucket:_:lOc8DQrBAXOMFGUwl6b4qaKD4YwtKd6_f state=0x564f035c8418 s->prefetch_data=0 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 10 manifest: total_size = 9 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.5254455669702033839 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f0350c1a0 obj=check-bucket:_:lOc8DQrBAXOMFGUwl6b4qaKD4YwtKd6_f state=0x564f035c8418 s->prefetch_data=0 2024-09-12T17:38:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 prepare_atomic_modification: state is not atomic. state=0x564f035c8418 2024-09-12T17:38:48.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.125+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:48.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.129+0000 7fa6160b69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:48.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.129+0000 7fa6160b69c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:38:48.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.129+0000 7fa6160b69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:38:48.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.129+0000 7fa6160b69c0 5 delete_objs_inline: removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.1__shadow:dVZjubcRTlInRFnLnNz7ncQ1cBdS6W8_.YbUzLKOaOnuRRXTiULX92R7j1tTnl_c_0 2024-09-12T17:38:48.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.129+0000 7fa6160b69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:48.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.129+0000 7fa6160b69c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:38:48.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.129+0000 7fa6160b69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:38:48.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.129+0000 7fa6160b69c0 5 delete_objs_inline: removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.1__shadow:-P1Ie9EoGFPE1vdUM2ZHJzWzc.w55iM_.cHxeaEyVnF52G_4ohGPu4V5gsZUIJzM_0 2024-09-12T17:38:48.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:48.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:38:48.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:38:48.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 5 delete_objs_inline: removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.1__shadow:PCWQR4DbCV0ugRUq-Hk2Ijv.KrYU6Z6_.ah1dFRmxSEyu7PWIrOMc2xQ_CjtUkYg_0 2024-09-12T17:38:48.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:38:48.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:48.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T17:38:48.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:38:48.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 5 delete_objs_inline: removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.1__shadow:lOc8DQrBAXOMFGUwl6b4qaKD4YwtKd6_.IVF8SUIOXg20F6AP5EfkAuFYjnJ8xnw_0 2024-09-12T17:38:48.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:38:48.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa4f2ffd640 20 handle_completion(): completion ok for obj=d[dVZjubcRTlInRFnLnNz7ncQ1cBdS6W8] 2024-09-12T17:38:48.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:48.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.133+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:48.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.137+0000 7fa4f2ffd640 20 handle_completion(): completion ok for obj=c[-P1Ie9EoGFPE1vdUM2ZHJzWzc.w55iM] 2024-09-12T17:38:48.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.137+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f031cc3b0 obj=check-bucket:e state=0x564f03508628 s->prefetch_data=0 2024-09-12T17:38:48.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.137+0000 7fa6160b69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mopt354z5wehfq600t0tpak3766y113t 2024-09-12T17:38:48.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.137+0000 7fa6160b69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:38:48.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.137+0000 7fa4f27fc640 20 handle_completion(): completion ok for obj=e[PCWQR4DbCV0ugRUq-Hk2Ijv.KrYU6Z6] 2024-09-12T17:38:48.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.137+0000 7fa4f2ffd640 20 handle_completion(): completion ok for obj=f[lOc8DQrBAXOMFGUwl6b4qaKD4YwtKd6] 2024-09-12T17:38:48.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.137+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:48.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.137+0000 7fa6160b69c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:38:48.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.137+0000 7fa6160b69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:38:48.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.141+0000 7fa6160b69c0 20 get_obj_state: octx=0x564f0350c1a0 obj=check-bucket:f state=0x564f03503ab8 s->prefetch_data=0 2024-09-12T17:38:48.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.141+0000 7fa6160b69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gok6j1zjbtzn03eb5wjeqv6m2yjk3crh 2024-09-12T17:38:48.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.141+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:48.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.141+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:48.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.141+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:48.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.145+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:48.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.145+0000 7fa6160b69c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:38:48.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.145+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:48.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.145+0000 7fa6160b69c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:38:48.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.149+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:48.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.149+0000 7fa6160b69c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:48.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.149+0000 7fa6160b69c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:38:48.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.149+0000 7fa6160b69c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:38:48.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.153+0000 7fa4c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:48.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.157+0000 7fa6160b69c0 20 remove_watcher() i=0 2024-09-12T17:38:48.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.157+0000 7fa6160b69c0 2 removed watcher, disabling cache 2024-09-12T17:38:48.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.157+0000 7fa6160b69c0 20 remove_watcher() i=1 2024-09-12T17:38:48.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.161+0000 7fa6160b69c0 20 remove_watcher() i=2 2024-09-12T17:38:48.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.161+0000 7fa6160b69c0 20 remove_watcher() i=3 2024-09-12T17:38:48.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.165+0000 7fa6160b69c0 20 remove_watcher() i=4 2024-09-12T17:38:48.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.165+0000 7fa6160b69c0 20 remove_watcher() i=5 2024-09-12T17:38:48.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.169+0000 7fa6160b69c0 20 remove_watcher() i=6 2024-09-12T17:38:48.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.173+0000 7fa6160b69c0 20 remove_watcher() i=7 2024-09-12T17:38:48.196 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:48.196 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:48.230 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:48.230 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:48.285 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:48.285 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:48.345 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:48.345 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:48.400 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T17:38:48.400 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:48.402 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:48.402 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:48.535 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:48.600 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:48.600 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:48.670 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:48.671 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:48.742 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:48.742 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:48.809 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T17:38:48.809 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:48.810 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:38:48.848 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:48.848 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:48.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.889+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 20 realm 2024-09-12T17:38:48.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:48.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:48.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:48.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.893+0000 7f835e6da9c0 20 searching for the correct realm 2024-09-12T17:38:48.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.901+0000 7f835c9e1640 0 -- 172.21.15.97:0/3017573237 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f83440c8070 msgr2=0x7f83440c8450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:48.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.905+0000 7f835c1e0640 0 -- 172.21.15.97:0/3017573237 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f8354087470 msgr2=0x7f835405c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:48.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.913+0000 7f835e6da9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:48.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.913+0000 7f835e6da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:48.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.913+0000 7f835e6da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:48.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.913+0000 7f835e6da9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:48.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.913+0000 7f835e6da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:48.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.913+0000 7f835e6da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:48.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.913+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.913+0000 7f835e6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.913+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.913+0000 7f835e6da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.913+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 20 zone default found 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 4 Realm: () 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 20 zonegroup default 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:48.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 20 started sync module instance, tier type = 2024-09-12T17:38:48.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.917+0000 7f835e6da9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:48.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.937+0000 7f835e6da9c0 20 add_watcher() i=0 2024-09-12T17:38:48.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.937+0000 7f835e6da9c0 20 add_watcher() i=1 2024-09-12T17:38:48.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.937+0000 7f835e6da9c0 20 add_watcher() i=2 2024-09-12T17:38:48.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.937+0000 7f835e6da9c0 20 add_watcher() i=3 2024-09-12T17:38:48.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.937+0000 7f835e6da9c0 20 add_watcher() i=4 2024-09-12T17:38:48.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.937+0000 7f835e6da9c0 20 add_watcher() i=5 2024-09-12T17:38:48.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.937+0000 7f835e6da9c0 20 add_watcher() i=6 2024-09-12T17:38:48.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.941+0000 7f835e6da9c0 20 add_watcher() i=7 2024-09-12T17:38:48.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.941+0000 7f835e6da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:48.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f8212fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:48.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:48.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:48.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 5 note: GC not initialized 2024-09-12T17:38:48.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f8211fdb640 20 reqs_thread_entry: start 2024-09-12T17:38:48.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:48.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 20 Filter name: none 2024-09-12T17:38:48.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f81837fe640 20 reqs_thread_entry: start 2024-09-12T17:38:48.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:38:48.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:48.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:38:48.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:38:48.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 : miss 2024-09-12T17:38:48.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.945+0000 7f835e6da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:48.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:48.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 info.flags=0x17 2024-09-12T17:38:48.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 to cache LRU end 2024-09-12T17:38:48.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:48.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:38:48.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 2024-09-12T17:38:48.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:48.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:38:48.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:48.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:38:48.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:48.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:38:48.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:48.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:38:48.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.949+0000 7f835e6da9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:48.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.953+0000 7f835e6da9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:38:48.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.953+0000 7f835e6da9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:48.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.953+0000 7f835e6da9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:38:48.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.953+0000 7f835e6da9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:48.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.953+0000 7f835e6da9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:38:48.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.953+0000 7f835e6da9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:48.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.953+0000 7f835e6da9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:38:48.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.953+0000 7f835e6da9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:48.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.953+0000 7f835e6da9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:38:48.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.953+0000 7f835e6da9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:48.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.957+0000 7f835e6da9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:38:48.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.957+0000 7f835e6da9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:48.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.957+0000 7f835e6da9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:38:48.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.957+0000 7f835e6da9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:38:48.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.957+0000 7f8212fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:48.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.961+0000 7f835e6da9c0 20 remove_watcher() i=0 2024-09-12T17:38:48.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.961+0000 7f835e6da9c0 2 removed watcher, disabling cache 2024-09-12T17:38:48.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.965+0000 7f835e6da9c0 20 remove_watcher() i=1 2024-09-12T17:38:48.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.965+0000 7f835e6da9c0 20 remove_watcher() i=2 2024-09-12T17:38:48.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.969+0000 7f835e6da9c0 20 remove_watcher() i=3 2024-09-12T17:38:48.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.969+0000 7f835e6da9c0 20 remove_watcher() i=4 2024-09-12T17:38:48.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.973+0000 7f835e6da9c0 20 remove_watcher() i=5 2024-09-12T17:38:48.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.973+0000 7f835e6da9c0 20 remove_watcher() i=6 2024-09-12T17:38:48.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:48.977+0000 7f835e6da9c0 20 remove_watcher() i=7 2024-09-12T17:38:48.998 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:48.998 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:49.305 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:49.305 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:49.441 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:38:49.477 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:49.477 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:49.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.517+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.521+0000 7fc58ee1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.521+0000 7fc58ee1a9c0 20 realm 2024-09-12T17:38:49.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.521+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.521+0000 7fc58ee1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.521+0000 7fc58ee1a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:49.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.521+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.521+0000 7fc58ee1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.521+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.525+0000 7fc58ee1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:49.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.525+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.525+0000 7fc58ee1a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:49.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.525+0000 7fc58ee1a9c0 20 searching for the correct realm 2024-09-12T17:38:49.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.529+0000 7fc58d121640 0 -- 172.21.15.97:0/2642855786 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fc5800e5030 msgr2=0x7fc5801370b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:49.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.537+0000 7fc58c920640 0 -- 172.21.15.97:0/2642855786 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fc584027040 msgr2=0x7fc584045920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:49.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:49.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:49.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 zone default found 2024-09-12T17:38:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 4 Realm: () 2024-09-12T17:38:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 zonegroup default 2024-09-12T17:38:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 started sync module instance, tier type = 2024-09-12T17:38:49.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.545+0000 7fc58ee1a9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:49.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.569+0000 7fc58ee1a9c0 20 add_watcher() i=0 2024-09-12T17:38:49.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.569+0000 7fc58ee1a9c0 20 add_watcher() i=1 2024-09-12T17:38:49.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.569+0000 7fc58ee1a9c0 20 add_watcher() i=2 2024-09-12T17:38:49.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.569+0000 7fc58ee1a9c0 20 add_watcher() i=3 2024-09-12T17:38:49.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.569+0000 7fc58ee1a9c0 20 add_watcher() i=4 2024-09-12T17:38:49.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.569+0000 7fc58ee1a9c0 20 add_watcher() i=5 2024-09-12T17:38:49.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.569+0000 7fc58ee1a9c0 20 add_watcher() i=6 2024-09-12T17:38:49.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.569+0000 7fc58ee1a9c0 20 add_watcher() i=7 2024-09-12T17:38:49.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.569+0000 7fc58ee1a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:49.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.573+0000 7fc4437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:49.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.573+0000 7fc58ee1a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:49.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.573+0000 7fc58ee1a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:49.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.573+0000 7fc58ee1a9c0 5 note: GC not initialized 2024-09-12T17:38:49.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.573+0000 7fc4427e4640 20 reqs_thread_entry: start 2024-09-12T17:38:49.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.573+0000 7fc58ee1a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:49.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.573+0000 7fc58ee1a9c0 20 Filter name: none 2024-09-12T17:38:49.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.573+0000 7fc43b7fe640 20 reqs_thread_entry: start 2024-09-12T17:38:49.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.573+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:49.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:49.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:49.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:49.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 INFO: main: starting shard=0 2024-09-12T17:38:49.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:49.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 INFO: main: starting shard=1 2024-09-12T17:38:49.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:49.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 INFO: main: starting shard=2 2024-09-12T17:38:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.577+0000 7fc58ee1a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 INFO: main: starting shard=3 2024-09-12T17:38:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:49.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 INFO: main: starting shard=4 2024-09-12T17:38:49.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:49.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 INFO: main: starting shard=5 2024-09-12T17:38:49.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:49.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:38:49.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 INFO: main: starting shard=6 2024-09-12T17:38:49.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:49.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 INFO: main: starting shard=7 2024-09-12T17:38:49.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.581+0000 7fc58ee1a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc58ee1a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc58ee1a9c0 20 INFO: main: starting shard=8 2024-09-12T17:38:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc58ee1a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc58ee1a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc58ee1a9c0 20 INFO: main: starting shard=9 2024-09-12T17:38:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc58ee1a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc58ee1a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc58ee1a9c0 20 INFO: main: starting shard=10 2024-09-12T17:38:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc58ee1a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:49.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc58ee1a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc58ee1a9c0 20 INFO: main: done 2024-09-12T17:38:49.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.585+0000 7fc4437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:49.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.589+0000 7fc58ee1a9c0 20 remove_watcher() i=0 2024-09-12T17:38:49.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.589+0000 7fc58ee1a9c0 2 removed watcher, disabling cache 2024-09-12T17:38:49.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.593+0000 7fc58ee1a9c0 20 remove_watcher() i=1 2024-09-12T17:38:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.597+0000 7fc58ee1a9c0 20 remove_watcher() i=2 2024-09-12T17:38:49.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.597+0000 7fc58ee1a9c0 20 remove_watcher() i=3 2024-09-12T17:38:49.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.601+0000 7fc58ee1a9c0 20 remove_watcher() i=4 2024-09-12T17:38:49.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.601+0000 7fc58ee1a9c0 20 remove_watcher() i=5 2024-09-12T17:38:49.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.605+0000 7fc58ee1a9c0 20 remove_watcher() i=6 2024-09-12T17:38:49.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.609+0000 7fc58ee1a9c0 20 remove_watcher() i=7 2024-09-12T17:38:49.626 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:38:49.656 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:49.656 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:49.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.697+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.697+0000 7fe4b843d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.697+0000 7fe4b843d9c0 20 realm 2024-09-12T17:38:49.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.697+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.701+0000 7fe4b843d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.701+0000 7fe4b843d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:49.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.701+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.701+0000 7fe4b843d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.701+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.701+0000 7fe4b843d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:49.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.701+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.701+0000 7fe4b843d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:49.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.701+0000 7fe4b843d9c0 20 searching for the correct realm 2024-09-12T17:38:49.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.705+0000 7fe4b5742640 0 -- 172.21.15.97:0/173635514 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fe4ac103550 msgr2=0x7fe4ac0b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:49.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.921+0000 7fe4b6744640 0 -- 172.21.15.97:0/173635514 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x558e4dc1e690 msgr2=0x558e4dc20ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 zone default found 2024-09-12T17:38:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 4 Realm: () 2024-09-12T17:38:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 zonegroup default 2024-09-12T17:38:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.933+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.937+0000 7fe4b843d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.937+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.937+0000 7fe4b843d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:49.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.937+0000 7fe4b843d9c0 20 started sync module instance, tier type = 2024-09-12T17:38:49.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.937+0000 7fe4b843d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:49.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.965+0000 7fe4b843d9c0 20 add_watcher() i=0 2024-09-12T17:38:49.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.965+0000 7fe4b843d9c0 20 add_watcher() i=1 2024-09-12T17:38:49.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.965+0000 7fe4b843d9c0 20 add_watcher() i=2 2024-09-12T17:38:49.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.965+0000 7fe4b843d9c0 20 add_watcher() i=3 2024-09-12T17:38:49.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.965+0000 7fe4b843d9c0 20 add_watcher() i=4 2024-09-12T17:38:49.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.965+0000 7fe4b843d9c0 20 add_watcher() i=5 2024-09-12T17:38:49.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.965+0000 7fe4b843d9c0 20 add_watcher() i=6 2024-09-12T17:38:49.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.969+0000 7fe4b843d9c0 20 add_watcher() i=7 2024-09-12T17:38:49.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.969+0000 7fe4b843d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:49.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.973+0000 7fe3677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:49.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.973+0000 7fe4b843d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:49.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.973+0000 7fe4b843d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:49.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.973+0000 7fe4b843d9c0 5 note: GC not initialized 2024-09-12T17:38:49.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.973+0000 7fe3667fc640 20 reqs_thread_entry: start 2024-09-12T17:38:49.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.973+0000 7fe4b843d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:49.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.973+0000 7fe4b843d9c0 20 Filter name: none 2024-09-12T17:38:49.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.973+0000 7fe2d7fff640 20 reqs_thread_entry: start 2024-09-12T17:38:49.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.973+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.977+0000 7fe4b843d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:49.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.977+0000 7fe4b843d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:49.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.977+0000 7fe4b843d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.977+0000 7fe4b843d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.977+0000 7fe4b843d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.977+0000 7fe4b843d9c0 20 INFO: main: starting shard=0 2024-09-12T17:38:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.977+0000 7fe4b843d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:49.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.977+0000 7fe4b843d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.977+0000 7fe4b843d9c0 20 INFO: main: starting shard=1 2024-09-12T17:38:49.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.977+0000 7fe4b843d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:49.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: starting shard=2 2024-09-12T17:38:49.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: starting shard=3 2024-09-12T17:38:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: starting shard=4 2024-09-12T17:38:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:49.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: starting shard=5 2024-09-12T17:38:49.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:49.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: starting shard=6 2024-09-12T17:38:49.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:49.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 INFO: main: starting shard=7 2024-09-12T17:38:49.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.981+0000 7fe4b843d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:49.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe4b843d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe4b843d9c0 20 INFO: main: starting shard=8 2024-09-12T17:38:49.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe4b843d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:49.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe4b843d9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:38:49.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe4b843d9c0 20 INFO: main: starting shard=9 2024-09-12T17:38:49.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe4b843d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:49.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe4b843d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe4b843d9c0 20 INFO: main: starting shard=10 2024-09-12T17:38:49.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe4b843d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:49.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe4b843d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:49.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe4b843d9c0 20 INFO: main: done 2024-09-12T17:38:49.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.985+0000 7fe3677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:49.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.993+0000 7fe4b843d9c0 20 remove_watcher() i=0 2024-09-12T17:38:49.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.993+0000 7fe4b843d9c0 2 removed watcher, disabling cache 2024-09-12T17:38:49.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.993+0000 7fe4b843d9c0 20 remove_watcher() i=1 2024-09-12T17:38:50.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.997+0000 7fe4b843d9c0 20 remove_watcher() i=2 2024-09-12T17:38:50.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:49.997+0000 7fe4b843d9c0 20 remove_watcher() i=3 2024-09-12T17:38:50.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.001+0000 7fe4b843d9c0 20 remove_watcher() i=4 2024-09-12T17:38:50.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.001+0000 7fe4b843d9c0 20 remove_watcher() i=5 2024-09-12T17:38:50.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.005+0000 7fe4b843d9c0 20 remove_watcher() i=6 2024-09-12T17:38:50.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.009+0000 7fe4b843d9c0 20 remove_watcher() i=7 2024-09-12T17:38:50.028 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T17:38:50.028 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:50.028 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:38:50.058 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:50.058 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:50.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.097+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.101+0000 7f684efde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.101+0000 7f684efde9c0 20 realm 2024-09-12T17:38:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.101+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.101+0000 7f684efde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.101+0000 7f684efde9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:50.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.101+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.101+0000 7f684efde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.101+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.101+0000 7f684efde9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:50.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.101+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.105+0000 7f684efde9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.105+0000 7f684efde9c0 20 searching for the correct realm 2024-09-12T17:38:50.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.113+0000 7f684cae4640 0 -- 172.21.15.97:0/2153382099 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x556116973190 msgr2=0x556116975580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:50.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.317+0000 7f684cae4640 0 -- 172.21.15.97:0/2153382099 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x7f671807dc90 msgr2=0x7f6718080080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:50.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:50.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:50.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:50.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:50.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:50.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:50.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:50.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:50.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 zone default found 2024-09-12T17:38:50.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 4 Realm: () 2024-09-12T17:38:50.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:50.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:50.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:50.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 zonegroup default 2024-09-12T17:38:50.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.329+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.333+0000 7f684efde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.333+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.333+0000 7f684efde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.333+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.333+0000 7f684efde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.333+0000 7f684efde9c0 20 started sync module instance, tier type = 2024-09-12T17:38:50.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.333+0000 7f684efde9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:50.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.361+0000 7f684efde9c0 20 add_watcher() i=0 2024-09-12T17:38:50.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.361+0000 7f684efde9c0 20 add_watcher() i=1 2024-09-12T17:38:50.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.361+0000 7f684efde9c0 20 add_watcher() i=2 2024-09-12T17:38:50.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.361+0000 7f684efde9c0 20 add_watcher() i=3 2024-09-12T17:38:50.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.361+0000 7f684efde9c0 20 add_watcher() i=4 2024-09-12T17:38:50.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.361+0000 7f684efde9c0 20 add_watcher() i=5 2024-09-12T17:38:50.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.361+0000 7f684efde9c0 20 add_watcher() i=6 2024-09-12T17:38:50.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.365+0000 7f684efde9c0 20 add_watcher() i=7 2024-09-12T17:38:50.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.365+0000 7f684efde9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:50.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.369+0000 7f6702fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:50.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:50.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:50.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 5 note: GC not initialized 2024-09-12T17:38:50.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f6701fe3640 20 reqs_thread_entry: start 2024-09-12T17:38:50.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:50.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 20 Filter name: none 2024-09-12T17:38:50.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f66737fe640 20 reqs_thread_entry: start 2024-09-12T17:38:50.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:38:50.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:50.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:38:50.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:38:50.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 : miss 2024-09-12T17:38:50.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.373+0000 7f684efde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:50.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 info.flags=0x17 2024-09-12T17:38:50.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 to cache LRU end 2024-09-12T17:38:50.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:50.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:38:50.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 2024-09-12T17:38:50.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:50.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:38:50.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:50.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:38:50.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:50.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:38:50.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:50.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:38:50.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.377+0000 7f684efde9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:50.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.381+0000 7f684efde9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:38:50.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.381+0000 7f684efde9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:50.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.381+0000 7f684efde9c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:38:50.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.381+0000 7f684efde9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:50.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.381+0000 7f684efde9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:38:50.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.381+0000 7f684efde9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:50.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.385+0000 7f684efde9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:38:50.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.385+0000 7f684efde9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:50.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.385+0000 7f684efde9c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:38:50.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.385+0000 7f684efde9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:50.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.385+0000 7f684efde9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:38:50.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.385+0000 7f684efde9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:50.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.385+0000 7f684efde9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:38:50.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.385+0000 7f684efde9c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T17:38:50.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.385+0000 7f6702fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:50.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.389+0000 7f684efde9c0 20 remove_watcher() i=0 2024-09-12T17:38:50.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.389+0000 7f684efde9c0 2 removed watcher, disabling cache 2024-09-12T17:38:50.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.393+0000 7f684efde9c0 20 remove_watcher() i=1 2024-09-12T17:38:50.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.397+0000 7f684efde9c0 20 remove_watcher() i=2 2024-09-12T17:38:50.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.397+0000 7f684efde9c0 20 remove_watcher() i=3 2024-09-12T17:38:50.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.401+0000 7f684efde9c0 20 remove_watcher() i=4 2024-09-12T17:38:50.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.401+0000 7f684efde9c0 20 remove_watcher() i=5 2024-09-12T17:38:50.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.405+0000 7f684efde9c0 20 remove_watcher() i=6 2024-09-12T17:38:50.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.409+0000 7f684efde9c0 20 remove_watcher() i=7 2024-09-12T17:38:50.430 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T17:38:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:50.431 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:38:50.466 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:50.466 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:50.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.505+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.509+0000 7fa90d4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.509+0000 7fa90d4bf9c0 20 realm 2024-09-12T17:38:50.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.509+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.509+0000 7fa90d4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.509+0000 7fa90d4bf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:50.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.509+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.509+0000 7fa90d4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.509+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.513+0000 7fa90d4bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:50.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.513+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.513+0000 7fa90d4bf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:50.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.513+0000 7fa90d4bf9c0 20 searching for the correct realm 2024-09-12T17:38:50.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.517+0000 7fa90afc5640 0 -- 172.21.15.97:0/4200701222 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fa8fc0ff920 msgr2=0x7fa8fc100a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:50.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.525+0000 7fa90afc5640 0 -- 172.21.15.97:0/4200701222 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x5638a5571970 msgr2=0x5638a5573d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:50.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.529+0000 7fa90d4bf9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:50.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.529+0000 7fa90d4bf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:50.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.529+0000 7fa90d4bf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:50.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.529+0000 7fa90d4bf9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:50.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.529+0000 7fa90d4bf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:50.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.529+0000 7fa90d4bf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:50.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.529+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:50.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:50.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 zone default found 2024-09-12T17:38:50.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 4 Realm: () 2024-09-12T17:38:50.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:50.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:50.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:50.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 zonegroup default 2024-09-12T17:38:50.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 started sync module instance, tier type = 2024-09-12T17:38:50.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.533+0000 7fa90d4bf9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:50.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.557+0000 7fa90d4bf9c0 20 add_watcher() i=0 2024-09-12T17:38:50.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.557+0000 7fa90d4bf9c0 20 add_watcher() i=1 2024-09-12T17:38:50.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.557+0000 7fa90d4bf9c0 20 add_watcher() i=2 2024-09-12T17:38:50.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.557+0000 7fa90d4bf9c0 20 add_watcher() i=3 2024-09-12T17:38:50.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.557+0000 7fa90d4bf9c0 20 add_watcher() i=4 2024-09-12T17:38:50.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.557+0000 7fa90d4bf9c0 20 add_watcher() i=5 2024-09-12T17:38:50.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.557+0000 7fa90d4bf9c0 20 add_watcher() i=6 2024-09-12T17:38:50.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.561+0000 7fa90d4bf9c0 20 add_watcher() i=7 2024-09-12T17:38:50.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.561+0000 7fa90d4bf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:50.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa7c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:50.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:50.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:50.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 5 note: GC not initialized 2024-09-12T17:38:50.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa7c0fe1640 20 reqs_thread_entry: start 2024-09-12T17:38:50.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:50.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 20 Filter name: none 2024-09-12T17:38:50.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa7b9ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:50.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:38:50.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:50.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:38:50.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:38:50.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 : miss 2024-09-12T17:38:50.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:50.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 info.flags=0x17 2024-09-12T17:38:50.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 to cache LRU end 2024-09-12T17:38:50.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:50.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:38:50.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 2024-09-12T17:38:50.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.565+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:50.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.569+0000 7fa90d4bf9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:38:50.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.569+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:50.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.569+0000 7fa90d4bf9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:38:50.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.569+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:50.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.569+0000 7fa90d4bf9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:38:50.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.569+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:50.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.569+0000 7fa90d4bf9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:38:50.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.569+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:50.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:38:50.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:50.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 20 get_obj_state: octx=0x5638a52693b0 obj=check-bucket:d state=0x5638a55ac768 s->prefetch_data=0 2024-09-12T17:38:50.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:50.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:38:50.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:50.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:38:50.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:50.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 20 get_obj_state: octx=0x5638a530e190 obj=check-bucket:c state=0x5638a55a8058 s->prefetch_data=0 2024-09-12T17:38:50.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:50.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:38:50.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.573+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 get_obj_state: setting s->obj_tag to 3rh5wxhjlzywbr9of8zk1jbdx8vpva8l 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 get_obj_state_impl: setting s->olh_tag to m41w8lrkf7xmto5fb3c2s6548emb2to7 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 get_obj_state: setting s->obj_tag to n0399bnzupt3gkrv8sxb7o6d96ftninc 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 get_obj_state_impl: setting s->olh_tag to 0k8qjl9054ef0jlc2l3q0wlx6au1pwd0 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 olh_log_entry: epoch=4 op=3 key=c[s7kWjTP7awE..T1uMl8DK7RKSn.3XyT] 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 get_obj_state: octx=0x5638a55f4ea0 obj=check-bucket:_:s7kWjTP7awE..T1uMl8DK7RKSn.3XyT_c state=0x5638a55f8948 s->prefetch_data=0 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T17:38:50.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 olh_log_entry: epoch=4 op=3 key=d[Set3U0P5BxHJEro-skUDHhfvRG0uYPP] 2024-09-12T17:38:50.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 get_obj_state: octx=0x5638a55d4ea0 obj=check-bucket:_:Set3U0P5BxHJEro-skUDHhfvRG0uYPP_d state=0x5638a55fe938 s->prefetch_data=0 2024-09-12T17:38:50.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 get_obj_state: octx=0x5638a55f4ea0 obj=check-bucket:c state=0x5638a55fe7a8 s->prefetch_data=0 2024-09-12T17:38:50.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 get_obj_state: setting s->obj_tag to n0399bnzupt3gkrv8sxb7o6d96ftninc 2024-09-12T17:38:50.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 get_obj_state_impl: setting s->olh_tag to 0k8qjl9054ef0jlc2l3q0wlx6au1pwd0 2024-09-12T17:38:50.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0k8qjl9054ef0jlc2l3q0wlx6au1pwd0 2024-09-12T17:38:50.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.577+0000 7fa90d4bf9c0 20 get_obj_state: octx=0x5638a55d4ea0 obj=check-bucket:d state=0x5638a55a6e68 s->prefetch_data=0 2024-09-12T17:38:50.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.581+0000 7fa90d4bf9c0 20 get_obj_state: setting s->obj_tag to 3rh5wxhjlzywbr9of8zk1jbdx8vpva8l 2024-09-12T17:38:50.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.581+0000 7fa90d4bf9c0 20 get_obj_state_impl: setting s->olh_tag to m41w8lrkf7xmto5fb3c2s6548emb2to7 2024-09-12T17:38:50.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.581+0000 7fa90d4bf9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=m41w8lrkf7xmto5fb3c2s6548emb2to7 2024-09-12T17:38:50.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.585+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:50.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.589+0000 7fa90d4bf9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:50.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.593+0000 7fa90d4bf9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:38:50.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.593+0000 7fa90d4bf9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:38:50.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.593+0000 7fa90d4bf9c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T17:38:50.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.593+0000 7fa7c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:50.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.597+0000 7fa90d4bf9c0 20 remove_watcher() i=0 2024-09-12T17:38:50.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.597+0000 7fa90d4bf9c0 2 removed watcher, disabling cache 2024-09-12T17:38:50.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.597+0000 7fa90d4bf9c0 20 remove_watcher() i=1 2024-09-12T17:38:50.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.601+0000 7fa90d4bf9c0 20 remove_watcher() i=2 2024-09-12T17:38:50.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.605+0000 7fa90d4bf9c0 20 remove_watcher() i=3 2024-09-12T17:38:50.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.605+0000 7fa90d4bf9c0 20 remove_watcher() i=4 2024-09-12T17:38:50.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.609+0000 7fa90d4bf9c0 20 remove_watcher() i=5 2024-09-12T17:38:50.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.609+0000 7fa90d4bf9c0 20 remove_watcher() i=6 2024-09-12T17:38:50.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.613+0000 7fa90d4bf9c0 20 remove_watcher() i=7 2024-09-12T17:38:50.634 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:38:50.666 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:50.666 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:50.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.705+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.709+0000 7fc72cc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.709+0000 7fc72cc0d9c0 20 realm 2024-09-12T17:38:50.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.709+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.709+0000 7fc72cc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.709+0000 7fc72cc0d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:50.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.709+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.709+0000 7fc72cc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.709+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.713+0000 7fc72cc0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:50.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.713+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.713+0000 7fc72cc0d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:50.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.713+0000 7fc72cc0d9c0 20 searching for the correct realm 2024-09-12T17:38:50.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.717+0000 7fc729f12640 0 -- 172.21.15.97:0/209266232 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fc72001c3f0 msgr2=0x7fc72001c870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:50.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.725+0000 7fc72a713640 0 -- 172.21.15.97:0/209266232 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fc724100330 msgr2=0x7fc7240f62b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:50.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:50.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:50.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:50.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:50.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:50.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:50.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:50.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:50.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 zone default found 2024-09-12T17:38:50.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 4 Realm: () 2024-09-12T17:38:50.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:50.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:50.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:50.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 zonegroup default 2024-09-12T17:38:50.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.733+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.737+0000 7fc72cc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.737+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.737+0000 7fc72cc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.737+0000 7fc72cc0d9c0 20 started sync module instance, tier type = 2024-09-12T17:38:50.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.737+0000 7fc72cc0d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:50.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.757+0000 7fc72cc0d9c0 20 add_watcher() i=0 2024-09-12T17:38:50.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.757+0000 7fc72cc0d9c0 20 add_watcher() i=1 2024-09-12T17:38:50.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.757+0000 7fc72cc0d9c0 20 add_watcher() i=2 2024-09-12T17:38:50.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.757+0000 7fc72cc0d9c0 20 add_watcher() i=3 2024-09-12T17:38:50.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.757+0000 7fc72cc0d9c0 20 add_watcher() i=4 2024-09-12T17:38:50.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.757+0000 7fc72cc0d9c0 20 add_watcher() i=5 2024-09-12T17:38:50.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.757+0000 7fc72cc0d9c0 20 add_watcher() i=6 2024-09-12T17:38:50.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.761+0000 7fc72cc0d9c0 20 add_watcher() i=7 2024-09-12T17:38:50.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.761+0000 7fc72cc0d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:50.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.761+0000 7fc5e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 5 note: GC not initialized 2024-09-12T17:38:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc55b7fe640 20 reqs_thread_entry: start 2024-09-12T17:38:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 Filter name: none 2024-09-12T17:38:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc5597fa640 20 reqs_thread_entry: start 2024-09-12T17:38:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:50.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:50.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:50.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 INFO: main: starting shard=0 2024-09-12T17:38:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 INFO: main: starting shard=1 2024-09-12T17:38:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.765+0000 7fc72cc0d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: starting shard=2 2024-09-12T17:38:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: starting shard=3 2024-09-12T17:38:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: starting shard=4 2024-09-12T17:38:50.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:50.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: starting shard=5 2024-09-12T17:38:50.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:50.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: starting shard=6 2024-09-12T17:38:50.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:50.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 INFO: main: starting shard=7 2024-09-12T17:38:50.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.769+0000 7fc72cc0d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:50.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc72cc0d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc72cc0d9c0 20 INFO: main: starting shard=8 2024-09-12T17:38:50.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc72cc0d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:50.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc72cc0d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc72cc0d9c0 20 INFO: main: starting shard=9 2024-09-12T17:38:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc72cc0d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc72cc0d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc72cc0d9c0 20 INFO: main: starting shard=10 2024-09-12T17:38:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc72cc0d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:50.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc72cc0d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc72cc0d9c0 20 INFO: main: done 2024-09-12T17:38:50.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.773+0000 7fc5e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:50.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.781+0000 7fc72cc0d9c0 20 remove_watcher() i=0 2024-09-12T17:38:50.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.781+0000 7fc72cc0d9c0 2 removed watcher, disabling cache 2024-09-12T17:38:50.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.781+0000 7fc72cc0d9c0 20 remove_watcher() i=1 2024-09-12T17:38:50.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.785+0000 7fc72cc0d9c0 20 remove_watcher() i=2 2024-09-12T17:38:50.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.785+0000 7fc72cc0d9c0 20 remove_watcher() i=3 2024-09-12T17:38:50.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.789+0000 7fc72cc0d9c0 20 remove_watcher() i=4 2024-09-12T17:38:50.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.789+0000 7fc72cc0d9c0 20 remove_watcher() i=5 2024-09-12T17:38:50.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.793+0000 7fc72cc0d9c0 20 remove_watcher() i=6 2024-09-12T17:38:50.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.797+0000 7fc72cc0d9c0 20 remove_watcher() i=7 2024-09-12T17:38:50.816 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:38:50.845 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:50.845 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:50.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.885+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.889+0000 7f5bef0ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.889+0000 7f5bef0ee9c0 20 realm 2024-09-12T17:38:50.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.889+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.889+0000 7f5bef0ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.889+0000 7f5bef0ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:50.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.889+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.889+0000 7f5bef0ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.889+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.893+0000 7f5bef0ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:50.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.893+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.893+0000 7f5bef0ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:50.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.893+0000 7f5bef0ee9c0 20 searching for the correct realm 2024-09-12T17:38:50.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.897+0000 7f5becbf4640 0 -- 172.21.15.97:0/37967863 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f5be0067c20 msgr2=0x7f5be00a1050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:50.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.905+0000 7f5becbf4640 0 -- 172.21.15.97:0/37967863 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f5be8035410 msgr2=0x7f5be8035870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:50.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:50.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:50.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:50.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:50.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 zone default found 2024-09-12T17:38:50.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 4 Realm: () 2024-09-12T17:38:50.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:50.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:50.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:50.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 zonegroup default 2024-09-12T17:38:50.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.913+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.917+0000 7f5bef0ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:50.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.917+0000 7f5bef0ee9c0 20 started sync module instance, tier type = 2024-09-12T17:38:50.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.917+0000 7f5bef0ee9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:50.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.937+0000 7f5bef0ee9c0 20 add_watcher() i=0 2024-09-12T17:38:50.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.937+0000 7f5bef0ee9c0 20 add_watcher() i=1 2024-09-12T17:38:50.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.937+0000 7f5bef0ee9c0 20 add_watcher() i=2 2024-09-12T17:38:50.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.937+0000 7f5bef0ee9c0 20 add_watcher() i=3 2024-09-12T17:38:50.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.937+0000 7f5bef0ee9c0 20 add_watcher() i=4 2024-09-12T17:38:50.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.937+0000 7f5bef0ee9c0 20 add_watcher() i=5 2024-09-12T17:38:50.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.937+0000 7f5bef0ee9c0 20 add_watcher() i=6 2024-09-12T17:38:50.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.941+0000 7f5bef0ee9c0 20 add_watcher() i=7 2024-09-12T17:38:50.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.941+0000 7f5bef0ee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:50.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5aa2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:50.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:50.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:50.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 5 note: GC not initialized 2024-09-12T17:38:50.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5aa1fe3640 20 reqs_thread_entry: start 2024-09-12T17:38:50.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:50.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 Filter name: none 2024-09-12T17:38:50.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5a137fe640 20 reqs_thread_entry: start 2024-09-12T17:38:50.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:50.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:50.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:50.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:50.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:50.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 INFO: main: starting shard=0 2024-09-12T17:38:50.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:50.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 INFO: main: starting shard=1 2024-09-12T17:38:50.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.945+0000 7f5bef0ee9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:50.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: starting shard=2 2024-09-12T17:38:50.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:50.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: starting shard=3 2024-09-12T17:38:50.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:50.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: starting shard=4 2024-09-12T17:38:50.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:50.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: starting shard=5 2024-09-12T17:38:50.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:50.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: starting shard=6 2024-09-12T17:38:50.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:50.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 INFO: main: starting shard=7 2024-09-12T17:38:50.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.949+0000 7f5bef0ee9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:50.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5bef0ee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5bef0ee9c0 20 INFO: main: starting shard=8 2024-09-12T17:38:50.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5bef0ee9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:50.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5bef0ee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5bef0ee9c0 20 INFO: main: starting shard=9 2024-09-12T17:38:50.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5bef0ee9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:50.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5bef0ee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5bef0ee9c0 20 INFO: main: starting shard=10 2024-09-12T17:38:50.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5bef0ee9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:50.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5bef0ee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:50.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5bef0ee9c0 20 INFO: main: done 2024-09-12T17:38:50.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.953+0000 7f5aa2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:50.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.957+0000 7f5bef0ee9c0 20 remove_watcher() i=0 2024-09-12T17:38:50.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.957+0000 7f5bef0ee9c0 2 removed watcher, disabling cache 2024-09-12T17:38:50.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.961+0000 7f5bef0ee9c0 20 remove_watcher() i=1 2024-09-12T17:38:50.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.961+0000 7f5bef0ee9c0 20 remove_watcher() i=2 2024-09-12T17:38:50.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.965+0000 7f5bef0ee9c0 20 remove_watcher() i=3 2024-09-12T17:38:50.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.965+0000 7f5bef0ee9c0 20 remove_watcher() i=4 2024-09-12T17:38:50.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.969+0000 7f5bef0ee9c0 20 remove_watcher() i=5 2024-09-12T17:38:50.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.973+0000 7f5bef0ee9c0 20 remove_watcher() i=6 2024-09-12T17:38:50.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:50.973+0000 7f5bef0ee9c0 20 remove_watcher() i=7 2024-09-12T17:38:50.992 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T17:38:50.993 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:50.993 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:38:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:51.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.061+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:51.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 20 realm 2024-09-12T17:38:51.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:51.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:51.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:51.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:51.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:51.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.065+0000 7f286d0c09c0 20 searching for the correct realm 2024-09-12T17:38:51.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.073+0000 7f286abc6640 0 -- 172.21.15.97:0/47437540 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f285c068c40 msgr2=0x7f285c06f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:51.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.077+0000 7f286abc6640 0 -- 172.21.15.97:0/47437540 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f28640787e0 msgr2=0x7f2864086130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:51.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:51.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:51.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:51.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:51.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:51.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:51.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:51.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:51.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:51.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 zone default found 2024-09-12T17:38:51.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 4 Realm: () 2024-09-12T17:38:51.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:51.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:51.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:51.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 zonegroup default 2024-09-12T17:38:51.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.085+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.089+0000 7f286d0c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:51.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.089+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.089+0000 7f286d0c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:51.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.089+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.089+0000 7f286d0c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:51.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.089+0000 7f286d0c09c0 20 started sync module instance, tier type = 2024-09-12T17:38:51.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.089+0000 7f286d0c09c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:51.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.113+0000 7f286d0c09c0 20 add_watcher() i=0 2024-09-12T17:38:51.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.113+0000 7f286d0c09c0 20 add_watcher() i=1 2024-09-12T17:38:51.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.113+0000 7f286d0c09c0 20 add_watcher() i=2 2024-09-12T17:38:51.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.113+0000 7f286d0c09c0 20 add_watcher() i=3 2024-09-12T17:38:51.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.113+0000 7f286d0c09c0 20 add_watcher() i=4 2024-09-12T17:38:51.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.113+0000 7f286d0c09c0 20 add_watcher() i=5 2024-09-12T17:38:51.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.113+0000 7f286d0c09c0 20 add_watcher() i=6 2024-09-12T17:38:51.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.113+0000 7f286d0c09c0 20 add_watcher() i=7 2024-09-12T17:38:51.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.113+0000 7f286d0c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:51.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.117+0000 7f27217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:51.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.117+0000 7f286d0c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:51.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.117+0000 7f286d0c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:51.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.117+0000 7f286d0c09c0 5 note: GC not initialized 2024-09-12T17:38:51.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.117+0000 7f269bfff640 20 reqs_thread_entry: start 2024-09-12T17:38:51.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.117+0000 7f286d0c09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:51.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.117+0000 7f286d0c09c0 20 Filter name: none 2024-09-12T17:38:51.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.117+0000 7f2699ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:51.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.117+0000 7f286d0c09c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:38:51.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.117+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:51.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:38:51.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:38:51.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 : miss 2024-09-12T17:38:51.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:51.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:51.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 info.flags=0x17 2024-09-12T17:38:51.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 to cache LRU end 2024-09-12T17:38:51.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:51.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:38:51.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 2024-09-12T17:38:51.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:51.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:38:51.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:51.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:38:51.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.121+0000 7f286d0c09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:51.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.125+0000 7f286d0c09c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:38:51.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.125+0000 7f286d0c09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:51.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.125+0000 7f286d0c09c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:38:51.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.125+0000 7f286d0c09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:51.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.125+0000 7f286d0c09c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:38:51.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.125+0000 7f286d0c09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:51.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.125+0000 7f286d0c09c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:38:51.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.125+0000 7f286d0c09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:51.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.125+0000 7f286d0c09c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:38:51.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.125+0000 7f286d0c09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:51.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.129+0000 7f286d0c09c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:38:51.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.129+0000 7f286d0c09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:51.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.129+0000 7f286d0c09c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:38:51.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.129+0000 7f286d0c09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:51.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.129+0000 7f286d0c09c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:38:51.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.129+0000 7f286d0c09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:51.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.129+0000 7f286d0c09c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:38:51.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.129+0000 7f286d0c09c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:38:51.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.129+0000 7f27217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:51.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.133+0000 7f286d0c09c0 20 remove_watcher() i=0 2024-09-12T17:38:51.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.133+0000 7f286d0c09c0 2 removed watcher, disabling cache 2024-09-12T17:38:51.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.137+0000 7f286d0c09c0 20 remove_watcher() i=1 2024-09-12T17:38:51.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.137+0000 7f286d0c09c0 20 remove_watcher() i=2 2024-09-12T17:38:51.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.141+0000 7f286d0c09c0 20 remove_watcher() i=3 2024-09-12T17:38:51.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.145+0000 7f286d0c09c0 20 remove_watcher() i=4 2024-09-12T17:38:51.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.149+0000 7f286d0c09c0 20 remove_watcher() i=5 2024-09-12T17:38:51.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.149+0000 7f286d0c09c0 20 remove_watcher() i=6 2024-09-12T17:38:51.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:51.153+0000 7f286d0c09c0 20 remove_watcher() i=7 2024-09-12T17:38:51.172 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T17:38:51.172 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:51.173 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:51.173 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:51.201 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:51.201 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:51.227 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:51.227 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:51.319 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T17:38:51.319 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:38:51.321 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:51.321 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:51.447 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:51.448 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:51.939 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:51.939 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:52.101 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:52.101 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:52.165 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:52.165 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:52.293 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:52.361 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:52.361 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:52.500 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:52.501 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:52.558 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:52.558 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:52.690 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:52.758 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:52.891 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:52.961 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:53.108 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:53.108 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:53.173 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:38:53.616 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:38:55.067 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:55.067 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:55.224 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:38:55.225 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:38:55.261 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:55.261 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:55.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.301+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.305+0000 7fc2af7a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.305+0000 7fc2af7a39c0 20 realm 2024-09-12T17:38:55.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.305+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.305+0000 7fc2af7a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.305+0000 7fc2af7a39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:55.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.305+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.305+0000 7fc2af7a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.305+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.305+0000 7fc2af7a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:55.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.305+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.309+0000 7fc2af7a39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:55.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.309+0000 7fc2af7a39c0 20 searching for the correct realm 2024-09-12T17:38:55.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.313+0000 7fc2adaaa640 0 -- 172.21.15.97:0/1586598551 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fc2980cc420 msgr2=0x7fc2980cc8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:55.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.317+0000 7fc2ad2a9640 0 -- 172.21.15.97:0/1586598551 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fc2a800e070 msgr2=0x7fc2a8078450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:55.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.325+0000 7fc2af7a39c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:55.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.325+0000 7fc2af7a39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:55.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.325+0000 7fc2af7a39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:55.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.325+0000 7fc2af7a39c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:55.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.325+0000 7fc2af7a39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:55.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.325+0000 7fc2af7a39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:55.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.325+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.325+0000 7fc2af7a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.325+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.325+0000 7fc2af7a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:55.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.325+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:55.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 20 zone default found 2024-09-12T17:38:55.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 4 Realm: () 2024-09-12T17:38:55.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:55.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:55.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:55.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 20 zonegroup default 2024-09-12T17:38:55.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 20 started sync module instance, tier type = 2024-09-12T17:38:55.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.329+0000 7fc2af7a39c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:55.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.349+0000 7fc2af7a39c0 20 add_watcher() i=0 2024-09-12T17:38:55.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.349+0000 7fc2af7a39c0 20 add_watcher() i=1 2024-09-12T17:38:55.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.349+0000 7fc2af7a39c0 20 add_watcher() i=2 2024-09-12T17:38:55.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.349+0000 7fc2af7a39c0 20 add_watcher() i=3 2024-09-12T17:38:55.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.349+0000 7fc2af7a39c0 20 add_watcher() i=4 2024-09-12T17:38:55.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.349+0000 7fc2af7a39c0 20 add_watcher() i=5 2024-09-12T17:38:55.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.349+0000 7fc2af7a39c0 20 add_watcher() i=6 2024-09-12T17:38:55.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.353+0000 7fc2af7a39c0 20 add_watcher() i=7 2024-09-12T17:38:55.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.353+0000 7fc2af7a39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:55.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.357+0000 7fc163fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:55.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.357+0000 7fc2af7a39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:55.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.357+0000 7fc2af7a39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:55.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.357+0000 7fc2af7a39c0 5 note: GC not initialized 2024-09-12T17:38:55.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.357+0000 7fc162fe5640 20 reqs_thread_entry: start 2024-09-12T17:38:55.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.357+0000 7fc2af7a39c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:55.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.357+0000 7fc2af7a39c0 20 Filter name: none 2024-09-12T17:38:55.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.357+0000 7fc160fe1640 20 reqs_thread_entry: start 2024-09-12T17:38:55.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.357+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.361+0000 7fc2af7a39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:55.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.361+0000 7fc2af7a39c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.361+0000 7fc2af7a39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:55.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.361+0000 7fc2af7a39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:55.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.361+0000 7fc2af7a39c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:55.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.361+0000 7fc2af7a39c0 20 INFO: main: starting shard=0 2024-09-12T17:38:55.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.361+0000 7fc2af7a39c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:55.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.361+0000 7fc2af7a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.361+0000 7fc2af7a39c0 20 INFO: main: starting shard=1 2024-09-12T17:38:55.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.361+0000 7fc2af7a39c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:55.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: starting shard=2 2024-09-12T17:38:55.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:55.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: starting shard=3 2024-09-12T17:38:55.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:55.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: starting shard=4 2024-09-12T17:38:55.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:55.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: starting shard=5 2024-09-12T17:38:55.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:55.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: starting shard=6 2024-09-12T17:38:55.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:55.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 INFO: main: starting shard=7 2024-09-12T17:38:55.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.365+0000 7fc2af7a39c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:55.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.369+0000 7fc2af7a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.369+0000 7fc2af7a39c0 20 INFO: main: starting shard=8 2024-09-12T17:38:55.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.369+0000 7fc2af7a39c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:55.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.369+0000 7fc2af7a39c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:38:55.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.369+0000 7fc2af7a39c0 20 INFO: main: starting shard=9 2024-09-12T17:38:55.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.369+0000 7fc2af7a39c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:55.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.369+0000 7fc2af7a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.369+0000 7fc2af7a39c0 20 INFO: main: starting shard=10 2024-09-12T17:38:55.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.369+0000 7fc2af7a39c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:55.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.369+0000 7fc2af7a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.369+0000 7fc2af7a39c0 20 INFO: main: done 2024-09-12T17:38:55.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.373+0000 7fc163fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:55.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.377+0000 7fc2af7a39c0 20 remove_watcher() i=0 2024-09-12T17:38:55.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.377+0000 7fc2af7a39c0 2 removed watcher, disabling cache 2024-09-12T17:38:55.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.381+0000 7fc2af7a39c0 20 remove_watcher() i=1 2024-09-12T17:38:55.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.381+0000 7fc2af7a39c0 20 remove_watcher() i=2 2024-09-12T17:38:55.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.385+0000 7fc2af7a39c0 20 remove_watcher() i=3 2024-09-12T17:38:55.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.389+0000 7fc2af7a39c0 20 remove_watcher() i=4 2024-09-12T17:38:55.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.389+0000 7fc2af7a39c0 20 remove_watcher() i=5 2024-09-12T17:38:55.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.393+0000 7fc2af7a39c0 20 remove_watcher() i=6 2024-09-12T17:38:55.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.397+0000 7fc2af7a39c0 20 remove_watcher() i=7 2024-09-12T17:38:55.415 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:55.416 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:55.445 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:55.445 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:55.472 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:55.473 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:55.596 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:38:55.597 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:38:55.632 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:55.632 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:55.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.673+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 20 realm 2024-09-12T17:38:55.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:55.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:55.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:55.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.677+0000 7fdd62aba9c0 20 searching for the correct realm 2024-09-12T17:38:55.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.685+0000 7fdd605c0640 0 -- 172.21.15.97:0/2119702876 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fdd5008ac20 msgr2=0x7fdd5007f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:55.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.689+0000 7fdd605c0640 0 -- 172.21.15.97:0/2119702876 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55970faff050 msgr2=0x55970fb01460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:55.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:55.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:55.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:55.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:55.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:55.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:55.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:55.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:55.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 zone default found 2024-09-12T17:38:55.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 4 Realm: () 2024-09-12T17:38:55.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:55.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:55.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:55.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 zonegroup default 2024-09-12T17:38:55.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.697+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.701+0000 7fdd62aba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.701+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.701+0000 7fdd62aba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.701+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.701+0000 7fdd62aba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:55.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.701+0000 7fdd62aba9c0 20 started sync module instance, tier type = 2024-09-12T17:38:55.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.701+0000 7fdd62aba9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:55.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.721+0000 7fdd62aba9c0 20 add_watcher() i=0 2024-09-12T17:38:55.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.721+0000 7fdd62aba9c0 20 add_watcher() i=1 2024-09-12T17:38:55.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.721+0000 7fdd62aba9c0 20 add_watcher() i=2 2024-09-12T17:38:55.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.721+0000 7fdd62aba9c0 20 add_watcher() i=3 2024-09-12T17:38:55.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.721+0000 7fdd62aba9c0 20 add_watcher() i=4 2024-09-12T17:38:55.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.721+0000 7fdd62aba9c0 20 add_watcher() i=5 2024-09-12T17:38:55.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.721+0000 7fdd62aba9c0 20 add_watcher() i=6 2024-09-12T17:38:55.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.725+0000 7fdd62aba9c0 20 add_watcher() i=7 2024-09-12T17:38:55.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.725+0000 7fdd62aba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:55.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.725+0000 7fdc177de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:55.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.725+0000 7fdd62aba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:55.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.725+0000 7fdd62aba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:55.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.725+0000 7fdd62aba9c0 5 note: GC not initialized 2024-09-12T17:38:55.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdc167dc640 20 reqs_thread_entry: start 2024-09-12T17:38:55.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:55.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 Filter name: none 2024-09-12T17:38:55.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdc0f7fe640 20 reqs_thread_entry: start 2024-09-12T17:38:55.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:55.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:55.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:55.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:55.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:55.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 INFO: main: starting shard=0 2024-09-12T17:38:55.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:55.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 INFO: main: starting shard=1 2024-09-12T17:38:55.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.729+0000 7fdd62aba9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:55.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 INFO: main: starting shard=2 2024-09-12T17:38:55.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:55.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 INFO: main: starting shard=3 2024-09-12T17:38:55.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:55.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 INFO: main: starting shard=4 2024-09-12T17:38:55.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:55.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 INFO: main: starting shard=5 2024-09-12T17:38:55.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:55.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:38:55.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 INFO: main: starting shard=6 2024-09-12T17:38:55.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.733+0000 7fdd62aba9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:55.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 INFO: main: starting shard=7 2024-09-12T17:38:55.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:55.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 INFO: main: starting shard=8 2024-09-12T17:38:55.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:55.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 INFO: main: starting shard=9 2024-09-12T17:38:55.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:55.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 INFO: main: starting shard=10 2024-09-12T17:38:55.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:55.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:55.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.737+0000 7fdd62aba9c0 20 INFO: main: done 2024-09-12T17:38:55.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.741+0000 7fdc177de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:55.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.745+0000 7fdd62aba9c0 20 remove_watcher() i=0 2024-09-12T17:38:55.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.745+0000 7fdd62aba9c0 2 removed watcher, disabling cache 2024-09-12T17:38:55.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.745+0000 7fdd62aba9c0 20 remove_watcher() i=1 2024-09-12T17:38:55.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.749+0000 7fdd62aba9c0 20 remove_watcher() i=2 2024-09-12T17:38:55.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.749+0000 7fdd62aba9c0 20 remove_watcher() i=3 2024-09-12T17:38:55.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.753+0000 7fdd62aba9c0 20 remove_watcher() i=4 2024-09-12T17:38:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.753+0000 7fdd62aba9c0 20 remove_watcher() i=5 2024-09-12T17:38:55.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.757+0000 7fdd62aba9c0 20 remove_watcher() i=6 2024-09-12T17:38:55.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:55.761+0000 7fdd62aba9c0 20 remove_watcher() i=7 2024-09-12T17:38:55.784 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:55.784 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:55.821 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:55.821 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:55.956 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:38:55.957 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:38:55.992 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:55.992 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:56.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.033+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.037+0000 7f4e9e7e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.037+0000 7f4e9e7e19c0 20 realm 2024-09-12T17:38:56.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.037+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.037+0000 7f4e9e7e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.037+0000 7f4e9e7e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:56.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.037+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.037+0000 7f4e9e7e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.037+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.037+0000 7f4e9e7e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:56.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.037+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.041+0000 7f4e9e7e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:56.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.041+0000 7f4e9e7e19c0 20 searching for the correct realm 2024-09-12T17:38:56.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.045+0000 7f4e9cae8640 0 -- 172.21.15.97:0/1346941447 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55c537da8630 msgr2=0x55c537daaa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:56.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.053+0000 7f4e9c2e7640 0 -- 172.21.15.97:0/1346941447 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55c537dac660 msgr2=0x55c537daeb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:56.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:56.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:56.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:56.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:56.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:56.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:56.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 zone default found 2024-09-12T17:38:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 4 Realm: () 2024-09-12T17:38:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 zonegroup default 2024-09-12T17:38:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 started sync module instance, tier type = 2024-09-12T17:38:56.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.061+0000 7f4e9e7e19c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:56.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.085+0000 7f4e9e7e19c0 20 add_watcher() i=0 2024-09-12T17:38:56.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.085+0000 7f4e9e7e19c0 20 add_watcher() i=1 2024-09-12T17:38:56.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.085+0000 7f4e9e7e19c0 20 add_watcher() i=2 2024-09-12T17:38:56.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.085+0000 7f4e9e7e19c0 20 add_watcher() i=3 2024-09-12T17:38:56.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.085+0000 7f4e9e7e19c0 20 add_watcher() i=4 2024-09-12T17:38:56.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.085+0000 7f4e9e7e19c0 20 add_watcher() i=5 2024-09-12T17:38:56.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.085+0000 7f4e9e7e19c0 20 add_watcher() i=6 2024-09-12T17:38:56.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.089+0000 7f4e9e7e19c0 20 add_watcher() i=7 2024-09-12T17:38:56.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.089+0000 7f4e9e7e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:56.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.089+0000 7f4d52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:56.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:56.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:56.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 5 note: GC not initialized 2024-09-12T17:38:56.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4d51fe3640 20 reqs_thread_entry: start 2024-09-12T17:38:56.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:56.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 Filter name: none 2024-09-12T17:38:56.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4d4b7fe640 20 reqs_thread_entry: start 2024-09-12T17:38:56.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:56.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:56.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:56.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:56.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 INFO: main: starting shard=0 2024-09-12T17:38:56.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:56.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 INFO: main: starting shard=1 2024-09-12T17:38:56.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.093+0000 7f4e9e7e19c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:56.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:38:56.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 INFO: main: starting shard=2 2024-09-12T17:38:56.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:56.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 INFO: main: starting shard=3 2024-09-12T17:38:56.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:56.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 INFO: main: starting shard=4 2024-09-12T17:38:56.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:56.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 INFO: main: starting shard=5 2024-09-12T17:38:56.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:56.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 INFO: main: starting shard=6 2024-09-12T17:38:56.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.097+0000 7f4e9e7e19c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:56.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 INFO: main: starting shard=7 2024-09-12T17:38:56.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:56.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 INFO: main: starting shard=8 2024-09-12T17:38:56.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:56.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 INFO: main: starting shard=9 2024-09-12T17:38:56.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:56.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 INFO: main: starting shard=10 2024-09-12T17:38:56.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:56.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.101+0000 7f4e9e7e19c0 20 INFO: main: done 2024-09-12T17:38:56.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.105+0000 7f4d52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:56.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.109+0000 7f4e9e7e19c0 20 remove_watcher() i=0 2024-09-12T17:38:56.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.109+0000 7f4e9e7e19c0 2 removed watcher, disabling cache 2024-09-12T17:38:56.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.109+0000 7f4e9e7e19c0 20 remove_watcher() i=1 2024-09-12T17:38:56.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.113+0000 7f4e9e7e19c0 20 remove_watcher() i=2 2024-09-12T17:38:56.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.113+0000 7f4e9e7e19c0 20 remove_watcher() i=3 2024-09-12T17:38:56.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.117+0000 7f4e9e7e19c0 20 remove_watcher() i=4 2024-09-12T17:38:56.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.117+0000 7f4e9e7e19c0 20 remove_watcher() i=5 2024-09-12T17:38:56.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.121+0000 7f4e9e7e19c0 20 remove_watcher() i=6 2024-09-12T17:38:56.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.125+0000 7f4e9e7e19c0 20 remove_watcher() i=7 2024-09-12T17:38:56.145 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:56.145 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:56.170 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:56.170 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:56.296 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:38:56.297 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:38:56.332 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:56.332 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:56.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.373+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 20 realm 2024-09-12T17:38:56.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:56.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:56.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:56.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.377+0000 7f55b4da89c0 20 searching for the correct realm 2024-09-12T17:38:56.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.385+0000 7f55b20ad640 0 -- 172.21.15.97:0/3773733427 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x55cc0854b3e0 msgr2=0x7f55a80e8400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:56.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.389+0000 7f55b20ad640 0 -- 172.21.15.97:0/3773733427 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55cc08779590 msgr2=0x55cc0877b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:56.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.397+0000 7f55b4da89c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:56.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.397+0000 7f55b4da89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.397+0000 7f55b4da89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.397+0000 7f55b4da89c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.397+0000 7f55b4da89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.397+0000 7f55b4da89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.397+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.397+0000 7f55b4da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.397+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:56.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:56.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 zone default found 2024-09-12T17:38:56.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 4 Realm: () 2024-09-12T17:38:56.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:56.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:56.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:56.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 zonegroup default 2024-09-12T17:38:56.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:56.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 started sync module instance, tier type = 2024-09-12T17:38:56.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.401+0000 7f55b4da89c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:56.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.421+0000 7f55b4da89c0 20 add_watcher() i=0 2024-09-12T17:38:56.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.421+0000 7f55b4da89c0 20 add_watcher() i=1 2024-09-12T17:38:56.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.421+0000 7f55b4da89c0 20 add_watcher() i=2 2024-09-12T17:38:56.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.421+0000 7f55b4da89c0 20 add_watcher() i=3 2024-09-12T17:38:56.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.421+0000 7f55b4da89c0 20 add_watcher() i=4 2024-09-12T17:38:56.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.421+0000 7f55b4da89c0 20 add_watcher() i=5 2024-09-12T17:38:56.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.421+0000 7f55b4da89c0 20 add_watcher() i=6 2024-09-12T17:38:56.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.421+0000 7f55b4da89c0 20 add_watcher() i=7 2024-09-12T17:38:56.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.421+0000 7f55b4da89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:56.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.425+0000 7f54697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:56.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.425+0000 7f55b4da89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:56.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.425+0000 7f55b4da89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:56.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.425+0000 7f55b4da89c0 5 note: GC not initialized 2024-09-12T17:38:56.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.425+0000 7f53e3fff640 20 reqs_thread_entry: start 2024-09-12T17:38:56.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.425+0000 7f55b4da89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:56.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 Filter name: none 2024-09-12T17:38:56.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f53e1ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:56.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:56.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:56.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:56.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:38:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 INFO: main: starting shard=0 2024-09-12T17:38:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 INFO: main: starting shard=1 2024-09-12T17:38:56.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.429+0000 7f55b4da89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:56.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 INFO: main: starting shard=2 2024-09-12T17:38:56.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:56.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 INFO: main: starting shard=3 2024-09-12T17:38:56.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:56.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 INFO: main: starting shard=4 2024-09-12T17:38:56.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:56.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 INFO: main: starting shard=5 2024-09-12T17:38:56.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.433+0000 7f55b4da89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:56.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 INFO: main: starting shard=6 2024-09-12T17:38:56.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:56.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 INFO: main: starting shard=7 2024-09-12T17:38:56.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 INFO: main: starting shard=8 2024-09-12T17:38:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:56.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 INFO: main: starting shard=9 2024-09-12T17:38:56.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:56.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:38:56.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 INFO: main: starting shard=10 2024-09-12T17:38:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.437+0000 7f55b4da89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.441+0000 7f55b4da89c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:38:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.441+0000 7f55b4da89c0 20 INFO: main: done 2024-09-12T17:38:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.441+0000 7f54697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:56.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.445+0000 7f55b4da89c0 20 remove_watcher() i=0 2024-09-12T17:38:56.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.445+0000 7f55b4da89c0 2 removed watcher, disabling cache 2024-09-12T17:38:56.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.445+0000 7f55b4da89c0 20 remove_watcher() i=1 2024-09-12T17:38:56.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.449+0000 7f55b4da89c0 20 remove_watcher() i=2 2024-09-12T17:38:56.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.453+0000 7f55b4da89c0 20 remove_watcher() i=3 2024-09-12T17:38:56.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.457+0000 7f55b4da89c0 20 remove_watcher() i=4 2024-09-12T17:38:56.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.461+0000 7f55b4da89c0 20 remove_watcher() i=5 2024-09-12T17:38:56.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.461+0000 7f55b4da89c0 20 remove_watcher() i=6 2024-09-12T17:38:56.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:56.465+0000 7f55b4da89c0 20 remove_watcher() i=7 2024-09-12T17:38:56.485 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:56.510 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:38:56.942 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:38:57.370 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:38:57.394 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:57.394 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:57.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.429+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 20 realm 2024-09-12T17:38:57.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:57.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:57.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:57.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.433+0000 7f59eef519c0 20 searching for the correct realm 2024-09-12T17:38:57.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.441+0000 7f59eca57640 0 -- 172.21.15.97:0/3383690390 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x5593ca75ad60 msgr2=0x5593ca75d150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:57.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.449+0000 7f59eca57640 0 -- 172.21.15.97:0/3383690390 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f59e40c5040 msgr2=0x7f59e40dd3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:57.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:57.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:57.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:57.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:57.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:57.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:57.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:57.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:57.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 zone default found 2024-09-12T17:38:57.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 4 Realm: () 2024-09-12T17:38:57.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:57.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:57.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:57.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 zonegroup default 2024-09-12T17:38:57.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.453+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.457+0000 7f59eef519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.457+0000 7f59eef519c0 20 started sync module instance, tier type = 2024-09-12T17:38:57.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.457+0000 7f59eef519c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:57.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.473+0000 7f59eef519c0 20 add_watcher() i=0 2024-09-12T17:38:57.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.473+0000 7f59eef519c0 20 add_watcher() i=1 2024-09-12T17:38:57.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.473+0000 7f59eef519c0 20 add_watcher() i=2 2024-09-12T17:38:57.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.473+0000 7f59eef519c0 20 add_watcher() i=3 2024-09-12T17:38:57.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.473+0000 7f59eef519c0 20 add_watcher() i=4 2024-09-12T17:38:57.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.473+0000 7f59eef519c0 20 add_watcher() i=5 2024-09-12T17:38:57.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.473+0000 7f59eef519c0 20 add_watcher() i=6 2024-09-12T17:38:57.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.477+0000 7f59eef519c0 20 add_watcher() i=7 2024-09-12T17:38:57.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.477+0000 7f59eef519c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:57.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f58a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 5 note: GC not initialized 2024-09-12T17:38:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f58a1fe3640 20 reqs_thread_entry: start 2024-09-12T17:38:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 20 Filter name: none 2024-09-12T17:38:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f58137fe640 20 reqs_thread_entry: start 2024-09-12T17:38:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:38:57.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:38:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:38:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 : miss 2024-09-12T17:38:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 info.flags=0x17 2024-09-12T17:38:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 to cache LRU end 2024-09-12T17:38:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:38:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 2024-09-12T17:38:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.481+0000 7f59eef519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.485+0000 7f59eef519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:57.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.485+0000 7f59eef519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:57.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.485+0000 7f59eef519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:57.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.485+0000 7f59eef519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:57.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.485+0000 7f59eef519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:57.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.489+0000 7f59eef519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:57.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.489+0000 7f59eef519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:57.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.489+0000 7f59eef519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:57.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.489+0000 7f59eef519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:57.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.489+0000 7f59eef519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:57.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.497+0000 7f58a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:57.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.501+0000 7f59eef519c0 20 remove_watcher() i=0 2024-09-12T17:38:57.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.501+0000 7f59eef519c0 2 removed watcher, disabling cache 2024-09-12T17:38:57.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.505+0000 7f59eef519c0 20 remove_watcher() i=1 2024-09-12T17:38:57.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.505+0000 7f59eef519c0 20 remove_watcher() i=2 2024-09-12T17:38:57.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.509+0000 7f59eef519c0 20 remove_watcher() i=3 2024-09-12T17:38:57.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.509+0000 7f59eef519c0 20 remove_watcher() i=4 2024-09-12T17:38:57.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.513+0000 7f59eef519c0 20 remove_watcher() i=5 2024-09-12T17:38:57.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.513+0000 7f59eef519c0 20 remove_watcher() i=6 2024-09-12T17:38:57.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.517+0000 7f59eef519c0 20 remove_watcher() i=7 2024-09-12T17:38:57.532 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:38:57.562 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:57.563 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:57.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.597+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.601+0000 7fd1286c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.601+0000 7fd1286c99c0 20 realm 2024-09-12T17:38:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.601+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.601+0000 7fd1286c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.601+0000 7fd1286c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.601+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.601+0000 7fd1286c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.601+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.601+0000 7fd1286c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:57.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.601+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.605+0000 7fd1286c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:57.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.605+0000 7fd1286c99c0 20 searching for the correct realm 2024-09-12T17:38:57.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.609+0000 7fd1259ce640 0 -- 172.21.15.97:0/643400283 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5571ec811ac0 msgr2=0x5571ec813f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:57.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.617+0000 7fd1261cf640 0 -- 172.21.15.97:0/643400283 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x5571ec815d10 msgr2=0x5571ec818140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:57.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.621+0000 7fd1286c99c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:57.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.621+0000 7fd1286c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:57.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.621+0000 7fd1286c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:57.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.621+0000 7fd1286c99c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:57.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.621+0000 7fd1286c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:57.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.621+0000 7fd1286c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:57.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.621+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.621+0000 7fd1286c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.621+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.621+0000 7fd1286c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:57.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.621+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:57.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 20 zone default found 2024-09-12T17:38:57.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 4 Realm: () 2024-09-12T17:38:57.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:57.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:57.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:57.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 20 zonegroup default 2024-09-12T17:38:57.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:57.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 20 started sync module instance, tier type = 2024-09-12T17:38:57.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.625+0000 7fd1286c99c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:57.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.645+0000 7fd1286c99c0 20 add_watcher() i=0 2024-09-12T17:38:57.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.645+0000 7fd1286c99c0 20 add_watcher() i=1 2024-09-12T17:38:57.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.645+0000 7fd1286c99c0 20 add_watcher() i=2 2024-09-12T17:38:57.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.645+0000 7fd1286c99c0 20 add_watcher() i=3 2024-09-12T17:38:57.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.645+0000 7fd1286c99c0 20 add_watcher() i=4 2024-09-12T17:38:57.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.645+0000 7fd1286c99c0 20 add_watcher() i=5 2024-09-12T17:38:57.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.645+0000 7fd1286c99c0 20 add_watcher() i=6 2024-09-12T17:38:57.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.649+0000 7fd1286c99c0 20 add_watcher() i=7 2024-09-12T17:38:57.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.649+0000 7fd1286c99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:57.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fcfdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:57.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:57.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:57.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 5 note: GC not initialized 2024-09-12T17:38:57.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fcf577fe640 20 reqs_thread_entry: start 2024-09-12T17:38:57.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:57.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 20 Filter name: none 2024-09-12T17:38:57.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fcf557fa640 20 reqs_thread_entry: start 2024-09-12T17:38:57.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:38:57.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:57.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:38:57.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:38:57.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 : miss 2024-09-12T17:38:57.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:57.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:57.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 info.flags=0x17 2024-09-12T17:38:57.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 to cache LRU end 2024-09-12T17:38:57.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:57.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:38:57.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.1 2024-09-12T17:38:57.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.653+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.0 2024-09-12T17:38:57.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:38:57.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:57.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.2 2024-09-12T17:38:57.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:38:57.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.3 2024-09-12T17:38:57.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:38:57.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.4 2024-09-12T17:38:57.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:38:57.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:57.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.6 2024-09-12T17:38:57.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:38:57.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.657+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.7 2024-09-12T17:38:57.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.661+0000 7fd1286c99c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:38:57.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.661+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:57.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.661+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.9 2024-09-12T17:38:57.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.661+0000 7fd1286c99c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:38:57.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.661+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:57.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.661+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:57.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.661+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec5103b0 obj=check-bucket:e state=0x5571ec849a48 s->prefetch_data=0 2024-09-12T17:38:57.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.661+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:57.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec5b51a0 obj=check-bucket:d state=0x5571ec84b118 s->prefetch_data=0 2024-09-12T17:38:57.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:57.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec84c4f0 obj=check-bucket:c state=0x5571ec845178 s->prefetch_data=0 2024-09-12T17:38:57.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:57.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec84e8b0 obj=check-bucket:f state=0x5571ec848a78 s->prefetch_data=0 2024-09-12T17:38:57.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 get_obj_state: setting s->obj_tag to wk4cl6na6a6pyvq38hc330xhtjvkk0u5 2024-09-12T17:38:57.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 get_obj_state_impl: setting s->olh_tag to biqtzun33bqg1rderovsk9s1p5ftoef0 2024-09-12T17:38:57.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=biqtzun33bqg1rderovsk9s1p5ftoef0 2024-09-12T17:38:57.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 get_obj_state: setting s->obj_tag to 8asl2vcihd4p37xckdjp1kzohybex7nv 2024-09-12T17:38:57.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 get_obj_state_impl: setting s->olh_tag to iix0hbmnevvac6phw39tuieyq5kt571h 2024-09-12T17:38:57.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=iix0hbmnevvac6phw39tuieyq5kt571h 2024-09-12T17:38:57.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 get_obj_state: setting s->obj_tag to 357rb7hkz5oxejmpkgwuvfbh42z3zd2r 2024-09-12T17:38:57.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 get_obj_state_impl: setting s->olh_tag to mlkod5yph5ce43zndnusiv9zk72y8fqv 2024-09-12T17:38:57.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mlkod5yph5ce43zndnusiv9zk72y8fqv 2024-09-12T17:38:57.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 get_obj_state: setting s->obj_tag to 4034vhsgw6x3e9oxio70op7uz7y7xda1 2024-09-12T17:38:57.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 get_obj_state_impl: setting s->olh_tag to 27v3yoj2qr2mak856hh0lk9i6atu8kke 2024-09-12T17:38:57.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=27v3yoj2qr2mak856hh0lk9i6atu8kke 2024-09-12T17:38:57.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:57.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:57.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:57.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.665+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:57.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:57.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 olh_log_entry: epoch=3 op=3 key=c[uKHFzMA9Cs.0hZ1iPKGPKBUwdMETtUQ] 2024-09-12T17:38:57.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec84c4f0 obj=check-bucket:_:uKHFzMA9Cs.0hZ1iPKGPKBUwdMETtUQ_c state=0x5571ec8e4b48 s->prefetch_data=0 2024-09-12T17:38:57.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 10 manifest: total_size = 12 2024-09-12T17:38:57.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.18284298594530632066 2024-09-12T17:38:57.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec84c4f0 obj=check-bucket:_:uKHFzMA9Cs.0hZ1iPKGPKBUwdMETtUQ_c state=0x5571ec8e4b48 s->prefetch_data=0 2024-09-12T17:38:57.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 prepare_atomic_modification: state is not atomic. state=0x5571ec8e4b48 2024-09-12T17:38:57.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:57.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:57.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:38:57.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 olh_log_entry: epoch=2 op=3 key=f[QVMpf4VolQWqNTChy0YWVTDhJfZcIz-] 2024-09-12T17:38:57.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec84e8b0 obj=check-bucket:_:QVMpf4VolQWqNTChy0YWVTDhJfZcIz-_f state=0x5571ec8d7328 s->prefetch_data=0 2024-09-12T17:38:57.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:57.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 10 manifest: total_size = 22 2024-09-12T17:38:57.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.12634196832363141750 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec84e8b0 obj=check-bucket:_:QVMpf4VolQWqNTChy0YWVTDhJfZcIz-_f state=0x5571ec8d7328 s->prefetch_data=0 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 prepare_atomic_modification: state is not atomic. state=0x5571ec8d7328 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 olh_log_entry: epoch=2 op=3 key=e[DOFUErRu3czsyXygRANp0gTTjIT0ukZ] 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec5103b0 obj=check-bucket:_:DOFUErRu3czsyXygRANp0gTTjIT0ukZ_e state=0x5571ec8ec468 s->prefetch_data=0 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 olh_log_entry: epoch=3 op=3 key=d[8B1UTAL-nLMNon9LgKAaR6x8IcAfX82] 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec5b51a0 obj=check-bucket:_:8B1UTAL-nLMNon9LgKAaR6x8IcAfX82_d state=0x5571ec906328 s->prefetch_data=0 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 10 manifest: total_size = 22 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.6786900244081716986 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec5103b0 obj=check-bucket:_:DOFUErRu3czsyXygRANp0gTTjIT0ukZ_e state=0x5571ec8ec468 s->prefetch_data=0 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 prepare_atomic_modification: state is not atomic. state=0x5571ec8ec468 2024-09-12T17:38:57.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.669+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:57.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 10 manifest: total_size = 12 2024-09-12T17:38:57.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.10630416655194681117 2024-09-12T17:38:57.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec5b51a0 obj=check-bucket:_:8B1UTAL-nLMNon9LgKAaR6x8IcAfX82_d state=0x5571ec906328 s->prefetch_data=0 2024-09-12T17:38:57.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 20 prepare_atomic_modification: state is not atomic. state=0x5571ec906328 2024-09-12T17:38:57.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:57.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:57.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:38:57.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:38:57.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 5 delete_objs_inline: removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.1__shadow:uKHFzMA9Cs.0hZ1iPKGPKBUwdMETtUQ_.CwUJQxuoXKM0ccLHBPKpC-Xzk4D-VG-_0 2024-09-12T17:38:57.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:57.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:38:57.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:38:57.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 5 delete_objs_inline: removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.1__shadow:QVMpf4VolQWqNTChy0YWVTDhJfZcIz-_.Rva-YcBUA3xGi0G974_ryQ9GaVrvUSF_0 2024-09-12T17:38:57.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd1286c99c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:38:57.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.673+0000 7fd009ffb640 20 handle_completion(): completion ok for obj=c[uKHFzMA9Cs.0hZ1iPKGPKBUwdMETtUQ] 2024-09-12T17:38:57.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:38:57.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:57.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:57.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd009ffb640 20 handle_completion(): completion ok for obj=f[QVMpf4VolQWqNTChy0YWVTDhJfZcIz-] 2024-09-12T17:38:57.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:57.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:38:57.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:38:57.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 5 delete_objs_inline: removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.1__shadow:DOFUErRu3czsyXygRANp0gTTjIT0ukZ_._bMWVb2JNk-pj5wKvLrjCxmCVbqUlQh_0 2024-09-12T17:38:57.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:38:57.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:38:57.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:38:57.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 5 delete_objs_inline: removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.1__shadow:8B1UTAL-nLMNon9LgKAaR6x8IcAfX82_.v229CpsZvFTA3OSBX8jPBgIascypigj_0 2024-09-12T17:38:57.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec84e8b0 obj=check-bucket:f state=0x5571ec848a78 s->prefetch_data=0 2024-09-12T17:38:57.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=27v3yoj2qr2mak856hh0lk9i6atu8kke 2024-09-12T17:38:57.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.677+0000 7fd1286c99c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:38:57.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.681+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.8 2024-09-12T17:38:57.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.681+0000 7fd1286c99c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:38:57.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.681+0000 7fd1286c99c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:38:57.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.681+0000 7fd0097fa640 20 handle_completion(): completion ok for obj=d[8B1UTAL-nLMNon9LgKAaR6x8IcAfX82] 2024-09-12T17:38:57.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.681+0000 7fd0097fa640 20 handle_completion(): completion ok for obj=e[DOFUErRu3czsyXygRANp0gTTjIT0ukZ] 2024-09-12T17:38:57.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.681+0000 7fd1286c99c0 20 get_obj_state: octx=0x5571ec5103b0 obj=check-bucket:e state=0x5571ec849a48 s->prefetch_data=0 2024-09-12T17:38:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.681+0000 7fd1286c99c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=biqtzun33bqg1rderovsk9s1p5ftoef0 2024-09-12T17:38:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.681+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.681+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.681+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.685+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.5 2024-09-12T17:38:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.685+0000 7fd1286c99c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:38:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.685+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.10 2024-09-12T17:38:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.685+0000 7fd1286c99c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:38:57.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.685+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:57.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.689+0000 7fd1286c99c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.1.1 2024-09-12T17:38:57.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.689+0000 7fd1286c99c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:38:57.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.689+0000 7fd1286c99c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:38:57.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.689+0000 7fcfdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:57.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.693+0000 7fd1286c99c0 20 remove_watcher() i=0 2024-09-12T17:38:57.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.693+0000 7fd1286c99c0 2 removed watcher, disabling cache 2024-09-12T17:38:57.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.697+0000 7fd1286c99c0 20 remove_watcher() i=1 2024-09-12T17:38:57.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.697+0000 7fd1286c99c0 20 remove_watcher() i=2 2024-09-12T17:38:57.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.701+0000 7fd1286c99c0 20 remove_watcher() i=3 2024-09-12T17:38:57.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.701+0000 7fd1286c99c0 20 remove_watcher() i=4 2024-09-12T17:38:57.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.701+0000 7fd1286c99c0 20 remove_watcher() i=5 2024-09-12T17:38:57.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.705+0000 7fd1286c99c0 20 remove_watcher() i=6 2024-09-12T17:38:57.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:57.709+0000 7fd1286c99c0 20 remove_watcher() i=7 2024-09-12T17:38:57.725 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:57.725 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:57.763 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:57.763 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:58.181 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:38:58.215 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:58.215 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:58.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.257+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.261+0000 7fb82e1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:58.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.261+0000 7fb82e1d79c0 20 realm 2024-09-12T17:38:58.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.261+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.261+0000 7fb82e1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:58.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.261+0000 7fb82e1d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:58.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.261+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.261+0000 7fb82e1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:58.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.261+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.261+0000 7fb82e1d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:58.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.261+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.265+0000 7fb82e1d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:58.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.265+0000 7fb82e1d79c0 20 searching for the correct realm 2024-09-12T17:38:58.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.269+0000 7fb82b4dc640 0 -- 172.21.15.97:0/2108843769 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fb8200aa3d0 msgr2=0x7fb8200aa850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:58.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.273+0000 7fb82b4dc640 0 -- 172.21.15.97:0/2108843769 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5640dabb62c0 msgr2=0x5640dabb86f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:58.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.281+0000 7fb82e1d79c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:38:58.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.281+0000 7fb82e1d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:58.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.281+0000 7fb82e1d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:58.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.281+0000 7fb82e1d79c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:38:58.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.281+0000 7fb82e1d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:58.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.281+0000 7fb82e1d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:58.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.281+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:58.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:58.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:58.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 zone default found 2024-09-12T17:38:58.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 4 Realm: () 2024-09-12T17:38:58.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:38:58.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:38:58.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:58.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 zonegroup default 2024-09-12T17:38:58.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:58.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:58.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:58.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 started sync module instance, tier type = 2024-09-12T17:38:58.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.285+0000 7fb82e1d79c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:38:58.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.305+0000 7fb82e1d79c0 20 add_watcher() i=0 2024-09-12T17:38:58.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.305+0000 7fb82e1d79c0 20 add_watcher() i=1 2024-09-12T17:38:58.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.305+0000 7fb82e1d79c0 20 add_watcher() i=2 2024-09-12T17:38:58.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.305+0000 7fb82e1d79c0 20 add_watcher() i=3 2024-09-12T17:38:58.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.305+0000 7fb82e1d79c0 20 add_watcher() i=4 2024-09-12T17:38:58.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.305+0000 7fb82e1d79c0 20 add_watcher() i=5 2024-09-12T17:38:58.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.305+0000 7fb82e1d79c0 20 add_watcher() i=6 2024-09-12T17:38:58.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.309+0000 7fb82e1d79c0 20 add_watcher() i=7 2024-09-12T17:38:58.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.309+0000 7fb82e1d79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:58.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb6e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:58.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:58.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:58.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 5 note: GC not initialized 2024-09-12T17:38:58.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb6e0fe1640 20 reqs_thread_entry: start 2024-09-12T17:38:58.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:58.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 Filter name: none 2024-09-12T17:38:58.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb65a7fc640 20 reqs_thread_entry: start 2024-09-12T17:38:58.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:58.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:58.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:58.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:38:58.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.313+0000 7fb82e1d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:58.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.317+0000 7fb82e1d79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:38:58.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.317+0000 7fb82e1d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:58.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.317+0000 7fb6e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:58.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.321+0000 7fb82e1d79c0 20 remove_watcher() i=0 2024-09-12T17:38:58.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.321+0000 7fb82e1d79c0 2 removed watcher, disabling cache 2024-09-12T17:38:58.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.325+0000 7fb82e1d79c0 20 remove_watcher() i=1 2024-09-12T17:38:58.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.325+0000 7fb82e1d79c0 20 remove_watcher() i=2 2024-09-12T17:38:58.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.329+0000 7fb82e1d79c0 20 remove_watcher() i=3 2024-09-12T17:38:58.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.333+0000 7fb82e1d79c0 20 remove_watcher() i=4 2024-09-12T17:38:58.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.333+0000 7fb82e1d79c0 20 remove_watcher() i=5 2024-09-12T17:38:58.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.337+0000 7fb82e1d79c0 20 remove_watcher() i=6 2024-09-12T17:38:58.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:38:58.341+0000 7fb82e1d79c0 20 remove_watcher() i=7 2024-09-12T17:38:58.358 INFO:tasks.workunit.client.0.smithi097.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:38:58.358 INFO:tasks.workunit.client.0.smithi097.stderr:Deleting bucket check-bucket 2024-09-12T17:38:58.359 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:58.359 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:58.396 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:38:58.397 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:38:58.906 INFO:tasks.workunit.client.0.smithi097.stderr:Completed bucket check tests 2024-09-12T17:38:58.907 INFO:tasks.workunit.client.0.smithi097.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T17:38:58.907 INFO:tasks.workunit.client.0.smithi097.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T17:38:58.907 INFO:tasks.workunit.client.0.smithi097.stdout:connected to https://localhost:443 2024-09-12T17:38:59.008 INFO:tasks.workunit.client.0.smithi097.stderr:+ deactivate 2024-09-12T17:38:59.008 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T17:38:59.008 INFO:tasks.workunit.client.0.smithi097.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:38:59.008 INFO:tasks.workunit.client.0.smithi097.stderr:+ export PATH 2024-09-12T17:38:59.008 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:38:59.008 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-12T17:38:59.009 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:38:59.009 INFO:tasks.workunit.client.0.smithi097.stderr:+ hash -r 2024-09-12T17:38:59.009 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-12T17:38:59.009 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:38:59.009 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:38:59.009 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:38:59.009 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset -f deactivate 2024-09-12T17:38:59.009 INFO:tasks.workunit.client.0.smithi097.stderr:+ echo OK. 2024-09-12T17:38:59.010 INFO:tasks.workunit.client.0.smithi097.stdout:OK. 2024-09-12T17:38:59.010 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:38:59.011 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:38:59.022 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T17:38:59.023 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:38:59.540 DEBUG:teuthology.parallel:result is None 2024-09-12T17:38:59.541 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:38:59.551 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:38:59.551 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:59.615 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:38:59.616 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:38:59.632 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:38:59.632 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:38:59.633 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:59.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:38:59.665 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:38:59.665 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:59.712 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:38:59.712 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:38:59.761 INFO:tasks.workunit:timeout=3h 2024-09-12T17:38:59.761 INFO:tasks.workunit:cleanup=True 2024-09-12T17:38:59.762 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:38:59.810 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:39:56.427 INFO:tasks.workunit.client.0.smithi097.stderr:Updating files: 98% (12518/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:39:57.092 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:39:57.092 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:39:57.092 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:39:57.092 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:39:57.092 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:39:57.093 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:39:57.093 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:39:57.093 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:39:57.093 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:39:57.093 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-09-12T17:39:57.093 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:39:57.093 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-09-12T17:39:57.093 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:39:57.093 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-09-12T17:39:57.093 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:39:57.093 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:39:57.094 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:39:57.094 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:39:57.100 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:39:57.148 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:39:57.152 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:39:57.152 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:39:57.206 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:39:57.260 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:39:57.304 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:39:57.306 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:39:57.306 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:39:57.345 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:39:57.349 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:39:57.349 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:39:57.399 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T17:39:57.400 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T17:39:57.401 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T17:39:57.466 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-12T17:39:57.466 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:39:57.466 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:39:57.466 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from ClsLock 2024-09-12T17:39:57.466 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T17:39:59.004 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-12T17:39:59.005 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: exclusive 2024-09-12T17:39:59.005 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-12T17:39:59.005 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-12T17:39:59.005 INFO:tasks.workunit.client.0.smithi097.stdout: client.5000 expiration=2024-09-12T17:41:58.996881+0000 addr=v1:172.21.15.97:0/3816868473 cookie= 2024-09-12T17:39:59.012 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-12T17:39:59.013 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: shared 2024-09-12T17:39:59.013 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-12T17:39:59.013 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-12T17:39:59.013 INFO:tasks.workunit.client.0.smithi097.stdout: client.5000 expiration=2024-09-12T17:41:59.009985+0000 addr=v1:172.21.15.97:0/3816868473 cookie= 2024-09-12T17:39:59.013 INFO:tasks.workunit.client.0.smithi097.stdout: client.5006 expiration=0.000000 addr=v1:172.21.15.97:0/2363050842 cookie= 2024-09-12T17:39:59.015 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-12T17:39:59.015 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: shared 2024-09-12T17:39:59.015 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-12T17:39:59.015 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-12T17:39:59.015 INFO:tasks.workunit.client.0.smithi097.stdout: client.5006 expiration=0.000000 addr=v1:172.21.15.97:0/2363050842 cookie= 2024-09-12T17:39:59.949 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestMultiLocking (2483 ms) 2024-09-12T17:39:59.949 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T17:40:02.230 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-12T17:40:02.230 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: shared 2024-09-12T17:40:02.231 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-12T17:40:02.231 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-12T17:40:02.231 INFO:tasks.workunit.client.0.smithi097.stdout: client.5015 expiration=0.000000 addr=v1:172.21.15.97:0/2678485677 cookie= 2024-09-12T17:40:02.236 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-12T17:40:02.236 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: exclusive 2024-09-12T17:40:02.236 INFO:tasks.workunit.client.0.smithi097.stdout: tag: new_tag 2024-09-12T17:40:02.236 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-12T17:40:02.236 INFO:tasks.workunit.client.0.smithi097.stdout: client.5169 expiration=0.000000 addr=v1:172.21.15.97:0/2797040906 cookie= 2024-09-12T17:40:02.955 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestMeta (3006 ms) 2024-09-12T17:40:02.956 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T17:40:05.051 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-12T17:40:05.052 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: exclusive 2024-09-12T17:40:05.052 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-12T17:40:05.052 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-12T17:40:05.057 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-12T17:40:05.057 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: shared 2024-09-12T17:40:05.058 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-12T17:40:05.058 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-12T17:40:05.058 INFO:tasks.workunit.client.0.smithi097.stdout: client.5181 expiration=0.000000 addr=v1:172.21.15.97:0/777250816 cookie= 2024-09-12T17:40:05.058 INFO:tasks.workunit.client.0.smithi097.stdout: client.5181 expiration=0.000000 addr=v1:172.21.15.97:0/777250816 cookie=new cookie 2024-09-12T17:40:06.017 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestCookie (3061 ms) 2024-09-12T17:40:06.017 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T17:40:09.024 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestMultipleLocks (3007 ms) 2024-09-12T17:40:09.024 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T17:40:16.185 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestLockDuration (7161 ms) 2024-09-12T17:40:16.185 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T17:40:19.222 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestAssertLocked (3037 ms) 2024-09-12T17:40:19.222 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T17:40:22.259 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestSetCookie (3035 ms) 2024-09-12T17:40:22.260 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T17:40:42.926 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestRenew (20669 ms) 2024-09-12T17:40:42.927 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T17:40:49.908 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6982 ms) 2024-09-12T17:40:49.908 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T17:40:57.949 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8041 ms) 2024-09-12T17:40:57.949 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T17:41:05.971 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8019 ms) 2024-09-12T17:41:05.972 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from ClsLock (68502 ms total) 2024-09-12T17:41:05.972 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:41:05.972 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:41:05.972 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 11 tests from 1 test suite ran. (68502 ms total) 2024-09-12T17:41:05.972 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 11 tests. 2024-09-12T17:41:05.974 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:41:05.974 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:41:06.036 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T17:41:06.037 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T17:41:06.037 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T17:41:06.109 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-12T17:41:06.110 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:41:06.110 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:41:06.110 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from cls_log 2024-09-12T17:41:06.110 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T17:41:08.998 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_log.test_log_add_same_time (2888 ms) 2024-09-12T17:41:08.999 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T17:41:12.066 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_log.test_log_add_different_time (3068 ms) 2024-09-12T17:41:12.066 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T17:41:15.083 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_log.trim_by_time (3017 ms) 2024-09-12T17:41:15.083 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T17:41:18.132 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_log.trim_by_marker (3049 ms) 2024-09-12T17:41:18.132 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from cls_log (12022 ms total) 2024-09-12T17:41:18.132 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:41:18.132 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:41:18.132 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 4 tests from 1 test suite ran. (12022 ms total) 2024-09-12T17:41:18.132 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 4 tests. 2024-09-12T17:41:18.138 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:41:18.138 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:41:18.193 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T17:41:18.194 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T17:41:18.194 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T17:41:18.258 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-12T17:41:18.258 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:41:18.258 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:41:18.258 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from cls_refcount 2024-09-12T17:41:18.258 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T17:41:21.155 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_implicit (2897 ms) 2024-09-12T17:41:21.155 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T17:41:24.204 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3050 ms) 2024-09-12T17:41:24.205 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T17:41:33.283 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_put_snap (9078 ms) 2024-09-12T17:41:33.283 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T17:41:36.289 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_explicit (3007 ms) 2024-09-12T17:41:36.290 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.set 2024-09-12T17:41:39.353 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.set (3063 ms) 2024-09-12T17:41:39.353 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T17:41:46.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_implicit_ec (7043 ms) 2024-09-12T17:41:46.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T17:41:53.435 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7039 ms) 2024-09-12T17:41:53.435 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T17:42:05.607 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_put_snap_ec (12172 ms) 2024-09-12T17:42:05.607 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T17:42:12.698 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_explicit_ec (7092 ms) 2024-09-12T17:42:12.698 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T17:42:19.761 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.set_ec (7063 ms) 2024-09-12T17:42:19.761 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from cls_refcount (61504 ms total) 2024-09-12T17:42:19.761 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:42:19.761 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:42:19.762 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 10 tests from 1 test suite ran. (61504 ms total) 2024-09-12T17:42:19.762 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 10 tests. 2024-09-12T17:42:19.766 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:42:19.767 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:42:19.834 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T17:42:19.835 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T17:42:19.835 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T17:42:19.897 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-12T17:42:19.898 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-12T17:42:19.898 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:42:19.898 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 18 tests from cls_rgw 2024-09-12T17:42:21.775 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T17:42:21.876 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_basic (100 ms) 2024-09-12T17:42:21.876 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T17:42:21.957 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (82 ms) 2024-09-12T17:42:21.957 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T17:42:22.060 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_remove_object (103 ms) 2024-09-12T17:42:22.060 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T17:42:24.414 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_suggest (2354 ms) 2024-09-12T17:42:24.415 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T17:42:24.428 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_suggest_complete (14 ms) 2024-09-12T17:42:24.429 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T17:42:24.485 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_list (56 ms) 2024-09-12T17:42:24.485 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T17:43:21.869 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_list_delimited (57384 ms) 2024-09-12T17:43:21.870 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T17:43:22.113 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.bi_list (244 ms) 2024-09-12T17:43:22.113 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T17:43:22.139 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.gc_set (27 ms) 2024-09-12T17:43:22.139 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T17:43:22.376 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.gc_list (237 ms) 2024-09-12T17:43:22.376 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T17:43:29.992 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.gc_defer (7616 ms) 2024-09-12T17:43:29.992 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T17:43:30.192 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.usage_basic (200 ms) 2024-09-12T17:43:30.192 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T17:43:30.196 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.usage_clear_no_obj (4 ms) 2024-09-12T17:43:30.196 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T17:43:30.421 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.usage_clear (225 ms) 2024-09-12T17:43:30.421 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T17:43:30.550 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.bi_log_trim (130 ms) 2024-09-12T17:43:30.551 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T17:43:30.586 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_racing_removes (35 ms) 2024-09-12T17:43:30.586 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T17:43:30.621 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.reshardlog_list (35 ms) 2024-09-12T17:43:30.621 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T17:43:30.650 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.reshardlog_num (29 ms) 2024-09-12T17:43:31.024 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 18 tests from cls_rgw (68875 ms total) 2024-09-12T17:43:31.025 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:43:31.025 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:43:31.025 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 18 tests from 1 test suite ran. (71127 ms total) 2024-09-12T17:43:31.025 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 18 tests. 2024-09-12T17:43:31.032 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:43:31.032 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:43:31.088 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T17:43:31.089 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T17:43:31.089 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T17:43:31.158 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-12T17:43:31.158 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:43:31.158 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:43:31.158 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T17:43:31.158 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T17:43:33.024 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.init (1866 ms) 2024-09-12T17:43:33.024 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T17:43:33.072 INFO:tasks.workunit.client.0.smithi097.stderr:[ ] list info tag = chain-0 2024-09-12T17:43:33.073 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (48 ms) 2024-09-12T17:43:33.073 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T17:43:33.084 INFO:tasks.workunit.client.0.smithi097.stderr:[ ] next_marker is: = 0/4263 2024-09-12T17:43:33.085 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (13 ms) 2024-09-12T17:43:33.085 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T17:43:33.100 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (16 ms) 2024-09-12T17:43:33.101 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T17:43:33.117 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (16 ms) 2024-09-12T17:43:33.117 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T17:43:33.133 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (16 ms) 2024-09-12T17:43:33.133 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T17:43:33.147 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (14 ms) 2024-09-12T17:43:33.147 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T17:43:33.164 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (17 ms) 2024-09-12T17:43:33.164 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T17:43:34.031 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.finalize (867 ms) 2024-09-12T17:43:34.031 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from cls_rgw_gc (2873 ms total) 2024-09-12T17:43:34.031 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:43:34.031 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:43:34.031 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 9 tests from 1 test suite ran. (2873 ms total) 2024-09-12T17:43:34.031 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 9 tests. 2024-09-12T17:43:34.038 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:43:34.038 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:43:34.095 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T17:43:34.097 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T17:43:34.097 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T17:43:34.172 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:34.172 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:34.172 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T17:43:34.172 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:43:36.092 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T17:43:36.092 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T17:43:36.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.109+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~UCSVP6THATV1.0 size=1048576 2024-09-12T17:43:36.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.109+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~UCSVP6THATV1.1 size=680020 2024-09-12T17:43:36.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.113+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=UCSVP6THATV1 tag=THHQ03WK77S2 type=write size=2777172 2024-09-12T17:43:36.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.117+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=5DNNMJWTJUC8 type=del size=4158372 2024-09-12T17:43:36.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.121+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~J296LGWTY172.0 size=103254 2024-09-12T17:43:36.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.121+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=J296LGWTY172 tag=4TQLV5NEIOUP type=write size=1151830 2024-09-12T17:43:36.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.125+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=BFVR0RE5ABB8 type=del size=1494639 2024-09-12T17:43:36.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.129+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=UYHWX019HUWL type=write size=1020783 2024-09-12T17:43:36.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.137+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~M87OIPZD7YEY.0 size=1048576 2024-09-12T17:43:36.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.141+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~M87OIPZD7YEY.1 size=1048576 2024-09-12T17:43:36.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.141+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~M87OIPZD7YEY.2 size=509016 2024-09-12T17:43:36.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.141+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=M87OIPZD7YEY tag=2B8WA0SY9G33 type=write size=3654744 2024-09-12T17:43:36.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.145+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=Y95UJX0KWTFR type=del size=2241694 2024-09-12T17:43:36.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.149+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=H5AWY43N1H15 type=del size=1347924 2024-09-12T17:43:36.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.157+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~064KQDVJ59OD.0 size=1048576 2024-09-12T17:43:36.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.161+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~064KQDVJ59OD.1 size=486126 2024-09-12T17:43:36.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.161+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=064KQDVJ59OD tag=XPFFHCBUF4RQ type=write size=2583278 2024-09-12T17:43:36.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.165+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=RT6RY3MWISY9 type=del size=3724042 2024-09-12T17:43:36.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.169+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=MJ71XEOL4YTW type=del size=608250 2024-09-12T17:43:36.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.177+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~6DCQWP86JSUM.0 size=1048576 2024-09-12T17:43:36.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.177+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~6DCQWP86JSUM.1 size=6381 2024-09-12T17:43:36.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.177+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=6DCQWP86JSUM tag=29DGGWIRA05O type=write size=2103533 2024-09-12T17:43:36.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.185+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=WNAEKWTSJOW8 type=write size=536185 2024-09-12T17:43:36.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.189+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=FS0WXW2UPYA9 type=del size=1665724 2024-09-12T17:43:36.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.193+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~PFFXZ8RA0AVT.0 size=1048576 2024-09-12T17:43:36.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.197+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~PFFXZ8RA0AVT.1 size=1048576 2024-09-12T17:43:36.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.201+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~PFFXZ8RA0AVT.2 size=463002 2024-09-12T17:43:36.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.201+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=PFFXZ8RA0AVT tag=U0SDJAUUQ7JJ type=write size=3608730 2024-09-12T17:43:36.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.205+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=DY88P862OPI0 type=del size=408334 2024-09-12T17:43:36.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.205+0000 7f51d61a08c0 1 < canceled part key=_multipart_XL9QDBTYSP7F.2~UCSVP6THATV1.0 size=1048576 2024-09-12T17:43:36.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.209+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~UCSVP6THATV1.1 size=680020 2024-09-12T17:43:36.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.217+0000 7f51d61a08c0 1 < canceled multipart upload key=XL9QDBTYSP7F upload=UCSVP6THATV1 tag=THHQ03WK77S2 type=write size=2777172 2024-09-12T17:43:36.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.225+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~JGZ4BTJUVSJN.0 size=254889 2024-09-12T17:43:36.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.225+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=JGZ4BTJUVSJN tag=56ZWPJGULBNQ type=write size=1303465 2024-09-12T17:43:36.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.229+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=5DNNMJWTJUC8 type=del 2024-09-12T17:43:36.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.229+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=077NBZPEV4CO type=del size=4150542 2024-09-12T17:43:36.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.237+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~J296LGWTY172.0 size=103254 2024-09-12T17:43:36.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.241+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=J296LGWTY172 tag=4TQLV5NEIOUP type=write size=1151830 2024-09-12T17:43:36.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.245+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=2KUCLLGSNXTM type=del size=895760 2024-09-12T17:43:36.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.253+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=BFVR0RE5ABB8 type=del 2024-09-12T17:43:36.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.253+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=Z6JT8QTRAILJ type=write size=352236 2024-09-12T17:43:36.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.261+0000 7f51d61a08c0 1 < completed write operation key=GJX1YGAQFXZ2 tag=UYHWX019HUWL type=write size=1020783 2024-09-12T17:43:36.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.265+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~PJX7IO96GG8M.0 size=519373 2024-09-12T17:43:36.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.265+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=PJX7IO96GG8M tag=9HG1PLZF7010 type=write size=1567949 2024-09-12T17:43:36.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.269+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~M87OIPZD7YEY.0 size=1048576 2024-09-12T17:43:36.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.273+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~M87OIPZD7YEY.1 size=1048576 2024-09-12T17:43:36.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.277+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~M87OIPZD7YEY.2 size=509016 2024-09-12T17:43:36.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.285+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=M87OIPZD7YEY tag=2B8WA0SY9G33 type=write size=3654744 2024-09-12T17:43:36.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.289+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=WIXTG2LOHGLF type=del size=2776322 2024-09-12T17:43:36.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.297+0000 7f51d61a08c0 1 < suggested remove operation key=10WBH16J1AF8 tag=Y95UJX0KWTFR type=del 2024-09-12T17:43:36.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.301+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=U82X4MKJERZ6 type=del size=3457819 2024-09-12T17:43:36.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.305+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=H5AWY43N1H15 type=del 2024-09-12T17:43:36.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.313+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~H7ZTNY3T3GCP.0 size=1048576 2024-09-12T17:43:36.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.313+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~H7ZTNY3T3GCP.1 size=1048576 2024-09-12T17:43:36.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.317+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~H7ZTNY3T3GCP.2 size=326685 2024-09-12T17:43:36.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.317+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=H7ZTNY3T3GCP tag=B4P3XFIZML3D type=write size=3472413 2024-09-12T17:43:36.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.321+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~064KQDVJ59OD.0 size=1048576 2024-09-12T17:43:36.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.325+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~064KQDVJ59OD.1 size=486126 2024-09-12T17:43:36.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.329+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=064KQDVJ59OD tag=XPFFHCBUF4RQ type=write size=2583278 2024-09-12T17:43:36.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.333+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=6O9SLJN62O6I type=del size=3317214 2024-09-12T17:43:36.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.341+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=RT6RY3MWISY9 type=del 2024-09-12T17:43:36.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.345+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=OA3PFELAK7SB type=write size=1011115 2024-09-12T17:43:36.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.349+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=MJ71XEOL4YTW type=del 2024-09-12T17:43:36.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.353+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=9YR2G35NISNT type=del size=3615921 2024-09-12T17:43:36.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.353+0000 7f51d61a08c0 1 < canceled part key=_multipart_XL9QDBTYSP7F.2~6DCQWP86JSUM.0 size=1048576 2024-09-12T17:43:36.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.357+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~6DCQWP86JSUM.1 size=6381 2024-09-12T17:43:36.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.361+0000 7f51d61a08c0 1 < canceled multipart upload key=XL9QDBTYSP7F upload=6DCQWP86JSUM tag=29DGGWIRA05O type=write size=2103533 2024-09-12T17:43:36.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.365+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=UO1BSAQ5ZXP4 type=del size=2417374 2024-09-12T17:43:36.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.369+0000 7f51d61a08c0 1 < completed write operation key=S292EX1P7IZA tag=WNAEKWTSJOW8 type=write size=536185 2024-09-12T17:43:36.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.373+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=LF7BHE9JJH61 type=del size=3759399 2024-09-12T17:43:36.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.377+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=FS0WXW2UPYA9 type=del 2024-09-12T17:43:36.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.381+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=RR30Q52YFZYQ type=del size=3260987 2024-09-12T17:43:36.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.385+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~PFFXZ8RA0AVT.0 size=1048576 2024-09-12T17:43:36.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.389+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~PFFXZ8RA0AVT.1 size=1048576 2024-09-12T17:43:36.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.393+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~PFFXZ8RA0AVT.2 size=463002 2024-09-12T17:43:36.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.397+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=PFFXZ8RA0AVT tag=U0SDJAUUQ7JJ type=write size=3608730 2024-09-12T17:43:36.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.401+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=IUHBR1GTNXEF type=write size=349468 2024-09-12T17:43:36.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.405+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=DY88P862OPI0 type=del 2024-09-12T17:43:36.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.413+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~DGP6W2S7YHXS.0 size=1048576 2024-09-12T17:43:36.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.417+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~DGP6W2S7YHXS.1 size=537710 2024-09-12T17:43:36.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.417+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=DGP6W2S7YHXS tag=NO3RGFJKCFD1 type=write size=2634862 2024-09-12T17:43:36.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.421+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~JGZ4BTJUVSJN.0 size=254889 2024-09-12T17:43:36.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.425+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=JGZ4BTJUVSJN tag=56ZWPJGULBNQ type=write size=1303465 2024-09-12T17:43:36.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.429+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=T733WFDD4Q5O type=write size=641941 2024-09-12T17:43:36.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.437+0000 7f51d61a08c0 1 < suggested remove operation key=FKKV7SXZSP90 tag=077NBZPEV4CO type=del 2024-09-12T17:43:36.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.441+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=T3U49V9TR4VU type=del size=4132782 2024-09-12T17:43:36.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.449+0000 7f51d61a08c0 1 < suggested update operation key=IWEJXLG1CDAV tag=2KUCLLGSNXTM type=del size=895760 2024-09-12T17:43:36.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.453+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=C8GV9DFS7N32 type=del size=7156 2024-09-12T17:43:36.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.457+0000 7f51d61a08c0 -1 < failed to complete operation key=IWEJXLG1CDAV tag=Z6JT8QTRAILJ type=write size=352236: (22) Invalid argument 2024-09-12T17:43:36.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.465+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~X8ZGK90X6R91.0 size=1048576 2024-09-12T17:43:36.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.469+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~X8ZGK90X6R91.1 size=793768 2024-09-12T17:43:36.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.469+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=X8ZGK90X6R91 tag=FSKD6VA7M9OZ type=write size=2890920 2024-09-12T17:43:36.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.473+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~PJX7IO96GG8M.0 size=519373 2024-09-12T17:43:36.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.477+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=PJX7IO96GG8M tag=9HG1PLZF7010 type=write size=1567949 2024-09-12T17:43:36.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.481+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=QX9X4RNGMLQA type=del size=3430674 2024-09-12T17:43:36.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.489+0000 7f51d61a08c0 1 < suggested remove operation key=V5KMBUNVQA0H tag=WIXTG2LOHGLF type=del 2024-09-12T17:43:36.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.497+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~N0Z1KWPH9E9X.0 size=1048576 2024-09-12T17:43:36.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.501+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~N0Z1KWPH9E9X.1 size=916498 2024-09-12T17:43:36.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.501+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=N0Z1KWPH9E9X tag=1QKTN7HZOPIP type=write size=3013650 2024-09-12T17:43:36.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.505+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=U82X4MKJERZ6 type=del 2024-09-12T17:43:36.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.513+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~3E5YI4RKVILZ.0 size=1048576 2024-09-12T17:43:36.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.517+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~3E5YI4RKVILZ.1 size=108296 2024-09-12T17:43:36.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.517+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=3E5YI4RKVILZ tag=GMI4KPT7QMZQ type=write size=2205448 2024-09-12T17:43:36.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.521+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~H7ZTNY3T3GCP.0 size=1048576 2024-09-12T17:43:36.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.525+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~H7ZTNY3T3GCP.1 size=1048576 2024-09-12T17:43:36.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.525+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~H7ZTNY3T3GCP.2 size=326685 2024-09-12T17:43:36.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.533+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=H7ZTNY3T3GCP tag=B4P3XFIZML3D type=write size=3472413 2024-09-12T17:43:36.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.537+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=ZJ8OVZLYDQYO type=del size=3679773 2024-09-12T17:43:36.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.541+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=6O9SLJN62O6I type=del 2024-09-12T17:43:36.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.545+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=Q0S74SFJ3YXB type=del size=1588507 2024-09-12T17:43:36.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.549+0000 7f51d61a08c0 -1 < failed to complete operation key=V5KMBUNVQA0H tag=OA3PFELAK7SB type=write size=1011115: (22) Invalid argument 2024-09-12T17:43:36.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.553+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=375931J7THHJ type=write size=331167 2024-09-12T17:43:36.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.557+0000 7f51d61a08c0 -1 < failed to complete operation key=IWEJXLG1CDAV tag=9YR2G35NISNT type=del size=3615921: (22) Invalid argument 2024-09-12T17:43:36.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.561+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=MM8412ED2FDF type=del size=3503723 2024-09-12T17:43:36.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.565+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=UO1BSAQ5ZXP4 type=del 2024-09-12T17:43:36.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.569+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=0YO83T6WQSW7 type=del size=4011960 2024-09-12T17:43:36.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.573+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=LF7BHE9JJH61 type=del 2024-09-12T17:43:36.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~QLKRTGMDSV15.0 size=1007868 2024-09-12T17:43:36.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.577+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=QLKRTGMDSV15 tag=GSEX3DUJ7G5B type=write size=2056444 2024-09-12T17:43:36.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.585+0000 7f51d61a08c0 1 < suggested remove operation key=92CMI8Q29LB3 tag=RR30Q52YFZYQ type=del 2024-09-12T17:43:36.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.589+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=ZZER7FS0UMTO type=del size=3793299 2024-09-12T17:43:36.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.593+0000 7f51d61a08c0 -1 < failed to complete operation key=V5KMBUNVQA0H tag=IUHBR1GTNXEF type=write size=349468: (22) Invalid argument 2024-09-12T17:43:36.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.597+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=NIRVA2KKSCDC type=write size=325115 2024-09-12T17:43:36.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.601+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~DGP6W2S7YHXS.0 size=1048576 2024-09-12T17:43:36.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.605+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~DGP6W2S7YHXS.1 size=537710 2024-09-12T17:43:36.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.609+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=DGP6W2S7YHXS tag=NO3RGFJKCFD1 type=write size=2634862 2024-09-12T17:43:36.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.613+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=FE7CNDQ42RN9 type=del size=246656 2024-09-12T17:43:36.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.617+0000 7f51d61a08c0 -1 < failed to complete operation key=FKKV7SXZSP90 tag=T733WFDD4Q5O type=write size=641941: (22) Invalid argument 2024-09-12T17:43:36.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.621+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=2LMEYMP0HT4V type=del size=3977665 2024-09-12T17:43:36.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.625+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=T3U49V9TR4VU type=del 2024-09-12T17:43:36.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.629+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=Q727TGKJZCSY type=del size=3869296 2024-09-12T17:43:36.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.633+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=C8GV9DFS7N32 type=del 2024-09-12T17:43:36.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.637+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=681HS24ZV8IR type=write size=104099 2024-09-12T17:43:36.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.641+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~X8ZGK90X6R91.0 size=1048576 2024-09-12T17:43:36.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.641+0000 7f51d61a08c0 1 < canceled part key=_multipart_XL9QDBTYSP7F.2~X8ZGK90X6R91.1 size=793768 2024-09-12T17:43:36.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.645+0000 7f51d61a08c0 1 < canceled multipart upload key=XL9QDBTYSP7F upload=X8ZGK90X6R91 tag=FSKD6VA7M9OZ type=write size=2890920 2024-09-12T17:43:36.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.649+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=AZWES0RCJ0KZ type=del size=2625758 2024-09-12T17:43:36.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.657+0000 7f51d61a08c0 1 < suggested update operation key=NIQAUF085D97 tag=QX9X4RNGMLQA type=del size=3430674 2024-09-12T17:43:36.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.665+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~9I82DVJW61G9.0 size=1048576 2024-09-12T17:43:36.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.669+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~9I82DVJW61G9.1 size=91893 2024-09-12T17:43:36.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.669+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=9I82DVJW61G9 tag=MNQH1BOHAEFO type=write size=2189045 2024-09-12T17:43:36.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.673+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~N0Z1KWPH9E9X.0 size=1048576 2024-09-12T17:43:36.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.673+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~N0Z1KWPH9E9X.1 size=916498 2024-09-12T17:43:36.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.681+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=N0Z1KWPH9E9X tag=1QKTN7HZOPIP type=write size=3013650 2024-09-12T17:43:36.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.685+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=ASW4SC18BXVL type=write size=796970 2024-09-12T17:43:36.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.689+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~3E5YI4RKVILZ.0 size=1048576 2024-09-12T17:43:36.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.693+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~3E5YI4RKVILZ.1 size=108296 2024-09-12T17:43:36.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.697+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=3E5YI4RKVILZ tag=GMI4KPT7QMZQ type=write size=2205448 2024-09-12T17:43:36.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.701+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=3WQYHC9KQZFM type=write size=23716 2024-09-12T17:43:36.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.705+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=ZJ8OVZLYDQYO type=del 2024-09-12T17:43:36.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.709+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=WLGRQMY787GQ type=del size=3382130 2024-09-12T17:43:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.713+0000 7f51d61a08c0 1 < canceled operation key=83V7KSWRKFMZ tag=Q0S74SFJ3YXB type=del size=1588507 2024-09-12T17:43:36.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.721+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=DBV3O3YV416N type=del size=968358 2024-09-12T17:43:36.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.721+0000 7f51d61a08c0 1 < completed write operation key=GJX1YGAQFXZ2 tag=375931J7THHJ type=write size=331167 2024-09-12T17:43:36.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.725+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=H6MCULLI1XW0 type=del size=1015342 2024-09-12T17:43:36.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.729+0000 7f51d61a08c0 -1 < failed to complete operation key=NIQAUF085D97 tag=MM8412ED2FDF type=del size=3503723: (22) Invalid argument 2024-09-12T17:43:36.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.737+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~UEFVKGKW0WAK.0 size=1048576 2024-09-12T17:43:36.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.741+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~UEFVKGKW0WAK.1 size=213669 2024-09-12T17:43:36.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.741+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=UEFVKGKW0WAK tag=1JZ32QEET4LA type=write size=2310821 2024-09-12T17:43:36.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.745+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=0YO83T6WQSW7 type=del 2024-09-12T17:43:36.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.749+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~V1IEL3QO2CP2.0 size=995714 2024-09-12T17:43:36.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.749+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=V1IEL3QO2CP2 tag=QMLUZICW9VKX type=write size=2044290 2024-09-12T17:43:36.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.753+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~QLKRTGMDSV15.0 size=1007868 2024-09-12T17:43:36.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.761+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=QLKRTGMDSV15 tag=GSEX3DUJ7G5B type=write size=2056444 2024-09-12T17:43:36.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.765+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=D2XLVARJ9NO6 type=del size=1465075 2024-09-12T17:43:36.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.773+0000 7f51d61a08c0 1 < suggested remove operation key=JEXD4ZU5HJ2B tag=ZZER7FS0UMTO type=del 2024-09-12T17:43:36.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.777+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=9P5GJH2MLRBX type=del size=2892484 2024-09-12T17:43:36.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.781+0000 7f51d61a08c0 1 < completed write operation key=1ZETSL5TXYSM tag=NIRVA2KKSCDC type=write size=325115 2024-09-12T17:43:36.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.789+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~SUNOOZ47QAXM.0 size=1048576 2024-09-12T17:43:36.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.789+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~SUNOOZ47QAXM.1 size=1048576 2024-09-12T17:43:36.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.793+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~SUNOOZ47QAXM.2 size=438937 2024-09-12T17:43:36.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.793+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=SUNOOZ47QAXM tag=QPAQUPGOT9WL type=write size=3584665 2024-09-12T17:43:36.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.801+0000 7f51d61a08c0 1 < canceled operation key=10WBH16J1AF8 tag=FE7CNDQ42RN9 type=del size=246656 2024-09-12T17:43:36.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.805+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=Y2L2OE27UDE5 type=del size=2382048 2024-09-12T17:43:36.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.809+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=2LMEYMP0HT4V type=del 2024-09-12T17:43:36.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.813+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=JOTXEHF9PI1M type=del size=1454630 2024-09-12T17:43:36.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.817+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=Q727TGKJZCSY type=del 2024-09-12T17:43:36.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.817+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=L8KQDC6V7QK0 type=del size=127065 2024-09-12T17:43:36.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.825+0000 7f51d61a08c0 1 < suggested update operation key=83V7KSWRKFMZ tag=681HS24ZV8IR type=write size=104099 2024-09-12T17:43:36.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.833+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~ZVPFGXZP31TL.0 size=1048576 2024-09-12T17:43:36.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.837+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~ZVPFGXZP31TL.1 size=1048576 2024-09-12T17:43:36.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.837+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~ZVPFGXZP31TL.2 size=765982 2024-09-12T17:43:36.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.837+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=ZVPFGXZP31TL tag=45HX1WZ7NIXB type=write size=3911710 2024-09-12T17:43:36.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.841+0000 7f51d61a08c0 1 < canceled operation key=593CD3H40DFH tag=AZWES0RCJ0KZ type=del size=2625758 2024-09-12T17:43:36.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.845+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=2SWY821Y2M5F type=del size=4003867 2024-09-12T17:43:36.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.853+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~9I82DVJW61G9.0 size=1048576 2024-09-12T17:43:36.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.853+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~9I82DVJW61G9.1 size=91893 2024-09-12T17:43:36.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.861+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=9I82DVJW61G9 tag=MNQH1BOHAEFO type=write size=2189045 2024-09-12T17:43:36.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.865+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=5HG924ABJ33V type=del size=82414 2024-09-12T17:43:36.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.869+0000 7f51d61a08c0 1 < completed write operation key=96OWZQXI2ALM tag=ASW4SC18BXVL type=write size=796970 2024-09-12T17:43:36.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.873+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=ZALDZZYRDX69 type=del size=2618475 2024-09-12T17:43:36.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.877+0000 7f51d61a08c0 1 < canceled operation key=96OWZQXI2ALM tag=3WQYHC9KQZFM type=write size=23716 2024-09-12T17:43:36.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.885+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=UNTONEH4HRM6 type=write size=294777 2024-09-12T17:43:36.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.897+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=WLGRQMY787GQ type=del 2024-09-12T17:43:36.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.897+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=2OCEV9ILNKOU type=del size=3435179 2024-09-12T17:43:36.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.905+0000 7f51d61a08c0 1 < suggested remove operation key=7FBK3439R80H tag=DBV3O3YV416N type=del 2024-09-12T17:43:36.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.909+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=KIHSOV3QRNS5 type=del size=3531245 2024-09-12T17:43:36.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.913+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=H6MCULLI1XW0 type=del 2024-09-12T17:43:36.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.917+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=0NF10KPAR4RR type=del size=520750 2024-09-12T17:43:36.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.921+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~UEFVKGKW0WAK.0 size=1048576 2024-09-12T17:43:36.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.921+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~UEFVKGKW0WAK.1 size=213669 2024-09-12T17:43:36.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.929+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=UEFVKGKW0WAK tag=1JZ32QEET4LA type=write size=2310821 2024-09-12T17:43:36.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.933+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~X3BIFR0IOTI1.0 size=1026937 2024-09-12T17:43:36.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.933+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=X3BIFR0IOTI1 tag=QOK7JNDK23XC type=write size=2075513 2024-09-12T17:43:36.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.937+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~V1IEL3QO2CP2.0 size=995714 2024-09-12T17:43:36.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.941+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=V1IEL3QO2CP2 tag=QMLUZICW9VKX type=write size=2044290 2024-09-12T17:43:36.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.945+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=L8E1EEZSFGCF type=del size=1424281 2024-09-12T17:43:36.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.949+0000 7f51d61a08c0 1 < canceled operation key=DCLENF1A1W2Q tag=D2XLVARJ9NO6 type=del size=1465075 2024-09-12T17:43:36.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.953+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~L3FDKFYX05KQ.0 size=1048576 2024-09-12T17:43:36.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.957+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~L3FDKFYX05KQ.1 size=627945 2024-09-12T17:43:36.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.957+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=L3FDKFYX05KQ tag=XJPRRNFTMXGC type=write size=2725097 2024-09-12T17:43:36.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.961+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=9P5GJH2MLRBX type=del 2024-09-12T17:43:36.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.965+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=4ZVT86O3LFTD type=write size=882805 2024-09-12T17:43:36.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.969+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~SUNOOZ47QAXM.0 size=1048576 2024-09-12T17:43:36.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.969+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~SUNOOZ47QAXM.1 size=1048576 2024-09-12T17:43:36.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.973+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~SUNOOZ47QAXM.2 size=438937 2024-09-12T17:43:36.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.977+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=SUNOOZ47QAXM tag=QPAQUPGOT9WL type=write size=3584665 2024-09-12T17:43:36.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.981+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=9VY4AX8ENE38 type=write size=729966 2024-09-12T17:43:36.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.985+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=Y2L2OE27UDE5 type=del 2024-09-12T17:43:36.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.989+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=RBDLU3OAY1VA type=del size=3547331 2024-09-12T17:43:36.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.993+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=JOTXEHF9PI1M type=del 2024-09-12T17:43:37.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:36.997+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=FXA8KH2L38OF type=del size=3248339 2024-09-12T17:43:37.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.001+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=L8KQDC6V7QK0 type=del 2024-09-12T17:43:37.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.009+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~Y1K4908FM841.0 size=1048576 2024-09-12T17:43:37.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.013+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~Y1K4908FM841.1 size=1048576 2024-09-12T17:43:37.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.013+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~Y1K4908FM841.2 size=795619 2024-09-12T17:43:37.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.013+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=Y1K4908FM841 tag=3J06LNU6K8TO type=write size=3941347 2024-09-12T17:43:37.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.017+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~ZVPFGXZP31TL.0 size=1048576 2024-09-12T17:43:37.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.021+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~ZVPFGXZP31TL.1 size=1048576 2024-09-12T17:43:37.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.025+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~ZVPFGXZP31TL.2 size=765982 2024-09-12T17:43:37.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.029+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=ZVPFGXZP31TL tag=45HX1WZ7NIXB type=write size=3911710 2024-09-12T17:43:37.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~TP055KACDN33.0 size=1048576 2024-09-12T17:43:37.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.041+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~TP055KACDN33.1 size=1048576 2024-09-12T17:43:37.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.041+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~TP055KACDN33.2 size=593012 2024-09-12T17:43:37.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.041+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=TP055KACDN33 tag=H23KS4ZL30JC type=write size=3738740 2024-09-12T17:43:37.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.049+0000 7f51d61a08c0 1 < suggested remove operation key=1ZETSL5TXYSM tag=2SWY821Y2M5F type=del 2024-09-12T17:43:37.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.053+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=XSZDX3V0WA4O type=del size=297853 2024-09-12T17:43:37.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.061+0000 7f51d61a08c0 1 < suggested update operation key=HUWVRJIZ5JYE tag=5HG924ABJ33V type=del size=82414 2024-09-12T17:43:37.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.065+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~9Z2QGM8ESRO7.0 size=524067 2024-09-12T17:43:37.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.065+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=9Z2QGM8ESRO7 tag=EGHVLZFTWFQO type=write size=1572643 2024-09-12T17:43:37.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.077+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=ZALDZZYRDX69 type=del 2024-09-12T17:43:37.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.081+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=HW4TGDKRD5NE type=write size=328144 2024-09-12T17:43:37.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.085+0000 7f51d61a08c0 1 < completed write operation key=XL9QDBTYSP7F tag=UNTONEH4HRM6 type=write size=294777 2024-09-12T17:43:37.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.089+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~GL9JC4P74QHM.0 size=1048576 2024-09-12T17:43:37.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.093+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~GL9JC4P74QHM.1 size=801568 2024-09-12T17:43:37.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.093+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=GL9JC4P74QHM tag=ZNQN1CD6ZR08 type=write size=2898720 2024-09-12T17:43:37.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.097+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=2OCEV9ILNKOU type=del 2024-09-12T17:43:37.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.101+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~60BEMZVH23KN.0 size=1048576 2024-09-12T17:43:37.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.105+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~60BEMZVH23KN.1 size=1048576 2024-09-12T17:43:37.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.109+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~60BEMZVH23KN.2 size=274899 2024-09-12T17:43:37.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.109+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=60BEMZVH23KN tag=4GDO7U0IXUHJ type=write size=3420627 2024-09-12T17:43:37.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.113+0000 7f51d61a08c0 1 < canceled operation key=XL9QDBTYSP7F tag=KIHSOV3QRNS5 type=del size=3531245 2024-09-12T17:43:37.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.113+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=EDLPPP1B9UX4 type=del size=4079345 2024-09-12T17:43:37.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.117+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=0NF10KPAR4RR type=del 2024-09-12T17:43:37.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.121+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=P41TTB9FGO56 type=del size=2220654 2024-09-12T17:43:37.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.121+0000 7f51d61a08c0 1 < canceled part key=_multipart_26X723PN8K8T.2~X3BIFR0IOTI1.0 size=1026937 2024-09-12T17:43:37.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.125+0000 7f51d61a08c0 1 < canceled multipart upload key=26X723PN8K8T upload=X3BIFR0IOTI1 tag=QOK7JNDK23XC type=write size=2075513 2024-09-12T17:43:37.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.129+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=Y952117CI0AF type=write size=139049 2024-09-12T17:43:37.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.133+0000 7f51d61a08c0 1 < canceled operation key=8J72KCZ5WRPU tag=L8E1EEZSFGCF type=del size=1424281 2024-09-12T17:43:37.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.137+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=235OH1J2EINX type=del size=4107915 2024-09-12T17:43:37.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.141+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~L3FDKFYX05KQ.0 size=1048576 2024-09-12T17:43:37.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.145+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~L3FDKFYX05KQ.1 size=627945 2024-09-12T17:43:37.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.149+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=L3FDKFYX05KQ tag=XJPRRNFTMXGC type=write size=2725097 2024-09-12T17:43:37.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.153+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=PMNSLH09W50W type=del size=4084302 2024-09-12T17:43:37.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.161+0000 7f51d61a08c0 1 < suggested remove operation key=10WBH16J1AF8 tag=4ZVT86O3LFTD type=write 2024-09-12T17:43:37.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.169+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~URBGPBDENP1Y.0 size=1048576 2024-09-12T17:43:37.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.169+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~URBGPBDENP1Y.1 size=736401 2024-09-12T17:43:37.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.169+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=URBGPBDENP1Y tag=LHOTQAV8HZM8 type=write size=2833553 2024-09-12T17:43:37.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.177+0000 7f51d61a08c0 1 < suggested update operation key=7FBK3439R80H tag=9VY4AX8ENE38 type=write size=729966 2024-09-12T17:43:37.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.181+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=5X04REJIU9EP type=del size=1639052 2024-09-12T17:43:37.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.185+0000 7f51d61a08c0 1 < canceled operation key=83V7KSWRKFMZ tag=RBDLU3OAY1VA type=del size=3547331 2024-09-12T17:43:37.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.193+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~T0Q2HYY6Z7T5.0 size=796145 2024-09-12T17:43:37.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.193+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=T0Q2HYY6Z7T5 tag=RGJUEZS8RGZT type=write size=1844721 2024-09-12T17:43:37.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.197+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=FXA8KH2L38OF type=del 2024-09-12T17:43:37.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.201+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=4TKVJ5HS2DS2 type=del size=1648221 2024-09-12T17:43:37.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.205+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~Y1K4908FM841.0 size=1048576 2024-09-12T17:43:37.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.209+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~Y1K4908FM841.1 size=1048576 2024-09-12T17:43:37.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.209+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~Y1K4908FM841.2 size=795619 2024-09-12T17:43:37.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.221+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=Y1K4908FM841 tag=3J06LNU6K8TO type=write size=3941347 2024-09-12T17:43:37.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.225+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=CNHKI918YTKE type=del size=897078 2024-09-12T17:43:37.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.229+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~TP055KACDN33.0 size=1048576 2024-09-12T17:43:37.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.229+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~TP055KACDN33.1 size=1048576 2024-09-12T17:43:37.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.233+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~TP055KACDN33.2 size=593012 2024-09-12T17:43:37.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.241+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=TP055KACDN33 tag=H23KS4ZL30JC type=write size=3738740 2024-09-12T17:43:37.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.245+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=H737M2IXKCLY type=del size=1657237 2024-09-12T17:43:37.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.249+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=XSZDX3V0WA4O type=del 2024-09-12T17:43:37.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.253+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~CUIGKL02XNZ6.0 size=1048576 2024-09-12T17:43:37.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.257+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~CUIGKL02XNZ6.1 size=1048576 2024-09-12T17:43:37.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.261+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~CUIGKL02XNZ6.2 size=812697 2024-09-12T17:43:37.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.261+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=CUIGKL02XNZ6 tag=R508B2XVL6E8 type=write size=3958425 2024-09-12T17:43:37.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.265+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~9Z2QGM8ESRO7.0 size=524067 2024-09-12T17:43:37.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.269+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=9Z2QGM8ESRO7 tag=EGHVLZFTWFQO type=write size=1572643 2024-09-12T17:43:37.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.273+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=ANU4HYEFMTC7 type=del size=2642379 2024-09-12T17:43:37.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.277+0000 7f51d61a08c0 1 < completed write operation key=XL9QDBTYSP7F tag=HW4TGDKRD5NE type=write size=328144 2024-09-12T17:43:37.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.281+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=NTUL2QJII1NS type=del size=1054755 2024-09-12T17:43:37.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.285+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~GL9JC4P74QHM.0 size=1048576 2024-09-12T17:43:37.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.289+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~GL9JC4P74QHM.1 size=801568 2024-09-12T17:43:37.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.297+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=GL9JC4P74QHM tag=ZNQN1CD6ZR08 type=write size=2898720 2024-09-12T17:43:37.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.305+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~FC18HRXNRE19.0 size=1048576 2024-09-12T17:43:37.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.309+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~FC18HRXNRE19.1 size=1048576 2024-09-12T17:43:37.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.309+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~FC18HRXNRE19.2 size=761769 2024-09-12T17:43:37.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.309+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=FC18HRXNRE19 tag=VJCJYIMXPE9E type=write size=3907497 2024-09-12T17:43:37.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.313+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~60BEMZVH23KN.0 size=1048576 2024-09-12T17:43:37.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.317+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~60BEMZVH23KN.1 size=1048576 2024-09-12T17:43:37.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.321+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~60BEMZVH23KN.2 size=274899 2024-09-12T17:43:37.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.329+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=60BEMZVH23KN tag=4GDO7U0IXUHJ type=write size=3420627 2024-09-12T17:43:37.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.333+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~0RMR659DG9WF.0 size=869192 2024-09-12T17:43:37.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.333+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=0RMR659DG9WF tag=OTYON9428UJ8 type=write size=1917768 2024-09-12T17:43:37.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.337+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=EDLPPP1B9UX4 type=del 2024-09-12T17:43:37.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.345+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~IHMW18M4SJ86.0 size=757369 2024-09-12T17:43:37.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.345+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=IHMW18M4SJ86 tag=VJCZ10IX8N83 type=write size=1805945 2024-09-12T17:43:37.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.349+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=P41TTB9FGO56 type=del 2024-09-12T17:43:37.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.353+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=ARNGSB8WEB2U type=write size=847252 2024-09-12T17:43:37.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.357+0000 7f51d61a08c0 -1 < failed to complete operation key=7FBK3439R80H tag=Y952117CI0AF type=write size=139049: (22) Invalid argument 2024-09-12T17:43:37.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.361+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=KJEDCB3KOSUD type=del size=3341997 2024-09-12T17:43:37.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.365+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=235OH1J2EINX type=del 2024-09-12T17:43:37.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.369+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=3RIWPHIDFYY7 type=del size=922150 2024-09-12T17:43:37.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.373+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=PMNSLH09W50W type=del 2024-09-12T17:43:37.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.377+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=G343J623YFX4 type=del size=451929 2024-09-12T17:43:37.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.381+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~URBGPBDENP1Y.0 size=1048576 2024-09-12T17:43:37.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.385+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~URBGPBDENP1Y.1 size=736401 2024-09-12T17:43:37.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.393+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=URBGPBDENP1Y tag=LHOTQAV8HZM8 type=write size=2833553 2024-09-12T17:43:37.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.397+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=THF886UAYCOT type=write size=498983 2024-09-12T17:43:37.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.401+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=5X04REJIU9EP type=del 2024-09-12T17:43:37.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.405+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=S42T7J8MNH7C type=del size=535281 2024-09-12T17:43:37.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.409+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~T0Q2HYY6Z7T5.0 size=796145 2024-09-12T17:43:37.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.413+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=T0Q2HYY6Z7T5 tag=RGJUEZS8RGZT type=write size=1844721 2024-09-12T17:43:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.421+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~6P7TM5GM7L14.0 size=1048576 2024-09-12T17:43:37.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.425+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~6P7TM5GM7L14.1 size=617540 2024-09-12T17:43:37.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.425+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=6P7TM5GM7L14 tag=40UM9QQTDE2A type=write size=2714692 2024-09-12T17:43:37.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.429+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=4TKVJ5HS2DS2 type=del 2024-09-12T17:43:37.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.433+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=NFQ3RPLT0SB6 type=del size=65781 2024-09-12T17:43:37.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.445+0000 7f51d61a08c0 1 < canceled operation key=GCL7UJEJM1UV tag=CNHKI918YTKE type=del size=897078 2024-09-12T17:43:37.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.449+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=BDDHO9QB55S1 type=del size=536427 2024-09-12T17:43:37.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.453+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=H737M2IXKCLY type=del 2024-09-12T17:43:37.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.457+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=ZZQKWI5IGKQ5 type=del size=404271 2024-09-12T17:43:37.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.457+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~CUIGKL02XNZ6.0 size=1048576 2024-09-12T17:43:37.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.461+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~CUIGKL02XNZ6.1 size=1048576 2024-09-12T17:43:37.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.465+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~CUIGKL02XNZ6.2 size=812697 2024-09-12T17:43:37.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.469+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=CUIGKL02XNZ6 tag=R508B2XVL6E8 type=write size=3958425 2024-09-12T17:43:37.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.477+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~78PCHOG7DRTP.0 size=1048576 2024-09-12T17:43:37.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.481+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~78PCHOG7DRTP.1 size=1048576 2024-09-12T17:43:37.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.481+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~78PCHOG7DRTP.2 size=647210 2024-09-12T17:43:37.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.481+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=78PCHOG7DRTP tag=BJACSQ9OWCVB type=write size=3792938 2024-09-12T17:43:37.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.485+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=ANU4HYEFMTC7 type=del 2024-09-12T17:43:37.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.489+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=3L4O0QFJTLYT type=del size=190468 2024-09-12T17:43:37.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.493+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=NTUL2QJII1NS type=del 2024-09-12T17:43:37.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.501+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=MD0WUD51TV87 type=del size=2614032 2024-09-12T17:43:37.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.501+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~FC18HRXNRE19.0 size=1048576 2024-09-12T17:43:37.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.505+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~FC18HRXNRE19.1 size=1048576 2024-09-12T17:43:37.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.509+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~FC18HRXNRE19.2 size=761769 2024-09-12T17:43:37.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.513+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=FC18HRXNRE19 tag=VJCJYIMXPE9E type=write size=3907497 2024-09-12T17:43:37.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.517+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=D6IAGGP6WKID type=del size=1216688 2024-09-12T17:43:37.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.521+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~0RMR659DG9WF.0 size=869192 2024-09-12T17:43:37.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.529+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=0RMR659DG9WF tag=OTYON9428UJ8 type=write size=1917768 2024-09-12T17:43:37.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.533+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=OMS6WSWO3IR7 type=write size=319568 2024-09-12T17:43:37.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.533+0000 7f51d61a08c0 1 < canceled part key=_multipart_92CMI8Q29LB3.2~IHMW18M4SJ86.0 size=757369 2024-09-12T17:43:37.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.541+0000 7f51d61a08c0 1 < canceled multipart upload key=92CMI8Q29LB3 upload=IHMW18M4SJ86 tag=VJCZ10IX8N83 type=write size=1805945 2024-09-12T17:43:37.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.545+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=YGPS102C3T7R type=del size=532859 2024-09-12T17:43:37.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.549+0000 7f51d61a08c0 1 < canceled operation key=GCL7UJEJM1UV tag=ARNGSB8WEB2U type=write size=847252 2024-09-12T17:43:37.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.553+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=6XQ15IGS7OQH type=del size=1341441 2024-09-12T17:43:37.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.557+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=KJEDCB3KOSUD type=del 2024-09-12T17:43:37.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.561+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~EO2573V9C3JQ.0 size=38176 2024-09-12T17:43:37.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.561+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=EO2573V9C3JQ tag=J6J81VE6G9U4 type=write size=1086752 2024-09-12T17:43:37.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.573+0000 7f51d61a08c0 1 < suggested remove operation key=GJX1YGAQFXZ2 tag=3RIWPHIDFYY7 type=del 2024-09-12T17:43:37.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.577+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=1R8NHMOL8UA5 type=del size=705517 2024-09-12T17:43:37.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.581+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=G343J623YFX4 type=del 2024-09-12T17:43:37.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.585+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=ZKWVPUKY8KN2 type=del size=3005208 2024-09-12T17:43:37.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.593+0000 7f51d61a08c0 1 < completed write operation key=92CMI8Q29LB3 tag=THF886UAYCOT type=write size=498983 2024-09-12T17:43:37.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.593+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=FGM45VDVIHB3 type=del size=1702419 2024-09-12T17:43:37.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.597+0000 7f51d61a08c0 -1 < failed to complete operation key=GJX1YGAQFXZ2 tag=S42T7J8MNH7C type=del size=535281: (22) Invalid argument 2024-09-12T17:43:37.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.605+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~BZ46WCRI0RJQ.0 size=24161 2024-09-12T17:43:37.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.605+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=BZ46WCRI0RJQ tag=D5QIFG9CEINA type=write size=1072737 2024-09-12T17:43:37.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.609+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~6P7TM5GM7L14.0 size=1048576 2024-09-12T17:43:37.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.613+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~6P7TM5GM7L14.1 size=617540 2024-09-12T17:43:37.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.621+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=6P7TM5GM7L14 tag=40UM9QQTDE2A type=write size=2714692 2024-09-12T17:43:37.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.625+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=3S1NY3KNXZWW type=write size=220212 2024-09-12T17:43:37.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.629+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=NFQ3RPLT0SB6 type=del 2024-09-12T17:43:37.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.637+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~3BY8EJU0LOSC.0 size=1048576 2024-09-12T17:43:37.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.637+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~3BY8EJU0LOSC.1 size=495145 2024-09-12T17:43:37.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.637+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=3BY8EJU0LOSC tag=LRH1VPQTNCKL type=write size=2592297 2024-09-12T17:43:37.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.641+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=BDDHO9QB55S1 type=del 2024-09-12T17:43:37.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.649+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~SGW3F2KFLFZ0.0 size=430315 2024-09-12T17:43:37.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.649+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=SGW3F2KFLFZ0 tag=1G8UQ4TP2Y4F type=write size=1478891 2024-09-12T17:43:37.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.653+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=ZZQKWI5IGKQ5 type=del 2024-09-12T17:43:37.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.661+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~306RSDNT7TAQ.0 size=1048576 2024-09-12T17:43:37.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.661+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~306RSDNT7TAQ.1 size=1048576 2024-09-12T17:43:37.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.665+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~306RSDNT7TAQ.2 size=471031 2024-09-12T17:43:37.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.665+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=306RSDNT7TAQ tag=HP1W9ZXUZ03N type=write size=3616759 2024-09-12T17:43:37.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.669+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~78PCHOG7DRTP.0 size=1048576 2024-09-12T17:43:37.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.673+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~78PCHOG7DRTP.1 size=1048576 2024-09-12T17:43:37.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.677+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~78PCHOG7DRTP.2 size=647210 2024-09-12T17:43:37.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.681+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=78PCHOG7DRTP tag=BJACSQ9OWCVB type=write size=3792938 2024-09-12T17:43:37.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.685+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=IOMEV10CDV10 type=del size=963618 2024-09-12T17:43:37.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.689+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=3L4O0QFJTLYT type=del 2024-09-12T17:43:37.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.693+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=V8CBE883GRUQ type=write size=83671 2024-09-12T17:43:37.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.697+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=MD0WUD51TV87 type=del 2024-09-12T17:43:37.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.705+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~WA9YIBXXX5P9.0 size=1048576 2024-09-12T17:43:37.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.709+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~WA9YIBXXX5P9.1 size=182503 2024-09-12T17:43:37.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.709+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=WA9YIBXXX5P9 tag=760SDF2KN80W type=write size=2279655 2024-09-12T17:43:37.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.713+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=D6IAGGP6WKID type=del 2024-09-12T17:43:37.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.717+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~F99XYQARPNMR.0 size=1048576 2024-09-12T17:43:37.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.721+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~F99XYQARPNMR.1 size=1048576 2024-09-12T17:43:37.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.725+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~F99XYQARPNMR.2 size=320374 2024-09-12T17:43:37.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.725+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=F99XYQARPNMR tag=CHOYJIVUCUVP type=write size=3466102 2024-09-12T17:43:37.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.729+0000 7f51d61a08c0 1 < completed write operation key=3LE20KMMPH8P tag=OMS6WSWO3IR7 type=write size=319568 2024-09-12T17:43:37.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.733+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~2TG88J0XS2DV.0 size=244218 2024-09-12T17:43:37.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.733+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=2TG88J0XS2DV tag=CCVXK36FQPWH type=write size=1292794 2024-09-12T17:43:37.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.741+0000 7f51d61a08c0 1 < suggested remove operation key=26X723PN8K8T tag=YGPS102C3T7R type=del 2024-09-12T17:43:37.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.745+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=21ZARFB6HZTL type=del size=93034 2024-09-12T17:43:37.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.749+0000 7f51d61a08c0 1 < canceled operation key=IWEJXLG1CDAV tag=6XQ15IGS7OQH type=del size=1341441 2024-09-12T17:43:37.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.757+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~M002CXMNS8JF.0 size=1048576 2024-09-12T17:43:37.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.761+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~M002CXMNS8JF.1 size=1048576 2024-09-12T17:43:37.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.761+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~M002CXMNS8JF.2 size=844054 2024-09-12T17:43:37.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.761+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=M002CXMNS8JF tag=PE6QKRY9KS3N type=write size=3989782 2024-09-12T17:43:37.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.765+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~EO2573V9C3JQ.0 size=38176 2024-09-12T17:43:37.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.773+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=EO2573V9C3JQ tag=J6J81VE6G9U4 type=write size=1086752 2024-09-12T17:43:37.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~F2D1AKJ1PJCR.0 size=1048576 2024-09-12T17:43:37.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.785+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~F2D1AKJ1PJCR.1 size=1048576 2024-09-12T17:43:37.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.785+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~F2D1AKJ1PJCR.2 size=811381 2024-09-12T17:43:37.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.785+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=F2D1AKJ1PJCR tag=09T0SM2DTFGE type=write size=3957109 2024-09-12T17:43:37.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.789+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=1R8NHMOL8UA5 type=del 2024-09-12T17:43:37.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.793+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=6DZPJ70O9TH6 type=write size=479883 2024-09-12T17:43:37.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.801+0000 7f51d61a08c0 1 < suggested update operation key=SSOA6J297L1C tag=ZKWVPUKY8KN2 type=del size=3005208 2024-09-12T17:43:37.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.805+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=RWYI55S50HZV type=write size=175713 2024-09-12T17:43:37.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.809+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=FGM45VDVIHB3 type=del 2024-09-12T17:43:37.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.817+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~FZH9YF2HP3NF.0 size=1048576 2024-09-12T17:43:37.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.821+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~FZH9YF2HP3NF.1 size=1048576 2024-09-12T17:43:37.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.821+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~FZH9YF2HP3NF.2 size=597110 2024-09-12T17:43:37.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.821+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=FZH9YF2HP3NF tag=EOCNE536RCQW type=write size=3742838 2024-09-12T17:43:37.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.825+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~BZ46WCRI0RJQ.0 size=24161 2024-09-12T17:43:37.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.833+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=BZ46WCRI0RJQ tag=D5QIFG9CEINA type=write size=1072737 2024-09-12T17:43:37.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.837+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=AKT47GXP15YX type=write size=964208 2024-09-12T17:43:37.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.845+0000 7f51d61a08c0 1 < suggested update operation key=GCL7UJEJM1UV tag=3S1NY3KNXZWW type=write size=220212 2024-09-12T17:43:37.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.853+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~8VD6HLUSS71U.0 size=361528 2024-09-12T17:43:37.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.853+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=8VD6HLUSS71U tag=2DONQB4RMN2W type=write size=1410104 2024-09-12T17:43:37.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.857+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~3BY8EJU0LOSC.0 size=1048576 2024-09-12T17:43:37.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.857+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~3BY8EJU0LOSC.1 size=495145 2024-09-12T17:43:37.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.865+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=3BY8EJU0LOSC tag=LRH1VPQTNCKL type=write size=2592297 2024-09-12T17:43:37.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.869+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=3K5SYPSY2VUD type=del size=2226436 2024-09-12T17:43:37.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.873+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~SGW3F2KFLFZ0.0 size=430315 2024-09-12T17:43:37.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.877+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=SGW3F2KFLFZ0 tag=1G8UQ4TP2Y4F type=write size=1478891 2024-09-12T17:43:37.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.881+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=ZBGQB3Y1TN3Q type=del size=183512 2024-09-12T17:43:37.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.885+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~306RSDNT7TAQ.0 size=1048576 2024-09-12T17:43:37.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.889+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~306RSDNT7TAQ.1 size=1048576 2024-09-12T17:43:37.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.893+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~306RSDNT7TAQ.2 size=471031 2024-09-12T17:43:37.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.897+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=306RSDNT7TAQ tag=HP1W9ZXUZ03N type=write size=3616759 2024-09-12T17:43:37.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.905+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~K3K1Q45QO0Y1.0 size=1048576 2024-09-12T17:43:37.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.909+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~K3K1Q45QO0Y1.1 size=1048576 2024-09-12T17:43:37.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.913+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~K3K1Q45QO0Y1.2 size=240110 2024-09-12T17:43:37.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.913+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=K3K1Q45QO0Y1 tag=GRN0JWJAECY1 type=write size=3385838 2024-09-12T17:43:37.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.917+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=IOMEV10CDV10 type=del 2024-09-12T17:43:37.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.921+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=YGNA0B6B3MSA type=del size=3049687 2024-09-12T17:43:37.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.925+0000 7f51d61a08c0 1 < completed write operation key=7FBK3439R80H tag=V8CBE883GRUQ type=write size=83671 2024-09-12T17:43:37.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.929+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=FX03ACFPXFWL type=write size=654237 2024-09-12T17:43:37.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.933+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~WA9YIBXXX5P9.0 size=1048576 2024-09-12T17:43:37.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.933+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~WA9YIBXXX5P9.1 size=182503 2024-09-12T17:43:37.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.945+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=WA9YIBXXX5P9 tag=760SDF2KN80W type=write size=2279655 2024-09-12T17:43:37.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.949+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~00ECMJTVVASQ.0 size=1048576 2024-09-12T17:43:37.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.953+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~00ECMJTVVASQ.1 size=1048576 2024-09-12T17:43:37.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.957+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~00ECMJTVVASQ.2 size=749571 2024-09-12T17:43:37.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.957+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=00ECMJTVVASQ tag=LGN82EYO4U45 type=write size=3895299 2024-09-12T17:43:37.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.961+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~F99XYQARPNMR.0 size=1048576 2024-09-12T17:43:37.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.965+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~F99XYQARPNMR.1 size=1048576 2024-09-12T17:43:37.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.965+0000 7f51d61a08c0 1 < canceled part key=_multipart_V5KMBUNVQA0H.2~F99XYQARPNMR.2 size=320374 2024-09-12T17:43:37.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.973+0000 7f51d61a08c0 1 < canceled multipart upload key=V5KMBUNVQA0H upload=F99XYQARPNMR tag=CHOYJIVUCUVP type=write size=3466102 2024-09-12T17:43:37.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.977+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=YP2FE1S4U2S7 type=del size=3210534 2024-09-12T17:43:37.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.981+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~2TG88J0XS2DV.0 size=244218 2024-09-12T17:43:37.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.985+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=2TG88J0XS2DV tag=CCVXK36FQPWH type=write size=1292794 2024-09-12T17:43:37.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.993+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~9K11Q6B443VT.0 size=1048576 2024-09-12T17:43:37.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.997+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~9K11Q6B443VT.1 size=1048576 2024-09-12T17:43:38.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.997+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~9K11Q6B443VT.2 size=254685 2024-09-12T17:43:38.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:37.997+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=9K11Q6B443VT tag=UNFZOAYGZPL2 type=write size=3400413 2024-09-12T17:43:38.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.005+0000 7f51d61a08c0 1 < suggested update operation key=X6KC9Z6LD7VG tag=21ZARFB6HZTL type=del size=93034 2024-09-12T17:43:38.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.009+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=DXXQT987MHHW type=del size=53885 2024-09-12T17:43:38.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.013+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~M002CXMNS8JF.0 size=1048576 2024-09-12T17:43:38.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.017+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~M002CXMNS8JF.1 size=1048576 2024-09-12T17:43:38.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.021+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~M002CXMNS8JF.2 size=844054 2024-09-12T17:43:38.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.025+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=M002CXMNS8JF tag=PE6QKRY9KS3N type=write size=3989782 2024-09-12T17:43:38.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.029+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=V2GTO7E1PAEC type=del size=3879058 2024-09-12T17:43:38.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.033+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~F2D1AKJ1PJCR.0 size=1048576 2024-09-12T17:43:38.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.037+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~F2D1AKJ1PJCR.1 size=1048576 2024-09-12T17:43:38.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.041+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~F2D1AKJ1PJCR.2 size=811381 2024-09-12T17:43:38.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.045+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=F2D1AKJ1PJCR tag=09T0SM2DTFGE type=write size=3957109 2024-09-12T17:43:38.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.053+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~AE2L301ZZ83C.0 size=274726 2024-09-12T17:43:38.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.053+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=AE2L301ZZ83C tag=CLA444FFL7ZC type=write size=1323302 2024-09-12T17:43:38.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.061+0000 7f51d61a08c0 1 < suggested remove operation key=2WC0YDQFKAJD tag=6DZPJ70O9TH6 type=write 2024-09-12T17:43:38.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.065+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~K1N1OTEBF1QG.0 size=1048576 2024-09-12T17:43:38.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.069+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~K1N1OTEBF1QG.1 size=804826 2024-09-12T17:43:38.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.069+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=K1N1OTEBF1QG tag=72Y3I3F9WE1N type=write size=2901978 2024-09-12T17:43:38.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.073+0000 7f51d61a08c0 1 < completed write operation key=8J72KCZ5WRPU tag=RWYI55S50HZV type=write size=175713 2024-09-12T17:43:38.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.081+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~ADIF9XN3L2IX.0 size=1048576 2024-09-12T17:43:38.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.085+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~ADIF9XN3L2IX.1 size=1048576 2024-09-12T17:43:38.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.085+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~ADIF9XN3L2IX.2 size=349159 2024-09-12T17:43:38.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.085+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=ADIF9XN3L2IX tag=UOOWIPP2JTJL type=write size=3494887 2024-09-12T17:43:38.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.089+0000 7f51d61a08c0 1 < canceled part key=_multipart_EDVAEE9FKH1T.2~FZH9YF2HP3NF.0 size=1048576 2024-09-12T17:43:38.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.089+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~FZH9YF2HP3NF.1 size=1048576 2024-09-12T17:43:38.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.093+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~FZH9YF2HP3NF.2 size=597110 2024-09-12T17:43:38.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.101+0000 7f51d61a08c0 1 < canceled multipart upload key=EDVAEE9FKH1T upload=FZH9YF2HP3NF tag=EOCNE536RCQW type=write size=3742838 2024-09-12T17:43:38.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.105+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=JST3XU78XN1Y type=del size=1975767 2024-09-12T17:43:38.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.109+0000 7f51d61a08c0 1 < completed write operation key=BF36J1Q6CZFB tag=AKT47GXP15YX type=write size=964208 2024-09-12T17:43:38.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.113+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~IFES12TXWVOF.0 size=1048576 2024-09-12T17:43:38.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.117+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~IFES12TXWVOF.1 size=1048576 2024-09-12T17:43:38.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.121+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~IFES12TXWVOF.2 size=266920 2024-09-12T17:43:38.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.121+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=IFES12TXWVOF tag=ZI2CI40LDG7G type=write size=3412648 2024-09-12T17:43:38.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.125+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~8VD6HLUSS71U.0 size=361528 2024-09-12T17:43:38.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.129+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=8VD6HLUSS71U tag=2DONQB4RMN2W type=write size=1410104 2024-09-12T17:43:38.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.133+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=FZMEZLJG4BPE type=del size=784022 2024-09-12T17:43:38.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.137+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=3K5SYPSY2VUD type=del 2024-09-12T17:43:38.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.145+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~SSZ2FNGCX7OI.0 size=351607 2024-09-12T17:43:38.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.145+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=SSZ2FNGCX7OI tag=WSQNHK37ZNDA type=write size=1400183 2024-09-12T17:43:38.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.149+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=ZBGQB3Y1TN3Q type=del 2024-09-12T17:43:38.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.157+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~SHE8I9HV15ED.0 size=1048576 2024-09-12T17:43:38.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.157+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~SHE8I9HV15ED.1 size=489420 2024-09-12T17:43:38.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.157+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=SHE8I9HV15ED tag=SA113LANYTS9 type=write size=2586572 2024-09-12T17:43:38.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.161+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~K3K1Q45QO0Y1.0 size=1048576 2024-09-12T17:43:38.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.165+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~K3K1Q45QO0Y1.1 size=1048576 2024-09-12T17:43:38.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.169+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~K3K1Q45QO0Y1.2 size=240110 2024-09-12T17:43:38.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.173+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=K3K1Q45QO0Y1 tag=GRN0JWJAECY1 type=write size=3385838 2024-09-12T17:43:38.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.177+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=UHMUT73GJ0IK type=del size=1746529 2024-09-12T17:43:38.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.181+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=YGNA0B6B3MSA type=del 2024-09-12T17:43:38.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.185+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=NJ99SVI7T9CH type=del size=1564765 2024-09-12T17:43:38.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.189+0000 7f51d61a08c0 1 < completed write operation key=EDVAEE9FKH1T tag=FX03ACFPXFWL type=write size=654237 2024-09-12T17:43:38.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.193+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=BEYT7O0Q7LES type=del size=4081017 2024-09-12T17:43:38.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.197+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~00ECMJTVVASQ.0 size=1048576 2024-09-12T17:43:38.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.201+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~00ECMJTVVASQ.1 size=1048576 2024-09-12T17:43:38.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.205+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~00ECMJTVVASQ.2 size=749571 2024-09-12T17:43:38.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.209+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=00ECMJTVVASQ tag=LGN82EYO4U45 type=write size=3895299 2024-09-12T17:43:38.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.213+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=U7DA0HBQ14NN type=write size=1027070 2024-09-12T17:43:38.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.217+0000 7f51d61a08c0 -1 < failed to complete operation key=X6KC9Z6LD7VG tag=YP2FE1S4U2S7 type=del size=3210534: (22) Invalid argument 2024-09-12T17:43:38.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.221+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=A5JJHL61X1SM type=del size=289955 2024-09-12T17:43:38.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.225+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~9K11Q6B443VT.0 size=1048576 2024-09-12T17:43:38.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.229+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~9K11Q6B443VT.1 size=1048576 2024-09-12T17:43:38.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.229+0000 7f51d61a08c0 1 < canceled part key=_multipart_V5KMBUNVQA0H.2~9K11Q6B443VT.2 size=254685 2024-09-12T17:43:38.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.233+0000 7f51d61a08c0 1 < canceled multipart upload key=V5KMBUNVQA0H upload=9K11Q6B443VT tag=UNFZOAYGZPL2 type=write size=3400413 2024-09-12T17:43:38.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.245+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~4VFAPXWIKVZI.0 size=301460 2024-09-12T17:43:38.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.245+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=4VFAPXWIKVZI tag=50QB0H2NGTQ7 type=write size=1350036 2024-09-12T17:43:38.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.249+0000 7f51d61a08c0 1 < suggested update operation key=1ZETSL5TXYSM tag=DXXQT987MHHW type=del size=53885 2024-09-12T17:43:38.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.257+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~W494MATGAJS6.0 size=747799 2024-09-12T17:43:38.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.257+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=W494MATGAJS6 tag=HGD9BF3CM6EX type=write size=1796375 2024-09-12T17:43:38.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.265+0000 7f51d61a08c0 1 < suggested update operation key=U3GZL9YPFMZY tag=V2GTO7E1PAEC type=del size=3879058 2024-09-12T17:43:38.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.269+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=TWDCJRQ94WZA type=del size=1060346 2024-09-12T17:43:38.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.273+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~AE2L301ZZ83C.0 size=274726 2024-09-12T17:43:38.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.277+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=AE2L301ZZ83C tag=CLA444FFL7ZC type=write size=1323302 2024-09-12T17:43:38.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.285+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~285WGNY7SQ8E.0 size=1048576 2024-09-12T17:43:38.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.293+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~285WGNY7SQ8E.1 size=1048576 2024-09-12T17:43:38.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.293+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~285WGNY7SQ8E.2 size=154529 2024-09-12T17:43:38.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.293+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=285WGNY7SQ8E tag=2ZSH3PPCLAMY type=write size=3300257 2024-09-12T17:43:38.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.297+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~K1N1OTEBF1QG.0 size=1048576 2024-09-12T17:43:38.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.301+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~K1N1OTEBF1QG.1 size=804826 2024-09-12T17:43:38.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.309+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=K1N1OTEBF1QG tag=72Y3I3F9WE1N type=write size=2901978 2024-09-12T17:43:38.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.313+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=MHMERLJ16LEF type=del size=3519024 2024-09-12T17:43:38.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.317+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~ADIF9XN3L2IX.0 size=1048576 2024-09-12T17:43:38.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.317+0000 7f51d61a08c0 1 < canceled part key=_multipart_IWEJXLG1CDAV.2~ADIF9XN3L2IX.1 size=1048576 2024-09-12T17:43:38.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.317+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~ADIF9XN3L2IX.2 size=349159 2024-09-12T17:43:38.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.325+0000 7f51d61a08c0 1 < canceled multipart upload key=IWEJXLG1CDAV upload=ADIF9XN3L2IX tag=UOOWIPP2JTJL type=write size=3494887 2024-09-12T17:43:38.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.333+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~8H0Y7EVCS8AC.0 size=1048576 2024-09-12T17:43:38.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.333+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~8H0Y7EVCS8AC.1 size=335000 2024-09-12T17:43:38.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.333+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=8H0Y7EVCS8AC tag=LUUIDEGKL1TW type=write size=2432152 2024-09-12T17:43:38.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.337+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=JST3XU78XN1Y type=del 2024-09-12T17:43:38.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.345+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~4TCAVX1OUTCK.0 size=1048576 2024-09-12T17:43:38.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.349+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~4TCAVX1OUTCK.1 size=1048576 2024-09-12T17:43:38.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.353+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~4TCAVX1OUTCK.2 size=538686 2024-09-12T17:43:38.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.353+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=4TCAVX1OUTCK tag=2KR59QA6R5C2 type=write size=3684414 2024-09-12T17:43:38.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.353+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~IFES12TXWVOF.0 size=1048576 2024-09-12T17:43:38.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.357+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~IFES12TXWVOF.1 size=1048576 2024-09-12T17:43:38.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.361+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~IFES12TXWVOF.2 size=266920 2024-09-12T17:43:38.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.365+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=IFES12TXWVOF tag=ZI2CI40LDG7G type=write size=3412648 2024-09-12T17:43:38.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.369+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=RJ10JU8AIP3G type=write size=264374 2024-09-12T17:43:38.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.373+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=FZMEZLJG4BPE type=del 2024-09-12T17:43:38.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.377+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=ES76ZZFS3A5D type=del size=93760 2024-09-12T17:43:38.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.381+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~SSZ2FNGCX7OI.0 size=351607 2024-09-12T17:43:38.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.389+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=SSZ2FNGCX7OI tag=WSQNHK37ZNDA type=write size=1400183 2024-09-12T17:43:38.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.393+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=Z7A6LGEFJP4I type=del size=3082217 2024-09-12T17:43:38.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.397+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~SHE8I9HV15ED.0 size=1048576 2024-09-12T17:43:38.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.397+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~SHE8I9HV15ED.1 size=489420 2024-09-12T17:43:38.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.405+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=SHE8I9HV15ED tag=SA113LANYTS9 type=write size=2586572 2024-09-12T17:43:38.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.409+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=7J3IAOJFL49H type=del size=1193787 2024-09-12T17:43:38.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.417+0000 7f51d61a08c0 1 < suggested remove operation key=V5KMBUNVQA0H tag=UHMUT73GJ0IK type=del 2024-09-12T17:43:38.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.421+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=F3AV1PRGCS8W type=del size=335122 2024-09-12T17:43:38.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.429+0000 7f51d61a08c0 1 < suggested remove operation key=A7V478K2SNOF tag=NJ99SVI7T9CH type=del 2024-09-12T17:43:38.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.433+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=Q35OVRCMSYUE type=del size=277075 2024-09-12T17:43:38.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.437+0000 7f51d61a08c0 1 < canceled operation key=JEXD4ZU5HJ2B tag=BEYT7O0Q7LES type=del size=4081017 2024-09-12T17:43:38.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.441+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~3BW4KFHZ4R00.0 size=1048576 2024-09-12T17:43:38.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.445+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~3BW4KFHZ4R00.1 size=134485 2024-09-12T17:43:38.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.445+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=3BW4KFHZ4R00 tag=BOQQ6MAGD69H type=write size=2231637 2024-09-12T17:43:38.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.449+0000 7f51d61a08c0 1 < completed write operation key=JEXD4ZU5HJ2B tag=U7DA0HBQ14NN type=write size=1027070 2024-09-12T17:43:38.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.457+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~YT6LKJV2BBRU.0 size=1048576 2024-09-12T17:43:38.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.461+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~YT6LKJV2BBRU.1 size=1048576 2024-09-12T17:43:38.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.461+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~YT6LKJV2BBRU.2 size=594379 2024-09-12T17:43:38.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.461+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=YT6LKJV2BBRU tag=G9EXQN3HB19Y type=write size=3740107 2024-09-12T17:43:38.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.465+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=A5JJHL61X1SM type=del 2024-09-12T17:43:38.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.469+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=75ODLCZUVN8N type=del size=1387443 2024-09-12T17:43:38.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.473+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~4VFAPXWIKVZI.0 size=301460 2024-09-12T17:43:38.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.481+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=4VFAPXWIKVZI tag=50QB0H2NGTQ7 type=write size=1350036 2024-09-12T17:43:38.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.485+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=2BH9Y1SXPEVF type=del size=2085378 2024-09-12T17:43:38.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.489+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~W494MATGAJS6.0 size=747799 2024-09-12T17:43:38.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.493+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=W494MATGAJS6 tag=HGD9BF3CM6EX type=write size=1796375 2024-09-12T17:43:38.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.501+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~Y5FYF2HR23ZZ.0 size=1048576 2024-09-12T17:43:38.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.505+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~Y5FYF2HR23ZZ.1 size=1048576 2024-09-12T17:43:38.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.505+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~Y5FYF2HR23ZZ.2 size=451415 2024-09-12T17:43:38.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.505+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=Y5FYF2HR23ZZ tag=B11H4G4IR158 type=write size=3597143 2024-09-12T17:43:38.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.509+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=TWDCJRQ94WZA type=del 2024-09-12T17:43:38.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.513+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=7DEI02CW0BE3 type=del size=2384771 2024-09-12T17:43:38.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.517+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~285WGNY7SQ8E.0 size=1048576 2024-09-12T17:43:38.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.521+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~285WGNY7SQ8E.1 size=1048576 2024-09-12T17:43:38.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.525+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~285WGNY7SQ8E.2 size=154529 2024-09-12T17:43:38.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.529+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=285WGNY7SQ8E tag=2ZSH3PPCLAMY type=write size=3300257 2024-09-12T17:43:38.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.533+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=ETDYGIFCJW6E type=del size=2102064 2024-09-12T17:43:38.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.537+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=MHMERLJ16LEF type=del 2024-09-12T17:43:38.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.545+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~72URKZ0PCGNM.0 size=1048576 2024-09-12T17:43:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.545+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~72URKZ0PCGNM.1 size=221799 2024-09-12T17:43:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.545+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=72URKZ0PCGNM tag=PYPVKRT3R5ZY type=write size=2318951 2024-09-12T17:43:38.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.549+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~8H0Y7EVCS8AC.0 size=1048576 2024-09-12T17:43:38.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.553+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~8H0Y7EVCS8AC.1 size=335000 2024-09-12T17:43:38.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.561+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=8H0Y7EVCS8AC tag=LUUIDEGKL1TW type=write size=2432152 2024-09-12T17:43:38.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.565+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=U4C6G00NI9OA type=del size=1374016 2024-09-12T17:43:38.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.565+0000 7f51d61a08c0 1 < canceled part key=_multipart_V5KMBUNVQA0H.2~4TCAVX1OUTCK.0 size=1048576 2024-09-12T17:43:38.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.569+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~4TCAVX1OUTCK.1 size=1048576 2024-09-12T17:43:38.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.569+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~4TCAVX1OUTCK.2 size=538686 2024-09-12T17:43:38.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.577+0000 7f51d61a08c0 1 < canceled multipart upload key=V5KMBUNVQA0H upload=4TCAVX1OUTCK tag=2KR59QA6R5C2 type=write size=3684414 2024-09-12T17:43:38.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.581+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=7TGQ0PV0OKEX type=del size=2094952 2024-09-12T17:43:38.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.589+0000 7f51d61a08c0 1 < suggested remove operation key=92CMI8Q29LB3 tag=RJ10JU8AIP3G type=write 2024-09-12T17:43:38.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.593+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=U74WPYF1U9KD type=write size=9819 2024-09-12T17:43:38.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.601+0000 7f51d61a08c0 1 < suggested remove operation key=GJX1YGAQFXZ2 tag=ES76ZZFS3A5D type=del 2024-09-12T17:43:38.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.605+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=ADW032KW09IH type=del size=972190 2024-09-12T17:43:38.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.609+0000 7f51d61a08c0 1 < canceled operation key=FKKV7SXZSP90 tag=Z7A6LGEFJP4I type=del size=3082217 2024-09-12T17:43:38.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.613+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=GHCNILR3E0KI type=del size=1283526 2024-09-12T17:43:38.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.621+0000 7f51d61a08c0 1 < suggested update operation key=10WBH16J1AF8 tag=7J3IAOJFL49H type=del size=1193787 2024-09-12T17:43:38.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.625+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=AITK0FH0PK3Q type=del size=781772 2024-09-12T17:43:38.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.629+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=F3AV1PRGCS8W type=del 2024-09-12T17:43:38.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.633+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=WZUA85TQ3D0L type=write size=429076 2024-09-12T17:43:38.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.637+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=Q35OVRCMSYUE type=del 2024-09-12T17:43:38.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.649+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~IFAPTA85ED0E.0 size=658411 2024-09-12T17:43:38.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.649+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=IFAPTA85ED0E tag=V3VN0RVSE5JJ type=write size=1706987 2024-09-12T17:43:38.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.653+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~3BW4KFHZ4R00.0 size=1048576 2024-09-12T17:43:38.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.657+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~3BW4KFHZ4R00.1 size=134485 2024-09-12T17:43:38.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.665+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=3BW4KFHZ4R00 tag=BOQQ6MAGD69H type=write size=2231637 2024-09-12T17:43:38.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.673+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~KSM7EY7SLCN1.0 size=1048576 2024-09-12T17:43:38.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.673+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~KSM7EY7SLCN1.1 size=423899 2024-09-12T17:43:38.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.673+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=KSM7EY7SLCN1 tag=CVUDWX4EXE48 type=write size=2521051 2024-09-12T17:43:38.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.677+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~YT6LKJV2BBRU.0 size=1048576 2024-09-12T17:43:38.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.681+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~YT6LKJV2BBRU.1 size=1048576 2024-09-12T17:43:38.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.685+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~YT6LKJV2BBRU.2 size=594379 2024-09-12T17:43:38.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.689+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=YT6LKJV2BBRU tag=G9EXQN3HB19Y type=write size=3740107 2024-09-12T17:43:38.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.693+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=1HBJP6F70CVU type=del size=1254395 2024-09-12T17:43:38.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.697+0000 7f51d61a08c0 1 < completed delete operation key=U3GZL9YPFMZY tag=75ODLCZUVN8N type=del 2024-09-12T17:43:38.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.701+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=XQ1WA0BA0CE3 type=del size=3693036 2024-09-12T17:43:38.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.705+0000 7f51d61a08c0 -1 < failed to complete operation key=GJX1YGAQFXZ2 tag=2BH9Y1SXPEVF type=del size=2085378: (22) Invalid argument 2024-09-12T17:43:38.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.713+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~EWRHS6QJ3KNC.0 size=1048576 2024-09-12T17:43:38.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.713+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~EWRHS6QJ3KNC.1 size=1048576 2024-09-12T17:43:38.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.717+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~EWRHS6QJ3KNC.2 size=356813 2024-09-12T17:43:38.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.717+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=EWRHS6QJ3KNC tag=FATHUO6FYM8T type=write size=3502541 2024-09-12T17:43:38.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.721+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~Y5FYF2HR23ZZ.0 size=1048576 2024-09-12T17:43:38.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.725+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~Y5FYF2HR23ZZ.1 size=1048576 2024-09-12T17:43:38.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.729+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~Y5FYF2HR23ZZ.2 size=451415 2024-09-12T17:43:38.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.733+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=Y5FYF2HR23ZZ tag=B11H4G4IR158 type=write size=3597143 2024-09-12T17:43:38.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.737+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=MPMOQY3EOJ96 type=del size=1818106 2024-09-12T17:43:38.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.745+0000 7f51d61a08c0 1 < suggested update operation key=FKKV7SXZSP90 tag=7DEI02CW0BE3 type=del size=2384771 2024-09-12T17:43:38.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.753+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~V7AQN8L7SIZ8.0 size=1048576 2024-09-12T17:43:38.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.757+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~V7AQN8L7SIZ8.1 size=156570 2024-09-12T17:43:38.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.757+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=V7AQN8L7SIZ8 tag=HWNYZUYGNLCZ type=write size=2253722 2024-09-12T17:43:38.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.765+0000 7f51d61a08c0 1 < suggested remove operation key=26X723PN8K8T tag=ETDYGIFCJW6E type=del 2024-09-12T17:43:38.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.769+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=Z5R961M5QWUQ type=write size=942340 2024-09-12T17:43:38.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.773+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~72URKZ0PCGNM.0 size=1048576 2024-09-12T17:43:38.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.773+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~72URKZ0PCGNM.1 size=221799 2024-09-12T17:43:38.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.781+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=72URKZ0PCGNM tag=PYPVKRT3R5ZY type=write size=2318951 2024-09-12T17:43:38.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.785+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=S1P6QBLMVQ3L type=del size=3518769 2024-09-12T17:43:38.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.789+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=U4C6G00NI9OA type=del 2024-09-12T17:43:38.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.797+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~T05BGO8RYI72.0 size=1048576 2024-09-12T17:43:38.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.801+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~T05BGO8RYI72.1 size=995266 2024-09-12T17:43:38.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.801+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=T05BGO8RYI72 tag=TXZXAJFJ8P4R type=write size=3092418 2024-09-12T17:43:38.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.805+0000 7f51d61a08c0 -1 < failed to complete operation key=FKKV7SXZSP90 tag=7TGQ0PV0OKEX type=del size=2094952: (22) Invalid argument 2024-09-12T17:43:38.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.809+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=77UZ4JDJTL2I type=del size=1538369 2024-09-12T17:43:38.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.813+0000 7f51d61a08c0 1 < completed write operation key=JEXD4ZU5HJ2B tag=U74WPYF1U9KD type=write size=9819 2024-09-12T17:43:38.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.821+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~1J30DCQL0YQO.0 size=396719 2024-09-12T17:43:38.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.821+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=1J30DCQL0YQO tag=AL5XTO0GTPI0 type=write size=1445295 2024-09-12T17:43:38.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.829+0000 7f51d61a08c0 1 < suggested update operation key=GJX1YGAQFXZ2 tag=ADW032KW09IH type=del size=972190 2024-09-12T17:43:38.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.837+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=3AJYMAV9GDK3 type=del size=1988590 2024-09-12T17:43:38.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.841+0000 7f51d61a08c0 -1 < failed to complete operation key=GJX1YGAQFXZ2 tag=GHCNILR3E0KI type=del size=1283526: (22) Invalid argument 2024-09-12T17:43:38.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.845+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=SIQBP8DF6CBR type=write size=52516 2024-09-12T17:43:38.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.849+0000 7f51d61a08c0 1 < canceled operation key=7FBK3439R80H tag=AITK0FH0PK3Q type=del size=781772 2024-09-12T17:43:38.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.853+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~ZALOIPW7UYDU.0 size=148722 2024-09-12T17:43:38.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.853+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=ZALOIPW7UYDU tag=YAMGRY0MS9M7 type=write size=1197298 2024-09-12T17:43:38.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.857+0000 7f51d61a08c0 1 < completed write operation key=3LE20KMMPH8P tag=WZUA85TQ3D0L type=write size=429076 2024-09-12T17:43:38.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.865+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~J2Z2U0XL983X.0 size=1048576 2024-09-12T17:43:38.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.869+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~J2Z2U0XL983X.1 size=1048576 2024-09-12T17:43:38.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.873+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~J2Z2U0XL983X.2 size=340024 2024-09-12T17:43:38.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.873+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=J2Z2U0XL983X tag=3W44PE8R9WFF type=write size=3485752 2024-09-12T17:43:38.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.877+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~IFAPTA85ED0E.0 size=658411 2024-09-12T17:43:38.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.881+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=IFAPTA85ED0E tag=V3VN0RVSE5JJ type=write size=1706987 2024-09-12T17:43:38.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.889+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~IN9LJGNTWR7R.0 size=171574 2024-09-12T17:43:38.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.889+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=IN9LJGNTWR7R tag=AECV96ZEU1OG type=write size=1220150 2024-09-12T17:43:38.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.893+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~KSM7EY7SLCN1.0 size=1048576 2024-09-12T17:43:38.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.897+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~KSM7EY7SLCN1.1 size=423899 2024-09-12T17:43:38.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.901+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=KSM7EY7SLCN1 tag=CVUDWX4EXE48 type=write size=2521051 2024-09-12T17:43:38.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.909+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~X2H0IOEL6B1R.0 size=1048576 2024-09-12T17:43:38.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.913+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~X2H0IOEL6B1R.1 size=1048576 2024-09-12T17:43:38.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.913+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~X2H0IOEL6B1R.2 size=756170 2024-09-12T17:43:38.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.913+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=X2H0IOEL6B1R tag=TJK75FMSMJBT type=write size=3901898 2024-09-12T17:43:38.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.917+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=1HBJP6F70CVU type=del 2024-09-12T17:43:38.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.925+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~OX1GB2YBXUSS.0 size=1048576 2024-09-12T17:43:38.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.929+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~OX1GB2YBXUSS.1 size=983647 2024-09-12T17:43:38.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.929+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=OX1GB2YBXUSS tag=J1RGUQMJICV2 type=write size=3080799 2024-09-12T17:43:38.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.933+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=XQ1WA0BA0CE3 type=del 2024-09-12T17:43:38.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.937+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=GA8ERNWLX2O9 type=del size=3781313 2024-09-12T17:43:38.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.941+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~EWRHS6QJ3KNC.0 size=1048576 2024-09-12T17:43:38.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.941+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~EWRHS6QJ3KNC.1 size=1048576 2024-09-12T17:43:38.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.945+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~EWRHS6QJ3KNC.2 size=356813 2024-09-12T17:43:38.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.949+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=EWRHS6QJ3KNC tag=FATHUO6FYM8T type=write size=3502541 2024-09-12T17:43:38.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.953+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=5P3EKI1RHBBR type=write size=7743 2024-09-12T17:43:38.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.957+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=MPMOQY3EOJ96 type=del 2024-09-12T17:43:38.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.961+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=XJSFBUD06YJP type=del size=846118 2024-09-12T17:43:38.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.965+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~V7AQN8L7SIZ8.0 size=1048576 2024-09-12T17:43:38.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.969+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~V7AQN8L7SIZ8.1 size=156570 2024-09-12T17:43:38.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.973+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=V7AQN8L7SIZ8 tag=HWNYZUYGNLCZ type=write size=2253722 2024-09-12T17:43:38.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.977+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~J5RXWKD3XV15.0 size=678699 2024-09-12T17:43:38.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.977+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=J5RXWKD3XV15 tag=QO1NJ2RWOL9P type=write size=1727275 2024-09-12T17:43:38.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.981+0000 7f51d61a08c0 1 < completed write operation key=HUWVRJIZ5JYE tag=Z5R961M5QWUQ type=write size=942340 2024-09-12T17:43:38.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.989+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~TFE9UH1XWYA5.0 size=1048576 2024-09-12T17:43:38.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.993+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~TFE9UH1XWYA5.1 size=982801 2024-09-12T17:43:38.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.993+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=TFE9UH1XWYA5 tag=BMPW0JXPMLYR type=write size=3079953 2024-09-12T17:43:39.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:38.997+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=S1P6QBLMVQ3L type=del 2024-09-12T17:43:39.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.001+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=RKVJVP328M3I type=del size=3751122 2024-09-12T17:43:39.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.005+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~T05BGO8RYI72.0 size=1048576 2024-09-12T17:43:39.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.009+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~T05BGO8RYI72.1 size=995266 2024-09-12T17:43:39.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.013+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=T05BGO8RYI72 tag=TXZXAJFJ8P4R type=write size=3092418 2024-09-12T17:43:39.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.021+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~03WIGEL1QKC8.0 size=385253 2024-09-12T17:43:39.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.021+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=03WIGEL1QKC8 tag=0BI18BP00687 type=write size=1433829 2024-09-12T17:43:39.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.025+0000 7f51d61a08c0 1 < suggested remove operation key=92CMI8Q29LB3 tag=77UZ4JDJTL2I type=del 2024-09-12T17:43:39.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.033+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~JT38HH31DJUX.0 size=1048576 2024-09-12T17:43:39.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~JT38HH31DJUX.1 size=1048576 2024-09-12T17:43:39.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~JT38HH31DJUX.2 size=345617 2024-09-12T17:43:39.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.037+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=JT38HH31DJUX tag=YUJIM7J3HD0J type=write size=3491345 2024-09-12T17:43:39.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.041+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~1J30DCQL0YQO.0 size=396719 2024-09-12T17:43:39.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.045+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=1J30DCQL0YQO tag=AL5XTO0GTPI0 type=write size=1445295 2024-09-12T17:43:39.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.049+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=DNL463M7ZM7N type=del size=2586539 2024-09-12T17:43:39.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.057+0000 7f51d61a08c0 1 < suggested remove operation key=GCL7UJEJM1UV tag=3AJYMAV9GDK3 type=del 2024-09-12T17:43:39.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.065+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~E3HE06VI01DF.0 size=1048576 2024-09-12T17:43:39.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.065+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~E3HE06VI01DF.1 size=61235 2024-09-12T17:43:39.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.065+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=E3HE06VI01DF tag=SV2L1700MUQG type=write size=2158387 2024-09-12T17:43:39.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.069+0000 7f51d61a08c0 1 < completed write operation key=10WBH16J1AF8 tag=SIQBP8DF6CBR type=write size=52516 2024-09-12T17:43:39.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.073+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=GSE2P7EAKYPL type=write size=691553 2024-09-12T17:43:39.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.077+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~ZALOIPW7UYDU.0 size=148722 2024-09-12T17:43:39.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.081+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=ZALOIPW7UYDU tag=YAMGRY0MS9M7 type=write size=1197298 2024-09-12T17:43:39.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.085+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=E1LPOT4RZVXB type=del size=3026502 2024-09-12T17:43:39.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.089+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~J2Z2U0XL983X.0 size=1048576 2024-09-12T17:43:39.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.093+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~J2Z2U0XL983X.1 size=1048576 2024-09-12T17:43:39.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.097+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~J2Z2U0XL983X.2 size=340024 2024-09-12T17:43:39.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.101+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=J2Z2U0XL983X tag=3W44PE8R9WFF type=write size=3485752 2024-09-12T17:43:39.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.105+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=R7VB6FJ99N19 type=del size=1497700 2024-09-12T17:43:39.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.109+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~IN9LJGNTWR7R.0 size=171574 2024-09-12T17:43:39.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.113+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=IN9LJGNTWR7R tag=AECV96ZEU1OG type=write size=1220150 2024-09-12T17:43:39.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.121+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~0KO2L6PT8PK5.0 size=1048576 2024-09-12T17:43:39.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.121+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~0KO2L6PT8PK5.1 size=1048576 2024-09-12T17:43:39.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.125+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~0KO2L6PT8PK5.2 size=783062 2024-09-12T17:43:39.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.125+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=0KO2L6PT8PK5 tag=9SP7EGXIMKIL type=write size=3928790 2024-09-12T17:43:39.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.129+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~X2H0IOEL6B1R.0 size=1048576 2024-09-12T17:43:39.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.133+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~X2H0IOEL6B1R.1 size=1048576 2024-09-12T17:43:39.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.137+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~X2H0IOEL6B1R.2 size=756170 2024-09-12T17:43:39.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.141+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=X2H0IOEL6B1R tag=TJK75FMSMJBT type=write size=3901898 2024-09-12T17:43:39.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.145+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=LXYN757HOYA7 type=del size=3510119 2024-09-12T17:43:39.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.149+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~OX1GB2YBXUSS.0 size=1048576 2024-09-12T17:43:39.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.149+0000 7f51d61a08c0 1 < canceled part key=_multipart_JT373R4HAJZS.2~OX1GB2YBXUSS.1 size=983647 2024-09-12T17:43:39.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.153+0000 7f51d61a08c0 1 < canceled multipart upload key=JT373R4HAJZS upload=OX1GB2YBXUSS tag=J1RGUQMJICV2 type=write size=3080799 2024-09-12T17:43:39.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.161+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~E46KYWW4D1ED.0 size=1048576 2024-09-12T17:43:39.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.165+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~E46KYWW4D1ED.1 size=1048576 2024-09-12T17:43:39.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.169+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~E46KYWW4D1ED.2 size=250361 2024-09-12T17:43:39.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.169+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=E46KYWW4D1ED tag=D9GUIZ9ZDVQL type=write size=3396089 2024-09-12T17:43:39.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.173+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=GA8ERNWLX2O9 type=del 2024-09-12T17:43:39.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.177+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=BXSHNQODGKIH type=del size=1756727 2024-09-12T17:43:39.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.181+0000 7f51d61a08c0 1 < completed write operation key=BF36J1Q6CZFB tag=5P3EKI1RHBBR type=write size=7743 2024-09-12T17:43:39.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.185+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=0MY7EN70SB0B type=del size=2179919 2024-09-12T17:43:39.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.189+0000 7f51d61a08c0 1 < canceled operation key=10WBH16J1AF8 tag=XJSFBUD06YJP type=del size=846118 2024-09-12T17:43:39.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.197+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~0LY8FX1VB0SL.0 size=126144 2024-09-12T17:43:39.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.197+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=0LY8FX1VB0SL tag=MEUA3J1LA45V type=write size=1174720 2024-09-12T17:43:39.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.197+0000 7f51d61a08c0 1 < canceled part key=_multipart_HUWVRJIZ5JYE.2~J5RXWKD3XV15.0 size=678699 2024-09-12T17:43:39.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.205+0000 7f51d61a08c0 1 < canceled multipart upload key=HUWVRJIZ5JYE upload=J5RXWKD3XV15 tag=QO1NJ2RWOL9P type=write size=1727275 2024-09-12T17:43:39.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.213+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~632E7GZ6WUNX.0 size=1048576 2024-09-12T17:43:39.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.217+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~632E7GZ6WUNX.1 size=89340 2024-09-12T17:43:39.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.217+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=632E7GZ6WUNX tag=TV6CQV6GN1U4 type=write size=2186492 2024-09-12T17:43:39.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.221+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~TFE9UH1XWYA5.0 size=1048576 2024-09-12T17:43:39.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.221+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~TFE9UH1XWYA5.1 size=982801 2024-09-12T17:43:39.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.229+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=TFE9UH1XWYA5 tag=BMPW0JXPMLYR type=write size=3079953 2024-09-12T17:43:39.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.233+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~0T36EI0QUB5Q.0 size=50811 2024-09-12T17:43:39.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.233+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=0T36EI0QUB5Q tag=8H77P513F34A type=write size=1099387 2024-09-12T17:43:39.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.237+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=RKVJVP328M3I type=del 2024-09-12T17:43:39.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.241+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=DYAYWJ7VAKFW type=write size=472880 2024-09-12T17:43:39.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.245+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~03WIGEL1QKC8.0 size=385253 2024-09-12T17:43:39.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.253+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=03WIGEL1QKC8 tag=0BI18BP00687 type=write size=1433829 2024-09-12T17:43:39.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.257+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=6FDMB909620K type=del size=900985 2024-09-12T17:43:39.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.261+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~JT38HH31DJUX.0 size=1048576 2024-09-12T17:43:39.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.261+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~JT38HH31DJUX.1 size=1048576 2024-09-12T17:43:39.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.265+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~JT38HH31DJUX.2 size=345617 2024-09-12T17:43:39.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.273+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=JT38HH31DJUX tag=YUJIM7J3HD0J type=write size=3491345 2024-09-12T17:43:39.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.277+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~3MBGKBQTBWUI.0 size=1048576 2024-09-12T17:43:39.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.281+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~3MBGKBQTBWUI.1 size=707859 2024-09-12T17:43:39.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.281+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=3MBGKBQTBWUI tag=DJY0BYI0G8FF type=write size=2805011 2024-09-12T17:43:39.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.285+0000 7f51d61a08c0 1 < canceled operation key=JEXD4ZU5HJ2B tag=DNL463M7ZM7N type=del size=2586539 2024-09-12T17:43:39.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.293+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=9BBZVHK70PMS type=del size=2892872 2024-09-12T17:43:39.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.297+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~E3HE06VI01DF.0 size=1048576 2024-09-12T17:43:39.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.297+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~E3HE06VI01DF.1 size=61235 2024-09-12T17:43:39.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.305+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=E3HE06VI01DF tag=SV2L1700MUQG type=write size=2158387 2024-09-12T17:43:39.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.309+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=W3OR0CIXBVOM type=del size=2994148 2024-09-12T17:43:39.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.313+0000 7f51d61a08c0 1 < completed write operation key=83V7KSWRKFMZ tag=GSE2P7EAKYPL type=write size=691553 2024-09-12T17:43:39.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.317+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=49W368LE0H0Y type=del size=1154990 2024-09-12T17:43:39.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.325+0000 7f51d61a08c0 1 < suggested update operation key=92CMI8Q29LB3 tag=E1LPOT4RZVXB type=del size=3026502 2024-09-12T17:43:39.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.329+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=VA2TESO26FJ5 type=del size=1020804 2024-09-12T17:43:39.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.333+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=R7VB6FJ99N19 type=del 2024-09-12T17:43:39.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.337+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=WNQISXIXJMOM type=del size=289973 2024-09-12T17:43:39.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.341+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~0KO2L6PT8PK5.0 size=1048576 2024-09-12T17:43:39.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.345+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~0KO2L6PT8PK5.1 size=1048576 2024-09-12T17:43:39.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.349+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~0KO2L6PT8PK5.2 size=783062 2024-09-12T17:43:39.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.353+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=0KO2L6PT8PK5 tag=9SP7EGXIMKIL type=write size=3928790 2024-09-12T17:43:39.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.357+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=V640WQJK234O type=del size=732885 2024-09-12T17:43:39.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.361+0000 7f51d61a08c0 1 < canceled operation key=JT373R4HAJZS tag=LXYN757HOYA7 type=del size=3510119 2024-09-12T17:43:39.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.365+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=EGFS8RSFC5S7 type=del size=2581331 2024-09-12T17:43:39.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.373+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~E46KYWW4D1ED.0 size=1048576 2024-09-12T17:43:39.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.373+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~E46KYWW4D1ED.1 size=1048576 2024-09-12T17:43:39.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.377+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~E46KYWW4D1ED.2 size=250361 2024-09-12T17:43:39.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.381+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=E46KYWW4D1ED tag=D9GUIZ9ZDVQL type=write size=3396089 2024-09-12T17:43:39.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.389+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~8YUB1KZJSK30.0 size=287533 2024-09-12T17:43:39.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.389+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=8YUB1KZJSK30 tag=O4VEGJ6Q11T8 type=write size=1336109 2024-09-12T17:43:39.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.393+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=BXSHNQODGKIH type=del 2024-09-12T17:43:39.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.401+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~CM6RLZOTXXBD.0 size=295002 2024-09-12T17:43:39.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.401+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=CM6RLZOTXXBD tag=8KY9CJ5XMN2P type=write size=1343578 2024-09-12T17:43:39.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.405+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=0MY7EN70SB0B type=del 2024-09-12T17:43:39.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.409+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=HKYJ9YBXQ3WO type=write size=472167 2024-09-12T17:43:39.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.413+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~0LY8FX1VB0SL.0 size=126144 2024-09-12T17:43:39.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.417+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=0LY8FX1VB0SL tag=MEUA3J1LA45V type=write size=1174720 2024-09-12T17:43:39.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.421+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=49YWLD07G7CS type=del size=2116706 2024-09-12T17:43:39.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.425+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~632E7GZ6WUNX.0 size=1048576 2024-09-12T17:43:39.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.425+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~632E7GZ6WUNX.1 size=89340 2024-09-12T17:43:39.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.433+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=632E7GZ6WUNX tag=TV6CQV6GN1U4 type=write size=2186492 2024-09-12T17:43:39.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.437+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=VM80GENZB5GO type=del size=2213586 2024-09-12T17:43:39.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.441+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~0T36EI0QUB5Q.0 size=50811 2024-09-12T17:43:39.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.445+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=0T36EI0QUB5Q tag=8H77P513F34A type=write size=1099387 2024-09-12T17:43:39.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.453+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~VLYY3KFO9X6S.0 size=1048576 2024-09-12T17:43:39.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.453+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~VLYY3KFO9X6S.1 size=1048576 2024-09-12T17:43:39.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.457+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~VLYY3KFO9X6S.2 size=227487 2024-09-12T17:43:39.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.457+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=VLYY3KFO9X6S tag=PAAGTGI7BHRJ type=write size=3373215 2024-09-12T17:43:39.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.461+0000 7f51d61a08c0 1 < completed write operation key=A7V478K2SNOF tag=DYAYWJ7VAKFW type=write size=472880 2024-09-12T17:43:39.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.465+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=TUH7JTALYXL2 type=del size=2797565 2024-09-12T17:43:39.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.473+0000 7f51d61a08c0 1 < suggested remove operation key=NIQAUF085D97 tag=6FDMB909620K type=del 2024-09-12T17:43:39.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.477+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~TRJ14HG33G8M.0 size=1048576 2024-09-12T17:43:39.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.481+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~TRJ14HG33G8M.1 size=765447 2024-09-12T17:43:39.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.481+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=TRJ14HG33G8M tag=4A3LU5DDSHJE type=write size=2862599 2024-09-12T17:43:39.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.485+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~3MBGKBQTBWUI.0 size=1048576 2024-09-12T17:43:39.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.489+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~3MBGKBQTBWUI.1 size=707859 2024-09-12T17:43:39.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.493+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=3MBGKBQTBWUI tag=DJY0BYI0G8FF type=write size=2805011 2024-09-12T17:43:39.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.497+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=2ZFC6Y9R28QI type=del size=30866 2024-09-12T17:43:39.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.501+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=9BBZVHK70PMS type=del 2024-09-12T17:43:39.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.509+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~QFC9TFC132JN.0 size=1048576 2024-09-12T17:43:39.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.513+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~QFC9TFC132JN.1 size=818931 2024-09-12T17:43:39.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.513+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=QFC9TFC132JN tag=BK8T2KXXE94I type=write size=2916083 2024-09-12T17:43:39.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.517+0000 7f51d61a08c0 1 < suggested remove operation key=3LE20KMMPH8P tag=W3OR0CIXBVOM type=del 2024-09-12T17:43:39.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.521+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=KAUREK5Q3TWE type=write size=78455 2024-09-12T17:43:39.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.525+0000 7f51d61a08c0 -1 < failed to complete operation key=92CMI8Q29LB3 tag=49W368LE0H0Y type=del size=1154990: (22) Invalid argument 2024-09-12T17:43:39.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.529+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=E35VZR44Z35Y type=del size=3980094 2024-09-12T17:43:39.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.533+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=VA2TESO26FJ5 type=del 2024-09-12T17:43:39.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.537+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=EZIDAH5QLT21 type=del size=3278154 2024-09-12T17:43:39.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.549+0000 7f51d61a08c0 1 < suggested remove operation key=JEXD4ZU5HJ2B tag=WNQISXIXJMOM type=del 2024-09-12T17:43:39.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.553+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=1XANEOYTNWA7 type=del size=3760927 2024-09-12T17:43:39.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.557+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=V640WQJK234O type=del 2024-09-12T17:43:39.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.561+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=1NWPZH7AXI29 type=del size=1552102 2024-09-12T17:43:39.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.569+0000 7f51d61a08c0 1 < suggested remove operation key=S292EX1P7IZA tag=EGFS8RSFC5S7 type=del 2024-09-12T17:43:39.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.573+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=3BIV0VMDU948 type=del size=1347133 2024-09-12T17:43:39.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.573+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~8YUB1KZJSK30.0 size=287533 2024-09-12T17:43:39.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.581+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=8YUB1KZJSK30 tag=O4VEGJ6Q11T8 type=write size=1336109 2024-09-12T17:43:39.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.589+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~Z2O94AKE8EET.0 size=1048576 2024-09-12T17:43:39.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.589+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~Z2O94AKE8EET.1 size=1048576 2024-09-12T17:43:39.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.593+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~Z2O94AKE8EET.2 size=87981 2024-09-12T17:43:39.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.593+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=Z2O94AKE8EET tag=ZV01SFWZ5HCC type=write size=3233709 2024-09-12T17:43:39.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.597+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~CM6RLZOTXXBD.0 size=295002 2024-09-12T17:43:39.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.601+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=CM6RLZOTXXBD tag=8KY9CJ5XMN2P type=write size=1343578 2024-09-12T17:43:39.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.609+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~4VOO40Z3AW9F.0 size=1048576 2024-09-12T17:43:39.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.613+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~4VOO40Z3AW9F.1 size=1048576 2024-09-12T17:43:39.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.617+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~4VOO40Z3AW9F.2 size=468652 2024-09-12T17:43:39.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.617+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=4VOO40Z3AW9F tag=08N1EMFG2EP3 type=write size=3614380 2024-09-12T17:43:39.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.621+0000 7f51d61a08c0 1 < completed write operation key=SSOA6J297L1C tag=HKYJ9YBXQ3WO type=write size=472167 2024-09-12T17:43:39.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.625+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=D2CFD46AY7QS type=del size=1856606 2024-09-12T17:43:39.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.629+0000 7f51d61a08c0 -1 < failed to complete operation key=NIQAUF085D97 tag=49YWLD07G7CS type=del size=2116706: (22) Invalid argument 2024-09-12T17:43:39.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.633+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~L14OP0FYNW26.0 size=1048576 2024-09-12T17:43:39.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.637+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~L14OP0FYNW26.1 size=382952 2024-09-12T17:43:39.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.637+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=L14OP0FYNW26 tag=HMSKAXW3TO0R type=write size=2480104 2024-09-12T17:43:39.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.641+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=VM80GENZB5GO type=del 2024-09-12T17:43:39.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.645+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=3CK08UYB7ADN type=del size=2815477 2024-09-12T17:43:39.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.649+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~VLYY3KFO9X6S.0 size=1048576 2024-09-12T17:43:39.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.653+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~VLYY3KFO9X6S.1 size=1048576 2024-09-12T17:43:39.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.657+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~VLYY3KFO9X6S.2 size=227487 2024-09-12T17:43:39.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.661+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=VLYY3KFO9X6S tag=PAAGTGI7BHRJ type=write size=3373215 2024-09-12T17:43:39.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.669+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~JAL2MWZVRLRN.0 size=1048576 2024-09-12T17:43:39.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.673+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~JAL2MWZVRLRN.1 size=758159 2024-09-12T17:43:39.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.673+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=JAL2MWZVRLRN tag=WYBIHX8MW4LJ type=write size=2855311 2024-09-12T17:43:39.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.681+0000 7f51d61a08c0 1 < suggested update operation key=7FBK3439R80H tag=TUH7JTALYXL2 type=del size=2797565 2024-09-12T17:43:39.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.689+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=4F9ZXO2OIBTR type=write size=318340 2024-09-12T17:43:39.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.693+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~TRJ14HG33G8M.0 size=1048576 2024-09-12T17:43:39.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.697+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~TRJ14HG33G8M.1 size=765447 2024-09-12T17:43:39.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.705+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=TRJ14HG33G8M tag=4A3LU5DDSHJE type=write size=2862599 2024-09-12T17:43:39.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.709+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~3QGV65QR3YE1.0 size=1048576 2024-09-12T17:43:39.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.713+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~3QGV65QR3YE1.1 size=1026202 2024-09-12T17:43:39.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.713+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=3QGV65QR3YE1 tag=2BKAVCZTMI9L type=write size=3123354 2024-09-12T17:43:39.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.721+0000 7f51d61a08c0 1 < suggested update operation key=S292EX1P7IZA tag=2ZFC6Y9R28QI type=del size=30866 2024-09-12T17:43:39.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.725+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=O3Q60BBGHWGU type=del size=1100013 2024-09-12T17:43:39.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.729+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~QFC9TFC132JN.0 size=1048576 2024-09-12T17:43:39.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.733+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~QFC9TFC132JN.1 size=818931 2024-09-12T17:43:39.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.737+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=QFC9TFC132JN tag=BK8T2KXXE94I type=write size=2916083 2024-09-12T17:43:39.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.741+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=R1AQ7W835QPY type=write size=460801 2024-09-12T17:43:39.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.745+0000 7f51d61a08c0 1 < completed write operation key=JT373R4HAJZS tag=KAUREK5Q3TWE type=write size=78455 2024-09-12T17:43:39.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.753+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~PMUS685GZR8C.0 size=139464 2024-09-12T17:43:39.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.753+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=PMUS685GZR8C tag=KVNG30J2QYCZ type=write size=1188040 2024-09-12T17:43:39.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.757+0000 7f51d61a08c0 1 < suggested remove operation key=SSOA6J297L1C tag=E35VZR44Z35Y type=del 2024-09-12T17:43:39.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.761+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=ANTLFYWQULGG type=write size=206405 2024-09-12T17:43:39.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.765+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=EZIDAH5QLT21 type=del 2024-09-12T17:43:39.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.769+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=85OUMWIEFH1F type=del size=3736466 2024-09-12T17:43:39.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.777+0000 7f51d61a08c0 1 < suggested update operation key=10WBH16J1AF8 tag=1XANEOYTNWA7 type=del size=3760927 2024-09-12T17:43:39.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.781+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=3WLS240STW3M type=del size=633987 2024-09-12T17:43:39.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.785+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=1NWPZH7AXI29 type=del 2024-09-12T17:43:39.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.789+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=MXYZTWIB961H type=del size=1313658 2024-09-12T17:43:39.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.793+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=3BIV0VMDU948 type=del 2024-09-12T17:43:39.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.797+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=TH0RES8EIURX type=write size=781470 2024-09-12T17:43:39.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.801+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~Z2O94AKE8EET.0 size=1048576 2024-09-12T17:43:39.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.805+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~Z2O94AKE8EET.1 size=1048576 2024-09-12T17:43:39.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.809+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~Z2O94AKE8EET.2 size=87981 2024-09-12T17:43:39.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.817+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=Z2O94AKE8EET tag=ZV01SFWZ5HCC type=write size=3233709 2024-09-12T17:43:39.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.821+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~1NWMPDJ4C7H5.0 size=1048576 2024-09-12T17:43:39.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.825+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~1NWMPDJ4C7H5.1 size=494216 2024-09-12T17:43:39.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.825+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=1NWMPDJ4C7H5 tag=E5LWCYV6XP6R type=write size=2591368 2024-09-12T17:43:39.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.829+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~4VOO40Z3AW9F.0 size=1048576 2024-09-12T17:43:39.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.833+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~4VOO40Z3AW9F.1 size=1048576 2024-09-12T17:43:39.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.833+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~4VOO40Z3AW9F.2 size=468652 2024-09-12T17:43:39.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.841+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=4VOO40Z3AW9F tag=08N1EMFG2EP3 type=write size=3614380 2024-09-12T17:43:39.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.845+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=F364MZ11P17V type=del size=3172275 2024-09-12T17:43:39.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.849+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=D2CFD46AY7QS type=del 2024-09-12T17:43:39.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.857+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~N5MK6K1XQ3GF.0 size=527466 2024-09-12T17:43:39.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.857+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=N5MK6K1XQ3GF tag=OM60EWL80CBC type=write size=1576042 2024-09-12T17:43:39.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.857+0000 7f51d61a08c0 1 < canceled part key=_multipart_10WBH16J1AF8.2~L14OP0FYNW26.0 size=1048576 2024-09-12T17:43:39.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.861+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~L14OP0FYNW26.1 size=382952 2024-09-12T17:43:39.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.869+0000 7f51d61a08c0 1 < canceled multipart upload key=10WBH16J1AF8 upload=L14OP0FYNW26 tag=HMSKAXW3TO0R type=write size=2480104 2024-09-12T17:43:39.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.873+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=79K3O3XT0FAP type=write size=1045268 2024-09-12T17:43:39.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.877+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=3CK08UYB7ADN type=del 2024-09-12T17:43:39.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.881+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=C8TQMJ4P208W type=del size=2973328 2024-09-12T17:43:39.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.885+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~JAL2MWZVRLRN.0 size=1048576 2024-09-12T17:43:39.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.885+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~JAL2MWZVRLRN.1 size=758159 2024-09-12T17:43:39.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.893+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=JAL2MWZVRLRN tag=WYBIHX8MW4LJ type=write size=2855311 2024-09-12T17:43:39.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.897+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=CE6K8XUNZTUD type=del size=2391097 2024-09-12T17:43:39.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.901+0000 7f51d61a08c0 1 < completed write operation key=DCLENF1A1W2Q tag=4F9ZXO2OIBTR type=write size=318340 2024-09-12T17:43:39.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.905+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~YAAN9O00G1XL.0 size=1048576 2024-09-12T17:43:39.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.909+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~YAAN9O00G1XL.1 size=743443 2024-09-12T17:43:39.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.909+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=YAAN9O00G1XL tag=A98L1RCQN509 type=write size=2840595 2024-09-12T17:43:39.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.913+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~3QGV65QR3YE1.0 size=1048576 2024-09-12T17:43:39.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.917+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~3QGV65QR3YE1.1 size=1026202 2024-09-12T17:43:39.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.921+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=3QGV65QR3YE1 tag=2BKAVCZTMI9L type=write size=3123354 2024-09-12T17:43:39.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.925+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=VY7KMJJFIHA2 type=write size=889500 2024-09-12T17:43:39.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.929+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=O3Q60BBGHWGU type=del 2024-09-12T17:43:39.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.937+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~M5CI1TKFZCIA.0 size=1048576 2024-09-12T17:43:39.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.941+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~M5CI1TKFZCIA.1 size=1048576 2024-09-12T17:43:39.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.941+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~M5CI1TKFZCIA.2 size=129913 2024-09-12T17:43:39.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.941+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=M5CI1TKFZCIA tag=3P2X4OMWV7VY type=write size=3275641 2024-09-12T17:43:39.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.949+0000 7f51d61a08c0 1 < suggested update operation key=92CMI8Q29LB3 tag=R1AQ7W835QPY type=write size=460801 2024-09-12T17:43:39.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.957+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~9TV6PQJI05TJ.0 size=1048576 2024-09-12T17:43:39.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.961+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~9TV6PQJI05TJ.1 size=1048576 2024-09-12T17:43:39.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.961+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~9TV6PQJI05TJ.2 size=983140 2024-09-12T17:43:39.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.961+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=9TV6PQJI05TJ tag=GHOTNSBSRFEN type=write size=4128868 2024-09-12T17:43:39.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.965+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~PMUS685GZR8C.0 size=139464 2024-09-12T17:43:39.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.973+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=PMUS685GZR8C tag=KVNG30J2QYCZ type=write size=1188040 2024-09-12T17:43:39.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.977+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=NQT2WKR8HVZ0 type=del size=1586782 2024-09-12T17:43:39.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.981+0000 7f51d61a08c0 1 < completed write operation key=X6KC9Z6LD7VG tag=ANTLFYWQULGG type=write size=206405 2024-09-12T17:43:39.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.985+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=PB52EY4SKSM0 type=write size=386991 2024-09-12T17:43:39.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.989+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=85OUMWIEFH1F type=del 2024-09-12T17:43:39.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.993+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=DJO80OI1WJTJ type=del size=2220259 2024-09-12T17:43:40.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:39.997+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=3WLS240STW3M type=del 2024-09-12T17:43:40.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.001+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=E44E6H8HRVAJ type=del size=2593248 2024-09-12T17:43:40.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.009+0000 7f51d61a08c0 1 < suggested update operation key=EDVAEE9FKH1T tag=MXYZTWIB961H type=del size=1313658 2024-09-12T17:43:40.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.017+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~3EXWTN4A6U48.0 size=1048576 2024-09-12T17:43:40.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.017+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~3EXWTN4A6U48.1 size=1048576 2024-09-12T17:43:40.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.021+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~3EXWTN4A6U48.2 size=836883 2024-09-12T17:43:40.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.021+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=3EXWTN4A6U48 tag=DSFOTZNJ7WJ5 type=write size=3982611 2024-09-12T17:43:40.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.025+0000 7f51d61a08c0 1 < completed write operation key=SSOA6J297L1C tag=TH0RES8EIURX type=write size=781470 2024-09-12T17:43:40.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.029+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=85K4JLXR9G63 type=del size=1551464 2024-09-12T17:43:40.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.033+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~1NWMPDJ4C7H5.0 size=1048576 2024-09-12T17:43:40.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.037+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~1NWMPDJ4C7H5.1 size=494216 2024-09-12T17:43:40.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.045+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=1NWMPDJ4C7H5 tag=E5LWCYV6XP6R type=write size=2591368 2024-09-12T17:43:40.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.049+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=UL2I3M7LVQHJ type=del size=1088948 2024-09-12T17:43:40.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.053+0000 7f51d61a08c0 1 < canceled operation key=A7V478K2SNOF tag=F364MZ11P17V type=del size=3172275 2024-09-12T17:43:40.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.053+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=3BQR22ZX2I7D type=write size=377194 2024-09-12T17:43:40.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.057+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~N5MK6K1XQ3GF.0 size=527466 2024-09-12T17:43:40.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.065+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=N5MK6K1XQ3GF tag=OM60EWL80CBC type=write size=1576042 2024-09-12T17:43:40.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.065+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=HEYHI3NJ3GTH type=write size=806022 2024-09-12T17:43:40.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.069+0000 7f51d61a08c0 1 < completed write operation key=1ZETSL5TXYSM tag=79K3O3XT0FAP type=write size=1045268 2024-09-12T17:43:40.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.073+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=BH5GW3B1DWDP type=del size=109089 2024-09-12T17:43:40.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.081+0000 7f51d61a08c0 1 < suggested remove operation key=X6KC9Z6LD7VG tag=C8TQMJ4P208W type=del 2024-09-12T17:43:40.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.085+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=NJ9N20JQIQ1B type=del size=3477546 2024-09-12T17:43:40.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.089+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=CE6K8XUNZTUD type=del 2024-09-12T17:43:40.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.093+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~LW11MJCKCZ0L.0 size=1048576 2024-09-12T17:43:40.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.097+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~LW11MJCKCZ0L.1 size=148449 2024-09-12T17:43:40.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.097+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=LW11MJCKCZ0L tag=Q4MZRT86BZPH type=write size=2245601 2024-09-12T17:43:40.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.101+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~YAAN9O00G1XL.0 size=1048576 2024-09-12T17:43:40.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.105+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~YAAN9O00G1XL.1 size=743443 2024-09-12T17:43:40.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.109+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=YAAN9O00G1XL tag=A98L1RCQN509 type=write size=2840595 2024-09-12T17:43:40.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.125+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=FWXRWGF3288W type=del size=1387555 2024-09-12T17:43:40.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.133+0000 7f51d61a08c0 1 < suggested remove operation key=10WBH16J1AF8 tag=VY7KMJJFIHA2 type=write 2024-09-12T17:43:40.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.137+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=PR4OMZI4WG9B type=write size=59935 2024-09-12T17:43:40.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.141+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~M5CI1TKFZCIA.0 size=1048576 2024-09-12T17:43:40.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.141+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~M5CI1TKFZCIA.1 size=1048576 2024-09-12T17:43:40.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.145+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~M5CI1TKFZCIA.2 size=129913 2024-09-12T17:43:40.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.153+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=M5CI1TKFZCIA tag=3P2X4OMWV7VY type=write size=3275641 2024-09-12T17:43:40.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.157+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=K14XM24N1UIQ type=del size=2858977 2024-09-12T17:43:40.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.161+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~9TV6PQJI05TJ.0 size=1048576 2024-09-12T17:43:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.161+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~9TV6PQJI05TJ.1 size=1048576 2024-09-12T17:43:40.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.165+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~9TV6PQJI05TJ.2 size=983140 2024-09-12T17:43:40.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.169+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=9TV6PQJI05TJ tag=GHOTNSBSRFEN type=write size=4128868 2024-09-12T17:43:40.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.173+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=7FX9EXQON31B type=del size=1630786 2024-09-12T17:43:40.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.177+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=NQT2WKR8HVZ0 type=del 2024-09-12T17:43:40.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.181+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=2RZ1J94H5TYL type=del size=149118 2024-09-12T17:43:40.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.185+0000 7f51d61a08c0 1 < completed write operation key=26X723PN8K8T tag=PB52EY4SKSM0 type=write size=386991 2024-09-12T17:43:40.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.189+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=0C5QM8AQ4MPE type=del size=241076 2024-09-12T17:43:40.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.197+0000 7f51d61a08c0 1 < suggested update operation key=IWEJXLG1CDAV tag=DJO80OI1WJTJ type=del size=2220259 2024-09-12T17:43:40.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.205+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~5ZF768QVMF82.0 size=1048576 2024-09-12T17:43:40.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.209+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~5ZF768QVMF82.1 size=1048576 2024-09-12T17:43:40.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.213+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~5ZF768QVMF82.2 size=989860 2024-09-12T17:43:40.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.213+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=5ZF768QVMF82 tag=TTI3WCRZ20P2 type=write size=4135588 2024-09-12T17:43:40.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.217+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=E44E6H8HRVAJ type=del 2024-09-12T17:43:40.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.221+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~K1G1ZVBXZ6IH.0 size=1048576 2024-09-12T17:43:40.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.225+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~K1G1ZVBXZ6IH.1 size=102049 2024-09-12T17:43:40.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.225+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=K1G1ZVBXZ6IH tag=3IG0OSWQIC73 type=write size=2199201 2024-09-12T17:43:40.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.229+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~3EXWTN4A6U48.0 size=1048576 2024-09-12T17:43:40.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.229+0000 7f51d61a08c0 1 < canceled part key=_multipart_HUWVRJIZ5JYE.2~3EXWTN4A6U48.1 size=1048576 2024-09-12T17:43:40.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.233+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~3EXWTN4A6U48.2 size=836883 2024-09-12T17:43:40.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.237+0000 7f51d61a08c0 1 < canceled multipart upload key=HUWVRJIZ5JYE upload=3EXWTN4A6U48 tag=DSFOTZNJ7WJ5 type=write size=3982611 2024-09-12T17:43:40.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.241+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=RLT8TODN8IE4 type=del size=3491840 2024-09-12T17:43:40.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.245+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=85K4JLXR9G63 type=del 2024-09-12T17:43:40.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.249+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=I6QA3JBMM8N6 type=write size=503421 2024-09-12T17:43:40.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.253+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=UL2I3M7LVQHJ type=del 2024-09-12T17:43:40.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.257+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=4T31EC0JBZNV type=write size=38631 2024-09-12T17:43:40.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.261+0000 7f51d61a08c0 1 < completed write operation key=HUWVRJIZ5JYE tag=3BQR22ZX2I7D type=write size=377194 2024-09-12T17:43:40.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.269+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~2WO7LFNEZ3WY.0 size=1048576 2024-09-12T17:43:40.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.269+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~2WO7LFNEZ3WY.1 size=319961 2024-09-12T17:43:40.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.269+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=2WO7LFNEZ3WY tag=LJ43ISQIPF3A type=write size=2417113 2024-09-12T17:43:40.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.273+0000 7f51d61a08c0 1 < completed write operation key=DCLENF1A1W2Q tag=HEYHI3NJ3GTH type=write size=806022 2024-09-12T17:43:40.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.277+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=0AU9DNYY8ZN1 type=del size=869878 2024-09-12T17:43:40.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.281+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=BH5GW3B1DWDP type=del 2024-09-12T17:43:40.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.289+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~5KT3XK70O23S.0 size=1048576 2024-09-12T17:43:40.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.293+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~5KT3XK70O23S.1 size=288960 2024-09-12T17:43:40.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.293+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=5KT3XK70O23S tag=LLIC7SSH3089 type=write size=2386112 2024-09-12T17:43:40.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.297+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=NJ9N20JQIQ1B type=del 2024-09-12T17:43:40.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.301+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=XOXXM317N8LF type=del size=1326291 2024-09-12T17:43:40.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.305+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~LW11MJCKCZ0L.0 size=1048576 2024-09-12T17:43:40.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.305+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~LW11MJCKCZ0L.1 size=148449 2024-09-12T17:43:40.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.313+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=LW11MJCKCZ0L tag=Q4MZRT86BZPH type=write size=2245601 2024-09-12T17:43:40.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.321+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~9MP9A52HRF7L.0 size=1048576 2024-09-12T17:43:40.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.321+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~9MP9A52HRF7L.1 size=567440 2024-09-12T17:43:40.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.321+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=9MP9A52HRF7L tag=FHH4PAPR2LGQ type=write size=2664592 2024-09-12T17:43:40.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.325+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=FWXRWGF3288W type=del 2024-09-12T17:43:40.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.333+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~JSD1XX58RVAI.0 size=1048576 2024-09-12T17:43:40.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.337+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~JSD1XX58RVAI.1 size=1048576 2024-09-12T17:43:40.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.337+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~JSD1XX58RVAI.2 size=246570 2024-09-12T17:43:40.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.337+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=JSD1XX58RVAI tag=KBZMQN8Z5JYW type=write size=3392298 2024-09-12T17:43:40.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.345+0000 7f51d61a08c0 1 < completed write operation key=HUWVRJIZ5JYE tag=PR4OMZI4WG9B type=write size=59935 2024-09-12T17:43:40.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.349+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~Q2EGZA0MGGOU.0 size=430892 2024-09-12T17:43:40.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.349+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=Q2EGZA0MGGOU tag=108G0OQ8BP9A type=write size=1479468 2024-09-12T17:43:40.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.353+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=K14XM24N1UIQ type=del 2024-09-12T17:43:40.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.361+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~S83U6H5AHEQG.0 size=1048576 2024-09-12T17:43:40.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.365+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~S83U6H5AHEQG.1 size=500790 2024-09-12T17:43:40.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.365+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=S83U6H5AHEQG tag=3XNHTKSLG92L type=write size=2597942 2024-09-12T17:43:40.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.369+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=7FX9EXQON31B type=del 2024-09-12T17:43:40.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.373+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=DDCTVCNO70V8 type=write size=82312 2024-09-12T17:43:40.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.381+0000 7f51d61a08c0 1 < suggested update operation key=BF36J1Q6CZFB tag=2RZ1J94H5TYL type=del size=149118 2024-09-12T17:43:40.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.389+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~F61C99I1UVQM.0 size=861612 2024-09-12T17:43:40.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.389+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=F61C99I1UVQM tag=8H03NG2R6ZA2 type=write size=1910188 2024-09-12T17:43:40.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.393+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=0C5QM8AQ4MPE type=del 2024-09-12T17:43:40.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.397+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=CMPBSUN3YY4J type=write size=318397 2024-09-12T17:43:40.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.401+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~5ZF768QVMF82.0 size=1048576 2024-09-12T17:43:40.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.409+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~5ZF768QVMF82.1 size=1048576 2024-09-12T17:43:40.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.409+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~5ZF768QVMF82.2 size=989860 2024-09-12T17:43:40.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.417+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=5ZF768QVMF82 tag=TTI3WCRZ20P2 type=write size=4135588 2024-09-12T17:43:40.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.421+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=VYGYJQQM3F1I type=write size=685823 2024-09-12T17:43:40.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.425+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~K1G1ZVBXZ6IH.0 size=1048576 2024-09-12T17:43:40.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.429+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~K1G1ZVBXZ6IH.1 size=102049 2024-09-12T17:43:40.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.433+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=K1G1ZVBXZ6IH tag=3IG0OSWQIC73 type=write size=2199201 2024-09-12T17:43:40.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.437+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=359QMGABICBI type=del size=2470587 2024-09-12T17:43:40.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.441+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=RLT8TODN8IE4 type=del 2024-09-12T17:43:40.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.445+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=O6I81U25Z4T3 type=write size=742923 2024-09-12T17:43:40.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.453+0000 7f51d61a08c0 1 < suggested update operation key=JT373R4HAJZS tag=I6QA3JBMM8N6 type=write size=503421 2024-09-12T17:43:40.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.457+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=XEM0D2XNU59U type=del size=3889517 2024-09-12T17:43:40.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.465+0000 7f51d61a08c0 1 < suggested remove operation key=SSOA6J297L1C tag=4T31EC0JBZNV type=write 2024-09-12T17:43:40.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.473+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~NLN4MRFZIJDN.0 size=1048576 2024-09-12T17:43:40.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.477+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~NLN4MRFZIJDN.1 size=1048576 2024-09-12T17:43:40.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.481+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~NLN4MRFZIJDN.2 size=371777 2024-09-12T17:43:40.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.481+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=NLN4MRFZIJDN tag=7AU71EE7EAWN type=write size=3517505 2024-09-12T17:43:40.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.485+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~2WO7LFNEZ3WY.0 size=1048576 2024-09-12T17:43:40.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.485+0000 7f51d61a08c0 1 < canceled part key=_multipart_2WC0YDQFKAJD.2~2WO7LFNEZ3WY.1 size=319961 2024-09-12T17:43:40.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.489+0000 7f51d61a08c0 1 < canceled multipart upload key=2WC0YDQFKAJD upload=2WO7LFNEZ3WY tag=LJ43ISQIPF3A type=write size=2417113 2024-09-12T17:43:40.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.497+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~Y8AJJKCGQJIH.0 size=1048576 2024-09-12T17:43:40.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.501+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~Y8AJJKCGQJIH.1 size=817175 2024-09-12T17:43:40.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.501+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=Y8AJJKCGQJIH tag=KX5QSGJWQVEL type=write size=2914327 2024-09-12T17:43:40.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.509+0000 7f51d61a08c0 1 < suggested update operation key=DCLENF1A1W2Q tag=0AU9DNYY8ZN1 type=del size=869878 2024-09-12T17:43:40.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.517+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~HR2Z853JHBYN.0 size=655487 2024-09-12T17:43:40.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.517+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=HR2Z853JHBYN tag=HS175ZYRUMON type=write size=1704063 2024-09-12T17:43:40.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.517+0000 7f51d61a08c0 1 < canceled part key=_multipart_FKKV7SXZSP90.2~5KT3XK70O23S.0 size=1048576 2024-09-12T17:43:40.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.521+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~5KT3XK70O23S.1 size=288960 2024-09-12T17:43:40.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.529+0000 7f51d61a08c0 1 < canceled multipart upload key=FKKV7SXZSP90 upload=5KT3XK70O23S tag=LLIC7SSH3089 type=write size=2386112 2024-09-12T17:43:40.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.533+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~M1LPQTGRJQDD.0 size=1048576 2024-09-12T17:43:40.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.537+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~M1LPQTGRJQDD.1 size=4287 2024-09-12T17:43:40.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.537+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=M1LPQTGRJQDD tag=OQ32Z9R5Y0VL type=write size=2101439 2024-09-12T17:43:40.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.545+0000 7f51d61a08c0 1 < suggested remove operation key=96OWZQXI2ALM tag=XOXXM317N8LF type=del 2024-09-12T17:43:40.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.553+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~E9RPWA69LYR0.0 size=1048576 2024-09-12T17:43:40.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.557+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~E9RPWA69LYR0.1 size=1048576 2024-09-12T17:43:40.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.561+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~E9RPWA69LYR0.2 size=303895 2024-09-12T17:43:40.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.561+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=E9RPWA69LYR0 tag=V8B2MIHDUFIR type=write size=3449623 2024-09-12T17:43:40.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.565+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~9MP9A52HRF7L.0 size=1048576 2024-09-12T17:43:40.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.565+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~9MP9A52HRF7L.1 size=567440 2024-09-12T17:43:40.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.573+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=9MP9A52HRF7L tag=FHH4PAPR2LGQ type=write size=2664592 2024-09-12T17:43:40.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.577+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=3E602K41LGZ3 type=del size=2346366 2024-09-12T17:43:40.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.581+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~JSD1XX58RVAI.0 size=1048576 2024-09-12T17:43:40.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.585+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~JSD1XX58RVAI.1 size=1048576 2024-09-12T17:43:40.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.585+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~JSD1XX58RVAI.2 size=246570 2024-09-12T17:43:40.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.593+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=JSD1XX58RVAI tag=KBZMQN8Z5JYW type=write size=3392298 2024-09-12T17:43:40.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.601+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~8M11DGLTYB95.0 size=90881 2024-09-12T17:43:40.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.601+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=8M11DGLTYB95 tag=34GO4AN5O4BQ type=write size=1139457 2024-09-12T17:43:40.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.601+0000 7f51d61a08c0 1 < canceled part key=_multipart_2WC0YDQFKAJD.2~Q2EGZA0MGGOU.0 size=430892 2024-09-12T17:43:40.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.605+0000 7f51d61a08c0 1 < canceled multipart upload key=2WC0YDQFKAJD upload=Q2EGZA0MGGOU tag=108G0OQ8BP9A type=write size=1479468 2024-09-12T17:43:40.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.609+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=IKABN6X8DV5G type=del size=1180123 2024-09-12T17:43:40.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.613+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~S83U6H5AHEQG.0 size=1048576 2024-09-12T17:43:40.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.617+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~S83U6H5AHEQG.1 size=500790 2024-09-12T17:43:40.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.625+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=S83U6H5AHEQG tag=3XNHTKSLG92L type=write size=2597942 2024-09-12T17:43:40.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.629+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=K0T0HA05ZLIZ type=del size=745181 2024-09-12T17:43:40.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.637+0000 7f51d61a08c0 1 < suggested update operation key=8J72KCZ5WRPU tag=DDCTVCNO70V8 type=write size=82312 2024-09-12T17:43:40.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.641+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=B6MDNQVOW2HV type=del size=2476919 2024-09-12T17:43:40.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.645+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~F61C99I1UVQM.0 size=861612 2024-09-12T17:43:40.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.649+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=F61C99I1UVQM tag=8H03NG2R6ZA2 type=write size=1910188 2024-09-12T17:43:40.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.657+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~7QFEF39K5PTU.0 size=1048576 2024-09-12T17:43:40.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.661+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~7QFEF39K5PTU.1 size=1048576 2024-09-12T17:43:40.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.665+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~7QFEF39K5PTU.2 size=113699 2024-09-12T17:43:40.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.665+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=7QFEF39K5PTU tag=7HWUMMPF1366 type=write size=3259427 2024-09-12T17:43:40.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.669+0000 7f51d61a08c0 1 < completed write operation key=593CD3H40DFH tag=CMPBSUN3YY4J type=write size=318397 2024-09-12T17:43:40.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.673+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~YVKUHXDEMZFH.0 size=492534 2024-09-12T17:43:40.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.673+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=YVKUHXDEMZFH tag=6O4GZY0D2OWV type=write size=1541110 2024-09-12T17:43:40.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.677+0000 7f51d61a08c0 1 < completed write operation key=BF36J1Q6CZFB tag=VYGYJQQM3F1I type=write size=685823 2024-09-12T17:43:40.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.681+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=XNKBZG4X3H09 type=del size=996939 2024-09-12T17:43:40.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.685+0000 7f51d61a08c0 1 < canceled operation key=10WBH16J1AF8 tag=359QMGABICBI type=del size=2470587 2024-09-12T17:43:40.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.693+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~T2OW30Q6P8ID.0 size=1048576 2024-09-12T17:43:40.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~T2OW30Q6P8ID.1 size=1048576 2024-09-12T17:43:40.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~T2OW30Q6P8ID.2 size=378130 2024-09-12T17:43:40.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.697+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=T2OW30Q6P8ID tag=AQ4H8GNBA1CP type=write size=3523858 2024-09-12T17:43:40.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.701+0000 7f51d61a08c0 1 < completed write operation key=EDVAEE9FKH1T tag=O6I81U25Z4T3 type=write size=742923 2024-09-12T17:43:40.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.709+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~5VIFZCE3QHDJ.0 size=1048576 2024-09-12T17:43:40.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.713+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~5VIFZCE3QHDJ.1 size=700963 2024-09-12T17:43:40.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.713+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=5VIFZCE3QHDJ tag=UU9LX1YTY4BC type=write size=2798115 2024-09-12T17:43:40.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.717+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=XEM0D2XNU59U type=del 2024-09-12T17:43:40.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.721+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=G9U5CO9SEFXL type=del size=2973578 2024-09-12T17:43:40.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.725+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~NLN4MRFZIJDN.0 size=1048576 2024-09-12T17:43:40.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.725+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~NLN4MRFZIJDN.1 size=1048576 2024-09-12T17:43:40.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.729+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~NLN4MRFZIJDN.2 size=371777 2024-09-12T17:43:40.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.737+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=NLN4MRFZIJDN tag=7AU71EE7EAWN type=write size=3517505 2024-09-12T17:43:40.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.741+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=1962QPU03E4Y type=del size=3056246 2024-09-12T17:43:40.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.745+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~Y8AJJKCGQJIH.0 size=1048576 2024-09-12T17:43:40.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.745+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~Y8AJJKCGQJIH.1 size=817175 2024-09-12T17:43:40.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.753+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=Y8AJJKCGQJIH tag=KX5QSGJWQVEL type=write size=2914327 2024-09-12T17:43:40.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.757+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=YHMSRROQQGN9 type=del size=2344523 2024-09-12T17:43:40.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.761+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~HR2Z853JHBYN.0 size=655487 2024-09-12T17:43:40.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.769+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=HR2Z853JHBYN tag=HS175ZYRUMON type=write size=1704063 2024-09-12T17:43:40.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.777+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~0BR6NLVPI03H.0 size=1048576 2024-09-12T17:43:40.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.777+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~0BR6NLVPI03H.1 size=673157 2024-09-12T17:43:40.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.777+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=0BR6NLVPI03H tag=1HLKPYQE0SZS type=write size=2770309 2024-09-12T17:43:40.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.781+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~M1LPQTGRJQDD.0 size=1048576 2024-09-12T17:43:40.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.785+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~M1LPQTGRJQDD.1 size=4287 2024-09-12T17:43:40.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.793+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=M1LPQTGRJQDD tag=OQ32Z9R5Y0VL type=write size=2101439 2024-09-12T17:43:40.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.801+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~PDP1CL0Z83SF.0 size=1048576 2024-09-12T17:43:40.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.801+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~PDP1CL0Z83SF.1 size=600161 2024-09-12T17:43:40.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.801+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=PDP1CL0Z83SF tag=2VJUJ0ZJ0VQI type=write size=2697313 2024-09-12T17:43:40.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.809+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~E9RPWA69LYR0.0 size=1048576 2024-09-12T17:43:40.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.809+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~E9RPWA69LYR0.1 size=1048576 2024-09-12T17:43:40.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.813+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~E9RPWA69LYR0.2 size=303895 2024-09-12T17:43:40.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.821+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=E9RPWA69LYR0 tag=V8B2MIHDUFIR type=write size=3449623 2024-09-12T17:43:40.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.829+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~66T15RC41MD7.0 size=85231 2024-09-12T17:43:40.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.829+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=66T15RC41MD7 tag=01J3DYODI1YE type=write size=1133807 2024-09-12T17:43:40.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.833+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=3E602K41LGZ3 type=del 2024-09-12T17:43:40.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.837+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=F25TVYCH24B4 type=del size=805566 2024-09-12T17:43:40.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.841+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~8M11DGLTYB95.0 size=90881 2024-09-12T17:43:40.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.849+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=8M11DGLTYB95 tag=34GO4AN5O4BQ type=write size=1139457 2024-09-12T17:43:40.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.853+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=XN2TJ095V4ZR type=write size=867190 2024-09-12T17:43:40.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.861+0000 7f51d61a08c0 1 < suggested update operation key=XL9QDBTYSP7F tag=IKABN6X8DV5G type=del size=1180123 2024-09-12T17:43:40.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.865+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=NAGELM1ROT3G type=write size=830497 2024-09-12T17:43:40.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.869+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=K0T0HA05ZLIZ type=del 2024-09-12T17:43:40.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.873+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=VSQDY0BGBVO9 type=write size=532105 2024-09-12T17:43:40.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.881+0000 7f51d61a08c0 1 < canceled operation key=26X723PN8K8T tag=B6MDNQVOW2HV type=del size=2476919 2024-09-12T17:43:40.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.885+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=YBYFMFWC4ZZX type=del size=3137450 2024-09-12T17:43:40.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.889+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~7QFEF39K5PTU.0 size=1048576 2024-09-12T17:43:40.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.889+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~7QFEF39K5PTU.1 size=1048576 2024-09-12T17:43:40.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.893+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~7QFEF39K5PTU.2 size=113699 2024-09-12T17:43:40.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.901+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=7QFEF39K5PTU tag=7HWUMMPF1366 type=write size=3259427 2024-09-12T17:43:40.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.905+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=UENJQZXBDERW type=del size=1358810 2024-09-12T17:43:40.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.909+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~YVKUHXDEMZFH.0 size=492534 2024-09-12T17:43:40.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.917+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=YVKUHXDEMZFH tag=6O4GZY0D2OWV type=write size=1541110 2024-09-12T17:43:40.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.921+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=ZVC52TSF7R2Q type=write size=6791 2024-09-12T17:43:40.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.929+0000 7f51d61a08c0 1 < suggested update operation key=DCLENF1A1W2Q tag=XNKBZG4X3H09 type=del size=996939 2024-09-12T17:43:40.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.937+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~OCEMURYV0J2L.0 size=607561 2024-09-12T17:43:40.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.937+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=OCEMURYV0J2L tag=3Z5CQSLSLQ15 type=write size=1656137 2024-09-12T17:43:40.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.941+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~T2OW30Q6P8ID.0 size=1048576 2024-09-12T17:43:40.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.945+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~T2OW30Q6P8ID.1 size=1048576 2024-09-12T17:43:40.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.945+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~T2OW30Q6P8ID.2 size=378130 2024-09-12T17:43:40.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.953+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=T2OW30Q6P8ID tag=AQ4H8GNBA1CP type=write size=3523858 2024-09-12T17:43:40.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.957+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=B1BSC6B0ODO6 type=del size=1260226 2024-09-12T17:43:40.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.961+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~5VIFZCE3QHDJ.0 size=1048576 2024-09-12T17:43:40.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.961+0000 7f51d61a08c0 1 < canceled part key=_multipart_FKKV7SXZSP90.2~5VIFZCE3QHDJ.1 size=700963 2024-09-12T17:43:40.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.969+0000 7f51d61a08c0 1 < canceled multipart upload key=FKKV7SXZSP90 upload=5VIFZCE3QHDJ tag=UU9LX1YTY4BC type=write size=2798115 2024-09-12T17:43:40.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.973+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=3O2D6GEDV40M type=write size=791022 2024-09-12T17:43:40.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.977+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=G9U5CO9SEFXL type=del 2024-09-12T17:43:40.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.981+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=H47IM2IJ50DT type=write size=335738 2024-09-12T17:43:40.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.985+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=1962QPU03E4Y type=del 2024-09-12T17:43:40.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.989+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=FDNNEHC6H0ID type=del size=1963688 2024-09-12T17:43:40.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.993+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=YHMSRROQQGN9 type=del 2024-09-12T17:43:40.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:40.997+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=WCKKGX6QGTH0 type=del size=3667751 2024-09-12T17:43:41.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.001+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~0BR6NLVPI03H.0 size=1048576 2024-09-12T17:43:41.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.001+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~0BR6NLVPI03H.1 size=673157 2024-09-12T17:43:41.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.009+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=0BR6NLVPI03H tag=1HLKPYQE0SZS type=write size=2770309 2024-09-12T17:43:41.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.013+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=HQ147N2L4R7M type=del size=1907886 2024-09-12T17:43:41.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.017+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~PDP1CL0Z83SF.0 size=1048576 2024-09-12T17:43:41.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.021+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~PDP1CL0Z83SF.1 size=600161 2024-09-12T17:43:41.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.025+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=PDP1CL0Z83SF tag=2VJUJ0ZJ0VQI type=write size=2697313 2024-09-12T17:43:41.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.029+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=9OH35ER4364A type=write size=227613 2024-09-12T17:43:41.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.037+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~66T15RC41MD7.0 size=85231 2024-09-12T17:43:41.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.041+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=66T15RC41MD7 tag=01J3DYODI1YE type=write size=1133807 2024-09-12T17:43:41.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.045+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=TQTRLDAUFHSE type=del size=1048293 2024-09-12T17:43:41.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.049+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=F25TVYCH24B4 type=del 2024-09-12T17:43:41.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.057+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~GJ76JSE31GFQ.0 size=1048576 2024-09-12T17:43:41.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.061+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~GJ76JSE31GFQ.1 size=1048576 2024-09-12T17:43:41.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.065+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~GJ76JSE31GFQ.2 size=420299 2024-09-12T17:43:41.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.065+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=GJ76JSE31GFQ tag=CS3D4I441UMV type=write size=3566027 2024-09-12T17:43:41.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.069+0000 7f51d61a08c0 1 < completed write operation key=EDVAEE9FKH1T tag=XN2TJ095V4ZR type=write size=867190 2024-09-12T17:43:41.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.073+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=SKC0BM16AXQU type=del size=2070535 2024-09-12T17:43:41.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.077+0000 7f51d61a08c0 1 < completed write operation key=7FBK3439R80H tag=NAGELM1ROT3G type=write size=830497 2024-09-12T17:43:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.081+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=9F3RHSHL7T7N type=del size=112966 2024-09-12T17:43:41.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.085+0000 7f51d61a08c0 1 < completed write operation key=IWEJXLG1CDAV tag=VSQDY0BGBVO9 type=write size=532105 2024-09-12T17:43:41.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.093+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~6S9NAA91DSKW.0 size=981785 2024-09-12T17:43:41.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.093+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=6S9NAA91DSKW tag=REIE9KFUF2Z8 type=write size=2030361 2024-09-12T17:43:41.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.097+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=YBYFMFWC4ZZX type=del 2024-09-12T17:43:41.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.101+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=NC53G2EJGBJ7 type=del size=1340175 2024-09-12T17:43:41.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.105+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=UENJQZXBDERW type=del 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.109+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~VBKR68F9CWVS.0 size=214334 2024-09-12T17:43:41.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.109+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=VBKR68F9CWVS tag=ACX03RGR8WGB type=write size=1262910 2024-09-12T17:43:41.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.117+0000 7f51d61a08c0 1 < completed write operation key=8J72KCZ5WRPU tag=ZVC52TSF7R2Q type=write size=6791 2024-09-12T17:43:41.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.121+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=70OKQ4WHE6JR type=del size=2978506 2024-09-12T17:43:41.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.125+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~OCEMURYV0J2L.0 size=607561 2024-09-12T17:43:41.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.129+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=OCEMURYV0J2L tag=3Z5CQSLSLQ15 type=write size=1656137 2024-09-12T17:43:41.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.133+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=BLV7R2GVJIKG type=write size=109565 2024-09-12T17:43:41.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.145+0000 7f51d61a08c0 1 < suggested update operation key=DCLENF1A1W2Q tag=B1BSC6B0ODO6 type=del size=1260226 2024-09-12T17:43:41.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.149+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=BSK8BND951XQ type=del size=3280227 2024-09-12T17:43:41.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.149+0000 7f51d61a08c0 1 < completed write operation key=593CD3H40DFH tag=3O2D6GEDV40M type=write size=791022 2024-09-12T17:43:41.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.153+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=U32R4ZQ4PI5P type=del size=1498429 2024-09-12T17:43:41.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.157+0000 7f51d61a08c0 1 < completed write operation key=FKKV7SXZSP90 tag=H47IM2IJ50DT type=write size=335738 2024-09-12T17:43:41.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.161+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=WKEGT3SR0XV1 type=del size=1590712 2024-09-12T17:43:41.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.165+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=FDNNEHC6H0ID type=del 2024-09-12T17:43:41.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.169+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=U495O7HR12FP type=del size=3389283 2024-09-12T17:43:41.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.173+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=WCKKGX6QGTH0 type=del 2024-09-12T17:43:41.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.177+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=8EQ35MVW0W4E type=del size=2830906 2024-09-12T17:43:41.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.181+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=HQ147N2L4R7M type=del 2024-09-12T17:43:41.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.189+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~O392GZVQMW0E.0 size=1048576 2024-09-12T17:43:41.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.193+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~O392GZVQMW0E.1 size=1048576 2024-09-12T17:43:41.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.193+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~O392GZVQMW0E.2 size=312173 2024-09-12T17:43:41.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.193+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=O392GZVQMW0E tag=801OLFANGLCP type=write size=3457901 2024-09-12T17:43:41.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.197+0000 7f51d61a08c0 1 < canceled operation key=JT373R4HAJZS tag=9OH35ER4364A type=write size=227613 2024-09-12T17:43:41.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.201+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=UJBM5FTYGZ74 type=write size=454153 2024-09-12T17:43:41.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.213+0000 7f51d61a08c0 1 < suggested remove operation key=X6KC9Z6LD7VG tag=TQTRLDAUFHSE type=del 2024-09-12T17:43:41.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.217+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~5JGBXVUJ333H.0 size=1048576 2024-09-12T17:43:41.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.221+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~5JGBXVUJ333H.1 size=1048576 2024-09-12T17:43:41.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.225+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~5JGBXVUJ333H.2 size=431080 2024-09-12T17:43:41.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.225+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=5JGBXVUJ333H tag=6VX8L0OET8WS type=write size=3576808 2024-09-12T17:43:41.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.229+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~GJ76JSE31GFQ.0 size=1048576 2024-09-12T17:43:41.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.229+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~GJ76JSE31GFQ.1 size=1048576 2024-09-12T17:43:41.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.233+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~GJ76JSE31GFQ.2 size=420299 2024-09-12T17:43:41.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.241+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=GJ76JSE31GFQ tag=CS3D4I441UMV type=write size=3566027 2024-09-12T17:43:41.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.245+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=5KLETBB0549W type=del size=291777 2024-09-12T17:43:41.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.249+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=SKC0BM16AXQU type=del 2024-09-12T17:43:41.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.257+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~BZ3KUL414XY9.0 size=1048576 2024-09-12T17:43:41.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.257+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~BZ3KUL414XY9.1 size=1048576 2024-09-12T17:43:41.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.261+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~BZ3KUL414XY9.2 size=139034 2024-09-12T17:43:41.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.261+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=BZ3KUL414XY9 tag=4LVM3N580FQ7 type=write size=3284762 2024-09-12T17:43:41.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.265+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=9F3RHSHL7T7N type=del 2024-09-12T17:43:41.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.269+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=FOH2142OBNPM type=del size=3782108 2024-09-12T17:43:41.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.273+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~6S9NAA91DSKW.0 size=981785 2024-09-12T17:43:41.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.281+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=6S9NAA91DSKW tag=REIE9KFUF2Z8 type=write size=2030361 2024-09-12T17:43:41.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.285+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=E23GOLV4VM2H type=del size=3367439 2024-09-12T17:43:41.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.285+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=NC53G2EJGBJ7 type=del 2024-09-12T17:43:41.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.293+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=RW425T3AQWO1 type=del size=3271686 2024-09-12T17:43:41.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.297+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~VBKR68F9CWVS.0 size=214334 2024-09-12T17:43:41.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.301+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=VBKR68F9CWVS tag=ACX03RGR8WGB type=write size=1262910 2024-09-12T17:43:41.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.305+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=7TVG3FSWUEQT type=del size=2483968 2024-09-12T17:43:41.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.309+0000 7f51d61a08c0 1 < canceled operation key=3LE20KMMPH8P tag=70OKQ4WHE6JR type=del size=2978506 2024-09-12T17:43:41.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.313+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=0LPL0BANRHWC type=del size=3960458 2024-09-12T17:43:41.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.317+0000 7f51d61a08c0 -1 < failed to complete operation key=DCLENF1A1W2Q tag=BLV7R2GVJIKG type=write size=109565: (22) Invalid argument 2024-09-12T17:43:41.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.321+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=PNO292FYULB1 type=del size=4151994 2024-09-12T17:43:41.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.325+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=BSK8BND951XQ type=del 2024-09-12T17:43:41.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.329+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=YBRHRNKQ3TVY type=del size=2445971 2024-09-12T17:43:41.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.337+0000 7f51d61a08c0 1 < suggested update operation key=I22NJJISU96B tag=U32R4ZQ4PI5P type=del size=1498429 2024-09-12T17:43:41.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.341+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=0G8AKQ1IPTT1 type=del size=1679917 2024-09-12T17:43:41.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.345+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=WKEGT3SR0XV1 type=del 2024-09-12T17:43:41.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.349+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=FNSKWGPF2EH0 type=del size=2959969 2024-09-12T17:43:41.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.353+0000 7f51d61a08c0 -1 < failed to complete operation key=I22NJJISU96B tag=U495O7HR12FP type=del size=3389283: (22) Invalid argument 2024-09-12T17:43:41.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.357+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=VCQNZAIMXDJB type=del size=680371 2024-09-12T17:43:41.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.361+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=8EQ35MVW0W4E type=del 2024-09-12T17:43:41.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.365+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=9ABBY38T13BK type=del size=2568238 2024-09-12T17:43:41.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.369+0000 7f51d61a08c0 1 < canceled part key=_multipart_JT373R4HAJZS.2~O392GZVQMW0E.0 size=1048576 2024-09-12T17:43:41.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.369+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~O392GZVQMW0E.1 size=1048576 2024-09-12T17:43:41.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.373+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~O392GZVQMW0E.2 size=312173 2024-09-12T17:43:41.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.381+0000 7f51d61a08c0 1 < canceled multipart upload key=JT373R4HAJZS upload=O392GZVQMW0E tag=801OLFANGLCP type=write size=3457901 2024-09-12T17:43:41.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.389+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~11WONVVJQ11N.0 size=1048576 2024-09-12T17:43:41.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.389+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~11WONVVJQ11N.1 size=586821 2024-09-12T17:43:41.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.389+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=11WONVVJQ11N tag=LL4V8ZH2P2QF type=write size=2683973 2024-09-12T17:43:41.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.393+0000 7f51d61a08c0 1 < completed write operation key=7FBK3439R80H tag=UJBM5FTYGZ74 type=write size=454153 2024-09-12T17:43:41.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.397+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=M4FZRZ86B8Y7 type=del size=3660833 2024-09-12T17:43:41.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.401+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~5JGBXVUJ333H.0 size=1048576 2024-09-12T17:43:41.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.405+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~5JGBXVUJ333H.1 size=1048576 2024-09-12T17:43:41.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.409+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~5JGBXVUJ333H.2 size=431080 2024-09-12T17:43:41.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.417+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=5JGBXVUJ333H tag=6VX8L0OET8WS type=write size=3576808 2024-09-12T17:43:41.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.421+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~Q25U4AOU5OFV.0 size=1048576 2024-09-12T17:43:41.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.425+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~Q25U4AOU5OFV.1 size=1048576 2024-09-12T17:43:41.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.429+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~Q25U4AOU5OFV.2 size=959787 2024-09-12T17:43:41.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.429+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=Q25U4AOU5OFV tag=H2OMSX96WFGB type=write size=4105515 2024-09-12T17:43:41.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.433+0000 7f51d61a08c0 1 < canceled operation key=EDVAEE9FKH1T tag=5KLETBB0549W type=del size=291777 2024-09-12T17:43:41.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.437+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=R6ZKKVQMN1ET type=del size=214666 2024-09-12T17:43:41.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.441+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~BZ3KUL414XY9.0 size=1048576 2024-09-12T17:43:41.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.445+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~BZ3KUL414XY9.1 size=1048576 2024-09-12T17:43:41.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.449+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~BZ3KUL414XY9.2 size=139034 2024-09-12T17:43:41.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.453+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=BZ3KUL414XY9 tag=4LVM3N580FQ7 type=write size=3284762 2024-09-12T17:43:41.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.457+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=E9R54SXTKCYL type=del size=896473 2024-09-12T17:43:41.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.465+0000 7f51d61a08c0 1 < suggested remove operation key=JEXD4ZU5HJ2B tag=FOH2142OBNPM type=del 2024-09-12T17:43:41.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.473+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~M1TKI5MVYL7Y.0 size=293169 2024-09-12T17:43:41.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.473+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=M1TKI5MVYL7Y tag=EUHCVDDCFY4S type=write size=1341745 2024-09-12T17:43:41.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.477+0000 7f51d61a08c0 1 < canceled operation key=V5KMBUNVQA0H tag=E23GOLV4VM2H type=del size=3367439 2024-09-12T17:43:41.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.485+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~22RWH10RLM5I.0 size=1038812 2024-09-12T17:43:41.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.485+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=22RWH10RLM5I tag=TLR9027AMEXS type=write size=2087388 2024-09-12T17:43:41.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.489+0000 7f51d61a08c0 1 < canceled operation key=BF36J1Q6CZFB tag=RW425T3AQWO1 type=del size=3271686 2024-09-12T17:43:41.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.493+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=QWONB764C2RM type=del size=158159 2024-09-12T17:43:41.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.497+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=7TVG3FSWUEQT type=del 2024-09-12T17:43:41.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.505+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~6ZSU9RSBENP9.0 size=990946 2024-09-12T17:43:41.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.505+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=6ZSU9RSBENP9 tag=KIJ0BBV4C9YL type=write size=2039522 2024-09-12T17:43:41.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.509+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=0LPL0BANRHWC type=del 2024-09-12T17:43:41.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.517+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=E5TX2FP4QVPI type=del size=2218693 2024-09-12T17:43:41.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.525+0000 7f51d61a08c0 1 < suggested update operation key=ZCB4V47S38TN tag=PNO292FYULB1 type=del size=4151994 2024-09-12T17:43:41.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.529+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=FQ76YJMKK6C7 type=write size=601736 2024-09-12T17:43:41.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.533+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=YBRHRNKQ3TVY type=del 2024-09-12T17:43:41.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.537+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~S716J3GUEAWX.0 size=759926 2024-09-12T17:43:41.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.537+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=S716J3GUEAWX tag=GZD8W4YQBNJB type=write size=1808502 2024-09-12T17:43:41.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.541+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=0G8AKQ1IPTT1 type=del 2024-09-12T17:43:41.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.545+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=E4I15SFMTC1I type=write size=753362 2024-09-12T17:43:41.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.549+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=FNSKWGPF2EH0 type=del 2024-09-12T17:43:41.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.553+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=YVCYYQZAB206 type=del size=3827406 2024-09-12T17:43:41.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.557+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=VCQNZAIMXDJB type=del 2024-09-12T17:43:41.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.561+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=WF93ST06YF2T type=del size=2878042 2024-09-12T17:43:41.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.565+0000 7f51d61a08c0 1 < canceled operation key=HY2US2MMDNI4 tag=9ABBY38T13BK type=del size=2568238 2024-09-12T17:43:41.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.569+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=XCZJR4H5XV29 type=del size=1448625 2024-09-12T17:43:41.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.573+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~11WONVVJQ11N.0 size=1048576 2024-09-12T17:43:41.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.577+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~11WONVVJQ11N.1 size=586821 2024-09-12T17:43:41.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.585+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=11WONVVJQ11N tag=LL4V8ZH2P2QF type=write size=2683973 2024-09-12T17:43:41.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.589+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~SK0R0A6T1OG1.0 size=113267 2024-09-12T17:43:41.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.589+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=SK0R0A6T1OG1 tag=EZYN2TDONLQC type=write size=1161843 2024-09-12T17:43:41.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.593+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=M4FZRZ86B8Y7 type=del 2024-09-12T17:43:41.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.601+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~PNE918W3T79E.0 size=1048576 2024-09-12T17:43:41.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.605+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~PNE918W3T79E.1 size=1048576 2024-09-12T17:43:41.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.605+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~PNE918W3T79E.2 size=821754 2024-09-12T17:43:41.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.605+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=PNE918W3T79E tag=R8HLU1Z0XGIP type=write size=3967482 2024-09-12T17:43:41.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.605+0000 7f51d61a08c0 1 < canceled part key=_multipart_JEXD4ZU5HJ2B.2~Q25U4AOU5OFV.0 size=1048576 2024-09-12T17:43:41.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.609+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~Q25U4AOU5OFV.1 size=1048576 2024-09-12T17:43:41.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.613+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~Q25U4AOU5OFV.2 size=959787 2024-09-12T17:43:41.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.621+0000 7f51d61a08c0 1 < canceled multipart upload key=JEXD4ZU5HJ2B upload=Q25U4AOU5OFV tag=H2OMSX96WFGB type=write size=4105515 2024-09-12T17:43:41.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.625+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=QE0U9GVP0VBV type=write size=945199 2024-09-12T17:43:41.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.629+0000 7f51d61a08c0 1 < suggested update operation key=SSOA6J297L1C tag=R6ZKKVQMN1ET type=del size=214666 2024-09-12T17:43:41.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.633+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=WWNONIJAL5IA type=del size=284149 2024-09-12T17:43:41.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.637+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=E9R54SXTKCYL type=del 2024-09-12T17:43:41.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.641+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=CDEAY2YZ0A7C type=del size=774502 2024-09-12T17:43:41.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.645+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~M1TKI5MVYL7Y.0 size=293169 2024-09-12T17:43:41.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.653+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=M1TKI5MVYL7Y tag=EUHCVDDCFY4S type=write size=1341745 2024-09-12T17:43:41.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.657+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=O0G74NPB35Y5 type=write size=812223 2024-09-12T17:43:41.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.657+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~22RWH10RLM5I.0 size=1038812 2024-09-12T17:43:41.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.665+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=22RWH10RLM5I tag=TLR9027AMEXS type=write size=2087388 2024-09-12T17:43:41.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.673+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~YK319C2AXNDI.0 size=1048576 2024-09-12T17:43:41.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.673+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~YK319C2AXNDI.1 size=1048576 2024-09-12T17:43:41.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.677+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~YK319C2AXNDI.2 size=389032 2024-09-12T17:43:41.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.677+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=YK319C2AXNDI tag=YW3XRH6Y5ZFJ type=write size=3534760 2024-09-12T17:43:41.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.681+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=QWONB764C2RM type=del 2024-09-12T17:43:41.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.689+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~BEQE9JR7HQR0.0 size=1048576 2024-09-12T17:43:41.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.689+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~BEQE9JR7HQR0.1 size=311338 2024-09-12T17:43:41.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.689+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=BEQE9JR7HQR0 tag=4GPOB3JWVZGA type=write size=2408490 2024-09-12T17:43:41.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.693+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~6ZSU9RSBENP9.0 size=990946 2024-09-12T17:43:41.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.701+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=6ZSU9RSBENP9 tag=KIJ0BBV4C9YL type=write size=2039522 2024-09-12T17:43:41.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.709+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~FKFXG2UQ0O2G.0 size=1048576 2024-09-12T17:43:41.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.709+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~FKFXG2UQ0O2G.1 size=569330 2024-09-12T17:43:41.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.709+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=FKFXG2UQ0O2G tag=OGHDIE1DZDVQ type=write size=2666482 2024-09-12T17:43:41.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.713+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=E5TX2FP4QVPI type=del 2024-09-12T17:43:41.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.717+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=DCSI477CN0LO type=write size=471614 2024-09-12T17:43:41.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.725+0000 7f51d61a08c0 1 < suggested update operation key=7FBK3439R80H tag=FQ76YJMKK6C7 type=write size=601736 2024-09-12T17:43:41.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.729+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=8JA3P0OKXRM5 type=write size=791536 2024-09-12T17:43:41.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.733+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~S716J3GUEAWX.0 size=759926 2024-09-12T17:43:41.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.741+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=S716J3GUEAWX tag=GZD8W4YQBNJB type=write size=1808502 2024-09-12T17:43:41.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.745+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=0MKY187R9CGB type=del size=1749607 2024-09-12T17:43:41.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.749+0000 7f51d61a08c0 1 < suggested update operation key=EDVAEE9FKH1T tag=E4I15SFMTC1I type=write size=753362 2024-09-12T17:43:41.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.753+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=LRSWCNCR1RYJ type=del size=752729 2024-09-12T17:43:41.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.757+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=YVCYYQZAB206 type=del 2024-09-12T17:43:41.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.765+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~WQ5ABDDNLG7D.0 size=177481 2024-09-12T17:43:41.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.765+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=WQ5ABDDNLG7D tag=1XR2G3CL0YO8 type=write size=1226057 2024-09-12T17:43:41.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.769+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=WF93ST06YF2T type=del 2024-09-12T17:43:41.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.777+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~IU3Q8FKOVEI2.0 size=1048576 2024-09-12T17:43:41.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.777+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~IU3Q8FKOVEI2.1 size=1048576 2024-09-12T17:43:41.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~IU3Q8FKOVEI2.2 size=942675 2024-09-12T17:43:41.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.781+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=IU3Q8FKOVEI2 tag=KDQXZ8ZJ72HL type=write size=4088403 2024-09-12T17:43:41.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.785+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=XCZJR4H5XV29 type=del 2024-09-12T17:43:41.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.789+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=2NATNB2KFGLE type=del size=12138 2024-09-12T17:43:41.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.793+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~SK0R0A6T1OG1.0 size=113267 2024-09-12T17:43:41.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.797+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=SK0R0A6T1OG1 tag=EZYN2TDONLQC type=write size=1161843 2024-09-12T17:43:41.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.805+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~OGJDUTAODDF9.0 size=1048576 2024-09-12T17:43:41.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.809+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~OGJDUTAODDF9.1 size=113180 2024-09-12T17:43:41.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.809+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=OGJDUTAODDF9 tag=R4REPQQ0XVXC type=write size=2210332 2024-09-12T17:43:41.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.813+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~PNE918W3T79E.0 size=1048576 2024-09-12T17:43:41.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.817+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~PNE918W3T79E.1 size=1048576 2024-09-12T17:43:41.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.821+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~PNE918W3T79E.2 size=821754 2024-09-12T17:43:41.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.829+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=PNE918W3T79E tag=R8HLU1Z0XGIP type=write size=3967482 2024-09-12T17:43:41.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.833+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=67T8VKS6AH05 type=del size=3436341 2024-09-12T17:43:41.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.837+0000 7f51d61a08c0 1 < completed write operation key=3LE20KMMPH8P tag=QE0U9GVP0VBV type=write size=945199 2024-09-12T17:43:41.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.841+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=748GMRKAIRVP type=del size=1876012 2024-09-12T17:43:41.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.845+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=WWNONIJAL5IA type=del 2024-09-12T17:43:41.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.849+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=PAULE1IXGKXG type=del size=4137703 2024-09-12T17:43:41.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.849+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=CDEAY2YZ0A7C type=del 2024-09-12T17:43:41.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.857+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=9Y6FSOQA8HMV type=del size=1575399 2024-09-12T17:43:41.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.857+0000 7f51d61a08c0 1 < completed write operation key=U3GZL9YPFMZY tag=O0G74NPB35Y5 type=write size=812223 2024-09-12T17:43:41.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.869+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~0FF7Z2EME49R.0 size=1048576 2024-09-12T17:43:41.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.873+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~0FF7Z2EME49R.1 size=798886 2024-09-12T17:43:41.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.873+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=0FF7Z2EME49R tag=U08NGECCE0SI type=write size=2896038 2024-09-12T17:43:41.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.873+0000 7f51d61a08c0 1 < canceled part key=_multipart_593CD3H40DFH.2~YK319C2AXNDI.0 size=1048576 2024-09-12T17:43:41.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.873+0000 7f51d61a08c0 1 < canceled part key=_multipart_593CD3H40DFH.2~YK319C2AXNDI.1 size=1048576 2024-09-12T17:43:41.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.877+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~YK319C2AXNDI.2 size=389032 2024-09-12T17:43:41.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.881+0000 7f51d61a08c0 1 < canceled multipart upload key=593CD3H40DFH upload=YK319C2AXNDI tag=YW3XRH6Y5ZFJ type=write size=3534760 2024-09-12T17:43:41.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.889+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~60IM8Y1D53HK.0 size=1048576 2024-09-12T17:43:41.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.893+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~60IM8Y1D53HK.1 size=1048576 2024-09-12T17:43:41.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.893+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~60IM8Y1D53HK.2 size=286687 2024-09-12T17:43:41.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.893+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=60IM8Y1D53HK tag=IRCJ1UW4LXXC type=write size=3432415 2024-09-12T17:43:41.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.897+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~BEQE9JR7HQR0.0 size=1048576 2024-09-12T17:43:41.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.901+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~BEQE9JR7HQR0.1 size=311338 2024-09-12T17:43:41.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.905+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=BEQE9JR7HQR0 tag=4GPOB3JWVZGA type=write size=2408490 2024-09-12T17:43:41.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.913+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~UWNP44MUTHOI.0 size=851151 2024-09-12T17:43:41.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.913+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=UWNP44MUTHOI tag=VC2G144SB50P type=write size=1899727 2024-09-12T17:43:41.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.917+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~FKFXG2UQ0O2G.0 size=1048576 2024-09-12T17:43:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.921+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~FKFXG2UQ0O2G.1 size=569330 2024-09-12T17:43:41.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.925+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=FKFXG2UQ0O2G tag=OGHDIE1DZDVQ type=write size=2666482 2024-09-12T17:43:41.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.929+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=9KX8D55CRMY2 type=write size=778064 2024-09-12T17:43:41.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.933+0000 7f51d61a08c0 1 < completed write operation key=SSOA6J297L1C tag=DCSI477CN0LO type=write size=471614 2024-09-12T17:43:41.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.937+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=2Y4MZJA25G03 type=del size=183303 2024-09-12T17:43:41.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.941+0000 7f51d61a08c0 1 < canceled operation key=1ZETSL5TXYSM tag=8JA3P0OKXRM5 type=write size=791536 2024-09-12T17:43:41.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.949+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~GBRGH307Q06X.0 size=1048576 2024-09-12T17:43:41.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.953+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~GBRGH307Q06X.1 size=1048576 2024-09-12T17:43:41.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.953+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~GBRGH307Q06X.2 size=513518 2024-09-12T17:43:41.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.953+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=GBRGH307Q06X tag=HST1EMIH2LA2 type=write size=3659246 2024-09-12T17:43:41.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.957+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=0MKY187R9CGB type=del 2024-09-12T17:43:41.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.961+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=NAEX0ID7VX9N type=write size=534426 2024-09-12T17:43:41.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.965+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=LRSWCNCR1RYJ type=del 2024-09-12T17:43:41.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.973+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~034RKQRYX2ID.0 size=304778 2024-09-12T17:43:41.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.973+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=034RKQRYX2ID tag=MWCQJUK257GJ type=write size=1353354 2024-09-12T17:43:41.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.977+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~WQ5ABDDNLG7D.0 size=177481 2024-09-12T17:43:41.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.981+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=WQ5ABDDNLG7D tag=1XR2G3CL0YO8 type=write size=1226057 2024-09-12T17:43:41.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.985+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=PVRU37V4R6EC type=del size=1032156 2024-09-12T17:43:41.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.989+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~IU3Q8FKOVEI2.0 size=1048576 2024-09-12T17:43:41.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.993+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~IU3Q8FKOVEI2.1 size=1048576 2024-09-12T17:43:41.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:41.997+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~IU3Q8FKOVEI2.2 size=942675 2024-09-12T17:43:42.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.001+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=IU3Q8FKOVEI2 tag=KDQXZ8ZJ72HL type=write size=4088403 2024-09-12T17:43:42.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.005+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=KAFTUCXHW0T5 type=del size=2517423 2024-09-12T17:43:42.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.009+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=2NATNB2KFGLE type=del 2024-09-12T17:43:42.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.013+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=5YK1TFIY5K08 type=del size=3802518 2024-09-12T17:43:42.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.017+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~OGJDUTAODDF9.0 size=1048576 2024-09-12T17:43:42.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.021+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~OGJDUTAODDF9.1 size=113180 2024-09-12T17:43:42.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.025+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=OGJDUTAODDF9 tag=R4REPQQ0XVXC type=write size=2210332 2024-09-12T17:43:42.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.033+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~MUJZ0MRAJ7B9.0 size=135091 2024-09-12T17:43:42.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.033+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=MUJZ0MRAJ7B9 tag=V9E1P69O7HRH type=write size=1183667 2024-09-12T17:43:42.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.033+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=67T8VKS6AH05 type=del 2024-09-12T17:43:42.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.037+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=RDGDSZ37NWSK type=write size=626987 2024-09-12T17:43:42.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.041+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=748GMRKAIRVP type=del 2024-09-12T17:43:42.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.045+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=UN315FSA9GUC type=del size=412773 2024-09-12T17:43:42.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.049+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=PAULE1IXGKXG type=del 2024-09-12T17:43:42.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.057+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~T288RWDWFUW3.0 size=1033897 2024-09-12T17:43:42.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.057+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=T288RWDWFUW3 tag=7CF8IUY8TM8V type=write size=2082473 2024-09-12T17:43:42.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.061+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=9Y6FSOQA8HMV type=del 2024-09-12T17:43:42.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.061+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=XDBQWS28EGD8 type=del size=1571313 2024-09-12T17:43:42.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.065+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~0FF7Z2EME49R.0 size=1048576 2024-09-12T17:43:42.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.069+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~0FF7Z2EME49R.1 size=798886 2024-09-12T17:43:42.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.077+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=0FF7Z2EME49R tag=U08NGECCE0SI type=write size=2896038 2024-09-12T17:43:42.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.081+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=YWJJLNMOB9SY type=write size=244505 2024-09-12T17:43:42.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.085+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~60IM8Y1D53HK.0 size=1048576 2024-09-12T17:43:42.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.085+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~60IM8Y1D53HK.1 size=1048576 2024-09-12T17:43:42.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.089+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~60IM8Y1D53HK.2 size=286687 2024-09-12T17:43:42.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.097+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=60IM8Y1D53HK tag=IRCJ1UW4LXXC type=write size=3432415 2024-09-12T17:43:42.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.101+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=8HNY0UK4LNN2 type=write size=953886 2024-09-12T17:43:42.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.105+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~UWNP44MUTHOI.0 size=851151 2024-09-12T17:43:42.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.109+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=UWNP44MUTHOI tag=VC2G144SB50P type=write size=1899727 2024-09-12T17:43:42.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.113+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=HARB2RCUAPNS type=del size=3552912 2024-09-12T17:43:42.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.117+0000 7f51d61a08c0 1 < canceled operation key=ZCB4V47S38TN tag=9KX8D55CRMY2 type=write size=778064 2024-09-12T17:43:42.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.125+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~62NI7KM34KT7.0 size=1048576 2024-09-12T17:43:42.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.129+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~62NI7KM34KT7.1 size=721412 2024-09-12T17:43:42.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.129+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=62NI7KM34KT7 tag=A0FXYMPGJVTK type=write size=2818564 2024-09-12T17:43:42.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.137+0000 7f51d61a08c0 1 < suggested remove operation key=HY2US2MMDNI4 tag=2Y4MZJA25G03 type=del 2024-09-12T17:43:42.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.141+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=FZYN8QYOGZ79 type=write size=52695 2024-09-12T17:43:42.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.145+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~GBRGH307Q06X.0 size=1048576 2024-09-12T17:43:42.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.149+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~GBRGH307Q06X.1 size=1048576 2024-09-12T17:43:42.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.153+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~GBRGH307Q06X.2 size=513518 2024-09-12T17:43:42.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.157+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=GBRGH307Q06X tag=HST1EMIH2LA2 type=write size=3659246 2024-09-12T17:43:42.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.165+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~SYC14MRNG35U.0 size=789513 2024-09-12T17:43:42.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.165+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=SYC14MRNG35U tag=A9BMBNUWOOYX type=write size=1838089 2024-09-12T17:43:42.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.169+0000 7f51d61a08c0 1 < canceled operation key=10WBH16J1AF8 tag=NAEX0ID7VX9N type=write size=534426 2024-09-12T17:43:42.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.177+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~035J3NCSYZOF.0 size=1048576 2024-09-12T17:43:42.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.181+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~035J3NCSYZOF.1 size=445841 2024-09-12T17:43:42.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.181+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=035J3NCSYZOF tag=Z1FH35H4CBN8 type=write size=2542993 2024-09-12T17:43:42.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.185+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~034RKQRYX2ID.0 size=304778 2024-09-12T17:43:42.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.189+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=034RKQRYX2ID tag=MWCQJUK257GJ type=write size=1353354 2024-09-12T17:43:42.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.193+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=H8DAGTGDW3SO type=del size=1430212 2024-09-12T17:43:42.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.201+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=PVRU37V4R6EC type=del 2024-09-12T17:43:42.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.205+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=HWBDTWQGM3K3 type=del size=2219635 2024-09-12T17:43:42.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.209+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=KAFTUCXHW0T5 type=del 2024-09-12T17:43:42.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.213+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=OE3UMI6GNOYR type=del size=663835 2024-09-12T17:43:42.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.217+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=5YK1TFIY5K08 type=del 2024-09-12T17:43:42.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.225+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~VW7KVRY5D1AD.0 size=360258 2024-09-12T17:43:42.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.225+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=VW7KVRY5D1AD tag=613AYTVQYRO3 type=write size=1408834 2024-09-12T17:43:42.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.229+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~MUJZ0MRAJ7B9.0 size=135091 2024-09-12T17:43:42.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.233+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=MUJZ0MRAJ7B9 tag=V9E1P69O7HRH type=write size=1183667 2024-09-12T17:43:42.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.237+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=KVO7F4ZHGDNJ type=del size=2520170 2024-09-12T17:43:42.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.241+0000 7f51d61a08c0 1 < completed write operation key=I22NJJISU96B tag=RDGDSZ37NWSK type=write size=626987 2024-09-12T17:43:42.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.245+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=0DLS48QCA0YL type=del size=2165000 2024-09-12T17:43:42.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.249+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=UN315FSA9GUC type=del 2024-09-12T17:43:42.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.253+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=UDWN30HPFEM0 type=del size=2645596 2024-09-12T17:43:42.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.261+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~T288RWDWFUW3.0 size=1033897 2024-09-12T17:43:42.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.265+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=T288RWDWFUW3 tag=7CF8IUY8TM8V type=write size=2082473 2024-09-12T17:43:42.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.269+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=LRKG1D4OE0V8 type=del size=123473 2024-09-12T17:43:42.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.273+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=XDBQWS28EGD8 type=del 2024-09-12T17:43:42.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.281+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~YLJ4VDMD8DAD.0 size=235997 2024-09-12T17:43:42.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.281+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=YLJ4VDMD8DAD tag=X6X4S5D5594T type=write size=1284573 2024-09-12T17:43:42.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.285+0000 7f51d61a08c0 1 < completed write operation key=96OWZQXI2ALM tag=YWJJLNMOB9SY type=write size=244505 2024-09-12T17:43:42.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.289+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=YURZWS091WP6 type=write size=311395 2024-09-12T17:43:42.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.293+0000 7f51d61a08c0 1 < completed write operation key=XL9QDBTYSP7F tag=8HNY0UK4LNN2 type=write size=953886 2024-09-12T17:43:42.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.297+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=ASWFCTN0TDYG type=del size=3287998 2024-09-12T17:43:42.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.301+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=HARB2RCUAPNS type=del 2024-09-12T17:43:42.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.305+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=ZXT7FN33RZAZ type=del size=817054 2024-09-12T17:43:42.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.309+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~62NI7KM34KT7.0 size=1048576 2024-09-12T17:43:42.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.313+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~62NI7KM34KT7.1 size=721412 2024-09-12T17:43:42.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.317+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=62NI7KM34KT7 tag=A0FXYMPGJVTK type=write size=2818564 2024-09-12T17:43:42.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.321+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=SR2MLWH6KI1W type=del size=4046614 2024-09-12T17:43:42.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.325+0000 7f51d61a08c0 1 < completed write operation key=83V7KSWRKFMZ tag=FZYN8QYOGZ79 type=write size=52695 2024-09-12T17:43:42.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.333+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=Y1XH6XPH1LKZ type=del size=770041 2024-09-12T17:43:42.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.337+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~SYC14MRNG35U.0 size=789513 2024-09-12T17:43:42.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.341+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=SYC14MRNG35U tag=A9BMBNUWOOYX type=write size=1838089 2024-09-12T17:43:42.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.345+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=BV132JH7MYLV type=del size=1263774 2024-09-12T17:43:42.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.353+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~035J3NCSYZOF.0 size=1048576 2024-09-12T17:43:42.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.357+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~035J3NCSYZOF.1 size=445841 2024-09-12T17:43:42.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.361+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=035J3NCSYZOF tag=Z1FH35H4CBN8 type=write size=2542993 2024-09-12T17:43:42.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.369+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=BVCEV3O7Y7NB type=del size=1276472 2024-09-12T17:43:42.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.373+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=H8DAGTGDW3SO type=del 2024-09-12T17:43:42.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.377+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=GL9LC95GLD18 type=del size=2352354 2024-09-12T17:43:42.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.381+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=HWBDTWQGM3K3 type=del 2024-09-12T17:43:42.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.389+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~K1E0Y9BG1V06.0 size=1048576 2024-09-12T17:43:42.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.393+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~K1E0Y9BG1V06.1 size=1048576 2024-09-12T17:43:42.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.397+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~K1E0Y9BG1V06.2 size=605387 2024-09-12T17:43:42.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.397+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=K1E0Y9BG1V06 tag=RDC3IIK2RHW2 type=write size=3751115 2024-09-12T17:43:42.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.401+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=OE3UMI6GNOYR type=del 2024-09-12T17:43:42.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.405+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=SODFQKCH7ZTN type=del size=2207005 2024-09-12T17:43:42.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.409+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~VW7KVRY5D1AD.0 size=360258 2024-09-12T17:43:42.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.413+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=VW7KVRY5D1AD tag=613AYTVQYRO3 type=write size=1408834 2024-09-12T17:43:42.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.421+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~R178ACN3SI19.0 size=1048576 2024-09-12T17:43:42.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.425+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~R178ACN3SI19.1 size=1048576 2024-09-12T17:43:42.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.429+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~R178ACN3SI19.2 size=1005958 2024-09-12T17:43:42.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.429+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=R178ACN3SI19 tag=5FJFYBVSZZJE type=write size=4151686 2024-09-12T17:43:42.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.433+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=KVO7F4ZHGDNJ type=del 2024-09-12T17:43:42.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.437+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=72NN8T13Q4B0 type=del size=499067 2024-09-12T17:43:42.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.441+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=0DLS48QCA0YL type=del 2024-09-12T17:43:42.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.445+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=DA4M6J13A48P type=del size=630672 2024-09-12T17:43:42.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.457+0000 7f51d61a08c0 1 < suggested remove operation key=I22NJJISU96B tag=UDWN30HPFEM0 type=del 2024-09-12T17:43:42.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.461+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~ASBOKEB9E071.0 size=1048576 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.465+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~ASBOKEB9E071.1 size=409861 2024-09-12T17:43:42.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.465+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=ASBOKEB9E071 tag=30SN8E5SW7GX type=write size=2507013 2024-09-12T17:43:42.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.473+0000 7f51d61a08c0 1 < suggested remove operation key=DCLENF1A1W2Q tag=LRKG1D4OE0V8 type=del 2024-09-12T17:43:42.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.477+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~PRNOGEZC9K07.0 size=1048576 2024-09-12T17:43:42.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.481+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~PRNOGEZC9K07.1 size=1048576 2024-09-12T17:43:42.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.485+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~PRNOGEZC9K07.2 size=495562 2024-09-12T17:43:42.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.485+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=PRNOGEZC9K07 tag=9BQ47AKI34YQ type=write size=3641290 2024-09-12T17:43:42.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.489+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~YLJ4VDMD8DAD.0 size=235997 2024-09-12T17:43:42.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.493+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=YLJ4VDMD8DAD tag=X6X4S5D5594T type=write size=1284573 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.501+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~HA5E1DE4M26U.0 size=215634 2024-09-12T17:43:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.501+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=HA5E1DE4M26U tag=H14FOO7LQQA1 type=write size=1264210 2024-09-12T17:43:42.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.505+0000 7f51d61a08c0 1 < completed write operation key=2WC0YDQFKAJD tag=YURZWS091WP6 type=write size=311395 2024-09-12T17:43:42.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.509+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=OKUOPI6OAPG3 type=del size=337383 2024-09-12T17:43:42.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.517+0000 7f51d61a08c0 1 < suggested remove operation key=X6KC9Z6LD7VG tag=ASWFCTN0TDYG type=del 2024-09-12T17:43:42.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.525+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~LRCOF0L1HU7H.0 size=1048576 2024-09-12T17:43:42.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.525+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~LRCOF0L1HU7H.1 size=1048576 2024-09-12T17:43:42.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.529+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~LRCOF0L1HU7H.2 size=743650 2024-09-12T17:43:42.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.529+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=LRCOF0L1HU7H tag=AQM612A9O01V type=write size=3889378 2024-09-12T17:43:42.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.533+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=ZXT7FN33RZAZ type=del 2024-09-12T17:43:42.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.537+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=RGCU4GR7TPAO type=del size=1078080 2024-09-12T17:43:42.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.541+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=SR2MLWH6KI1W type=del 2024-09-12T17:43:42.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.545+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=FXCD4IJ0JWL6 type=del size=2092915 2024-09-12T17:43:42.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.553+0000 7f51d61a08c0 1 < suggested update operation key=2WC0YDQFKAJD tag=Y1XH6XPH1LKZ type=del size=770041 2024-09-12T17:43:42.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.557+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~75IOG4T4118K.0 size=957596 2024-09-12T17:43:42.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.557+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=75IOG4T4118K tag=TKHNIFBVE4YQ type=write size=2006172 2024-09-12T17:43:42.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.565+0000 7f51d61a08c0 1 < suggested remove operation key=ZCB4V47S38TN tag=BV132JH7MYLV type=del 2024-09-12T17:43:42.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.569+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=6E50X851VDFS type=del size=4183092 2024-09-12T17:43:42.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.573+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=BVCEV3O7Y7NB type=del 2024-09-12T17:43:42.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.581+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~97HR3MRGWO06.0 size=1048576 2024-09-12T17:43:42.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.585+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~97HR3MRGWO06.1 size=58017 2024-09-12T17:43:42.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.585+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=97HR3MRGWO06 tag=QN1OSWD1NPAZ type=write size=2155169 2024-09-12T17:43:42.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.593+0000 7f51d61a08c0 1 < suggested update operation key=83V7KSWRKFMZ tag=GL9LC95GLD18 type=del size=2352354 2024-09-12T17:43:42.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.601+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~E6686KG2X0UY.0 size=1048576 2024-09-12T17:43:42.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.605+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~E6686KG2X0UY.1 size=558498 2024-09-12T17:43:42.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.605+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=E6686KG2X0UY tag=9Q4KXQYXD5GN type=write size=2655650 2024-09-12T17:43:42.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.609+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~K1E0Y9BG1V06.0 size=1048576 2024-09-12T17:43:42.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.613+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~K1E0Y9BG1V06.1 size=1048576 2024-09-12T17:43:42.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.613+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~K1E0Y9BG1V06.2 size=605387 2024-09-12T17:43:42.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.621+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=K1E0Y9BG1V06 tag=RDC3IIK2RHW2 type=write size=3751115 2024-09-12T17:43:42.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.625+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=5SO2MFCOCQU8 type=del size=232468 2024-09-12T17:43:42.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.629+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=SODFQKCH7ZTN type=del 2024-09-12T17:43:42.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.637+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~NG8LQHFHW7CP.0 size=445555 2024-09-12T17:43:42.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.637+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=NG8LQHFHW7CP tag=UFTQK551AZ40 type=write size=1494131 2024-09-12T17:43:42.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.641+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~R178ACN3SI19.0 size=1048576 2024-09-12T17:43:42.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.641+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~R178ACN3SI19.1 size=1048576 2024-09-12T17:43:42.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.641+0000 7f51d61a08c0 1 < canceled part key=_multipart_X6KC9Z6LD7VG.2~R178ACN3SI19.2 size=1005958 2024-09-12T17:43:42.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.649+0000 7f51d61a08c0 1 < canceled multipart upload key=X6KC9Z6LD7VG upload=R178ACN3SI19 tag=5FJFYBVSZZJE type=write size=4151686 2024-09-12T17:43:42.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.653+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=A6ZVRW8LPN5N type=del size=3145747 2024-09-12T17:43:42.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.657+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=72NN8T13Q4B0 type=del 2024-09-12T17:43:42.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.661+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~3T3LP6XRVZ0A.0 size=277130 2024-09-12T17:43:42.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.661+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=3T3LP6XRVZ0A tag=ZYAW60V2PZ0M type=write size=1325706 2024-09-12T17:43:42.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.669+0000 7f51d61a08c0 1 < completed delete operation key=U3GZL9YPFMZY tag=DA4M6J13A48P type=del 2024-09-12T17:43:42.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.673+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=HZLC0RY6R0M6 type=del size=292548 2024-09-12T17:43:42.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.677+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~ASBOKEB9E071.0 size=1048576 2024-09-12T17:43:42.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.677+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~ASBOKEB9E071.1 size=409861 2024-09-12T17:43:42.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.685+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=ASBOKEB9E071 tag=30SN8E5SW7GX type=write size=2507013 2024-09-12T17:43:42.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.693+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~JWJ09WPCHUG6.0 size=1048576 2024-09-12T17:43:42.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.693+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~JWJ09WPCHUG6.1 size=1048576 2024-09-12T17:43:42.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~JWJ09WPCHUG6.2 size=1019311 2024-09-12T17:43:42.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.697+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=JWJ09WPCHUG6 tag=DK3PZ1D9W17I type=write size=4165039 2024-09-12T17:43:42.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.701+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~PRNOGEZC9K07.0 size=1048576 2024-09-12T17:43:42.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.705+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~PRNOGEZC9K07.1 size=1048576 2024-09-12T17:43:42.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.705+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~PRNOGEZC9K07.2 size=495562 2024-09-12T17:43:42.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.713+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=PRNOGEZC9K07 tag=9BQ47AKI34YQ type=write size=3641290 2024-09-12T17:43:42.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.721+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~LJB2UF02K0XL.0 size=1048576 2024-09-12T17:43:42.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.721+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~LJB2UF02K0XL.1 size=120159 2024-09-12T17:43:42.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.721+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=LJB2UF02K0XL tag=HG7L5W6FN9F0 type=write size=2217311 2024-09-12T17:43:42.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.725+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~HA5E1DE4M26U.0 size=215634 2024-09-12T17:43:42.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.733+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=HA5E1DE4M26U tag=H14FOO7LQQA1 type=write size=1264210 2024-09-12T17:43:42.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.737+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=YKDGOYB97IIG type=del size=3846491 2024-09-12T17:43:42.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.741+0000 7f51d61a08c0 1 < suggested update operation key=A7V478K2SNOF tag=OKUOPI6OAPG3 type=del size=337383 2024-09-12T17:43:42.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.749+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~EAM9BNF8HIEY.0 size=812694 2024-09-12T17:43:42.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.749+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=EAM9BNF8HIEY tag=CCBTD6OW8VX1 type=write size=1861270 2024-09-12T17:43:42.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.753+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~LRCOF0L1HU7H.0 size=1048576 2024-09-12T17:43:42.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.753+0000 7f51d61a08c0 1 < canceled part key=_multipart_I22NJJISU96B.2~LRCOF0L1HU7H.1 size=1048576 2024-09-12T17:43:42.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.757+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~LRCOF0L1HU7H.2 size=743650 2024-09-12T17:43:42.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.761+0000 7f51d61a08c0 1 < canceled multipart upload key=I22NJJISU96B upload=LRCOF0L1HU7H tag=AQM612A9O01V type=write size=3889378 2024-09-12T17:43:42.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.769+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~36W55LWJA0YI.0 size=1048576 2024-09-12T17:43:42.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.773+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~36W55LWJA0YI.1 size=911233 2024-09-12T17:43:42.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.773+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=36W55LWJA0YI tag=UII0S2W8U1AP type=write size=3008385 2024-09-12T17:43:42.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.777+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=RGCU4GR7TPAO type=del 2024-09-12T17:43:42.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.781+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=C1LFX0NPJOJS type=del size=61026 2024-09-12T17:43:42.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.785+0000 7f51d61a08c0 1 < canceled operation key=96OWZQXI2ALM tag=FXCD4IJ0JWL6 type=del size=2092915 2024-09-12T17:43:42.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.789+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~4HCKB3OXMYRQ.0 size=1048576 2024-09-12T17:43:42.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.793+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~4HCKB3OXMYRQ.1 size=1048576 2024-09-12T17:43:42.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.797+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~4HCKB3OXMYRQ.2 size=805162 2024-09-12T17:43:42.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.797+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=4HCKB3OXMYRQ tag=CHRNQFCKY3ZE type=write size=3950890 2024-09-12T17:43:42.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.801+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~75IOG4T4118K.0 size=957596 2024-09-12T17:43:42.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.805+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=75IOG4T4118K tag=TKHNIFBVE4YQ type=write size=2006172 2024-09-12T17:43:42.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.813+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~25NND83HY4JS.0 size=1048576 2024-09-12T17:43:42.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.813+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~25NND83HY4JS.1 size=1048576 2024-09-12T17:43:42.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.817+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~25NND83HY4JS.2 size=877709 2024-09-12T17:43:42.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.817+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=25NND83HY4JS tag=K58V88NA631X type=write size=4023437 2024-09-12T17:43:42.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.821+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=6E50X851VDFS type=del 2024-09-12T17:43:42.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.825+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=F6WXC5ME4BJP type=del size=3348751 2024-09-12T17:43:42.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.829+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~97HR3MRGWO06.0 size=1048576 2024-09-12T17:43:42.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.833+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~97HR3MRGWO06.1 size=58017 2024-09-12T17:43:42.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.837+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=97HR3MRGWO06 tag=QN1OSWD1NPAZ type=write size=2155169 2024-09-12T17:43:42.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.845+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~SV2X8R53BPMC.0 size=1048576 2024-09-12T17:43:42.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.849+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~SV2X8R53BPMC.1 size=294704 2024-09-12T17:43:42.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.849+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=SV2X8R53BPMC tag=V6IGD8Q7F2GN type=write size=2391856 2024-09-12T17:43:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.853+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~E6686KG2X0UY.0 size=1048576 2024-09-12T17:43:42.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.853+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~E6686KG2X0UY.1 size=558498 2024-09-12T17:43:42.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.861+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=E6686KG2X0UY tag=9Q4KXQYXD5GN type=write size=2655650 2024-09-12T17:43:42.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.869+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~NKYLV2XH3NLT.0 size=529550 2024-09-12T17:43:42.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.869+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=NKYLV2XH3NLT tag=PNRM21F9XN9B type=write size=1578126 2024-09-12T17:43:42.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.873+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=5SO2MFCOCQU8 type=del 2024-09-12T17:43:42.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.877+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=JL5K0AQL0UQH type=write size=264159 2024-09-12T17:43:42.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.877+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~NG8LQHFHW7CP.0 size=445555 2024-09-12T17:43:42.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.885+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=NG8LQHFHW7CP tag=UFTQK551AZ40 type=write size=1494131 2024-09-12T17:43:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.893+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~B9ZN6OAM9C0V.0 size=300399 2024-09-12T17:43:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.893+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=B9ZN6OAM9C0V tag=H0RUBJD4AYGB type=write size=1348975 2024-09-12T17:43:42.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.897+0000 7f51d61a08c0 -1 < failed to complete operation key=A7V478K2SNOF tag=A6ZVRW8LPN5N type=del size=3145747: (22) Invalid argument 2024-09-12T17:43:42.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.905+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~E2MBZO9UEFHP.0 size=291136 2024-09-12T17:43:42.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.905+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=E2MBZO9UEFHP tag=R69WUSMHC5E9 type=write size=1339712 2024-09-12T17:43:42.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.909+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~3T3LP6XRVZ0A.0 size=277130 2024-09-12T17:43:42.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.913+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=3T3LP6XRVZ0A tag=ZYAW60V2PZ0M type=write size=1325706 2024-09-12T17:43:42.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.921+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~LG2K6V9H35OX.0 size=1048576 2024-09-12T17:43:42.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.925+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~LG2K6V9H35OX.1 size=1048576 2024-09-12T17:43:42.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.925+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~LG2K6V9H35OX.2 size=212418 2024-09-12T17:43:42.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.925+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=LG2K6V9H35OX tag=18SRMMI02RVY type=write size=3358146 2024-09-12T17:43:42.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.937+0000 7f51d61a08c0 1 < suggested update operation key=1ZETSL5TXYSM tag=HZLC0RY6R0M6 type=del size=292548 2024-09-12T17:43:42.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.945+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~SCSJUPOJ92MJ.0 size=1048576 2024-09-12T17:43:42.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.945+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~SCSJUPOJ92MJ.1 size=1048576 2024-09-12T17:43:42.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.949+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~SCSJUPOJ92MJ.2 size=404366 2024-09-12T17:43:42.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.949+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=SCSJUPOJ92MJ tag=3HMX2BOJQ0Y6 type=write size=3550094 2024-09-12T17:43:42.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.953+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~JWJ09WPCHUG6.0 size=1048576 2024-09-12T17:43:42.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.957+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~JWJ09WPCHUG6.1 size=1048576 2024-09-12T17:43:42.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.961+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~JWJ09WPCHUG6.2 size=1019311 2024-09-12T17:43:42.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.965+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=JWJ09WPCHUG6 tag=DK3PZ1D9W17I type=write size=4165039 2024-09-12T17:43:42.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.969+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=O3QE4EGZWRU1 type=del size=1775291 2024-09-12T17:43:42.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.973+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~LJB2UF02K0XL.0 size=1048576 2024-09-12T17:43:42.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.977+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~LJB2UF02K0XL.1 size=120159 2024-09-12T17:43:42.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.985+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=LJB2UF02K0XL tag=HG7L5W6FN9F0 type=write size=2217311 2024-09-12T17:43:42.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.989+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~JBWYU7U5Y8Q8.0 size=1048576 2024-09-12T17:43:42.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.993+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~JBWYU7U5Y8Q8.1 size=598485 2024-09-12T17:43:42.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.993+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=JBWYU7U5Y8Q8 tag=5XYTG4FRYHZV type=write size=2695637 2024-09-12T17:43:43.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:42.997+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=YKDGOYB97IIG type=del 2024-09-12T17:43:43.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.001+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=D9ZPRPB1TZWD type=del size=2257260 2024-09-12T17:43:43.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.005+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~EAM9BNF8HIEY.0 size=812694 2024-09-12T17:43:43.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.013+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=EAM9BNF8HIEY tag=CCBTD6OW8VX1 type=write size=1861270 2024-09-12T17:43:43.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.017+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=QJZZ0PQQY07S type=write size=446281 2024-09-12T17:43:43.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.021+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~36W55LWJA0YI.0 size=1048576 2024-09-12T17:43:43.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.025+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~36W55LWJA0YI.1 size=911233 2024-09-12T17:43:43.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.029+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=36W55LWJA0YI tag=UII0S2W8U1AP type=write size=3008385 2024-09-12T17:43:43.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~4YWW0K3QSYQQ.0 size=1048576 2024-09-12T17:43:43.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.041+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~4YWW0K3QSYQQ.1 size=1048576 2024-09-12T17:43:43.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.045+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~4YWW0K3QSYQQ.2 size=267228 2024-09-12T17:43:43.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.045+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=4YWW0K3QSYQQ tag=CF71LC2WJ1AW type=write size=3412956 2024-09-12T17:43:43.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.049+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=C1LFX0NPJOJS type=del 2024-09-12T17:43:43.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.049+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=BFVVVJS3NWZH type=del size=110315 2024-09-12T17:43:43.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.053+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~4HCKB3OXMYRQ.0 size=1048576 2024-09-12T17:43:43.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.057+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~4HCKB3OXMYRQ.1 size=1048576 2024-09-12T17:43:43.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.061+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~4HCKB3OXMYRQ.2 size=805162 2024-09-12T17:43:43.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.069+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=4HCKB3OXMYRQ tag=CHRNQFCKY3ZE type=write size=3950890 2024-09-12T17:43:43.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.077+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~5T8YOGOD5BGI.0 size=1048576 2024-09-12T17:43:43.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.077+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~5T8YOGOD5BGI.1 size=1048576 2024-09-12T17:43:43.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.081+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~5T8YOGOD5BGI.2 size=725170 2024-09-12T17:43:43.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.081+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=5T8YOGOD5BGI tag=24DCW5PB08VD type=write size=3870898 2024-09-12T17:43:43.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.085+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~25NND83HY4JS.0 size=1048576 2024-09-12T17:43:43.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.089+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~25NND83HY4JS.1 size=1048576 2024-09-12T17:43:43.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.093+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~25NND83HY4JS.2 size=877709 2024-09-12T17:43:43.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.097+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=25NND83HY4JS tag=K58V88NA631X type=write size=4023437 2024-09-12T17:43:43.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.105+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~9BY1Y9M6LKBA.0 size=806356 2024-09-12T17:43:43.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.105+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=9BY1Y9M6LKBA tag=19Z5MJFXN2ZB type=write size=1854932 2024-09-12T17:43:43.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.109+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=F6WXC5ME4BJP type=del 2024-09-12T17:43:43.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.113+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=Z0WV0TNOW3C3 type=del size=1251143 2024-09-12T17:43:43.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.117+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~SV2X8R53BPMC.0 size=1048576 2024-09-12T17:43:43.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.121+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~SV2X8R53BPMC.1 size=294704 2024-09-12T17:43:43.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.125+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=SV2X8R53BPMC tag=V6IGD8Q7F2GN type=write size=2391856 2024-09-12T17:43:43.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.129+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=K8MMSF3FFOY2 type=del size=3907101 2024-09-12T17:43:43.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.133+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~NKYLV2XH3NLT.0 size=529550 2024-09-12T17:43:43.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.141+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=NKYLV2XH3NLT tag=PNRM21F9XN9B type=write size=1578126 2024-09-12T17:43:43.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.145+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=MBNQB13DJ22O type=del size=365320 2024-09-12T17:43:43.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.149+0000 7f51d61a08c0 1 < canceled operation key=IWEJXLG1CDAV tag=JL5K0AQL0UQH type=write size=264159 2024-09-12T17:43:43.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.153+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=9BPR0P2JUIBP type=del size=1888289 2024-09-12T17:43:43.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.157+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~B9ZN6OAM9C0V.0 size=300399 2024-09-12T17:43:43.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.165+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=B9ZN6OAM9C0V tag=H0RUBJD4AYGB type=write size=1348975 2024-09-12T17:43:43.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.173+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~F2YQHDOEOFTA.0 size=1048576 2024-09-12T17:43:43.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.177+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~F2YQHDOEOFTA.1 size=376458 2024-09-12T17:43:43.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.177+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=F2YQHDOEOFTA tag=VAS2IOLP8O7F type=write size=2473610 2024-09-12T17:43:43.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.181+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~E2MBZO9UEFHP.0 size=291136 2024-09-12T17:43:43.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.189+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=E2MBZO9UEFHP tag=R69WUSMHC5E9 type=write size=1339712 2024-09-12T17:43:43.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.193+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=4FL7R1MJM9GP type=write size=181406 2024-09-12T17:43:43.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.197+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~LG2K6V9H35OX.0 size=1048576 2024-09-12T17:43:43.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.197+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~LG2K6V9H35OX.1 size=1048576 2024-09-12T17:43:43.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.201+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~LG2K6V9H35OX.2 size=212418 2024-09-12T17:43:43.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.209+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=LG2K6V9H35OX tag=18SRMMI02RVY type=write size=3358146 2024-09-12T17:43:43.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.213+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=AOWR2LIXIQV9 type=del size=4141521 2024-09-12T17:43:43.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.213+0000 7f51d61a08c0 1 < canceled part key=_multipart_2WC0YDQFKAJD.2~SCSJUPOJ92MJ.0 size=1048576 2024-09-12T17:43:43.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.217+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~SCSJUPOJ92MJ.1 size=1048576 2024-09-12T17:43:43.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.217+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~SCSJUPOJ92MJ.2 size=404366 2024-09-12T17:43:43.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.225+0000 7f51d61a08c0 1 < canceled multipart upload key=2WC0YDQFKAJD upload=SCSJUPOJ92MJ tag=3HMX2BOJQ0Y6 type=write size=3550094 2024-09-12T17:43:43.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.233+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~X2QV29U1ER1P.0 size=21560 2024-09-12T17:43:43.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.233+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=X2QV29U1ER1P tag=IUXV6N7NHPIO type=write size=1070136 2024-09-12T17:43:43.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.237+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=O3QE4EGZWRU1 type=del 2024-09-12T17:43:43.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.245+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=GO0YRIXNKFM1 type=write size=41584 2024-09-12T17:43:43.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.249+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~JBWYU7U5Y8Q8.0 size=1048576 2024-09-12T17:43:43.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.253+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~JBWYU7U5Y8Q8.1 size=598485 2024-09-12T17:43:43.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.257+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=JBWYU7U5Y8Q8 tag=5XYTG4FRYHZV type=write size=2695637 2024-09-12T17:43:43.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.261+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=KAEQZEKLDYZW type=del size=122174 2024-09-12T17:43:43.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.265+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=D9ZPRPB1TZWD type=del 2024-09-12T17:43:43.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.269+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=JOO6KZC1QSUG type=del size=3196686 2024-09-12T17:43:43.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.273+0000 7f51d61a08c0 1 < completed write operation key=ZCB4V47S38TN tag=QJZZ0PQQY07S type=write size=446281 2024-09-12T17:43:43.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.281+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=BR6YR8G93IED type=del size=1295963 2024-09-12T17:43:43.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.285+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~4YWW0K3QSYQQ.0 size=1048576 2024-09-12T17:43:43.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.285+0000 7f51d61a08c0 1 < canceled part key=_multipart_JEXD4ZU5HJ2B.2~4YWW0K3QSYQQ.1 size=1048576 2024-09-12T17:43:43.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.289+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~4YWW0K3QSYQQ.2 size=267228 2024-09-12T17:43:43.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.297+0000 7f51d61a08c0 1 < canceled multipart upload key=JEXD4ZU5HJ2B upload=4YWW0K3QSYQQ tag=CF71LC2WJ1AW type=write size=3412956 2024-09-12T17:43:43.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.305+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~1W9VFC48QV5K.0 size=1048576 2024-09-12T17:43:43.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.309+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~1W9VFC48QV5K.1 size=1020205 2024-09-12T17:43:43.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.309+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=1W9VFC48QV5K tag=SX04GAUML0MN type=write size=3117357 2024-09-12T17:43:43.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.317+0000 7f51d61a08c0 1 < suggested update operation key=7FBK3439R80H tag=BFVVVJS3NWZH type=del size=110315 2024-09-12T17:43:43.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.325+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~NCN65ZPGO63C.0 size=694906 2024-09-12T17:43:43.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.325+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=NCN65ZPGO63C tag=EPRUPQRZ2C3A type=write size=1743482 2024-09-12T17:43:43.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.329+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~5T8YOGOD5BGI.0 size=1048576 2024-09-12T17:43:43.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.333+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~5T8YOGOD5BGI.1 size=1048576 2024-09-12T17:43:43.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.337+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~5T8YOGOD5BGI.2 size=725170 2024-09-12T17:43:43.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.345+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=5T8YOGOD5BGI tag=24DCW5PB08VD type=write size=3870898 2024-09-12T17:43:43.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.345+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=4X383IHS0QCN type=del size=1468782 2024-09-12T17:43:43.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.349+0000 7f51d61a08c0 1 < canceled part key=_multipart_BF36J1Q6CZFB.2~9BY1Y9M6LKBA.0 size=806356 2024-09-12T17:43:43.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.353+0000 7f51d61a08c0 1 < canceled multipart upload key=BF36J1Q6CZFB upload=9BY1Y9M6LKBA tag=19Z5MJFXN2ZB type=write size=1854932 2024-09-12T17:43:43.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.361+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=MNZ5FOCT0EKL type=del size=3292125 2024-09-12T17:43:43.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.369+0000 7f51d61a08c0 1 < suggested update operation key=XL9QDBTYSP7F tag=Z0WV0TNOW3C3 type=del size=1251143 2024-09-12T17:43:43.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.377+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~ZIB4DK3P0LPR.0 size=1048576 2024-09-12T17:43:43.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.377+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~ZIB4DK3P0LPR.1 size=1048576 2024-09-12T17:43:43.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.381+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~ZIB4DK3P0LPR.2 size=994502 2024-09-12T17:43:43.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.381+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=ZIB4DK3P0LPR tag=7VHNWX71Z3MS type=write size=4140230 2024-09-12T17:43:43.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.385+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=K8MMSF3FFOY2 type=del 2024-09-12T17:43:43.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.389+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=6EVSUQ9CX3DN type=del size=4163732 2024-09-12T17:43:43.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.393+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=MBNQB13DJ22O type=del 2024-09-12T17:43:43.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.397+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=I2O9YZP6W647 type=del size=3689629 2024-09-12T17:43:43.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.401+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=9BPR0P2JUIBP type=del 2024-09-12T17:43:43.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.409+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~1HVX0QGW50HB.0 size=1048576 2024-09-12T17:43:43.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.409+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~1HVX0QGW50HB.1 size=1048576 2024-09-12T17:43:43.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.413+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~1HVX0QGW50HB.2 size=237171 2024-09-12T17:43:43.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.413+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=1HVX0QGW50HB tag=3YA8GJ0ZHZNH type=write size=3382899 2024-09-12T17:43:43.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.417+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~F2YQHDOEOFTA.0 size=1048576 2024-09-12T17:43:43.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.421+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~F2YQHDOEOFTA.1 size=376458 2024-09-12T17:43:43.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.425+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=F2YQHDOEOFTA tag=VAS2IOLP8O7F type=write size=2473610 2024-09-12T17:43:43.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.433+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~90ULEHK3K1LI.0 size=1048576 2024-09-12T17:43:43.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.437+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~90ULEHK3K1LI.1 size=1048576 2024-09-12T17:43:43.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.437+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~90ULEHK3K1LI.2 size=812652 2024-09-12T17:43:43.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.437+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=90ULEHK3K1LI tag=PE917A1QPPEC type=write size=3958380 2024-09-12T17:43:43.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.445+0000 7f51d61a08c0 1 < completed write operation key=DCLENF1A1W2Q tag=4FL7R1MJM9GP type=write size=181406 2024-09-12T17:43:43.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.449+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=USVNUA5GIO4M type=del size=2144660 2024-09-12T17:43:43.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.453+0000 7f51d61a08c0 -1 < failed to complete operation key=XL9QDBTYSP7F tag=AOWR2LIXIQV9 type=del size=4141521: (22) Invalid argument 2024-09-12T17:43:43.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.457+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=60AJ9YFJ6EXL type=write size=327598 2024-09-12T17:43:43.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.461+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~X2QV29U1ER1P.0 size=21560 2024-09-12T17:43:43.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.465+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=X2QV29U1ER1P tag=IUXV6N7NHPIO type=write size=1070136 2024-09-12T17:43:43.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.469+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=I7WUUUQXXTMM type=del size=4055499 2024-09-12T17:43:43.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.473+0000 7f51d61a08c0 1 < canceled operation key=8J72KCZ5WRPU tag=GO0YRIXNKFM1 type=write size=41584 2024-09-12T17:43:43.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.481+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~F21YXA23T1CU.0 size=1048576 2024-09-12T17:43:43.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.485+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~F21YXA23T1CU.1 size=1048576 2024-09-12T17:43:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.485+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~F21YXA23T1CU.2 size=994225 2024-09-12T17:43:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.485+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=F21YXA23T1CU tag=LS184ET09PQV type=write size=4139953 2024-09-12T17:43:43.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.489+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=KAEQZEKLDYZW type=del 2024-09-12T17:43:43.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.497+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~ULO96XQMYS3M.0 size=1048576 2024-09-12T17:43:43.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.501+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~ULO96XQMYS3M.1 size=317614 2024-09-12T17:43:43.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.501+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=ULO96XQMYS3M tag=ABG7EHGEHPUC type=write size=2414766 2024-09-12T17:43:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.505+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=JOO6KZC1QSUG type=del 2024-09-12T17:43:43.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.509+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=T5DRYL6VO4DI type=write size=627827 2024-09-12T17:43:43.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.513+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=BR6YR8G93IED type=del 2024-09-12T17:43:43.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.521+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~YK94LC0VJMOU.0 size=1048576 2024-09-12T17:43:43.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.521+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~YK94LC0VJMOU.1 size=1048576 2024-09-12T17:43:43.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.525+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~YK94LC0VJMOU.2 size=507773 2024-09-12T17:43:43.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.525+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=YK94LC0VJMOU tag=QR0ZGNIL1OVU type=write size=3653501 2024-09-12T17:43:43.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.529+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~1W9VFC48QV5K.0 size=1048576 2024-09-12T17:43:43.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.533+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~1W9VFC48QV5K.1 size=1020205 2024-09-12T17:43:43.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.541+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=1W9VFC48QV5K tag=SX04GAUML0MN type=write size=3117357 2024-09-12T17:43:43.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.545+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=EMRKIPWLES7M type=write size=501635 2024-09-12T17:43:43.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.549+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~NCN65ZPGO63C.0 size=694906 2024-09-12T17:43:43.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.557+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=NCN65ZPGO63C tag=EPRUPQRZ2C3A type=write size=1743482 2024-09-12T17:43:43.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.561+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=PYSEG14H8APE type=del size=3459655 2024-09-12T17:43:43.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.569+0000 7f51d61a08c0 1 < suggested update operation key=HUWVRJIZ5JYE tag=4X383IHS0QCN type=del size=1468782 2024-09-12T17:43:43.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~JAROFSJX4MHM.0 size=1048576 2024-09-12T17:43:43.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.581+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~JAROFSJX4MHM.1 size=1048576 2024-09-12T17:43:43.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.581+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~JAROFSJX4MHM.2 size=1040059 2024-09-12T17:43:43.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.581+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=JAROFSJX4MHM tag=H48BGH2D2V3Z type=write size=4185787 2024-09-12T17:43:43.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.593+0000 7f51d61a08c0 1 < suggested update operation key=1ZETSL5TXYSM tag=MNZ5FOCT0EKL type=del size=3292125 2024-09-12T17:43:43.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.597+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=UQ3YCKXNI51W type=del size=1043437 2024-09-12T17:43:43.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.601+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~ZIB4DK3P0LPR.0 size=1048576 2024-09-12T17:43:43.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.601+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~ZIB4DK3P0LPR.1 size=1048576 2024-09-12T17:43:43.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.605+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~ZIB4DK3P0LPR.2 size=994502 2024-09-12T17:43:43.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.613+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=ZIB4DK3P0LPR tag=7VHNWX71Z3MS type=write size=4140230 2024-09-12T17:43:43.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.617+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=0VVUIHHWYV0H type=del size=3146503 2024-09-12T17:43:43.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.621+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=6EVSUQ9CX3DN type=del 2024-09-12T17:43:43.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.625+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=KQ9TXJ0Y84KJ type=del size=1119458 2024-09-12T17:43:43.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.629+0000 7f51d61a08c0 1 < canceled operation key=U3GZL9YPFMZY tag=I2O9YZP6W647 type=del size=3689629 2024-09-12T17:43:43.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.637+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~STVHQ7IUB9VB.0 size=1048576 2024-09-12T17:43:43.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.637+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~STVHQ7IUB9VB.1 size=1048576 2024-09-12T17:43:43.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.641+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~STVHQ7IUB9VB.2 size=427768 2024-09-12T17:43:43.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.641+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=STVHQ7IUB9VB tag=OAHJKE2AI2KT type=write size=3573496 2024-09-12T17:43:43.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.645+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~1HVX0QGW50HB.0 size=1048576 2024-09-12T17:43:43.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.649+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~1HVX0QGW50HB.1 size=1048576 2024-09-12T17:43:43.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.653+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~1HVX0QGW50HB.2 size=237171 2024-09-12T17:43:43.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.657+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=1HVX0QGW50HB tag=3YA8GJ0ZHZNH type=write size=3382899 2024-09-12T17:43:43.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.665+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=1NM0CWE3VI2N type=del size=4063904 2024-09-12T17:43:43.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.669+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~90ULEHK3K1LI.0 size=1048576 2024-09-12T17:43:43.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.673+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~90ULEHK3K1LI.1 size=1048576 2024-09-12T17:43:43.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.673+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~90ULEHK3K1LI.2 size=812652 2024-09-12T17:43:43.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.681+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=90ULEHK3K1LI tag=PE917A1QPPEC type=write size=3958380 2024-09-12T17:43:43.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.685+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=KHX8VILVH08E type=del size=3096981 2024-09-12T17:43:43.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.689+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=USVNUA5GIO4M type=del 2024-09-12T17:43:43.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.693+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=8IR7GBTANV6C type=del size=2777771 2024-09-12T17:43:43.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.697+0000 7f51d61a08c0 1 < canceled operation key=7FBK3439R80H tag=60AJ9YFJ6EXL type=write size=327598 2024-09-12T17:43:43.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.701+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=YF99K9M6EAA6 type=del size=1884554 2024-09-12T17:43:43.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.705+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=I7WUUUQXXTMM type=del 2024-09-12T17:43:43.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.709+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=TOI58ZZOV074 type=del size=2556857 2024-09-12T17:43:43.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.713+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~F21YXA23T1CU.0 size=1048576 2024-09-12T17:43:43.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.717+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~F21YXA23T1CU.1 size=1048576 2024-09-12T17:43:43.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.717+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~F21YXA23T1CU.2 size=994225 2024-09-12T17:43:43.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.725+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=F21YXA23T1CU tag=LS184ET09PQV type=write size=4139953 2024-09-12T17:43:43.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.729+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=9AGCPZLO2OAI type=del size=2128773 2024-09-12T17:43:43.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.733+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~ULO96XQMYS3M.0 size=1048576 2024-09-12T17:43:43.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.737+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~ULO96XQMYS3M.1 size=317614 2024-09-12T17:43:43.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.745+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=ULO96XQMYS3M tag=ABG7EHGEHPUC type=write size=2414766 2024-09-12T17:43:43.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.753+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~8B7EB8IA4VDF.0 size=403315 2024-09-12T17:43:43.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.753+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=8B7EB8IA4VDF tag=0A3JDPUARI3I type=write size=1451891 2024-09-12T17:43:43.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.757+0000 7f51d61a08c0 1 < completed write operation key=ZCB4V47S38TN tag=T5DRYL6VO4DI type=write size=627827 2024-09-12T17:43:43.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.761+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=LA7GTLVPFNTX type=del size=4162464 2024-09-12T17:43:43.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.765+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~YK94LC0VJMOU.0 size=1048576 2024-09-12T17:43:43.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.769+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~YK94LC0VJMOU.1 size=1048576 2024-09-12T17:43:43.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.769+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~YK94LC0VJMOU.2 size=507773 2024-09-12T17:43:43.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.777+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=YK94LC0VJMOU tag=QR0ZGNIL1OVU type=write size=3653501 2024-09-12T17:43:43.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~76X9J9Y7TGIF.0 size=397089 2024-09-12T17:43:43.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.781+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=76X9J9Y7TGIF tag=1GDY0FDR53DZ type=write size=1445665 2024-09-12T17:43:43.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.789+0000 7f51d61a08c0 1 < completed write operation key=HY2US2MMDNI4 tag=EMRKIPWLES7M type=write size=501635 2024-09-12T17:43:43.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.789+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=UAJSLRN9Z882 type=del size=2567576 2024-09-12T17:43:43.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.797+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=PYSEG14H8APE type=del 2024-09-12T17:43:43.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.801+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~JQBUS2BA4SBL.0 size=1048576 2024-09-12T17:43:43.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.805+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~JQBUS2BA4SBL.1 size=707165 2024-09-12T17:43:43.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.805+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=JQBUS2BA4SBL tag=8PTDMIS16EN8 type=write size=2804317 2024-09-12T17:43:43.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.809+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~JAROFSJX4MHM.0 size=1048576 2024-09-12T17:43:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.813+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~JAROFSJX4MHM.1 size=1048576 2024-09-12T17:43:43.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.817+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~JAROFSJX4MHM.2 size=1040059 2024-09-12T17:43:43.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.821+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=JAROFSJX4MHM tag=H48BGH2D2V3Z type=write size=4185787 2024-09-12T17:43:43.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.825+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=N5PXM1SNNTKN type=write size=423531 2024-09-12T17:43:43.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.829+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=UQ3YCKXNI51W type=del 2024-09-12T17:43:43.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.833+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=PJ7UUB100Y9E type=del size=1081632 2024-09-12T17:43:43.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.837+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=0VVUIHHWYV0H type=del 2024-09-12T17:43:43.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.841+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=ZAW53Y0I4HWP type=del size=1231532 2024-09-12T17:43:43.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.849+0000 7f51d61a08c0 1 < suggested remove operation key=3LE20KMMPH8P tag=KQ9TXJ0Y84KJ type=del 2024-09-12T17:43:43.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.857+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~IKPKFNH9SY78.0 size=422129 2024-09-12T17:43:43.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.857+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=IKPKFNH9SY78 tag=941GL2SPD59W type=write size=1470705 2024-09-12T17:43:43.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.861+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~STVHQ7IUB9VB.0 size=1048576 2024-09-12T17:43:43.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.861+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~STVHQ7IUB9VB.1 size=1048576 2024-09-12T17:43:43.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.865+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~STVHQ7IUB9VB.2 size=427768 2024-09-12T17:43:43.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.873+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=STVHQ7IUB9VB tag=OAHJKE2AI2KT type=write size=3573496 2024-09-12T17:43:43.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.877+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=46I7U24XU6YB type=del size=3426280 2024-09-12T17:43:43.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.881+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=1NM0CWE3VI2N type=del 2024-09-12T17:43:43.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.885+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~RB7UFQD93QLQ.0 size=1048576 2024-09-12T17:43:43.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.889+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~RB7UFQD93QLQ.1 size=1048576 2024-09-12T17:43:43.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.893+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~RB7UFQD93QLQ.2 size=698599 2024-09-12T17:43:43.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.893+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=RB7UFQD93QLQ tag=GCK9LEC1X7NJ type=write size=3844327 2024-09-12T17:43:43.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.897+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=KHX8VILVH08E type=del 2024-09-12T17:43:43.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.901+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=HO1C1PH4JTG5 type=del size=3054601 2024-09-12T17:43:43.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.905+0000 7f51d61a08c0 1 < suggested update operation key=96OWZQXI2ALM tag=8IR7GBTANV6C type=del size=2777771 2024-09-12T17:43:43.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.913+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~7EQVLQDILZUM.0 size=1048576 2024-09-12T17:43:43.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.917+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~7EQVLQDILZUM.1 size=230074 2024-09-12T17:43:43.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.917+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=7EQVLQDILZUM tag=OJYBKDUZGBGI type=write size=2327226 2024-09-12T17:43:43.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.925+0000 7f51d61a08c0 1 < suggested remove operation key=96OWZQXI2ALM tag=YF99K9M6EAA6 type=del 2024-09-12T17:43:43.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.929+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=G7PFQFLOV4PM type=del size=2311223 2024-09-12T17:43:43.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.937+0000 7f51d61a08c0 1 < suggested remove operation key=HY2US2MMDNI4 tag=TOI58ZZOV074 type=del 2024-09-12T17:43:43.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.941+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=YECVQNCRLALL type=del size=2365506 2024-09-12T17:43:43.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.945+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=9AGCPZLO2OAI type=del 2024-09-12T17:43:43.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.949+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=YQ9NWGW4MRKG type=del size=2527028 2024-09-12T17:43:43.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.953+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~8B7EB8IA4VDF.0 size=403315 2024-09-12T17:43:43.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.957+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=8B7EB8IA4VDF tag=0A3JDPUARI3I type=write size=1451891 2024-09-12T17:43:43.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.965+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~ON0DWD6FL2RO.0 size=155506 2024-09-12T17:43:43.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.965+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=ON0DWD6FL2RO tag=P76OQDZ5MTSS type=write size=1204082 2024-09-12T17:43:43.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.969+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=LA7GTLVPFNTX type=del 2024-09-12T17:43:43.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.977+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~7UV3HEHPFV7F.0 size=1048576 2024-09-12T17:43:43.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.977+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~7UV3HEHPFV7F.1 size=626694 2024-09-12T17:43:43.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.977+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=7UV3HEHPFV7F tag=MIOCMIIJE4DV type=write size=2723846 2024-09-12T17:43:43.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.981+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~76X9J9Y7TGIF.0 size=397089 2024-09-12T17:43:43.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.989+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=76X9J9Y7TGIF tag=1GDY0FDR53DZ type=write size=1445665 2024-09-12T17:43:43.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.997+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~5PC0GIH932B1.0 size=1048576 2024-09-12T17:43:44.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:43.997+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~5PC0GIH932B1.1 size=1048576 2024-09-12T17:43:44.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.001+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~5PC0GIH932B1.2 size=266344 2024-09-12T17:43:44.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.001+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=5PC0GIH932B1 tag=4CKVURJWA3DS type=write size=3412072 2024-09-12T17:43:44.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.005+0000 7f51d61a08c0 -1 < failed to complete operation key=3LE20KMMPH8P tag=UAJSLRN9Z882 type=del size=2567576: (22) Invalid argument 2024-09-12T17:43:44.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.009+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=RYP1OR2CLIFD type=del size=1618984 2024-09-12T17:43:44.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.013+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~JQBUS2BA4SBL.0 size=1048576 2024-09-12T17:43:44.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.017+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~JQBUS2BA4SBL.1 size=707165 2024-09-12T17:43:44.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.025+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=JQBUS2BA4SBL tag=8PTDMIS16EN8 type=write size=2804317 2024-09-12T17:43:44.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.033+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~NTILC9HG42V7.0 size=1048576 2024-09-12T17:43:44.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.033+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~NTILC9HG42V7.1 size=1040673 2024-09-12T17:43:44.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.033+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=NTILC9HG42V7 tag=892D1NYL0WIG type=write size=3137825 2024-09-12T17:43:44.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.037+0000 7f51d61a08c0 1 < canceled operation key=I22NJJISU96B tag=N5PXM1SNNTKN type=write size=423531 2024-09-12T17:43:44.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.045+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~RYX2RN6CUD8R.0 size=1048576 2024-09-12T17:43:44.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.049+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~RYX2RN6CUD8R.1 size=1048576 2024-09-12T17:43:44.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.049+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~RYX2RN6CUD8R.2 size=462292 2024-09-12T17:43:44.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.049+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=RYX2RN6CUD8R tag=YTM69XJ7P92S type=write size=3608020 2024-09-12T17:43:44.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.053+0000 7f51d61a08c0 -1 < failed to complete operation key=3LE20KMMPH8P tag=PJ7UUB100Y9E type=del size=1081632: (22) Invalid argument 2024-09-12T17:43:44.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.057+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=PWP38LP4S2PE type=del size=3893763 2024-09-12T17:43:44.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.065+0000 7f51d61a08c0 1 < suggested remove operation key=BF36J1Q6CZFB tag=ZAW53Y0I4HWP type=del 2024-09-12T17:43:44.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.073+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=5TXOEX1Z0HV3 type=del size=1982235 2024-09-12T17:43:44.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.077+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~IKPKFNH9SY78.0 size=422129 2024-09-12T17:43:44.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.081+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=IKPKFNH9SY78 tag=941GL2SPD59W type=write size=1470705 2024-09-12T17:43:44.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.089+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~LJGUC3W2ASPK.0 size=71672 2024-09-12T17:43:44.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.089+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=LJGUC3W2ASPK tag=V9Y1IP3QEQSD type=write size=1120248 2024-09-12T17:43:44.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.097+0000 7f51d61a08c0 1 < suggested update operation key=X6KC9Z6LD7VG tag=46I7U24XU6YB type=del size=3426280 2024-09-12T17:43:44.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.105+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~TNRTTWS8T3FA.0 size=1048576 2024-09-12T17:43:44.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.109+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~TNRTTWS8T3FA.1 size=430772 2024-09-12T17:43:44.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.109+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=TNRTTWS8T3FA tag=ZH707K7Q9XPD type=write size=2527924 2024-09-12T17:43:44.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.113+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~RB7UFQD93QLQ.0 size=1048576 2024-09-12T17:43:44.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.117+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~RB7UFQD93QLQ.1 size=1048576 2024-09-12T17:43:44.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.117+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~RB7UFQD93QLQ.2 size=698599 2024-09-12T17:43:44.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.125+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=RB7UFQD93QLQ tag=GCK9LEC1X7NJ type=write size=3844327 2024-09-12T17:43:44.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.129+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=K9THA065UH0O type=del size=3752218 2024-09-12T17:43:44.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.137+0000 7f51d61a08c0 1 < suggested update operation key=92CMI8Q29LB3 tag=HO1C1PH4JTG5 type=del size=3054601 2024-09-12T17:43:44.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.141+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~HY9EZSAL9QYY.0 size=197633 2024-09-12T17:43:44.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.141+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=HY9EZSAL9QYY tag=RDNWUQBQFBWS type=write size=1246209 2024-09-12T17:43:44.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.145+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~7EQVLQDILZUM.0 size=1048576 2024-09-12T17:43:44.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.149+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~7EQVLQDILZUM.1 size=230074 2024-09-12T17:43:44.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.153+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=7EQVLQDILZUM tag=OJYBKDUZGBGI type=write size=2327226 2024-09-12T17:43:44.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.161+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~3M7DZVGEQPYY.0 size=882275 2024-09-12T17:43:44.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.161+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=3M7DZVGEQPYY tag=UYUXLY7XKRUX type=write size=1930851 2024-09-12T17:43:44.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.165+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=G7PFQFLOV4PM type=del 2024-09-12T17:43:44.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.169+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=U4KR7F6OOWLT type=del size=2300316 2024-09-12T17:43:44.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.173+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=YECVQNCRLALL type=del 2024-09-12T17:43:44.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.177+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=2U0Q30Q0L2JC type=del size=3472868 2024-09-12T17:43:44.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.181+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=YQ9NWGW4MRKG type=del 2024-09-12T17:43:44.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.185+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=AOYKA24F0I08 type=del size=1997376 2024-09-12T17:43:44.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.189+0000 7f51d61a08c0 1 < canceled part key=_multipart_X6KC9Z6LD7VG.2~ON0DWD6FL2RO.0 size=155506 2024-09-12T17:43:44.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.193+0000 7f51d61a08c0 1 < canceled multipart upload key=X6KC9Z6LD7VG upload=ON0DWD6FL2RO tag=P76OQDZ5MTSS type=write size=1204082 2024-09-12T17:43:44.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.201+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~6XY8PZUFTY53.0 size=996014 2024-09-12T17:43:44.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.201+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=6XY8PZUFTY53 tag=0RZ52RMFX4OF type=write size=2044590 2024-09-12T17:43:44.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.205+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~7UV3HEHPFV7F.0 size=1048576 2024-09-12T17:43:44.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.205+0000 7f51d61a08c0 1 < canceled part key=_multipart_JEXD4ZU5HJ2B.2~7UV3HEHPFV7F.1 size=626694 2024-09-12T17:43:44.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.209+0000 7f51d61a08c0 1 < canceled multipart upload key=JEXD4ZU5HJ2B upload=7UV3HEHPFV7F tag=MIOCMIIJE4DV type=write size=2723846 2024-09-12T17:43:44.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.213+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=KYJ7J9S5UKLI type=write size=576905 2024-09-12T17:43:44.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.217+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~5PC0GIH932B1.0 size=1048576 2024-09-12T17:43:44.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.217+0000 7f51d61a08c0 1 < canceled part key=_multipart_GJX1YGAQFXZ2.2~5PC0GIH932B1.1 size=1048576 2024-09-12T17:43:44.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.217+0000 7f51d61a08c0 1 < canceled part key=_multipart_GJX1YGAQFXZ2.2~5PC0GIH932B1.2 size=266344 2024-09-12T17:43:44.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.225+0000 7f51d61a08c0 1 < canceled multipart upload key=GJX1YGAQFXZ2 upload=5PC0GIH932B1 tag=4CKVURJWA3DS type=write size=3412072 2024-09-12T17:43:44.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.233+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~ACPZABBX25XZ.0 size=1048576 2024-09-12T17:43:44.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.233+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~ACPZABBX25XZ.1 size=1048576 2024-09-12T17:43:44.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.237+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~ACPZABBX25XZ.2 size=289810 2024-09-12T17:43:44.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.237+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=ACPZABBX25XZ tag=ZQUVW7S77JAA type=write size=3435538 2024-09-12T17:43:44.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.241+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=RYP1OR2CLIFD type=del 2024-09-12T17:43:44.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.245+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=ZCAIO70T03HY type=del size=3749960 2024-09-12T17:43:44.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.249+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~NTILC9HG42V7.0 size=1048576 2024-09-12T17:43:44.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.253+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~NTILC9HG42V7.1 size=1040673 2024-09-12T17:43:44.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.257+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=NTILC9HG42V7 tag=892D1NYL0WIG type=write size=3137825 2024-09-12T17:43:44.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.265+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~OINKAJ8PR077.0 size=130578 2024-09-12T17:43:44.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.265+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=OINKAJ8PR077 tag=WEZ3IH7R1CED type=write size=1179154 2024-09-12T17:43:44.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.269+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~RYX2RN6CUD8R.0 size=1048576 2024-09-12T17:43:44.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.269+0000 7f51d61a08c0 1 < canceled part key=_multipart_SSOA6J297L1C.2~RYX2RN6CUD8R.1 size=1048576 2024-09-12T17:43:44.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.273+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~RYX2RN6CUD8R.2 size=462292 2024-09-12T17:43:44.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.281+0000 7f51d61a08c0 1 < canceled multipart upload key=SSOA6J297L1C upload=RYX2RN6CUD8R tag=YTM69XJ7P92S type=write size=3608020 2024-09-12T17:43:44.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.285+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=7D46UOE5G0E2 type=del size=738287 2024-09-12T17:43:44.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.289+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=PWP38LP4S2PE type=del 2024-09-12T17:43:44.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.293+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=OY6GDUOI9HBG type=del size=3202567 2024-09-12T17:43:44.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.297+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=5TXOEX1Z0HV3 type=del 2024-09-12T17:43:44.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.305+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~OTDE607XP0RH.0 size=1048576 2024-09-12T17:43:44.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.309+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~OTDE607XP0RH.1 size=1032563 2024-09-12T17:43:44.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.309+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=OTDE607XP0RH tag=A1UZYVJWOTQP type=write size=3129715 2024-09-12T17:43:44.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.313+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~LJGUC3W2ASPK.0 size=71672 2024-09-12T17:43:44.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.321+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=LJGUC3W2ASPK tag=V9Y1IP3QEQSD type=write size=1120248 2024-09-12T17:43:44.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.333+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~6OGLGLW0TVDT.0 size=1048576 2024-09-12T17:43:44.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.333+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~6OGLGLW0TVDT.1 size=1048576 2024-09-12T17:43:44.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.337+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~6OGLGLW0TVDT.2 size=413106 2024-09-12T17:43:44.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.337+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=6OGLGLW0TVDT tag=H1MQTSTF8XQ4 type=write size=3558834 2024-09-12T17:43:44.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.341+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~TNRTTWS8T3FA.0 size=1048576 2024-09-12T17:43:44.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.345+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~TNRTTWS8T3FA.1 size=430772 2024-09-12T17:43:44.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.349+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=TNRTTWS8T3FA tag=ZH707K7Q9XPD type=write size=2527924 2024-09-12T17:43:44.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.353+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=ES8R36JAGZ0D type=del size=4155745 2024-09-12T17:43:44.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.357+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=K9THA065UH0O type=del 2024-09-12T17:43:44.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.361+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=GFJRAJX5QNOX type=write size=45825 2024-09-12T17:43:44.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.365+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~HY9EZSAL9QYY.0 size=197633 2024-09-12T17:43:44.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.373+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=HY9EZSAL9QYY tag=RDNWUQBQFBWS type=write size=1246209 2024-09-12T17:43:44.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.377+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=4V8M33OTF92X type=del size=66108 2024-09-12T17:43:44.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.381+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~3M7DZVGEQPYY.0 size=882275 2024-09-12T17:43:44.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.389+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=3M7DZVGEQPYY tag=UYUXLY7XKRUX type=write size=1930851 2024-09-12T17:43:44.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.393+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=2MHG720W93R6 type=del size=986854 2024-09-12T17:43:44.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.397+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=U4KR7F6OOWLT type=del 2024-09-12T17:43:44.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.401+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=LQNHT5AH55GM type=del size=1678141 2024-09-12T17:43:44.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.405+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=2U0Q30Q0L2JC type=del 2024-09-12T17:43:44.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.409+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=V248RE9T51HA type=write size=932758 2024-09-12T17:43:44.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.413+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=AOYKA24F0I08 type=del 2024-09-12T17:43:44.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.421+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~22B4W4Z3FAPS.0 size=836178 2024-09-12T17:43:44.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.421+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=22B4W4Z3FAPS tag=YANC70N306LP type=write size=1884754 2024-09-12T17:43:44.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.425+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~6XY8PZUFTY53.0 size=996014 2024-09-12T17:43:44.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.433+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=6XY8PZUFTY53 tag=0RZ52RMFX4OF type=write size=2044590 2024-09-12T17:43:44.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.437+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=YP5XM1ZTPB08 type=del size=492586 2024-09-12T17:43:44.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.441+0000 7f51d61a08c0 1 < completed write operation key=SSOA6J297L1C tag=KYJ7J9S5UKLI type=write size=576905 2024-09-12T17:43:44.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.445+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=8M30VM6GRUO1 type=del size=1472488 2024-09-12T17:43:44.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.445+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~ACPZABBX25XZ.0 size=1048576 2024-09-12T17:43:44.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.449+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~ACPZABBX25XZ.1 size=1048576 2024-09-12T17:43:44.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.449+0000 7f51d61a08c0 1 < canceled part key=_multipart_HUWVRJIZ5JYE.2~ACPZABBX25XZ.2 size=289810 2024-09-12T17:43:44.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.457+0000 7f51d61a08c0 1 < canceled multipart upload key=HUWVRJIZ5JYE upload=ACPZABBX25XZ tag=ZQUVW7S77JAA type=write size=3435538 2024-09-12T17:43:44.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.461+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=VQ02PT293DUR type=write size=168091 2024-09-12T17:43:44.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.469+0000 7f51d61a08c0 1 < suggested remove operation key=U3GZL9YPFMZY tag=ZCAIO70T03HY type=del 2024-09-12T17:43:44.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.473+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=CPUEVBGWAR6A type=del size=2006781 2024-09-12T17:43:44.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.477+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~OINKAJ8PR077.0 size=130578 2024-09-12T17:43:44.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.481+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=OINKAJ8PR077 tag=WEZ3IH7R1CED type=write size=1179154 2024-09-12T17:43:44.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.485+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=N1NX9TO6KXI8 type=write size=152190 2024-09-12T17:43:44.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.489+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=7D46UOE5G0E2 type=del 2024-09-12T17:43:44.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.493+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=M6CO6JCDMTU8 type=del size=3112969 2024-09-12T17:43:44.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.497+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=OY6GDUOI9HBG type=del 2024-09-12T17:43:44.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.501+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=M1DZAM612DD2 type=write size=560128 2024-09-12T17:43:44.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.505+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~OTDE607XP0RH.0 size=1048576 2024-09-12T17:43:44.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.509+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~OTDE607XP0RH.1 size=1032563 2024-09-12T17:43:44.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.513+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=OTDE607XP0RH tag=A1UZYVJWOTQP type=write size=3129715 2024-09-12T17:43:44.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.517+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=R15623A0XETG type=del size=3923860 2024-09-12T17:43:44.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.521+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~6OGLGLW0TVDT.0 size=1048576 2024-09-12T17:43:44.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.525+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~6OGLGLW0TVDT.1 size=1048576 2024-09-12T17:43:44.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.525+0000 7f51d61a08c0 1 < canceled part key=_multipart_FKKV7SXZSP90.2~6OGLGLW0TVDT.2 size=413106 2024-09-12T17:43:44.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.533+0000 7f51d61a08c0 1 < canceled multipart upload key=FKKV7SXZSP90 upload=6OGLGLW0TVDT tag=H1MQTSTF8XQ4 type=write size=3558834 2024-09-12T17:43:44.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.537+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~8PCG7AXB6NBG.0 size=1048576 2024-09-12T17:43:44.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.541+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~8PCG7AXB6NBG.1 size=1048576 2024-09-12T17:43:44.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.545+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~8PCG7AXB6NBG.2 size=220504 2024-09-12T17:43:44.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.545+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=8PCG7AXB6NBG tag=5UGRJ07JA8D9 type=write size=3366232 2024-09-12T17:43:44.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.549+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=ES8R36JAGZ0D type=del 2024-09-12T17:43:44.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.553+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~MR10UOR5Z4JN.0 size=1048576 2024-09-12T17:43:44.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.557+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~MR10UOR5Z4JN.1 size=310673 2024-09-12T17:43:44.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.557+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=MR10UOR5Z4JN tag=RDZZR7PN7YO5 type=write size=2407825 2024-09-12T17:43:44.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.561+0000 7f51d61a08c0 1 < completed write operation key=S292EX1P7IZA tag=GFJRAJX5QNOX type=write size=45825 2024-09-12T17:43:44.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.569+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~E47Y1VR773B0.0 size=167030 2024-09-12T17:43:44.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.569+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=E47Y1VR773B0 tag=W3KV9ECDDCQJ type=write size=1215606 2024-09-12T17:43:44.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.569+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=4V8M33OTF92X type=del 2024-09-12T17:43:44.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.573+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=5RRFT43F65IY type=del size=2985537 2024-09-12T17:43:44.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.577+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=2MHG720W93R6 type=del 2024-09-12T17:43:44.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.585+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~RV72UKMM4M9B.0 size=1048576 2024-09-12T17:43:44.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.589+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~RV72UKMM4M9B.1 size=597279 2024-09-12T17:43:44.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.589+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=RV72UKMM4M9B tag=IIUYEYULT68X type=write size=2694431 2024-09-12T17:43:44.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.593+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=LQNHT5AH55GM type=del 2024-09-12T17:43:44.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.601+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~RIVJV2M42R6X.0 size=798051 2024-09-12T17:43:44.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.601+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=RIVJV2M42R6X tag=E38KBJV04MRH type=write size=1846627 2024-09-12T17:43:44.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.609+0000 7f51d61a08c0 1 < suggested update operation key=83V7KSWRKFMZ tag=V248RE9T51HA type=write size=932758 2024-09-12T17:43:44.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.617+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~K31D957ESO32.0 size=1048576 2024-09-12T17:43:44.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.621+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~K31D957ESO32.1 size=1048576 2024-09-12T17:43:44.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.625+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~K31D957ESO32.2 size=89998 2024-09-12T17:43:44.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.625+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=K31D957ESO32 tag=JVQIKNACOKMP type=write size=3235726 2024-09-12T17:43:44.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.629+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~22B4W4Z3FAPS.0 size=836178 2024-09-12T17:43:44.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.633+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=22B4W4Z3FAPS tag=YANC70N306LP type=write size=1884754 2024-09-12T17:43:44.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.641+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~ZGB23W63M9L3.0 size=1048576 2024-09-12T17:43:44.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.645+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~ZGB23W63M9L3.1 size=629992 2024-09-12T17:43:44.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.645+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=ZGB23W63M9L3 tag=802LO2EOG3XO type=write size=2727144 2024-09-12T17:43:44.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.645+0000 7f51d61a08c0 -1 < failed to complete operation key=U3GZL9YPFMZY tag=YP5XM1ZTPB08 type=del size=492586: (22) Invalid argument 2024-09-12T17:43:44.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.653+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=UO5RI8P9M2H1 type=del size=2240939 2024-09-12T17:43:44.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.661+0000 7f51d61a08c0 1 < suggested update operation key=U3GZL9YPFMZY tag=8M30VM6GRUO1 type=del size=1472488 2024-09-12T17:43:44.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.665+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~HHVWUAUVRD51.0 size=1048576 2024-09-12T17:43:44.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.669+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~HHVWUAUVRD51.1 size=1048576 2024-09-12T17:43:44.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.673+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~HHVWUAUVRD51.2 size=796192 2024-09-12T17:43:44.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.673+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=HHVWUAUVRD51 tag=C122RI97LGZ5 type=write size=3941920 2024-09-12T17:43:44.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.677+0000 7f51d61a08c0 1 < completed write operation key=10WBH16J1AF8 tag=VQ02PT293DUR type=write size=168091 2024-09-12T17:43:44.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.681+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=8ZNWLELOOJBU type=write size=106871 2024-09-12T17:43:44.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.685+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=CPUEVBGWAR6A type=del 2024-09-12T17:43:44.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~D2V8HL1VZV5R.0 size=1048576 2024-09-12T17:43:44.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~D2V8HL1VZV5R.1 size=1048576 2024-09-12T17:43:44.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~D2V8HL1VZV5R.2 size=618973 2024-09-12T17:43:44.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.697+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=D2V8HL1VZV5R tag=LI5EZ2LXORGS type=write size=3764701 2024-09-12T17:43:44.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.701+0000 7f51d61a08c0 1 < canceled operation key=NIQAUF085D97 tag=N1NX9TO6KXI8 type=write size=152190 2024-09-12T17:43:44.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.709+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~V5KQ28HQP078.0 size=523294 2024-09-12T17:43:44.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.709+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=V5KQ28HQP078 tag=YEXU8V6B96PV type=write size=1571870 2024-09-12T17:43:44.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.713+0000 7f51d61a08c0 -1 < failed to complete operation key=U3GZL9YPFMZY tag=M6CO6JCDMTU8 type=del size=3112969: (22) Invalid argument 2024-09-12T17:43:44.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.717+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=UUIKU6MNXTR2 type=del size=4099915 2024-09-12T17:43:44.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.721+0000 7f51d61a08c0 -1 < failed to complete operation key=83V7KSWRKFMZ tag=M1DZAM612DD2 type=write size=560128: (22) Invalid argument 2024-09-12T17:43:44.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.729+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~RVFOJG8Y2GBZ.0 size=1048576 2024-09-12T17:43:44.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.733+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~RVFOJG8Y2GBZ.1 size=964489 2024-09-12T17:43:44.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.733+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=RVFOJG8Y2GBZ tag=FFJYJW3PEDCW type=write size=3061641 2024-09-12T17:43:44.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.737+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=R15623A0XETG type=del 2024-09-12T17:43:44.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.741+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=HATAFSFVK6ZL type=del size=1539313 2024-09-12T17:43:44.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.745+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~8PCG7AXB6NBG.0 size=1048576 2024-09-12T17:43:44.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.753+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~8PCG7AXB6NBG.1 size=1048576 2024-09-12T17:43:44.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.753+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~8PCG7AXB6NBG.2 size=220504 2024-09-12T17:43:44.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.761+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=8PCG7AXB6NBG tag=5UGRJ07JA8D9 type=write size=3366232 2024-09-12T17:43:44.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.769+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~63F7I44JOFDB.0 size=1048576 2024-09-12T17:43:44.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.769+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~63F7I44JOFDB.1 size=1048576 2024-09-12T17:43:44.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.773+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~63F7I44JOFDB.2 size=829133 2024-09-12T17:43:44.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.773+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=63F7I44JOFDB tag=KCOUWY3H9DDD type=write size=3974861 2024-09-12T17:43:44.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.777+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~MR10UOR5Z4JN.0 size=1048576 2024-09-12T17:43:44.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.781+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~MR10UOR5Z4JN.1 size=310673 2024-09-12T17:43:44.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.785+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=MR10UOR5Z4JN tag=RDZZR7PN7YO5 type=write size=2407825 2024-09-12T17:43:44.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.789+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=MTZZTUHCD3VX type=del size=4049331 2024-09-12T17:43:44.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.793+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~E47Y1VR773B0.0 size=167030 2024-09-12T17:43:44.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.801+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=E47Y1VR773B0 tag=W3KV9ECDDCQJ type=write size=1215606 2024-09-12T17:43:44.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.805+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=BWJK9TLUVV1K type=del size=264797 2024-09-12T17:43:44.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.809+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=5RRFT43F65IY type=del 2024-09-12T17:43:44.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.817+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~SVDPWWOQPXCS.0 size=1048576 2024-09-12T17:43:44.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.821+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~SVDPWWOQPXCS.1 size=720055 2024-09-12T17:43:44.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.821+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=SVDPWWOQPXCS tag=QOVKBRVPMGYF type=write size=2817207 2024-09-12T17:43:44.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.825+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~RV72UKMM4M9B.0 size=1048576 2024-09-12T17:43:44.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.829+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~RV72UKMM4M9B.1 size=597279 2024-09-12T17:43:44.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.833+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=RV72UKMM4M9B tag=IIUYEYULT68X type=write size=2694431 2024-09-12T17:43:44.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.841+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~GFB8AXBSUNCI.0 size=1048576 2024-09-12T17:43:44.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.845+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~GFB8AXBSUNCI.1 size=1048576 2024-09-12T17:43:44.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.849+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~GFB8AXBSUNCI.2 size=10153 2024-09-12T17:43:44.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.849+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=GFB8AXBSUNCI tag=USK4M234I7BU type=write size=3155881 2024-09-12T17:43:44.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.853+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~RIVJV2M42R6X.0 size=798051 2024-09-12T17:43:44.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.861+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=RIVJV2M42R6X tag=E38KBJV04MRH type=write size=1846627 2024-09-12T17:43:44.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.861+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=WZ4DOBOI6KE9 type=del size=478768 2024-09-12T17:43:44.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.865+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~K31D957ESO32.0 size=1048576 2024-09-12T17:43:44.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.869+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~K31D957ESO32.1 size=1048576 2024-09-12T17:43:44.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.873+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~K31D957ESO32.2 size=89998 2024-09-12T17:43:44.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.881+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=K31D957ESO32 tag=JVQIKNACOKMP type=write size=3235726 2024-09-12T17:43:44.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.885+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=BIB0AA64UBG8 type=write size=760245 2024-09-12T17:43:44.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.889+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~ZGB23W63M9L3.0 size=1048576 2024-09-12T17:43:44.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.893+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~ZGB23W63M9L3.1 size=629992 2024-09-12T17:43:44.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.901+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=ZGB23W63M9L3 tag=802LO2EOG3XO type=write size=2727144 2024-09-12T17:43:44.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.901+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=SCOXK2W9RH22 type=del size=3066414 2024-09-12T17:43:44.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.905+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=UO5RI8P9M2H1 type=del 2024-09-12T17:43:44.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.913+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~IT5EYOYNQZS3.0 size=1048576 2024-09-12T17:43:44.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.917+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~IT5EYOYNQZS3.1 size=1048576 2024-09-12T17:43:44.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.921+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~IT5EYOYNQZS3.2 size=679374 2024-09-12T17:43:44.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.921+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=IT5EYOYNQZS3 tag=D2K03ZRJBKEZ type=write size=3825102 2024-09-12T17:43:44.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.925+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~HHVWUAUVRD51.0 size=1048576 2024-09-12T17:43:44.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.929+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~HHVWUAUVRD51.1 size=1048576 2024-09-12T17:43:44.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.933+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~HHVWUAUVRD51.2 size=796192 2024-09-12T17:43:44.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.941+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=HHVWUAUVRD51 tag=C122RI97LGZ5 type=write size=3941920 2024-09-12T17:43:44.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.949+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~WDQ61FP94CKV.0 size=1048576 2024-09-12T17:43:44.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.949+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~WDQ61FP94CKV.1 size=32653 2024-09-12T17:43:44.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.949+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=WDQ61FP94CKV tag=4A43QSLMNVZR type=write size=2129805 2024-09-12T17:43:44.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.957+0000 7f51d61a08c0 1 < completed write operation key=1ZETSL5TXYSM tag=8ZNWLELOOJBU type=write size=106871 2024-09-12T17:43:44.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.961+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~YFM4ZYCZJIOJ.0 size=1048576 2024-09-12T17:43:44.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.965+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~YFM4ZYCZJIOJ.1 size=1048576 2024-09-12T17:43:44.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.969+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~YFM4ZYCZJIOJ.2 size=714075 2024-09-12T17:43:44.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.969+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=YFM4ZYCZJIOJ tag=N18ISXEKDM7N type=write size=3859803 2024-09-12T17:43:44.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.973+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~D2V8HL1VZV5R.0 size=1048576 2024-09-12T17:43:44.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.977+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~D2V8HL1VZV5R.1 size=1048576 2024-09-12T17:43:44.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.977+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~D2V8HL1VZV5R.2 size=618973 2024-09-12T17:43:44.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.985+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=D2V8HL1VZV5R tag=LI5EZ2LXORGS type=write size=3764701 2024-09-12T17:43:44.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.993+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~ERRPYTF8FQXA.0 size=1048576 2024-09-12T17:43:44.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.997+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~ERRPYTF8FQXA.1 size=469247 2024-09-12T17:43:44.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:44.997+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=ERRPYTF8FQXA tag=NZGZ366R2TOH type=write size=2566399 2024-09-12T17:43:45.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.001+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~V5KQ28HQP078.0 size=523294 2024-09-12T17:43:45.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.005+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=V5KQ28HQP078 tag=YEXU8V6B96PV type=write size=1571870 2024-09-12T17:43:45.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.009+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=GL5N8OZI9DC2 type=write size=77206 2024-09-12T17:43:45.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.013+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=UUIKU6MNXTR2 type=del 2024-09-12T17:43:45.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.017+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=8RNBHI9FRPYH type=del size=902395 2024-09-12T17:43:45.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.021+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~RVFOJG8Y2GBZ.0 size=1048576 2024-09-12T17:43:45.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.021+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~RVFOJG8Y2GBZ.1 size=964489 2024-09-12T17:43:45.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.029+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=RVFOJG8Y2GBZ tag=FFJYJW3PEDCW type=write size=3061641 2024-09-12T17:43:45.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.029+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=FIEGF9LNZLCB type=write size=889752 2024-09-12T17:43:45.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.033+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=HATAFSFVK6ZL type=del 2024-09-12T17:43:45.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.037+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=LP7CLX3Q4XGD type=write size=559739 2024-09-12T17:43:45.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.041+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~63F7I44JOFDB.0 size=1048576 2024-09-12T17:43:45.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.045+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~63F7I44JOFDB.1 size=1048576 2024-09-12T17:43:45.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.049+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~63F7I44JOFDB.2 size=829133 2024-09-12T17:43:45.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.053+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=63F7I44JOFDB tag=KCOUWY3H9DDD type=write size=3974861 2024-09-12T17:43:45.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.057+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=TID704OLJ0WE type=del size=3963852 2024-09-12T17:43:45.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.061+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=MTZZTUHCD3VX type=del 2024-09-12T17:43:45.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.065+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=L5HZNZICMU96 type=del size=1273070 2024-09-12T17:43:45.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.069+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=BWJK9TLUVV1K type=del 2024-09-12T17:43:45.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.073+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=OUDWA25TB95O type=del size=1187593 2024-09-12T17:43:45.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.077+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~SVDPWWOQPXCS.0 size=1048576 2024-09-12T17:43:45.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.077+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~SVDPWWOQPXCS.1 size=720055 2024-09-12T17:43:45.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.085+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=SVDPWWOQPXCS tag=QOVKBRVPMGYF type=write size=2817207 2024-09-12T17:43:45.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.089+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=CSDXIRPEWPUM type=del size=103879 2024-09-12T17:43:45.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.089+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~GFB8AXBSUNCI.0 size=1048576 2024-09-12T17:43:45.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.089+0000 7f51d61a08c0 1 < canceled part key=_multipart_I22NJJISU96B.2~GFB8AXBSUNCI.1 size=1048576 2024-09-12T17:43:45.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.093+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~GFB8AXBSUNCI.2 size=10153 2024-09-12T17:43:45.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.101+0000 7f51d61a08c0 1 < canceled multipart upload key=I22NJJISU96B upload=GFB8AXBSUNCI tag=USK4M234I7BU type=write size=3155881 2024-09-12T17:43:45.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.105+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=QQ3KFO5NMFU3 type=write size=773407 2024-09-12T17:43:45.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.109+0000 7f51d61a08c0 1 < canceled operation key=DCLENF1A1W2Q tag=WZ4DOBOI6KE9 type=del size=478768 2024-09-12T17:43:45.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.113+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=7TLGGAD9S9V7 type=del size=379838 2024-09-12T17:43:45.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.117+0000 7f51d61a08c0 1 < canceled operation key=3LE20KMMPH8P tag=BIB0AA64UBG8 type=write size=760245 2024-09-12T17:43:45.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.121+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=KG349TJPNMJW type=del size=1242554 2024-09-12T17:43:45.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.125+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=SCOXK2W9RH22 type=del 2024-09-12T17:43:45.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.133+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~DYTDI1MAI4N2.0 size=1048576 2024-09-12T17:43:45.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.133+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~DYTDI1MAI4N2.1 size=1048576 2024-09-12T17:43:45.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.137+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~DYTDI1MAI4N2.2 size=165473 2024-09-12T17:43:45.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.137+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=DYTDI1MAI4N2 tag=VOJMIIY1QGIR type=write size=3311201 2024-09-12T17:43:45.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.141+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~IT5EYOYNQZS3.0 size=1048576 2024-09-12T17:43:45.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.145+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~IT5EYOYNQZS3.1 size=1048576 2024-09-12T17:43:45.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.149+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~IT5EYOYNQZS3.2 size=679374 2024-09-12T17:43:45.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.157+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=IT5EYOYNQZS3 tag=D2K03ZRJBKEZ type=write size=3825102 2024-09-12T17:43:45.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.161+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=KUCFVMQ3RCWT type=del size=381943 2024-09-12T17:43:45.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.165+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~WDQ61FP94CKV.0 size=1048576 2024-09-12T17:43:45.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.165+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~WDQ61FP94CKV.1 size=32653 2024-09-12T17:43:45.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.173+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=WDQ61FP94CKV tag=4A43QSLMNVZR type=write size=2129805 2024-09-12T17:43:45.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.181+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~GFF1OL65FRI9.0 size=1048576 2024-09-12T17:43:45.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.181+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~GFF1OL65FRI9.1 size=1048576 2024-09-12T17:43:45.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.185+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~GFF1OL65FRI9.2 size=269060 2024-09-12T17:43:45.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.185+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=GFF1OL65FRI9 tag=RSOTNIJJT27C type=write size=3414788 2024-09-12T17:43:45.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.189+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~YFM4ZYCZJIOJ.0 size=1048576 2024-09-12T17:43:45.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.193+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~YFM4ZYCZJIOJ.1 size=1048576 2024-09-12T17:43:45.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.193+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~YFM4ZYCZJIOJ.2 size=714075 2024-09-12T17:43:45.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.201+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=YFM4ZYCZJIOJ tag=N18ISXEKDM7N type=write size=3859803 2024-09-12T17:43:45.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.205+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=AMR5DYTJBVGX type=del size=2373365 2024-09-12T17:43:45.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.209+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~ERRPYTF8FQXA.0 size=1048576 2024-09-12T17:43:45.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.213+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~ERRPYTF8FQXA.1 size=469247 2024-09-12T17:43:45.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.217+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=ERRPYTF8FQXA tag=NZGZ366R2TOH type=write size=2566399 2024-09-12T17:43:45.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.225+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~16XGUZ5PMV91.0 size=1048576 2024-09-12T17:43:45.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.229+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~16XGUZ5PMV91.1 size=516141 2024-09-12T17:43:45.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.229+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=16XGUZ5PMV91 tag=123GP4PKMPXY type=write size=2613293 2024-09-12T17:43:45.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.237+0000 7f51d61a08c0 1 < suggested remove operation key=JT373R4HAJZS tag=GL5N8OZI9DC2 type=write 2024-09-12T17:43:45.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.241+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=GA8RVL96ZVII type=write size=696771 2024-09-12T17:43:45.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.245+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=8RNBHI9FRPYH type=del 2024-09-12T17:43:45.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.249+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=83MA4BGT7AWD type=del size=3079515 2024-09-12T17:43:45.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.253+0000 7f51d61a08c0 1 < completed write operation key=593CD3H40DFH tag=FIEGF9LNZLCB type=write size=889752 2024-09-12T17:43:45.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.257+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=QHEUEAX4ECP2 type=del size=3350469 2024-09-12T17:43:45.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.261+0000 7f51d61a08c0 1 < completed write operation key=7FBK3439R80H tag=LP7CLX3Q4XGD type=write size=559739 2024-09-12T17:43:45.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.265+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=RO95F06XBT6K type=del size=3197158 2024-09-12T17:43:45.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.269+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=TID704OLJ0WE type=del 2024-09-12T17:43:45.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.273+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=ZKWMZJJ3AMJK type=del size=1193051 2024-09-12T17:43:45.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.277+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=L5HZNZICMU96 type=del 2024-09-12T17:43:45.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.281+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=ON6UZSNX6EWF type=del size=3848608 2024-09-12T17:43:45.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.285+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=OUDWA25TB95O type=del 2024-09-12T17:43:45.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.289+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=4RMXT9Y3QXRV type=write size=142712 2024-09-12T17:43:45.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.293+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=CSDXIRPEWPUM type=del 2024-09-12T17:43:45.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.297+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=959TTIHF0CG2 type=write size=446373 2024-09-12T17:43:45.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.305+0000 7f51d61a08c0 1 < suggested update operation key=10WBH16J1AF8 tag=QQ3KFO5NMFU3 type=write size=773407 2024-09-12T17:43:45.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.309+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=QUR1C0G1SVFE type=del size=2323870 2024-09-12T17:43:45.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.313+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=7TLGGAD9S9V7 type=del 2024-09-12T17:43:45.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.317+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~TH6331QJ10P4.0 size=543489 2024-09-12T17:43:45.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.317+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=TH6331QJ10P4 tag=K118CHU1KDHO type=write size=1592065 2024-09-12T17:43:45.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.325+0000 7f51d61a08c0 1 < suggested update operation key=GJX1YGAQFXZ2 tag=KG349TJPNMJW type=del size=1242554 2024-09-12T17:43:45.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.329+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=HYO99DAU0Y5I type=del size=2924573 2024-09-12T17:43:45.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.333+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~DYTDI1MAI4N2.0 size=1048576 2024-09-12T17:43:45.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.337+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~DYTDI1MAI4N2.1 size=1048576 2024-09-12T17:43:45.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.341+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~DYTDI1MAI4N2.2 size=165473 2024-09-12T17:43:45.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.349+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=DYTDI1MAI4N2 tag=VOJMIIY1QGIR type=write size=3311201 2024-09-12T17:43:45.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.353+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=OQKD72O3NV2T type=write size=32726 2024-09-12T17:43:45.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.357+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=KUCFVMQ3RCWT type=del 2024-09-12T17:43:45.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.361+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=O7P3RY7J906A type=write size=590378 2024-09-12T17:43:45.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.361+0000 7f51d61a08c0 1 < canceled part key=_multipart_83V7KSWRKFMZ.2~GFF1OL65FRI9.0 size=1048576 2024-09-12T17:43:45.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.365+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~GFF1OL65FRI9.1 size=1048576 2024-09-12T17:43:45.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.365+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~GFF1OL65FRI9.2 size=269060 2024-09-12T17:43:45.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.373+0000 7f51d61a08c0 1 < canceled multipart upload key=83V7KSWRKFMZ upload=GFF1OL65FRI9 tag=RSOTNIJJT27C type=write size=3414788 2024-09-12T17:43:45.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.377+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=DBFVKK8H0T37 type=del size=501798 2024-09-12T17:43:45.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.381+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=AMR5DYTJBVGX type=del 2024-09-12T17:43:45.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.385+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=RPQUWQFAPKF2 type=write size=616924 2024-09-12T17:43:45.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.389+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~16XGUZ5PMV91.0 size=1048576 2024-09-12T17:43:45.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.389+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~16XGUZ5PMV91.1 size=516141 2024-09-12T17:43:45.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.397+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=16XGUZ5PMV91 tag=123GP4PKMPXY type=write size=2613293 2024-09-12T17:43:45.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.405+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~X3OIM4MTVVOO.0 size=1048576 2024-09-12T17:43:45.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.405+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~X3OIM4MTVVOO.1 size=127412 2024-09-12T17:43:45.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.405+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=X3OIM4MTVVOO tag=6NJEQYL4EQ96 type=write size=2224564 2024-09-12T17:43:45.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.409+0000 7f51d61a08c0 1 < completed write operation key=IWEJXLG1CDAV tag=GA8RVL96ZVII type=write size=696771 2024-09-12T17:43:45.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.413+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=XXJB4OYY1183 type=del size=3335628 2024-09-12T17:43:45.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.417+0000 7f51d61a08c0 1 < canceled operation key=NIQAUF085D97 tag=83MA4BGT7AWD type=del size=3079515 2024-09-12T17:43:45.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.421+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=JAL643WCSVYD type=del size=935032 2024-09-12T17:43:45.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.425+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=QHEUEAX4ECP2 type=del 2024-09-12T17:43:45.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.433+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~03LWJ82EHD4R.0 size=969505 2024-09-12T17:43:45.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.433+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=03LWJ82EHD4R tag=FFYBPBACDLCB type=write size=2018081 2024-09-12T17:43:45.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.437+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=RO95F06XBT6K type=del 2024-09-12T17:43:45.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.441+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=4GMFCQSITDMI type=write size=525734 2024-09-12T17:43:45.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.445+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=ZKWMZJJ3AMJK type=del 2024-09-12T17:43:45.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.449+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=IL9V633K92KZ type=del size=3448242 2024-09-12T17:43:45.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.453+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=ON6UZSNX6EWF type=del 2024-09-12T17:43:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.457+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=EBALV7N1QCUV type=del size=338880 2024-09-12T17:43:45.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.469+0000 7f51d61a08c0 1 < suggested remove operation key=I22NJJISU96B tag=4RMXT9Y3QXRV type=write 2024-09-12T17:43:45.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.473+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=E6EEI4KF75XB type=del size=272845 2024-09-12T17:43:45.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.477+0000 7f51d61a08c0 1 < suggested update operation key=EDVAEE9FKH1T tag=959TTIHF0CG2 type=write size=446373 2024-09-12T17:43:45.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.481+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=6YE0OZ5O20BT type=del size=1827541 2024-09-12T17:43:45.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.485+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=QUR1C0G1SVFE type=del 2024-09-12T17:43:45.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.489+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=HFRHFJ01U4L3 type=write size=932863 2024-09-12T17:43:45.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.493+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~TH6331QJ10P4.0 size=543489 2024-09-12T17:43:45.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.501+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=TH6331QJ10P4 tag=K118CHU1KDHO type=write size=1592065 2024-09-12T17:43:45.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.505+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=YJ7CY19LYGGX type=del size=2173216 2024-09-12T17:43:45.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.509+0000 7f51d61a08c0 1 < suggested remove operation key=A7V478K2SNOF tag=HYO99DAU0Y5I type=del 2024-09-12T17:43:45.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.517+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=7X8CD1GANY75 type=write size=248578 2024-09-12T17:43:45.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.517+0000 7f51d61a08c0 -1 < no bi entry to suggest for operation key=A7V478K2SNOF tag=OQKD72O3NV2T type=write size=32726: (2) No such file or directory 2024-09-12T17:43:45.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.521+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=UKR2IA82HBO6 type=del size=1774017 2024-09-12T17:43:45.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.525+0000 7f51d61a08c0 1 < completed write operation key=S292EX1P7IZA tag=O7P3RY7J906A type=write size=590378 2024-09-12T17:43:45.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.529+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=YFGS88F0I6ZH type=write size=496743 2024-09-12T17:43:45.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.533+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=DBFVKK8H0T37 type=del 2024-09-12T17:43:45.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.537+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=RJNBXZX68EF1 type=del size=3279962 2024-09-12T17:43:45.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.541+0000 7f51d61a08c0 1 < completed write operation key=FKKV7SXZSP90 tag=RPQUWQFAPKF2 type=write size=616924 2024-09-12T17:43:45.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.545+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=ZFSFDACMULKS type=write size=724689 2024-09-12T17:43:45.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.549+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~X3OIM4MTVVOO.0 size=1048576 2024-09-12T17:43:45.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.553+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~X3OIM4MTVVOO.1 size=127412 2024-09-12T17:43:45.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.561+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=X3OIM4MTVVOO tag=6NJEQYL4EQ96 type=write size=2224564 2024-09-12T17:43:45.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.565+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=Z8YNK21NUIUW type=del size=1644957 2024-09-12T17:43:45.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.569+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=XXJB4OYY1183 type=del 2024-09-12T17:43:45.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.573+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~K40H2V3F2H9W.0 size=1048576 2024-09-12T17:43:45.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~K40H2V3F2H9W.1 size=216070 2024-09-12T17:43:45.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.577+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=K40H2V3F2H9W tag=L3XHB70CRI3A type=write size=2313222 2024-09-12T17:43:45.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.585+0000 7f51d61a08c0 1 < suggested remove operation key=JT373R4HAJZS tag=JAL643WCSVYD type=del 2024-09-12T17:43:45.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.589+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=7XBDG834W1UL type=del size=2257525 2024-09-12T17:43:45.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.593+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~03LWJ82EHD4R.0 size=969505 2024-09-12T17:43:45.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.597+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=03LWJ82EHD4R tag=FFYBPBACDLCB type=write size=2018081 2024-09-12T17:43:45.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.605+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~4JPMVPP6U3A0.0 size=1048576 2024-09-12T17:43:45.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.609+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~4JPMVPP6U3A0.1 size=33770 2024-09-12T17:43:45.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.609+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=4JPMVPP6U3A0 tag=F0HHVY1SXXRY type=write size=2130922 2024-09-12T17:43:45.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.617+0000 7f51d61a08c0 1 < suggested update operation key=96OWZQXI2ALM tag=4GMFCQSITDMI type=write size=525734 2024-09-12T17:43:45.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.621+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=O9XFEWNDGZGR type=del size=4075772 2024-09-12T17:43:45.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.625+0000 7f51d61a08c0 1 < suggested update operation key=593CD3H40DFH tag=IL9V633K92KZ type=del size=3448242 2024-09-12T17:43:45.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.629+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=SF4SNXPSUHQL type=del size=3847537 2024-09-12T17:43:45.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.633+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=EBALV7N1QCUV type=del 2024-09-12T17:43:45.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.637+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=PA7YR02N3VAM type=del size=3999715 2024-09-12T17:43:45.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.641+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=E6EEI4KF75XB type=del 2024-09-12T17:43:45.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.649+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~06K4X97D6H1G.0 size=1048576 2024-09-12T17:43:45.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.653+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~06K4X97D6H1G.1 size=257104 2024-09-12T17:43:45.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.653+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=06K4X97D6H1G tag=G7T4V5ZSTCWK type=write size=2354256 2024-09-12T17:43:45.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.657+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=6YE0OZ5O20BT type=del 2024-09-12T17:43:45.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.661+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=RZNKNSR13XI3 type=del size=129864 2024-09-12T17:43:45.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.665+0000 7f51d61a08c0 1 < completed write operation key=92CMI8Q29LB3 tag=HFRHFJ01U4L3 type=write size=932863 2024-09-12T17:43:45.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.669+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~NT7GGZZI3LUC.0 size=1023283 2024-09-12T17:43:45.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.669+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=NT7GGZZI3LUC tag=G0RUZ4TEGXN9 type=write size=2071859 2024-09-12T17:43:45.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.677+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=YJ7CY19LYGGX type=del 2024-09-12T17:43:45.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.677+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=QIUU4XICJI3H type=del size=1072032 2024-09-12T17:43:45.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.681+0000 7f51d61a08c0 -1 < failed to complete operation key=96OWZQXI2ALM tag=7X8CD1GANY75 type=write size=248578: (22) Invalid argument 2024-09-12T17:43:45.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.689+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=MQCH75AQ122J type=del size=4053121 2024-09-12T17:43:45.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.693+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=UKR2IA82HBO6 type=del 2024-09-12T17:43:45.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~FWSHOG5I0XYQ.0 size=560214 2024-09-12T17:43:45.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.697+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=FWSHOG5I0XYQ tag=VTXDV84CVKT1 type=write size=1608790 2024-09-12T17:43:45.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.701+0000 7f51d61a08c0 1 < completed write operation key=NIQAUF085D97 tag=YFGS88F0I6ZH type=write size=496743 2024-09-12T17:43:45.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.709+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~OCOU6LYW6U2F.0 size=1048576 2024-09-12T17:43:45.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.713+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~OCOU6LYW6U2F.1 size=569040 2024-09-12T17:43:45.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.713+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=OCOU6LYW6U2F tag=SASQYEIS4GUW type=write size=2666192 2024-09-12T17:43:45.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.717+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=RJNBXZX68EF1 type=del 2024-09-12T17:43:45.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.721+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=O1RR3HRRFM66 type=del size=2958656 2024-09-12T17:43:45.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.725+0000 7f51d61a08c0 1 < completed write operation key=83V7KSWRKFMZ tag=ZFSFDACMULKS type=write size=724689 2024-09-12T17:43:45.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.733+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~NK03093TBU2E.0 size=1048576 2024-09-12T17:43:45.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.733+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~NK03093TBU2E.1 size=1048576 2024-09-12T17:43:45.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.737+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~NK03093TBU2E.2 size=41641 2024-09-12T17:43:45.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.737+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=NK03093TBU2E tag=K27TPF0KBVOD type=write size=3187369 2024-09-12T17:43:45.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.745+0000 7f51d61a08c0 1 < suggested update operation key=GJX1YGAQFXZ2 tag=Z8YNK21NUIUW type=del size=1644957 2024-09-12T17:43:45.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.753+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~J55N78L48KH7.0 size=592788 2024-09-12T17:43:45.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.753+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=J55N78L48KH7 tag=90FDPTSSG6DQ type=write size=1641364 2024-09-12T17:43:45.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.757+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~K40H2V3F2H9W.0 size=1048576 2024-09-12T17:43:45.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.757+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~K40H2V3F2H9W.1 size=216070 2024-09-12T17:43:45.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.765+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=K40H2V3F2H9W tag=L3XHB70CRI3A type=write size=2313222 2024-09-12T17:43:45.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.773+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~KYRD367SCK0B.0 size=455569 2024-09-12T17:43:45.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.773+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=KYRD367SCK0B tag=6KFL1BOAAQYS type=write size=1504145 2024-09-12T17:43:45.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.777+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=7XBDG834W1UL type=del 2024-09-12T17:43:45.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.785+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~YU87B0JWFVYH.0 size=1042164 2024-09-12T17:43:45.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.785+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=YU87B0JWFVYH tag=XD18SJ5AC2MP type=write size=2090740 2024-09-12T17:43:45.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.789+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~4JPMVPP6U3A0.0 size=1048576 2024-09-12T17:43:45.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.789+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~4JPMVPP6U3A0.1 size=33770 2024-09-12T17:43:45.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.797+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=4JPMVPP6U3A0 tag=F0HHVY1SXXRY type=write size=2130922 2024-09-12T17:43:45.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.801+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=30VX1U332YB2 type=del size=3397965 2024-09-12T17:43:45.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.805+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=O9XFEWNDGZGR type=del 2024-09-12T17:43:45.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.813+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~KJKWBKGC9TKN.0 size=1048576 2024-09-12T17:43:45.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.817+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~KJKWBKGC9TKN.1 size=931158 2024-09-12T17:43:45.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.817+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=KJKWBKGC9TKN tag=BOA70HK047Z4 type=write size=3028310 2024-09-12T17:43:45.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.821+0000 7f51d61a08c0 1 < canceled operation key=83V7KSWRKFMZ tag=SF4SNXPSUHQL type=del size=3847537 2024-09-12T17:43:45.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.825+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=85K5LBTUZVSS type=del size=2634495 2024-09-12T17:43:45.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.829+0000 7f51d61a08c0 1 < canceled operation key=96OWZQXI2ALM tag=PA7YR02N3VAM type=del size=3999715 2024-09-12T17:43:45.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.837+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=8WK8FDFEJJ5U type=del size=114556 2024-09-12T17:43:45.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.841+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~06K4X97D6H1G.0 size=1048576 2024-09-12T17:43:45.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.845+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~06K4X97D6H1G.1 size=257104 2024-09-12T17:43:45.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.849+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=06K4X97D6H1G tag=G7T4V5ZSTCWK type=write size=2354256 2024-09-12T17:43:45.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.857+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=769K2N864UIE type=del size=2901352 2024-09-12T17:43:45.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.861+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=RZNKNSR13XI3 type=del 2024-09-12T17:43:45.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.865+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=DWUPYS9KBUFV type=del size=3824785 2024-09-12T17:43:45.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.869+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~NT7GGZZI3LUC.0 size=1023283 2024-09-12T17:43:45.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.873+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=NT7GGZZI3LUC tag=G0RUZ4TEGXN9 type=write size=2071859 2024-09-12T17:43:45.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.877+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=817JDMPHAJ5P type=del size=658913 2024-09-12T17:43:45.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.885+0000 7f51d61a08c0 1 < suggested update operation key=A7V478K2SNOF tag=QIUU4XICJI3H type=del size=1072032 2024-09-12T17:43:45.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.893+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~DFZZBPOWMZJJ.0 size=1048576 2024-09-12T17:43:45.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.897+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~DFZZBPOWMZJJ.1 size=515953 2024-09-12T17:43:45.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.897+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=DFZZBPOWMZJJ tag=OMK3A1SIMB7W type=write size=2613105 2024-09-12T17:43:45.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.901+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=MQCH75AQ122J type=del 2024-09-12T17:43:45.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.901+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=24E7KIZU1630 type=del size=2439974 2024-09-12T17:43:45.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.905+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~FWSHOG5I0XYQ.0 size=560214 2024-09-12T17:43:45.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.913+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=FWSHOG5I0XYQ tag=VTXDV84CVKT1 type=write size=1608790 2024-09-12T17:43:45.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.917+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=GN9BORWL26YU type=del size=1814112 2024-09-12T17:43:45.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.921+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~OCOU6LYW6U2F.0 size=1048576 2024-09-12T17:43:45.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.925+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~OCOU6LYW6U2F.1 size=569040 2024-09-12T17:43:45.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.929+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=OCOU6LYW6U2F tag=SASQYEIS4GUW type=write size=2666192 2024-09-12T17:43:45.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.933+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=ZN44ZKNUWG3V type=del size=2810406 2024-09-12T17:43:45.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.937+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=O1RR3HRRFM66 type=del 2024-09-12T17:43:45.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.945+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~D446D6JG8TNY.0 size=1048576 2024-09-12T17:43:45.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.945+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~D446D6JG8TNY.1 size=1048576 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.949+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~D446D6JG8TNY.2 size=255353 2024-09-12T17:43:45.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.949+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=D446D6JG8TNY tag=Q431KBW1575F type=write size=3401081 2024-09-12T17:43:45.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.953+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~NK03093TBU2E.0 size=1048576 2024-09-12T17:43:45.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.957+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~NK03093TBU2E.1 size=1048576 2024-09-12T17:43:45.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.961+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~NK03093TBU2E.2 size=41641 2024-09-12T17:43:45.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.965+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=NK03093TBU2E tag=K27TPF0KBVOD type=write size=3187369 2024-09-12T17:43:45.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.969+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=3QU8MUOEGU0S type=del size=1572824 2024-09-12T17:43:45.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.973+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~J55N78L48KH7.0 size=592788 2024-09-12T17:43:45.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.981+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=J55N78L48KH7 tag=90FDPTSSG6DQ type=write size=1641364 2024-09-12T17:43:45.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.985+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~NM24SN4TUXGP.0 size=1048576 2024-09-12T17:43:45.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.989+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~NM24SN4TUXGP.1 size=1048576 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.993+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~NM24SN4TUXGP.2 size=439599 2024-09-12T17:43:45.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.993+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=NM24SN4TUXGP tag=VQ01ASQJP3FZ type=write size=3585327 2024-09-12T17:43:45.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:45.997+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~KYRD367SCK0B.0 size=455569 2024-09-12T17:43:46.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.001+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=KYRD367SCK0B tag=6KFL1BOAAQYS type=write size=1504145 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.009+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~MU5ZOQYST4WC.0 size=455753 2024-09-12T17:43:46.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.009+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=MU5ZOQYST4WC tag=ZTLM19CU8WSZ type=write size=1504329 2024-09-12T17:43:46.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.013+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~YU87B0JWFVYH.0 size=1042164 2024-09-12T17:43:46.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.021+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=YU87B0JWFVYH tag=XD18SJ5AC2MP type=write size=2090740 2024-09-12T17:43:46.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.025+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~14IJUJ1JGAGC.0 size=1048576 2024-09-12T17:43:46.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.029+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~14IJUJ1JGAGC.1 size=1048576 2024-09-12T17:43:46.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.033+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~14IJUJ1JGAGC.2 size=867540 2024-09-12T17:43:46.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.033+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=14IJUJ1JGAGC tag=27YWGKVUD5HY type=write size=4013268 2024-09-12T17:43:46.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.041+0000 7f51d61a08c0 1 < suggested update operation key=ZCB4V47S38TN tag=30VX1U332YB2 type=del size=3397965 2024-09-12T17:43:46.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.045+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=CLU57OF68T1E type=del size=3045590 2024-09-12T17:43:46.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.049+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~KJKWBKGC9TKN.0 size=1048576 2024-09-12T17:43:46.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.053+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~KJKWBKGC9TKN.1 size=931158 2024-09-12T17:43:46.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.057+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=KJKWBKGC9TKN tag=BOA70HK047Z4 type=write size=3028310 2024-09-12T17:43:46.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.061+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=TX3R4U2AL1GF type=del size=2794509 2024-09-12T17:43:46.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.065+0000 7f51d61a08c0 1 < canceled operation key=NIQAUF085D97 tag=85K5LBTUZVSS type=del size=2634495 2024-09-12T17:43:46.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.073+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~TZTNX2CMBEMG.0 size=1048576 2024-09-12T17:43:46.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.077+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~TZTNX2CMBEMG.1 size=1048576 2024-09-12T17:43:46.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.081+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~TZTNX2CMBEMG.2 size=1011515 2024-09-12T17:43:46.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.081+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=TZTNX2CMBEMG tag=KZUKAM1DKSHV type=write size=4157243 2024-09-12T17:43:46.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.085+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=8WK8FDFEJJ5U type=del 2024-09-12T17:43:46.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.089+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=ST6I8ON1YXZ8 type=del size=1500413 2024-09-12T17:43:46.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.093+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=769K2N864UIE type=del 2024-09-12T17:43:46.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.097+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~0LK6OCIUWXKI.0 size=1048576 2024-09-12T17:43:46.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.101+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~0LK6OCIUWXKI.1 size=1048576 2024-09-12T17:43:46.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.105+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~0LK6OCIUWXKI.2 size=911486 2024-09-12T17:43:46.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.105+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=0LK6OCIUWXKI tag=6V6B85B6IIRW type=write size=4057214 2024-09-12T17:43:46.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.109+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=DWUPYS9KBUFV type=del 2024-09-12T17:43:46.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.113+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=TFDJ3P6KRB0J type=del size=3310440 2024-09-12T17:43:46.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.117+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=817JDMPHAJ5P type=del 2024-09-12T17:43:46.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.121+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=L9UY4CMJFEHA type=write size=147801 2024-09-12T17:43:46.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.121+0000 7f51d61a08c0 1 < canceled part key=_multipart_HY2US2MMDNI4.2~DFZZBPOWMZJJ.0 size=1048576 2024-09-12T17:43:46.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.125+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~DFZZBPOWMZJJ.1 size=515953 2024-09-12T17:43:46.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.129+0000 7f51d61a08c0 1 < canceled multipart upload key=HY2US2MMDNI4 upload=DFZZBPOWMZJJ tag=OMK3A1SIMB7W type=write size=2613105 2024-09-12T17:43:46.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.137+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~NMLQK51A325K.0 size=38637 2024-09-12T17:43:46.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.137+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=NMLQK51A325K tag=F05Y4ODE87YQ type=write size=1087213 2024-09-12T17:43:46.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.141+0000 7f51d61a08c0 1 < canceled operation key=92CMI8Q29LB3 tag=24E7KIZU1630 type=del size=2439974 2024-09-12T17:43:46.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.145+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=LZ3POG0J3DXF type=del size=1055412 2024-09-12T17:43:46.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.149+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=GN9BORWL26YU type=del 2024-09-12T17:43:46.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.153+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~KMS22TVFV1BB.0 size=958800 2024-09-12T17:43:46.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.153+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=KMS22TVFV1BB tag=V4Q93DVZS1VO type=write size=2007376 2024-09-12T17:43:46.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.157+0000 7f51d61a08c0 1 < canceled operation key=I22NJJISU96B tag=ZN44ZKNUWG3V type=del size=2810406 2024-09-12T17:43:46.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.161+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=9K1X3BNN2TJ6 type=del size=2364917 2024-09-12T17:43:46.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.165+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~D446D6JG8TNY.0 size=1048576 2024-09-12T17:43:46.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.169+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~D446D6JG8TNY.1 size=1048576 2024-09-12T17:43:46.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.173+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~D446D6JG8TNY.2 size=255353 2024-09-12T17:43:46.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.177+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=D446D6JG8TNY tag=Q431KBW1575F type=write size=3401081 2024-09-12T17:43:46.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.181+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=BFGNHKOPCT9X type=del size=3795705 2024-09-12T17:43:46.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.189+0000 7f51d61a08c0 1 < canceled operation key=1ZETSL5TXYSM tag=3QU8MUOEGU0S type=del size=1572824 2024-09-12T17:43:46.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.193+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=NT2RHHG5KIDX type=del size=893241 2024-09-12T17:43:46.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.197+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~NM24SN4TUXGP.0 size=1048576 2024-09-12T17:43:46.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.201+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~NM24SN4TUXGP.1 size=1048576 2024-09-12T17:43:46.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.201+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~NM24SN4TUXGP.2 size=439599 2024-09-12T17:43:46.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.209+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=NM24SN4TUXGP tag=VQ01ASQJP3FZ type=write size=3585327 2024-09-12T17:43:46.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.217+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~CLZN1UETM2T3.0 size=1048576 2024-09-12T17:43:46.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.217+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~CLZN1UETM2T3.1 size=1048576 2024-09-12T17:43:46.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.221+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~CLZN1UETM2T3.2 size=536002 2024-09-12T17:43:46.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.221+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=CLZN1UETM2T3 tag=M5GDD4W2DV5B type=write size=3681730 2024-09-12T17:43:46.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.225+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~MU5ZOQYST4WC.0 size=455753 2024-09-12T17:43:46.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.233+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=MU5ZOQYST4WC tag=ZTLM19CU8WSZ type=write size=1504329 2024-09-12T17:43:46.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.241+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~9CW3WEE4ED6M.0 size=1048576 2024-09-12T17:43:46.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.241+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~9CW3WEE4ED6M.1 size=1048576 2024-09-12T17:43:46.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.245+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~9CW3WEE4ED6M.2 size=924672 2024-09-12T17:43:46.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.245+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=9CW3WEE4ED6M tag=QKKF6KY5RSMR type=write size=4070400 2024-09-12T17:43:46.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.249+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~14IJUJ1JGAGC.0 size=1048576 2024-09-12T17:43:46.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.257+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~14IJUJ1JGAGC.1 size=1048576 2024-09-12T17:43:46.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.257+0000 7f51d61a08c0 1 < canceled part key=_multipart_10WBH16J1AF8.2~14IJUJ1JGAGC.2 size=867540 2024-09-12T17:43:46.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.261+0000 7f51d61a08c0 1 < canceled multipart upload key=10WBH16J1AF8 upload=14IJUJ1JGAGC tag=27YWGKVUD5HY type=write size=4013268 2024-09-12T17:43:46.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.265+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=2ZZ2NLZFN1WX type=del size=3607949 2024-09-12T17:43:46.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.273+0000 7f51d61a08c0 1 < suggested update operation key=FKKV7SXZSP90 tag=CLU57OF68T1E type=del size=3045590 2024-09-12T17:43:46.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.277+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=V8YCM9FLBDD7 type=del size=1024314 2024-09-12T17:43:46.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.281+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=TX3R4U2AL1GF type=del 2024-09-12T17:43:46.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.289+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=QS5PNX1QQGA1 type=del size=2240167 2024-09-12T17:43:46.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.289+0000 7f51d61a08c0 1 < canceled part key=_multipart_10WBH16J1AF8.2~TZTNX2CMBEMG.0 size=1048576 2024-09-12T17:43:46.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.293+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~TZTNX2CMBEMG.1 size=1048576 2024-09-12T17:43:46.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.293+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~TZTNX2CMBEMG.2 size=1011515 2024-09-12T17:43:46.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.301+0000 7f51d61a08c0 1 < canceled multipart upload key=10WBH16J1AF8 upload=TZTNX2CMBEMG tag=KZUKAM1DKSHV type=write size=4157243 2024-09-12T17:43:46.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.309+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~NEJ4FGG47C0K.0 size=328969 2024-09-12T17:43:46.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.309+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=NEJ4FGG47C0K tag=8OIYQ68WQINI type=write size=1377545 2024-09-12T17:43:46.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.317+0000 7f51d61a08c0 1 < suggested update operation key=92CMI8Q29LB3 tag=ST6I8ON1YXZ8 type=del size=1500413 2024-09-12T17:43:46.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.325+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~0043OKOTTT3C.0 size=1048576 2024-09-12T17:43:46.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.329+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~0043OKOTTT3C.1 size=817626 2024-09-12T17:43:46.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.329+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=0043OKOTTT3C tag=RSAL3ETSOWWV type=write size=2914778 2024-09-12T17:43:46.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.333+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~0LK6OCIUWXKI.0 size=1048576 2024-09-12T17:43:46.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.337+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~0LK6OCIUWXKI.1 size=1048576 2024-09-12T17:43:46.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.337+0000 7f51d61a08c0 1 < canceled part key=_multipart_26X723PN8K8T.2~0LK6OCIUWXKI.2 size=911486 2024-09-12T17:43:46.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.341+0000 7f51d61a08c0 1 < canceled multipart upload key=26X723PN8K8T upload=0LK6OCIUWXKI tag=6V6B85B6IIRW type=write size=4057214 2024-09-12T17:43:46.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.345+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=7ED91MF029QN type=write size=15137 2024-09-12T17:43:46.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.353+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=TFDJ3P6KRB0J type=del 2024-09-12T17:43:46.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.357+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=9KKDFV039N78 type=write size=71966 2024-09-12T17:43:46.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.361+0000 7f51d61a08c0 1 < completed write operation key=2WC0YDQFKAJD tag=L9UY4CMJFEHA type=write size=147801 2024-09-12T17:43:46.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.369+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~NBJVV5HTGZKD.0 size=1048576 2024-09-12T17:43:46.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.369+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~NBJVV5HTGZKD.1 size=612486 2024-09-12T17:43:46.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.369+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=NBJVV5HTGZKD tag=MM2WLX7ECYE2 type=write size=2709638 2024-09-12T17:43:46.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.373+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~NMLQK51A325K.0 size=38637 2024-09-12T17:43:46.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.381+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=NMLQK51A325K tag=F05Y4ODE87YQ type=write size=1087213 2024-09-12T17:43:46.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.389+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~SOMFBW9FB84S.0 size=104236 2024-09-12T17:43:46.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.389+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=SOMFBW9FB84S tag=4TT7X8IITFAK type=write size=1152812 2024-09-12T17:43:46.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.393+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=LZ3POG0J3DXF type=del 2024-09-12T17:43:46.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.401+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~SPK6XOT4U2PH.0 size=913448 2024-09-12T17:43:46.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.401+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=SPK6XOT4U2PH tag=PUJUU4OT39AP type=write size=1962024 2024-09-12T17:43:46.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.405+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~KMS22TVFV1BB.0 size=958800 2024-09-12T17:43:46.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.409+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=KMS22TVFV1BB tag=V4Q93DVZS1VO type=write size=2007376 2024-09-12T17:43:46.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.413+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=ALZ19JSV97BX type=del size=2673218 2024-09-12T17:43:46.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.417+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=9K1X3BNN2TJ6 type=del 2024-09-12T17:43:46.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.421+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=43DPFH6FYCZ0 type=del size=1932901 2024-09-12T17:43:46.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.429+0000 7f51d61a08c0 1 < suggested remove operation key=U3GZL9YPFMZY tag=BFGNHKOPCT9X type=del 2024-09-12T17:43:46.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.437+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~NXIEG7AKOZSG.0 size=364317 2024-09-12T17:43:46.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.437+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=NXIEG7AKOZSG tag=KT6L9S4HTMJG type=write size=1412893 2024-09-12T17:43:46.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.437+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=NT2RHHG5KIDX type=del 2024-09-12T17:43:46.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.441+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=B2PFREDFF1DN type=del size=616765 2024-09-12T17:43:46.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.445+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~CLZN1UETM2T3.0 size=1048576 2024-09-12T17:43:46.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.449+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~CLZN1UETM2T3.1 size=1048576 2024-09-12T17:43:46.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.453+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~CLZN1UETM2T3.2 size=536002 2024-09-12T17:43:46.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.457+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=CLZN1UETM2T3 tag=M5GDD4W2DV5B type=write size=3681730 2024-09-12T17:43:46.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.465+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~3IEVX4HNFZHU.0 size=1048576 2024-09-12T17:43:46.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.469+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~3IEVX4HNFZHU.1 size=1048576 2024-09-12T17:43:46.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.473+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~3IEVX4HNFZHU.2 size=59055 2024-09-12T17:43:46.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.473+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=3IEVX4HNFZHU tag=CU8S9ZWON9NJ type=write size=3204783 2024-09-12T17:43:46.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.477+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~9CW3WEE4ED6M.0 size=1048576 2024-09-12T17:43:46.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.477+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~9CW3WEE4ED6M.1 size=1048576 2024-09-12T17:43:46.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.481+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~9CW3WEE4ED6M.2 size=924672 2024-09-12T17:43:46.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.489+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=9CW3WEE4ED6M tag=QKKF6KY5RSMR type=write size=4070400 2024-09-12T17:43:46.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.489+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=4AIU7LLQA038 type=del size=1153537 2024-09-12T17:43:46.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.493+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=2ZZ2NLZFN1WX type=del 2024-09-12T17:43:46.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.497+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=SPPR24ANX00X type=del size=1400041 2024-09-12T17:43:46.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.505+0000 7f51d61a08c0 1 < suggested update operation key=SSOA6J297L1C tag=V8YCM9FLBDD7 type=del size=1024314 2024-09-12T17:43:46.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.509+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=UUIUMS9I0682 type=del size=3029786 2024-09-12T17:43:46.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.513+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=QS5PNX1QQGA1 type=del 2024-09-12T17:43:46.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.521+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~ST1WU1HBLI2O.0 size=1048576 2024-09-12T17:43:46.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.521+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~ST1WU1HBLI2O.1 size=1048576 2024-09-12T17:43:46.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.525+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~ST1WU1HBLI2O.2 size=47331 2024-09-12T17:43:46.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.525+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=ST1WU1HBLI2O tag=WCUTBTT8W3A9 type=write size=3193059 2024-09-12T17:43:46.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.529+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~NEJ4FGG47C0K.0 size=328969 2024-09-12T17:43:46.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.537+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=NEJ4FGG47C0K tag=8OIYQ68WQINI type=write size=1377545 2024-09-12T17:43:46.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.541+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~FEZK6GRYR4WJ.0 size=1048576 2024-09-12T17:43:46.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.549+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~FEZK6GRYR4WJ.1 size=193335 2024-09-12T17:43:46.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.549+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=FEZK6GRYR4WJ tag=VCCCTDJ964Q1 type=write size=2290487 2024-09-12T17:43:46.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.553+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~0043OKOTTT3C.0 size=1048576 2024-09-12T17:43:46.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.553+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~0043OKOTTT3C.1 size=817626 2024-09-12T17:43:46.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.561+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=0043OKOTTT3C tag=RSAL3ETSOWWV type=write size=2914778 2024-09-12T17:43:46.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.565+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=B42W2QEMLZVI type=del size=615262 2024-09-12T17:43:46.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.569+0000 7f51d61a08c0 1 < completed write operation key=S292EX1P7IZA tag=7ED91MF029QN type=write size=15137 2024-09-12T17:43:46.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~E4UDI6ZNBVA9.0 size=1048576 2024-09-12T17:43:46.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~E4UDI6ZNBVA9.1 size=545885 2024-09-12T17:43:46.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.577+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=E4UDI6ZNBVA9 tag=A28NHC2K3G87 type=write size=2643037 2024-09-12T17:43:46.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.585+0000 7f51d61a08c0 1 < suggested remove operation key=U3GZL9YPFMZY tag=9KKDFV039N78 type=write 2024-09-12T17:43:46.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.589+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=QQ6462T9BUL0 type=del size=2131091 2024-09-12T17:43:46.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.593+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~NBJVV5HTGZKD.0 size=1048576 2024-09-12T17:43:46.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.597+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~NBJVV5HTGZKD.1 size=612486 2024-09-12T17:43:46.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.605+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=NBJVV5HTGZKD tag=MM2WLX7ECYE2 type=write size=2709638 2024-09-12T17:43:46.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.605+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=06Q88MF9EFWA type=del size=1386853 2024-09-12T17:43:46.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.609+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~SOMFBW9FB84S.0 size=104236 2024-09-12T17:43:46.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.617+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=SOMFBW9FB84S tag=4TT7X8IITFAK type=write size=1152812 2024-09-12T17:43:46.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.621+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=I4ACXF8ZDIW5 type=del size=1711622 2024-09-12T17:43:46.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.625+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~SPK6XOT4U2PH.0 size=913448 2024-09-12T17:43:46.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.629+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=SPK6XOT4U2PH tag=PUJUU4OT39AP type=write size=1962024 2024-09-12T17:43:46.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.633+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=AC81GGSR0KZE type=del size=1564646 2024-09-12T17:43:46.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.637+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=ALZ19JSV97BX type=del 2024-09-12T17:43:46.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.641+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=UTD6ACTV2T5Z type=del size=844139 2024-09-12T17:43:46.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.645+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=43DPFH6FYCZ0 type=del 2024-09-12T17:43:46.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.653+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=4E83KTQF1Z8L type=del size=886701 2024-09-12T17:43:46.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.657+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~NXIEG7AKOZSG.0 size=364317 2024-09-12T17:43:46.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.661+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=NXIEG7AKOZSG tag=KT6L9S4HTMJG type=write size=1412893 2024-09-12T17:43:46.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.665+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=5DD9RJMG49OV type=del size=4136757 2024-09-12T17:43:46.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.669+0000 7f51d61a08c0 1 < canceled operation key=593CD3H40DFH tag=B2PFREDFF1DN type=del size=616765 2024-09-12T17:43:46.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.673+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=VW97G8RD3WRO type=del size=1423852 2024-09-12T17:43:46.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.677+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~3IEVX4HNFZHU.0 size=1048576 2024-09-12T17:43:46.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.681+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~3IEVX4HNFZHU.1 size=1048576 2024-09-12T17:43:46.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.681+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~3IEVX4HNFZHU.2 size=59055 2024-09-12T17:43:46.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.689+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=3IEVX4HNFZHU tag=CU8S9ZWON9NJ type=write size=3204783 2024-09-12T17:43:46.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~82QN2RN8DT07.0 size=646499 2024-09-12T17:43:46.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.697+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=82QN2RN8DT07 tag=BJJS4ITTL8X4 type=write size=1695075 2024-09-12T17:43:46.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.701+0000 7f51d61a08c0 -1 < failed to complete operation key=U3GZL9YPFMZY tag=4AIU7LLQA038 type=del size=1153537: (22) Invalid argument 2024-09-12T17:43:46.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.705+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=UVFIFA5H22XV type=del size=2505820 2024-09-12T17:43:46.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.709+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=SPPR24ANX00X type=del 2024-09-12T17:43:46.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.717+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~H8ORYMV9LCNK.0 size=534732 2024-09-12T17:43:46.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.717+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=H8ORYMV9LCNK tag=HPF173QVPLTA type=write size=1583308 2024-09-12T17:43:46.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.721+0000 7f51d61a08c0 1 < canceled operation key=GJX1YGAQFXZ2 tag=UUIUMS9I0682 type=del size=3029786 2024-09-12T17:43:46.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.725+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=OOZJJC5AXG37 type=write size=199887 2024-09-12T17:43:46.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.729+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~ST1WU1HBLI2O.0 size=1048576 2024-09-12T17:43:46.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.729+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~ST1WU1HBLI2O.1 size=1048576 2024-09-12T17:43:46.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.733+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~ST1WU1HBLI2O.2 size=47331 2024-09-12T17:43:46.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.741+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=ST1WU1HBLI2O tag=WCUTBTT8W3A9 type=write size=3193059 2024-09-12T17:43:46.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.745+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=GPTQGDFYJIY9 type=write size=310497 2024-09-12T17:43:46.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.749+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~FEZK6GRYR4WJ.0 size=1048576 2024-09-12T17:43:46.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.749+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~FEZK6GRYR4WJ.1 size=193335 2024-09-12T17:43:46.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.757+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=FEZK6GRYR4WJ tag=VCCCTDJ964Q1 type=write size=2290487 2024-09-12T17:43:46.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.761+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=I3M80UC8NB8P type=del size=2271375 2024-09-12T17:43:46.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.765+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=B42W2QEMLZVI type=del 2024-09-12T17:43:46.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.773+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~Y01I9RRHPW73.0 size=961402 2024-09-12T17:43:46.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.773+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=Y01I9RRHPW73 tag=5FAELZHCT40I type=write size=2009978 2024-09-12T17:43:46.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.777+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~E4UDI6ZNBVA9.0 size=1048576 2024-09-12T17:43:46.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.781+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~E4UDI6ZNBVA9.1 size=545885 2024-09-12T17:43:46.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.785+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=E4UDI6ZNBVA9 tag=A28NHC2K3G87 type=write size=2643037 2024-09-12T17:43:46.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.789+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=PIUZUQZGO928 type=del size=1125481 2024-09-12T17:43:46.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.797+0000 7f51d61a08c0 1 < suggested update operation key=IWEJXLG1CDAV tag=QQ6462T9BUL0 type=del size=2131091 2024-09-12T17:43:46.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.805+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~9IXG8T3T5CTL.0 size=346099 2024-09-12T17:43:46.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.805+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=9IXG8T3T5CTL tag=CUPUEUT8XEP1 type=write size=1394675 2024-09-12T17:43:46.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.809+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=06Q88MF9EFWA type=del 2024-09-12T17:43:46.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.817+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~GW8L5BK66OC4.0 size=1048576 2024-09-12T17:43:46.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.821+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~GW8L5BK66OC4.1 size=51149 2024-09-12T17:43:46.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.821+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=GW8L5BK66OC4 tag=EWC0YW2VYJ38 type=write size=2148301 2024-09-12T17:43:46.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.825+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=I4ACXF8ZDIW5 type=del 2024-09-12T17:43:46.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.829+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~ULR5VU0PC1IH.0 size=1048576 2024-09-12T17:43:46.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.833+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~ULR5VU0PC1IH.1 size=719670 2024-09-12T17:43:46.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.833+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=ULR5VU0PC1IH tag=CDQS20DSCV4J type=write size=2816822 2024-09-12T17:43:46.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.841+0000 7f51d61a08c0 1 < suggested remove operation key=96OWZQXI2ALM tag=AC81GGSR0KZE type=del 2024-09-12T17:43:46.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.845+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=SR5KEIQJD7WS type=del size=298362 2024-09-12T17:43:46.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.853+0000 7f51d61a08c0 1 < suggested remove operation key=NIQAUF085D97 tag=UTD6ACTV2T5Z type=del 2024-09-12T17:43:46.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.861+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~4JA7RBKLTJ8N.0 size=542369 2024-09-12T17:43:46.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.861+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=4JA7RBKLTJ8N tag=HM5BUGCRDIY9 type=write size=1590945 2024-09-12T17:43:46.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.865+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=4E83KTQF1Z8L type=del 2024-09-12T17:43:46.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.869+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=7CMQW1HR0POM type=write size=94402 2024-09-12T17:43:46.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.873+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=5DD9RJMG49OV type=del 2024-09-12T17:43:46.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.877+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=3YX0CKY2UIT0 type=del size=693004 2024-09-12T17:43:46.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.877+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=VW97G8RD3WRO type=del 2024-09-12T17:43:46.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.885+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~W5LD7BSXHQ6M.0 size=897702 2024-09-12T17:43:46.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.885+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=W5LD7BSXHQ6M tag=FRQWD0BF1A15 type=write size=1946278 2024-09-12T17:43:46.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.889+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~82QN2RN8DT07.0 size=646499 2024-09-12T17:43:46.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.893+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=82QN2RN8DT07 tag=BJJS4ITTL8X4 type=write size=1695075 2024-09-12T17:43:46.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.897+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=GXNDAQF1BLW4 type=del size=1788630 2024-09-12T17:43:46.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.905+0000 7f51d61a08c0 1 < suggested remove operation key=92CMI8Q29LB3 tag=UVFIFA5H22XV type=del 2024-09-12T17:43:46.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.909+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=OZFIMB7G5V26 type=del size=1862514 2024-09-12T17:43:46.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.913+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~H8ORYMV9LCNK.0 size=534732 2024-09-12T17:43:46.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.917+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=H8ORYMV9LCNK tag=HPF173QVPLTA type=write size=1583308 2024-09-12T17:43:46.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.921+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=QLUB08UNQAD0 type=del size=665201 2024-09-12T17:43:46.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.925+0000 7f51d61a08c0 1 < completed write operation key=2WC0YDQFKAJD tag=OOZJJC5AXG37 type=write size=199887 2024-09-12T17:43:46.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.929+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=I2ZKMS9MCZGG type=del size=2812053 2024-09-12T17:43:46.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.933+0000 7f51d61a08c0 1 < suggested update operation key=S292EX1P7IZA tag=GPTQGDFYJIY9 type=write size=310497 2024-09-12T17:43:46.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.941+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~LLTKI5MY8YYS.0 size=1048576 2024-09-12T17:43:46.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.945+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~LLTKI5MY8YYS.1 size=1048576 2024-09-12T17:43:46.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.945+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~LLTKI5MY8YYS.2 size=141470 2024-09-12T17:43:46.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.945+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=LLTKI5MY8YYS tag=PQAO9BO1ODTJ type=write size=3287198 2024-09-12T17:43:46.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.949+0000 7f51d61a08c0 -1 < failed to complete operation key=IWEJXLG1CDAV tag=I3M80UC8NB8P type=del size=2271375: (22) Invalid argument 2024-09-12T17:43:46.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.953+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=WH9Y0YXNDY8J type=del size=2966270 2024-09-12T17:43:46.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.957+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~Y01I9RRHPW73.0 size=961402 2024-09-12T17:43:46.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.961+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=Y01I9RRHPW73 tag=5FAELZHCT40I type=write size=2009978 2024-09-12T17:43:46.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.969+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~1LAOJB9AP6QL.0 size=148723 2024-09-12T17:43:46.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.969+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=1LAOJB9AP6QL tag=YQBACDMGSK43 type=write size=1197299 2024-09-12T17:43:46.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.969+0000 7f51d61a08c0 -1 < failed to complete operation key=NIQAUF085D97 tag=PIUZUQZGO928 type=del size=1125481: (22) Invalid argument 2024-09-12T17:43:46.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.973+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=3TUKL3YPY86I type=del size=3086090 2024-09-12T17:43:46.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.977+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~9IXG8T3T5CTL.0 size=346099 2024-09-12T17:43:46.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.981+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=9IXG8T3T5CTL tag=CUPUEUT8XEP1 type=write size=1394675 2024-09-12T17:43:46.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.989+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~PUXNLE071V1Z.0 size=1048576 2024-09-12T17:43:46.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.993+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~PUXNLE071V1Z.1 size=1048576 2024-09-12T17:43:46.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.993+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~PUXNLE071V1Z.2 size=202015 2024-09-12T17:43:46.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.993+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=PUXNLE071V1Z tag=UUDMAZSV7S3R type=write size=3347743 2024-09-12T17:43:47.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:46.997+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~GW8L5BK66OC4.0 size=1048576 2024-09-12T17:43:47.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.001+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~GW8L5BK66OC4.1 size=51149 2024-09-12T17:43:47.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.005+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=GW8L5BK66OC4 tag=EWC0YW2VYJ38 type=write size=2148301 2024-09-12T17:43:47.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.009+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=7Y94UVF02JBN type=del size=3422561 2024-09-12T17:43:47.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.009+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~ULR5VU0PC1IH.0 size=1048576 2024-09-12T17:43:47.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.013+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~ULR5VU0PC1IH.1 size=719670 2024-09-12T17:43:47.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.021+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=ULR5VU0PC1IH tag=CDQS20DSCV4J type=write size=2816822 2024-09-12T17:43:47.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.025+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~31DWAHU40YB1.0 size=1048576 2024-09-12T17:43:47.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.029+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~31DWAHU40YB1.1 size=1040186 2024-09-12T17:43:47.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.029+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=31DWAHU40YB1 tag=IXGND6C159JL type=write size=3137338 2024-09-12T17:43:47.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.033+0000 7f51d61a08c0 1 < canceled operation key=HY2US2MMDNI4 tag=SR5KEIQJD7WS type=del size=298362 2024-09-12T17:43:47.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.037+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=YBCLRSIY93GN type=del size=4038409 2024-09-12T17:43:47.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.037+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~4JA7RBKLTJ8N.0 size=542369 2024-09-12T17:43:47.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.045+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=4JA7RBKLTJ8N tag=HM5BUGCRDIY9 type=write size=1590945 2024-09-12T17:43:47.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.049+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=WYIYAHXGVL0P type=del size=1326031 2024-09-12T17:43:47.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.053+0000 7f51d61a08c0 1 < suggested update operation key=HY2US2MMDNI4 tag=7CMQW1HR0POM type=write size=94402 2024-09-12T17:43:47.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.061+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~NUR2NSJJ4U94.0 size=1048576 2024-09-12T17:43:47.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.065+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~NUR2NSJJ4U94.1 size=1048576 2024-09-12T17:43:47.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.065+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~NUR2NSJJ4U94.2 size=827434 2024-09-12T17:43:47.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.065+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=NUR2NSJJ4U94 tag=BQCKNH0ED4Q6 type=write size=3973162 2024-09-12T17:43:47.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.069+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=3YX0CKY2UIT0 type=del 2024-09-12T17:43:47.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.073+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=FXKM1P1JYRN0 type=del size=3962726 2024-09-12T17:43:47.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.073+0000 7f51d61a08c0 1 < canceled part key=_multipart_26X723PN8K8T.2~W5LD7BSXHQ6M.0 size=897702 2024-09-12T17:43:47.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.081+0000 7f51d61a08c0 1 < canceled multipart upload key=26X723PN8K8T upload=W5LD7BSXHQ6M tag=FRQWD0BF1A15 type=write size=1946278 2024-09-12T17:43:47.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.081+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=GM03K7LQT2KU type=del size=2378517 2024-09-12T17:43:47.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.085+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=GXNDAQF1BLW4 type=del 2024-09-12T17:43:47.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.089+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=QSK1RJQHIQIU type=write size=581601 2024-09-12T17:43:47.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.093+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=OZFIMB7G5V26 type=del 2024-09-12T17:43:47.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.097+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=LKIN3EYM5L16 type=del size=1975778 2024-09-12T17:43:47.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.101+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=QLUB08UNQAD0 type=del 2024-09-12T17:43:47.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.105+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~51TT1ZGWNJ9R.0 size=868625 2024-09-12T17:43:47.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.105+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=51TT1ZGWNJ9R tag=6K0VFF6I4D73 type=write size=1917201 2024-09-12T17:43:47.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.109+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=I2ZKMS9MCZGG type=del 2024-09-12T17:43:47.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.113+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=V6AAJV27P5TF type=del size=2426035 2024-09-12T17:43:47.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.117+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~LLTKI5MY8YYS.0 size=1048576 2024-09-12T17:43:47.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.121+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~LLTKI5MY8YYS.1 size=1048576 2024-09-12T17:43:47.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.125+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~LLTKI5MY8YYS.2 size=141470 2024-09-12T17:43:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.129+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=LLTKI5MY8YYS tag=PQAO9BO1ODTJ type=write size=3287198 2024-09-12T17:43:47.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.133+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=1Y96TK67ZCQI type=del size=86469 2024-09-12T17:43:47.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.137+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=WH9Y0YXNDY8J type=del 2024-09-12T17:43:47.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.141+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=B9OEFQMGROCU type=del size=1288764 2024-09-12T17:43:47.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.145+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~1LAOJB9AP6QL.0 size=148723 2024-09-12T17:43:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.153+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=1LAOJB9AP6QL tag=YQBACDMGSK43 type=write size=1197299 2024-09-12T17:43:47.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.157+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=XE9BN4CJD08W type=del size=35367 2024-09-12T17:43:47.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.161+0000 7f51d61a08c0 -1 < failed to complete operation key=HY2US2MMDNI4 tag=3TUKL3YPY86I type=del size=3086090: (22) Invalid argument 2024-09-12T17:43:47.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.165+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~H67IF4YSRWF6.0 size=200550 2024-09-12T17:43:47.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.165+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=H67IF4YSRWF6 tag=F4JV47LHP2W8 type=write size=1249126 2024-09-12T17:43:47.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.169+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~PUXNLE071V1Z.0 size=1048576 2024-09-12T17:43:47.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.173+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~PUXNLE071V1Z.1 size=1048576 2024-09-12T17:43:47.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.177+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~PUXNLE071V1Z.2 size=202015 2024-09-12T17:43:47.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.181+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=PUXNLE071V1Z tag=UUDMAZSV7S3R type=write size=3347743 2024-09-12T17:43:47.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.185+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=ONZR51V6K1HQ type=del size=3683817 2024-09-12T17:43:47.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.189+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=7Y94UVF02JBN type=del 2024-09-12T17:43:47.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.193+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=92DAGJG70LPX type=del size=1812253 2024-09-12T17:43:47.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.197+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~31DWAHU40YB1.0 size=1048576 2024-09-12T17:43:47.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.201+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~31DWAHU40YB1.1 size=1040186 2024-09-12T17:43:47.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.205+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=31DWAHU40YB1 tag=IXGND6C159JL type=write size=3137338 2024-09-12T17:43:47.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.213+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~9PKHCG8D5PMA.0 size=1048576 2024-09-12T17:43:47.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.217+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~9PKHCG8D5PMA.1 size=766918 2024-09-12T17:43:47.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.217+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=9PKHCG8D5PMA tag=0PGHEY13T7I5 type=write size=2864070 2024-09-12T17:43:47.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.225+0000 7f51d61a08c0 1 < suggested update operation key=NIQAUF085D97 tag=YBCLRSIY93GN type=del size=4038409 2024-09-12T17:43:47.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.237+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~WUE9F1Y229T7.0 size=16816 2024-09-12T17:43:47.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.237+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=WUE9F1Y229T7 tag=K4VZ742HC54A type=write size=1065392 2024-09-12T17:43:47.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.241+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=WYIYAHXGVL0P type=del 2024-09-12T17:43:47.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.245+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=03LEPA1J96TN type=write size=632354 2024-09-12T17:43:47.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.249+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~NUR2NSJJ4U94.0 size=1048576 2024-09-12T17:43:47.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.249+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~NUR2NSJJ4U94.1 size=1048576 2024-09-12T17:43:47.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.253+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~NUR2NSJJ4U94.2 size=827434 2024-09-12T17:43:47.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.261+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=NUR2NSJJ4U94 tag=BQCKNH0ED4Q6 type=write size=3973162 2024-09-12T17:43:47.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.265+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=002AHOJP7L25 type=del size=723170 2024-09-12T17:43:47.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.273+0000 7f51d61a08c0 1 < suggested update operation key=NIQAUF085D97 tag=FXKM1P1JYRN0 type=del size=3962726 2024-09-12T17:43:47.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.277+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=XF23ONO5BRES type=del size=2802610 2024-09-12T17:43:47.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.281+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=GM03K7LQT2KU type=del 2024-09-12T17:43:47.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.285+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=2RIDEA8JCWH8 type=del size=4043767 2024-09-12T17:43:47.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.289+0000 7f51d61a08c0 1 < suggested update operation key=83V7KSWRKFMZ tag=QSK1RJQHIQIU type=write size=581601 2024-09-12T17:43:47.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.297+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~0KHH2F3XTSP0.0 size=1048576 2024-09-12T17:43:47.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.301+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~0KHH2F3XTSP0.1 size=1048576 2024-09-12T17:43:47.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.301+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~0KHH2F3XTSP0.2 size=744505 2024-09-12T17:43:47.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.301+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=0KHH2F3XTSP0 tag=6643205E27H1 type=write size=3890233 2024-09-12T17:43:47.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.309+0000 7f51d61a08c0 1 < suggested update operation key=8J72KCZ5WRPU tag=LKIN3EYM5L16 type=del size=1975778 2024-09-12T17:43:47.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.313+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=P008JDXLUYFE type=write size=647604 2024-09-12T17:43:47.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.317+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~51TT1ZGWNJ9R.0 size=868625 2024-09-12T17:43:47.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.325+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=51TT1ZGWNJ9R tag=6K0VFF6I4D73 type=write size=1917201 2024-09-12T17:43:47.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.329+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~IC5J56SHR2GA.0 size=1048576 2024-09-12T17:43:47.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.333+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~IC5J56SHR2GA.1 size=1048576 2024-09-12T17:43:47.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.337+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~IC5J56SHR2GA.2 size=704786 2024-09-12T17:43:47.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.337+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=IC5J56SHR2GA tag=970YDL7BIED0 type=write size=3850514 2024-09-12T17:43:47.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.345+0000 7f51d61a08c0 1 < suggested remove operation key=I22NJJISU96B tag=V6AAJV27P5TF type=del 2024-09-12T17:43:47.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.349+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=XGW6IUPQ3KNO type=del size=3691617 2024-09-12T17:43:47.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.353+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=1Y96TK67ZCQI type=del 2024-09-12T17:43:47.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.357+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~XNZWP5SSCIB6.0 size=1048576 2024-09-12T17:43:47.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.361+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~XNZWP5SSCIB6.1 size=937443 2024-09-12T17:43:47.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.361+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=XNZWP5SSCIB6 tag=1CJGOT6AIRS1 type=write size=3034595 2024-09-12T17:43:47.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.369+0000 7f51d61a08c0 1 < suggested update operation key=BF36J1Q6CZFB tag=B9OEFQMGROCU type=del size=1288764 2024-09-12T17:43:47.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.377+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~O1DFM46UXFZ2.0 size=1048576 2024-09-12T17:43:47.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.377+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~O1DFM46UXFZ2.1 size=1048576 2024-09-12T17:43:47.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.381+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~O1DFM46UXFZ2.2 size=1026300 2024-09-12T17:43:47.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.381+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=O1DFM46UXFZ2 tag=UOMWGYBEGEYK type=write size=4172028 2024-09-12T17:43:47.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.385+0000 7f51d61a08c0 1 < canceled operation key=X6KC9Z6LD7VG tag=XE9BN4CJD08W type=del size=35367 2024-09-12T17:43:47.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.393+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~ZM95CGWEYW9H.0 size=1048576 2024-09-12T17:43:47.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.397+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~ZM95CGWEYW9H.1 size=487872 2024-09-12T17:43:47.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.397+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=ZM95CGWEYW9H tag=TBXL2I16QJE1 type=write size=2585024 2024-09-12T17:43:47.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.401+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~H67IF4YSRWF6.0 size=200550 2024-09-12T17:43:47.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.405+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=H67IF4YSRWF6 tag=F4JV47LHP2W8 type=write size=1249126 2024-09-12T17:43:47.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.413+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~CA0HBT2FAEPR.0 size=382362 2024-09-12T17:43:47.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.413+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=CA0HBT2FAEPR tag=YW1OX8GWLT69 type=write size=1430938 2024-09-12T17:43:47.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.417+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=ONZR51V6K1HQ type=del 2024-09-12T17:43:47.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.421+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=3EV4CKWAADYV type=del size=746751 2024-09-12T17:43:47.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.425+0000 7f51d61a08c0 1 < completed delete operation key=U3GZL9YPFMZY tag=92DAGJG70LPX type=del 2024-09-12T17:43:47.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.429+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=Z5UABYV3M0JZ type=del size=273263 2024-09-12T17:43:47.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.433+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~9PKHCG8D5PMA.0 size=1048576 2024-09-12T17:43:47.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.437+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~9PKHCG8D5PMA.1 size=766918 2024-09-12T17:43:47.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.441+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=9PKHCG8D5PMA tag=0PGHEY13T7I5 type=write size=2864070 2024-09-12T17:43:47.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.445+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=B8KYPN6B20UX type=del size=3468036 2024-09-12T17:43:47.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.449+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~WUE9F1Y229T7.0 size=16816 2024-09-12T17:43:47.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.457+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=WUE9F1Y229T7 tag=K4VZ742HC54A type=write size=1065392 2024-09-12T17:43:47.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.461+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=016OQFD6SHAU type=del size=2399376 2024-09-12T17:43:47.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.465+0000 7f51d61a08c0 1 < completed write operation key=IWEJXLG1CDAV tag=03LEPA1J96TN type=write size=632354 2024-09-12T17:43:47.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.469+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=T1RWW81EIWFQ type=del size=2499011 2024-09-12T17:43:47.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.477+0000 7f51d61a08c0 1 < suggested remove operation key=S292EX1P7IZA tag=002AHOJP7L25 type=del 2024-09-12T17:43:47.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.481+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~GPK2UQXQ1HR0.0 size=540728 2024-09-12T17:43:47.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.481+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=GPK2UQXQ1HR0 tag=W7FO2U3WM9RP type=write size=1589304 2024-09-12T17:43:47.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.485+0000 7f51d61a08c0 1 < canceled operation key=NIQAUF085D97 tag=XF23ONO5BRES type=del size=2802610 2024-09-12T17:43:47.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.489+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=6ZZ0UB78KYUY type=del size=2806253 2024-09-12T17:43:47.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.497+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=2RIDEA8JCWH8 type=del 2024-09-12T17:43:47.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.501+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=EEY3AIJ6P1UB type=del size=2004545 2024-09-12T17:43:47.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.505+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~0KHH2F3XTSP0.0 size=1048576 2024-09-12T17:43:47.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.505+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~0KHH2F3XTSP0.1 size=1048576 2024-09-12T17:43:47.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.509+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~0KHH2F3XTSP0.2 size=744505 2024-09-12T17:43:47.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.513+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=0KHH2F3XTSP0 tag=6643205E27H1 type=write size=3890233 2024-09-12T17:43:47.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.517+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=HVKM9HA83X5Q type=write size=532706 2024-09-12T17:43:47.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.521+0000 7f51d61a08c0 1 < completed write operation key=FKKV7SXZSP90 tag=P008JDXLUYFE type=write size=647604 2024-09-12T17:43:47.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.525+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=NBLNDV7NEHC2 type=write size=122194 2024-09-12T17:43:47.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.529+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~IC5J56SHR2GA.0 size=1048576 2024-09-12T17:43:47.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.533+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~IC5J56SHR2GA.1 size=1048576 2024-09-12T17:43:47.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.537+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~IC5J56SHR2GA.2 size=704786 2024-09-12T17:43:47.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.541+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=IC5J56SHR2GA tag=970YDL7BIED0 type=write size=3850514 2024-09-12T17:43:47.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.545+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=W2AWYRIV2LD4 type=del size=3436891 2024-09-12T17:43:47.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.549+0000 7f51d61a08c0 1 < canceled operation key=GJX1YGAQFXZ2 tag=XGW6IUPQ3KNO type=del size=3691617 2024-09-12T17:43:47.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.553+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=MFU9T8XN11RU type=del size=1703349 2024-09-12T17:43:47.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.557+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~XNZWP5SSCIB6.0 size=1048576 2024-09-12T17:43:47.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.561+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~XNZWP5SSCIB6.1 size=937443 2024-09-12T17:43:47.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.569+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=XNZWP5SSCIB6 tag=1CJGOT6AIRS1 type=write size=3034595 2024-09-12T17:43:47.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.573+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~E8R237EGZK48.0 size=1048576 2024-09-12T17:43:47.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~E8R237EGZK48.1 size=522790 2024-09-12T17:43:47.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.577+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=E8R237EGZK48 tag=4R5WDMKKVP04 type=write size=2619942 2024-09-12T17:43:47.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.581+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~O1DFM46UXFZ2.0 size=1048576 2024-09-12T17:43:47.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.589+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~O1DFM46UXFZ2.1 size=1048576 2024-09-12T17:43:47.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.593+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~O1DFM46UXFZ2.2 size=1026300 2024-09-12T17:43:47.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.601+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=O1DFM46UXFZ2 tag=UOMWGYBEGEYK type=write size=4172028 2024-09-12T17:43:47.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.605+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=7LVTYPJLK2GV type=del size=3844274 2024-09-12T17:43:47.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.609+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~ZM95CGWEYW9H.0 size=1048576 2024-09-12T17:43:47.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.613+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~ZM95CGWEYW9H.1 size=487872 2024-09-12T17:43:47.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.621+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=ZM95CGWEYW9H tag=TBXL2I16QJE1 type=write size=2585024 2024-09-12T17:43:47.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.625+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=3ZC50SZR8L63 type=write size=504416 2024-09-12T17:43:47.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.629+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~CA0HBT2FAEPR.0 size=382362 2024-09-12T17:43:47.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.637+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=CA0HBT2FAEPR tag=YW1OX8GWLT69 type=write size=1430938 2024-09-12T17:43:47.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.641+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=YZOX4KCQI37O type=write size=467645 2024-09-12T17:43:47.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.649+0000 7f51d61a08c0 1 < suggested remove operation key=I22NJJISU96B tag=3EV4CKWAADYV type=del 2024-09-12T17:43:47.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.657+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~JC4MB995SSE4.0 size=1048576 2024-09-12T17:43:47.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.657+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~JC4MB995SSE4.1 size=1048576 2024-09-12T17:43:47.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.661+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~JC4MB995SSE4.2 size=450758 2024-09-12T17:43:47.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.661+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=JC4MB995SSE4 tag=XBCX480LPOCX type=write size=3596486 2024-09-12T17:43:47.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.665+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=Z5UABYV3M0JZ type=del 2024-09-12T17:43:47.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.673+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=S304N7AOHDLA type=del size=3715203 2024-09-12T17:43:47.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.681+0000 7f51d61a08c0 1 < suggested update operation key=96OWZQXI2ALM tag=B8KYPN6B20UX type=del size=3468036 2024-09-12T17:43:47.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.685+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~SG5OAO5ARW0Y.0 size=1048576 2024-09-12T17:43:47.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.689+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~SG5OAO5ARW0Y.1 size=1048576 2024-09-12T17:43:47.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.693+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~SG5OAO5ARW0Y.2 size=363046 2024-09-12T17:43:47.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.693+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=SG5OAO5ARW0Y tag=2YVKUHYIRFQ7 type=write size=3508774 2024-09-12T17:43:47.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.697+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=016OQFD6SHAU type=del 2024-09-12T17:43:47.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.701+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=T9I9E7KG8IZW type=del size=1385319 2024-09-12T17:43:47.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.705+0000 7f51d61a08c0 1 < suggested remove operation key=96OWZQXI2ALM tag=T1RWW81EIWFQ type=del 2024-09-12T17:43:47.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.709+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=SXUM12JU6N0G type=del size=970511 2024-09-12T17:43:47.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.713+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~GPK2UQXQ1HR0.0 size=540728 2024-09-12T17:43:47.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.721+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=GPK2UQXQ1HR0 tag=W7FO2U3WM9RP type=write size=1589304 2024-09-12T17:43:47.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.729+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~3X9QB3P5XKZ9.0 size=1048576 2024-09-12T17:43:47.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.733+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~3X9QB3P5XKZ9.1 size=1046037 2024-09-12T17:43:47.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.733+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=3X9QB3P5XKZ9 tag=25TKROGP0GIR type=write size=3143189 2024-09-12T17:43:47.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.737+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=6ZZ0UB78KYUY type=del 2024-09-12T17:43:47.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.741+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=RNOWJUDFUAGY type=del size=2010972 2024-09-12T17:43:47.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.745+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=EEY3AIJ6P1UB type=del 2024-09-12T17:43:47.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.749+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=GRQD6K89BFP7 type=write size=858827 2024-09-12T17:43:47.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.753+0000 7f51d61a08c0 1 < completed write operation key=IWEJXLG1CDAV tag=HVKM9HA83X5Q type=write size=532706 2024-09-12T17:43:47.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.757+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=Y4B5TMBV0JD0 type=write size=735038 2024-09-12T17:43:47.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.761+0000 7f51d61a08c0 1 < completed write operation key=GJX1YGAQFXZ2 tag=NBLNDV7NEHC2 type=write size=122194 2024-09-12T17:43:47.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.765+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=49P5DT8CF43E type=del size=133062 2024-09-12T17:43:47.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.773+0000 7f51d61a08c0 1 < suggested update operation key=SSOA6J297L1C tag=W2AWYRIV2LD4 type=del size=3436891 2024-09-12T17:43:47.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~R5WBJD39IF3V.0 size=1048576 2024-09-12T17:43:47.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~R5WBJD39IF3V.1 size=1048576 2024-09-12T17:43:47.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.785+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~R5WBJD39IF3V.2 size=533965 2024-09-12T17:43:47.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.785+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=R5WBJD39IF3V tag=X00YMYXNVQKN type=write size=3679693 2024-09-12T17:43:47.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.797+0000 7f51d61a08c0 1 < suggested update operation key=2WC0YDQFKAJD tag=MFU9T8XN11RU type=del size=1703349 2024-09-12T17:43:47.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.801+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~ZO948VUOBCHG.0 size=1048576 2024-09-12T17:43:47.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.805+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~ZO948VUOBCHG.1 size=1048576 2024-09-12T17:43:47.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.809+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~ZO948VUOBCHG.2 size=931602 2024-09-12T17:43:47.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.809+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=ZO948VUOBCHG tag=4LTU0B13BFF4 type=write size=4077330 2024-09-12T17:43:47.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.813+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~E8R237EGZK48.0 size=1048576 2024-09-12T17:43:47.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.817+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~E8R237EGZK48.1 size=522790 2024-09-12T17:43:47.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.821+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=E8R237EGZK48 tag=4R5WDMKKVP04 type=write size=2619942 2024-09-12T17:43:47.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.829+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~VO5R2HO95G79.0 size=1048576 2024-09-12T17:43:47.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.833+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~VO5R2HO95G79.1 size=1048576 2024-09-12T17:43:47.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.837+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~VO5R2HO95G79.2 size=426094 2024-09-12T17:43:47.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.837+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=VO5R2HO95G79 tag=7O9O8H3A501M type=write size=3571822 2024-09-12T17:43:47.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.841+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=7LVTYPJLK2GV type=del 2024-09-12T17:43:47.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.841+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=UY6X2CY7SSJP type=del size=1108661 2024-09-12T17:43:47.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.845+0000 7f51d61a08c0 -1 < failed to complete operation key=2WC0YDQFKAJD tag=3ZC50SZR8L63 type=write size=504416: (22) Invalid argument 2024-09-12T17:43:47.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.849+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=0ZR72Q3F4NHG type=del size=2166304 2024-09-12T17:43:47.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.853+0000 7f51d61a08c0 1 < completed write operation key=3LE20KMMPH8P tag=YZOX4KCQI37O type=write size=467645 2024-09-12T17:43:47.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.857+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=ZN2Q74GCS8Z8 type=del size=1372017 2024-09-12T17:43:47.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.857+0000 7f51d61a08c0 1 < canceled part key=_multipart_HY2US2MMDNI4.2~JC4MB995SSE4.0 size=1048576 2024-09-12T17:43:47.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.857+0000 7f51d61a08c0 1 < canceled part key=_multipart_HY2US2MMDNI4.2~JC4MB995SSE4.1 size=1048576 2024-09-12T17:43:47.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.861+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~JC4MB995SSE4.2 size=450758 2024-09-12T17:43:47.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.869+0000 7f51d61a08c0 1 < canceled multipart upload key=HY2US2MMDNI4 upload=JC4MB995SSE4 tag=XBCX480LPOCX type=write size=3596486 2024-09-12T17:43:47.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.873+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=673KNJOKNOLA type=del size=70640 2024-09-12T17:43:47.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.873+0000 7f51d61a08c0 -1 < failed to complete operation key=SSOA6J297L1C tag=S304N7AOHDLA type=del size=3715203: (22) Invalid argument 2024-09-12T17:43:47.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.877+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=OYG5PVDZF56J type=del size=2679671 2024-09-12T17:43:47.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.881+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~SG5OAO5ARW0Y.0 size=1048576 2024-09-12T17:43:47.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.881+0000 7f51d61a08c0 1 < canceled part key=_multipart_ZCB4V47S38TN.2~SG5OAO5ARW0Y.1 size=1048576 2024-09-12T17:43:47.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.885+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~SG5OAO5ARW0Y.2 size=363046 2024-09-12T17:43:47.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.889+0000 7f51d61a08c0 1 < canceled multipart upload key=ZCB4V47S38TN upload=SG5OAO5ARW0Y tag=2YVKUHYIRFQ7 type=write size=3508774 2024-09-12T17:43:47.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.893+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=0GMGDGBQWHG6 type=del size=3481583 2024-09-12T17:43:47.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.897+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=T9I9E7KG8IZW type=del 2024-09-12T17:43:47.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.901+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=QSAP97V2RWBU type=del size=4152063 2024-09-12T17:43:47.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.909+0000 7f51d61a08c0 1 < suggested remove operation key=26X723PN8K8T tag=SXUM12JU6N0G type=del 2024-09-12T17:43:47.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.913+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=FB91TPSP1NCA type=write size=849428 2024-09-12T17:43:47.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.913+0000 7f51d61a08c0 1 < canceled part key=_multipart_83V7KSWRKFMZ.2~3X9QB3P5XKZ9.0 size=1048576 2024-09-12T17:43:47.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.917+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~3X9QB3P5XKZ9.1 size=1046037 2024-09-12T17:43:47.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.921+0000 7f51d61a08c0 1 < canceled multipart upload key=83V7KSWRKFMZ upload=3X9QB3P5XKZ9 tag=25TKROGP0GIR type=write size=3143189 2024-09-12T17:43:47.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.925+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=1QC118V2H09C type=del size=403398 2024-09-12T17:43:47.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.933+0000 7f51d61a08c0 1 < suggested remove operation key=S292EX1P7IZA tag=RNOWJUDFUAGY type=del 2024-09-12T17:43:47.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.937+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=QMWUPPWPAKXW type=write size=539546 2024-09-12T17:43:47.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.937+0000 7f51d61a08c0 1 < completed write operation key=593CD3H40DFH tag=GRQD6K89BFP7 type=write size=858827 2024-09-12T17:43:47.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.945+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~2USORW1Z14SN.0 size=1048576 2024-09-12T17:43:47.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.949+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~2USORW1Z14SN.1 size=398120 2024-09-12T17:43:47.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.949+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=2USORW1Z14SN tag=CW0H3ZC91YV2 type=write size=2495272 2024-09-12T17:43:47.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.961+0000 7f51d61a08c0 1 < suggested remove operation key=HY2US2MMDNI4 tag=Y4B5TMBV0JD0 type=write 2024-09-12T17:43:47.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.965+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=N0PWIY71K0DS type=del size=1553115 2024-09-12T17:43:47.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.969+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=49P5DT8CF43E type=del 2024-09-12T17:43:47.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.973+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~00Y7SY5AGBSL.0 size=48103 2024-09-12T17:43:47.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.973+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=00Y7SY5AGBSL tag=98AWTF2E6DB1 type=write size=1096679 2024-09-12T17:43:47.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.977+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~R5WBJD39IF3V.0 size=1048576 2024-09-12T17:43:47.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.981+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~R5WBJD39IF3V.1 size=1048576 2024-09-12T17:43:47.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.985+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~R5WBJD39IF3V.2 size=533965 2024-09-12T17:43:47.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.989+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=R5WBJD39IF3V tag=X00YMYXNVQKN type=write size=3679693 2024-09-12T17:43:47.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.993+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=1AAZOHEAFUOF type=del size=27721 2024-09-12T17:43:47.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.997+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~ZO948VUOBCHG.0 size=1048576 2024-09-12T17:43:48.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:47.997+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~ZO948VUOBCHG.1 size=1048576 2024-09-12T17:43:48.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.001+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~ZO948VUOBCHG.2 size=931602 2024-09-12T17:43:48.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.009+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=ZO948VUOBCHG tag=4LTU0B13BFF4 type=write size=4077330 2024-09-12T17:43:48.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.013+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=OU7E60ILALQQ type=del size=3511975 2024-09-12T17:43:48.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.017+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~VO5R2HO95G79.0 size=1048576 2024-09-12T17:43:48.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.017+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~VO5R2HO95G79.1 size=1048576 2024-09-12T17:43:48.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.017+0000 7f51d61a08c0 1 < canceled part key=_multipart_FKKV7SXZSP90.2~VO5R2HO95G79.2 size=426094 2024-09-12T17:43:48.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.025+0000 7f51d61a08c0 1 < canceled multipart upload key=FKKV7SXZSP90 upload=VO5R2HO95G79 tag=7O9O8H3A501M type=write size=3571822 2024-09-12T17:43:48.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.029+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=HCI4RZPCZD5L type=del size=520309 2024-09-12T17:43:48.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.033+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=UY6X2CY7SSJP type=del 2024-09-12T17:43:48.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~6QKTS24NEK2P.0 size=1048576 2024-09-12T17:43:48.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.041+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~6QKTS24NEK2P.1 size=526958 2024-09-12T17:43:48.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.041+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=6QKTS24NEK2P tag=IU3VJ5S0ROJY type=write size=2624110 2024-09-12T17:43:48.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.045+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=0ZR72Q3F4NHG type=del 2024-09-12T17:43:48.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.053+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~J0DMN6BCHAO6.0 size=1048576 2024-09-12T17:43:48.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.053+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~J0DMN6BCHAO6.1 size=1048576 2024-09-12T17:43:48.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.057+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~J0DMN6BCHAO6.2 size=697325 2024-09-12T17:43:48.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.057+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=J0DMN6BCHAO6 tag=5VGJQVWEA4ZH type=write size=3843053 2024-09-12T17:43:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.061+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=ZN2Q74GCS8Z8 type=del 2024-09-12T17:43:48.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.065+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=VYP4Y6SWEISN type=write size=73881 2024-09-12T17:43:48.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.069+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=673KNJOKNOLA type=del 2024-09-12T17:43:48.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.073+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~3SLMR0W1NA75.0 size=1048576 2024-09-12T17:43:48.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.077+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~3SLMR0W1NA75.1 size=624921 2024-09-12T17:43:48.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.077+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=3SLMR0W1NA75 tag=XPN035E2KOJJ type=write size=2722073 2024-09-12T17:43:48.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.081+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=OYG5PVDZF56J type=del 2024-09-12T17:43:48.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.085+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=U9CXRYEWRYXF type=write size=515738 2024-09-12T17:43:48.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.089+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=0GMGDGBQWHG6 type=del 2024-09-12T17:43:48.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.093+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=IPICV7SAAN06 type=del size=974286 2024-09-12T17:43:48.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.097+0000 7f51d61a08c0 -1 < failed to complete operation key=26X723PN8K8T tag=QSAP97V2RWBU type=del size=4152063: (22) Invalid argument 2024-09-12T17:43:48.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.101+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=K6TNS1BRV5QU type=del size=3863945 2024-09-12T17:43:48.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.105+0000 7f51d61a08c0 1 < completed write operation key=96OWZQXI2ALM tag=FB91TPSP1NCA type=write size=849428 2024-09-12T17:43:48.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.109+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=786R0YR9A2DD type=del size=1198189 2024-09-12T17:43:48.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.113+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=1QC118V2H09C type=del 2024-09-12T17:43:48.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.117+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=V7T5NC721337 type=del size=1398946 2024-09-12T17:43:48.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.121+0000 7f51d61a08c0 1 < completed write operation key=I22NJJISU96B tag=QMWUPPWPAKXW type=write size=539546 2024-09-12T17:43:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.125+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=CG90JRKOVHXW type=del size=3835686 2024-09-12T17:43:48.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.129+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~2USORW1Z14SN.0 size=1048576 2024-09-12T17:43:48.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.133+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~2USORW1Z14SN.1 size=398120 2024-09-12T17:43:48.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.137+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=2USORW1Z14SN tag=CW0H3ZC91YV2 type=write size=2495272 2024-09-12T17:43:48.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.141+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=GT4NEKQCH91B type=write size=812556 2024-09-12T17:43:48.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.145+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=N0PWIY71K0DS type=del 2024-09-12T17:43:48.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.149+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=MCSGXW4UKWDS type=del size=770720 2024-09-12T17:43:48.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.153+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~00Y7SY5AGBSL.0 size=48103 2024-09-12T17:43:48.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.157+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=00Y7SY5AGBSL tag=98AWTF2E6DB1 type=write size=1096679 2024-09-12T17:43:48.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.161+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=L82I1U4GT4BY type=del size=4177022 2024-09-12T17:43:48.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.165+0000 7f51d61a08c0 1 < canceled operation key=I22NJJISU96B tag=1AAZOHEAFUOF type=del size=27721 2024-09-12T17:43:48.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.169+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=RJGB503PVYN4 type=del size=2714007 2024-09-12T17:43:48.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.173+0000 7f51d61a08c0 1 < canceled operation key=BF36J1Q6CZFB tag=OU7E60ILALQQ type=del size=3511975 2024-09-12T17:43:48.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.181+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~PFP8Z7SRA22O.0 size=163454 2024-09-12T17:43:48.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.181+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=PFP8Z7SRA22O tag=A92XMSUE4WXC type=write size=1212030 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.189+0000 7f51d61a08c0 1 < suggested remove operation key=8J72KCZ5WRPU tag=HCI4RZPCZD5L type=del 2024-09-12T17:43:48.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.193+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~VGI52LXEWV8N.0 size=286501 2024-09-12T17:43:48.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.193+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=VGI52LXEWV8N tag=2TUHSNYCMSXV type=write size=1335077 2024-09-12T17:43:48.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.197+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~6QKTS24NEK2P.0 size=1048576 2024-09-12T17:43:48.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.201+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~6QKTS24NEK2P.1 size=526958 2024-09-12T17:43:48.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.205+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=6QKTS24NEK2P tag=IU3VJ5S0ROJY type=write size=2624110 2024-09-12T17:43:48.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.213+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~N6BXONW0M2FJ.0 size=1048576 2024-09-12T17:43:48.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.217+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~N6BXONW0M2FJ.1 size=1048576 2024-09-12T17:43:48.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.221+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~N6BXONW0M2FJ.2 size=371860 2024-09-12T17:43:48.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.221+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=N6BXONW0M2FJ tag=3C5DPUZAXB2G type=write size=3517588 2024-09-12T17:43:48.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.225+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~J0DMN6BCHAO6.0 size=1048576 2024-09-12T17:43:48.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.229+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~J0DMN6BCHAO6.1 size=1048576 2024-09-12T17:43:48.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.229+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~J0DMN6BCHAO6.2 size=697325 2024-09-12T17:43:48.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.237+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=J0DMN6BCHAO6 tag=5VGJQVWEA4ZH type=write size=3843053 2024-09-12T17:43:48.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.245+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~45RCERV1D45R.0 size=1048576 2024-09-12T17:43:48.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.249+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~45RCERV1D45R.1 size=655296 2024-09-12T17:43:48.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.249+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=45RCERV1D45R tag=0EAM1AFZBSVJ type=write size=2752448 2024-09-12T17:43:48.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.253+0000 7f51d61a08c0 1 < completed write operation key=JT373R4HAJZS tag=VYP4Y6SWEISN type=write size=73881 2024-09-12T17:43:48.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.257+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~9YFRXFDJ6GV4.0 size=1048576 2024-09-12T17:43:48.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.261+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~9YFRXFDJ6GV4.1 size=668851 2024-09-12T17:43:48.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.261+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=9YFRXFDJ6GV4 tag=80IWTB2MOKQW type=write size=2766003 2024-09-12T17:43:48.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.261+0000 7f51d61a08c0 1 < canceled part key=_multipart_JEXD4ZU5HJ2B.2~3SLMR0W1NA75.0 size=1048576 2024-09-12T17:43:48.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.265+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~3SLMR0W1NA75.1 size=624921 2024-09-12T17:43:48.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.273+0000 7f51d61a08c0 1 < canceled multipart upload key=JEXD4ZU5HJ2B upload=3SLMR0W1NA75 tag=XPN035E2KOJJ type=write size=2722073 2024-09-12T17:43:48.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.277+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=V3PVOSPARDNT type=write size=386856 2024-09-12T17:43:48.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.285+0000 7f51d61a08c0 1 < suggested update operation key=I22NJJISU96B tag=U9CXRYEWRYXF type=write size=515738 2024-09-12T17:43:48.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.289+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=47Z8TCYWQ5XZ type=write size=279768 2024-09-12T17:43:48.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.293+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=IPICV7SAAN06 type=del 2024-09-12T17:43:48.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.301+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~L88QMIGDQ4VH.0 size=1048576 2024-09-12T17:43:48.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.313+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~L88QMIGDQ4VH.1 size=273678 2024-09-12T17:43:48.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.313+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=L88QMIGDQ4VH tag=X6VA3B4PIA7I type=write size=2370830 2024-09-12T17:43:48.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.313+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=K6TNS1BRV5QU type=del 2024-09-12T17:43:48.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.317+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=FC10MTSGDS1E type=del size=2996313 2024-09-12T17:43:48.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.325+0000 7f51d61a08c0 1 < canceled operation key=92CMI8Q29LB3 tag=786R0YR9A2DD type=del size=1198189 2024-09-12T17:43:48.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.329+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~QZBSFA9YOVJ6.0 size=1048576 2024-09-12T17:43:48.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.333+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~QZBSFA9YOVJ6.1 size=1048576 2024-09-12T17:43:48.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.337+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~QZBSFA9YOVJ6.2 size=920621 2024-09-12T17:43:48.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.337+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=QZBSFA9YOVJ6 tag=BAL11RNRU91R type=write size=4066349 2024-09-12T17:43:48.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.341+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=V7T5NC721337 type=del 2024-09-12T17:43:48.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.345+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~EN9WJT7CCGSH.0 size=890568 2024-09-12T17:43:48.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.345+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=EN9WJT7CCGSH tag=8JQC6QBYGPNS type=write size=1939144 2024-09-12T17:43:48.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.353+0000 7f51d61a08c0 1 < suggested update operation key=GCL7UJEJM1UV tag=CG90JRKOVHXW type=del size=3835686 2024-09-12T17:43:48.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.361+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~DEMO17ED37X1.0 size=700664 2024-09-12T17:43:48.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.361+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=DEMO17ED37X1 tag=YTVPT1KP71HE type=write size=1749240 2024-09-12T17:43:48.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.365+0000 7f51d61a08c0 1 < completed write operation key=BF36J1Q6CZFB tag=GT4NEKQCH91B type=write size=812556 2024-09-12T17:43:48.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.369+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=PGEE5JTD5DG0 type=del size=1901137 2024-09-12T17:43:48.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.369+0000 7f51d61a08c0 -1 < no bi entry to suggest for operation key=8J72KCZ5WRPU tag=MCSGXW4UKWDS type=del size=770720: (2) No such file or directory 2024-09-12T17:43:48.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.377+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~T4V6MQAR2E7A.0 size=1048576 2024-09-12T17:43:48.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.381+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~T4V6MQAR2E7A.1 size=990120 2024-09-12T17:43:48.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.381+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=T4V6MQAR2E7A tag=WGBB51OLONGI type=write size=3087272 2024-09-12T17:43:48.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.385+0000 7f51d61a08c0 1 < completed delete operation key=U3GZL9YPFMZY tag=L82I1U4GT4BY type=del 2024-09-12T17:43:48.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.389+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~NN7OD01W5L69.0 size=1048576 2024-09-12T17:43:48.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.393+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~NN7OD01W5L69.1 size=1048576 2024-09-12T17:43:48.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.397+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~NN7OD01W5L69.2 size=180191 2024-09-12T17:43:48.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.397+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=NN7OD01W5L69 tag=0KWSFPUH8TAI type=write size=3325919 2024-09-12T17:43:48.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.405+0000 7f51d61a08c0 1 < suggested remove operation key=GCL7UJEJM1UV tag=RJGB503PVYN4 type=del 2024-09-12T17:43:48.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.409+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=OWCJX3VVAWLW type=del size=3406732 2024-09-12T17:43:48.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.413+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~PFP8Z7SRA22O.0 size=163454 2024-09-12T17:43:48.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.417+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=PFP8Z7SRA22O tag=A92XMSUE4WXC type=write size=1212030 2024-09-12T17:43:48.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.421+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=ULGZVOKXX3N1 type=del size=3964083 2024-09-12T17:43:48.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.425+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~VGI52LXEWV8N.0 size=286501 2024-09-12T17:43:48.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.433+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=VGI52LXEWV8N tag=2TUHSNYCMSXV type=write size=1335077 2024-09-12T17:43:48.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.437+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=DZ7AR6FG3DQV type=del size=3423429 2024-09-12T17:43:48.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.441+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~N6BXONW0M2FJ.0 size=1048576 2024-09-12T17:43:48.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.445+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~N6BXONW0M2FJ.1 size=1048576 2024-09-12T17:43:48.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.449+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~N6BXONW0M2FJ.2 size=371860 2024-09-12T17:43:48.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.453+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=N6BXONW0M2FJ tag=3C5DPUZAXB2G type=write size=3517588 2024-09-12T17:43:48.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.457+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=21Q7EBJT0ZMD type=write size=982362 2024-09-12T17:43:48.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.461+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~45RCERV1D45R.0 size=1048576 2024-09-12T17:43:48.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.465+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~45RCERV1D45R.1 size=655296 2024-09-12T17:43:48.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.473+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=45RCERV1D45R tag=0EAM1AFZBSVJ type=write size=2752448 2024-09-12T17:43:48.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.477+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=PJE32EXSKMD5 type=write size=736507 2024-09-12T17:43:48.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.481+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~9YFRXFDJ6GV4.0 size=1048576 2024-09-12T17:43:48.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.485+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~9YFRXFDJ6GV4.1 size=668851 2024-09-12T17:43:48.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.493+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=9YFRXFDJ6GV4 tag=80IWTB2MOKQW type=write size=2766003 2024-09-12T17:43:48.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.497+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=KIJ12M7FT02K type=del size=3377512 2024-09-12T17:43:48.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.501+0000 7f51d61a08c0 -1 < failed to complete operation key=GCL7UJEJM1UV tag=V3PVOSPARDNT type=write size=386856: (22) Invalid argument 2024-09-12T17:43:48.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.505+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=JBN2708B04WY type=del size=3798558 2024-09-12T17:43:48.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.509+0000 7f51d61a08c0 1 < completed write operation key=1ZETSL5TXYSM tag=47Z8TCYWQ5XZ type=write size=279768 2024-09-12T17:43:48.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.517+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~TMTS15K1Q6S5.0 size=1048576 2024-09-12T17:43:48.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.521+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~TMTS15K1Q6S5.1 size=1048576 2024-09-12T17:43:48.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.521+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~TMTS15K1Q6S5.2 size=738603 2024-09-12T17:43:48.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.521+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=TMTS15K1Q6S5 tag=PXXI1A0NW0SE type=write size=3884331 2024-09-12T17:43:48.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.525+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~L88QMIGDQ4VH.0 size=1048576 2024-09-12T17:43:48.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.529+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~L88QMIGDQ4VH.1 size=273678 2024-09-12T17:43:48.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.533+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=L88QMIGDQ4VH tag=X6VA3B4PIA7I type=write size=2370830 2024-09-12T17:43:48.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.537+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=TWN0ZI1HIWSG type=del size=2106380 2024-09-12T17:43:48.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.541+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=FC10MTSGDS1E type=del 2024-09-12T17:43:48.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.545+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=J97NWQR263KV type=del size=3844844 2024-09-12T17:43:48.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.549+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~QZBSFA9YOVJ6.0 size=1048576 2024-09-12T17:43:48.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.553+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~QZBSFA9YOVJ6.1 size=1048576 2024-09-12T17:43:48.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.557+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~QZBSFA9YOVJ6.2 size=920621 2024-09-12T17:43:48.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.561+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=QZBSFA9YOVJ6 tag=BAL11RNRU91R type=write size=4066349 2024-09-12T17:43:48.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.565+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~H8F1T6UCHEH3.0 size=1048576 2024-09-12T17:43:48.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.569+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~H8F1T6UCHEH3.1 size=669825 2024-09-12T17:43:48.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.569+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=H8F1T6UCHEH3 tag=4UTA7RY1ME0R type=write size=2766977 2024-09-12T17:43:48.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.573+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~EN9WJT7CCGSH.0 size=890568 2024-09-12T17:43:48.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.577+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=EN9WJT7CCGSH tag=8JQC6QBYGPNS type=write size=1939144 2024-09-12T17:43:48.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.585+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~H8VOX6O1Y3CP.0 size=1048576 2024-09-12T17:43:48.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.589+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~H8VOX6O1Y3CP.1 size=233450 2024-09-12T17:43:48.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.589+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=H8VOX6O1Y3CP tag=5E3RI7EAH28N type=write size=2330602 2024-09-12T17:43:48.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.593+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~DEMO17ED37X1.0 size=700664 2024-09-12T17:43:48.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.597+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=DEMO17ED37X1 tag=YTVPT1KP71HE type=write size=1749240 2024-09-12T17:43:48.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.601+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=ENV4ISGTVX59 type=del size=3149724 2024-09-12T17:43:48.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.605+0000 7f51d61a08c0 -1 < failed to complete operation key=GCL7UJEJM1UV tag=PGEE5JTD5DG0 type=del size=1901137: (22) Invalid argument 2024-09-12T17:43:48.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.609+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=JJQS0T5RVIU2 type=del size=1641752 2024-09-12T17:43:48.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.613+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~T4V6MQAR2E7A.0 size=1048576 2024-09-12T17:43:48.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.613+0000 7f51d61a08c0 1 < canceled part key=_multipart_A7V478K2SNOF.2~T4V6MQAR2E7A.1 size=990120 2024-09-12T17:43:48.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.621+0000 7f51d61a08c0 1 < canceled multipart upload key=A7V478K2SNOF upload=T4V6MQAR2E7A tag=WGBB51OLONGI type=write size=3087272 2024-09-12T17:43:48.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.625+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=UI81ZQ9AFNX2 type=write size=971061 2024-09-12T17:43:48.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.625+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~NN7OD01W5L69.0 size=1048576 2024-09-12T17:43:48.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.629+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~NN7OD01W5L69.1 size=1048576 2024-09-12T17:43:48.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.633+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~NN7OD01W5L69.2 size=180191 2024-09-12T17:43:48.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.637+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=NN7OD01W5L69 tag=0KWSFPUH8TAI type=write size=3325919 2024-09-12T17:43:48.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.641+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=7YHVJF8T9JES type=del size=2906123 2024-09-12T17:43:48.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.645+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=OWCJX3VVAWLW type=del 2024-09-12T17:43:48.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.649+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=SY6DUYHAP6GQ type=del size=1418951 2024-09-12T17:43:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.653+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=ULGZVOKXX3N1 type=del 2024-09-12T17:43:48.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.657+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=FG8REIF7N5IF type=del size=1072123 2024-09-12T17:43:48.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.665+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=DZ7AR6FG3DQV type=del 2024-09-12T17:43:48.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.669+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=N0XIAQKHVPDW type=write size=322505 2024-09-12T17:43:48.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.673+0000 7f51d61a08c0 1 < completed write operation key=GCL7UJEJM1UV tag=21Q7EBJT0ZMD type=write size=982362 2024-09-12T17:43:48.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.681+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~5QE0GQSYDMPT.0 size=1048576 2024-09-12T17:43:48.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.681+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~5QE0GQSYDMPT.1 size=601463 2024-09-12T17:43:48.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.681+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=5QE0GQSYDMPT tag=2HYCQZBCC7ME type=write size=2698615 2024-09-12T17:43:48.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.685+0000 7f51d61a08c0 1 < completed write operation key=NIQAUF085D97 tag=PJE32EXSKMD5 type=write size=736507 2024-09-12T17:43:48.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.693+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~M3U3WF5H3OR1.0 size=1048576 2024-09-12T17:43:48.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~M3U3WF5H3OR1.1 size=147441 2024-09-12T17:43:48.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.697+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=M3U3WF5H3OR1 tag=C67IA0GQ405K type=write size=2244593 2024-09-12T17:43:48.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.701+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=KIJ12M7FT02K type=del 2024-09-12T17:43:48.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.705+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=9FLDNJJOVLPK type=del size=247490 2024-09-12T17:43:48.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.709+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=JBN2708B04WY type=del 2024-09-12T17:43:48.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.713+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=NFA6KL1O4IEO type=del size=2501228 2024-09-12T17:43:48.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.713+0000 7f51d61a08c0 1 < canceled part key=_multipart_V5KMBUNVQA0H.2~TMTS15K1Q6S5.0 size=1048576 2024-09-12T17:43:48.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.717+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~TMTS15K1Q6S5.1 size=1048576 2024-09-12T17:43:48.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.721+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~TMTS15K1Q6S5.2 size=738603 2024-09-12T17:43:48.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.725+0000 7f51d61a08c0 1 < canceled multipart upload key=V5KMBUNVQA0H upload=TMTS15K1Q6S5 tag=PXXI1A0NW0SE type=write size=3884331 2024-09-12T17:43:48.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.733+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~WRGN9OOCE6J2.0 size=1048576 2024-09-12T17:43:48.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.737+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~WRGN9OOCE6J2.1 size=945146 2024-09-12T17:43:48.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.737+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=WRGN9OOCE6J2 tag=2UPC2IT2BUEV type=write size=3042298 2024-09-12T17:43:48.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.741+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=TWN0ZI1HIWSG type=del 2024-09-12T17:43:48.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.745+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=SQOOD2WC0P7S type=del size=606937 2024-09-12T17:43:48.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.749+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=J97NWQR263KV type=del 2024-09-12T17:43:48.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.753+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=012WOXO6H070 type=write size=811109 2024-09-12T17:43:48.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.757+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~H8F1T6UCHEH3.0 size=1048576 2024-09-12T17:43:48.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.757+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~H8F1T6UCHEH3.1 size=669825 2024-09-12T17:43:48.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.765+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=H8F1T6UCHEH3 tag=4UTA7RY1ME0R type=write size=2766977 2024-09-12T17:43:48.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.773+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~XH63VBMLS32E.0 size=1048576 2024-09-12T17:43:48.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.773+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~XH63VBMLS32E.1 size=1048576 2024-09-12T17:43:48.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.777+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~XH63VBMLS32E.2 size=729489 2024-09-12T17:43:48.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.777+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=XH63VBMLS32E tag=ORX0XF59WC3S type=write size=3875217 2024-09-12T17:43:48.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.777+0000 7f51d61a08c0 1 < canceled part key=_multipart_ZCB4V47S38TN.2~H8VOX6O1Y3CP.0 size=1048576 2024-09-12T17:43:48.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.781+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~H8VOX6O1Y3CP.1 size=233450 2024-09-12T17:43:48.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.789+0000 7f51d61a08c0 1 < canceled multipart upload key=ZCB4V47S38TN upload=H8VOX6O1Y3CP tag=5E3RI7EAH28N type=write size=2330602 2024-09-12T17:43:48.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.789+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=9B8HOFUM6P44 type=del size=3992042 2024-09-12T17:43:48.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.797+0000 7f51d61a08c0 1 < suggested remove operation key=S292EX1P7IZA tag=ENV4ISGTVX59 type=del 2024-09-12T17:43:48.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.801+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=YJPF0PSXJGFY type=del size=2346387 2024-09-12T17:43:48.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.805+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=JJQS0T5RVIU2 type=del 2024-09-12T17:43:48.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.813+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~FO4SLH4770HB.0 size=1048576 2024-09-12T17:43:48.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.817+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~FO4SLH4770HB.1 size=1048576 2024-09-12T17:43:48.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.821+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~FO4SLH4770HB.2 size=50711 2024-09-12T17:43:48.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.821+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=FO4SLH4770HB tag=Y9Y3ALOIM9IA type=write size=3196439 2024-09-12T17:43:48.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.825+0000 7f51d61a08c0 1 < completed write operation key=U3GZL9YPFMZY tag=UI81ZQ9AFNX2 type=write size=971061 2024-09-12T17:43:48.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.833+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~5QMIQOZ99PQC.0 size=1048576 2024-09-12T17:43:48.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.833+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~5QMIQOZ99PQC.1 size=1048576 2024-09-12T17:43:48.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.837+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~5QMIQOZ99PQC.2 size=302269 2024-09-12T17:43:48.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.837+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=5QMIQOZ99PQC tag=NDF3Z2OXTAFQ type=write size=3447997 2024-09-12T17:43:48.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.841+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=7YHVJF8T9JES type=del 2024-09-12T17:43:48.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.849+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~J7O1K7WDZ6P8.0 size=1048576 2024-09-12T17:43:48.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.853+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~J7O1K7WDZ6P8.1 size=753097 2024-09-12T17:43:48.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.853+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=J7O1K7WDZ6P8 tag=CXPH539B3TN9 type=write size=2850249 2024-09-12T17:43:48.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.857+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=SY6DUYHAP6GQ type=del 2024-09-12T17:43:48.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.861+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~42AVMDOOY1VJ.0 size=143982 2024-09-12T17:43:48.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.861+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=42AVMDOOY1VJ tag=4MN1PYHGH1YR type=write size=1192558 2024-09-12T17:43:48.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.869+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=FG8REIF7N5IF type=del 2024-09-12T17:43:48.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.873+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=E9VINYZW5Q5M type=del size=694433 2024-09-12T17:43:48.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.877+0000 7f51d61a08c0 1 < suggested remove operation key=XL9QDBTYSP7F tag=N0XIAQKHVPDW type=write 2024-09-12T17:43:48.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.881+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=1ZX552ADBU4T type=del size=3225758 2024-09-12T17:43:48.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.885+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~5QE0GQSYDMPT.0 size=1048576 2024-09-12T17:43:48.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.889+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~5QE0GQSYDMPT.1 size=601463 2024-09-12T17:43:48.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.897+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=5QE0GQSYDMPT tag=2HYCQZBCC7ME type=write size=2698615 2024-09-12T17:43:48.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.901+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=SD2Y68JKYBYG type=write size=1000014 2024-09-12T17:43:48.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.905+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~M3U3WF5H3OR1.0 size=1048576 2024-09-12T17:43:48.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.909+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~M3U3WF5H3OR1.1 size=147441 2024-09-12T17:43:48.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.913+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=M3U3WF5H3OR1 tag=C67IA0GQ405K type=write size=2244593 2024-09-12T17:43:48.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.917+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=34CGS81ZLRXH type=del size=3738882 2024-09-12T17:43:48.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.921+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=9FLDNJJOVLPK type=del 2024-09-12T17:43:48.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.925+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=DJ14LRFIHKCD type=del size=3298153 2024-09-12T17:43:48.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.929+0000 7f51d61a08c0 1 < suggested remove operation key=NIQAUF085D97 tag=NFA6KL1O4IEO type=del 2024-09-12T17:43:48.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.937+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~11ORV46DOM3V.0 size=1048576 2024-09-12T17:43:48.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.941+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~11ORV46DOM3V.1 size=1048576 2024-09-12T17:43:48.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.941+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~11ORV46DOM3V.2 size=430985 2024-09-12T17:43:48.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.941+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=11ORV46DOM3V tag=C8WBQBKLX6IW type=write size=3576713 2024-09-12T17:43:48.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.945+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~WRGN9OOCE6J2.0 size=1048576 2024-09-12T17:43:48.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.945+0000 7f51d61a08c0 1 < canceled part key=_multipart_A7V478K2SNOF.2~WRGN9OOCE6J2.1 size=945146 2024-09-12T17:43:48.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.953+0000 7f51d61a08c0 1 < canceled multipart upload key=A7V478K2SNOF upload=WRGN9OOCE6J2 tag=2UPC2IT2BUEV type=write size=3042298 2024-09-12T17:43:48.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.957+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=PQZM10KTZYTN type=del size=878458 2024-09-12T17:43:48.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.965+0000 7f51d61a08c0 1 < suggested update operation key=HY2US2MMDNI4 tag=SQOOD2WC0P7S type=del size=606937 2024-09-12T17:43:48.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.965+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=LMJ0D8CO5TC3 type=del size=4090282 2024-09-12T17:43:48.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.973+0000 7f51d61a08c0 1 < suggested update operation key=3LE20KMMPH8P tag=012WOXO6H070 type=write size=811109 2024-09-12T17:43:48.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.977+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=PM1OILBZQ2LB type=del size=1844596 2024-09-12T17:43:48.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.977+0000 7f51d61a08c0 1 < canceled part key=_multipart_GJX1YGAQFXZ2.2~XH63VBMLS32E.0 size=1048576 2024-09-12T17:43:48.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.981+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~XH63VBMLS32E.1 size=1048576 2024-09-12T17:43:48.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.981+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~XH63VBMLS32E.2 size=729489 2024-09-12T17:43:48.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.989+0000 7f51d61a08c0 1 < canceled multipart upload key=GJX1YGAQFXZ2 upload=XH63VBMLS32E tag=ORX0XF59WC3S type=write size=3875217 2024-09-12T17:43:48.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.993+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=7G4RZOUCFOM0 type=del size=1102818 2024-09-12T17:43:48.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:48.997+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=9B8HOFUM6P44 type=del 2024-09-12T17:43:49.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.001+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=Q2DEJNNPZKYF type=write size=303829 2024-09-12T17:43:49.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.005+0000 7f51d61a08c0 1 < canceled operation key=S292EX1P7IZA tag=YJPF0PSXJGFY type=del size=2346387 2024-09-12T17:43:49.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.009+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=PLJ7V1NUDEAC type=write size=676128 2024-09-12T17:43:49.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.009+0000 7f51d61a08c0 1 < canceled part key=_multipart_92CMI8Q29LB3.2~FO4SLH4770HB.0 size=1048576 2024-09-12T17:43:49.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.013+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~FO4SLH4770HB.1 size=1048576 2024-09-12T17:43:49.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.017+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~FO4SLH4770HB.2 size=50711 2024-09-12T17:43:49.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.025+0000 7f51d61a08c0 1 < canceled multipart upload key=92CMI8Q29LB3 upload=FO4SLH4770HB tag=Y9Y3ALOIM9IA type=write size=3196439 2024-09-12T17:43:49.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.033+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~QG6DJLTW1DIO.0 size=1048576 2024-09-12T17:43:49.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.033+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~QG6DJLTW1DIO.1 size=797139 2024-09-12T17:43:49.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.033+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=QG6DJLTW1DIO tag=QZV3OL10H2BO type=write size=2894291 2024-09-12T17:43:49.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.037+0000 7f51d61a08c0 1 < canceled part key=_multipart_GJX1YGAQFXZ2.2~5QMIQOZ99PQC.0 size=1048576 2024-09-12T17:43:49.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.037+0000 7f51d61a08c0 1 < canceled part key=_multipart_GJX1YGAQFXZ2.2~5QMIQOZ99PQC.1 size=1048576 2024-09-12T17:43:49.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.037+0000 7f51d61a08c0 1 < canceled part key=_multipart_GJX1YGAQFXZ2.2~5QMIQOZ99PQC.2 size=302269 2024-09-12T17:43:49.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.041+0000 7f51d61a08c0 1 < canceled multipart upload key=GJX1YGAQFXZ2 upload=5QMIQOZ99PQC tag=NDF3Z2OXTAFQ type=write size=3447997 2024-09-12T17:43:49.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.045+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=4B4PP7MVVJ32 type=del size=1427119 2024-09-12T17:43:49.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.049+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~J7O1K7WDZ6P8.0 size=1048576 2024-09-12T17:43:49.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.053+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~J7O1K7WDZ6P8.1 size=753097 2024-09-12T17:43:49.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.061+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=J7O1K7WDZ6P8 tag=CXPH539B3TN9 type=write size=2850249 2024-09-12T17:43:49.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.065+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~987MLZSTL8BB.0 size=1048576 2024-09-12T17:43:49.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.069+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~987MLZSTL8BB.1 size=213363 2024-09-12T17:43:49.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.069+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=987MLZSTL8BB tag=J6G7JNYQZHWG type=write size=2310515 2024-09-12T17:43:49.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.073+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~42AVMDOOY1VJ.0 size=143982 2024-09-12T17:43:49.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.081+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=42AVMDOOY1VJ tag=4MN1PYHGH1YR type=write size=1192558 2024-09-12T17:43:49.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.085+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=CEBHQWHQV0DK type=del size=1882791 2024-09-12T17:43:49.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.089+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=E9VINYZW5Q5M type=del 2024-09-12T17:43:49.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.097+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~W8KNH3M7HVGI.0 size=1048576 2024-09-12T17:43:49.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.097+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~W8KNH3M7HVGI.1 size=1048576 2024-09-12T17:43:49.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.101+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~W8KNH3M7HVGI.2 size=700044 2024-09-12T17:43:49.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.101+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=W8KNH3M7HVGI tag=3GZHR1F31Y54 type=write size=3845772 2024-09-12T17:43:49.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.109+0000 7f51d61a08c0 1 < suggested remove operation key=IWEJXLG1CDAV tag=1ZX552ADBU4T type=del 2024-09-12T17:43:49.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.113+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=NLVTTSC71VPI type=del size=2148921 2024-09-12T17:43:49.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.121+0000 7f51d61a08c0 1 < suggested update operation key=NIQAUF085D97 tag=SD2Y68JKYBYG type=write size=1000014 2024-09-12T17:43:49.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.129+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~WE1O94DDH2SJ.0 size=1048576 2024-09-12T17:43:49.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.133+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~WE1O94DDH2SJ.1 size=316558 2024-09-12T17:43:49.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.133+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=WE1O94DDH2SJ tag=FUT0ROCF33K3 type=write size=2413710 2024-09-12T17:43:49.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.137+0000 7f51d61a08c0 -1 < failed to complete operation key=HY2US2MMDNI4 tag=34CGS81ZLRXH type=del size=3738882: (22) Invalid argument 2024-09-12T17:43:49.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.141+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~TXKZSAN9IJU1.0 size=264499 2024-09-12T17:43:49.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.141+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=TXKZSAN9IJU1 tag=GETDMUG5JTS4 type=write size=1313075 2024-09-12T17:43:49.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.145+0000 7f51d61a08c0 -1 < failed to complete operation key=NIQAUF085D97 tag=DJ14LRFIHKCD type=del size=3298153: (22) Invalid argument 2024-09-12T17:43:49.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.149+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=WO5JPYT5KQT7 type=del size=548763 2024-09-12T17:43:49.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.153+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~11ORV46DOM3V.0 size=1048576 2024-09-12T17:43:49.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.157+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~11ORV46DOM3V.1 size=1048576 2024-09-12T17:43:49.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.161+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~11ORV46DOM3V.2 size=430985 2024-09-12T17:43:49.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.165+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=11ORV46DOM3V tag=C8WBQBKLX6IW type=write size=3576713 2024-09-12T17:43:49.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.169+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=7DZG4T2HSK7G type=del size=681985 2024-09-12T17:43:49.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.173+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=PQZM10KTZYTN type=del 2024-09-12T17:43:49.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.177+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=4ELYDJ5834AY type=del size=3123577 2024-09-12T17:43:49.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.181+0000 7f51d61a08c0 1 < canceled operation key=ZCB4V47S38TN tag=LMJ0D8CO5TC3 type=del size=4090282 2024-09-12T17:43:49.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.185+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=2I4ZG6N7M7YC type=del size=3287282 2024-09-12T17:43:49.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.189+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=PM1OILBZQ2LB type=del 2024-09-12T17:43:49.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.193+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=SBQ97RKIJ8N3 type=write size=1010298 2024-09-12T17:43:49.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.197+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=7G4RZOUCFOM0 type=del 2024-09-12T17:43:49.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.205+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~33QBPJBV9FQL.0 size=1048576 2024-09-12T17:43:49.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.209+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~33QBPJBV9FQL.1 size=1048576 2024-09-12T17:43:49.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.209+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~33QBPJBV9FQL.2 size=903897 2024-09-12T17:43:49.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.209+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=33QBPJBV9FQL tag=CSJEJVBRU1VB type=write size=4049625 2024-09-12T17:43:49.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.213+0000 7f51d61a08c0 1 < completed write operation key=83V7KSWRKFMZ tag=Q2DEJNNPZKYF type=write size=303829 2024-09-12T17:43:49.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.217+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=2IG8BNAY3MTI type=del size=1540279 2024-09-12T17:43:49.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.221+0000 7f51d61a08c0 1 < completed write operation key=X6KC9Z6LD7VG tag=PLJ7V1NUDEAC type=write size=676128 2024-09-12T17:43:49.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.225+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=6M6XJA0Y0MKP type=del size=2055516 2024-09-12T17:43:49.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.229+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~QG6DJLTW1DIO.0 size=1048576 2024-09-12T17:43:49.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.233+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~QG6DJLTW1DIO.1 size=797139 2024-09-12T17:43:49.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.237+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=QG6DJLTW1DIO tag=QZV3OL10H2BO type=write size=2894291 2024-09-12T17:43:49.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.245+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~D7ZDWI1H2CD9.0 size=1048576 2024-09-12T17:43:49.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.249+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~D7ZDWI1H2CD9.1 size=1048576 2024-09-12T17:43:49.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.253+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~D7ZDWI1H2CD9.2 size=495776 2024-09-12T17:43:49.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.253+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=D7ZDWI1H2CD9 tag=3EOHA4DHHY28 type=write size=3641504 2024-09-12T17:43:49.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.257+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=4B4PP7MVVJ32 type=del 2024-09-12T17:43:49.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.261+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~SHUGCIZBB798.0 size=1048576 2024-09-12T17:43:49.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.265+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~SHUGCIZBB798.1 size=1048576 2024-09-12T17:43:49.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.269+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~SHUGCIZBB798.2 size=79184 2024-09-12T17:43:49.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.269+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=SHUGCIZBB798 tag=DBNJJ0V5FOTW type=write size=3224912 2024-09-12T17:43:49.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.273+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~987MLZSTL8BB.0 size=1048576 2024-09-12T17:43:49.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.277+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~987MLZSTL8BB.1 size=213363 2024-09-12T17:43:49.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.281+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=987MLZSTL8BB tag=J6G7JNYQZHWG type=write size=2310515 2024-09-12T17:43:49.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.285+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=Z6W7CYLCQYO9 type=del size=1428198 2024-09-12T17:43:49.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.289+0000 7f51d61a08c0 -1 < failed to complete operation key=NIQAUF085D97 tag=CEBHQWHQV0DK type=del size=1882791: (22) Invalid argument 2024-09-12T17:43:49.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.297+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=4AANYZUNHS9Y type=del size=2627071 2024-09-12T17:43:49.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.301+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~W8KNH3M7HVGI.0 size=1048576 2024-09-12T17:43:49.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.305+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~W8KNH3M7HVGI.1 size=1048576 2024-09-12T17:43:49.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.309+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~W8KNH3M7HVGI.2 size=700044 2024-09-12T17:43:49.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.313+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=W8KNH3M7HVGI tag=3GZHR1F31Y54 type=write size=3845772 2024-09-12T17:43:49.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.321+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~TK180YGRBZKE.0 size=957555 2024-09-12T17:43:49.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.321+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=TK180YGRBZKE tag=3KL1JSP37YW2 type=write size=2006131 2024-09-12T17:43:49.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.325+0000 7f51d61a08c0 1 < canceled operation key=1ZETSL5TXYSM tag=NLVTTSC71VPI type=del size=2148921 2024-09-12T17:43:49.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.333+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~SI8G2U4XP8LV.0 size=1048576 2024-09-12T17:43:49.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.337+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~SI8G2U4XP8LV.1 size=1048576 2024-09-12T17:43:49.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.341+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~SI8G2U4XP8LV.2 size=1044474 2024-09-12T17:43:49.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.341+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=SI8G2U4XP8LV tag=PVIGCXNZSWD5 type=write size=4190202 2024-09-12T17:43:49.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.345+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~WE1O94DDH2SJ.0 size=1048576 2024-09-12T17:43:49.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.345+0000 7f51d61a08c0 1 < canceled part key=_multipart_HUWVRJIZ5JYE.2~WE1O94DDH2SJ.1 size=316558 2024-09-12T17:43:49.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.353+0000 7f51d61a08c0 1 < canceled multipart upload key=HUWVRJIZ5JYE upload=WE1O94DDH2SJ tag=FUT0ROCF33K3 type=write size=2413710 2024-09-12T17:43:49.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.357+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=K0FCAZ72KH40 type=write size=255477 2024-09-12T17:43:49.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.365+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~TXKZSAN9IJU1.0 size=264499 2024-09-12T17:43:49.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.369+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=TXKZSAN9IJU1 tag=GETDMUG5JTS4 type=write size=1313075 2024-09-12T17:43:49.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.377+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~KMD7Y8CJWAVZ.0 size=1048576 2024-09-12T17:43:49.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.385+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~KMD7Y8CJWAVZ.1 size=756270 2024-09-12T17:43:49.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.385+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=KMD7Y8CJWAVZ tag=BUHO9R5VIEW5 type=write size=2853422 2024-09-12T17:43:49.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.389+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=WO5JPYT5KQT7 type=del 2024-09-12T17:43:49.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.393+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=3PPY476BCPPA type=del size=3594430 2024-09-12T17:43:49.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.401+0000 7f51d61a08c0 1 < suggested update operation key=8J72KCZ5WRPU tag=7DZG4T2HSK7G type=del size=681985 2024-09-12T17:43:49.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.405+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=2Y6TYTE1XSE5 type=write size=231042 2024-09-12T17:43:49.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.409+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=4ELYDJ5834AY type=del 2024-09-12T17:43:49.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.413+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=0H87ZNU23O3V type=del size=1153059 2024-09-12T17:43:49.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.417+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=2I4ZG6N7M7YC type=del 2024-09-12T17:43:49.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.425+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~N243E9NYPBJZ.0 size=660874 2024-09-12T17:43:49.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.425+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=N243E9NYPBJZ tag=27RFMJQ0P5I7 type=write size=1709450 2024-09-12T17:43:49.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.429+0000 7f51d61a08c0 1 < completed write operation key=HUWVRJIZ5JYE tag=SBQ97RKIJ8N3 type=write size=1010298 2024-09-12T17:43:49.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.437+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~EBOG6GA1PR5M.0 size=1048576 2024-09-12T17:43:49.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.441+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~EBOG6GA1PR5M.1 size=1048576 2024-09-12T17:43:49.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.445+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~EBOG6GA1PR5M.2 size=38483 2024-09-12T17:43:49.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.445+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=EBOG6GA1PR5M tag=79R9OVFDCSMC type=write size=3184211 2024-09-12T17:43:49.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.449+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~33QBPJBV9FQL.0 size=1048576 2024-09-12T17:43:49.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.449+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~33QBPJBV9FQL.1 size=1048576 2024-09-12T17:43:49.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.453+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~33QBPJBV9FQL.2 size=903897 2024-09-12T17:43:49.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.461+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=33QBPJBV9FQL tag=CSJEJVBRU1VB type=write size=4049625 2024-09-12T17:43:49.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.465+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~G8ORC99UPRSG.0 size=1048576 2024-09-12T17:43:49.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.469+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~G8ORC99UPRSG.1 size=1048576 2024-09-12T17:43:49.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.473+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~G8ORC99UPRSG.2 size=475507 2024-09-12T17:43:49.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.473+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=G8ORC99UPRSG tag=HR2GHJMZT6Y3 type=write size=3621235 2024-09-12T17:43:49.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.473+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=2IG8BNAY3MTI type=del 2024-09-12T17:43:49.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.477+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=IG2O9JAQGOQN type=del size=3426851 2024-09-12T17:43:49.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.481+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=6M6XJA0Y0MKP type=del 2024-09-12T17:43:49.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.489+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~330OR5HXUPGB.0 size=1048576 2024-09-12T17:43:49.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.489+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~330OR5HXUPGB.1 size=1048576 2024-09-12T17:43:49.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.493+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~330OR5HXUPGB.2 size=807005 2024-09-12T17:43:49.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.493+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=330OR5HXUPGB tag=4RAVUYOOKSND type=write size=3952733 2024-09-12T17:43:49.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.493+0000 7f51d61a08c0 1 < canceled part key=_multipart_26X723PN8K8T.2~D7ZDWI1H2CD9.0 size=1048576 2024-09-12T17:43:49.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.497+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~D7ZDWI1H2CD9.1 size=1048576 2024-09-12T17:43:49.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.501+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~D7ZDWI1H2CD9.2 size=495776 2024-09-12T17:43:49.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.505+0000 7f51d61a08c0 1 < canceled multipart upload key=26X723PN8K8T upload=D7ZDWI1H2CD9 tag=3EOHA4DHHY28 type=write size=3641504 2024-09-12T17:43:49.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.513+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~6DNMG1PL75HJ.0 size=1046536 2024-09-12T17:43:49.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.513+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=6DNMG1PL75HJ tag=VW8E1AI19ESK type=write size=2095112 2024-09-12T17:43:49.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.517+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~SHUGCIZBB798.0 size=1048576 2024-09-12T17:43:49.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.517+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~SHUGCIZBB798.1 size=1048576 2024-09-12T17:43:49.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.521+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~SHUGCIZBB798.2 size=79184 2024-09-12T17:43:49.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.529+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=SHUGCIZBB798 tag=DBNJJ0V5FOTW type=write size=3224912 2024-09-12T17:43:49.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.533+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=RH42RJSAUWIB type=write size=528583 2024-09-12T17:43:49.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.533+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=Z6W7CYLCQYO9 type=del 2024-09-12T17:43:49.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.541+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~HNTQE24MD5BV.0 size=50261 2024-09-12T17:43:49.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.541+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=HNTQE24MD5BV tag=H0L80VHTPF0O type=write size=1098837 2024-09-12T17:43:49.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.545+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=4AANYZUNHS9Y type=del 2024-09-12T17:43:49.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.553+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~EYOQW0NUV2AT.0 size=1048576 2024-09-12T17:43:49.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.553+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~EYOQW0NUV2AT.1 size=1048576 2024-09-12T17:43:49.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.557+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~EYOQW0NUV2AT.2 size=348023 2024-09-12T17:43:49.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.557+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=EYOQW0NUV2AT tag=5P5X521X81ER type=write size=3493751 2024-09-12T17:43:49.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.561+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~TK180YGRBZKE.0 size=957555 2024-09-12T17:43:49.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.569+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=TK180YGRBZKE tag=3KL1JSP37YW2 type=write size=2006131 2024-09-12T17:43:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.573+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=PXKGIFTDTYHJ type=del size=620087 2024-09-12T17:43:49.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.577+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~SI8G2U4XP8LV.0 size=1048576 2024-09-12T17:43:49.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.577+0000 7f51d61a08c0 1 < canceled part key=_multipart_1ZETSL5TXYSM.2~SI8G2U4XP8LV.1 size=1048576 2024-09-12T17:43:49.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.581+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~SI8G2U4XP8LV.2 size=1044474 2024-09-12T17:43:49.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.585+0000 7f51d61a08c0 1 < canceled multipart upload key=1ZETSL5TXYSM upload=SI8G2U4XP8LV tag=PVIGCXNZSWD5 type=write size=4190202 2024-09-12T17:43:49.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.589+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=NS3GCEWIPA8G type=del size=3063423 2024-09-12T17:43:49.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.593+0000 7f51d61a08c0 1 < completed write operation key=2WC0YDQFKAJD tag=K0FCAZ72KH40 type=write size=255477 2024-09-12T17:43:49.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.597+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=XSYJ63M53GF4 type=write size=993069 2024-09-12T17:43:49.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.601+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~KMD7Y8CJWAVZ.0 size=1048576 2024-09-12T17:43:49.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.605+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~KMD7Y8CJWAVZ.1 size=756270 2024-09-12T17:43:49.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.609+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=KMD7Y8CJWAVZ tag=BUHO9R5VIEW5 type=write size=2853422 2024-09-12T17:43:49.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.617+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~B3DAS930JYM2.0 size=4648 2024-09-12T17:43:49.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.617+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=B3DAS930JYM2 tag=TM21WQD2OB05 type=write size=1053224 2024-09-12T17:43:49.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.625+0000 7f51d61a08c0 1 < suggested update operation key=HY2US2MMDNI4 tag=3PPY476BCPPA type=del size=3594430 2024-09-12T17:43:49.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.629+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=LIA2IFEE4B0J type=del size=57675 2024-09-12T17:43:49.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.633+0000 7f51d61a08c0 1 < completed write operation key=7FBK3439R80H tag=2Y6TYTE1XSE5 type=write size=231042 2024-09-12T17:43:49.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.637+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=R419SNFGVR1P type=write size=582583 2024-09-12T17:43:49.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.641+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=0H87ZNU23O3V type=del 2024-09-12T17:43:49.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.645+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=E14AZBO3OESA type=del size=137201 2024-09-12T17:43:49.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.649+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~N243E9NYPBJZ.0 size=660874 2024-09-12T17:43:49.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.653+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=N243E9NYPBJZ tag=27RFMJQ0P5I7 type=write size=1709450 2024-09-12T17:43:49.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.661+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~CTT1XCHOMU15.0 size=164407 2024-09-12T17:43:49.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.661+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=CTT1XCHOMU15 tag=MSZPT1HD75IP type=write size=1212983 2024-09-12T17:43:49.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.661+0000 7f51d61a08c0 1 < canceled part key=_multipart_V5KMBUNVQA0H.2~EBOG6GA1PR5M.0 size=1048576 2024-09-12T17:43:49.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.665+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~EBOG6GA1PR5M.1 size=1048576 2024-09-12T17:43:49.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.669+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~EBOG6GA1PR5M.2 size=38483 2024-09-12T17:43:49.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.673+0000 7f51d61a08c0 1 < canceled multipart upload key=V5KMBUNVQA0H upload=EBOG6GA1PR5M tag=79R9OVFDCSMC type=write size=3184211 2024-09-12T17:43:49.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.677+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=A2D20WH09ADC type=del size=3122878 2024-09-12T17:43:49.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.681+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~G8ORC99UPRSG.0 size=1048576 2024-09-12T17:43:49.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.685+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~G8ORC99UPRSG.1 size=1048576 2024-09-12T17:43:49.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.689+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~G8ORC99UPRSG.2 size=475507 2024-09-12T17:43:49.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.697+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=G8ORC99UPRSG tag=HR2GHJMZT6Y3 type=write size=3621235 2024-09-12T17:43:49.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.697+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=RBGBO0AZ3TJX type=del size=943570 2024-09-12T17:43:49.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.701+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=IG2O9JAQGOQN type=del 2024-09-12T17:43:49.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.705+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=1GR40QYZSE9F type=del size=2712780 2024-09-12T17:43:49.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.709+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~330OR5HXUPGB.0 size=1048576 2024-09-12T17:43:49.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.713+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~330OR5HXUPGB.1 size=1048576 2024-09-12T17:43:49.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.717+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~330OR5HXUPGB.2 size=807005 2024-09-12T17:43:49.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.725+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=330OR5HXUPGB tag=4RAVUYOOKSND type=write size=3952733 2024-09-12T17:43:49.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.729+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=YEYTKNKTB5P8 type=del size=3124686 2024-09-12T17:43:49.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.737+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~6DNMG1PL75HJ.0 size=1046536 2024-09-12T17:43:49.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.741+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=6DNMG1PL75HJ tag=VW8E1AI19ESK type=write size=2095112 2024-09-12T17:43:49.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.749+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~08B7IYSR0WFI.0 size=1048576 2024-09-12T17:43:49.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.753+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~08B7IYSR0WFI.1 size=1048576 2024-09-12T17:43:49.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.753+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~08B7IYSR0WFI.2 size=392470 2024-09-12T17:43:49.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.753+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=08B7IYSR0WFI tag=4IALX7MM798Q type=write size=3538198 2024-09-12T17:43:49.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.761+0000 7f51d61a08c0 1 < suggested remove operation key=GJX1YGAQFXZ2 tag=RH42RJSAUWIB type=write 2024-09-12T17:43:49.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.769+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~JHU7Q1RID7MW.0 size=1048576 2024-09-12T17:43:49.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.773+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~JHU7Q1RID7MW.1 size=1048576 2024-09-12T17:43:49.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.777+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~JHU7Q1RID7MW.2 size=37499 2024-09-12T17:43:49.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.777+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=JHU7Q1RID7MW tag=V2VZ1RZSZ6VX type=write size=3183227 2024-09-12T17:43:49.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.781+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~HNTQE24MD5BV.0 size=50261 2024-09-12T17:43:49.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.785+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=HNTQE24MD5BV tag=H0L80VHTPF0O type=write size=1098837 2024-09-12T17:43:49.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.789+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=7S6H0NI1GWL6 type=del size=13722 2024-09-12T17:43:49.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.793+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~EYOQW0NUV2AT.0 size=1048576 2024-09-12T17:43:49.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.797+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~EYOQW0NUV2AT.1 size=1048576 2024-09-12T17:43:49.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.801+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~EYOQW0NUV2AT.2 size=348023 2024-09-12T17:43:49.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.805+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=EYOQW0NUV2AT tag=5P5X521X81ER type=write size=3493751 2024-09-12T17:43:49.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.809+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=PFYMJVW7044X type=del size=218794 2024-09-12T17:43:49.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.813+0000 7f51d61a08c0 -1 < failed to complete operation key=HY2US2MMDNI4 tag=PXKGIFTDTYHJ type=del size=620087: (22) Invalid argument 2024-09-12T17:43:49.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.817+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=QQS29IM613IF type=write size=989784 2024-09-12T17:43:49.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.821+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=NS3GCEWIPA8G type=del 2024-09-12T17:43:49.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.829+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~OXYBDUB5DPFE.0 size=688942 2024-09-12T17:43:49.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.829+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=OXYBDUB5DPFE tag=6EKINRK4U9W0 type=write size=1737518 2024-09-12T17:43:49.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.833+0000 7f51d61a08c0 1 < completed write operation key=JEXD4ZU5HJ2B tag=XSYJ63M53GF4 type=write size=993069 2024-09-12T17:43:49.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.837+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=23YFTX403AKP type=write size=305908 2024-09-12T17:43:49.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.841+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~B3DAS930JYM2.0 size=4648 2024-09-12T17:43:49.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.845+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=B3DAS930JYM2 tag=TM21WQD2OB05 type=write size=1053224 2024-09-12T17:43:49.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.853+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~5V1BPT14FP2G.0 size=1048576 2024-09-12T17:43:49.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.857+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~5V1BPT14FP2G.1 size=943681 2024-09-12T17:43:49.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.857+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=5V1BPT14FP2G tag=E6J7OHM4OGBM type=write size=3040833 2024-09-12T17:43:49.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.865+0000 7f51d61a08c0 1 < suggested update operation key=X6KC9Z6LD7VG tag=LIA2IFEE4B0J type=del size=57675 2024-09-12T17:43:49.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.869+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~0RBODZ35YL8T.0 size=885924 2024-09-12T17:43:49.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.869+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=0RBODZ35YL8T tag=DFEGZZ7EL2WN type=write size=1934500 2024-09-12T17:43:49.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.873+0000 7f51d61a08c0 -1 < failed to complete operation key=X6KC9Z6LD7VG tag=R419SNFGVR1P type=write size=582583: (22) Invalid argument 2024-09-12T17:43:49.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.877+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=1O4NPV8YJLY2 type=del size=3779787 2024-09-12T17:43:49.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.881+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=E14AZBO3OESA type=del 2024-09-12T17:43:49.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.885+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=PY81LEFH8058 type=del size=1050774 2024-09-12T17:43:49.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.889+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~CTT1XCHOMU15.0 size=164407 2024-09-12T17:43:49.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.897+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=CTT1XCHOMU15 tag=MSZPT1HD75IP type=write size=1212983 2024-09-12T17:43:49.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.901+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=T08GTWZGZPSL type=write size=998937 2024-09-12T17:43:49.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.905+0000 7f51d61a08c0 1 < canceled operation key=83V7KSWRKFMZ tag=A2D20WH09ADC type=del size=3122878 2024-09-12T17:43:49.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.909+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~HC09N4G2SFD0.0 size=18542 2024-09-12T17:43:49.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.909+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=HC09N4G2SFD0 tag=WJHYMCVMCMTQ type=write size=1067118 2024-09-12T17:43:49.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.913+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=RBGBO0AZ3TJX type=del 2024-09-12T17:43:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.917+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=2JQ1IRK9I6AS type=write size=924076 2024-09-12T17:43:49.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.921+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=1GR40QYZSE9F type=del 2024-09-12T17:43:49.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.929+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~RLRAFASLE7KT.0 size=1048576 2024-09-12T17:43:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.933+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~RLRAFASLE7KT.1 size=283326 2024-09-12T17:43:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.933+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=RLRAFASLE7KT tag=BWLE676W2NUU type=write size=2380478 2024-09-12T17:43:49.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.941+0000 7f51d61a08c0 1 < suggested update operation key=SSOA6J297L1C tag=YEYTKNKTB5P8 type=del size=3124686 2024-09-12T17:43:49.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.945+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=R3MX83EYCQ82 type=del size=1297223 2024-09-12T17:43:49.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.949+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~08B7IYSR0WFI.0 size=1048576 2024-09-12T17:43:49.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.949+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~08B7IYSR0WFI.1 size=1048576 2024-09-12T17:43:49.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.953+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~08B7IYSR0WFI.2 size=392470 2024-09-12T17:43:49.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.961+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=08B7IYSR0WFI tag=4IALX7MM798Q type=write size=3538198 2024-09-12T17:43:49.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.965+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~N1MR6U78AXG6.0 size=661087 2024-09-12T17:43:49.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.965+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=N1MR6U78AXG6 tag=5QMK8EJEIMVE type=write size=1709663 2024-09-12T17:43:49.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.969+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~JHU7Q1RID7MW.0 size=1048576 2024-09-12T17:43:49.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.969+0000 7f51d61a08c0 1 < canceled part key=_multipart_GCL7UJEJM1UV.2~JHU7Q1RID7MW.1 size=1048576 2024-09-12T17:43:49.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.973+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~JHU7Q1RID7MW.2 size=37499 2024-09-12T17:43:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.977+0000 7f51d61a08c0 1 < canceled multipart upload key=GCL7UJEJM1UV upload=JHU7Q1RID7MW tag=V2VZ1RZSZ6VX type=write size=3183227 2024-09-12T17:43:49.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.985+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~B9H7UHV1N57E.0 size=102798 2024-09-12T17:43:49.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.985+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=B9H7UHV1N57E tag=JE3EILQFU8C5 type=write size=1151374 2024-09-12T17:43:49.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.989+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=7S6H0NI1GWL6 type=del 2024-09-12T17:43:49.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.993+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=W0U3L3080JQ9 type=del size=427953 2024-09-12T17:43:50.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:49.997+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=PFYMJVW7044X type=del 2024-09-12T17:43:50.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.001+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=MKXXT3AFXBRN type=del size=3846700 2024-09-12T17:43:50.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.005+0000 7f51d61a08c0 1 < canceled operation key=U3GZL9YPFMZY tag=QQS29IM613IF type=write size=989784 2024-09-12T17:43:50.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.009+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=JHT0FJ2A40XQ type=del size=1791288 2024-09-12T17:43:50.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.013+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~OXYBDUB5DPFE.0 size=688942 2024-09-12T17:43:50.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.021+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=OXYBDUB5DPFE tag=6EKINRK4U9W0 type=write size=1737518 2024-09-12T17:43:50.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.025+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=HQRK27MPWTPY type=del size=3413871 2024-09-12T17:43:50.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.029+0000 7f51d61a08c0 1 < canceled operation key=HY2US2MMDNI4 tag=23YFTX403AKP type=write size=305908 2024-09-12T17:43:50.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~GFEY3KKIALZ1.0 size=1048576 2024-09-12T17:43:50.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~GFEY3KKIALZ1.1 size=1048576 2024-09-12T17:43:50.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.041+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~GFEY3KKIALZ1.2 size=517543 2024-09-12T17:43:50.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.041+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=GFEY3KKIALZ1 tag=ULCTYPT4W26Q type=write size=3663271 2024-09-12T17:43:50.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.045+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~5V1BPT14FP2G.0 size=1048576 2024-09-12T17:43:50.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.049+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~5V1BPT14FP2G.1 size=943681 2024-09-12T17:43:50.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.053+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=5V1BPT14FP2G tag=E6J7OHM4OGBM type=write size=3040833 2024-09-12T17:43:50.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.057+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=LPOIF068851V type=del size=3151237 2024-09-12T17:43:50.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.061+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~0RBODZ35YL8T.0 size=885924 2024-09-12T17:43:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.069+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=0RBODZ35YL8T tag=DFEGZZ7EL2WN type=write size=1934500 2024-09-12T17:43:50.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.073+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=6TAIB7KZVKB6 type=del size=3773657 2024-09-12T17:43:50.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.077+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=1O4NPV8YJLY2 type=del 2024-09-12T17:43:50.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.081+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=3NL18R2ZPQZ2 type=del size=1788882 2024-09-12T17:43:50.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.093+0000 7f51d61a08c0 1 < suggested remove operation key=ZCB4V47S38TN tag=PY81LEFH8058 type=del 2024-09-12T17:43:50.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.097+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=UD78Z1VQ5CWR type=del size=510740 2024-09-12T17:43:50.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.101+0000 7f51d61a08c0 1 < completed write operation key=2WC0YDQFKAJD tag=T08GTWZGZPSL type=write size=998937 2024-09-12T17:43:50.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.105+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~5WJBU08KOS07.0 size=22873 2024-09-12T17:43:50.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.105+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=5WJBU08KOS07 tag=X7I85R0Z5RB3 type=write size=1071449 2024-09-12T17:43:50.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.109+0000 7f51d61a08c0 1 < canceled part key=_multipart_BF36J1Q6CZFB.2~HC09N4G2SFD0.0 size=18542 2024-09-12T17:43:50.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.113+0000 7f51d61a08c0 1 < canceled multipart upload key=BF36J1Q6CZFB upload=HC09N4G2SFD0 tag=WJHYMCVMCMTQ type=write size=1067118 2024-09-12T17:43:50.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.121+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~1J5Y0Q2C0Y34.0 size=1048576 2024-09-12T17:43:50.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.125+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~1J5Y0Q2C0Y34.1 size=1048576 2024-09-12T17:43:50.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.125+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~1J5Y0Q2C0Y34.2 size=966187 2024-09-12T17:43:50.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.125+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=1J5Y0Q2C0Y34 tag=JXKDNOHU3MWO type=write size=4111915 2024-09-12T17:43:50.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.129+0000 7f51d61a08c0 1 < completed write operation key=DCLENF1A1W2Q tag=2JQ1IRK9I6AS type=write size=924076 2024-09-12T17:43:50.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.137+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~AZYL0H19PO4R.0 size=1048576 2024-09-12T17:43:50.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.141+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~AZYL0H19PO4R.1 size=581528 2024-09-12T17:43:50.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.141+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=AZYL0H19PO4R tag=LODD27TVBMUS type=write size=2678680 2024-09-12T17:43:50.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.141+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~RLRAFASLE7KT.0 size=1048576 2024-09-12T17:43:50.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.145+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~RLRAFASLE7KT.1 size=283326 2024-09-12T17:43:50.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.153+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=RLRAFASLE7KT tag=BWLE676W2NUU type=write size=2380478 2024-09-12T17:43:50.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.157+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=IW2DLJJ10EQT type=del size=2945841 2024-09-12T17:43:50.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.165+0000 7f51d61a08c0 1 < suggested remove operation key=GCL7UJEJM1UV tag=R3MX83EYCQ82 type=del 2024-09-12T17:43:50.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.169+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=VZRPMQB0K2ZG type=del size=3256825 2024-09-12T17:43:50.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.173+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~N1MR6U78AXG6.0 size=661087 2024-09-12T17:43:50.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.177+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=N1MR6U78AXG6 tag=5QMK8EJEIMVE type=write size=1709663 2024-09-12T17:43:50.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.181+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=UU82GYYT51QB type=del size=1772398 2024-09-12T17:43:50.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.185+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~B9H7UHV1N57E.0 size=102798 2024-09-12T17:43:50.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.189+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=B9H7UHV1N57E tag=JE3EILQFU8C5 type=write size=1151374 2024-09-12T17:43:50.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.193+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=HIIOH1K02GLH type=write size=948677 2024-09-12T17:43:50.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.197+0000 7f51d61a08c0 1 < canceled operation key=V5KMBUNVQA0H tag=W0U3L3080JQ9 type=del size=427953 2024-09-12T17:43:50.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.201+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=XDH0URKCQJ11 type=write size=123191 2024-09-12T17:43:50.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.205+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=MKXXT3AFXBRN type=del 2024-09-12T17:43:50.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.209+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=RWGMTOVIR0V1 type=del size=3357169 2024-09-12T17:43:50.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.221+0000 7f51d61a08c0 1 < suggested remove operation key=HY2US2MMDNI4 tag=JHT0FJ2A40XQ type=del 2024-09-12T17:43:50.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.225+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~6VPYFWLC3G3O.0 size=1048576 2024-09-12T17:43:50.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.229+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~6VPYFWLC3G3O.1 size=1048576 2024-09-12T17:43:50.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.233+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~6VPYFWLC3G3O.2 size=174832 2024-09-12T17:43:50.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.233+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=6VPYFWLC3G3O tag=I1Z2C5MPKFRT type=write size=3320560 2024-09-12T17:43:50.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.237+0000 7f51d61a08c0 -1 < failed to complete operation key=GCL7UJEJM1UV tag=HQRK27MPWTPY type=del size=3413871: (22) Invalid argument 2024-09-12T17:43:50.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.241+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=X8ETIR6CRN1W type=del size=2039037 2024-09-12T17:43:50.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.245+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~GFEY3KKIALZ1.0 size=1048576 2024-09-12T17:43:50.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.245+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~GFEY3KKIALZ1.1 size=1048576 2024-09-12T17:43:50.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.245+0000 7f51d61a08c0 1 < canceled part key=_multipart_DCLENF1A1W2Q.2~GFEY3KKIALZ1.2 size=517543 2024-09-12T17:43:50.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.253+0000 7f51d61a08c0 1 < canceled multipart upload key=DCLENF1A1W2Q upload=GFEY3KKIALZ1 tag=ULCTYPT4W26Q type=write size=3663271 2024-09-12T17:43:50.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.257+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=7IY4M0RP4CLE type=del size=3079056 2024-09-12T17:43:50.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.261+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=LPOIF068851V type=del 2024-09-12T17:43:50.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.265+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=EHFLUMJECOUX type=write size=519562 2024-09-12T17:43:50.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.269+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=6TAIB7KZVKB6 type=del 2024-09-12T17:43:50.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.273+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=8P1AI4GBM10R type=del size=961823 2024-09-12T17:43:50.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.277+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=3NL18R2ZPQZ2 type=del 2024-09-12T17:43:50.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.281+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=KKL2W4T4KIYS type=del size=525776 2024-09-12T17:43:50.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.285+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=UD78Z1VQ5CWR type=del 2024-09-12T17:43:50.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.293+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~WP1VYP78S9J0.0 size=1506 2024-09-12T17:43:50.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.293+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=WP1VYP78S9J0 tag=YRFWJPLGXZOB type=write size=1050082 2024-09-12T17:43:50.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.297+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~5WJBU08KOS07.0 size=22873 2024-09-12T17:43:50.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.305+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=5WJBU08KOS07 tag=X7I85R0Z5RB3 type=write size=1071449 2024-09-12T17:43:50.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.309+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~YING23IBWY73.0 size=410406 2024-09-12T17:43:50.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.309+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=YING23IBWY73 tag=F4WPKMN4JZU0 type=write size=1458982 2024-09-12T17:43:50.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.313+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~1J5Y0Q2C0Y34.0 size=1048576 2024-09-12T17:43:50.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.317+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~1J5Y0Q2C0Y34.1 size=1048576 2024-09-12T17:43:50.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.321+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~1J5Y0Q2C0Y34.2 size=966187 2024-09-12T17:43:50.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.325+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=1J5Y0Q2C0Y34 tag=JXKDNOHU3MWO type=write size=4111915 2024-09-12T17:43:50.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.333+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~QCFN4E4ZPU5H.0 size=1048576 2024-09-12T17:43:50.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.337+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~QCFN4E4ZPU5H.1 size=75556 2024-09-12T17:43:50.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.337+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=QCFN4E4ZPU5H tag=MQF0592HPZQK type=write size=2172708 2024-09-12T17:43:50.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.341+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~AZYL0H19PO4R.0 size=1048576 2024-09-12T17:43:50.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.345+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~AZYL0H19PO4R.1 size=581528 2024-09-12T17:43:50.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.349+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=AZYL0H19PO4R tag=LODD27TVBMUS type=write size=2678680 2024-09-12T17:43:50.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.357+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~T4HSJX0GZ1DC.0 size=1048576 2024-09-12T17:43:50.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.361+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~T4HSJX0GZ1DC.1 size=1048576 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.361+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~T4HSJX0GZ1DC.2 size=823413 2024-09-12T17:43:50.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.361+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=T4HSJX0GZ1DC tag=XSGE62RHPSSF type=write size=3969141 2024-09-12T17:43:50.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.365+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=IW2DLJJ10EQT type=del 2024-09-12T17:43:50.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.373+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~11A1DZZN0SOG.0 size=588284 2024-09-12T17:43:50.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.373+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=11A1DZZN0SOG tag=6JY0Z0SWFZ49 type=write size=1636860 2024-09-12T17:43:50.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.381+0000 7f51d61a08c0 1 < suggested remove operation key=I22NJJISU96B tag=VZRPMQB0K2ZG type=del 2024-09-12T17:43:50.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.385+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=0AHK17J64G3U type=del size=1729126 2024-09-12T17:43:50.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.393+0000 7f51d61a08c0 1 < suggested remove operation key=7FBK3439R80H tag=UU82GYYT51QB type=del 2024-09-12T17:43:50.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.401+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~IECGJK0PNPEL.0 size=1048576 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.405+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~IECGJK0PNPEL.1 size=955282 2024-09-12T17:43:50.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.405+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=IECGJK0PNPEL tag=EE0PG45RADWW type=write size=3052434 2024-09-12T17:43:50.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.409+0000 7f51d61a08c0 1 < completed write operation key=1ZETSL5TXYSM tag=HIIOH1K02GLH type=write size=948677 2024-09-12T17:43:50.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.413+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=F2WAX8PYY35L type=del size=696442 2024-09-12T17:43:50.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.421+0000 7f51d61a08c0 1 < suggested remove operation key=HUWVRJIZ5JYE tag=XDH0URKCQJ11 type=write 2024-09-12T17:43:50.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.425+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=3BZOOVNEFA91 type=del size=3148315 2024-09-12T17:43:50.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.425+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=RWGMTOVIR0V1 type=del 2024-09-12T17:43:50.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.433+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=GZ2Y2B2HZJIE type=write size=807033 2024-09-12T17:43:50.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.437+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~6VPYFWLC3G3O.0 size=1048576 2024-09-12T17:43:50.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.437+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~6VPYFWLC3G3O.1 size=1048576 2024-09-12T17:43:50.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.441+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~6VPYFWLC3G3O.2 size=174832 2024-09-12T17:43:50.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.453+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=6VPYFWLC3G3O tag=I1Z2C5MPKFRT type=write size=3320560 2024-09-12T17:43:50.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.457+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=LTD0C9HO0VZC type=del size=2026013 2024-09-12T17:43:50.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.461+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=X8ETIR6CRN1W type=del 2024-09-12T17:43:50.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.465+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=5NI186IKYDWC type=del size=3972724 2024-09-12T17:43:50.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.469+0000 7f51d61a08c0 1 < canceled operation key=593CD3H40DFH tag=7IY4M0RP4CLE type=del size=3079056 2024-09-12T17:43:50.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.477+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~O0UOEJPINDY2.0 size=1048576 2024-09-12T17:43:50.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.477+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~O0UOEJPINDY2.1 size=1048576 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.481+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~O0UOEJPINDY2.2 size=264443 2024-09-12T17:43:50.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.481+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=O0UOEJPINDY2 tag=GSH5K0W1N617 type=write size=3410171 2024-09-12T17:43:50.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.489+0000 7f51d61a08c0 1 < suggested remove operation key=2WC0YDQFKAJD tag=EHFLUMJECOUX type=write 2024-09-12T17:43:50.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.497+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~Y2SSN4QHMPXH.0 size=1048576 2024-09-12T17:43:50.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.497+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~Y2SSN4QHMPXH.1 size=1048576 2024-09-12T17:43:50.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.501+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~Y2SSN4QHMPXH.2 size=548487 2024-09-12T17:43:50.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.501+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=Y2SSN4QHMPXH tag=4B11DIC2TW2A type=write size=3694215 2024-09-12T17:43:50.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.509+0000 7f51d61a08c0 1 < suggested update operation key=NIQAUF085D97 tag=8P1AI4GBM10R type=del size=961823 2024-09-12T17:43:50.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.513+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~IXEJ5ZJHE0CJ.0 size=1048576 2024-09-12T17:43:50.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.517+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~IXEJ5ZJHE0CJ.1 size=1048576 2024-09-12T17:43:50.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.521+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~IXEJ5ZJHE0CJ.2 size=920471 2024-09-12T17:43:50.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.521+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=IXEJ5ZJHE0CJ tag=OMMC12Z3U7VI type=write size=4066199 2024-09-12T17:43:50.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.525+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=KKL2W4T4KIYS type=del 2024-09-12T17:43:50.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.529+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=Z3NYFY3H3B5X type=write size=298108 2024-09-12T17:43:50.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.533+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~WP1VYP78S9J0.0 size=1506 2024-09-12T17:43:50.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.537+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=WP1VYP78S9J0 tag=YRFWJPLGXZOB type=write size=1050082 2024-09-12T17:43:50.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.541+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=QP5KAV2SL0LK type=del size=2323834 2024-09-12T17:43:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.545+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~YING23IBWY73.0 size=410406 2024-09-12T17:43:50.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.553+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=YING23IBWY73 tag=F4WPKMN4JZU0 type=write size=1458982 2024-09-12T17:43:50.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.557+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~IVKAMM3L8VQQ.0 size=1048576 2024-09-12T17:43:50.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.561+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~IVKAMM3L8VQQ.1 size=548078 2024-09-12T17:43:50.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.561+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=IVKAMM3L8VQQ tag=PFMLR4ZLIPK2 type=write size=2645230 2024-09-12T17:43:50.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.561+0000 7f51d61a08c0 1 < canceled part key=_multipart_7FBK3439R80H.2~QCFN4E4ZPU5H.0 size=1048576 2024-09-12T17:43:50.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.565+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~QCFN4E4ZPU5H.1 size=75556 2024-09-12T17:43:50.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.569+0000 7f51d61a08c0 1 < canceled multipart upload key=7FBK3439R80H upload=QCFN4E4ZPU5H tag=MQF0592HPZQK type=write size=2172708 2024-09-12T17:43:50.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.573+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=BZL3JKZE8WNS type=del size=4100481 2024-09-12T17:43:50.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.577+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~T4HSJX0GZ1DC.0 size=1048576 2024-09-12T17:43:50.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.581+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~T4HSJX0GZ1DC.1 size=1048576 2024-09-12T17:43:50.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.585+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~T4HSJX0GZ1DC.2 size=823413 2024-09-12T17:43:50.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.589+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=T4HSJX0GZ1DC tag=XSGE62RHPSSF type=write size=3969141 2024-09-12T17:43:50.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.593+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=4SYQHKE3GBZO type=del size=2268760 2024-09-12T17:43:50.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.597+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~11A1DZZN0SOG.0 size=588284 2024-09-12T17:43:50.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.601+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=11A1DZZN0SOG tag=6JY0Z0SWFZ49 type=write size=1636860 2024-09-12T17:43:50.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.609+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~JMO7W2QLB86U.0 size=649079 2024-09-12T17:43:50.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.609+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=JMO7W2QLB86U tag=94POG25T5XPV type=write size=1697655 2024-09-12T17:43:50.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.613+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=0AHK17J64G3U type=del 2024-09-12T17:43:50.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.617+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=E4C6A7AJ8N97 type=del size=1883851 2024-09-12T17:43:50.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.617+0000 7f51d61a08c0 1 < canceled part key=_multipart_A7V478K2SNOF.2~IECGJK0PNPEL.0 size=1048576 2024-09-12T17:43:50.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.621+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~IECGJK0PNPEL.1 size=955282 2024-09-12T17:43:50.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.625+0000 7f51d61a08c0 1 < canceled multipart upload key=A7V478K2SNOF upload=IECGJK0PNPEL tag=EE0PG45RADWW type=write size=3052434 2024-09-12T17:43:50.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.629+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=BPMC891LCMBC type=del size=2216745 2024-09-12T17:43:50.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.633+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=F2WAX8PYY35L type=del 2024-09-12T17:43:50.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.637+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=7WG8S3PJ2U1A type=del size=3935180 2024-09-12T17:43:50.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.641+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=3BZOOVNEFA91 type=del 2024-09-12T17:43:50.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.649+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~K05MIRA2AVL9.0 size=278109 2024-09-12T17:43:50.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.649+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=K05MIRA2AVL9 tag=R4MTBAZMUL8K type=write size=1326685 2024-09-12T17:43:50.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.653+0000 7f51d61a08c0 1 < completed write operation key=ZCB4V47S38TN tag=GZ2Y2B2HZJIE type=write size=807033 2024-09-12T17:43:50.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.657+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=PIL8ODVNF1Y9 type=del size=413921 2024-09-12T17:43:50.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.661+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=LTD0C9HO0VZC type=del 2024-09-12T17:43:50.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.665+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=6I3J1T3B6DB3 type=del size=3858543 2024-09-12T17:43:50.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.669+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=5NI186IKYDWC type=del 2024-09-12T17:43:50.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.673+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=UBR0IK0AW8LQ type=del size=1459831 2024-09-12T17:43:50.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.677+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~O0UOEJPINDY2.0 size=1048576 2024-09-12T17:43:50.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.681+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~O0UOEJPINDY2.1 size=1048576 2024-09-12T17:43:50.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.685+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~O0UOEJPINDY2.2 size=264443 2024-09-12T17:43:50.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.689+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=O0UOEJPINDY2 tag=GSH5K0W1N617 type=write size=3410171 2024-09-12T17:43:50.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.693+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=M25RL1B4CZM2 type=del size=3642341 2024-09-12T17:43:50.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.697+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~Y2SSN4QHMPXH.0 size=1048576 2024-09-12T17:43:50.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.697+0000 7f51d61a08c0 1 < canceled part key=_multipart_HUWVRJIZ5JYE.2~Y2SSN4QHMPXH.1 size=1048576 2024-09-12T17:43:50.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.701+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~Y2SSN4QHMPXH.2 size=548487 2024-09-12T17:43:50.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.709+0000 7f51d61a08c0 1 < canceled multipart upload key=HUWVRJIZ5JYE upload=Y2SSN4QHMPXH tag=4B11DIC2TW2A type=write size=3694215 2024-09-12T17:43:50.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.713+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=AZF006ZCGR6H type=del size=3446396 2024-09-12T17:43:50.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.713+0000 7f51d61a08c0 1 < canceled part key=_multipart_GCL7UJEJM1UV.2~IXEJ5ZJHE0CJ.0 size=1048576 2024-09-12T17:43:50.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.717+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~IXEJ5ZJHE0CJ.1 size=1048576 2024-09-12T17:43:50.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.717+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~IXEJ5ZJHE0CJ.2 size=920471 2024-09-12T17:43:50.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.725+0000 7f51d61a08c0 1 < canceled multipart upload key=GCL7UJEJM1UV upload=IXEJ5ZJHE0CJ tag=OMMC12Z3U7VI type=write size=4066199 2024-09-12T17:43:50.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.729+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=J9TB342TF0P7 type=write size=113696 2024-09-12T17:43:50.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.733+0000 7f51d61a08c0 1 < completed write operation key=HUWVRJIZ5JYE tag=Z3NYFY3H3B5X type=write size=298108 2024-09-12T17:43:50.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.737+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=LLL7S6F1YYDG type=del size=1032319 2024-09-12T17:43:50.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.741+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=QP5KAV2SL0LK type=del 2024-09-12T17:43:50.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.745+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=A3QGFCN5GVOV type=del size=1557487 2024-09-12T17:43:50.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.749+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~IVKAMM3L8VQQ.0 size=1048576 2024-09-12T17:43:50.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.753+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~IVKAMM3L8VQQ.1 size=548078 2024-09-12T17:43:50.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.757+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=IVKAMM3L8VQQ tag=PFMLR4ZLIPK2 type=write size=2645230 2024-09-12T17:43:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.765+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~POLWK9CE2TF2.0 size=1048576 2024-09-12T17:43:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.769+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~POLWK9CE2TF2.1 size=836578 2024-09-12T17:43:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.769+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=POLWK9CE2TF2 tag=1ISG11LRL2ED type=write size=2933730 2024-09-12T17:43:50.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.773+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=BZL3JKZE8WNS type=del 2024-09-12T17:43:50.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~ETDK4FGVXU1M.0 size=1048576 2024-09-12T17:43:50.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~ETDK4FGVXU1M.1 size=1048576 2024-09-12T17:43:50.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.785+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~ETDK4FGVXU1M.2 size=98463 2024-09-12T17:43:50.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.785+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=ETDK4FGVXU1M tag=F14KA1D947C5 type=write size=3244191 2024-09-12T17:43:50.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.789+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=4SYQHKE3GBZO type=del 2024-09-12T17:43:50.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.793+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=CWROOGEKQC30 type=del size=4132091 2024-09-12T17:43:50.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.797+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~JMO7W2QLB86U.0 size=649079 2024-09-12T17:43:50.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.805+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=JMO7W2QLB86U tag=94POG25T5XPV type=write size=1697655 2024-09-12T17:43:50.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.809+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=RT9DXF2IWFSC type=del size=1335810 2024-09-12T17:43:50.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.817+0000 7f51d61a08c0 1 < suggested remove operation key=X6KC9Z6LD7VG tag=E4C6A7AJ8N97 type=del 2024-09-12T17:43:50.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.821+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=9FCB1RZW9TA7 type=del size=3606017 2024-09-12T17:43:50.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.825+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=BPMC891LCMBC type=del 2024-09-12T17:43:50.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.833+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~AUSUSIFFMH63.0 size=1048576 2024-09-12T17:43:50.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.837+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~AUSUSIFFMH63.1 size=766610 2024-09-12T17:43:50.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.837+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=AUSUSIFFMH63 tag=IMFBQ9EP1VT0 type=write size=2863762 2024-09-12T17:43:50.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.837+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=7WG8S3PJ2U1A type=del 2024-09-12T17:43:50.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.841+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=8B16OUAYHJW5 type=del size=1804969 2024-09-12T17:43:50.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.849+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~K05MIRA2AVL9.0 size=278109 2024-09-12T17:43:50.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.853+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=K05MIRA2AVL9 tag=R4MTBAZMUL8K type=write size=1326685 2024-09-12T17:43:50.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.861+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~XRKKVR0G46KB.0 size=841343 2024-09-12T17:43:50.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.861+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=XRKKVR0G46KB tag=WWUZ74CI0LCM type=write size=1889919 2024-09-12T17:43:50.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.865+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=PIL8ODVNF1Y9 type=del 2024-09-12T17:43:50.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.869+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~CGC6Y1X4EYM9.0 size=1048576 2024-09-12T17:43:50.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.873+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~CGC6Y1X4EYM9.1 size=1048576 2024-09-12T17:43:50.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.877+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~CGC6Y1X4EYM9.2 size=572327 2024-09-12T17:43:50.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.877+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=CGC6Y1X4EYM9 tag=QJJRAOPCBV71 type=write size=3718055 2024-09-12T17:43:50.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.881+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=6I3J1T3B6DB3 type=del 2024-09-12T17:43:50.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.889+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~GKZ2P01FVVKB.0 size=1048576 2024-09-12T17:43:50.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.889+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~GKZ2P01FVVKB.1 size=218398 2024-09-12T17:43:50.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.889+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=GKZ2P01FVVKB tag=40THGTCNBN2H type=write size=2315550 2024-09-12T17:43:50.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.893+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=UBR0IK0AW8LQ type=del 2024-09-12T17:43:50.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.897+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=01SDAFLN2EXS type=del size=2044476 2024-09-12T17:43:50.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.901+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=M25RL1B4CZM2 type=del 2024-09-12T17:43:50.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.909+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~BASTUBL7H68W.0 size=365322 2024-09-12T17:43:50.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.909+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=BASTUBL7H68W tag=I229ZS3SMV29 type=write size=1413898 2024-09-12T17:43:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.913+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=AZF006ZCGR6H type=del 2024-09-12T17:43:50.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.921+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~3UXIO2KJ5K40.0 size=1048576 2024-09-12T17:43:50.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.921+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~3UXIO2KJ5K40.1 size=1048576 2024-09-12T17:43:50.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.925+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~3UXIO2KJ5K40.2 size=573200 2024-09-12T17:43:50.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.925+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=3UXIO2KJ5K40 tag=RHHX9MO44MKW type=write size=3718928 2024-09-12T17:43:50.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.929+0000 7f51d61a08c0 1 < canceled operation key=V5KMBUNVQA0H tag=J9TB342TF0P7 type=write size=113696 2024-09-12T17:43:50.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.933+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=W70YDFXDBH18 type=del size=3756419 2024-09-12T17:43:50.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.937+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=LLL7S6F1YYDG type=del 2024-09-12T17:43:50.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.945+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~ZGSJSM9I1KZG.0 size=1048576 2024-09-12T17:43:50.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.945+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~ZGSJSM9I1KZG.1 size=1048576 2024-09-12T17:43:50.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.949+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~ZGSJSM9I1KZG.2 size=84184 2024-09-12T17:43:50.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.949+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=ZGSJSM9I1KZG tag=7J67OML5TVN4 type=write size=3229912 2024-09-12T17:43:50.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.953+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=A3QGFCN5GVOV type=del 2024-09-12T17:43:50.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.957+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=CIK8SK7T7L62 type=del size=609377 2024-09-12T17:43:50.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.961+0000 7f51d61a08c0 1 < canceled part key=_multipart_83V7KSWRKFMZ.2~POLWK9CE2TF2.0 size=1048576 2024-09-12T17:43:50.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.965+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~POLWK9CE2TF2.1 size=836578 2024-09-12T17:43:50.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.969+0000 7f51d61a08c0 1 < canceled multipart upload key=83V7KSWRKFMZ upload=POLWK9CE2TF2 tag=1ISG11LRL2ED type=write size=2933730 2024-09-12T17:43:50.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.973+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=GM744MY3BI1S type=del size=86234 2024-09-12T17:43:50.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.977+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~ETDK4FGVXU1M.0 size=1048576 2024-09-12T17:43:50.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.981+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~ETDK4FGVXU1M.1 size=1048576 2024-09-12T17:43:50.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.985+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~ETDK4FGVXU1M.2 size=98463 2024-09-12T17:43:50.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.993+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=ETDK4FGVXU1M tag=F14KA1D947C5 type=write size=3244191 2024-09-12T17:43:50.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.997+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=XJKIG2I96DVL type=write size=458662 2024-09-12T17:43:51.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:50.997+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=CWROOGEKQC30 type=del 2024-09-12T17:43:51.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.001+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=11QLLDLDI8DS type=del size=2547870 2024-09-12T17:43:51.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.005+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=RT9DXF2IWFSC type=del 2024-09-12T17:43:51.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.009+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=7H6SDBYNYL5Q type=del size=2354728 2024-09-12T17:43:51.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.017+0000 7f51d61a08c0 1 < suggested remove operation key=GCL7UJEJM1UV tag=9FCB1RZW9TA7 type=del 2024-09-12T17:43:51.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.021+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=IN91WLEZ58IW type=del size=3848000 2024-09-12T17:43:51.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.025+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~AUSUSIFFMH63.0 size=1048576 2024-09-12T17:43:51.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.029+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~AUSUSIFFMH63.1 size=766610 2024-09-12T17:43:51.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.033+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=AUSUSIFFMH63 tag=IMFBQ9EP1VT0 type=write size=2863762 2024-09-12T17:43:51.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.041+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~069OJ4OSWSU7.0 size=1048576 2024-09-12T17:43:51.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.045+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~069OJ4OSWSU7.1 size=1048576 2024-09-12T17:43:51.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.049+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~069OJ4OSWSU7.2 size=285143 2024-09-12T17:43:51.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.049+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=069OJ4OSWSU7 tag=F21EJ0YDMRAJ type=write size=3430871 2024-09-12T17:43:51.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.053+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=8B16OUAYHJW5 type=del 2024-09-12T17:43:51.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.057+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=8Y7J6Q65X7QW type=del size=3650129 2024-09-12T17:43:51.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.061+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~XRKKVR0G46KB.0 size=841343 2024-09-12T17:43:51.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.065+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=XRKKVR0G46KB tag=WWUZ74CI0LCM type=write size=1889919 2024-09-12T17:43:51.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.069+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=C8A1P2XVCAHW type=del size=559184 2024-09-12T17:43:51.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.073+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~CGC6Y1X4EYM9.0 size=1048576 2024-09-12T17:43:51.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.077+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~CGC6Y1X4EYM9.1 size=1048576 2024-09-12T17:43:51.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.077+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~CGC6Y1X4EYM9.2 size=572327 2024-09-12T17:43:51.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.085+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=CGC6Y1X4EYM9 tag=QJJRAOPCBV71 type=write size=3718055 2024-09-12T17:43:51.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.089+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=KDY9IOXT4J01 type=del size=3429625 2024-09-12T17:43:51.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.089+0000 7f51d61a08c0 1 < canceled part key=_multipart_ZCB4V47S38TN.2~GKZ2P01FVVKB.0 size=1048576 2024-09-12T17:43:51.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.093+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~GKZ2P01FVVKB.1 size=218398 2024-09-12T17:43:51.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.097+0000 7f51d61a08c0 1 < canceled multipart upload key=ZCB4V47S38TN upload=GKZ2P01FVVKB tag=40THGTCNBN2H type=write size=2315550 2024-09-12T17:43:51.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.101+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=OVU8COG2RYUV type=del size=240856 2024-09-12T17:43:51.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.109+0000 7f51d61a08c0 1 < suggested remove operation key=96OWZQXI2ALM tag=01SDAFLN2EXS type=del 2024-09-12T17:43:51.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.117+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~5WN8E1BE5PXQ.0 size=1048576 2024-09-12T17:43:51.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.117+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~5WN8E1BE5PXQ.1 size=124469 2024-09-12T17:43:51.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.117+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=5WN8E1BE5PXQ tag=NJE9VBQIMUOF type=write size=2221621 2024-09-12T17:43:51.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.121+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~BASTUBL7H68W.0 size=365322 2024-09-12T17:43:51.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.129+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=BASTUBL7H68W tag=I229ZS3SMV29 type=write size=1413898 2024-09-12T17:43:51.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.133+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=AQT6LU9AASPR type=del size=1088798 2024-09-12T17:43:51.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.137+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~3UXIO2KJ5K40.0 size=1048576 2024-09-12T17:43:51.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.141+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~3UXIO2KJ5K40.1 size=1048576 2024-09-12T17:43:51.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.141+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~3UXIO2KJ5K40.2 size=573200 2024-09-12T17:43:51.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.149+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=3UXIO2KJ5K40 tag=RHHX9MO44MKW type=write size=3718928 2024-09-12T17:43:51.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.157+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=BIR3NMW64V94 type=del size=1699905 2024-09-12T17:43:51.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.161+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=W70YDFXDBH18 type=del 2024-09-12T17:43:51.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.165+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~OVRSX6A181J7.0 size=1048576 2024-09-12T17:43:51.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.169+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~OVRSX6A181J7.1 size=24865 2024-09-12T17:43:51.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.169+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=OVRSX6A181J7 tag=Q9BT9INW74LU type=write size=2122017 2024-09-12T17:43:51.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.173+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~ZGSJSM9I1KZG.0 size=1048576 2024-09-12T17:43:51.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.177+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~ZGSJSM9I1KZG.1 size=1048576 2024-09-12T17:43:51.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.177+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~ZGSJSM9I1KZG.2 size=84184 2024-09-12T17:43:51.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.185+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=ZGSJSM9I1KZG tag=7J67OML5TVN4 type=write size=3229912 2024-09-12T17:43:51.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.189+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=PTQ64PU350TR type=del size=3331259 2024-09-12T17:43:51.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.193+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=CIK8SK7T7L62 type=del 2024-09-12T17:43:51.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.197+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=Y4GZIFBBV7LT type=del size=1760656 2024-09-12T17:43:51.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.201+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=GM744MY3BI1S type=del 2024-09-12T17:43:51.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.205+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=5R8Z06UJRQBZ type=del size=1603028 2024-09-12T17:43:51.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.209+0000 7f51d61a08c0 1 < completed write operation key=GJX1YGAQFXZ2 tag=XJKIG2I96DVL type=write size=458662 2024-09-12T17:43:51.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.213+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=47U4M80A8AB3 type=del size=4067354 2024-09-12T17:43:51.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.217+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=11QLLDLDI8DS type=del 2024-09-12T17:43:51.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.221+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=W2U7VE3JQZU8 type=del size=1625815 2024-09-12T17:43:51.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.225+0000 7f51d61a08c0 1 < canceled operation key=10WBH16J1AF8 tag=7H6SDBYNYL5Q type=del size=2354728 2024-09-12T17:43:51.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.229+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=V0QQNM3FX352 type=del size=380828 2024-09-12T17:43:51.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.229+0000 7f51d61a08c0 1 < canceled operation key=HY2US2MMDNI4 tag=IN91WLEZ58IW type=del size=3848000 2024-09-12T17:43:51.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.237+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~740YFL7S2VQ1.0 size=1048576 2024-09-12T17:43:51.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.241+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~740YFL7S2VQ1.1 size=931200 2024-09-12T17:43:51.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.241+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=740YFL7S2VQ1 tag=ZFXOAPOP1L44 type=write size=3028352 2024-09-12T17:43:51.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.245+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~069OJ4OSWSU7.0 size=1048576 2024-09-12T17:43:51.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.249+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~069OJ4OSWSU7.1 size=1048576 2024-09-12T17:43:51.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.249+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~069OJ4OSWSU7.2 size=285143 2024-09-12T17:43:51.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.257+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=069OJ4OSWSU7 tag=F21EJ0YDMRAJ type=write size=3430871 2024-09-12T17:43:51.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.261+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=FZNWI4V947SG type=del size=2625083 2024-09-12T17:43:51.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.265+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=8Y7J6Q65X7QW type=del 2024-09-12T17:43:51.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.269+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=CVLLXM16WJ0K type=write size=64268 2024-09-12T17:43:51.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.273+0000 7f51d61a08c0 1 < canceled operation key=V5KMBUNVQA0H tag=C8A1P2XVCAHW type=del size=559184 2024-09-12T17:43:51.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.281+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~7NMEMJL4BGXA.0 size=991175 2024-09-12T17:43:51.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.281+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=7NMEMJL4BGXA tag=04KLKAUY7D1Z type=write size=2039751 2024-09-12T17:43:51.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.285+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=KDY9IOXT4J01 type=del 2024-09-12T17:43:51.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.289+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~GU2P1G0YMP8A.0 size=1048576 2024-09-12T17:43:51.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.293+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~GU2P1G0YMP8A.1 size=991839 2024-09-12T17:43:51.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.293+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=GU2P1G0YMP8A tag=KXG4GNZQ621Q type=write size=3088991 2024-09-12T17:43:51.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.297+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=OVU8COG2RYUV type=del 2024-09-12T17:43:51.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.301+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=37ATO9TQGBW2 type=write size=602326 2024-09-12T17:43:51.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.305+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~5WN8E1BE5PXQ.0 size=1048576 2024-09-12T17:43:51.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.309+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~5WN8E1BE5PXQ.1 size=124469 2024-09-12T17:43:51.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.313+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=5WN8E1BE5PXQ tag=NJE9VBQIMUOF type=write size=2221621 2024-09-12T17:43:51.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.317+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=W3Q46KVV6Y8X type=del size=1893388 2024-09-12T17:43:51.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.325+0000 7f51d61a08c0 1 < suggested update operation key=IWEJXLG1CDAV tag=AQT6LU9AASPR type=del size=1088798 2024-09-12T17:43:51.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.329+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=1XOTDD12OPD4 type=del size=3554197 2024-09-12T17:43:51.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.341+0000 7f51d61a08c0 1 < suggested remove operation key=GJX1YGAQFXZ2 tag=BIR3NMW64V94 type=del 2024-09-12T17:43:51.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.345+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=Z8P7H1ARZSDF type=del size=3886491 2024-09-12T17:43:51.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.349+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~OVRSX6A181J7.0 size=1048576 2024-09-12T17:43:51.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.353+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~OVRSX6A181J7.1 size=24865 2024-09-12T17:43:51.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.361+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=OVRSX6A181J7 tag=Q9BT9INW74LU type=write size=2122017 2024-09-12T17:43:51.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.365+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=34LMNSCIGE3I type=write size=881453 2024-09-12T17:43:51.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.373+0000 7f51d61a08c0 1 < suggested update operation key=XL9QDBTYSP7F tag=PTQ64PU350TR type=del size=3331259 2024-09-12T17:43:51.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.377+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=AFEHICDFF9CK type=write size=162582 2024-09-12T17:43:51.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.389+0000 7f51d61a08c0 1 < suggested remove operation key=S292EX1P7IZA tag=Y4GZIFBBV7LT type=del 2024-09-12T17:43:51.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.393+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=HRBRHAHQ1X7Y type=del size=2693253 2024-09-12T17:43:51.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.397+0000 7f51d61a08c0 -1 < failed to complete operation key=XL9QDBTYSP7F tag=5R8Z06UJRQBZ type=del size=1603028: (22) Invalid argument 2024-09-12T17:43:51.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.405+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~TG0FYOAD7LUD.0 size=555882 2024-09-12T17:43:51.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.405+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=TG0FYOAD7LUD tag=4887E5DVLJ9B type=write size=1604458 2024-09-12T17:43:51.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.409+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=47U4M80A8AB3 type=del 2024-09-12T17:43:51.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.417+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~UKDSY2X49NJE.0 size=1048576 2024-09-12T17:43:51.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.417+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~UKDSY2X49NJE.1 size=507156 2024-09-12T17:43:51.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.417+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=UKDSY2X49NJE tag=92341WU2EYOP type=write size=2604308 2024-09-12T17:43:51.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.421+0000 7f51d61a08c0 -1 < failed to complete operation key=GJX1YGAQFXZ2 tag=W2U7VE3JQZU8 type=del size=1625815: (22) Invalid argument 2024-09-12T17:43:51.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.425+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=FBBI6OXWR88S type=del size=523173 2024-09-12T17:43:51.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.429+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=V0QQNM3FX352 type=del 2024-09-12T17:43:51.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.433+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=THRCKWWK6UU3 type=del size=3009279 2024-09-12T17:43:51.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.437+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~740YFL7S2VQ1.0 size=1048576 2024-09-12T17:43:51.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.441+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~740YFL7S2VQ1.1 size=931200 2024-09-12T17:43:51.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.449+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=740YFL7S2VQ1 tag=ZFXOAPOP1L44 type=write size=3028352 2024-09-12T17:43:51.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.453+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~P7SJOMIG74JI.0 size=326598 2024-09-12T17:43:51.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.453+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=P7SJOMIG74JI tag=EIEKN3DBIKBC type=write size=1375174 2024-09-12T17:43:51.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.457+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=FZNWI4V947SG type=del 2024-09-12T17:43:51.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.461+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=9XLF3J633C38 type=write size=1007880 2024-09-12T17:43:51.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.465+0000 7f51d61a08c0 1 < completed write operation key=26X723PN8K8T tag=CVLLXM16WJ0K type=write size=64268 2024-09-12T17:43:51.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.469+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=3JD0Y01G8SFS type=del size=676612 2024-09-12T17:43:51.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.473+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~7NMEMJL4BGXA.0 size=991175 2024-09-12T17:43:51.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.481+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=7NMEMJL4BGXA tag=04KLKAUY7D1Z type=write size=2039751 2024-09-12T17:43:51.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.485+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=3ILRJHMU9SHR type=del size=2187075 2024-09-12T17:43:51.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.489+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~GU2P1G0YMP8A.0 size=1048576 2024-09-12T17:43:51.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.489+0000 7f51d61a08c0 1 < canceled part key=_multipart_NIQAUF085D97.2~GU2P1G0YMP8A.1 size=991839 2024-09-12T17:43:51.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.493+0000 7f51d61a08c0 1 < canceled multipart upload key=NIQAUF085D97 upload=GU2P1G0YMP8A tag=KXG4GNZQ621Q type=write size=3088991 2024-09-12T17:43:51.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.497+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=561ALL14TUY5 type=del size=1546445 2024-09-12T17:43:51.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.501+0000 7f51d61a08c0 1 < completed write operation key=FKKV7SXZSP90 tag=37ATO9TQGBW2 type=write size=602326 2024-09-12T17:43:51.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.509+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~4NBJ643MVY5U.0 size=1048576 2024-09-12T17:43:51.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.513+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~4NBJ643MVY5U.1 size=1048576 2024-09-12T17:43:51.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.513+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~4NBJ643MVY5U.2 size=586122 2024-09-12T17:43:51.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.513+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=4NBJ643MVY5U tag=GU3T4RDV6E09 type=write size=3731850 2024-09-12T17:43:51.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.517+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=W3Q46KVV6Y8X type=del 2024-09-12T17:43:51.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.529+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~IY49O9A1L01Q.0 size=1048576 2024-09-12T17:43:51.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.533+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~IY49O9A1L01Q.1 size=755496 2024-09-12T17:43:51.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.533+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=IY49O9A1L01Q tag=UY9R631AT2ZH type=write size=2852648 2024-09-12T17:43:51.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.537+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=1XOTDD12OPD4 type=del 2024-09-12T17:43:51.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.541+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=0ACELQGK57VP type=write size=782978 2024-09-12T17:43:51.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.545+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=Z8P7H1ARZSDF type=del 2024-09-12T17:43:51.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.549+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=IWR59ZHFF403 type=del size=1888244 2024-09-12T17:43:51.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.553+0000 7f51d61a08c0 -1 < failed to complete operation key=XL9QDBTYSP7F tag=34LMNSCIGE3I type=write size=881453: (22) Invalid argument 2024-09-12T17:43:51.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.557+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~0929WDBIPOAP.0 size=1048576 2024-09-12T17:43:51.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.561+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~0929WDBIPOAP.1 size=156486 2024-09-12T17:43:51.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.561+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=0929WDBIPOAP tag=7QO1QKKLU94L type=write size=2253638 2024-09-12T17:43:51.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.565+0000 7f51d61a08c0 1 < completed write operation key=HUWVRJIZ5JYE tag=AFEHICDFF9CK type=write size=162582 2024-09-12T17:43:51.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.569+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=AF0UVN4NMR7D type=write size=251643 2024-09-12T17:43:51.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.573+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=HRBRHAHQ1X7Y type=del 2024-09-12T17:43:51.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.577+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=SJKGWS01Q0VL type=del size=3486313 2024-09-12T17:43:51.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.581+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~TG0FYOAD7LUD.0 size=555882 2024-09-12T17:43:51.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.585+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=TG0FYOAD7LUD tag=4887E5DVLJ9B type=write size=1604458 2024-09-12T17:43:51.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.589+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=J4IXTASJHAWY type=del size=4000347 2024-09-12T17:43:51.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.593+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~UKDSY2X49NJE.0 size=1048576 2024-09-12T17:43:51.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.597+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~UKDSY2X49NJE.1 size=507156 2024-09-12T17:43:51.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.601+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=UKDSY2X49NJE tag=92341WU2EYOP type=write size=2604308 2024-09-12T17:43:51.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.605+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=SPI1YJR8LX5K type=del size=1243821 2024-09-12T17:43:51.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.609+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=FBBI6OXWR88S type=del 2024-09-12T17:43:51.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.617+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~GJREIIWXLQ59.0 size=1048576 2024-09-12T17:43:51.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.621+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~GJREIIWXLQ59.1 size=538441 2024-09-12T17:43:51.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.621+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=GJREIIWXLQ59 tag=GJS0JXJG7KCE type=write size=2635593 2024-09-12T17:43:51.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.625+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=THRCKWWK6UU3 type=del 2024-09-12T17:43:51.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.629+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=UONGC2BS4VDB type=del size=2246312 2024-09-12T17:43:51.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.633+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~P7SJOMIG74JI.0 size=326598 2024-09-12T17:43:51.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.637+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=P7SJOMIG74JI tag=EIEKN3DBIKBC type=write size=1375174 2024-09-12T17:43:51.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.641+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=D3EGR3HRLL60 type=del size=1848324 2024-09-12T17:43:51.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.645+0000 7f51d61a08c0 1 < completed write operation key=8J72KCZ5WRPU tag=9XLF3J633C38 type=write size=1007880 2024-09-12T17:43:51.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.649+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=7LEZ32H2L4IE type=del size=2496269 2024-09-12T17:43:51.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.657+0000 7f51d61a08c0 1 < suggested remove operation key=FKKV7SXZSP90 tag=3JD0Y01G8SFS type=del 2024-09-12T17:43:51.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.661+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=S6ZPCDE23V8P type=del size=2127622 2024-09-12T17:43:51.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.665+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=3ILRJHMU9SHR type=del 2024-09-12T17:43:51.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.669+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~TB10KT6XOBCY.0 size=269636 2024-09-12T17:43:51.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.669+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=TB10KT6XOBCY tag=6CUO3Q9M8W46 type=write size=1318212 2024-09-12T17:43:51.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.673+0000 7f51d61a08c0 1 < completed delete operation key=U3GZL9YPFMZY tag=561ALL14TUY5 type=del 2024-09-12T17:43:51.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.681+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~B3MTZVXSXMUD.0 size=1048576 2024-09-12T17:43:51.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.685+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~B3MTZVXSXMUD.1 size=1048576 2024-09-12T17:43:51.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.685+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~B3MTZVXSXMUD.2 size=949664 2024-09-12T17:43:51.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.685+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=B3MTZVXSXMUD tag=MXHIYH579J4X type=write size=4095392 2024-09-12T17:43:51.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.693+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~4NBJ643MVY5U.0 size=1048576 2024-09-12T17:43:51.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.693+0000 7f51d61a08c0 1 < canceled part key=_multipart_BF36J1Q6CZFB.2~4NBJ643MVY5U.1 size=1048576 2024-09-12T17:43:51.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.693+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~4NBJ643MVY5U.2 size=586122 2024-09-12T17:43:51.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.701+0000 7f51d61a08c0 1 < canceled multipart upload key=BF36J1Q6CZFB upload=4NBJ643MVY5U tag=GU3T4RDV6E09 type=write size=3731850 2024-09-12T17:43:51.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.705+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=19OBA16S2861 type=write size=385843 2024-09-12T17:43:51.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.705+0000 7f51d61a08c0 1 < canceled part key=_multipart_83V7KSWRKFMZ.2~IY49O9A1L01Q.0 size=1048576 2024-09-12T17:43:51.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.709+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~IY49O9A1L01Q.1 size=755496 2024-09-12T17:43:51.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.713+0000 7f51d61a08c0 1 < canceled multipart upload key=83V7KSWRKFMZ upload=IY49O9A1L01Q tag=UY9R631AT2ZH type=write size=2852648 2024-09-12T17:43:51.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.717+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=AXJ8K5980LN3 type=del size=1679477 2024-09-12T17:43:51.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.721+0000 7f51d61a08c0 1 < completed write operation key=GJX1YGAQFXZ2 tag=0ACELQGK57VP type=write size=782978 2024-09-12T17:43:51.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.729+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~8FLZP90LC5HY.0 size=1048576 2024-09-12T17:43:51.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.733+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~8FLZP90LC5HY.1 size=138710 2024-09-12T17:43:51.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.733+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=8FLZP90LC5HY tag=P2AMYU51YR3Y type=write size=2235862 2024-09-12T17:43:51.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.737+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=IWR59ZHFF403 type=del 2024-09-12T17:43:51.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.945+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~373CMBIUVN2B.0 size=116194 2024-09-12T17:43:51.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.945+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=373CMBIUVN2B tag=3KITH243VWB3 type=write size=1164770 2024-09-12T17:43:51.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.949+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~0929WDBIPOAP.0 size=1048576 2024-09-12T17:43:51.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.953+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~0929WDBIPOAP.1 size=156486 2024-09-12T17:43:51.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.961+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=0929WDBIPOAP tag=7QO1QKKLU94L type=write size=2253638 2024-09-12T17:43:51.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.965+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=BZ0RR0LZVYTJ type=del size=523184 2024-09-12T17:43:51.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.969+0000 7f51d61a08c0 1 < completed write operation key=X6KC9Z6LD7VG tag=AF0UVN4NMR7D type=write size=251643 2024-09-12T17:43:51.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.973+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=5YP1SQYXRB06 type=del size=2872067 2024-09-12T17:43:51.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.981+0000 7f51d61a08c0 1 < suggested update operation key=83V7KSWRKFMZ tag=SJKGWS01Q0VL type=del size=3486313 2024-09-12T17:43:51.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.989+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~Y2OHJYROWRXD.0 size=1048576 2024-09-12T17:43:51.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.993+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~Y2OHJYROWRXD.1 size=1048576 2024-09-12T17:43:51.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.993+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~Y2OHJYROWRXD.2 size=86221 2024-09-12T17:43:51.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.993+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=Y2OHJYROWRXD tag=Q5DJM3LG911H type=write size=3231949 2024-09-12T17:43:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:51.997+0000 7f51d61a08c0 -1 < failed to complete operation key=83V7KSWRKFMZ tag=J4IXTASJHAWY type=del size=4000347: (22) Invalid argument 2024-09-12T17:43:52.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.005+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~GCY4LIVJS8PR.0 size=1048576 2024-09-12T17:43:52.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.009+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~GCY4LIVJS8PR.1 size=424918 2024-09-12T17:43:52.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.009+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=GCY4LIVJS8PR tag=AUNRLGWI0S92 type=write size=2522070 2024-09-12T17:43:52.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.013+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=SPI1YJR8LX5K type=del 2024-09-12T17:43:52.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.017+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=H1Q7M0PLVA25 type=del size=2762495 2024-09-12T17:43:52.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.021+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~GJREIIWXLQ59.0 size=1048576 2024-09-12T17:43:52.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.025+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~GJREIIWXLQ59.1 size=538441 2024-09-12T17:43:52.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.029+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=GJREIIWXLQ59 tag=GJS0JXJG7KCE type=write size=2635593 2024-09-12T17:43:52.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.033+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=6UV3F9QRKNAX type=del size=2146221 2024-09-12T17:43:52.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.037+0000 7f51d61a08c0 1 < completed delete operation key=U3GZL9YPFMZY tag=UONGC2BS4VDB type=del 2024-09-12T17:43:52.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.041+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=C3RDV37ZAYM9 type=write size=895521 2024-09-12T17:43:52.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.045+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=D3EGR3HRLL60 type=del 2024-09-12T17:43:52.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.049+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=XBD3HXWWYMJ0 type=write size=614 2024-09-12T17:43:52.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.053+0000 7f51d61a08c0 -1 < failed to complete operation key=FKKV7SXZSP90 tag=7LEZ32H2L4IE type=del size=2496269: (22) Invalid argument 2024-09-12T17:43:52.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.057+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=RX80T90LYVJJ type=del size=3908076 2024-09-12T17:43:52.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.061+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=S6ZPCDE23V8P type=del 2024-09-12T17:43:52.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.065+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=JM1L6WP1JK13 type=write size=802802 2024-09-12T17:43:52.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.069+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~TB10KT6XOBCY.0 size=269636 2024-09-12T17:43:52.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.077+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=TB10KT6XOBCY tag=6CUO3Q9M8W46 type=write size=1318212 2024-09-12T17:43:52.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.081+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=2SNONKY6A5LT type=del size=3951033 2024-09-12T17:43:52.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.085+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~B3MTZVXSXMUD.0 size=1048576 2024-09-12T17:43:52.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.089+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~B3MTZVXSXMUD.1 size=1048576 2024-09-12T17:43:52.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.093+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~B3MTZVXSXMUD.2 size=949664 2024-09-12T17:43:52.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.101+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=B3MTZVXSXMUD tag=MXHIYH579J4X type=write size=4095392 2024-09-12T17:43:52.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.105+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=YI7VROPWLWDW type=del size=541559 2024-09-12T17:43:52.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.109+0000 7f51d61a08c0 1 < completed write operation key=96OWZQXI2ALM tag=19OBA16S2861 type=write size=385843 2024-09-12T17:43:52.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.113+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=U2ZUCWRER7B4 type=del size=599828 2024-09-12T17:43:52.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.117+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=AXJ8K5980LN3 type=del 2024-09-12T17:43:52.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.121+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~HM6NE09Q8TNQ.0 size=1048576 2024-09-12T17:43:52.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.125+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~HM6NE09Q8TNQ.1 size=1048576 2024-09-12T17:43:52.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.129+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~HM6NE09Q8TNQ.2 size=151588 2024-09-12T17:43:52.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.129+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=HM6NE09Q8TNQ tag=RGHISK4GXGFO type=write size=3297316 2024-09-12T17:43:52.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.133+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~8FLZP90LC5HY.0 size=1048576 2024-09-12T17:43:52.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.133+0000 7f51d61a08c0 1 < canceled part key=_multipart_83V7KSWRKFMZ.2~8FLZP90LC5HY.1 size=138710 2024-09-12T17:43:52.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.137+0000 7f51d61a08c0 1 < canceled multipart upload key=83V7KSWRKFMZ upload=8FLZP90LC5HY tag=P2AMYU51YR3Y type=write size=2235862 2024-09-12T17:43:52.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.141+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=P3I9NO0XRQ0W type=write size=937947 2024-09-12T17:43:52.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.145+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~373CMBIUVN2B.0 size=116194 2024-09-12T17:43:52.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.153+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=373CMBIUVN2B tag=3KITH243VWB3 type=write size=1164770 2024-09-12T17:43:52.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.157+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=ROEA1R13KNZS type=del size=3199815 2024-09-12T17:43:52.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.161+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=BZ0RR0LZVYTJ type=del 2024-09-12T17:43:52.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.165+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=SLUHO4L9FH19 type=write size=781043 2024-09-12T17:43:52.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.169+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=5YP1SQYXRB06 type=del 2024-09-12T17:43:52.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.173+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=8PUJRJD03NN7 type=del size=334328 2024-09-12T17:43:52.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.177+0000 7f51d61a08c0 1 < canceled part key=_multipart_HUWVRJIZ5JYE.2~Y2OHJYROWRXD.0 size=1048576 2024-09-12T17:43:52.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.177+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~Y2OHJYROWRXD.1 size=1048576 2024-09-12T17:43:52.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.181+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~Y2OHJYROWRXD.2 size=86221 2024-09-12T17:43:52.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.189+0000 7f51d61a08c0 1 < canceled multipart upload key=HUWVRJIZ5JYE upload=Y2OHJYROWRXD tag=Q5DJM3LG911H type=write size=3231949 2024-09-12T17:43:52.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.193+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=XDLGCA1T9A09 type=del size=2016126 2024-09-12T17:43:52.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.193+0000 7f51d61a08c0 1 < canceled part key=_multipart_GJX1YGAQFXZ2.2~GCY4LIVJS8PR.0 size=1048576 2024-09-12T17:43:52.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.197+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~GCY4LIVJS8PR.1 size=424918 2024-09-12T17:43:52.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.201+0000 7f51d61a08c0 1 < canceled multipart upload key=GJX1YGAQFXZ2 upload=GCY4LIVJS8PR tag=AUNRLGWI0S92 type=write size=2522070 2024-09-12T17:43:52.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.209+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~VD8BNSEI0MWN.0 size=1048576 2024-09-12T17:43:52.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.213+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~VD8BNSEI0MWN.1 size=837412 2024-09-12T17:43:52.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.213+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=VD8BNSEI0MWN tag=K9N4RAS9KTZL type=write size=2934564 2024-09-12T17:43:52.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.221+0000 7f51d61a08c0 1 < suggested update operation key=GCL7UJEJM1UV tag=H1Q7M0PLVA25 type=del size=2762495 2024-09-12T17:43:52.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.225+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=FXNU3Q9GVNGQ type=del size=58044 2024-09-12T17:43:52.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.233+0000 7f51d61a08c0 1 < suggested update operation key=10WBH16J1AF8 tag=6UV3F9QRKNAX type=del size=2146221 2024-09-12T17:43:52.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.237+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~MIK655VUMW0F.0 size=860203 2024-09-12T17:43:52.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.237+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=MIK655VUMW0F tag=EY6JW8602FQY type=write size=1908779 2024-09-12T17:43:52.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.241+0000 7f51d61a08c0 1 < completed write operation key=JT373R4HAJZS tag=C3RDV37ZAYM9 type=write size=895521 2024-09-12T17:43:52.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.249+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~2DGQD21FVGMO.0 size=1048576 2024-09-12T17:43:52.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.253+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~2DGQD21FVGMO.1 size=1048576 2024-09-12T17:43:52.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.253+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~2DGQD21FVGMO.2 size=314829 2024-09-12T17:43:52.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.253+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=2DGQD21FVGMO tag=7MZGNN1SXI2Y type=write size=3460557 2024-09-12T17:43:52.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.257+0000 7f51d61a08c0 1 < completed write operation key=BF36J1Q6CZFB tag=XBD3HXWWYMJ0 type=write size=614 2024-09-12T17:43:52.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.265+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=UVJCTK47ZV58 type=write size=319892 2024-09-12T17:43:52.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.265+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=RX80T90LYVJJ type=del 2024-09-12T17:43:52.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.273+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=OOG7R49JD4WH type=write size=859922 2024-09-12T17:43:52.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.277+0000 7f51d61a08c0 1 < canceled operation key=8J72KCZ5WRPU tag=JM1L6WP1JK13 type=write size=802802 2024-09-12T17:43:52.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.281+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=A8OXWKXXB7AI type=del size=2933179 2024-09-12T17:43:52.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.281+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=2SNONKY6A5LT type=del 2024-09-12T17:43:52.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.285+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=5RL5683Q5GSX type=del size=2114666 2024-09-12T17:43:52.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.293+0000 7f51d61a08c0 1 < suggested update operation key=593CD3H40DFH tag=YI7VROPWLWDW type=del size=541559 2024-09-12T17:43:52.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.297+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=DTZW9NT1MQHF type=del size=3226963 2024-09-12T17:43:52.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.301+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=U2ZUCWRER7B4 type=del 2024-09-12T17:43:52.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.305+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=AM4CSQOYIUIF type=del size=398705 2024-09-12T17:43:52.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.309+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~HM6NE09Q8TNQ.0 size=1048576 2024-09-12T17:43:52.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.313+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~HM6NE09Q8TNQ.1 size=1048576 2024-09-12T17:43:52.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.313+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~HM6NE09Q8TNQ.2 size=151588 2024-09-12T17:43:52.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.321+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=HM6NE09Q8TNQ tag=RGHISK4GXGFO type=write size=3297316 2024-09-12T17:43:52.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.329+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~37WPPZ5ZZQN6.0 size=31086 2024-09-12T17:43:52.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.329+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=37WPPZ5ZZQN6 tag=1DL7ZXU12ES9 type=write size=1079662 2024-09-12T17:43:52.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.333+0000 7f51d61a08c0 1 < completed write operation key=HUWVRJIZ5JYE tag=P3I9NO0XRQ0W type=write size=937947 2024-09-12T17:43:52.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.337+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~E0F647DLPR95.0 size=1048576 2024-09-12T17:43:52.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.341+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~E0F647DLPR95.1 size=31676 2024-09-12T17:43:52.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.341+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=E0F647DLPR95 tag=2LG4QZP4DSRB type=write size=2128828 2024-09-12T17:43:52.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.345+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=ROEA1R13KNZS type=del 2024-09-12T17:43:52.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.353+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=IF4K89AA4BIV type=write size=905942 2024-09-12T17:43:52.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.361+0000 7f51d61a08c0 1 < suggested update operation key=2WC0YDQFKAJD tag=SLUHO4L9FH19 type=write size=781043 2024-09-12T17:43:52.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.365+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~RTDY15PUNUCN.0 size=1048576 2024-09-12T17:43:52.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.369+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~RTDY15PUNUCN.1 size=1048576 2024-09-12T17:43:52.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.373+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~RTDY15PUNUCN.2 size=448261 2024-09-12T17:43:52.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.373+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=RTDY15PUNUCN tag=EI11P5HGS8KK type=write size=3593989 2024-09-12T17:43:52.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.377+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=8PUJRJD03NN7 type=del 2024-09-12T17:43:52.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.385+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~QQEM36FZNY45.0 size=1048576 2024-09-12T17:43:52.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.385+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~QQEM36FZNY45.1 size=460044 2024-09-12T17:43:52.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.385+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=QQEM36FZNY45 tag=1B6PY5Q6LW31 type=write size=2557196 2024-09-12T17:43:52.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.389+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=XDLGCA1T9A09 type=del 2024-09-12T17:43:52.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.397+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~ZO6GVD5SC654.0 size=1048576 2024-09-12T17:43:52.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.401+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~ZO6GVD5SC654.1 size=262623 2024-09-12T17:43:52.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.401+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=ZO6GVD5SC654 tag=UOFSM5S2VB73 type=write size=2359775 2024-09-12T17:43:52.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.405+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~VD8BNSEI0MWN.0 size=1048576 2024-09-12T17:43:52.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.409+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~VD8BNSEI0MWN.1 size=837412 2024-09-12T17:43:52.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.413+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=VD8BNSEI0MWN tag=K9N4RAS9KTZL type=write size=2934564 2024-09-12T17:43:52.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.417+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=PK3V5AGZ7LP9 type=del size=526775 2024-09-12T17:43:52.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.421+0000 7f51d61a08c0 -1 < failed to complete operation key=2WC0YDQFKAJD tag=FXNU3Q9GVNGQ type=del size=58044: (22) Invalid argument 2024-09-12T17:43:52.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.425+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=0WV7W4302PE5 type=del size=3438017 2024-09-12T17:43:52.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.429+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~MIK655VUMW0F.0 size=860203 2024-09-12T17:43:52.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.437+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=MIK655VUMW0F tag=EY6JW8602FQY type=write size=1908779 2024-09-12T17:43:52.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.445+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~AWZCYHO4O9X5.0 size=1048576 2024-09-12T17:43:52.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.449+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~AWZCYHO4O9X5.1 size=1048576 2024-09-12T17:43:52.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.449+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~AWZCYHO4O9X5.2 size=765913 2024-09-12T17:43:52.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.449+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=AWZCYHO4O9X5 tag=RSU97S8H2QWV type=write size=3911641 2024-09-12T17:43:52.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.461+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~2DGQD21FVGMO.0 size=1048576 2024-09-12T17:43:52.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.465+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~2DGQD21FVGMO.1 size=1048576 2024-09-12T17:43:52.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.465+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~2DGQD21FVGMO.2 size=314829 2024-09-12T17:43:52.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.473+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=2DGQD21FVGMO tag=7MZGNN1SXI2Y type=write size=3460557 2024-09-12T17:43:52.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.477+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=69Y9OSJ0I0ZE type=del size=2057350 2024-09-12T17:43:52.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.481+0000 7f51d61a08c0 1 < completed write operation key=ZCB4V47S38TN tag=UVJCTK47ZV58 type=write size=319892 2024-09-12T17:43:52.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.489+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~3BVP1J0E748J.0 size=202630 2024-09-12T17:43:52.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.489+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=3BVP1J0E748J tag=H2RNKE4DO8DW type=write size=1251206 2024-09-12T17:43:52.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.493+0000 7f51d61a08c0 1 < completed write operation key=JT373R4HAJZS tag=OOG7R49JD4WH type=write size=859922 2024-09-12T17:43:52.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.497+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=QY9CHI0LSGM4 type=del size=250582 2024-09-12T17:43:52.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.509+0000 7f51d61a08c0 1 < suggested update operation key=JEXD4ZU5HJ2B tag=A8OXWKXXB7AI type=del size=2933179 2024-09-12T17:43:52.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.517+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~DOW8V16TI2YP.0 size=1048576 2024-09-12T17:43:52.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.517+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~DOW8V16TI2YP.1 size=808617 2024-09-12T17:43:52.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.517+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=DOW8V16TI2YP tag=1Q7KUWFZ6BPN type=write size=2905769 2024-09-12T17:43:52.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.521+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=5RL5683Q5GSX type=del 2024-09-12T17:43:52.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.529+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~Y5JGLL957CLG.0 size=1048576 2024-09-12T17:43:52.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.533+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~Y5JGLL957CLG.1 size=1048576 2024-09-12T17:43:52.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.533+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~Y5JGLL957CLG.2 size=660336 2024-09-12T17:43:52.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.533+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=Y5JGLL957CLG tag=PCLGHFD3G8M1 type=write size=3806064 2024-09-12T17:43:52.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.537+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=DTZW9NT1MQHF type=del 2024-09-12T17:43:52.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.541+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=E1NCVOJZZBLX type=write size=1018866 2024-09-12T17:43:52.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.545+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=AM4CSQOYIUIF type=del 2024-09-12T17:43:52.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.549+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=1QB2C3GG27B0 type=del size=1588709 2024-09-12T17:43:52.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.553+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~37WPPZ5ZZQN6.0 size=31086 2024-09-12T17:43:52.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.561+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=37WPPZ5ZZQN6 tag=1DL7ZXU12ES9 type=write size=1079662 2024-09-12T17:43:52.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.565+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=6M1WIQ4CNZ2J type=del size=1540309 2024-09-12T17:43:52.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.569+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~E0F647DLPR95.0 size=1048576 2024-09-12T17:43:52.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.569+0000 7f51d61a08c0 1 < canceled part key=_multipart_S292EX1P7IZA.2~E0F647DLPR95.1 size=31676 2024-09-12T17:43:52.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.573+0000 7f51d61a08c0 1 < canceled multipart upload key=S292EX1P7IZA upload=E0F647DLPR95 tag=2LG4QZP4DSRB type=write size=2128828 2024-09-12T17:43:52.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.577+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=5IOIG50F1MN5 type=del size=3497931 2024-09-12T17:43:52.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.585+0000 7f51d61a08c0 1 < suggested update operation key=GCL7UJEJM1UV tag=IF4K89AA4BIV type=write size=905942 2024-09-12T17:43:52.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.593+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~6JE5G6V10AGM.0 size=1048576 2024-09-12T17:43:52.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.593+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~6JE5G6V10AGM.1 size=1048576 2024-09-12T17:43:52.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.597+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~6JE5G6V10AGM.2 size=243726 2024-09-12T17:43:52.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.597+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=6JE5G6V10AGM tag=TYXXKM4ZUI46 type=write size=3389454 2024-09-12T17:43:52.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.601+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~RTDY15PUNUCN.0 size=1048576 2024-09-12T17:43:52.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.601+0000 7f51d61a08c0 1 < canceled part key=_multipart_XL9QDBTYSP7F.2~RTDY15PUNUCN.1 size=1048576 2024-09-12T17:43:52.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.605+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~RTDY15PUNUCN.2 size=448261 2024-09-12T17:43:52.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.613+0000 7f51d61a08c0 1 < canceled multipart upload key=XL9QDBTYSP7F upload=RTDY15PUNUCN tag=EI11P5HGS8KK type=write size=3593989 2024-09-12T17:43:52.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.617+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=C92H0XF4VX4D type=del size=1919672 2024-09-12T17:43:52.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.621+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~QQEM36FZNY45.0 size=1048576 2024-09-12T17:43:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.625+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~QQEM36FZNY45.1 size=460044 2024-09-12T17:43:52.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.633+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=QQEM36FZNY45 tag=1B6PY5Q6LW31 type=write size=2557196 2024-09-12T17:43:52.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.637+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=FQI0TKTQB1NY type=del size=3187432 2024-09-12T17:43:52.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.641+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~ZO6GVD5SC654.0 size=1048576 2024-09-12T17:43:52.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.645+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~ZO6GVD5SC654.1 size=262623 2024-09-12T17:43:52.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.649+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=ZO6GVD5SC654 tag=UOFSM5S2VB73 type=write size=2359775 2024-09-12T17:43:52.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.657+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~RD0WXPCQJDN2.0 size=364719 2024-09-12T17:43:52.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.657+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=RD0WXPCQJDN2 tag=4VY2Y30UZBJ2 type=write size=1413295 2024-09-12T17:43:52.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.665+0000 7f51d61a08c0 1 < suggested update operation key=92CMI8Q29LB3 tag=PK3V5AGZ7LP9 type=del size=526775 2024-09-12T17:43:52.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.673+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=4KQWKENFRECZ type=del size=79196 2024-09-12T17:43:52.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.677+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=0WV7W4302PE5 type=del 2024-09-12T17:43:52.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.681+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=857JATWASRO8 type=del size=3070471 2024-09-12T17:43:52.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.685+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~AWZCYHO4O9X5.0 size=1048576 2024-09-12T17:43:52.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.685+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~AWZCYHO4O9X5.1 size=1048576 2024-09-12T17:43:52.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.689+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~AWZCYHO4O9X5.2 size=765913 2024-09-12T17:43:52.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.697+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=AWZCYHO4O9X5 tag=RSU97S8H2QWV type=write size=3911641 2024-09-12T17:43:52.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.701+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=L60O2CKSPY80 type=del size=778691 2024-09-12T17:43:52.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.713+0000 7f51d61a08c0 1 < suggested update operation key=X6KC9Z6LD7VG tag=69Y9OSJ0I0ZE type=del size=2057350 2024-09-12T17:43:52.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.721+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~VMTGRKBZIIG3.0 size=230898 2024-09-12T17:43:52.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.721+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=VMTGRKBZIIG3 tag=KP4HB5VYX6HX type=write size=1279474 2024-09-12T17:43:52.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.725+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~3BVP1J0E748J.0 size=202630 2024-09-12T17:43:52.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.729+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=3BVP1J0E748J tag=H2RNKE4DO8DW type=write size=1251206 2024-09-12T17:43:52.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.737+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~H6246CQPMQY5.0 size=1048576 2024-09-12T17:43:52.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.741+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~H6246CQPMQY5.1 size=1048576 2024-09-12T17:43:52.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.745+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~H6246CQPMQY5.2 size=695114 2024-09-12T17:43:52.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.745+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=H6246CQPMQY5 tag=7B60OAXH36QQ type=write size=3840842 2024-09-12T17:43:52.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.749+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=QY9CHI0LSGM4 type=del 2024-09-12T17:43:52.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.753+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~A80J01MSE6A2.0 size=1048576 2024-09-12T17:43:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.757+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~A80J01MSE6A2.1 size=216394 2024-09-12T17:43:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.757+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=A80J01MSE6A2 tag=EEJD2EQCGBAT type=write size=2313546 2024-09-12T17:43:52.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.761+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~DOW8V16TI2YP.0 size=1048576 2024-09-12T17:43:52.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.765+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~DOW8V16TI2YP.1 size=808617 2024-09-12T17:43:52.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.769+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=DOW8V16TI2YP tag=1Q7KUWFZ6BPN type=write size=2905769 2024-09-12T17:43:52.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.777+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~FCUB0SAA2ESM.0 size=226606 2024-09-12T17:43:52.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.777+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=FCUB0SAA2ESM tag=VAR7OLLCNZ04 type=write size=1275182 2024-09-12T17:43:52.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.781+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~Y5JGLL957CLG.0 size=1048576 2024-09-12T17:43:52.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.785+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~Y5JGLL957CLG.1 size=1048576 2024-09-12T17:43:52.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.785+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~Y5JGLL957CLG.2 size=660336 2024-09-12T17:43:52.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.793+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=Y5JGLL957CLG tag=PCLGHFD3G8M1 type=write size=3806064 2024-09-12T17:43:52.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.801+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~8WYWC0Y424R0.0 size=1048576 2024-09-12T17:43:52.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.801+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~8WYWC0Y424R0.1 size=1048576 2024-09-12T17:43:52.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.805+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~8WYWC0Y424R0.2 size=402834 2024-09-12T17:43:52.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.805+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=8WYWC0Y424R0 tag=IAJW0T7SDEXG type=write size=3548562 2024-09-12T17:43:52.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.809+0000 7f51d61a08c0 1 < completed write operation key=593CD3H40DFH tag=E1NCVOJZZBLX type=write size=1018866 2024-09-12T17:43:52.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.817+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~0RSFXHR0T0EO.0 size=1048576 2024-09-12T17:43:52.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.821+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~0RSFXHR0T0EO.1 size=895592 2024-09-12T17:43:52.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.821+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=0RSFXHR0T0EO tag=0LY2CYP1P2PN type=write size=2992744 2024-09-12T17:43:52.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.829+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=1QB2C3GG27B0 type=del 2024-09-12T17:43:52.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.833+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=6T2MFPTDU0ZD type=del size=1136764 2024-09-12T17:43:52.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.841+0000 7f51d61a08c0 1 < suggested remove operation key=7FBK3439R80H tag=6M1WIQ4CNZ2J type=del 2024-09-12T17:43:52.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.845+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=1WVLGZ5WW6F8 type=del size=849552 2024-09-12T17:43:52.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.849+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=5IOIG50F1MN5 type=del 2024-09-12T17:43:52.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.853+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=KZK9I9YC5Z3M type=del size=2700936 2024-09-12T17:43:52.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.857+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~6JE5G6V10AGM.0 size=1048576 2024-09-12T17:43:52.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.861+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~6JE5G6V10AGM.1 size=1048576 2024-09-12T17:43:52.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.865+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~6JE5G6V10AGM.2 size=243726 2024-09-12T17:43:52.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.869+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=6JE5G6V10AGM tag=TYXXKM4ZUI46 type=write size=3389454 2024-09-12T17:43:52.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.877+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~RLNL8RWWM4L7.0 size=1048576 2024-09-12T17:43:52.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.881+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~RLNL8RWWM4L7.1 size=1048576 2024-09-12T17:43:52.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.885+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~RLNL8RWWM4L7.2 size=512654 2024-09-12T17:43:52.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.885+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=RLNL8RWWM4L7 tag=7LCX0BV1DCIB type=write size=3658382 2024-09-12T17:43:52.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.889+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=C92H0XF4VX4D type=del 2024-09-12T17:43:52.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.893+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=FTY0KW7X4F2R type=del size=2861461 2024-09-12T17:43:53.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.897+0000 7f51d61a08c0 -1 < failed to complete operation key=X6KC9Z6LD7VG tag=FQI0TKTQB1NY type=del size=3187432: (22) Invalid argument 2024-09-12T17:43:53.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.901+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=ZOF9RJW9H271 type=del size=2635780 2024-09-12T17:43:53.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.905+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~RD0WXPCQJDN2.0 size=364719 2024-09-12T17:43:53.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.909+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=RD0WXPCQJDN2 tag=4VY2Y30UZBJ2 type=write size=1413295 2024-09-12T17:43:53.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.913+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=QDJ5U7F393H8 type=del size=814773 2024-09-12T17:43:53.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.917+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=4KQWKENFRECZ type=del 2024-09-12T17:43:53.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.925+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~BTHUIOP6I755.0 size=1048576 2024-09-12T17:43:53.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.929+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~BTHUIOP6I755.1 size=56313 2024-09-12T17:43:53.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.929+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=BTHUIOP6I755 tag=LF3NJ3ST4PBB type=write size=2153465 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.933+0000 7f51d61a08c0 1 < suggested remove operation key=V5KMBUNVQA0H tag=857JATWASRO8 type=del 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.941+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=23ZEUUP5HQ5N type=del size=849254 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.945+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=L60O2CKSPY80 type=del 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.949+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=ZVWKT8V3F3AK type=write size=824767 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.953+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~VMTGRKBZIIG3.0 size=230898 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.957+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=VMTGRKBZIIG3 tag=KP4HB5VYX6HX type=write size=1279474 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.961+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=I9FD4HQ66YM8 type=del size=409190 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.965+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~H6246CQPMQY5.0 size=1048576 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.969+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~H6246CQPMQY5.1 size=1048576 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.973+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~H6246CQPMQY5.2 size=695114 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.977+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=H6246CQPMQY5 tag=7B60OAXH36QQ type=write size=3840842 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.981+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=FX0PPOIGW0PW type=del size=3502187 2024-09-12T17:43:53.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.985+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~A80J01MSE6A2.0 size=1048576 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.989+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~A80J01MSE6A2.1 size=216394 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:52.997+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=A80J01MSE6A2 tag=EEJD2EQCGBAT type=write size=2313546 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.001+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=MPKKYCPCFES7 type=write size=874809 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.005+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~FCUB0SAA2ESM.0 size=226606 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.009+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=FCUB0SAA2ESM tag=VAR7OLLCNZ04 type=write size=1275182 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.013+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=ES34HP51R2H4 type=write size=619423 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.017+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~8WYWC0Y424R0.0 size=1048576 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.021+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~8WYWC0Y424R0.1 size=1048576 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.025+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~8WYWC0Y424R0.2 size=402834 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.029+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=8WYWC0Y424R0 tag=IAJW0T7SDEXG type=write size=3548562 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~5UY2W5XHMMOW.0 size=588982 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.037+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=5UY2W5XHMMOW tag=WSI7EHCOGCI8 type=write size=1637558 2024-09-12T17:43:53.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.037+0000 7f51d61a08c0 1 < canceled part key=_multipart_3LE20KMMPH8P.2~0RSFXHR0T0EO.0 size=1048576 2024-09-12T17:43:53.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.041+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~0RSFXHR0T0EO.1 size=895592 2024-09-12T17:43:53.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.045+0000 7f51d61a08c0 1 < canceled multipart upload key=3LE20KMMPH8P upload=0RSFXHR0T0EO tag=0LY2CYP1P2PN type=write size=2992744 2024-09-12T17:43:53.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.049+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=4T95BV96PGYZ type=del size=708813 2024-09-12T17:43:53.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.053+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=6T2MFPTDU0ZD type=del 2024-09-12T17:43:53.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.061+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~PK3P7AH8VD05.0 size=1048576 2024-09-12T17:43:53.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.065+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~PK3P7AH8VD05.1 size=1048576 2024-09-12T17:43:53.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.065+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~PK3P7AH8VD05.2 size=887682 2024-09-12T17:43:53.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.065+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=PK3P7AH8VD05 tag=980OO9GKA8T5 type=write size=4033410 2024-09-12T17:43:53.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.069+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=1WVLGZ5WW6F8 type=del 2024-09-12T17:43:53.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.077+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~7XM6YOV1SJKB.0 size=1048576 2024-09-12T17:43:53.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.081+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~7XM6YOV1SJKB.1 size=1048576 2024-09-12T17:43:53.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.081+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~7XM6YOV1SJKB.2 size=886288 2024-09-12T17:43:53.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.081+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=7XM6YOV1SJKB tag=AZ7PTSHP156C type=write size=4032016 2024-09-12T17:43:53.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.089+0000 7f51d61a08c0 1 < suggested update operation key=2WC0YDQFKAJD tag=KZK9I9YC5Z3M type=del size=2700936 2024-09-12T17:43:53.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.097+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~COVGYHXAQ4A3.0 size=1048576 2024-09-12T17:43:53.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.101+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~COVGYHXAQ4A3.1 size=1048576 2024-09-12T17:43:53.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.105+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~COVGYHXAQ4A3.2 size=824742 2024-09-12T17:43:53.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.105+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=COVGYHXAQ4A3 tag=H7YFAS7117HP type=write size=3970470 2024-09-12T17:43:53.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.109+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~RLNL8RWWM4L7.0 size=1048576 2024-09-12T17:43:53.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.109+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~RLNL8RWWM4L7.1 size=1048576 2024-09-12T17:43:53.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.113+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~RLNL8RWWM4L7.2 size=512654 2024-09-12T17:43:53.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.117+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=RLNL8RWWM4L7 tag=7LCX0BV1DCIB type=write size=3658382 2024-09-12T17:43:53.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.121+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=6T8S3ODDA4EP type=del size=2569223 2024-09-12T17:43:53.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.125+0000 7f51d61a08c0 1 < canceled operation key=JEXD4ZU5HJ2B tag=FTY0KW7X4F2R type=del size=2861461 2024-09-12T17:43:53.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.129+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=L0WPY9UABWYZ type=write size=794903 2024-09-12T17:43:53.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.133+0000 7f51d61a08c0 1 < canceled operation key=8J72KCZ5WRPU tag=ZOF9RJW9H271 type=del size=2635780 2024-09-12T17:43:53.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.137+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=XXDTNLOV2YAJ type=del size=723594 2024-09-12T17:43:53.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.141+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=QDJ5U7F393H8 type=del 2024-09-12T17:43:53.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.145+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=XCA3HUKL6X65 type=del size=4041978 2024-09-12T17:43:53.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.149+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~BTHUIOP6I755.0 size=1048576 2024-09-12T17:43:53.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.149+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~BTHUIOP6I755.1 size=56313 2024-09-12T17:43:53.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.157+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=BTHUIOP6I755 tag=LF3NJ3ST4PBB type=write size=2153465 2024-09-12T17:43:53.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.161+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=GCF4MBV2QSZ1 type=write size=524288 2024-09-12T17:43:53.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.165+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=23ZEUUP5HQ5N type=del 2024-09-12T17:43:53.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.169+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~32IFTD98YGHF.0 size=109591 2024-09-12T17:43:53.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.169+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=32IFTD98YGHF tag=Y1UMRWLBWDJO type=write size=1158167 2024-09-12T17:43:53.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.173+0000 7f51d61a08c0 1 < completed write operation key=3LE20KMMPH8P tag=ZVWKT8V3F3AK type=write size=824767 2024-09-12T17:43:53.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.185+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=6VQKYO8YERFC type=del size=487920 2024-09-12T17:43:53.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.189+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=I9FD4HQ66YM8 type=del 2024-09-12T17:43:53.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.193+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~QEGBIM1KPB7B.0 size=1048576 2024-09-12T17:43:53.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.197+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~QEGBIM1KPB7B.1 size=236042 2024-09-12T17:43:53.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.197+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=QEGBIM1KPB7B tag=BXD7IZZ4BZN7 type=write size=2333194 2024-09-12T17:43:53.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.201+0000 7f51d61a08c0 1 < canceled operation key=HY2US2MMDNI4 tag=FX0PPOIGW0PW type=del size=3502187 2024-09-12T17:43:53.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.205+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=I0QIAKS8ZKHJ type=write size=319016 2024-09-12T17:43:53.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.209+0000 7f51d61a08c0 1 < completed write operation key=S292EX1P7IZA tag=MPKKYCPCFES7 type=write size=874809 2024-09-12T17:43:53.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.213+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=2BO1YBJOV99Q type=del size=2621216 2024-09-12T17:43:53.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.217+0000 7f51d61a08c0 1 < completed write operation key=8J72KCZ5WRPU tag=ES34HP51R2H4 type=write size=619423 2024-09-12T17:43:53.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.221+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~5Q3080VEX74L.0 size=1048576 2024-09-12T17:43:53.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.225+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~5Q3080VEX74L.1 size=1048576 2024-09-12T17:43:53.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.229+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~5Q3080VEX74L.2 size=617598 2024-09-12T17:43:53.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.229+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=5Q3080VEX74L tag=LHSM4POCB4WY type=write size=3763326 2024-09-12T17:43:53.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.233+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~5UY2W5XHMMOW.0 size=588982 2024-09-12T17:43:53.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.237+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=5UY2W5XHMMOW tag=WSI7EHCOGCI8 type=write size=1637558 2024-09-12T17:43:53.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.241+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=GP3TM53YC0Y3 type=del size=3517338 2024-09-12T17:43:53.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.249+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=4T95BV96PGYZ type=del 2024-09-12T17:43:53.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.249+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=ADL7R1D84HE3 type=del size=1605504 2024-09-12T17:43:53.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.253+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~PK3P7AH8VD05.0 size=1048576 2024-09-12T17:43:53.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.257+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~PK3P7AH8VD05.1 size=1048576 2024-09-12T17:43:53.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.261+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~PK3P7AH8VD05.2 size=887682 2024-09-12T17:43:53.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.265+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=PK3P7AH8VD05 tag=980OO9GKA8T5 type=write size=4033410 2024-09-12T17:43:53.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.269+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=199TDLCIQRCL type=del size=1063262 2024-09-12T17:43:53.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.273+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~7XM6YOV1SJKB.0 size=1048576 2024-09-12T17:43:53.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.277+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~7XM6YOV1SJKB.1 size=1048576 2024-09-12T17:43:53.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.281+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~7XM6YOV1SJKB.2 size=886288 2024-09-12T17:43:53.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.285+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=7XM6YOV1SJKB tag=AZ7PTSHP156C type=write size=4032016 2024-09-12T17:43:53.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.293+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~XN3XC33EPMZ1.0 size=1048576 2024-09-12T17:43:53.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.297+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~XN3XC33EPMZ1.1 size=1048576 2024-09-12T17:43:53.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.297+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~XN3XC33EPMZ1.2 size=16017 2024-09-12T17:43:53.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.297+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=XN3XC33EPMZ1 tag=W3LLX35K0OEM type=write size=3161745 2024-09-12T17:43:53.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.301+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~COVGYHXAQ4A3.0 size=1048576 2024-09-12T17:43:53.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.305+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~COVGYHXAQ4A3.1 size=1048576 2024-09-12T17:43:53.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.309+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~COVGYHXAQ4A3.2 size=824742 2024-09-12T17:43:53.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.313+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=COVGYHXAQ4A3 tag=H7YFAS7117HP type=write size=3970470 2024-09-12T17:43:53.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.321+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~2R7ENM8ZTUT3.0 size=1048576 2024-09-12T17:43:53.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.321+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~2R7ENM8ZTUT3.1 size=300952 2024-09-12T17:43:53.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.321+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=2R7ENM8ZTUT3 tag=FPQ7H39XJ7LN type=write size=2398104 2024-09-12T17:43:53.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.329+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=6T8S3ODDA4EP type=del 2024-09-12T17:43:53.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.329+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=BC8HBHJXTSKN type=del size=4078173 2024-09-12T17:43:53.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.333+0000 7f51d61a08c0 1 < completed write operation key=8J72KCZ5WRPU tag=L0WPY9UABWYZ type=write size=794903 2024-09-12T17:43:53.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.337+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=6GZQW7FCKGQD type=del size=2351060 2024-09-12T17:43:53.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.341+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=XXDTNLOV2YAJ type=del 2024-09-12T17:43:53.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.345+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=E05VBW8RA3D1 type=del size=2578535 2024-09-12T17:43:53.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.353+0000 7f51d61a08c0 1 < suggested remove operation key=2WC0YDQFKAJD tag=XCA3HUKL6X65 type=del 2024-09-12T17:43:53.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.361+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~3MW4ME4V0VXC.0 size=368387 2024-09-12T17:43:53.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.361+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=3MW4ME4V0VXC tag=L6LZJURHEJI2 type=write size=1416963 2024-09-12T17:43:53.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.365+0000 7f51d61a08c0 1 < completed write operation key=96OWZQXI2ALM tag=GCF4MBV2QSZ1 type=write size=524288 2024-09-12T17:43:53.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.369+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=CB2UURGP7KD4 type=del size=853143 2024-09-12T17:43:53.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.373+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~32IFTD98YGHF.0 size=109591 2024-09-12T17:43:53.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.377+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=32IFTD98YGHF tag=Y1UMRWLBWDJO type=write size=1158167 2024-09-12T17:43:53.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.381+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=WL888P4AP8EB type=del size=1557175 2024-09-12T17:43:53.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.385+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=6VQKYO8YERFC type=del 2024-09-12T17:43:53.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.393+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~DG3J3ET65KIE.0 size=1048576 2024-09-12T17:43:53.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.397+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~DG3J3ET65KIE.1 size=457534 2024-09-12T17:43:53.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.397+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=DG3J3ET65KIE tag=ST72JQMDZYUG type=write size=2554686 2024-09-12T17:43:53.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.401+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~QEGBIM1KPB7B.0 size=1048576 2024-09-12T17:43:53.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.401+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~QEGBIM1KPB7B.1 size=236042 2024-09-12T17:43:53.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.409+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=QEGBIM1KPB7B tag=BXD7IZZ4BZN7 type=write size=2333194 2024-09-12T17:43:53.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.413+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=RYNM9OM0BL8O type=write size=941135 2024-09-12T17:43:53.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.417+0000 7f51d61a08c0 1 < completed write operation key=7FBK3439R80H tag=I0QIAKS8ZKHJ type=write size=319016 2024-09-12T17:43:53.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.421+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=MS21EDOORFUP type=write size=126880 2024-09-12T17:43:53.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.425+0000 7f51d61a08c0 1 < completed delete operation key=U3GZL9YPFMZY tag=2BO1YBJOV99Q type=del 2024-09-12T17:43:53.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.429+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=PWVRPL7ZBCY2 type=del size=3559295 2024-09-12T17:43:53.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.433+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~5Q3080VEX74L.0 size=1048576 2024-09-12T17:43:53.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.437+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~5Q3080VEX74L.1 size=1048576 2024-09-12T17:43:53.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.437+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~5Q3080VEX74L.2 size=617598 2024-09-12T17:43:53.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.445+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=5Q3080VEX74L tag=LHSM4POCB4WY type=write size=3763326 2024-09-12T17:43:53.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.449+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=B5JIJ5V4MTMT type=del size=2287875 2024-09-12T17:43:53.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.453+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=GP3TM53YC0Y3 type=del 2024-09-12T17:43:53.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.457+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=Q3NXO4SEZM5C type=del size=3117968 2024-09-12T17:43:53.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.461+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=ADL7R1D84HE3 type=del 2024-09-12T17:43:53.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.465+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=EUPUNVI4GA22 type=del size=61338 2024-09-12T17:43:53.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.469+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=199TDLCIQRCL type=del 2024-09-12T17:43:53.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.473+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~HFI5U6DOTFNO.0 size=1048576 2024-09-12T17:43:53.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.477+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~HFI5U6DOTFNO.1 size=1048576 2024-09-12T17:43:53.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.481+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~HFI5U6DOTFNO.2 size=312830 2024-09-12T17:43:53.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.481+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=HFI5U6DOTFNO tag=H87633WI9C6Z type=write size=3458558 2024-09-12T17:43:53.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.485+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~XN3XC33EPMZ1.0 size=1048576 2024-09-12T17:43:53.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.489+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~XN3XC33EPMZ1.1 size=1048576 2024-09-12T17:43:53.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.489+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~XN3XC33EPMZ1.2 size=16017 2024-09-12T17:43:53.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.497+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=XN3XC33EPMZ1 tag=W3LLX35K0OEM type=write size=3161745 2024-09-12T17:43:53.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.501+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=OTZCAIK2A126 type=del size=516225 2024-09-12T17:43:53.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.505+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~2R7ENM8ZTUT3.0 size=1048576 2024-09-12T17:43:53.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.509+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~2R7ENM8ZTUT3.1 size=300952 2024-09-12T17:43:53.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.513+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=2R7ENM8ZTUT3 tag=FPQ7H39XJ7LN type=write size=2398104 2024-09-12T17:43:53.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.517+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=NI4JZ6A50V11 type=write size=474902 2024-09-12T17:43:53.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.525+0000 7f51d61a08c0 1 < suggested remove operation key=EDVAEE9FKH1T tag=BC8HBHJXTSKN type=del 2024-09-12T17:43:53.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.533+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=187QDDWEGMSJ type=del size=2609752 2024-09-12T17:43:53.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.541+0000 7f51d61a08c0 1 < suggested update operation key=8J72KCZ5WRPU tag=6GZQW7FCKGQD type=del size=2351060 2024-09-12T17:43:53.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.545+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=JDZDRADD87PT type=write size=763694 2024-09-12T17:43:53.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.553+0000 7f51d61a08c0 1 < suggested remove operation key=DCLENF1A1W2Q tag=E05VBW8RA3D1 type=del 2024-09-12T17:43:53.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.557+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=5TB798I45WLM type=del size=1691428 2024-09-12T17:43:53.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.561+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~3MW4ME4V0VXC.0 size=368387 2024-09-12T17:43:53.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.569+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=3MW4ME4V0VXC tag=L6LZJURHEJI2 type=write size=1416963 2024-09-12T17:43:53.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~QBTWEYDFM7TN.0 size=1048576 2024-09-12T17:43:53.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~QBTWEYDFM7TN.1 size=1048576 2024-09-12T17:43:53.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.581+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~QBTWEYDFM7TN.2 size=109428 2024-09-12T17:43:53.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.581+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=QBTWEYDFM7TN tag=TPT4CB510M09 type=write size=3255156 2024-09-12T17:43:53.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.589+0000 7f51d61a08c0 1 < suggested remove operation key=2WC0YDQFKAJD tag=CB2UURGP7KD4 type=del 2024-09-12T17:43:53.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.597+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~GYM8ZFTKRO55.0 size=169278 2024-09-12T17:43:53.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.597+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=GYM8ZFTKRO55 tag=YBLZZO3GC1AD type=write size=1217854 2024-09-12T17:43:53.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.601+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=WL888P4AP8EB type=del 2024-09-12T17:43:53.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.605+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=13KBI89JH2J7 type=del size=2417034 2024-09-12T17:43:53.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.609+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~DG3J3ET65KIE.0 size=1048576 2024-09-12T17:43:53.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.613+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~DG3J3ET65KIE.1 size=457534 2024-09-12T17:43:53.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.621+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=DG3J3ET65KIE tag=ST72JQMDZYUG type=write size=2554686 2024-09-12T17:43:53.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.625+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=H5CXJEGTR55X type=del size=3714744 2024-09-12T17:43:53.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.625+0000 7f51d61a08c0 -1 < no bi entry to suggest for operation key=EDVAEE9FKH1T tag=RYNM9OM0BL8O type=write size=941135: (2) No such file or directory 2024-09-12T17:43:53.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.633+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~K2AWPDS71UWY.0 size=512169 2024-09-12T17:43:53.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.633+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=K2AWPDS71UWY tag=MCL3EEG2ZOO1 type=write size=1560745 2024-09-12T17:43:53.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.637+0000 7f51d61a08c0 1 < completed write operation key=BF36J1Q6CZFB tag=MS21EDOORFUP type=write size=126880 2024-09-12T17:43:53.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.645+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~9IA1SYBNR2R9.0 size=47363 2024-09-12T17:43:53.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.645+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=9IA1SYBNR2R9 tag=YDN7M6C30VAF type=write size=1095939 2024-09-12T17:43:53.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.649+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=PWVRPL7ZBCY2 type=del 2024-09-12T17:43:53.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.653+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=LK9J4FONAL8C type=del size=2629483 2024-09-12T17:43:53.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.657+0000 7f51d61a08c0 -1 < failed to complete operation key=DCLENF1A1W2Q tag=B5JIJ5V4MTMT type=del size=2287875: (22) Invalid argument 2024-09-12T17:43:53.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.665+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~08E6QMRYN1A1.0 size=379392 2024-09-12T17:43:53.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.665+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=08E6QMRYN1A1 tag=XKL5OPPD8VUF type=write size=1427968 2024-09-12T17:43:53.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.669+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=Q3NXO4SEZM5C type=del 2024-09-12T17:43:53.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.677+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~OUPSETZQZH08.0 size=504693 2024-09-12T17:43:53.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.677+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=OUPSETZQZH08 tag=BG00ALNMSUMQ type=write size=1553269 2024-09-12T17:43:53.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.681+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=EUPUNVI4GA22 type=del 2024-09-12T17:43:53.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.685+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~2DIM6Z2VQ1VQ.0 size=1048576 2024-09-12T17:43:53.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.689+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~2DIM6Z2VQ1VQ.1 size=70801 2024-09-12T17:43:53.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.689+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=2DIM6Z2VQ1VQ tag=EDU30LZ07Z37 type=write size=2167953 2024-09-12T17:43:53.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.693+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~HFI5U6DOTFNO.0 size=1048576 2024-09-12T17:43:53.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.697+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~HFI5U6DOTFNO.1 size=1048576 2024-09-12T17:43:53.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.701+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~HFI5U6DOTFNO.2 size=312830 2024-09-12T17:43:53.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.705+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=HFI5U6DOTFNO tag=H87633WI9C6Z type=write size=3458558 2024-09-12T17:43:53.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.709+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=2MAAVVLBYT1K type=del size=1331662 2024-09-12T17:43:53.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.713+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=OTZCAIK2A126 type=del 2024-09-12T17:43:53.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.717+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=M4AY6Q0HBQTU type=del size=762734 2024-09-12T17:43:53.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.721+0000 7f51d61a08c0 1 < completed write operation key=GJX1YGAQFXZ2 tag=NI4JZ6A50V11 type=write size=474902 2024-09-12T17:43:53.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.729+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~DOTQ4PKFUC38.0 size=1048576 2024-09-12T17:43:53.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.733+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~DOTQ4PKFUC38.1 size=940656 2024-09-12T17:43:53.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.733+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=DOTQ4PKFUC38 tag=QATK67YA6410 type=write size=3037808 2024-09-12T17:43:53.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.737+0000 7f51d61a08c0 1 < canceled operation key=SSOA6J297L1C tag=187QDDWEGMSJ type=del size=2609752 2024-09-12T17:43:53.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.741+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=SP5JPRVK5ERL type=del size=395018 2024-09-12T17:43:53.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.745+0000 7f51d61a08c0 1 < completed write operation key=3LE20KMMPH8P tag=JDZDRADD87PT type=write size=763694 2024-09-12T17:43:53.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.749+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=6C6PH02GQTZE type=write size=474168 2024-09-12T17:43:53.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.753+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=5TB798I45WLM type=del 2024-09-12T17:43:53.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.761+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~K3ESHHO1J3D6.0 size=1048576 2024-09-12T17:43:53.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.761+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~K3ESHHO1J3D6.1 size=1048576 2024-09-12T17:43:53.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.765+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~K3ESHHO1J3D6.2 size=586460 2024-09-12T17:43:53.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.765+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=K3ESHHO1J3D6 tag=DV5ZSXEZE1XK type=write size=3732188 2024-09-12T17:43:53.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.765+0000 7f51d61a08c0 1 < canceled part key=_multipart_ZCB4V47S38TN.2~QBTWEYDFM7TN.0 size=1048576 2024-09-12T17:43:53.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.765+0000 7f51d61a08c0 1 < canceled part key=_multipart_ZCB4V47S38TN.2~QBTWEYDFM7TN.1 size=1048576 2024-09-12T17:43:53.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.769+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~QBTWEYDFM7TN.2 size=109428 2024-09-12T17:43:53.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.773+0000 7f51d61a08c0 1 < canceled multipart upload key=ZCB4V47S38TN upload=QBTWEYDFM7TN tag=TPT4CB510M09 type=write size=3255156 2024-09-12T17:43:53.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~H0N0G7OHYTZA.0 size=1048576 2024-09-12T17:43:53.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.785+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~H0N0G7OHYTZA.1 size=978487 2024-09-12T17:43:53.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.785+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=H0N0G7OHYTZA tag=IOC9QZEDCY1I type=write size=3075639 2024-09-12T17:43:53.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.789+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~GYM8ZFTKRO55.0 size=169278 2024-09-12T17:43:53.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.793+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=GYM8ZFTKRO55 tag=YBLZZO3GC1AD type=write size=1217854 2024-09-12T17:43:53.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.797+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=S10CGDM7MUGW type=del size=3728957 2024-09-12T17:43:53.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.809+0000 7f51d61a08c0 1 < suggested update operation key=GJX1YGAQFXZ2 tag=13KBI89JH2J7 type=del size=2417034 2024-09-12T17:43:53.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.813+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~AKSRD6OIF9R4.0 size=1048576 2024-09-12T17:43:53.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.817+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~AKSRD6OIF9R4.1 size=523866 2024-09-12T17:43:53.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.817+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=AKSRD6OIF9R4 tag=P66L0EKS58WH type=write size=2621018 2024-09-12T17:43:53.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.825+0000 7f51d61a08c0 1 < suggested update operation key=BF36J1Q6CZFB tag=H5CXJEGTR55X type=del size=3714744 2024-09-12T17:43:53.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.833+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~YQ0KAAW4U7B7.0 size=1048576 2024-09-12T17:43:53.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.837+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~YQ0KAAW4U7B7.1 size=836016 2024-09-12T17:43:53.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.837+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=YQ0KAAW4U7B7 tag=Z3NMDDW023RS type=write size=2933168 2024-09-12T17:43:53.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.837+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~K2AWPDS71UWY.0 size=512169 2024-09-12T17:43:53.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.845+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=K2AWPDS71UWY tag=MCL3EEG2ZOO1 type=write size=1560745 2024-09-12T17:43:53.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.849+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=08GSPFIV41F9 type=write size=769764 2024-09-12T17:43:53.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.853+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~9IA1SYBNR2R9.0 size=47363 2024-09-12T17:43:53.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.857+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=9IA1SYBNR2R9 tag=YDN7M6C30VAF type=write size=1095939 2024-09-12T17:43:53.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.861+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=I5CWX7MXA6UU type=del size=972828 2024-09-12T17:43:53.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.865+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=LK9J4FONAL8C type=del 2024-09-12T17:43:53.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.869+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=55QX39TAJ25M type=del size=2749794 2024-09-12T17:43:53.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.873+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~08E6QMRYN1A1.0 size=379392 2024-09-12T17:43:53.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.881+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=08E6QMRYN1A1 tag=XKL5OPPD8VUF type=write size=1427968 2024-09-12T17:43:53.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.885+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=8YTFMCW9ODU8 type=del size=9765 2024-09-12T17:43:53.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.885+0000 7f51d61a08c0 1 < canceled part key=_multipart_JEXD4ZU5HJ2B.2~OUPSETZQZH08.0 size=504693 2024-09-12T17:43:53.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.893+0000 7f51d61a08c0 1 < canceled multipart upload key=JEXD4ZU5HJ2B upload=OUPSETZQZH08 tag=BG00ALNMSUMQ type=write size=1553269 2024-09-12T17:43:53.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.897+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=8FA6OD2Q12WX type=del size=753248 2024-09-12T17:43:53.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.905+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~2DIM6Z2VQ1VQ.0 size=1048576 2024-09-12T17:43:53.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.909+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~2DIM6Z2VQ1VQ.1 size=70801 2024-09-12T17:43:53.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.917+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=2DIM6Z2VQ1VQ tag=EDU30LZ07Z37 type=write size=2167953 2024-09-12T17:43:53.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.921+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=0H0GGIFI39LV type=del size=2474347 2024-09-12T17:43:53.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.925+0000 7f51d61a08c0 -1 < failed to complete operation key=GJX1YGAQFXZ2 tag=2MAAVVLBYT1K type=del size=1331662: (22) Invalid argument 2024-09-12T17:43:53.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.929+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=UILFMUM6VX9K type=del size=3500867 2024-09-12T17:43:53.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.933+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=M4AY6Q0HBQTU type=del 2024-09-12T17:43:53.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.937+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~VY2VVVYNI6W3.0 size=1048576 2024-09-12T17:43:53.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.941+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~VY2VVVYNI6W3.1 size=835482 2024-09-12T17:43:53.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.941+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=VY2VVVYNI6W3 tag=IHMN2PLTM3RL type=write size=2932634 2024-09-12T17:43:53.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.945+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~DOTQ4PKFUC38.0 size=1048576 2024-09-12T17:43:53.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.949+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~DOTQ4PKFUC38.1 size=940656 2024-09-12T17:43:53.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.953+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=DOTQ4PKFUC38 tag=QATK67YA6410 type=write size=3037808 2024-09-12T17:43:53.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.957+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=I8DJFKNLAAA1 type=del size=3863081 2024-09-12T17:43:53.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.961+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=SP5JPRVK5ERL type=del 2024-09-12T17:43:53.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.965+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=NJF5LG3E4AE2 type=del size=894788 2024-09-12T17:43:53.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.969+0000 7f51d61a08c0 1 < completed write operation key=HUWVRJIZ5JYE tag=6C6PH02GQTZE type=write size=474168 2024-09-12T17:43:53.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.977+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~Z7NTJ9NP9FBV.0 size=1048576 2024-09-12T17:43:53.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.981+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~Z7NTJ9NP9FBV.1 size=82293 2024-09-12T17:43:53.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.981+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=Z7NTJ9NP9FBV tag=2VTM1Z1HO3LQ type=write size=2179445 2024-09-12T17:43:53.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.985+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~K3ESHHO1J3D6.0 size=1048576 2024-09-12T17:43:53.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.989+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~K3ESHHO1J3D6.1 size=1048576 2024-09-12T17:43:53.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.989+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~K3ESHHO1J3D6.2 size=586460 2024-09-12T17:43:54.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:53.997+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=K3ESHHO1J3D6 tag=DV5ZSXEZE1XK type=write size=3732188 2024-09-12T17:43:54.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.005+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~J0PI0LUKMEW4.0 size=1048576 2024-09-12T17:43:54.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.005+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~J0PI0LUKMEW4.1 size=1048576 2024-09-12T17:43:54.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.009+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~J0PI0LUKMEW4.2 size=218993 2024-09-12T17:43:54.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.009+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=J0PI0LUKMEW4 tag=6BQCYILYWIIX type=write size=3364721 2024-09-12T17:43:54.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.013+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~H0N0G7OHYTZA.0 size=1048576 2024-09-12T17:43:54.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.017+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~H0N0G7OHYTZA.1 size=978487 2024-09-12T17:43:54.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.021+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=H0N0G7OHYTZA tag=IOC9QZEDCY1I type=write size=3075639 2024-09-12T17:43:54.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.025+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=RSSAAHYA0VHW type=del size=1686295 2024-09-12T17:43:54.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.029+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=S10CGDM7MUGW type=del 2024-09-12T17:43:54.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~ZY618X2M6A5W.0 size=1048576 2024-09-12T17:43:54.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.041+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~ZY618X2M6A5W.1 size=1048576 2024-09-12T17:43:54.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.045+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~ZY618X2M6A5W.2 size=1012557 2024-09-12T17:43:54.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.045+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=ZY618X2M6A5W tag=19U60TT318RE type=write size=4158285 2024-09-12T17:43:54.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.049+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~AKSRD6OIF9R4.0 size=1048576 2024-09-12T17:43:54.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.053+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~AKSRD6OIF9R4.1 size=523866 2024-09-12T17:43:54.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.057+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=AKSRD6OIF9R4 tag=P66L0EKS58WH type=write size=2621018 2024-09-12T17:43:54.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.061+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=9W7L02E8VPW3 type=write size=693215 2024-09-12T17:43:54.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.065+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~YQ0KAAW4U7B7.0 size=1048576 2024-09-12T17:43:54.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.069+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~YQ0KAAW4U7B7.1 size=836016 2024-09-12T17:43:54.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.073+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=YQ0KAAW4U7B7 tag=Z3NMDDW023RS type=write size=2933168 2024-09-12T17:43:54.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.077+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=5ULWEM60AE06 type=del size=4138835 2024-09-12T17:43:54.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.081+0000 7f51d61a08c0 1 < completed write operation key=1ZETSL5TXYSM tag=08GSPFIV41F9 type=write size=769764 2024-09-12T17:43:54.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.085+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=V07YTQQ9GHI9 type=del size=804680 2024-09-12T17:43:54.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.093+0000 7f51d61a08c0 1 < suggested update operation key=DCLENF1A1W2Q tag=I5CWX7MXA6UU type=del size=972828 2024-09-12T17:43:54.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.101+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~PNS6C8RCRRW4.0 size=650388 2024-09-12T17:43:54.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.101+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=PNS6C8RCRRW4 tag=J6X1S6DEIR20 type=write size=1698964 2024-09-12T17:43:54.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.105+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=55QX39TAJ25M type=del 2024-09-12T17:43:54.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.113+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~5GDPCCNS1E1I.0 size=1048576 2024-09-12T17:43:54.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.117+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~5GDPCCNS1E1I.1 size=695707 2024-09-12T17:43:54.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.117+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=5GDPCCNS1E1I tag=RQ9J8RWDHOPZ type=write size=2792859 2024-09-12T17:43:54.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.121+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=8YTFMCW9ODU8 type=del 2024-09-12T17:43:54.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.125+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=TJ7FTR70YRVX type=del size=326713 2024-09-12T17:43:54.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.129+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=8FA6OD2Q12WX type=del 2024-09-12T17:43:54.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.133+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=F1AUFMQ9SMZI type=del size=3407124 2024-09-12T17:43:54.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.137+0000 7f51d61a08c0 1 < canceled operation key=FKKV7SXZSP90 tag=0H0GGIFI39LV type=del size=2474347 2024-09-12T17:43:54.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.145+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~JAEY86K1ZFV0.0 size=1048576 2024-09-12T17:43:54.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.149+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~JAEY86K1ZFV0.1 size=1048576 2024-09-12T17:43:54.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.149+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~JAEY86K1ZFV0.2 size=517785 2024-09-12T17:43:54.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.149+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=JAEY86K1ZFV0 tag=W35L6FA2F19K type=write size=3663513 2024-09-12T17:43:54.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.157+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=UILFMUM6VX9K type=del 2024-09-12T17:43:54.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.161+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=ENZR1FY2B9BG type=del size=2228220 2024-09-12T17:43:54.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.165+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~VY2VVVYNI6W3.0 size=1048576 2024-09-12T17:43:54.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.169+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~VY2VVVYNI6W3.1 size=835482 2024-09-12T17:43:54.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.173+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=VY2VVVYNI6W3 tag=IHMN2PLTM3RL type=write size=2932634 2024-09-12T17:43:54.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.177+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=Z7AC34DP20TA type=del size=767906 2024-09-12T17:43:54.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.185+0000 7f51d61a08c0 1 < canceled operation key=NIQAUF085D97 tag=I8DJFKNLAAA1 type=del size=3863081 2024-09-12T17:43:54.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.189+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=PLSEBQ0DNYJY type=write size=122428 2024-09-12T17:43:54.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.193+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=NJF5LG3E4AE2 type=del 2024-09-12T17:43:54.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.197+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=OQ09Z6QCQQ18 type=del size=3502508 2024-09-12T17:43:54.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.201+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~Z7NTJ9NP9FBV.0 size=1048576 2024-09-12T17:43:54.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.205+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~Z7NTJ9NP9FBV.1 size=82293 2024-09-12T17:43:54.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.209+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=Z7NTJ9NP9FBV tag=2VTM1Z1HO3LQ type=write size=2179445 2024-09-12T17:43:54.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.217+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~T3AWMHK7R36C.0 size=1048576 2024-09-12T17:43:54.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.225+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~T3AWMHK7R36C.1 size=753222 2024-09-12T17:43:54.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.225+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=T3AWMHK7R36C tag=T39YKSGFEN0O type=write size=2850374 2024-09-12T17:43:54.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.225+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~J0PI0LUKMEW4.0 size=1048576 2024-09-12T17:43:54.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.229+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~J0PI0LUKMEW4.1 size=1048576 2024-09-12T17:43:54.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.233+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~J0PI0LUKMEW4.2 size=218993 2024-09-12T17:43:54.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.237+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=J0PI0LUKMEW4 tag=6BQCYILYWIIX type=write size=3364721 2024-09-12T17:43:54.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.241+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=XPCAU25RWQLR type=del size=1979867 2024-09-12T17:43:54.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.245+0000 7f51d61a08c0 -1 < failed to complete operation key=DCLENF1A1W2Q tag=RSSAAHYA0VHW type=del size=1686295: (22) Invalid argument 2024-09-12T17:43:54.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.253+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~RQ558XS0TSFM.0 size=1048576 2024-09-12T17:43:54.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.257+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~RQ558XS0TSFM.1 size=954930 2024-09-12T17:43:54.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.257+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=RQ558XS0TSFM tag=9D3OGUS0Y940 type=write size=3052082 2024-09-12T17:43:54.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.261+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~ZY618X2M6A5W.0 size=1048576 2024-09-12T17:43:54.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.261+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~ZY618X2M6A5W.1 size=1048576 2024-09-12T17:43:54.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.273+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~ZY618X2M6A5W.2 size=1012557 2024-09-12T17:43:54.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.277+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=ZY618X2M6A5W tag=19U60TT318RE type=write size=4158285 2024-09-12T17:43:54.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.285+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~8DX7RF85OUPJ.0 size=819312 2024-09-12T17:43:54.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.285+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=8DX7RF85OUPJ tag=NMYSR65W1022 type=write size=1867888 2024-09-12T17:43:54.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.293+0000 7f51d61a08c0 1 < suggested update operation key=S292EX1P7IZA tag=9W7L02E8VPW3 type=write size=693215 2024-09-12T17:43:54.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.301+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~JAUZ1G3NFFJ6.0 size=1048576 2024-09-12T17:43:54.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.301+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~JAUZ1G3NFFJ6.1 size=1048576 2024-09-12T17:43:54.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.305+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~JAUZ1G3NFFJ6.2 size=738864 2024-09-12T17:43:54.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.305+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=JAUZ1G3NFFJ6 tag=7YSFJSD8N8OO type=write size=3884592 2024-09-12T17:43:54.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.309+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=5ULWEM60AE06 type=del 2024-09-12T17:43:54.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.313+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=78ZI92BL3AOU type=del size=1378563 2024-09-12T17:43:54.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.321+0000 7f51d61a08c0 1 < suggested remove operation key=3LE20KMMPH8P tag=V07YTQQ9GHI9 type=del 2024-09-12T17:43:54.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.325+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=F9ATBY5BS3YN type=del size=1567089 2024-09-12T17:43:54.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.329+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~PNS6C8RCRRW4.0 size=650388 2024-09-12T17:43:54.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.333+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=PNS6C8RCRRW4 tag=J6X1S6DEIR20 type=write size=1698964 2024-09-12T17:43:54.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.337+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=WEXEIJR3YVJB type=del size=3333152 2024-09-12T17:43:54.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.341+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~5GDPCCNS1E1I.0 size=1048576 2024-09-12T17:43:54.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.345+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~5GDPCCNS1E1I.1 size=695707 2024-09-12T17:43:54.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.353+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=5GDPCCNS1E1I tag=RQ9J8RWDHOPZ type=write size=2792859 2024-09-12T17:43:54.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.357+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=UGH3R7RRP6JC type=del size=3451662 2024-09-12T17:43:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.365+0000 7f51d61a08c0 1 < suggested update operation key=7FBK3439R80H tag=TJ7FTR70YRVX type=del size=326713 2024-09-12T17:43:54.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.369+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=TCBFDE443927 type=del size=2336275 2024-09-12T17:43:54.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.373+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=F1AUFMQ9SMZI type=del 2024-09-12T17:43:54.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.377+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~2H871WRCDYF7.0 size=1048576 2024-09-12T17:43:54.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.381+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~2H871WRCDYF7.1 size=1048576 2024-09-12T17:43:54.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.385+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~2H871WRCDYF7.2 size=83964 2024-09-12T17:43:54.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.385+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=2H871WRCDYF7 tag=FLOKLTT2WV85 type=write size=3229692 2024-09-12T17:43:54.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.389+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~JAEY86K1ZFV0.0 size=1048576 2024-09-12T17:43:54.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.389+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~JAEY86K1ZFV0.1 size=1048576 2024-09-12T17:43:54.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.393+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~JAEY86K1ZFV0.2 size=517785 2024-09-12T17:43:54.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.401+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=JAEY86K1ZFV0 tag=W35L6FA2F19K type=write size=3663513 2024-09-12T17:43:54.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.405+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=YSXU7J2ASXDS type=del size=2725932 2024-09-12T17:43:54.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.409+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=ENZR1FY2B9BG type=del 2024-09-12T17:43:54.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.417+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~AUD8WWFEI6FW.0 size=1048576 2024-09-12T17:43:54.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.421+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~AUD8WWFEI6FW.1 size=536922 2024-09-12T17:43:54.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.421+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=AUD8WWFEI6FW tag=IR4ZOWD8S6UZ type=write size=2634074 2024-09-12T17:43:54.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.425+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=Z7AC34DP20TA type=del 2024-09-12T17:43:54.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.429+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=G3UBUWH3EEZ1 type=del size=3512729 2024-09-12T17:43:54.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.433+0000 7f51d61a08c0 -1 < failed to complete operation key=S292EX1P7IZA tag=PLSEBQ0DNYJY type=write size=122428: (22) Invalid argument 2024-09-12T17:43:54.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.437+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=E4S6JF20XM86 type=del size=2836540 2024-09-12T17:43:54.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.445+0000 7f51d61a08c0 1 < suggested update operation key=DCLENF1A1W2Q tag=OQ09Z6QCQQ18 type=del size=3502508 2024-09-12T17:43:54.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.449+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=XZ2U7AE7I014 type=del size=2608021 2024-09-12T17:43:54.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.453+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~T3AWMHK7R36C.0 size=1048576 2024-09-12T17:43:54.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.457+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~T3AWMHK7R36C.1 size=753222 2024-09-12T17:43:54.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.465+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=T3AWMHK7R36C tag=T39YKSGFEN0O type=write size=2850374 2024-09-12T17:43:54.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.469+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=KKID4VQ8EGBG type=del size=57052 2024-09-12T17:43:54.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.477+0000 7f51d61a08c0 1 < suggested update operation key=FKKV7SXZSP90 tag=XPCAU25RWQLR type=del size=1979867 2024-09-12T17:43:54.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.481+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=32NSLFVWJMAD type=del size=3520788 2024-09-12T17:43:54.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.485+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~RQ558XS0TSFM.0 size=1048576 2024-09-12T17:43:54.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.485+0000 7f51d61a08c0 1 < canceled part key=_multipart_1ZETSL5TXYSM.2~RQ558XS0TSFM.1 size=954930 2024-09-12T17:43:54.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.489+0000 7f51d61a08c0 1 < canceled multipart upload key=1ZETSL5TXYSM upload=RQ558XS0TSFM tag=9D3OGUS0Y940 type=write size=3052082 2024-09-12T17:43:54.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.493+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=H1R6RW4499M5 type=del size=3305194 2024-09-12T17:43:54.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.497+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~8DX7RF85OUPJ.0 size=819312 2024-09-12T17:43:54.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.505+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=8DX7RF85OUPJ tag=NMYSR65W1022 type=write size=1867888 2024-09-12T17:43:54.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.509+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~SW9B4Z338ZNF.0 size=727572 2024-09-12T17:43:54.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.509+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=SW9B4Z338ZNF tag=1XQJS6TIIXD1 type=write size=1776148 2024-09-12T17:43:54.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.513+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~JAUZ1G3NFFJ6.0 size=1048576 2024-09-12T17:43:54.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.517+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~JAUZ1G3NFFJ6.1 size=1048576 2024-09-12T17:43:54.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.521+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~JAUZ1G3NFFJ6.2 size=738864 2024-09-12T17:43:54.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.525+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=JAUZ1G3NFFJ6 tag=7YSFJSD8N8OO type=write size=3884592 2024-09-12T17:43:54.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.529+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=NON827WUMGB2 type=write size=324953 2024-09-12T17:43:54.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.533+0000 7f51d61a08c0 -1 < failed to complete operation key=7FBK3439R80H tag=78ZI92BL3AOU type=del size=1378563: (22) Invalid argument 2024-09-12T17:43:54.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.537+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=CS60QYT5QM7G type=del size=3421358 2024-09-12T17:43:54.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.541+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=F9ATBY5BS3YN type=del 2024-09-12T17:43:54.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.549+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~FFKHTJQANF8Y.0 size=1048576 2024-09-12T17:43:54.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.549+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~FFKHTJQANF8Y.1 size=422762 2024-09-12T17:43:54.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.549+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=FFKHTJQANF8Y tag=ANF4Y3GFRJG4 type=write size=2519914 2024-09-12T17:43:54.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.553+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=WEXEIJR3YVJB type=del 2024-09-12T17:43:54.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.557+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=6HNIKI1PRDA8 type=del size=1402020 2024-09-12T17:43:54.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.561+0000 7f51d61a08c0 1 < canceled operation key=EDVAEE9FKH1T tag=UGH3R7RRP6JC type=del size=3451662 2024-09-12T17:43:54.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.569+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~QSR7PYBXUNPK.0 size=397617 2024-09-12T17:43:54.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.569+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=QSR7PYBXUNPK tag=XQHLG15VN4JL type=write size=1446193 2024-09-12T17:43:54.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.573+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=TCBFDE443927 type=del 2024-09-12T17:43:54.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.577+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=C5FHFCQEVZWU type=del size=3014920 2024-09-12T17:43:54.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.581+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~2H871WRCDYF7.0 size=1048576 2024-09-12T17:43:54.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.585+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~2H871WRCDYF7.1 size=1048576 2024-09-12T17:43:54.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.589+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~2H871WRCDYF7.2 size=83964 2024-09-12T17:43:54.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.593+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=2H871WRCDYF7 tag=FLOKLTT2WV85 type=write size=3229692 2024-09-12T17:43:54.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.597+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=OWG8BYID3KP9 type=write size=43043 2024-09-12T17:43:54.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.605+0000 7f51d61a08c0 1 < suggested update operation key=A7V478K2SNOF tag=YSXU7J2ASXDS type=del size=2725932 2024-09-12T17:43:54.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.609+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=8FX7Z0XLWJ36 type=del size=2768581 2024-09-12T17:43:54.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.613+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~AUD8WWFEI6FW.0 size=1048576 2024-09-12T17:43:54.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.617+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~AUD8WWFEI6FW.1 size=536922 2024-09-12T17:43:54.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.625+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=AUD8WWFEI6FW tag=IR4ZOWD8S6UZ type=write size=2634074 2024-09-12T17:43:54.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.637+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~9EC2GG7SD5R0.0 size=645323 2024-09-12T17:43:54.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.637+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=9EC2GG7SD5R0 tag=06ZCM9VFNSQK type=write size=1693899 2024-09-12T17:43:54.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.641+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=G3UBUWH3EEZ1 type=del 2024-09-12T17:43:54.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.645+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=KEC02QIOP86U type=write size=893113 2024-09-12T17:43:54.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.649+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=E4S6JF20XM86 type=del 2024-09-12T17:43:54.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.657+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~JHAXMEH65130.0 size=1048576 2024-09-12T17:43:54.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.661+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~JHAXMEH65130.1 size=203707 2024-09-12T17:43:54.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.661+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=JHAXMEH65130 tag=ME515UHEICGO type=write size=2300859 2024-09-12T17:43:54.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.665+0000 7f51d61a08c0 -1 < failed to complete operation key=FKKV7SXZSP90 tag=XZ2U7AE7I014 type=del size=2608021: (22) Invalid argument 2024-09-12T17:43:54.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.669+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=NR9KS02611GY type=del size=2110621 2024-09-12T17:43:54.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.673+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=KKID4VQ8EGBG type=del 2024-09-12T17:43:54.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.681+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~WO2XVKJ2Z92L.0 size=1048576 2024-09-12T17:43:54.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.681+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~WO2XVKJ2Z92L.1 size=107255 2024-09-12T17:43:54.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.681+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=WO2XVKJ2Z92L tag=92LIIBMB90EY type=write size=2204407 2024-09-12T17:43:54.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.685+0000 7f51d61a08c0 1 < canceled operation key=U3GZL9YPFMZY tag=32NSLFVWJMAD type=del size=3520788 2024-09-12T17:43:54.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.693+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~0XD6H48UIO5Z.0 size=1048576 2024-09-12T17:43:54.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~0XD6H48UIO5Z.1 size=46161 2024-09-12T17:43:54.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.697+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=0XD6H48UIO5Z tag=WCES90Z3YEWV type=write size=2143313 2024-09-12T17:43:54.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.701+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=H1R6RW4499M5 type=del 2024-09-12T17:43:54.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.705+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=UFR67OL7SA57 type=del size=4153205 2024-09-12T17:43:54.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.709+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~SW9B4Z338ZNF.0 size=727572 2024-09-12T17:43:54.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.713+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=SW9B4Z338ZNF tag=1XQJS6TIIXD1 type=write size=1776148 2024-09-12T17:43:54.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.721+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~9P1FOYTQLQ3N.0 size=393233 2024-09-12T17:43:54.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.721+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=9P1FOYTQLQ3N tag=14OSY0G4DPFD type=write size=1441809 2024-09-12T17:43:54.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.729+0000 7f51d61a08c0 1 < suggested update operation key=IWEJXLG1CDAV tag=NON827WUMGB2 type=write size=324953 2024-09-12T17:43:54.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.737+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~O7YXEVG96PCN.0 size=470812 2024-09-12T17:43:54.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.737+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=O7YXEVG96PCN tag=M975AIDRB6FY type=write size=1519388 2024-09-12T17:43:54.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.741+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=CS60QYT5QM7G type=del 2024-09-12T17:43:54.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.745+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=DC4275GEW509 type=write size=152046 2024-09-12T17:43:54.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.745+0000 7f51d61a08c0 1 < canceled part key=_multipart_HY2US2MMDNI4.2~FFKHTJQANF8Y.0 size=1048576 2024-09-12T17:43:54.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.749+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~FFKHTJQANF8Y.1 size=422762 2024-09-12T17:43:54.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.757+0000 7f51d61a08c0 1 < canceled multipart upload key=HY2US2MMDNI4 upload=FFKHTJQANF8Y tag=ANF4Y3GFRJG4 type=write size=2519914 2024-09-12T17:43:54.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.761+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=REBCH36MXH74 type=del size=1254251 2024-09-12T17:43:54.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.765+0000 7f51d61a08c0 1 < canceled operation key=X6KC9Z6LD7VG tag=6HNIKI1PRDA8 type=del size=1402020 2024-09-12T17:43:54.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.769+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=4BRIGCRGKRJN type=del size=4150518 2024-09-12T17:43:54.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.769+0000 7f51d61a08c0 1 < canceled part key=_multipart_JT373R4HAJZS.2~QSR7PYBXUNPK.0 size=397617 2024-09-12T17:43:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.777+0000 7f51d61a08c0 1 < canceled multipart upload key=JT373R4HAJZS upload=QSR7PYBXUNPK tag=XQHLG15VN4JL type=write size=1446193 2024-09-12T17:43:54.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.781+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=9GU4DH22EW91 type=del size=748909 2024-09-12T17:43:54.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.785+0000 7f51d61a08c0 1 < canceled operation key=DCLENF1A1W2Q tag=C5FHFCQEVZWU type=del size=3014920 2024-09-12T17:43:54.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.789+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=Q4CHH4HWRJ14 type=write size=323175 2024-09-12T17:43:54.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.793+0000 7f51d61a08c0 1 < completed write operation key=HY2US2MMDNI4 tag=OWG8BYID3KP9 type=write size=43043 2024-09-12T17:43:54.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.797+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=Z7JOIYAG51KI type=del size=1440368 2024-09-12T17:43:54.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.801+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=8FX7Z0XLWJ36 type=del 2024-09-12T17:43:54.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.805+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~LKA5CL9U2JB1.0 size=1048576 2024-09-12T17:43:54.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.809+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~LKA5CL9U2JB1.1 size=1048576 2024-09-12T17:43:54.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.813+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~LKA5CL9U2JB1.2 size=513179 2024-09-12T17:43:54.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.813+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=LKA5CL9U2JB1 tag=D7HGHAIWMB9L type=write size=3658907 2024-09-12T17:43:54.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.817+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~9EC2GG7SD5R0.0 size=645323 2024-09-12T17:43:54.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.821+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=9EC2GG7SD5R0 tag=06ZCM9VFNSQK type=write size=1693899 2024-09-12T17:43:54.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.829+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=OM030V78JNHZ type=del size=127319 2024-09-12T17:43:54.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.837+0000 7f51d61a08c0 1 < suggested update operation key=BF36J1Q6CZFB tag=KEC02QIOP86U type=write size=893113 2024-09-12T17:43:54.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.837+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=15ZKU5ASH0C3 type=del size=3204880 2024-09-12T17:43:54.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.845+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~JHAXMEH65130.0 size=1048576 2024-09-12T17:43:54.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.845+0000 7f51d61a08c0 1 < canceled part key=_multipart_92CMI8Q29LB3.2~JHAXMEH65130.1 size=203707 2024-09-12T17:43:54.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.849+0000 7f51d61a08c0 1 < canceled multipart upload key=92CMI8Q29LB3 upload=JHAXMEH65130 tag=ME515UHEICGO type=write size=2300859 2024-09-12T17:43:54.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.857+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=3LLSKNHQJALU type=del size=1512602 2024-09-12T17:43:54.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.861+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=NR9KS02611GY type=del 2024-09-12T17:43:54.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.865+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=Z0D8OU7GKHWU type=del size=3966179 2024-09-12T17:43:54.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.869+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~WO2XVKJ2Z92L.0 size=1048576 2024-09-12T17:43:54.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.873+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~WO2XVKJ2Z92L.1 size=107255 2024-09-12T17:43:54.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.877+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=WO2XVKJ2Z92L tag=92LIIBMB90EY type=write size=2204407 2024-09-12T17:43:54.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.885+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=XX9O6E990BAR type=del size=1201498 2024-09-12T17:43:54.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.889+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~0XD6H48UIO5Z.0 size=1048576 2024-09-12T17:43:54.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.889+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~0XD6H48UIO5Z.1 size=46161 2024-09-12T17:43:54.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.897+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=0XD6H48UIO5Z tag=WCES90Z3YEWV type=write size=2143313 2024-09-12T17:43:54.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.905+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~DS55RM5ATKZQ.0 size=1048576 2024-09-12T17:43:54.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.905+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~DS55RM5ATKZQ.1 size=556527 2024-09-12T17:43:54.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.909+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=DS55RM5ATKZQ tag=VTVYTWXH8YNR type=write size=2653679 2024-09-12T17:43:54.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.909+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=UFR67OL7SA57 type=del 2024-09-12T17:43:54.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.917+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~62RNCVD4BFGH.0 size=533591 2024-09-12T17:43:54.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.917+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=62RNCVD4BFGH tag=QAI45M5GSPU9 type=write size=1582167 2024-09-12T17:43:54.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.925+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~9P1FOYTQLQ3N.0 size=393233 2024-09-12T17:43:54.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.929+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=9P1FOYTQLQ3N tag=14OSY0G4DPFD type=write size=1441809 2024-09-12T17:43:54.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.933+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=3V1F5P6PKF56 type=write size=590171 2024-09-12T17:43:54.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.937+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~O7YXEVG96PCN.0 size=470812 2024-09-12T17:43:54.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.945+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=O7YXEVG96PCN tag=M975AIDRB6FY type=write size=1519388 2024-09-12T17:43:54.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.949+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=SWEDBEYLYCX5 type=del size=3972 2024-09-12T17:43:54.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.953+0000 7f51d61a08c0 1 < completed write operation key=SSOA6J297L1C tag=DC4275GEW509 type=write size=152046 2024-09-12T17:43:54.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.961+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~JWNA1I2807YF.0 size=180850 2024-09-12T17:43:54.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.961+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=JWNA1I2807YF tag=G0MD58XY8T71 type=write size=1229426 2024-09-12T17:43:54.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.965+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=REBCH36MXH74 type=del 2024-09-12T17:43:54.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.969+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=I22AS1T2DM6Y type=write size=1024781 2024-09-12T17:43:54.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.973+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=4BRIGCRGKRJN type=del 2024-09-12T17:43:54.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.981+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~CO7U1SL0G53J.0 size=1048576 2024-09-12T17:43:54.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.985+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~CO7U1SL0G53J.1 size=158603 2024-09-12T17:43:54.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.985+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=CO7U1SL0G53J tag=XIUXMEHD6IPR type=write size=2255755 2024-09-12T17:43:54.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.989+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=9GU4DH22EW91 type=del 2024-09-12T17:43:54.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.993+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=4GQGHMP8VHFT type=write size=364710 2024-09-12T17:43:54.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:54.997+0000 7f51d61a08c0 1 < completed write operation key=2WC0YDQFKAJD tag=Q4CHH4HWRJ14 type=write size=323175 2024-09-12T17:43:55.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.005+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~9NSQMUOJMWOX.0 size=1048576 2024-09-12T17:43:55.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.005+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~9NSQMUOJMWOX.1 size=1048576 2024-09-12T17:43:55.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.009+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~9NSQMUOJMWOX.2 size=203003 2024-09-12T17:43:55.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.009+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=9NSQMUOJMWOX tag=YW6OMM94UL46 type=write size=3348731 2024-09-12T17:43:55.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.017+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=Z7JOIYAG51KI type=del 2024-09-12T17:43:55.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.021+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=QX0UR1F7NK99 type=del size=1045366 2024-09-12T17:43:55.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.025+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~LKA5CL9U2JB1.0 size=1048576 2024-09-12T17:43:55.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.029+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~LKA5CL9U2JB1.1 size=1048576 2024-09-12T17:43:55.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.029+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~LKA5CL9U2JB1.2 size=513179 2024-09-12T17:43:55.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.037+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=LKA5CL9U2JB1 tag=D7HGHAIWMB9L type=write size=3658907 2024-09-12T17:43:55.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.045+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~CN0HTBRYD710.0 size=1048576 2024-09-12T17:43:55.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.045+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~CN0HTBRYD710.1 size=1048576 2024-09-12T17:43:55.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.049+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~CN0HTBRYD710.2 size=104227 2024-09-12T17:43:55.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.049+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=CN0HTBRYD710 tag=NLEO9NDA22ML type=write size=3249955 2024-09-12T17:43:55.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.053+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=OM030V78JNHZ type=del 2024-09-12T17:43:55.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.057+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=Q94IKHY50GU5 type=del size=2936398 2024-09-12T17:43:55.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.061+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=15ZKU5ASH0C3 type=del 2024-09-12T17:43:55.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.065+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=7SU2JVLY8ILL type=del size=1742293 2024-09-12T17:43:55.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.069+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=3LLSKNHQJALU type=del 2024-09-12T17:43:55.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.077+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~3YV2V4NAYQ7P.0 size=1048576 2024-09-12T17:43:55.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.077+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~3YV2V4NAYQ7P.1 size=1048576 2024-09-12T17:43:55.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.081+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~3YV2V4NAYQ7P.2 size=630173 2024-09-12T17:43:55.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.081+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=3YV2V4NAYQ7P tag=XG3I0G1O1HS9 type=write size=3775901 2024-09-12T17:43:55.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.085+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=Z0D8OU7GKHWU type=del 2024-09-12T17:43:55.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.089+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=UPZTT6V9AZRR type=del size=3274221 2024-09-12T17:43:55.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.093+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=XX9O6E990BAR type=del 2024-09-12T17:43:55.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.101+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~WUH5T4B2W2EI.0 size=1048576 2024-09-12T17:43:55.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.101+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~WUH5T4B2W2EI.1 size=597339 2024-09-12T17:43:55.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.101+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=WUH5T4B2W2EI tag=OP4NKLUI5MOS type=write size=2694491 2024-09-12T17:43:55.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.105+0000 7f51d61a08c0 1 < canceled part key=_multipart_92CMI8Q29LB3.2~DS55RM5ATKZQ.0 size=1048576 2024-09-12T17:43:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.105+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~DS55RM5ATKZQ.1 size=556527 2024-09-12T17:43:55.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.113+0000 7f51d61a08c0 1 < canceled multipart upload key=92CMI8Q29LB3 upload=DS55RM5ATKZQ tag=VTVYTWXH8YNR type=write size=2653679 2024-09-12T17:43:55.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.117+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=QHKHNZEKA5JZ type=del size=4022985 2024-09-12T17:43:55.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.117+0000 7f51d61a08c0 1 < canceled part key=_multipart_HY2US2MMDNI4.2~62RNCVD4BFGH.0 size=533591 2024-09-12T17:43:55.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.125+0000 7f51d61a08c0 1 < canceled multipart upload key=HY2US2MMDNI4 upload=62RNCVD4BFGH tag=QAI45M5GSPU9 type=write size=1582167 2024-09-12T17:43:55.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.129+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=6T0DFXCPDO67 type=write size=508956 2024-09-12T17:43:55.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.133+0000 7f51d61a08c0 1 < completed write operation key=2WC0YDQFKAJD tag=3V1F5P6PKF56 type=write size=590171 2024-09-12T17:43:55.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.137+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~ZX8UY0I8VQGN.0 size=579456 2024-09-12T17:43:55.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.137+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=ZX8UY0I8VQGN tag=0DWQS5MCHOH0 type=write size=1628032 2024-09-12T17:43:55.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.141+0000 7f51d61a08c0 1 < completed delete operation key=U3GZL9YPFMZY tag=SWEDBEYLYCX5 type=del 2024-09-12T17:43:55.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.145+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=R9I7V5C39ZYZ type=write size=491372 2024-09-12T17:43:55.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.153+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~JWNA1I2807YF.0 size=180850 2024-09-12T17:43:55.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.157+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=JWNA1I2807YF tag=G0MD58XY8T71 type=write size=1229426 2024-09-12T17:43:55.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.161+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=G0NOODOZXABM type=del size=359932 2024-09-12T17:43:55.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.165+0000 7f51d61a08c0 1 < completed write operation key=HY2US2MMDNI4 tag=I22AS1T2DM6Y type=write size=1024781 2024-09-12T17:43:55.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.173+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~1UIYETQKTCEN.0 size=1048576 2024-09-12T17:43:55.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.173+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~1UIYETQKTCEN.1 size=1048576 2024-09-12T17:43:55.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.177+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~1UIYETQKTCEN.2 size=562433 2024-09-12T17:43:55.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.177+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=1UIYETQKTCEN tag=IX617XK0OKAZ type=write size=3708161 2024-09-12T17:43:55.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.181+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~CO7U1SL0G53J.0 size=1048576 2024-09-12T17:43:55.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.185+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~CO7U1SL0G53J.1 size=158603 2024-09-12T17:43:55.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.189+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=CO7U1SL0G53J tag=XIUXMEHD6IPR type=write size=2255755 2024-09-12T17:43:55.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.193+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=B2VXJSOV9ZXQ type=del size=749201 2024-09-12T17:43:55.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.205+0000 7f51d61a08c0 1 < suggested remove operation key=A7V478K2SNOF tag=4GQGHMP8VHFT type=write 2024-09-12T17:43:55.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.213+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~E4D16K8SKI29.0 size=1048576 2024-09-12T17:43:55.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.213+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~E4D16K8SKI29.1 size=1048576 2024-09-12T17:43:55.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.217+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~E4D16K8SKI29.2 size=356833 2024-09-12T17:43:55.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.217+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=E4D16K8SKI29 tag=EC2Y2YJ1PICV type=write size=3502561 2024-09-12T17:43:55.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.221+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~9NSQMUOJMWOX.0 size=1048576 2024-09-12T17:43:55.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.225+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~9NSQMUOJMWOX.1 size=1048576 2024-09-12T17:43:55.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.229+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~9NSQMUOJMWOX.2 size=203003 2024-09-12T17:43:55.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.233+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=9NSQMUOJMWOX tag=YW6OMM94UL46 type=write size=3348731 2024-09-12T17:43:55.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.237+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=B2B25XZXQRRI type=del size=2157425 2024-09-12T17:43:55.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.249+0000 7f51d61a08c0 1 < suggested update operation key=96OWZQXI2ALM tag=QX0UR1F7NK99 type=del size=1045366 2024-09-12T17:43:55.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.253+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=DULCPRIV9MYX type=del size=2811199 2024-09-12T17:43:55.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.257+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~CN0HTBRYD710.0 size=1048576 2024-09-12T17:43:55.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.261+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~CN0HTBRYD710.1 size=1048576 2024-09-12T17:43:55.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.265+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~CN0HTBRYD710.2 size=104227 2024-09-12T17:43:55.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.273+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=CN0HTBRYD710 tag=NLEO9NDA22ML type=write size=3249955 2024-09-12T17:43:55.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.277+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~OOS6MARCMOLA.0 size=1048576 2024-09-12T17:43:55.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.281+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~OOS6MARCMOLA.1 size=1048576 2024-09-12T17:43:55.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.285+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~OOS6MARCMOLA.2 size=942603 2024-09-12T17:43:55.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.285+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=OOS6MARCMOLA tag=OUFATG760RR2 type=write size=4088331 2024-09-12T17:43:55.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.289+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=Q94IKHY50GU5 type=del 2024-09-12T17:43:55.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.297+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~82M3FAA1HQ7V.0 size=414612 2024-09-12T17:43:55.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.297+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=82M3FAA1HQ7V tag=VMGYY3VF3ZA6 type=write size=1463188 2024-09-12T17:43:55.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.301+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=7SU2JVLY8ILL type=del 2024-09-12T17:43:55.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.309+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~U1XRIHJT47KO.0 size=268099 2024-09-12T17:43:55.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.309+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=U1XRIHJT47KO tag=FO87A5XK6X91 type=write size=1316675 2024-09-12T17:43:55.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.313+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~3YV2V4NAYQ7P.0 size=1048576 2024-09-12T17:43:55.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.317+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~3YV2V4NAYQ7P.1 size=1048576 2024-09-12T17:43:55.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.321+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~3YV2V4NAYQ7P.2 size=630173 2024-09-12T17:43:55.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.329+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=3YV2V4NAYQ7P tag=XG3I0G1O1HS9 type=write size=3775901 2024-09-12T17:43:55.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.329+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=KUCBCSKBBM0A type=del size=154561 2024-09-12T17:43:55.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.337+0000 7f51d61a08c0 1 < suggested update operation key=92CMI8Q29LB3 tag=UPZTT6V9AZRR type=del size=3274221 2024-09-12T17:43:55.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.345+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~CLDXP5RYDG4P.0 size=54386 2024-09-12T17:43:55.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.345+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=CLDXP5RYDG4P tag=7PZOSYEYN0TV type=write size=1102962 2024-09-12T17:43:55.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.345+0000 7f51d61a08c0 1 < canceled part key=_multipart_V5KMBUNVQA0H.2~WUH5T4B2W2EI.0 size=1048576 2024-09-12T17:43:55.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.349+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~WUH5T4B2W2EI.1 size=597339 2024-09-12T17:43:55.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.353+0000 7f51d61a08c0 1 < canceled multipart upload key=V5KMBUNVQA0H upload=WUH5T4B2W2EI tag=OP4NKLUI5MOS type=write size=2694491 2024-09-12T17:43:55.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.357+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=QPSA0H1K2RA4 type=del size=3555826 2024-09-12T17:43:55.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.361+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=QHKHNZEKA5JZ type=del 2024-09-12T17:43:55.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.365+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=3S5UT3GB8LKM type=del size=1427873 2024-09-12T17:43:55.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.369+0000 7f51d61a08c0 1 < completed write operation key=10WBH16J1AF8 tag=6T0DFXCPDO67 type=write size=508956 2024-09-12T17:43:55.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.381+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~720QDTOBRTU7.0 size=1048576 2024-09-12T17:43:55.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.385+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~720QDTOBRTU7.1 size=728363 2024-09-12T17:43:55.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.385+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=720QDTOBRTU7 tag=9795OX1FM14R type=write size=2825515 2024-09-12T17:43:55.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.385+0000 7f51d61a08c0 1 < canceled part key=_multipart_GJX1YGAQFXZ2.2~ZX8UY0I8VQGN.0 size=579456 2024-09-12T17:43:55.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.393+0000 7f51d61a08c0 1 < canceled multipart upload key=GJX1YGAQFXZ2 upload=ZX8UY0I8VQGN tag=0DWQS5MCHOH0 type=write size=1628032 2024-09-12T17:43:55.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.393+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=9G7ZHW21DRXW type=del size=14937 2024-09-12T17:43:55.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.397+0000 7f51d61a08c0 1 < completed write operation key=GJX1YGAQFXZ2 tag=R9I7V5C39ZYZ type=write size=491372 2024-09-12T17:43:55.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.405+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=JIPE7DTAUPIX type=del size=3300792 2024-09-12T17:43:55.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.405+0000 7f51d61a08c0 -1 < failed to complete operation key=92CMI8Q29LB3 tag=G0NOODOZXABM type=del size=359932: (22) Invalid argument 2024-09-12T17:43:55.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.413+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=TW2EMC424WL9 type=del size=2134462 2024-09-12T17:43:55.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.417+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~1UIYETQKTCEN.0 size=1048576 2024-09-12T17:43:55.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.417+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~1UIYETQKTCEN.1 size=1048576 2024-09-12T17:43:55.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.421+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~1UIYETQKTCEN.2 size=562433 2024-09-12T17:43:55.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.429+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=1UIYETQKTCEN tag=IX617XK0OKAZ type=write size=3708161 2024-09-12T17:43:55.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.437+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~LIT874KN9B24.0 size=1048576 2024-09-12T17:43:55.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.437+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~LIT874KN9B24.1 size=645516 2024-09-12T17:43:55.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.437+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=LIT874KN9B24 tag=13QCL6V0RNM1 type=write size=2742668 2024-09-12T17:43:55.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.445+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=B2VXJSOV9ZXQ type=del 2024-09-12T17:43:55.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.449+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=6CGU7D255Q7T type=del size=312963 2024-09-12T17:43:55.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.453+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~E4D16K8SKI29.0 size=1048576 2024-09-12T17:43:55.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.457+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~E4D16K8SKI29.1 size=1048576 2024-09-12T17:43:55.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.457+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~E4D16K8SKI29.2 size=356833 2024-09-12T17:43:55.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.465+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=E4D16K8SKI29 tag=EC2Y2YJ1PICV type=write size=3502561 2024-09-12T17:43:55.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.473+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~6ZHEDHCAFSMV.0 size=1048576 2024-09-12T17:43:55.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.477+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~6ZHEDHCAFSMV.1 size=342392 2024-09-12T17:43:55.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.477+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=6ZHEDHCAFSMV tag=TRTNUXEHIUK2 type=write size=2439544 2024-09-12T17:43:55.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.481+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=B2B25XZXQRRI type=del 2024-09-12T17:43:55.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.489+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~THI5I2IB81ML.0 size=429723 2024-09-12T17:43:55.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.489+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=THI5I2IB81ML tag=5QPN1IJVL8ST type=write size=1478299 2024-09-12T17:43:55.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.497+0000 7f51d61a08c0 1 < suggested update operation key=EDVAEE9FKH1T tag=DULCPRIV9MYX type=del size=2811199 2024-09-12T17:43:55.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.505+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~F901IDHRKVVS.0 size=1048576 2024-09-12T17:43:55.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.509+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~F901IDHRKVVS.1 size=750632 2024-09-12T17:43:55.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.509+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=F901IDHRKVVS tag=7JSPLZC59KJD type=write size=2847784 2024-09-12T17:43:55.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.509+0000 7f51d61a08c0 1 < canceled part key=_multipart_S292EX1P7IZA.2~OOS6MARCMOLA.0 size=1048576 2024-09-12T17:43:55.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.513+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~OOS6MARCMOLA.1 size=1048576 2024-09-12T17:43:55.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.513+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~OOS6MARCMOLA.2 size=942603 2024-09-12T17:43:55.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.521+0000 7f51d61a08c0 1 < canceled multipart upload key=S292EX1P7IZA upload=OOS6MARCMOLA tag=OUFATG760RR2 type=write size=4088331 2024-09-12T17:43:55.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.525+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=XU4OH809PWG0 type=write size=735483 2024-09-12T17:43:55.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.529+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~82M3FAA1HQ7V.0 size=414612 2024-09-12T17:43:55.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.533+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=82M3FAA1HQ7V tag=VMGYY3VF3ZA6 type=write size=1463188 2024-09-12T17:43:55.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.537+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=4Y4MIJ77FASE type=del size=329182 2024-09-12T17:43:55.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.541+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~U1XRIHJT47KO.0 size=268099 2024-09-12T17:43:55.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.549+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=U1XRIHJT47KO tag=FO87A5XK6X91 type=write size=1316675 2024-09-12T17:43:55.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.553+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=I1UDR9Z97KGS type=del size=1794254 2024-09-12T17:43:55.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.557+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=KUCBCSKBBM0A type=del 2024-09-12T17:43:55.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.557+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=XVGAFHA3WUME type=del size=2330120 2024-09-12T17:43:55.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.561+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~CLDXP5RYDG4P.0 size=54386 2024-09-12T17:43:55.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.569+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=CLDXP5RYDG4P tag=7PZOSYEYN0TV type=write size=1102962 2024-09-12T17:43:55.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.573+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~M7I5AWGB8CJ0.0 size=1048576 2024-09-12T17:43:55.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~M7I5AWGB8CJ0.1 size=1048576 2024-09-12T17:43:55.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.581+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~M7I5AWGB8CJ0.2 size=635409 2024-09-12T17:43:55.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.581+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=M7I5AWGB8CJ0 tag=Q79NU16H1FY9 type=write size=3781137 2024-09-12T17:43:55.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.585+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=QPSA0H1K2RA4 type=del 2024-09-12T17:43:55.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.589+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=MWEFTLCQC0RJ type=del size=1313624 2024-09-12T17:43:55.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.593+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=3S5UT3GB8LKM type=del 2024-09-12T17:43:55.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.597+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~OPHBISW4LNJL.0 size=1048576 2024-09-12T17:43:55.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.601+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~OPHBISW4LNJL.1 size=893664 2024-09-12T17:43:55.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.601+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=OPHBISW4LNJL tag=E46GDP9EU9E6 type=write size=2990816 2024-09-12T17:43:55.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.601+0000 7f51d61a08c0 1 < canceled part key=_multipart_7FBK3439R80H.2~720QDTOBRTU7.0 size=1048576 2024-09-12T17:43:55.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.605+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~720QDTOBRTU7.1 size=728363 2024-09-12T17:43:55.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.613+0000 7f51d61a08c0 1 < canceled multipart upload key=7FBK3439R80H upload=720QDTOBRTU7 tag=9795OX1FM14R type=write size=2825515 2024-09-12T17:43:55.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.617+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=BDYAYKP2GZQ1 type=del size=3817474 2024-09-12T17:43:55.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.625+0000 7f51d61a08c0 1 < suggested update operation key=92CMI8Q29LB3 tag=9G7ZHW21DRXW type=del size=14937 2024-09-12T17:43:55.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.629+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~XDRFX20AH04W.0 size=122509 2024-09-12T17:43:55.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.629+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=XDRFX20AH04W tag=SCS4IS1NE022 type=write size=1171085 2024-09-12T17:43:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.637+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=JIPE7DTAUPIX type=del 2024-09-12T17:43:55.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.641+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=XP9IBVOHZTKE type=del size=1412359 2024-09-12T17:43:55.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.645+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=TW2EMC424WL9 type=del 2024-09-12T17:43:55.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.653+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~DJOJ3AUJLY4K.0 size=1048576 2024-09-12T17:43:55.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.653+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~DJOJ3AUJLY4K.1 size=1048576 2024-09-12T17:43:55.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.657+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~DJOJ3AUJLY4K.2 size=485920 2024-09-12T17:43:55.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.657+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=DJOJ3AUJLY4K tag=C8XPD3TV4E5R type=write size=3631648 2024-09-12T17:43:55.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.661+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~LIT874KN9B24.0 size=1048576 2024-09-12T17:43:55.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.665+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~LIT874KN9B24.1 size=645516 2024-09-12T17:43:55.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.669+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=LIT874KN9B24 tag=13QCL6V0RNM1 type=write size=2742668 2024-09-12T17:43:55.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.677+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~51X21MOLRT40.0 size=1048576 2024-09-12T17:43:55.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.681+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~51X21MOLRT40.1 size=1048576 2024-09-12T17:43:55.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.685+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~51X21MOLRT40.2 size=987779 2024-09-12T17:43:55.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.685+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=51X21MOLRT40 tag=V18OXBFUCTB1 type=write size=4133507 2024-09-12T17:43:55.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.689+0000 7f51d61a08c0 -1 < failed to complete operation key=EDVAEE9FKH1T tag=6CGU7D255Q7T type=del size=312963: (22) Invalid argument 2024-09-12T17:43:55.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.693+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~GMYOG2TL7HZG.0 size=1048576 2024-09-12T17:43:55.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~GMYOG2TL7HZG.1 size=348131 2024-09-12T17:43:55.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.697+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=GMYOG2TL7HZG tag=SPEWT155MYXA type=write size=2445283 2024-09-12T17:43:55.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.701+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~6ZHEDHCAFSMV.0 size=1048576 2024-09-12T17:43:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.705+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~6ZHEDHCAFSMV.1 size=342392 2024-09-12T17:43:55.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.709+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=6ZHEDHCAFSMV tag=TRTNUXEHIUK2 type=write size=2439544 2024-09-12T17:43:55.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.713+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=6NDEDVEHZN07 type=write size=651303 2024-09-12T17:43:55.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.717+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~THI5I2IB81ML.0 size=429723 2024-09-12T17:43:55.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.725+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=THI5I2IB81ML tag=5QPN1IJVL8ST type=write size=1478299 2024-09-12T17:43:55.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.729+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=Q1CI1IB4JYV3 type=del size=803740 2024-09-12T17:43:55.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.733+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~F901IDHRKVVS.0 size=1048576 2024-09-12T17:43:55.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.737+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~F901IDHRKVVS.1 size=750632 2024-09-12T17:43:55.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.745+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=F901IDHRKVVS tag=7JSPLZC59KJD type=write size=2847784 2024-09-12T17:43:55.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.749+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=LZ4BVJ2H9KIM type=del size=1535463 2024-09-12T17:43:55.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.753+0000 7f51d61a08c0 1 < completed write operation key=3LE20KMMPH8P tag=XU4OH809PWG0 type=write size=735483 2024-09-12T17:43:55.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.757+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~JHJO8LUA8XKG.0 size=831739 2024-09-12T17:43:55.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.757+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=JHJO8LUA8XKG tag=A9VQBOFS0IPH type=write size=1880315 2024-09-12T17:43:55.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.765+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=4Y4MIJ77FASE type=del 2024-09-12T17:43:55.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.769+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=V0MOG36Z2Y2C type=del size=1141138 2024-09-12T17:43:55.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.773+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=I1UDR9Z97KGS type=del 2024-09-12T17:43:55.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.777+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~1GBZQ3FQD679.0 size=1048576 2024-09-12T17:43:55.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~1GBZQ3FQD679.1 size=966183 2024-09-12T17:43:55.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.781+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=1GBZQ3FQD679 tag=RYJ5EBREHRU4 type=write size=3063335 2024-09-12T17:43:55.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.789+0000 7f51d61a08c0 1 < suggested update operation key=V5KMBUNVQA0H tag=XVGAFHA3WUME type=del size=2330120 2024-09-12T17:43:55.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.793+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=4PBDSY7526Q1 type=del size=550646 2024-09-12T17:43:55.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.797+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~M7I5AWGB8CJ0.0 size=1048576 2024-09-12T17:43:55.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.801+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~M7I5AWGB8CJ0.1 size=1048576 2024-09-12T17:43:55.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.801+0000 7f51d61a08c0 1 < canceled part key=_multipart_HY2US2MMDNI4.2~M7I5AWGB8CJ0.2 size=635409 2024-09-12T17:43:55.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.805+0000 7f51d61a08c0 1 < canceled multipart upload key=HY2US2MMDNI4 upload=M7I5AWGB8CJ0 tag=Q79NU16H1FY9 type=write size=3781137 2024-09-12T17:43:55.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.813+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=DJZUXLEE95QK type=del size=2771163 2024-09-12T17:43:55.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.817+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=MWEFTLCQC0RJ type=del 2024-09-12T17:43:55.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.821+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=55K590TG4JG2 type=del size=2995976 2024-09-12T17:43:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.825+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~OPHBISW4LNJL.0 size=1048576 2024-09-12T17:43:55.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.825+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~OPHBISW4LNJL.1 size=893664 2024-09-12T17:43:55.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.837+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=OPHBISW4LNJL tag=E46GDP9EU9E6 type=write size=2990816 2024-09-12T17:43:55.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.841+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~WZS7QMDKA4WR.0 size=355955 2024-09-12T17:43:55.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.841+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=WZS7QMDKA4WR tag=YZP9KX6DUCVT type=write size=1404531 2024-09-12T17:43:55.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.849+0000 7f51d61a08c0 1 < suggested update operation key=HUWVRJIZ5JYE tag=BDYAYKP2GZQ1 type=del size=3817474 2024-09-12T17:43:55.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.853+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=69YF0TEG9ENF type=del size=4098525 2024-09-12T17:43:55.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.857+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~XDRFX20AH04W.0 size=122509 2024-09-12T17:43:55.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.865+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=XDRFX20AH04W tag=SCS4IS1NE022 type=write size=1171085 2024-09-12T17:43:55.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.869+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=X4ED59YYBGMW type=del size=3686815 2024-09-12T17:43:55.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.873+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=XP9IBVOHZTKE type=del 2024-09-12T17:43:55.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.877+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=XOOBC28G5T22 type=write size=175300 2024-09-12T17:43:55.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.877+0000 7f51d61a08c0 1 < canceled part key=_multipart_I22NJJISU96B.2~DJOJ3AUJLY4K.0 size=1048576 2024-09-12T17:43:55.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.881+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~DJOJ3AUJLY4K.1 size=1048576 2024-09-12T17:43:55.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.881+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~DJOJ3AUJLY4K.2 size=485920 2024-09-12T17:43:55.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.889+0000 7f51d61a08c0 1 < canceled multipart upload key=I22NJJISU96B upload=DJOJ3AUJLY4K tag=C8XPD3TV4E5R type=write size=3631648 2024-09-12T17:43:55.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.893+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=VZCZWK9PJ2H2 type=del size=3079157 2024-09-12T17:43:55.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.897+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~51X21MOLRT40.0 size=1048576 2024-09-12T17:43:55.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.897+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~51X21MOLRT40.1 size=1048576 2024-09-12T17:43:55.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.901+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~51X21MOLRT40.2 size=987779 2024-09-12T17:43:55.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.909+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=51X21MOLRT40 tag=V18OXBFUCTB1 type=write size=4133507 2024-09-12T17:43:55.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.913+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=RVMUQB6660VN type=del size=2652610 2024-09-12T17:43:55.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.917+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~GMYOG2TL7HZG.0 size=1048576 2024-09-12T17:43:55.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.917+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~GMYOG2TL7HZG.1 size=348131 2024-09-12T17:43:55.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.925+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=GMYOG2TL7HZG tag=SPEWT155MYXA type=write size=2445283 2024-09-12T17:43:55.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.933+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~7DM5IOR7SP1P.0 size=271926 2024-09-12T17:43:55.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.933+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=7DM5IOR7SP1P tag=SYIINPLFQO05 type=write size=1320502 2024-09-12T17:43:55.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.937+0000 7f51d61a08c0 1 < canceled operation key=IWEJXLG1CDAV tag=6NDEDVEHZN07 type=write size=651303 2024-09-12T17:43:55.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.941+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=E32BVLL305TU type=del size=4166686 2024-09-12T17:43:55.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.945+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=Q1CI1IB4JYV3 type=del 2024-09-12T17:43:55.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.949+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=5R0SRZYIEYZD type=del size=1091391 2024-09-12T17:43:55.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.953+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=LZ4BVJ2H9KIM type=del 2024-09-12T17:43:55.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.957+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~5GSJ1ZRXPD1K.0 size=581312 2024-09-12T17:43:55.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.957+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=5GSJ1ZRXPD1K tag=7S2NHGA4977R type=write size=1629888 2024-09-12T17:43:55.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.961+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~JHJO8LUA8XKG.0 size=831739 2024-09-12T17:43:55.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.969+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=JHJO8LUA8XKG tag=A9VQBOFS0IPH type=write size=1880315 2024-09-12T17:43:55.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.973+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=O2DIP6DDFB8J type=del size=3696940 2024-09-12T17:43:55.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.977+0000 7f51d61a08c0 1 < canceled operation key=HY2US2MMDNI4 tag=V0MOG36Z2Y2C type=del size=1141138 2024-09-12T17:43:55.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.981+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=J5VP04CEV3UX type=del size=3336259 2024-09-12T17:43:55.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.985+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~1GBZQ3FQD679.0 size=1048576 2024-09-12T17:43:55.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.989+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~1GBZQ3FQD679.1 size=966183 2024-09-12T17:43:55.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.993+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=1GBZQ3FQD679 tag=RYJ5EBREHRU4 type=write size=3063335 2024-09-12T17:43:56.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:55.997+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=V9MY9QCN5LBK type=write size=739896 2024-09-12T17:43:56.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.005+0000 7f51d61a08c0 1 < canceled operation key=DCLENF1A1W2Q tag=4PBDSY7526Q1 type=del size=550646 2024-09-12T17:43:56.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.009+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=SI3QC12Q2CU9 type=del size=816320 2024-09-12T17:43:56.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.013+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=DJZUXLEE95QK type=del 2024-09-12T17:43:56.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.017+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=UCYEWAU4HN27 type=del size=3514507 2024-09-12T17:43:56.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.017+0000 7f51d61a08c0 -1 < failed to complete operation key=HUWVRJIZ5JYE tag=55K590TG4JG2 type=del size=2995976: (22) Invalid argument 2024-09-12T17:43:56.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.021+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=6U4UCXL4AFMJ type=del size=557008 2024-09-12T17:43:56.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.025+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~WZS7QMDKA4WR.0 size=355955 2024-09-12T17:43:56.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.033+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=WZS7QMDKA4WR tag=YZP9KX6DUCVT type=write size=1404531 2024-09-12T17:43:56.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.041+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~DZZBLYVQRWA5.0 size=1048576 2024-09-12T17:43:56.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.045+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~DZZBLYVQRWA5.1 size=554948 2024-09-12T17:43:56.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.045+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=DZZBLYVQRWA5 tag=16OGQB0XS1HH type=write size=2652100 2024-09-12T17:43:56.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.049+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=69YF0TEG9ENF type=del 2024-09-12T17:43:56.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.053+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=XQ3WE03BTLI9 type=del size=2488592 2024-09-12T17:43:56.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.057+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=X4ED59YYBGMW type=del 2024-09-12T17:43:56.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.061+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=UE3FP77QONEF type=del size=857891 2024-09-12T17:43:56.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.061+0000 7f51d61a08c0 1 < completed write operation key=JEXD4ZU5HJ2B tag=XOOBC28G5T22 type=write size=175300 2024-09-12T17:43:56.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.069+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~GD6RMEN9HUMU.0 size=270756 2024-09-12T17:43:56.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.069+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=GD6RMEN9HUMU tag=95DXRM3U7FQ5 type=write size=1319332 2024-09-12T17:43:56.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.073+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=VZCZWK9PJ2H2 type=del 2024-09-12T17:43:56.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.081+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~9Q9UGNI5XPY3.0 size=923337 2024-09-12T17:43:56.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.081+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=9Q9UGNI5XPY3 tag=HSC1A52DNJAO type=write size=1971913 2024-09-12T17:43:56.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.089+0000 7f51d61a08c0 1 < suggested remove operation key=A7V478K2SNOF tag=RVMUQB6660VN type=del 2024-09-12T17:43:56.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.093+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=ZXU3PBTEM9CW type=del size=4020090 2024-09-12T17:43:56.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.097+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~7DM5IOR7SP1P.0 size=271926 2024-09-12T17:43:56.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.109+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=7DM5IOR7SP1P tag=SYIINPLFQO05 type=write size=1320502 2024-09-12T17:43:56.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.113+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=66UCZUZJTAYP type=del size=3830966 2024-09-12T17:43:56.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.117+0000 7f51d61a08c0 1 < canceled operation key=NIQAUF085D97 tag=E32BVLL305TU type=del size=4166686 2024-09-12T17:43:56.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.121+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=4WY8HZFSV9LT type=del size=2517044 2024-09-12T17:43:56.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.125+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=5R0SRZYIEYZD type=del 2024-09-12T17:43:56.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.133+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=33K8EBEKK0QJ type=del size=500233 2024-09-12T17:43:56.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.137+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~5GSJ1ZRXPD1K.0 size=581312 2024-09-12T17:43:56.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.141+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=5GSJ1ZRXPD1K tag=7S2NHGA4977R type=write size=1629888 2024-09-12T17:43:56.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.149+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~TY7QZTMMGQS9.0 size=103555 2024-09-12T17:43:56.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.149+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=TY7QZTMMGQS9 tag=K40U3JCR7FLI type=write size=1152131 2024-09-12T17:43:56.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.153+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=O2DIP6DDFB8J type=del 2024-09-12T17:43:56.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.161+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~O0634VJ688RM.0 size=1048576 2024-09-12T17:43:56.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.165+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~O0634VJ688RM.1 size=1048576 2024-09-12T17:43:56.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.169+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~O0634VJ688RM.2 size=814921 2024-09-12T17:43:56.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.169+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=O0634VJ688RM tag=WJSMP3C21824 type=write size=3960649 2024-09-12T17:43:56.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.173+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=J5VP04CEV3UX type=del 2024-09-12T17:43:56.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.181+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~01A9RT9TE146.0 size=1048576 2024-09-12T17:43:56.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.181+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~01A9RT9TE146.1 size=494980 2024-09-12T17:43:56.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.181+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=01A9RT9TE146 tag=9BOS1HLTBU4N type=write size=2592132 2024-09-12T17:43:56.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.185+0000 7f51d61a08c0 1 < completed write operation key=JT373R4HAJZS tag=V9MY9QCN5LBK type=write size=739896 2024-09-12T17:43:56.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.189+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=7SV0WXNRGV2B type=del size=3424990 2024-09-12T17:43:56.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.193+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=SI3QC12Q2CU9 type=del 2024-09-12T17:43:56.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.197+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=V537R4SYSIQH type=del size=4185299 2024-09-12T17:43:56.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.205+0000 7f51d61a08c0 1 < suggested update operation key=10WBH16J1AF8 tag=UCYEWAU4HN27 type=del size=3514507 2024-09-12T17:43:56.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.209+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=543UWR8GF5M3 type=del size=135755 2024-09-12T17:43:56.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.213+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=6U4UCXL4AFMJ type=del 2024-09-12T17:43:56.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.217+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=1X5CVL078QAO type=write size=692594 2024-09-12T17:43:56.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.221+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~DZZBLYVQRWA5.0 size=1048576 2024-09-12T17:43:56.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.225+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~DZZBLYVQRWA5.1 size=554948 2024-09-12T17:43:56.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.233+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=DZZBLYVQRWA5 tag=16OGQB0XS1HH type=write size=2652100 2024-09-12T17:43:56.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.237+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~TFEA6MBR23KF.0 size=1048576 2024-09-12T17:43:56.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.241+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~TFEA6MBR23KF.1 size=59764 2024-09-12T17:43:56.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.241+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=TFEA6MBR23KF tag=PD8N4F6BSJDA type=write size=2156916 2024-09-12T17:43:56.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.245+0000 7f51d61a08c0 1 < canceled operation key=1ZETSL5TXYSM tag=XQ3WE03BTLI9 type=del size=2488592 2024-09-12T17:43:56.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.249+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=K06HUROXC9PN type=del size=202273 2024-09-12T17:43:56.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.253+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=UE3FP77QONEF type=del 2024-09-12T17:43:56.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.261+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~6L48GNGQMSDL.0 size=1048576 2024-09-12T17:43:56.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.261+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~6L48GNGQMSDL.1 size=1048576 2024-09-12T17:43:56.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.265+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~6L48GNGQMSDL.2 size=999162 2024-09-12T17:43:56.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.265+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=6L48GNGQMSDL tag=NX3MMMWK99Q2 type=write size=4144890 2024-09-12T17:43:56.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.269+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~GD6RMEN9HUMU.0 size=270756 2024-09-12T17:43:56.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.277+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=GD6RMEN9HUMU tag=95DXRM3U7FQ5 type=write size=1319332 2024-09-12T17:43:56.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.277+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=OVR1KLGV3DQS type=del size=757174 2024-09-12T17:43:56.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.281+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~9Q9UGNI5XPY3.0 size=923337 2024-09-12T17:43:56.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.289+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=9Q9UGNI5XPY3 tag=HSC1A52DNJAO type=write size=1971913 2024-09-12T17:43:56.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.297+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~MYAXJOTW246Q.0 size=1048576 2024-09-12T17:43:56.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.297+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~MYAXJOTW246Q.1 size=1048576 2024-09-12T17:43:56.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.301+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~MYAXJOTW246Q.2 size=289295 2024-09-12T17:43:56.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.301+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=MYAXJOTW246Q tag=AAB8SP29XCNO type=write size=3435023 2024-09-12T17:43:56.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.305+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=ZXU3PBTEM9CW type=del 2024-09-12T17:43:56.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.309+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=LU4BUXYD8B69 type=del size=2825716 2024-09-12T17:43:56.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.313+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=66UCZUZJTAYP type=del 2024-09-12T17:43:56.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.317+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=DAVJMV1J2O80 type=del size=1024505 2024-09-12T17:43:56.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.325+0000 7f51d61a08c0 1 < suggested remove operation key=7FBK3439R80H tag=4WY8HZFSV9LT type=del 2024-09-12T17:43:56.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.329+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=0KB1UGFC389B type=del size=3332868 2024-09-12T17:43:56.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.333+0000 7f51d61a08c0 1 < canceled operation key=SSOA6J297L1C tag=33K8EBEKK0QJ type=del size=500233 2024-09-12T17:43:56.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.341+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~TUKKEE5VHU3H.0 size=1048576 2024-09-12T17:43:56.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.341+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~TUKKEE5VHU3H.1 size=1048576 2024-09-12T17:43:56.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.345+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~TUKKEE5VHU3H.2 size=267502 2024-09-12T17:43:56.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.345+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=TUKKEE5VHU3H tag=NQDMCWX66TF8 type=write size=3413230 2024-09-12T17:43:56.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.349+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~TY7QZTMMGQS9.0 size=103555 2024-09-12T17:43:56.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.357+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=TY7QZTMMGQS9 tag=K40U3JCR7FLI type=write size=1152131 2024-09-12T17:43:56.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.365+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~XHNH2LIAG3ML.0 size=1048576 2024-09-12T17:43:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.369+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~XHNH2LIAG3ML.1 size=395797 2024-09-12T17:43:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.369+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=XHNH2LIAG3ML tag=MFF14A5JPFEC type=write size=2492949 2024-09-12T17:43:56.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.373+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~O0634VJ688RM.0 size=1048576 2024-09-12T17:43:56.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.373+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~O0634VJ688RM.1 size=1048576 2024-09-12T17:43:56.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.373+0000 7f51d61a08c0 1 < canceled part key=_multipart_GCL7UJEJM1UV.2~O0634VJ688RM.2 size=814921 2024-09-12T17:43:56.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.381+0000 7f51d61a08c0 1 < canceled multipart upload key=GCL7UJEJM1UV upload=O0634VJ688RM tag=WJSMP3C21824 type=write size=3960649 2024-09-12T17:43:56.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.385+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=LD7QX6176BG0 type=write size=463557 2024-09-12T17:43:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.389+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~01A9RT9TE146.0 size=1048576 2024-09-12T17:43:56.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.393+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~01A9RT9TE146.1 size=494980 2024-09-12T17:43:56.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.401+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=01A9RT9TE146 tag=9BOS1HLTBU4N type=write size=2592132 2024-09-12T17:43:56.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.405+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=BJW51ZN43YMU type=del size=289603 2024-09-12T17:43:56.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.413+0000 7f51d61a08c0 1 < suggested remove operation key=XL9QDBTYSP7F tag=7SV0WXNRGV2B type=del 2024-09-12T17:43:56.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.417+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~TRFD3JHOOSOM.0 size=1048576 2024-09-12T17:43:56.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.421+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~TRFD3JHOOSOM.1 size=1048576 2024-09-12T17:43:56.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.425+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~TRFD3JHOOSOM.2 size=226849 2024-09-12T17:43:56.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.425+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=TRFD3JHOOSOM tag=831GRG3VIVOL type=write size=3372577 2024-09-12T17:43:56.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.429+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=V537R4SYSIQH type=del 2024-09-12T17:43:56.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.433+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=GBE3OA3FQQZO type=del size=1425190 2024-09-12T17:43:56.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.433+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=543UWR8GF5M3 type=del 2024-09-12T17:43:56.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.437+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=AUR4B3G0M6TU type=del size=1908434 2024-09-12T17:43:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.441+0000 7f51d61a08c0 1 < completed write operation key=EDVAEE9FKH1T tag=1X5CVL078QAO type=write size=692594 2024-09-12T17:43:56.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.449+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=T2RGTN91BT7Z type=del size=4218 2024-09-12T17:43:56.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.453+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~TFEA6MBR23KF.0 size=1048576 2024-09-12T17:43:56.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.453+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~TFEA6MBR23KF.1 size=59764 2024-09-12T17:43:56.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.461+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=TFEA6MBR23KF tag=PD8N4F6BSJDA type=write size=2156916 2024-09-12T17:43:56.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.465+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=ZPXW6MG1W0ZO type=del size=3671516 2024-09-12T17:43:56.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.469+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=K06HUROXC9PN type=del 2024-09-12T17:43:56.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.477+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=9YQTPJGGX1WF type=del size=1340072 2024-09-12T17:43:56.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.481+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~6L48GNGQMSDL.0 size=1048576 2024-09-12T17:43:56.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.485+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~6L48GNGQMSDL.1 size=1048576 2024-09-12T17:43:56.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.489+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~6L48GNGQMSDL.2 size=999162 2024-09-12T17:43:56.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.497+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=6L48GNGQMSDL tag=NX3MMMWK99Q2 type=write size=4144890 2024-09-12T17:43:56.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.501+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~NVC8SYLRSPCM.0 size=1048576 2024-09-12T17:43:56.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.505+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~NVC8SYLRSPCM.1 size=983999 2024-09-12T17:43:56.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.505+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=NVC8SYLRSPCM tag=ZBR5JK6XKRZF type=write size=3081151 2024-09-12T17:43:56.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.509+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=OVR1KLGV3DQS type=del 2024-09-12T17:43:56.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.513+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=6JQPQB02Q4GJ type=write size=721235 2024-09-12T17:43:56.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.517+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~MYAXJOTW246Q.0 size=1048576 2024-09-12T17:43:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.521+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~MYAXJOTW246Q.1 size=1048576 2024-09-12T17:43:56.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.521+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~MYAXJOTW246Q.2 size=289295 2024-09-12T17:43:56.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.529+0000 7f51d61a08c0 1 < completed multipart upload key=593CD3H40DFH upload=MYAXJOTW246Q tag=AAB8SP29XCNO type=write size=3435023 2024-09-12T17:43:56.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.533+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=K7HJ2VX5B9GB type=write size=483097 2024-09-12T17:43:56.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.537+0000 7f51d61a08c0 1 < canceled operation key=I22NJJISU96B tag=LU4BUXYD8B69 type=del size=2825716 2024-09-12T17:43:56.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.545+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~6BY4AX01A21O.0 size=1048576 2024-09-12T17:43:56.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.545+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~6BY4AX01A21O.1 size=1048576 2024-09-12T17:43:56.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.549+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~6BY4AX01A21O.2 size=946672 2024-09-12T17:43:56.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.549+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=6BY4AX01A21O tag=AXPJHPZHG8S3 type=write size=4092400 2024-09-12T17:43:56.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.553+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=DAVJMV1J2O80 type=del 2024-09-12T17:43:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.557+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=6W4AV6HZV2PO type=write size=517326 2024-09-12T17:43:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.561+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=0KB1UGFC389B type=del 2024-09-12T17:43:56.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.565+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=ROKQIC3FLX0P type=del size=200536 2024-09-12T17:43:56.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.569+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~TUKKEE5VHU3H.0 size=1048576 2024-09-12T17:43:56.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.573+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~TUKKEE5VHU3H.1 size=1048576 2024-09-12T17:43:56.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.577+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~TUKKEE5VHU3H.2 size=267502 2024-09-12T17:43:56.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.581+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=TUKKEE5VHU3H tag=NQDMCWX66TF8 type=write size=3413230 2024-09-12T17:43:56.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.589+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~GWA7ZY2K5IJH.0 size=22668 2024-09-12T17:43:56.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.589+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=GWA7ZY2K5IJH tag=2JUY0DY38C22 type=write size=1071244 2024-09-12T17:43:56.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.593+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~XHNH2LIAG3ML.0 size=1048576 2024-09-12T17:43:56.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.597+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~XHNH2LIAG3ML.1 size=395797 2024-09-12T17:43:56.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.605+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=XHNH2LIAG3ML tag=MFF14A5JPFEC type=write size=2492949 2024-09-12T17:43:56.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.609+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=JJ66DQTGI9JF type=write size=1004267 2024-09-12T17:43:56.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.613+0000 7f51d61a08c0 1 < completed write operation key=GCL7UJEJM1UV tag=LD7QX6176BG0 type=write size=463557 2024-09-12T17:43:56.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.621+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~AEOZX0TWSNH2.0 size=1048576 2024-09-12T17:43:56.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.621+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~AEOZX0TWSNH2.1 size=1048576 2024-09-12T17:43:56.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.625+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~AEOZX0TWSNH2.2 size=1030420 2024-09-12T17:43:56.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.625+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=AEOZX0TWSNH2 tag=J0VEDFHPE4U7 type=write size=4176148 2024-09-12T17:43:56.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.629+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=BJW51ZN43YMU type=del 2024-09-12T17:43:56.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.637+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~DTL8DUKTQDPC.0 size=1048576 2024-09-12T17:43:56.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.637+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~DTL8DUKTQDPC.1 size=1048576 2024-09-12T17:43:56.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.641+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~DTL8DUKTQDPC.2 size=202866 2024-09-12T17:43:56.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.641+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=DTL8DUKTQDPC tag=F5QMYCOFHN96 type=write size=3348594 2024-09-12T17:43:56.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.645+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~TRFD3JHOOSOM.0 size=1048576 2024-09-12T17:43:56.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.645+0000 7f51d61a08c0 1 < canceled part key=_multipart_83V7KSWRKFMZ.2~TRFD3JHOOSOM.1 size=1048576 2024-09-12T17:43:56.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.645+0000 7f51d61a08c0 1 < canceled part key=_multipart_83V7KSWRKFMZ.2~TRFD3JHOOSOM.2 size=226849 2024-09-12T17:43:56.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.653+0000 7f51d61a08c0 1 < canceled multipart upload key=83V7KSWRKFMZ upload=TRFD3JHOOSOM tag=831GRG3VIVOL type=write size=3372577 2024-09-12T17:43:56.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.657+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~OGKDEXY67BNB.0 size=1048576 2024-09-12T17:43:56.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.661+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~OGKDEXY67BNB.1 size=1048576 2024-09-12T17:43:56.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.665+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~OGKDEXY67BNB.2 size=440458 2024-09-12T17:43:56.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.665+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=OGKDEXY67BNB tag=T1HS3J2Y15CG type=write size=3586186 2024-09-12T17:43:56.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.673+0000 7f51d61a08c0 1 < suggested update operation key=JT373R4HAJZS tag=GBE3OA3FQQZO type=del size=1425190 2024-09-12T17:43:56.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.677+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=ZDRB43U8I6KI type=write size=1001575 2024-09-12T17:43:56.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.681+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=AUR4B3G0M6TU type=del 2024-09-12T17:43:56.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.685+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~MURILHBX2LPE.0 size=1048576 2024-09-12T17:43:56.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.689+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~MURILHBX2LPE.1 size=1048576 2024-09-12T17:43:56.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.693+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~MURILHBX2LPE.2 size=901388 2024-09-12T17:43:56.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.693+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=MURILHBX2LPE tag=OFK039O5OBM2 type=write size=4047116 2024-09-12T17:43:56.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.697+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=T2RGTN91BT7Z type=del 2024-09-12T17:43:56.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.701+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~GYSTF0LIHSIU.0 size=1048576 2024-09-12T17:43:56.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.705+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~GYSTF0LIHSIU.1 size=913169 2024-09-12T17:43:56.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.705+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=GYSTF0LIHSIU tag=13C1EWPA2FT0 type=write size=3010321 2024-09-12T17:43:56.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.709+0000 7f51d61a08c0 1 < canceled operation key=S292EX1P7IZA tag=ZPXW6MG1W0ZO type=del size=3671516 2024-09-12T17:43:56.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.717+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~OBGQMF4BM6Y1.0 size=1048576 2024-09-12T17:43:56.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.721+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~OBGQMF4BM6Y1.1 size=1048576 2024-09-12T17:43:56.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.721+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~OBGQMF4BM6Y1.2 size=60940 2024-09-12T17:43:56.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.721+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=OBGQMF4BM6Y1 tag=F8KMJQNF1AMF type=write size=3206668 2024-09-12T17:43:56.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.725+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=9YQTPJGGX1WF type=del 2024-09-12T17:43:56.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.729+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=SMA0DCKMS2TJ type=del size=1604594 2024-09-12T17:43:56.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.733+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~NVC8SYLRSPCM.0 size=1048576 2024-09-12T17:43:56.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.737+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~NVC8SYLRSPCM.1 size=983999 2024-09-12T17:43:56.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.745+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=NVC8SYLRSPCM tag=ZBR5JK6XKRZF type=write size=3081151 2024-09-12T17:43:56.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.749+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=SYIIY8UGE0B1 type=del size=1948071 2024-09-12T17:43:56.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.753+0000 7f51d61a08c0 -1 < failed to complete operation key=JT373R4HAJZS tag=6JQPQB02Q4GJ type=write size=721235: (22) Invalid argument 2024-09-12T17:43:56.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.753+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=52WIJ08Z2Y8U type=del size=350105 2024-09-12T17:43:56.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.761+0000 7f51d61a08c0 1 < suggested update operation key=FKKV7SXZSP90 tag=K7HJ2VX5B9GB type=write size=483097 2024-09-12T17:43:56.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.765+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=MLYONLTBX59A type=del size=3334272 2024-09-12T17:43:56.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.773+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~6BY4AX01A21O.0 size=1048576 2024-09-12T17:43:56.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.777+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~6BY4AX01A21O.1 size=1048576 2024-09-12T17:43:56.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.777+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~6BY4AX01A21O.2 size=946672 2024-09-12T17:43:56.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.785+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=6BY4AX01A21O tag=AXPJHPZHG8S3 type=write size=4092400 2024-09-12T17:43:56.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.789+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=ILP34L6CT85M type=del size=269720 2024-09-12T17:43:56.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.793+0000 7f51d61a08c0 1 < completed write operation key=ZCB4V47S38TN tag=6W4AV6HZV2PO type=write size=517326 2024-09-12T17:43:56.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.797+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=I2A7BMI0UC9U type=del size=196692 2024-09-12T17:43:56.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.801+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=ROKQIC3FLX0P type=del 2024-09-12T17:43:56.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.805+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=7XKWIRVSCDF6 type=del size=1884254 2024-09-12T17:43:56.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.809+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~GWA7ZY2K5IJH.0 size=22668 2024-09-12T17:43:56.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.813+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=GWA7ZY2K5IJH tag=2JUY0DY38C22 type=write size=1071244 2024-09-12T17:43:56.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.821+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~RJXMW3OZ28LX.0 size=1048576 2024-09-12T17:43:56.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.825+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~RJXMW3OZ28LX.1 size=1048576 2024-09-12T17:43:56.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.833+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~RJXMW3OZ28LX.2 size=966686 2024-09-12T17:43:56.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.833+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=RJXMW3OZ28LX tag=BUSYS7MZ5SCM type=write size=4112414 2024-09-12T17:43:56.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.837+0000 7f51d61a08c0 1 < completed write operation key=8J72KCZ5WRPU tag=JJ66DQTGI9JF type=write size=1004267 2024-09-12T17:43:56.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.845+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~SW3QB84W3HRW.0 size=1048576 2024-09-12T17:43:56.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.845+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~SW3QB84W3HRW.1 size=143701 2024-09-12T17:43:56.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.845+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=SW3QB84W3HRW tag=8MMLGGS337LX type=write size=2240853 2024-09-12T17:43:56.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.849+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~AEOZX0TWSNH2.0 size=1048576 2024-09-12T17:43:56.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.853+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~AEOZX0TWSNH2.1 size=1048576 2024-09-12T17:43:56.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.857+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~AEOZX0TWSNH2.2 size=1030420 2024-09-12T17:43:56.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.861+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=AEOZX0TWSNH2 tag=J0VEDFHPE4U7 type=write size=4176148 2024-09-12T17:43:56.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.865+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=IJQNBAJLMDQT type=write size=609054 2024-09-12T17:43:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.869+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~DTL8DUKTQDPC.0 size=1048576 2024-09-12T17:43:56.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.873+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~DTL8DUKTQDPC.1 size=1048576 2024-09-12T17:43:56.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.873+0000 7f51d61a08c0 1 < canceled part key=_multipart_10WBH16J1AF8.2~DTL8DUKTQDPC.2 size=202866 2024-09-12T17:43:56.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.877+0000 7f51d61a08c0 1 < canceled multipart upload key=10WBH16J1AF8 upload=DTL8DUKTQDPC tag=F5QMYCOFHN96 type=write size=3348594 2024-09-12T17:43:56.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.885+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~F84XPCO14TQQ.0 size=143410 2024-09-12T17:43:56.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.885+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=F84XPCO14TQQ tag=D38SBGM229WQ type=write size=1191986 2024-09-12T17:43:56.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.885+0000 7f51d61a08c0 1 < canceled part key=_multipart_8J72KCZ5WRPU.2~OGKDEXY67BNB.0 size=1048576 2024-09-12T17:43:56.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.885+0000 7f51d61a08c0 1 < canceled part key=_multipart_8J72KCZ5WRPU.2~OGKDEXY67BNB.1 size=1048576 2024-09-12T17:43:56.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.889+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~OGKDEXY67BNB.2 size=440458 2024-09-12T17:43:56.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.893+0000 7f51d61a08c0 1 < canceled multipart upload key=8J72KCZ5WRPU upload=OGKDEXY67BNB tag=T1HS3J2Y15CG type=write size=3586186 2024-09-12T17:43:56.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.901+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~7KU0BNRYY5OO.0 size=1048576 2024-09-12T17:43:56.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.905+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~7KU0BNRYY5OO.1 size=1048576 2024-09-12T17:43:56.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.909+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~7KU0BNRYY5OO.2 size=781232 2024-09-12T17:43:56.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.909+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=7KU0BNRYY5OO tag=1LSAIXOGLBC8 type=write size=3926960 2024-09-12T17:43:56.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.913+0000 7f51d61a08c0 1 < completed write operation key=1ZETSL5TXYSM tag=ZDRB43U8I6KI type=write size=1001575 2024-09-12T17:43:56.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.917+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~SGNYR8I3377H.0 size=1048576 2024-09-12T17:43:56.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.921+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~SGNYR8I3377H.1 size=1048576 2024-09-12T17:43:56.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.925+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~SGNYR8I3377H.2 size=554397 2024-09-12T17:43:56.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.925+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=SGNYR8I3377H tag=GTONLOEHHIFP type=write size=3700125 2024-09-12T17:43:56.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.929+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~MURILHBX2LPE.0 size=1048576 2024-09-12T17:43:56.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.929+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~MURILHBX2LPE.1 size=1048576 2024-09-12T17:43:56.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.929+0000 7f51d61a08c0 1 < canceled part key=_multipart_2WC0YDQFKAJD.2~MURILHBX2LPE.2 size=901388 2024-09-12T17:43:56.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.937+0000 7f51d61a08c0 1 < canceled multipart upload key=2WC0YDQFKAJD upload=MURILHBX2LPE tag=OFK039O5OBM2 type=write size=4047116 2024-09-12T17:43:56.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.945+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~A75F4EJDARFQ.0 size=1048576 2024-09-12T17:43:56.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.949+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~A75F4EJDARFQ.1 size=1048576 2024-09-12T17:43:56.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.949+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~A75F4EJDARFQ.2 size=600492 2024-09-12T17:43:56.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.949+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=A75F4EJDARFQ tag=S6ZUQZ6QHSM0 type=write size=3746220 2024-09-12T17:43:56.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.953+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~GYSTF0LIHSIU.0 size=1048576 2024-09-12T17:43:56.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.957+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~GYSTF0LIHSIU.1 size=913169 2024-09-12T17:43:56.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.965+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=GYSTF0LIHSIU tag=13C1EWPA2FT0 type=write size=3010321 2024-09-12T17:43:56.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.969+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=CDS161UGLJHL type=del size=2127196 2024-09-12T17:43:56.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.973+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~OBGQMF4BM6Y1.0 size=1048576 2024-09-12T17:43:56.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.973+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~OBGQMF4BM6Y1.1 size=1048576 2024-09-12T17:43:56.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.977+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~OBGQMF4BM6Y1.2 size=60940 2024-09-12T17:43:56.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.985+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=OBGQMF4BM6Y1 tag=F8KMJQNF1AMF type=write size=3206668 2024-09-12T17:43:56.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.985+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=DCZH9PX741A6 type=del size=3518676 2024-09-12T17:43:56.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.993+0000 7f51d61a08c0 1 < suggested update operation key=92CMI8Q29LB3 tag=SMA0DCKMS2TJ type=del size=1604594 2024-09-12T17:43:57.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:56.997+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=23EP8N8J3RW7 type=del size=1410260 2024-09-12T17:43:57.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.001+0000 7f51d61a08c0 1 < canceled operation key=8J72KCZ5WRPU tag=SYIIY8UGE0B1 type=del size=1948071 2024-09-12T17:43:57.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.009+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~X8LI3K1F96KG.0 size=1048576 2024-09-12T17:43:57.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.013+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~X8LI3K1F96KG.1 size=256781 2024-09-12T17:43:57.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.013+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=X8LI3K1F96KG tag=AEF9UU88XVV5 type=write size=2353933 2024-09-12T17:43:57.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.017+0000 7f51d61a08c0 1 < canceled operation key=XL9QDBTYSP7F tag=52WIJ08Z2Y8U type=del size=350105 2024-09-12T17:43:57.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.021+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=3FX2B5NRRHAW type=del size=3787542 2024-09-12T17:43:57.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.021+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=MLYONLTBX59A type=del 2024-09-12T17:43:57.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.029+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~CMXDNKPQ5U4Z.0 size=1048576 2024-09-12T17:43:57.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.033+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~CMXDNKPQ5U4Z.1 size=1048576 2024-09-12T17:43:57.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~CMXDNKPQ5U4Z.2 size=770995 2024-09-12T17:43:57.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.037+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=CMXDNKPQ5U4Z tag=CBILGVM7K385 type=write size=3916723 2024-09-12T17:43:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.041+0000 7f51d61a08c0 1 < canceled operation key=3LE20KMMPH8P tag=ILP34L6CT85M type=del size=269720 2024-09-12T17:43:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.045+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=15QE4F846Q5P type=del size=4184357 2024-09-12T17:43:57.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.049+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=I2A7BMI0UC9U type=del 2024-09-12T17:43:57.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.053+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~2HNTQRAGCPQC.0 size=1048576 2024-09-12T17:43:57.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.057+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~2HNTQRAGCPQC.1 size=950557 2024-09-12T17:43:57.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.057+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=2HNTQRAGCPQC tag=7BVWVMDXAQTX type=write size=3047709 2024-09-12T17:43:57.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.061+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=7XKWIRVSCDF6 type=del 2024-09-12T17:43:57.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.065+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=033JMXJASO7W type=del size=1864226 2024-09-12T17:43:57.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.069+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~RJXMW3OZ28LX.0 size=1048576 2024-09-12T17:43:57.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.073+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~RJXMW3OZ28LX.1 size=1048576 2024-09-12T17:43:57.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.073+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~RJXMW3OZ28LX.2 size=966686 2024-09-12T17:43:57.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.081+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=RJXMW3OZ28LX tag=BUSYS7MZ5SCM type=write size=4112414 2024-09-12T17:43:57.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.085+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~LNV4HW1LMMZ4.0 size=356977 2024-09-12T17:43:57.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.085+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=LNV4HW1LMMZ4 tag=8PRAHFTCGXMS type=write size=1405553 2024-09-12T17:43:57.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.089+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~SW3QB84W3HRW.0 size=1048576 2024-09-12T17:43:57.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.093+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~SW3QB84W3HRW.1 size=143701 2024-09-12T17:43:57.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.101+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=SW3QB84W3HRW tag=8MMLGGS337LX type=write size=2240853 2024-09-12T17:43:57.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.105+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=JXSTJAA1U323 type=del size=81461 2024-09-12T17:43:57.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.109+0000 7f51d61a08c0 1 < completed write operation key=DCLENF1A1W2Q tag=IJQNBAJLMDQT type=write size=609054 2024-09-12T17:43:57.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.113+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=7M923DZX3FDM type=del size=69049 2024-09-12T17:43:57.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.117+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~F84XPCO14TQQ.0 size=143410 2024-09-12T17:43:57.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.121+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=F84XPCO14TQQ tag=D38SBGM229WQ type=write size=1191986 2024-09-12T17:43:57.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.125+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=S2E003ZHA91Y type=del size=1032899 2024-09-12T17:43:57.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.129+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~7KU0BNRYY5OO.0 size=1048576 2024-09-12T17:43:57.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.133+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~7KU0BNRYY5OO.1 size=1048576 2024-09-12T17:43:57.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.133+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~7KU0BNRYY5OO.2 size=781232 2024-09-12T17:43:57.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.141+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=7KU0BNRYY5OO tag=1LSAIXOGLBC8 type=write size=3926960 2024-09-12T17:43:57.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.149+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~EHTMHU8EJL3F.0 size=1048576 2024-09-12T17:43:57.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.149+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~EHTMHU8EJL3F.1 size=1048576 2024-09-12T17:43:57.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.153+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~EHTMHU8EJL3F.2 size=70376 2024-09-12T17:43:57.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.153+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=EHTMHU8EJL3F tag=2NBOFVYSE0SX type=write size=3216104 2024-09-12T17:43:57.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.153+0000 7f51d61a08c0 1 < canceled part key=_multipart_10WBH16J1AF8.2~SGNYR8I3377H.0 size=1048576 2024-09-12T17:43:57.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.157+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~SGNYR8I3377H.1 size=1048576 2024-09-12T17:43:57.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.161+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~SGNYR8I3377H.2 size=554397 2024-09-12T17:43:57.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.169+0000 7f51d61a08c0 1 < canceled multipart upload key=10WBH16J1AF8 upload=SGNYR8I3377H tag=GTONLOEHHIFP type=write size=3700125 2024-09-12T17:43:57.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.173+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=L19DU4JY551O type=del size=2346919 2024-09-12T17:43:57.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.177+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~A75F4EJDARFQ.0 size=1048576 2024-09-12T17:43:57.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.185+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~A75F4EJDARFQ.1 size=1048576 2024-09-12T17:43:57.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.189+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~A75F4EJDARFQ.2 size=600492 2024-09-12T17:43:57.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.197+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=A75F4EJDARFQ tag=S6ZUQZ6QHSM0 type=write size=3746220 2024-09-12T17:43:57.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.201+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=KCJFCYTUG9N2 type=del size=3690102 2024-09-12T17:43:57.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.205+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=CDS161UGLJHL type=del 2024-09-12T17:43:57.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.205+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=PP85O36KUXDM type=del size=409651 2024-09-12T17:43:57.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.209+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=DCZH9PX741A6 type=del 2024-09-12T17:43:57.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.217+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~FG762QITI4PA.0 size=341456 2024-09-12T17:43:57.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.217+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=FG762QITI4PA tag=8AI8G1KA9KGU type=write size=1390032 2024-09-12T17:43:57.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.225+0000 7f51d61a08c0 1 < suggested update operation key=FKKV7SXZSP90 tag=23EP8N8J3RW7 type=del size=1410260 2024-09-12T17:43:57.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.233+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~J0UDTFKNEELP.0 size=1048576 2024-09-12T17:43:57.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.237+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~J0UDTFKNEELP.1 size=1048576 2024-09-12T17:43:57.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.237+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~J0UDTFKNEELP.2 size=317864 2024-09-12T17:43:57.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.237+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=J0UDTFKNEELP tag=MUYFORQVTWT4 type=write size=3463592 2024-09-12T17:43:57.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.241+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~X8LI3K1F96KG.0 size=1048576 2024-09-12T17:43:57.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.245+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~X8LI3K1F96KG.1 size=256781 2024-09-12T17:43:57.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.249+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=X8LI3K1F96KG tag=AEF9UU88XVV5 type=write size=2353933 2024-09-12T17:43:57.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.253+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=8QQZN73H0JLD type=del size=3792218 2024-09-12T17:43:57.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.261+0000 7f51d61a08c0 1 < suggested update operation key=83V7KSWRKFMZ tag=3FX2B5NRRHAW type=del size=3787542 2024-09-12T17:43:57.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.265+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=5CCYEV36PSH1 type=del size=3763836 2024-09-12T17:43:57.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.269+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~CMXDNKPQ5U4Z.0 size=1048576 2024-09-12T17:43:57.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.273+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~CMXDNKPQ5U4Z.1 size=1048576 2024-09-12T17:43:57.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.277+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~CMXDNKPQ5U4Z.2 size=770995 2024-09-12T17:43:57.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.281+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=CMXDNKPQ5U4Z tag=CBILGVM7K385 type=write size=3916723 2024-09-12T17:43:57.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.285+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=L46QMOYUDJTK type=write size=466444 2024-09-12T17:43:57.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.289+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=15QE4F846Q5P type=del 2024-09-12T17:43:57.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.293+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=3M3Q16Q38JPF type=del size=2266578 2024-09-12T17:43:57.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.297+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~2HNTQRAGCPQC.0 size=1048576 2024-09-12T17:43:57.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.301+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~2HNTQRAGCPQC.1 size=950557 2024-09-12T17:43:57.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.309+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=2HNTQRAGCPQC tag=7BVWVMDXAQTX type=write size=3047709 2024-09-12T17:43:57.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.309+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=BSLR99PIAG9H type=del size=2967554 2024-09-12T17:43:57.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.313+0000 7f51d61a08c0 1 < canceled operation key=BF36J1Q6CZFB tag=033JMXJASO7W type=del size=1864226 2024-09-12T17:43:57.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.321+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~86FRUC3FJ4E3.0 size=653297 2024-09-12T17:43:57.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.321+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=86FRUC3FJ4E3 tag=3UCCFVUTTJZY type=write size=1701873 2024-09-12T17:43:57.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.325+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~LNV4HW1LMMZ4.0 size=356977 2024-09-12T17:43:57.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.333+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=LNV4HW1LMMZ4 tag=8PRAHFTCGXMS type=write size=1405553 2024-09-12T17:43:57.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.337+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=S10EI0X2UO3Z type=del size=1684359 2024-09-12T17:43:57.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.345+0000 7f51d61a08c0 1 < suggested remove operation key=7FBK3439R80H tag=JXSTJAA1U323 type=del 2024-09-12T17:43:57.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.349+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=IWAG5ZRD3RN5 type=del size=730966 2024-09-12T17:43:57.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.353+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=7M923DZX3FDM type=del 2024-09-12T17:43:57.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.357+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=CD8MTGV7KHE7 type=write size=328299 2024-09-12T17:43:57.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.361+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=S2E003ZHA91Y type=del 2024-09-12T17:43:57.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.365+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=S2BHQADTBMOQ type=del size=402600 2024-09-12T17:43:57.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.369+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~EHTMHU8EJL3F.0 size=1048576 2024-09-12T17:43:57.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.373+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~EHTMHU8EJL3F.1 size=1048576 2024-09-12T17:43:57.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.377+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~EHTMHU8EJL3F.2 size=70376 2024-09-12T17:43:57.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.385+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=EHTMHU8EJL3F tag=2NBOFVYSE0SX type=write size=3216104 2024-09-12T17:43:57.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.393+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~GGH01HWUUC8M.0 size=1048576 2024-09-12T17:43:57.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.397+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~GGH01HWUUC8M.1 size=553211 2024-09-12T17:43:57.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.397+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=GGH01HWUUC8M tag=IJ70IYIP6WWO type=write size=2650363 2024-09-12T17:43:57.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.401+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=L19DU4JY551O type=del 2024-09-12T17:43:57.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.405+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=O347SVLOFNG3 type=write size=436588 2024-09-12T17:43:57.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.409+0000 7f51d61a08c0 1 < canceled operation key=HUWVRJIZ5JYE tag=KCJFCYTUG9N2 type=del size=3690102 2024-09-12T17:43:57.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.417+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~PSYJTSPUBR74.0 size=1048576 2024-09-12T17:43:57.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.417+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~PSYJTSPUBR74.1 size=1048576 2024-09-12T17:43:57.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.421+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~PSYJTSPUBR74.2 size=696602 2024-09-12T17:43:57.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.421+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=PSYJTSPUBR74 tag=CT3AWXLXE56V type=write size=3842330 2024-09-12T17:43:57.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.425+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=PP85O36KUXDM type=del 2024-09-12T17:43:57.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.429+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=8PNYP3JE1O0N type=del size=2171544 2024-09-12T17:43:57.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.433+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~FG762QITI4PA.0 size=341456 2024-09-12T17:43:57.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.441+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=FG762QITI4PA tag=8AI8G1KA9KGU type=write size=1390032 2024-09-12T17:43:57.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.445+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=5U00VO3OCFLS type=del size=3799238 2024-09-12T17:43:57.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.449+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~J0UDTFKNEELP.0 size=1048576 2024-09-12T17:43:57.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.453+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~J0UDTFKNEELP.1 size=1048576 2024-09-12T17:43:57.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.457+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~J0UDTFKNEELP.2 size=317864 2024-09-12T17:43:57.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.461+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=J0UDTFKNEELP tag=MUYFORQVTWT4 type=write size=3463592 2024-09-12T17:43:57.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.465+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=BHJO53U2B07W type=del size=2250722 2024-09-12T17:43:57.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.473+0000 7f51d61a08c0 1 < suggested remove operation key=S292EX1P7IZA tag=8QQZN73H0JLD type=del 2024-09-12T17:43:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.481+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~07OY4V1GE3DP.0 size=1048576 2024-09-12T17:43:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.485+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~07OY4V1GE3DP.1 size=690088 2024-09-12T17:43:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.485+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=07OY4V1GE3DP tag=90KVDTULQ9BV type=write size=2787240 2024-09-12T17:43:57.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.489+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=5CCYEV36PSH1 type=del 2024-09-12T17:43:57.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.493+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=ZPIABOC9P617 type=del size=2145411 2024-09-12T17:43:57.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.501+0000 7f51d61a08c0 1 < canceled operation key=JEXD4ZU5HJ2B tag=L46QMOYUDJTK type=write size=466444 2024-09-12T17:43:57.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.505+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=R4JQ4S2PK714 type=del size=1915642 2024-09-12T17:43:57.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.513+0000 7f51d61a08c0 1 < suggested update operation key=U3GZL9YPFMZY tag=3M3Q16Q38JPF type=del size=2266578 2024-09-12T17:43:57.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.517+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=LSL2DRXJGA1Y type=del size=231955 2024-09-12T17:43:57.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.521+0000 7f51d61a08c0 -1 < failed to complete operation key=7FBK3439R80H tag=BSLR99PIAG9H type=del size=2967554: (22) Invalid argument 2024-09-12T17:43:57.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.525+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=GG2LLBLH6BFT type=del size=1096845 2024-09-12T17:43:57.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.529+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~86FRUC3FJ4E3.0 size=653297 2024-09-12T17:43:57.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.537+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=86FRUC3FJ4E3 tag=3UCCFVUTTJZY type=write size=1701873 2024-09-12T17:43:57.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.541+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=SB634C3CDX9G type=del size=2891856 2024-09-12T17:43:57.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.545+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=S10EI0X2UO3Z type=del 2024-09-12T17:43:57.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.557+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=D6O6UKUO94MF type=del size=2508657 2024-09-12T17:43:57.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.561+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=IWAG5ZRD3RN5 type=del 2024-09-12T17:43:57.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.565+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=TELQBQEIFN83 type=write size=345921 2024-09-12T17:43:57.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.569+0000 7f51d61a08c0 1 < completed write operation key=HY2US2MMDNI4 tag=CD8MTGV7KHE7 type=write size=328299 2024-09-12T17:43:57.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.573+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=UHD9BVIQKHL2 type=del size=3759208 2024-09-12T17:43:57.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.581+0000 7f51d61a08c0 1 < suggested update operation key=NIQAUF085D97 tag=S2BHQADTBMOQ type=del size=402600 2024-09-12T17:43:57.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.585+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=9P2N21NQNQH0 type=write size=460540 2024-09-12T17:43:57.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.589+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~GGH01HWUUC8M.0 size=1048576 2024-09-12T17:43:57.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.589+0000 7f51d61a08c0 1 < canceled part key=_multipart_A7V478K2SNOF.2~GGH01HWUUC8M.1 size=553211 2024-09-12T17:43:57.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.593+0000 7f51d61a08c0 1 < canceled multipart upload key=A7V478K2SNOF upload=GGH01HWUUC8M tag=IJ70IYIP6WWO type=write size=2650363 2024-09-12T17:43:57.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.597+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=H5TAE4ZEL3WQ type=del size=3732778 2024-09-12T17:43:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.601+0000 7f51d61a08c0 1 < completed write operation key=DCLENF1A1W2Q tag=O347SVLOFNG3 type=write size=436588 2024-09-12T17:43:57.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.605+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=G83P0EXQCB0O type=del size=1895778 2024-09-12T17:43:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.609+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~PSYJTSPUBR74.0 size=1048576 2024-09-12T17:43:57.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.613+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~PSYJTSPUBR74.1 size=1048576 2024-09-12T17:43:57.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.617+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~PSYJTSPUBR74.2 size=696602 2024-09-12T17:43:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.621+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=PSYJTSPUBR74 tag=CT3AWXLXE56V type=write size=3842330 2024-09-12T17:43:57.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.625+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=QAP4A3ZRHB8T type=del size=3206134 2024-09-12T17:43:57.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.633+0000 7f51d61a08c0 1 < suggested remove operation key=JEXD4ZU5HJ2B tag=8PNYP3JE1O0N type=del 2024-09-12T17:43:57.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.637+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=75S0535I5OY2 type=del size=3770517 2024-09-12T17:43:57.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.641+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=5U00VO3OCFLS type=del 2024-09-12T17:43:57.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.649+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~TI5890S6C81A.0 size=1048576 2024-09-12T17:43:57.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.653+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~TI5890S6C81A.1 size=1048576 2024-09-12T17:43:57.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.657+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~TI5890S6C81A.2 size=56249 2024-09-12T17:43:57.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.657+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=TI5890S6C81A tag=THQQECIP2544 type=write size=3201977 2024-09-12T17:43:57.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.661+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=BHJO53U2B07W type=del 2024-09-12T17:43:57.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.669+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~71CRET5BC44D.0 size=504981 2024-09-12T17:43:57.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.669+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=71CRET5BC44D tag=J8GNCRGHLUZH type=write size=1553557 2024-09-12T17:43:57.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.669+0000 7f51d61a08c0 1 < canceled part key=_multipart_I22NJJISU96B.2~07OY4V1GE3DP.0 size=1048576 2024-09-12T17:43:57.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.673+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~07OY4V1GE3DP.1 size=690088 2024-09-12T17:43:57.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.681+0000 7f51d61a08c0 1 < canceled multipart upload key=I22NJJISU96B upload=07OY4V1GE3DP tag=90KVDTULQ9BV type=write size=2787240 2024-09-12T17:43:57.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.685+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=LY46AZOSRGNW type=del size=3362643 2024-09-12T17:43:57.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.693+0000 7f51d61a08c0 1 < suggested update operation key=ZCB4V47S38TN tag=ZPIABOC9P617 type=del size=2145411 2024-09-12T17:43:57.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.701+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~KLCD2NM5D61E.0 size=1048576 2024-09-12T17:43:57.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.701+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~KLCD2NM5D61E.1 size=1048576 2024-09-12T17:43:57.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.705+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~KLCD2NM5D61E.2 size=421576 2024-09-12T17:43:57.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.705+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=KLCD2NM5D61E tag=QU60R5WRE1HC type=write size=3567304 2024-09-12T17:43:57.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.709+0000 7f51d61a08c0 -1 < failed to complete operation key=U3GZL9YPFMZY tag=R4JQ4S2PK714 type=del size=1915642: (22) Invalid argument 2024-09-12T17:43:57.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.713+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=0B6GCCDGUENG type=del size=3934371 2024-09-12T17:43:57.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.717+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=LSL2DRXJGA1Y type=del 2024-09-12T17:43:57.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.721+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=48KLGCV6WAR2 type=del size=1289899 2024-09-12T17:43:57.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.725+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=GG2LLBLH6BFT type=del 2024-09-12T17:43:57.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.729+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=UWKKET7X76BG type=del size=2248525 2024-09-12T17:43:57.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.729+0000 7f51d61a08c0 -1 < failed to complete operation key=ZCB4V47S38TN tag=SB634C3CDX9G type=del size=2891856: (22) Invalid argument 2024-09-12T17:43:57.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.733+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=R7EO19VVY2U1 type=del size=2694287 2024-09-12T17:43:57.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.741+0000 7f51d61a08c0 1 < suggested update operation key=1ZETSL5TXYSM tag=D6O6UKUO94MF type=del size=2508657 2024-09-12T17:43:57.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.749+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~3U0Q9JJNA9IR.0 size=468513 2024-09-12T17:43:57.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.749+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=3U0Q9JJNA9IR tag=FB2B9H78GKD1 type=write size=1517089 2024-09-12T17:43:57.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.757+0000 7f51d61a08c0 1 < suggested remove operation key=2WC0YDQFKAJD tag=TELQBQEIFN83 type=write 2024-09-12T17:43:57.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.761+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=UADPZOGG9MGT type=del size=2227036 2024-09-12T17:43:57.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.765+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=UHD9BVIQKHL2 type=del 2024-09-12T17:43:57.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.769+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=1OJR147ZQXON type=del size=3639903 2024-09-12T17:43:57.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.777+0000 7f51d61a08c0 1 < completed write operation key=HY2US2MMDNI4 tag=9P2N21NQNQH0 type=write size=460540 2024-09-12T17:43:57.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.777+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=TSB7B6ULNW8E type=del size=1976866 2024-09-12T17:43:57.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.785+0000 7f51d61a08c0 1 < canceled operation key=GJX1YGAQFXZ2 tag=H5TAE4ZEL3WQ type=del size=3732778 2024-09-12T17:43:57.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.789+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~1Z77CCNEEHXG.0 size=1048576 2024-09-12T17:43:57.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.793+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~1Z77CCNEEHXG.1 size=1048576 2024-09-12T17:43:57.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.797+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~1Z77CCNEEHXG.2 size=255386 2024-09-12T17:43:57.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.797+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=1Z77CCNEEHXG tag=SALHAP02SBMX type=write size=3401114 2024-09-12T17:43:57.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.801+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=G83P0EXQCB0O type=del 2024-09-12T17:43:57.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.809+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~J0QAYFKI8I5U.0 size=1048576 2024-09-12T17:43:57.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.813+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~J0QAYFKI8I5U.1 size=184104 2024-09-12T17:43:57.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.813+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=J0QAYFKI8I5U tag=WRFNHJVGEVA6 type=write size=2281256 2024-09-12T17:43:57.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.817+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=QAP4A3ZRHB8T type=del 2024-09-12T17:43:57.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.821+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~GOWXNKNTBVTF.0 size=1048576 2024-09-12T17:43:57.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.825+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~GOWXNKNTBVTF.1 size=471742 2024-09-12T17:43:57.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.825+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=GOWXNKNTBVTF tag=QZ7R3O7EKNDX type=write size=2568894 2024-09-12T17:43:57.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.829+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=75S0535I5OY2 type=del 2024-09-12T17:43:57.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.837+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~2TN89RSEN27A.0 size=1048576 2024-09-12T17:43:57.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.841+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~2TN89RSEN27A.1 size=570539 2024-09-12T17:43:57.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.841+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=2TN89RSEN27A tag=EQ9XAHDLIGOT type=write size=2667691 2024-09-12T17:43:57.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.845+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~TI5890S6C81A.0 size=1048576 2024-09-12T17:43:57.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.845+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~TI5890S6C81A.1 size=1048576 2024-09-12T17:43:57.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.849+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~TI5890S6C81A.2 size=56249 2024-09-12T17:43:57.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.857+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=TI5890S6C81A tag=THQQECIP2544 type=write size=3201977 2024-09-12T17:43:57.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.861+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~KH2JR0L979KA.0 size=1048576 2024-09-12T17:43:57.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.865+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~KH2JR0L979KA.1 size=1048576 2024-09-12T17:43:57.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.869+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~KH2JR0L979KA.2 size=796559 2024-09-12T17:43:57.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.869+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=KH2JR0L979KA tag=DTN8CGHPJVIH type=write size=3942287 2024-09-12T17:43:57.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.873+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~71CRET5BC44D.0 size=504981 2024-09-12T17:43:57.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.877+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=71CRET5BC44D tag=J8GNCRGHLUZH type=write size=1553557 2024-09-12T17:43:57.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.881+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=4PF0MZ02WXGO type=del size=2527822 2024-09-12T17:43:57.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.885+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=LY46AZOSRGNW type=del 2024-09-12T17:43:57.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.889+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=1OX2EUDQNKQK type=del size=1953739 2024-09-12T17:43:57.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.893+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~KLCD2NM5D61E.0 size=1048576 2024-09-12T17:43:57.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.897+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~KLCD2NM5D61E.1 size=1048576 2024-09-12T17:43:57.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.897+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~KLCD2NM5D61E.2 size=421576 2024-09-12T17:43:57.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.905+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=KLCD2NM5D61E tag=QU60R5WRE1HC type=write size=3567304 2024-09-12T17:43:57.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.909+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~GCH9VML35WQ2.0 size=1048576 2024-09-12T17:43:57.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.913+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~GCH9VML35WQ2.1 size=359101 2024-09-12T17:43:57.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.913+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=GCH9VML35WQ2 tag=Z9OCBFHSROIW type=write size=2456253 2024-09-12T17:43:57.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.925+0000 7f51d61a08c0 1 < suggested remove operation key=83V7KSWRKFMZ tag=0B6GCCDGUENG type=del 2024-09-12T17:43:57.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.929+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=S19QP05SNYYZ type=write size=528848 2024-09-12T17:43:57.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.933+0000 7f51d61a08c0 1 < canceled operation key=10WBH16J1AF8 tag=48KLGCV6WAR2 type=del size=1289899 2024-09-12T17:43:57.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.937+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=875H6EFHC27P type=del size=668210 2024-09-12T17:43:57.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.941+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=UWKKET7X76BG type=del 2024-09-12T17:43:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.945+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=ADVJKDM86BDU type=del size=3504632 2024-09-12T17:43:57.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.953+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=R7EO19VVY2U1 type=del 2024-09-12T17:43:57.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.961+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~KI4YD72D55F0.0 size=472893 2024-09-12T17:43:57.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.961+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=KI4YD72D55F0 tag=NHLYIQBTRHQ9 type=write size=1521469 2024-09-12T17:43:57.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.965+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~3U0Q9JJNA9IR.0 size=468513 2024-09-12T17:43:57.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.969+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=3U0Q9JJNA9IR tag=FB2B9H78GKD1 type=write size=1517089 2024-09-12T17:43:57.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.977+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=2C27Y7P95UZ0 type=del size=2750242 2024-09-12T17:43:57.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.981+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=UADPZOGG9MGT type=del 2024-09-12T17:43:57.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.985+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=E7ZXY151OOLI type=write size=333180 2024-09-12T17:43:57.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.989+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=1OJR147ZQXON type=del 2024-09-12T17:43:57.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.993+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=K0TTMAT3TMGE type=write size=979055 2024-09-12T17:43:58.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:57.997+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=TSB7B6ULNW8E type=del 2024-09-12T17:43:58.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.005+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~2CTWC1V1RQET.0 size=1048576 2024-09-12T17:43:58.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.009+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~2CTWC1V1RQET.1 size=1048576 2024-09-12T17:43:58.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.009+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~2CTWC1V1RQET.2 size=887288 2024-09-12T17:43:58.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.009+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=2CTWC1V1RQET tag=AS7ZOGQ7XMRK type=write size=4033016 2024-09-12T17:43:58.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.013+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~1Z77CCNEEHXG.0 size=1048576 2024-09-12T17:43:58.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.017+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~1Z77CCNEEHXG.1 size=1048576 2024-09-12T17:43:58.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.021+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~1Z77CCNEEHXG.2 size=255386 2024-09-12T17:43:58.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.025+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=1Z77CCNEEHXG tag=SALHAP02SBMX type=write size=3401114 2024-09-12T17:43:58.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.033+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~7AIB5JIYRUEV.0 size=1048576 2024-09-12T17:43:58.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~7AIB5JIYRUEV.1 size=293885 2024-09-12T17:43:58.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.037+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=7AIB5JIYRUEV tag=JLYPZP6C62MU type=write size=2391037 2024-09-12T17:43:58.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.041+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~J0QAYFKI8I5U.0 size=1048576 2024-09-12T17:43:58.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.041+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~J0QAYFKI8I5U.1 size=184104 2024-09-12T17:43:58.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.049+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=J0QAYFKI8I5U tag=WRFNHJVGEVA6 type=write size=2281256 2024-09-12T17:43:58.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.053+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=1CB73NWHUWMV type=write size=970444 2024-09-12T17:43:58.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.053+0000 7f51d61a08c0 1 < canceled part key=_multipart_HY2US2MMDNI4.2~GOWXNKNTBVTF.0 size=1048576 2024-09-12T17:43:58.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.057+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~GOWXNKNTBVTF.1 size=471742 2024-09-12T17:43:58.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.061+0000 7f51d61a08c0 1 < canceled multipart upload key=HY2US2MMDNI4 upload=GOWXNKNTBVTF tag=QZ7R3O7EKNDX type=write size=2568894 2024-09-12T17:43:58.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.069+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~LNP9LBHW3L0L.0 size=1048576 2024-09-12T17:43:58.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.073+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~LNP9LBHW3L0L.1 size=648178 2024-09-12T17:43:58.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.073+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=LNP9LBHW3L0L tag=2WH4FCLRRIKR type=write size=2745330 2024-09-12T17:43:58.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.077+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~2TN89RSEN27A.0 size=1048576 2024-09-12T17:43:58.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.081+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~2TN89RSEN27A.1 size=570539 2024-09-12T17:43:58.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.085+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=2TN89RSEN27A tag=EQ9XAHDLIGOT type=write size=2667691 2024-09-12T17:43:58.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.089+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=XTUIZZ4MKAU1 type=write size=524067 2024-09-12T17:43:58.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.093+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~KH2JR0L979KA.0 size=1048576 2024-09-12T17:43:58.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.097+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~KH2JR0L979KA.1 size=1048576 2024-09-12T17:43:58.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.101+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~KH2JR0L979KA.2 size=796559 2024-09-12T17:43:58.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.105+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=KH2JR0L979KA tag=DTN8CGHPJVIH type=write size=3942287 2024-09-12T17:43:58.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.109+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=O6OV6JL8YBSC type=del size=1509061 2024-09-12T17:43:58.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.117+0000 7f51d61a08c0 1 < suggested update operation key=96OWZQXI2ALM tag=4PF0MZ02WXGO type=del size=2527822 2024-09-12T17:43:58.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.125+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~Q8TGDT1T4HCR.0 size=1048576 2024-09-12T17:43:58.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.129+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~Q8TGDT1T4HCR.1 size=511846 2024-09-12T17:43:58.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.129+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=Q8TGDT1T4HCR tag=WTKIOH9P58CF type=write size=2608998 2024-09-12T17:43:58.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.133+0000 7f51d61a08c0 1 < canceled operation key=SSOA6J297L1C tag=1OX2EUDQNKQK type=del size=1953739 2024-09-12T17:43:58.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.141+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~COMRM9YYGHIU.0 size=849951 2024-09-12T17:43:58.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.141+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=COMRM9YYGHIU tag=CNCQ570IB290 type=write size=1898527 2024-09-12T17:43:58.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.145+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~GCH9VML35WQ2.0 size=1048576 2024-09-12T17:43:58.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.145+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~GCH9VML35WQ2.1 size=359101 2024-09-12T17:43:58.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.153+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=GCH9VML35WQ2 tag=Z9OCBFHSROIW type=write size=2456253 2024-09-12T17:43:58.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.157+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=QR3YPC8FUCHA type=write size=876098 2024-09-12T17:43:58.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.161+0000 7f51d61a08c0 1 < completed write operation key=593CD3H40DFH tag=S19QP05SNYYZ type=write size=528848 2024-09-12T17:43:58.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.165+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=91KU71CGO6VN type=del size=2140064 2024-09-12T17:43:58.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.169+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=875H6EFHC27P type=del 2024-09-12T17:43:58.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.173+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~JW8XROYGEL12.0 size=1207 2024-09-12T17:43:58.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.173+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=JW8XROYGEL12 tag=BFYZU0U92758 type=write size=1049783 2024-09-12T17:43:58.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.177+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=ADVJKDM86BDU type=del 2024-09-12T17:43:58.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.181+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=0WT57P12WN0C type=del size=3749443 2024-09-12T17:43:58.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.181+0000 7f51d61a08c0 1 < canceled part key=_multipart_HUWVRJIZ5JYE.2~KI4YD72D55F0.0 size=472893 2024-09-12T17:43:58.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.189+0000 7f51d61a08c0 1 < canceled multipart upload key=HUWVRJIZ5JYE upload=KI4YD72D55F0 tag=NHLYIQBTRHQ9 type=write size=1521469 2024-09-12T17:43:58.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.193+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=RS329GQ8L0BH type=del size=3935863 2024-09-12T17:43:58.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.197+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=2C27Y7P95UZ0 type=del 2024-09-12T17:43:58.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.201+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=YKUYBLLRB064 type=del size=2030259 2024-09-12T17:43:58.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.205+0000 7f51d61a08c0 1 < completed write operation key=26X723PN8K8T tag=E7ZXY151OOLI type=write size=333180 2024-09-12T17:43:58.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.209+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=DNCJI66PSYF1 type=del size=4113248 2024-09-12T17:43:58.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.213+0000 7f51d61a08c0 1 < canceled operation key=V5KMBUNVQA0H tag=K0TTMAT3TMGE type=write size=979055 2024-09-12T17:43:58.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.217+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~AJCTXR1MLWGK.0 size=1048576 2024-09-12T17:43:58.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.221+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~AJCTXR1MLWGK.1 size=406962 2024-09-12T17:43:58.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.221+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=AJCTXR1MLWGK tag=6YIXU8G1E2NY type=write size=2504114 2024-09-12T17:43:58.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.225+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~2CTWC1V1RQET.0 size=1048576 2024-09-12T17:43:58.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.229+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~2CTWC1V1RQET.1 size=1048576 2024-09-12T17:43:58.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.233+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~2CTWC1V1RQET.2 size=887288 2024-09-12T17:43:58.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.237+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=2CTWC1V1RQET tag=AS7ZOGQ7XMRK type=write size=4033016 2024-09-12T17:43:58.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.241+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=L5DMSX52OPA8 type=del size=1577665 2024-09-12T17:43:58.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.245+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~7AIB5JIYRUEV.0 size=1048576 2024-09-12T17:43:58.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.253+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~7AIB5JIYRUEV.1 size=293885 2024-09-12T17:43:58.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.253+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=7AIB5JIYRUEV tag=JLYPZP6C62MU type=write size=2391037 2024-09-12T17:43:58.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.261+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~SYHDQWX6XYBQ.0 size=1048576 2024-09-12T17:43:58.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.265+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~SYHDQWX6XYBQ.1 size=1048576 2024-09-12T17:43:58.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.269+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~SYHDQWX6XYBQ.2 size=107249 2024-09-12T17:43:58.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.269+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=SYHDQWX6XYBQ tag=XH3O9IQ22QP6 type=write size=3252977 2024-09-12T17:43:58.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.273+0000 7f51d61a08c0 1 < completed write operation key=83V7KSWRKFMZ tag=1CB73NWHUWMV type=write size=970444 2024-09-12T17:43:58.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.285+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~SL7211GZKBMY.0 size=1048576 2024-09-12T17:43:58.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.285+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~SL7211GZKBMY.1 size=1048576 2024-09-12T17:43:58.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.289+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~SL7211GZKBMY.2 size=228051 2024-09-12T17:43:58.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.289+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=SL7211GZKBMY tag=J5BDW1Z9IR5I type=write size=3373779 2024-09-12T17:43:58.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.293+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~LNP9LBHW3L0L.0 size=1048576 2024-09-12T17:43:58.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.297+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~LNP9LBHW3L0L.1 size=648178 2024-09-12T17:43:58.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.301+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=LNP9LBHW3L0L tag=2WH4FCLRRIKR type=write size=2745330 2024-09-12T17:43:58.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.305+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=1EDNIBEW867T type=del size=3831308 2024-09-12T17:43:58.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.309+0000 7f51d61a08c0 1 < completed write operation key=1ZETSL5TXYSM tag=XTUIZZ4MKAU1 type=write size=524067 2024-09-12T17:43:58.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.313+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=5ANH39ZVXDLY type=del size=3932360 2024-09-12T17:43:58.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.317+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=O6OV6JL8YBSC type=del 2024-09-12T17:43:58.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.321+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=OU4JGB7HDGP3 type=del size=1491351 2024-09-12T17:43:58.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.325+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~Q8TGDT1T4HCR.0 size=1048576 2024-09-12T17:43:58.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.329+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~Q8TGDT1T4HCR.1 size=511846 2024-09-12T17:43:58.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.333+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=Q8TGDT1T4HCR tag=WTKIOH9P58CF type=write size=2608998 2024-09-12T17:43:58.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.337+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=UKPQ5SWIH69M type=del size=431394 2024-09-12T17:43:58.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.341+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~COMRM9YYGHIU.0 size=849951 2024-09-12T17:43:58.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.345+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=COMRM9YYGHIU tag=CNCQ570IB290 type=write size=1898527 2024-09-12T17:43:58.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.349+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=9WLZGUE9LVYI type=del size=1065832 2024-09-12T17:43:58.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.353+0000 7f51d61a08c0 1 < completed write operation key=IWEJXLG1CDAV tag=QR3YPC8FUCHA type=write size=876098 2024-09-12T17:43:58.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.357+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=WJ29SYYS6ULI type=del size=3387660 2024-09-12T17:43:58.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.365+0000 7f51d61a08c0 1 < suggested update operation key=HUWVRJIZ5JYE tag=91KU71CGO6VN type=del size=2140064 2024-09-12T17:43:58.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.369+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=7Q9CNEN9CNGP type=del size=910503 2024-09-12T17:43:58.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.373+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~JW8XROYGEL12.0 size=1207 2024-09-12T17:43:58.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.381+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=JW8XROYGEL12 tag=BFYZU0U92758 type=write size=1049783 2024-09-12T17:43:58.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.385+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~T2OJ3TZCC6AA.0 size=9988 2024-09-12T17:43:58.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.385+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=T2OJ3TZCC6AA tag=DEWS7H5JC5EA type=write size=1058564 2024-09-12T17:43:58.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.389+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=0WT57P12WN0C type=del 2024-09-12T17:43:58.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.397+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~JYNP3GS38IK8.0 size=1048576 2024-09-12T17:43:58.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.401+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~JYNP3GS38IK8.1 size=1048576 2024-09-12T17:43:58.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.401+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~JYNP3GS38IK8.2 size=726831 2024-09-12T17:43:58.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.401+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=JYNP3GS38IK8 tag=80WT911AJJV2 type=write size=3872559 2024-09-12T17:43:58.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.405+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=RS329GQ8L0BH type=del 2024-09-12T17:43:58.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.409+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=ZFF73HJYR3BY type=del size=1667818 2024-09-12T17:43:58.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.413+0000 7f51d61a08c0 1 < canceled operation key=ZCB4V47S38TN tag=YKUYBLLRB064 type=del size=2030259 2024-09-12T17:43:58.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.417+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=AZVNL7Q016BM type=del size=7622 2024-09-12T17:43:58.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.421+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=DNCJI66PSYF1 type=del 2024-09-12T17:43:58.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.429+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~9RB2BL4728G8.0 size=651600 2024-09-12T17:43:58.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.429+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=9RB2BL4728G8 tag=CTJM9HKT3KKU type=write size=1700176 2024-09-12T17:43:58.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.433+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~AJCTXR1MLWGK.0 size=1048576 2024-09-12T17:43:58.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.437+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~AJCTXR1MLWGK.1 size=406962 2024-09-12T17:43:58.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.441+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=AJCTXR1MLWGK tag=6YIXU8G1E2NY type=write size=2504114 2024-09-12T17:43:58.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.449+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~GNVIAUGNOSS4.0 size=1004431 2024-09-12T17:43:58.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.449+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=GNVIAUGNOSS4 tag=QW1DITMU0YLM type=write size=2053007 2024-09-12T17:43:58.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.453+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=L5DMSX52OPA8 type=del 2024-09-12T17:43:58.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.457+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=CBNVCJMMM3AQ type=del size=3345945 2024-09-12T17:43:58.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.461+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~SYHDQWX6XYBQ.0 size=1048576 2024-09-12T17:43:58.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.465+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~SYHDQWX6XYBQ.1 size=1048576 2024-09-12T17:43:58.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.469+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~SYHDQWX6XYBQ.2 size=107249 2024-09-12T17:43:58.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.473+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=SYHDQWX6XYBQ tag=XH3O9IQ22QP6 type=write size=3252977 2024-09-12T17:43:58.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.477+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=AAI23R9DMAJW type=del size=3542612 2024-09-12T17:43:58.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.481+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~SL7211GZKBMY.0 size=1048576 2024-09-12T17:43:58.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.481+0000 7f51d61a08c0 1 < canceled part key=_multipart_HUWVRJIZ5JYE.2~SL7211GZKBMY.1 size=1048576 2024-09-12T17:43:58.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.485+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~SL7211GZKBMY.2 size=228051 2024-09-12T17:43:58.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.489+0000 7f51d61a08c0 1 < canceled multipart upload key=HUWVRJIZ5JYE upload=SL7211GZKBMY tag=J5BDW1Z9IR5I type=write size=3373779 2024-09-12T17:43:58.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.497+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~HS1PYDOIMD22.0 size=1048576 2024-09-12T17:43:58.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.501+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~HS1PYDOIMD22.1 size=294336 2024-09-12T17:43:58.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.501+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=HS1PYDOIMD22 tag=4SIAHJNVECT9 type=write size=2391488 2024-09-12T17:43:58.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.509+0000 7f51d61a08c0 1 < suggested remove operation key=1ZETSL5TXYSM tag=1EDNIBEW867T type=del 2024-09-12T17:43:58.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.513+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=0HUH7F8TJZXH type=del size=2384193 2024-09-12T17:43:58.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.517+0000 7f51d61a08c0 1 < canceled operation key=IWEJXLG1CDAV tag=5ANH39ZVXDLY type=del size=3932360 2024-09-12T17:43:58.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.521+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=CC4YYGLOV0PE type=del size=3525495 2024-09-12T17:43:58.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.529+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=OU4JGB7HDGP3 type=del 2024-09-12T17:43:58.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.533+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=FB4YQDE2ELLT type=del size=2427677 2024-09-12T17:43:58.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.537+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=UKPQ5SWIH69M type=del 2024-09-12T17:43:58.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.541+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=3A30NKYRCM64 type=del size=1091692 2024-09-12T17:43:58.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.545+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=9WLZGUE9LVYI type=del 2024-09-12T17:43:58.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.549+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=PT9P20WXH78A type=del size=3048384 2024-09-12T17:43:58.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.553+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=WJ29SYYS6ULI type=del 2024-09-12T17:43:58.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.561+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~XJS7JTUB4KUB.0 size=1048576 2024-09-12T17:43:58.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.565+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~XJS7JTUB4KUB.1 size=58261 2024-09-12T17:43:58.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.565+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=XJS7JTUB4KUB tag=8XCI0PHEN6N1 type=write size=2155413 2024-09-12T17:43:58.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.569+0000 7f51d61a08c0 1 < canceled operation key=3LE20KMMPH8P tag=7Q9CNEN9CNGP type=del size=910503 2024-09-12T17:43:58.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.573+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=ZI6URMCUZS5R type=del size=3581900 2024-09-12T17:43:58.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.577+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~T2OJ3TZCC6AA.0 size=9988 2024-09-12T17:43:58.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.585+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=T2OJ3TZCC6AA tag=DEWS7H5JC5EA type=write size=1058564 2024-09-12T17:43:58.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.593+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~QB17K29VRW69.0 size=650348 2024-09-12T17:43:58.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.593+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=QB17K29VRW69 tag=0IBNB5EX19I0 type=write size=1698924 2024-09-12T17:43:58.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.597+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~JYNP3GS38IK8.0 size=1048576 2024-09-12T17:43:58.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.597+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~JYNP3GS38IK8.1 size=1048576 2024-09-12T17:43:58.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.601+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~JYNP3GS38IK8.2 size=726831 2024-09-12T17:43:58.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.613+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=JYNP3GS38IK8 tag=80WT911AJJV2 type=write size=3872559 2024-09-12T17:43:58.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.613+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=37CBRC8NPBHR type=del size=1230807 2024-09-12T17:43:58.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.617+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=ZFF73HJYR3BY type=del 2024-09-12T17:43:58.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.621+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=MK2RLFKSEA98 type=del size=167146 2024-09-12T17:43:58.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.629+0000 7f51d61a08c0 -1 < failed to complete operation key=1ZETSL5TXYSM tag=AZVNL7Q016BM type=del size=7622: (22) Invalid argument 2024-09-12T17:43:58.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.633+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=303XSYLLANFJ type=del size=2959814 2024-09-12T17:43:58.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.637+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~9RB2BL4728G8.0 size=651600 2024-09-12T17:43:58.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.641+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=9RB2BL4728G8 tag=CTJM9HKT3KKU type=write size=1700176 2024-09-12T17:43:58.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.649+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=MPVK5HKBSCJ3 type=write size=50536 2024-09-12T17:43:58.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.657+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~GNVIAUGNOSS4.0 size=1004431 2024-09-12T17:43:58.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.661+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=GNVIAUGNOSS4 tag=QW1DITMU0YLM type=write size=2053007 2024-09-12T17:43:58.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.665+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=VRR0LFAH7S25 type=del size=212395 2024-09-12T17:43:58.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.669+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=CBNVCJMMM3AQ type=del 2024-09-12T17:43:58.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.673+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=YLQOCS97TR4S type=del size=205492 2024-09-12T17:43:58.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.677+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=AAI23R9DMAJW type=del 2024-09-12T17:43:58.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.681+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=I8IE4ZF1W45P type=del size=3608826 2024-09-12T17:43:58.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.685+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~HS1PYDOIMD22.0 size=1048576 2024-09-12T17:43:58.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.689+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~HS1PYDOIMD22.1 size=294336 2024-09-12T17:43:58.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.693+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=HS1PYDOIMD22 tag=4SIAHJNVECT9 type=write size=2391488 2024-09-12T17:43:58.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.701+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~8OXAG85NI2XR.0 size=163638 2024-09-12T17:43:58.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.701+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=8OXAG85NI2XR tag=91UJJPSO9TTB type=write size=1212214 2024-09-12T17:43:58.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.705+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=0HUH7F8TJZXH type=del 2024-09-12T17:43:58.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.713+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~CZCXYBXJCGFG.0 size=1048576 2024-09-12T17:43:58.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.717+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~CZCXYBXJCGFG.1 size=1048576 2024-09-12T17:43:58.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.717+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~CZCXYBXJCGFG.2 size=299661 2024-09-12T17:43:58.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.717+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=CZCXYBXJCGFG tag=N1J18OCGMKLP type=write size=3445389 2024-09-12T17:43:58.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.721+0000 7f51d61a08c0 1 < canceled operation key=X6KC9Z6LD7VG tag=CC4YYGLOV0PE type=del size=3525495 2024-09-12T17:43:58.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.729+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~4NSBTSCOXEBO.0 size=917107 2024-09-12T17:43:58.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.729+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=4NSBTSCOXEBO tag=PCZFJAR8QBVX type=write size=1965683 2024-09-12T17:43:58.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.733+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=FB4YQDE2ELLT type=del 2024-09-12T17:43:58.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.737+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=USN9DM950IY1 type=del size=4133462 2024-09-12T17:43:58.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.741+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=3A30NKYRCM64 type=del 2024-09-12T17:43:58.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.749+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~ZKPSBY1M2JMF.0 size=113932 2024-09-12T17:43:58.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.749+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=ZKPSBY1M2JMF tag=OYSLTRVOZ7LV type=write size=1162508 2024-09-12T17:43:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.753+0000 7f51d61a08c0 1 < suggested update operation key=A7V478K2SNOF tag=PT9P20WXH78A type=del size=3048384 2024-09-12T17:43:58.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.761+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~QDG8DNASPL32.0 size=1048576 2024-09-12T17:43:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.765+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~QDG8DNASPL32.1 size=1048576 2024-09-12T17:43:58.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.765+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~QDG8DNASPL32.2 size=692694 2024-09-12T17:43:58.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.765+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=QDG8DNASPL32 tag=ZUBTR1YUA1GK type=write size=3838422 2024-09-12T17:43:58.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.769+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~XJS7JTUB4KUB.0 size=1048576 2024-09-12T17:43:58.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.773+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~XJS7JTUB4KUB.1 size=58261 2024-09-12T17:43:58.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.781+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=XJS7JTUB4KUB tag=8XCI0PHEN6N1 type=write size=2155413 2024-09-12T17:43:58.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.785+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~X139K67D86AB.0 size=471399 2024-09-12T17:43:58.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.785+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=X139K67D86AB tag=AMHS44U7VQRI type=write size=1519975 2024-09-12T17:43:58.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.789+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=ZI6URMCUZS5R type=del 2024-09-12T17:43:58.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.793+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=FWB0XYWO9L97 type=del size=164502 2024-09-12T17:43:58.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.797+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~QB17K29VRW69.0 size=650348 2024-09-12T17:43:58.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.805+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=QB17K29VRW69 tag=0IBNB5EX19I0 type=write size=1698924 2024-09-12T17:43:58.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.813+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~NR0F6SY8PZ0S.0 size=1048576 2024-09-12T17:43:58.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.813+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~NR0F6SY8PZ0S.1 size=1048576 2024-09-12T17:43:58.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.817+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~NR0F6SY8PZ0S.2 size=266327 2024-09-12T17:43:58.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.817+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=NR0F6SY8PZ0S tag=EK6V75YN3K72 type=write size=3412055 2024-09-12T17:43:58.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.821+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=37CBRC8NPBHR type=del 2024-09-12T17:43:58.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.825+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=CJIG6X8N8O93 type=del size=2438050 2024-09-12T17:43:58.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.829+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=MK2RLFKSEA98 type=del 2024-09-12T17:43:58.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.833+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~GFE07SAJLWRV.0 size=1048576 2024-09-12T17:43:58.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.837+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~GFE07SAJLWRV.1 size=648407 2024-09-12T17:43:58.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.837+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=GFE07SAJLWRV tag=6F15GORWSKPX type=write size=2745559 2024-09-12T17:43:58.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.845+0000 7f51d61a08c0 1 < suggested remove operation key=U3GZL9YPFMZY tag=303XSYLLANFJ type=del 2024-09-12T17:43:58.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.853+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~7ZBI016ZS8GB.0 size=964376 2024-09-12T17:43:58.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.853+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=7ZBI016ZS8GB tag=U7GLH8J09791 type=write size=2012952 2024-09-12T17:43:58.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.857+0000 7f51d61a08c0 1 < completed write operation key=26X723PN8K8T tag=MPVK5HKBSCJ3 type=write size=50536 2024-09-12T17:43:58.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.865+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~QPIKR9SQ2UMV.0 size=2238 2024-09-12T17:43:58.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.865+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=QPIKR9SQ2UMV tag=1ZS8SWBUXX5H type=write size=1050814 2024-09-12T17:43:58.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.869+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=VRR0LFAH7S25 type=del 2024-09-12T17:43:58.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.873+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~I9W7XR5DJ215.0 size=1048576 2024-09-12T17:43:58.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.877+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~I9W7XR5DJ215.1 size=19418 2024-09-12T17:43:58.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.877+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=I9W7XR5DJ215 tag=3B9QXU8OEJRE type=write size=2116570 2024-09-12T17:43:58.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.881+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=YLQOCS97TR4S type=del 2024-09-12T17:43:58.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.885+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=GYPLN90M8APK type=del size=254585 2024-09-12T17:43:58.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.893+0000 7f51d61a08c0 1 < suggested update operation key=DCLENF1A1W2Q tag=I8IE4ZF1W45P type=del size=3608826 2024-09-12T17:43:58.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.901+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~K7CU329DR2OD.0 size=476161 2024-09-12T17:43:58.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.901+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=K7CU329DR2OD tag=0OPPAU6T55KH type=write size=1524737 2024-09-12T17:43:58.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.905+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~8OXAG85NI2XR.0 size=163638 2024-09-12T17:43:58.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.909+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=8OXAG85NI2XR tag=91UJJPSO9TTB type=write size=1212214 2024-09-12T17:43:58.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.913+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=PCUZKLPF5QEX type=del size=3436464 2024-09-12T17:43:58.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.917+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~CZCXYBXJCGFG.0 size=1048576 2024-09-12T17:43:58.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.921+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~CZCXYBXJCGFG.1 size=1048576 2024-09-12T17:43:58.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.921+0000 7f51d61a08c0 1 < canceled part key=_multipart_FKKV7SXZSP90.2~CZCXYBXJCGFG.2 size=299661 2024-09-12T17:43:58.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.925+0000 7f51d61a08c0 1 < canceled multipart upload key=FKKV7SXZSP90 upload=CZCXYBXJCGFG tag=N1J18OCGMKLP type=write size=3445389 2024-09-12T17:43:58.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.933+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~0YT0WZNMCZKH.0 size=1048576 2024-09-12T17:43:58.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.937+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~0YT0WZNMCZKH.1 size=1048576 2024-09-12T17:43:58.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.941+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~0YT0WZNMCZKH.2 size=1006395 2024-09-12T17:43:58.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.941+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=0YT0WZNMCZKH tag=LB93RSEYMSSU type=write size=4152123 2024-09-12T17:43:58.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.945+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~4NSBTSCOXEBO.0 size=917107 2024-09-12T17:43:58.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.949+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=4NSBTSCOXEBO tag=PCZFJAR8QBVX type=write size=1965683 2024-09-12T17:43:58.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.953+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=7VJ8NO91XNHI type=write size=476480 2024-09-12T17:43:58.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.957+0000 7f51d61a08c0 -1 < failed to complete operation key=DCLENF1A1W2Q tag=USN9DM950IY1 type=del size=4133462: (22) Invalid argument 2024-09-12T17:43:58.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.961+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=NI7V35EFP47O type=del size=2384666 2024-09-12T17:43:58.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.965+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~ZKPSBY1M2JMF.0 size=113932 2024-09-12T17:43:58.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.973+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=ZKPSBY1M2JMF tag=OYSLTRVOZ7LV type=write size=1162508 2024-09-12T17:43:58.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.977+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=1CR8ETSC16ZJ type=del size=1594887 2024-09-12T17:43:58.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.981+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~QDG8DNASPL32.0 size=1048576 2024-09-12T17:43:58.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.981+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~QDG8DNASPL32.1 size=1048576 2024-09-12T17:43:58.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.985+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~QDG8DNASPL32.2 size=692694 2024-09-12T17:43:58.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.993+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=QDG8DNASPL32 tag=ZUBTR1YUA1GK type=write size=3838422 2024-09-12T17:43:58.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:58.997+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=Y2HE7BLNEY2P type=write size=138566 2024-09-12T17:43:59.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.001+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~X139K67D86AB.0 size=471399 2024-09-12T17:43:59.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.013+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=X139K67D86AB tag=AMHS44U7VQRI type=write size=1519975 2024-09-12T17:43:59.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.013+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=XW00R9G5X9HV type=write size=772787 2024-09-12T17:43:59.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.017+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=FWB0XYWO9L97 type=del 2024-09-12T17:43:59.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.021+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=YY6MP298HR6F type=write size=473251 2024-09-12T17:43:59.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.025+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~NR0F6SY8PZ0S.0 size=1048576 2024-09-12T17:43:59.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.029+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~NR0F6SY8PZ0S.1 size=1048576 2024-09-12T17:43:59.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.033+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~NR0F6SY8PZ0S.2 size=266327 2024-09-12T17:43:59.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.037+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=NR0F6SY8PZ0S tag=EK6V75YN3K72 type=write size=3412055 2024-09-12T17:43:59.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.041+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=IKVXPT53HWTS type=del size=20542 2024-09-12T17:43:59.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.049+0000 7f51d61a08c0 1 < suggested update operation key=SSOA6J297L1C tag=CJIG6X8N8O93 type=del size=2438050 2024-09-12T17:43:59.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.053+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=1N4OG6Y0SM16 type=del size=2041097 2024-09-12T17:43:59.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.057+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~GFE07SAJLWRV.0 size=1048576 2024-09-12T17:43:59.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.057+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~GFE07SAJLWRV.1 size=648407 2024-09-12T17:43:59.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.065+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=GFE07SAJLWRV tag=6F15GORWSKPX type=write size=2745559 2024-09-12T17:43:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.069+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=832T2R81H4ZI type=del size=3201278 2024-09-12T17:43:59.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.073+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~7ZBI016ZS8GB.0 size=964376 2024-09-12T17:43:59.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.077+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=7ZBI016ZS8GB tag=U7GLH8J09791 type=write size=2012952 2024-09-12T17:43:59.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.081+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=K6G2VP1UUJCR type=del size=1043755 2024-09-12T17:43:59.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.085+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~QPIKR9SQ2UMV.0 size=2238 2024-09-12T17:43:59.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.093+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=QPIKR9SQ2UMV tag=1ZS8SWBUXX5H type=write size=1050814 2024-09-12T17:43:59.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.097+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=PHJAUNJ574YF type=del size=2199658 2024-09-12T17:43:59.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.097+0000 7f51d61a08c0 1 < canceled part key=_multipart_EDVAEE9FKH1T.2~I9W7XR5DJ215.0 size=1048576 2024-09-12T17:43:59.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.101+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~I9W7XR5DJ215.1 size=19418 2024-09-12T17:43:59.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.105+0000 7f51d61a08c0 1 < canceled multipart upload key=EDVAEE9FKH1T upload=I9W7XR5DJ215 tag=3B9QXU8OEJRE type=write size=2116570 2024-09-12T17:43:59.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.109+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=L5QZGD7HWDAX type=del size=3511662 2024-09-12T17:43:59.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.113+0000 7f51d61a08c0 1 < canceled operation key=2WC0YDQFKAJD tag=GYPLN90M8APK type=del size=254585 2024-09-12T17:43:59.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.121+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~RK68OA2RD6IU.0 size=1030489 2024-09-12T17:43:59.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.121+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=RK68OA2RD6IU tag=13WUUZ1E2HN6 type=write size=2079065 2024-09-12T17:43:59.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.125+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~K7CU329DR2OD.0 size=476161 2024-09-12T17:43:59.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.129+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=K7CU329DR2OD tag=0OPPAU6T55KH type=write size=1524737 2024-09-12T17:43:59.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.133+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=NYY22RV17U4Q type=write size=748718 2024-09-12T17:43:59.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.137+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=PCUZKLPF5QEX type=del 2024-09-12T17:43:59.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.141+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=DAVPMFFT9OU8 type=del size=1725241 2024-09-12T17:43:59.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.145+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~0YT0WZNMCZKH.0 size=1048576 2024-09-12T17:43:59.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.149+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~0YT0WZNMCZKH.1 size=1048576 2024-09-12T17:43:59.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.149+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~0YT0WZNMCZKH.2 size=1006395 2024-09-12T17:43:59.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.157+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=0YT0WZNMCZKH tag=LB93RSEYMSSU type=write size=4152123 2024-09-12T17:43:59.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.161+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=18GY219OG0L6 type=del size=1904947 2024-09-12T17:43:59.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.165+0000 7f51d61a08c0 1 < completed write operation key=EDVAEE9FKH1T tag=7VJ8NO91XNHI type=write size=476480 2024-09-12T17:43:59.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.169+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~0WKX33P2INIA.0 size=1048576 2024-09-12T17:43:59.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.173+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~0WKX33P2INIA.1 size=1048576 2024-09-12T17:43:59.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.177+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~0WKX33P2INIA.2 size=140537 2024-09-12T17:43:59.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.177+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=0WKX33P2INIA tag=LOZEIETY10DH type=write size=3286265 2024-09-12T17:43:59.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.181+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=NI7V35EFP47O type=del 2024-09-12T17:43:59.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.181+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=08Q7R39DQ8M1 type=del size=122769 2024-09-12T17:43:59.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.189+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=1CR8ETSC16ZJ type=del 2024-09-12T17:43:59.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.189+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=JYJ0FJX6SIWL type=del size=3801454 2024-09-12T17:43:59.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.193+0000 7f51d61a08c0 1 < canceled operation key=8J72KCZ5WRPU tag=Y2HE7BLNEY2P type=write size=138566 2024-09-12T17:43:59.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.197+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=61BMIJZCJNEL type=del size=1381294 2024-09-12T17:43:59.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.205+0000 7f51d61a08c0 1 < suggested update operation key=10WBH16J1AF8 tag=XW00R9G5X9HV type=write size=772787 2024-09-12T17:43:59.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.209+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=Z4X8YH1L1VED type=del size=2713967 2024-09-12T17:43:59.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.217+0000 7f51d61a08c0 1 < completed write operation key=EDVAEE9FKH1T tag=YY6MP298HR6F type=write size=473251 2024-09-12T17:43:59.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.217+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=GE9MEGNT395B type=write size=941393 2024-09-12T17:43:59.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.225+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=IKVXPT53HWTS type=del 2024-09-12T17:43:59.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.229+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=YX3H3ZGR9GBV type=del size=434152 2024-09-12T17:43:59.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.233+0000 7f51d61a08c0 1 < suggested remove operation key=2WC0YDQFKAJD tag=1N4OG6Y0SM16 type=del 2024-09-12T17:43:59.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.237+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=0R7OZF1GYMPE type=del size=878897 2024-09-12T17:43:59.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.241+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=832T2R81H4ZI type=del 2024-09-12T17:43:59.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.249+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~G60J8J9ZOWV0.0 size=1048576 2024-09-12T17:43:59.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.253+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~G60J8J9ZOWV0.1 size=1048576 2024-09-12T17:43:59.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.257+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~G60J8J9ZOWV0.2 size=1035508 2024-09-12T17:43:59.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.257+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=G60J8J9ZOWV0 tag=V9OL98NPF7ZU type=write size=4181236 2024-09-12T17:43:59.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.261+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=K6G2VP1UUJCR type=del 2024-09-12T17:43:59.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.265+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=FR1Z6YM6549B type=del size=1410450 2024-09-12T17:43:59.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.269+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=PHJAUNJ574YF type=del 2024-09-12T17:43:59.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.273+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=ZV93MO253BNL type=write size=564509 2024-09-12T17:43:59.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.277+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=L5QZGD7HWDAX type=del 2024-09-12T17:43:59.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.281+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=4V79V6Y00X71 type=del size=915823 2024-09-12T17:43:59.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.285+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~RK68OA2RD6IU.0 size=1030489 2024-09-12T17:43:59.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.289+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=RK68OA2RD6IU tag=13WUUZ1E2HN6 type=write size=2079065 2024-09-12T17:43:59.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.293+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=D22O1E60GQSP type=del size=80166 2024-09-12T17:43:59.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.297+0000 7f51d61a08c0 1 < completed write operation key=ZCB4V47S38TN tag=NYY22RV17U4Q type=write size=748718 2024-09-12T17:43:59.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.305+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~5QUVD5JQC9JI.0 size=1048576 2024-09-12T17:43:59.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.309+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~5QUVD5JQC9JI.1 size=1048576 2024-09-12T17:43:59.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.313+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~5QUVD5JQC9JI.2 size=988033 2024-09-12T17:43:59.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.313+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=5QUVD5JQC9JI tag=V5VKIERV5OUZ type=write size=4133761 2024-09-12T17:43:59.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.317+0000 7f51d61a08c0 1 < canceled operation key=NIQAUF085D97 tag=DAVPMFFT9OU8 type=del size=1725241 2024-09-12T17:43:59.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.321+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=BF9KTH7CU1OO type=del size=3482080 2024-09-12T17:43:59.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.325+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=18GY219OG0L6 type=del 2024-09-12T17:43:59.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.329+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=Z1TSFUFTYRPT type=del size=1173763 2024-09-12T17:43:59.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.333+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~0WKX33P2INIA.0 size=1048576 2024-09-12T17:43:59.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.333+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~0WKX33P2INIA.1 size=1048576 2024-09-12T17:43:59.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.337+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~0WKX33P2INIA.2 size=140537 2024-09-12T17:43:59.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.345+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=0WKX33P2INIA tag=LOZEIETY10DH type=write size=3286265 2024-09-12T17:43:59.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.349+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=4C98OQ92XZWM type=write size=273071 2024-09-12T17:43:59.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.353+0000 7f51d61a08c0 1 < canceled operation key=IWEJXLG1CDAV tag=08Q7R39DQ8M1 type=del size=122769 2024-09-12T17:43:59.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.361+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~Z1BXKUA7ZCZK.0 size=1048576 2024-09-12T17:43:59.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.369+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~Z1BXKUA7ZCZK.1 size=614956 2024-09-12T17:43:59.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.369+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=Z1BXKUA7ZCZK tag=V7BU85XPZMBY type=write size=2712108 2024-09-12T17:43:59.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.373+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=JYJ0FJX6SIWL type=del 2024-09-12T17:43:59.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.377+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~1IMVE8KC16HI.0 size=1048576 2024-09-12T17:43:59.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.381+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~1IMVE8KC16HI.1 size=1048576 2024-09-12T17:43:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.385+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~1IMVE8KC16HI.2 size=694549 2024-09-12T17:43:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.385+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=1IMVE8KC16HI tag=40PSVITRHH0Y type=write size=3840277 2024-09-12T17:43:59.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.389+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=61BMIJZCJNEL type=del 2024-09-12T17:43:59.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.397+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~50WUW192281D.0 size=282996 2024-09-12T17:43:59.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.397+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=50WUW192281D tag=5SX9T6LOYMG7 type=write size=1331572 2024-09-12T17:43:59.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.401+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=Z4X8YH1L1VED type=del 2024-09-12T17:43:59.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.405+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~KMH8QAKO1DE7.0 size=993749 2024-09-12T17:43:59.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.405+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=KMH8QAKO1DE7 tag=QFDDRCYYFZBB type=write size=2042325 2024-09-12T17:43:59.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.409+0000 7f51d61a08c0 1 < completed write operation key=EDVAEE9FKH1T tag=GE9MEGNT395B type=write size=941393 2024-09-12T17:43:59.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.417+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~U36X7967C6CY.0 size=1048576 2024-09-12T17:43:59.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.421+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~U36X7967C6CY.1 size=835917 2024-09-12T17:43:59.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.421+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=U36X7967C6CY tag=37V0JQZ2222H type=write size=2933069 2024-09-12T17:43:59.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.429+0000 7f51d61a08c0 1 < suggested update operation key=JT373R4HAJZS tag=YX3H3ZGR9GBV type=del size=434152 2024-09-12T17:43:59.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.437+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~FKJ0C4QTIMCJ.0 size=1048576 2024-09-12T17:43:59.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.437+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~FKJ0C4QTIMCJ.1 size=326837 2024-09-12T17:43:59.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.437+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=FKJ0C4QTIMCJ tag=5UAWLNYXMQWD type=write size=2423989 2024-09-12T17:43:59.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.445+0000 7f51d61a08c0 1 < suggested update operation key=BF36J1Q6CZFB tag=0R7OZF1GYMPE type=del size=878897 2024-09-12T17:43:59.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.453+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~ZRAWHXADOC6I.0 size=1048576 2024-09-12T17:43:59.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.457+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~ZRAWHXADOC6I.1 size=474103 2024-09-12T17:43:59.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.457+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=ZRAWHXADOC6I tag=MP18CIVS9DYI type=write size=2571255 2024-09-12T17:43:59.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.461+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~G60J8J9ZOWV0.0 size=1048576 2024-09-12T17:43:59.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.465+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~G60J8J9ZOWV0.1 size=1048576 2024-09-12T17:43:59.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.465+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~G60J8J9ZOWV0.2 size=1035508 2024-09-12T17:43:59.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.473+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=G60J8J9ZOWV0 tag=V9OL98NPF7ZU type=write size=4181236 2024-09-12T17:43:59.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.477+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=PCCDCQJTHDML type=del size=1330467 2024-09-12T17:43:59.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.481+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=FR1Z6YM6549B type=del 2024-09-12T17:43:59.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.485+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=PPF2LAAY3GFF type=del size=2927427 2024-09-12T17:43:59.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.489+0000 7f51d61a08c0 1 < completed write operation key=HY2US2MMDNI4 tag=ZV93MO253BNL type=write size=564509 2024-09-12T17:43:59.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.493+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=5KKAVHF3J71M type=del size=118956 2024-09-12T17:43:59.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.497+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=4V79V6Y00X71 type=del 2024-09-12T17:43:59.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.505+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~ADVU5QOPK8P7.0 size=1048576 2024-09-12T17:43:59.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.505+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~ADVU5QOPK8P7.1 size=375186 2024-09-12T17:43:59.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.505+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=ADVU5QOPK8P7 tag=RIBPEGXL4YZN type=write size=2472338 2024-09-12T17:43:59.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.509+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=D22O1E60GQSP type=del 2024-09-12T17:43:59.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.513+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=WH3C9G2N4P01 type=write size=464275 2024-09-12T17:43:59.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.517+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~5QUVD5JQC9JI.0 size=1048576 2024-09-12T17:43:59.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.521+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~5QUVD5JQC9JI.1 size=1048576 2024-09-12T17:43:59.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.525+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~5QUVD5JQC9JI.2 size=988033 2024-09-12T17:43:59.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.529+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=5QUVD5JQC9JI tag=V5VKIERV5OUZ type=write size=4133761 2024-09-12T17:43:59.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.537+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~9YKJJG1RM10D.0 size=1048576 2024-09-12T17:43:59.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.541+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~9YKJJG1RM10D.1 size=370140 2024-09-12T17:43:59.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.541+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=9YKJJG1RM10D tag=D4XREP1Q4U09 type=write size=2467292 2024-09-12T17:43:59.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.545+0000 7f51d61a08c0 1 < completed delete operation key=3LE20KMMPH8P tag=BF9KTH7CU1OO type=del 2024-09-12T17:43:59.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.549+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=LL079S9PHW04 type=del size=36211 2024-09-12T17:43:59.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.553+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=Z1TSFUFTYRPT type=del 2024-09-12T17:43:59.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.557+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=G22A55ECXPJM type=del size=2469929 2024-09-12T17:43:59.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.561+0000 7f51d61a08c0 1 < completed write operation key=92CMI8Q29LB3 tag=4C98OQ92XZWM type=write size=273071 2024-09-12T17:43:59.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.565+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~TAAIBBKXVZCB.0 size=1048576 2024-09-12T17:43:59.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.569+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~TAAIBBKXVZCB.1 size=1048576 2024-09-12T17:43:59.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.573+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~TAAIBBKXVZCB.2 size=593597 2024-09-12T17:43:59.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.573+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=TAAIBBKXVZCB tag=U34C6U8NAA03 type=write size=3739325 2024-09-12T17:43:59.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.577+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~Z1BXKUA7ZCZK.0 size=1048576 2024-09-12T17:43:59.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.581+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~Z1BXKUA7ZCZK.1 size=614956 2024-09-12T17:43:59.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.585+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=Z1BXKUA7ZCZK tag=V7BU85XPZMBY type=write size=2712108 2024-09-12T17:43:59.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.589+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~INXW40SKRAX7.0 size=147926 2024-09-12T17:43:59.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.589+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=INXW40SKRAX7 tag=6RIL3MQZ6T7R type=write size=1196502 2024-09-12T17:43:59.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.593+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~1IMVE8KC16HI.0 size=1048576 2024-09-12T17:43:59.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.597+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~1IMVE8KC16HI.1 size=1048576 2024-09-12T17:43:59.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.601+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~1IMVE8KC16HI.2 size=694549 2024-09-12T17:43:59.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.605+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=1IMVE8KC16HI tag=40PSVITRHH0Y type=write size=3840277 2024-09-12T17:43:59.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.609+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=AAJP2DHAC3QJ type=write size=204750 2024-09-12T17:43:59.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.613+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~50WUW192281D.0 size=282996 2024-09-12T17:43:59.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.621+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=50WUW192281D tag=5SX9T6LOYMG7 type=write size=1331572 2024-09-12T17:43:59.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.629+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~6HTRTOSD16Y1.0 size=1048576 2024-09-12T17:43:59.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.629+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~6HTRTOSD16Y1.1 size=745504 2024-09-12T17:43:59.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.629+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=6HTRTOSD16Y1 tag=WW5ZOBBE6QBF type=write size=2842656 2024-09-12T17:43:59.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.637+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~KMH8QAKO1DE7.0 size=993749 2024-09-12T17:43:59.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.641+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=KMH8QAKO1DE7 tag=QFDDRCYYFZBB type=write size=2042325 2024-09-12T17:43:59.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.645+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=EPKIMPJU2QQJ type=del size=1248643 2024-09-12T17:43:59.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.649+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~U36X7967C6CY.0 size=1048576 2024-09-12T17:43:59.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.649+0000 7f51d61a08c0 1 < canceled part key=_multipart_GJX1YGAQFXZ2.2~U36X7967C6CY.1 size=835917 2024-09-12T17:43:59.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.657+0000 7f51d61a08c0 1 < canceled multipart upload key=GJX1YGAQFXZ2 upload=U36X7967C6CY tag=37V0JQZ2222H type=write size=2933069 2024-09-12T17:43:59.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.661+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=IPBCES2F3S68 type=write size=820324 2024-09-12T17:43:59.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.665+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~FKJ0C4QTIMCJ.0 size=1048576 2024-09-12T17:43:59.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.665+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~FKJ0C4QTIMCJ.1 size=326837 2024-09-12T17:43:59.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.673+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=FKJ0C4QTIMCJ tag=5UAWLNYXMQWD type=write size=2423989 2024-09-12T17:43:59.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.681+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~9HUPLIHL8YNK.0 size=1048576 2024-09-12T17:43:59.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.681+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~9HUPLIHL8YNK.1 size=1048576 2024-09-12T17:43:59.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.685+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~9HUPLIHL8YNK.2 size=662717 2024-09-12T17:43:59.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.685+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=9HUPLIHL8YNK tag=YV8CWG13ZKFL type=write size=3808445 2024-09-12T17:43:59.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.689+0000 7f51d61a08c0 1 < canceled part key=_multipart_X6KC9Z6LD7VG.2~ZRAWHXADOC6I.0 size=1048576 2024-09-12T17:43:59.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.689+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~ZRAWHXADOC6I.1 size=474103 2024-09-12T17:43:59.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.697+0000 7f51d61a08c0 1 < canceled multipart upload key=X6KC9Z6LD7VG upload=ZRAWHXADOC6I tag=MP18CIVS9DYI type=write size=2571255 2024-09-12T17:43:59.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.701+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=W2OA0SXNRL6D type=del size=2936810 2024-09-12T17:43:59.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.709+0000 7f51d61a08c0 1 < suggested update operation key=S292EX1P7IZA tag=PCCDCQJTHDML type=del size=1330467 2024-09-12T17:43:59.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.721+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~15XZRG5GMZYL.0 size=1048576 2024-09-12T17:43:59.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.725+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~15XZRG5GMZYL.1 size=1048576 2024-09-12T17:43:59.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.729+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~15XZRG5GMZYL.2 size=694297 2024-09-12T17:43:59.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.729+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=15XZRG5GMZYL tag=8Z78OMZULMJ2 type=write size=3840025 2024-09-12T17:43:59.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.733+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=PPF2LAAY3GFF type=del 2024-09-12T17:43:59.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.737+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~UGYDVSJU50X2.0 size=943606 2024-09-12T17:43:59.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.737+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=UGYDVSJU50X2 tag=DT8WP73CVHAN type=write size=1992182 2024-09-12T17:43:59.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.745+0000 7f51d61a08c0 1 < suggested remove operation key=8J72KCZ5WRPU tag=5KKAVHF3J71M type=del 2024-09-12T17:43:59.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.753+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~32R800F3GQEX.0 size=1048576 2024-09-12T17:43:59.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.757+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~32R800F3GQEX.1 size=772251 2024-09-12T17:43:59.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.757+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=32R800F3GQEX tag=BWWOR7XTPYVN type=write size=2869403 2024-09-12T17:43:59.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.761+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~ADVU5QOPK8P7.0 size=1048576 2024-09-12T17:43:59.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.765+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~ADVU5QOPK8P7.1 size=375186 2024-09-12T17:43:59.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.773+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=ADVU5QOPK8P7 tag=RIBPEGXL4YZN type=write size=2472338 2024-09-12T17:43:59.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.777+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=SXY2RHBCZDUW type=del size=5110 2024-09-12T17:43:59.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.781+0000 7f51d61a08c0 1 < completed write operation key=1ZETSL5TXYSM tag=WH3C9G2N4P01 type=write size=464275 2024-09-12T17:43:59.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.785+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=LAK1BETRXIFE type=del size=150459 2024-09-12T17:43:59.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.789+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~9YKJJG1RM10D.0 size=1048576 2024-09-12T17:43:59.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.793+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~9YKJJG1RM10D.1 size=370140 2024-09-12T17:43:59.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.801+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=9YKJJG1RM10D tag=D4XREP1Q4U09 type=write size=2467292 2024-09-12T17:43:59.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.805+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=PDLPE8AYNEGZ type=write size=993235 2024-09-12T17:43:59.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.813+0000 7f51d61a08c0 1 < suggested remove operation key=JEXD4ZU5HJ2B tag=LL079S9PHW04 type=del 2024-09-12T17:43:59.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.821+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=MIRV0JTEZAOJ type=del size=2890211 2024-09-12T17:43:59.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.825+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=G22A55ECXPJM type=del 2024-09-12T17:43:59.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.829+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=QSA50L26FRST type=del size=1557772 2024-09-12T17:43:59.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.833+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~TAAIBBKXVZCB.0 size=1048576 2024-09-12T17:43:59.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.837+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~TAAIBBKXVZCB.1 size=1048576 2024-09-12T17:43:59.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.837+0000 7f51d61a08c0 1 < canceled part key=_multipart_JEXD4ZU5HJ2B.2~TAAIBBKXVZCB.2 size=593597 2024-09-12T17:43:59.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.845+0000 7f51d61a08c0 1 < canceled multipart upload key=JEXD4ZU5HJ2B upload=TAAIBBKXVZCB tag=U34C6U8NAA03 type=write size=3739325 2024-09-12T17:43:59.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.849+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=XIZYMB0CUIG7 type=del size=1788264 2024-09-12T17:43:59.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.853+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~INXW40SKRAX7.0 size=147926 2024-09-12T17:43:59.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.857+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=INXW40SKRAX7 tag=6RIL3MQZ6T7R type=write size=1196502 2024-09-12T17:43:59.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.861+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=QOUBST4SEXYW type=del size=999371 2024-09-12T17:43:59.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.865+0000 7f51d61a08c0 1 < completed write operation key=10WBH16J1AF8 tag=AAJP2DHAC3QJ type=write size=204750 2024-09-12T17:43:59.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.873+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=NYGYO2WQ7SQU type=del size=3269923 2024-09-12T17:43:59.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.877+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~6HTRTOSD16Y1.0 size=1048576 2024-09-12T17:43:59.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.877+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~6HTRTOSD16Y1.1 size=745504 2024-09-12T17:43:59.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.885+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=6HTRTOSD16Y1 tag=WW5ZOBBE6QBF type=write size=2842656 2024-09-12T17:43:59.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.889+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=XQPPQ1OE1VYW type=write size=992598 2024-09-12T17:43:59.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.893+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=EPKIMPJU2QQJ type=del 2024-09-12T17:43:59.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.897+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=XUYH9WK7BDO2 type=del size=3798760 2024-09-12T17:43:59.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.901+0000 7f51d61a08c0 1 < suggested remove operation key=S292EX1P7IZA tag=IPBCES2F3S68 type=write 2024-09-12T17:43:59.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.905+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=EWZQNX1TSAU8 type=del size=1394340 2024-09-12T17:43:59.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.909+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~9HUPLIHL8YNK.0 size=1048576 2024-09-12T17:43:59.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.913+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~9HUPLIHL8YNK.1 size=1048576 2024-09-12T17:43:59.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.917+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~9HUPLIHL8YNK.2 size=662717 2024-09-12T17:43:59.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.925+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=9HUPLIHL8YNK tag=YV8CWG13ZKFL type=write size=3808445 2024-09-12T17:43:59.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.929+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~DM5QSFAOCMOC.0 size=1048576 2024-09-12T17:43:59.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.933+0000 7f51d61a08c0 1 > prepared part key=_multipart_8J72KCZ5WRPU.2~DM5QSFAOCMOC.1 size=1028440 2024-09-12T17:43:59.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.933+0000 7f51d61a08c0 1 > prepared multipart upload key=8J72KCZ5WRPU upload=DM5QSFAOCMOC tag=51PNR0M2700Z type=write size=3125592 2024-09-12T17:43:59.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.937+0000 7f51d61a08c0 -1 < failed to complete operation key=JEXD4ZU5HJ2B tag=W2OA0SXNRL6D type=del size=2936810: (22) Invalid argument 2024-09-12T17:43:59.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.941+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=H3Q6L9NNM3L1 type=del size=2038746 2024-09-12T17:43:59.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.945+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~15XZRG5GMZYL.0 size=1048576 2024-09-12T17:43:59.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.949+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~15XZRG5GMZYL.1 size=1048576 2024-09-12T17:43:59.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.953+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~15XZRG5GMZYL.2 size=694297 2024-09-12T17:43:59.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.957+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=15XZRG5GMZYL tag=8Z78OMZULMJ2 type=write size=3840025 2024-09-12T17:43:59.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.965+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~YS5383MFJERM.0 size=626808 2024-09-12T17:43:59.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.965+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=YS5383MFJERM tag=S27I4LLGWQO0 type=write size=1675384 2024-09-12T17:43:59.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.969+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~UGYDVSJU50X2.0 size=943606 2024-09-12T17:43:59.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.977+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=UGYDVSJU50X2 tag=DT8WP73CVHAN type=write size=1992182 2024-09-12T17:43:59.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.981+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=P1VBIY7TH8ZX type=del size=2901169 2024-09-12T17:43:59.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.985+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~32R800F3GQEX.0 size=1048576 2024-09-12T17:43:59.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.985+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~32R800F3GQEX.1 size=772251 2024-09-12T17:43:59.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:43:59.993+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=32R800F3GQEX tag=BWWOR7XTPYVN type=write size=2869403 2024-09-12T17:44:00.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.001+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~I9YAET8N3U2A.0 size=1048576 2024-09-12T17:44:00.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.005+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~I9YAET8N3U2A.1 size=41427 2024-09-12T17:44:00.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.005+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=I9YAET8N3U2A tag=BZGO55QL93YL type=write size=2138579 2024-09-12T17:44:00.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.009+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=SXY2RHBCZDUW type=del 2024-09-12T17:44:00.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.013+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=I0MRKEF5AH6C type=del size=1275339 2024-09-12T17:44:00.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.017+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=LAK1BETRXIFE type=del 2024-09-12T17:44:00.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.021+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=2EA59TGAHYHG type=del size=3019356 2024-09-12T17:44:00.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.029+0000 7f51d61a08c0 1 < suggested remove operation key=83V7KSWRKFMZ tag=PDLPE8AYNEGZ type=write 2024-09-12T17:44:00.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.033+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=P85BX61YNMNP type=write size=601577 2024-09-12T17:44:00.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.037+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=MIRV0JTEZAOJ type=del 2024-09-12T17:44:00.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.041+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~LPWJS9GNIZ6R.0 size=602032 2024-09-12T17:44:00.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.041+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=LPWJS9GNIZ6R tag=JOCU504BOY2F type=write size=1650608 2024-09-12T17:44:00.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.049+0000 7f51d61a08c0 1 < suggested remove operation key=593CD3H40DFH tag=QSA50L26FRST type=del 2024-09-12T17:44:00.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.057+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~CG6WXTRHOFWO.0 size=1048576 2024-09-12T17:44:00.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.057+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~CG6WXTRHOFWO.1 size=99037 2024-09-12T17:44:00.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.057+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=CG6WXTRHOFWO tag=D98GDUGU4XKL type=write size=2196189 2024-09-12T17:44:00.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.061+0000 7f51d61a08c0 -1 < no bi entry to suggest for operation key=83V7KSWRKFMZ tag=XIZYMB0CUIG7 type=del size=1788264: (2) No such file or directory 2024-09-12T17:44:00.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.065+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=8JOT1Z2AK8I0 type=del size=1939883 2024-09-12T17:44:00.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.073+0000 7f51d61a08c0 1 < suggested update operation key=A7V478K2SNOF tag=QOUBST4SEXYW type=del size=999371 2024-09-12T17:44:00.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.077+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~JY31L6TDRLDB.0 size=967900 2024-09-12T17:44:00.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.077+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=JY31L6TDRLDB tag=8I0MP24IB1V4 type=write size=2016476 2024-09-12T17:44:00.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.081+0000 7f51d61a08c0 -1 < failed to complete operation key=A7V478K2SNOF tag=NYGYO2WQ7SQU type=del size=3269923: (22) Invalid argument 2024-09-12T17:44:00.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.085+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=T3B0NSS2OF25 type=del size=600555 2024-09-12T17:44:00.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.089+0000 7f51d61a08c0 1 < completed write operation key=2WC0YDQFKAJD tag=XQPPQ1OE1VYW type=write size=992598 2024-09-12T17:44:00.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.097+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~TZYXF98TGTT5.0 size=1048576 2024-09-12T17:44:00.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.097+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~TZYXF98TGTT5.1 size=871672 2024-09-12T17:44:00.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.097+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=TZYXF98TGTT5 tag=BHCG36S27YRK type=write size=2968824 2024-09-12T17:44:00.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.105+0000 7f51d61a08c0 1 < suggested update operation key=NIQAUF085D97 tag=XUYH9WK7BDO2 type=del size=3798760 2024-09-12T17:44:00.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.105+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=ZK2E6FBSB20D type=write size=3274 2024-09-12T17:44:00.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.109+0000 7f51d61a08c0 1 < canceled operation key=92CMI8Q29LB3 tag=EWZQNX1TSAU8 type=del size=1394340 2024-09-12T17:44:00.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.113+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~SAC3JTT2YWQ2.0 size=1048576 2024-09-12T17:44:00.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.117+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~SAC3JTT2YWQ2.1 size=1048576 2024-09-12T17:44:00.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.121+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~SAC3JTT2YWQ2.2 size=523856 2024-09-12T17:44:00.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.121+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=SAC3JTT2YWQ2 tag=WU1PH97JPXVP type=write size=3669584 2024-09-12T17:44:00.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.121+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~DM5QSFAOCMOC.0 size=1048576 2024-09-12T17:44:00.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.125+0000 7f51d61a08c0 1 < completed part key=_multipart_8J72KCZ5WRPU.2~DM5QSFAOCMOC.1 size=1028440 2024-09-12T17:44:00.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.129+0000 7f51d61a08c0 1 < completed multipart upload key=8J72KCZ5WRPU upload=DM5QSFAOCMOC tag=51PNR0M2700Z type=write size=3125592 2024-09-12T17:44:00.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.133+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=9ZW9CV4A51DE type=del size=4171010 2024-09-12T17:44:00.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.137+0000 7f51d61a08c0 1 < canceled operation key=X6KC9Z6LD7VG tag=H3Q6L9NNM3L1 type=del size=2038746 2024-09-12T17:44:00.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.141+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=MOUDGNRF1EG2 type=del size=1593778 2024-09-12T17:44:00.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.141+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~YS5383MFJERM.0 size=626808 2024-09-12T17:44:00.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.145+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=YS5383MFJERM tag=S27I4LLGWQO0 type=write size=1675384 2024-09-12T17:44:00.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.149+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=9QH7X1AN65Q4 type=del size=1038667 2024-09-12T17:44:00.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.153+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=P1VBIY7TH8ZX type=del 2024-09-12T17:44:00.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.157+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~2QDGZE2I04V2.0 size=684422 2024-09-12T17:44:00.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.157+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=2QDGZE2I04V2 tag=LESEDWL64HK0 type=write size=1732998 2024-09-12T17:44:00.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.161+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~I9YAET8N3U2A.0 size=1048576 2024-09-12T17:44:00.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.161+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~I9YAET8N3U2A.1 size=41427 2024-09-12T17:44:00.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.169+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=I9YAET8N3U2A tag=BZGO55QL93YL type=write size=2138579 2024-09-12T17:44:00.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.173+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~G1529MFSGOCC.0 size=1048576 2024-09-12T17:44:00.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.177+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~G1529MFSGOCC.1 size=1048576 2024-09-12T17:44:00.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.181+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~G1529MFSGOCC.2 size=239753 2024-09-12T17:44:00.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.181+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=G1529MFSGOCC tag=HIT2X7YPWX94 type=write size=3385481 2024-09-12T17:44:00.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.185+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=I0MRKEF5AH6C type=del 2024-09-12T17:44:00.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.185+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=8I6YDKYWC9UN type=del size=2882574 2024-09-12T17:44:00.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.193+0000 7f51d61a08c0 1 < suggested remove operation key=96OWZQXI2ALM tag=2EA59TGAHYHG type=del 2024-09-12T17:44:00.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.197+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=DSLMP9K9MQV0 type=write size=49405 2024-09-12T17:44:00.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.201+0000 7f51d61a08c0 1 < completed write operation key=FKKV7SXZSP90 tag=P85BX61YNMNP type=write size=601577 2024-09-12T17:44:00.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.209+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~PKBXFYG1P2AD.0 size=134112 2024-09-12T17:44:00.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.209+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=PKBXFYG1P2AD tag=E4K7PE3R8ZTO type=write size=1182688 2024-09-12T17:44:00.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.213+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~LPWJS9GNIZ6R.0 size=602032 2024-09-12T17:44:00.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.217+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=LPWJS9GNIZ6R tag=JOCU504BOY2F type=write size=1650608 2024-09-12T17:44:00.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.221+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=OMOQ9TUW2YPJ type=del size=1035051 2024-09-12T17:44:00.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.225+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~CG6WXTRHOFWO.0 size=1048576 2024-09-12T17:44:00.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.229+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~CG6WXTRHOFWO.1 size=99037 2024-09-12T17:44:00.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.233+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=CG6WXTRHOFWO tag=D98GDUGU4XKL type=write size=2196189 2024-09-12T17:44:00.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.237+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=NAKJXRSYCXMZ type=del size=580686 2024-09-12T17:44:00.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.241+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=8JOT1Z2AK8I0 type=del 2024-09-12T17:44:00.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.245+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=73RUBX8MHWPQ type=del size=3316498 2024-09-12T17:44:00.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.249+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~JY31L6TDRLDB.0 size=967900 2024-09-12T17:44:00.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.257+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=JY31L6TDRLDB tag=8I0MP24IB1V4 type=write size=2016476 2024-09-12T17:44:00.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.261+0000 7f51d61a08c0 1 > prepared operation key=3LE20KMMPH8P tag=RVOL32730P2S type=del size=1767714 2024-09-12T17:44:00.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.265+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=T3B0NSS2OF25 type=del 2024-09-12T17:44:00.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.273+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~1194WWQMBIY3.0 size=1048576 2024-09-12T17:44:00.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.277+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~1194WWQMBIY3.1 size=1048576 2024-09-12T17:44:00.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.277+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~1194WWQMBIY3.2 size=102120 2024-09-12T17:44:00.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.277+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=1194WWQMBIY3 tag=I50BTWB4TWLH type=write size=3247848 2024-09-12T17:44:00.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.277+0000 7f51d61a08c0 1 < canceled part key=_multipart_JEXD4ZU5HJ2B.2~TZYXF98TGTT5.0 size=1048576 2024-09-12T17:44:00.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.281+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~TZYXF98TGTT5.1 size=871672 2024-09-12T17:44:00.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.285+0000 7f51d61a08c0 1 < canceled multipart upload key=JEXD4ZU5HJ2B upload=TZYXF98TGTT5 tag=BHCG36S27YRK type=write size=2968824 2024-09-12T17:44:00.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.293+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~IIDX1FRF5YXL.0 size=25684 2024-09-12T17:44:00.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.293+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=IIDX1FRF5YXL tag=RP8S31M143GD type=write size=1074260 2024-09-12T17:44:00.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.301+0000 7f51d61a08c0 1 < suggested remove operation key=XL9QDBTYSP7F tag=ZK2E6FBSB20D type=write 2024-09-12T17:44:00.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.305+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=IJRP9HNGJUHR type=del size=2198756 2024-09-12T17:44:00.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.309+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~SAC3JTT2YWQ2.0 size=1048576 2024-09-12T17:44:00.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.309+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~SAC3JTT2YWQ2.1 size=1048576 2024-09-12T17:44:00.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.313+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~SAC3JTT2YWQ2.2 size=523856 2024-09-12T17:44:00.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.321+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=SAC3JTT2YWQ2 tag=WU1PH97JPXVP type=write size=3669584 2024-09-12T17:44:00.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.329+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~43JN8QKUY5W2.0 size=1048576 2024-09-12T17:44:00.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.333+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~43JN8QKUY5W2.1 size=36967 2024-09-12T17:44:00.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.333+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=43JN8QKUY5W2 tag=KSQB942RUL4A type=write size=2134119 2024-09-12T17:44:00.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.337+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=9ZW9CV4A51DE type=del 2024-09-12T17:44:00.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.341+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~2Q10IPG5U0YF.0 size=1048576 2024-09-12T17:44:00.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.345+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~2Q10IPG5U0YF.1 size=1048576 2024-09-12T17:44:00.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.349+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~2Q10IPG5U0YF.2 size=1023812 2024-09-12T17:44:00.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.349+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=2Q10IPG5U0YF tag=K8R361705HI2 type=write size=4169540 2024-09-12T17:44:00.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.357+0000 7f51d61a08c0 1 < suggested update operation key=83V7KSWRKFMZ tag=MOUDGNRF1EG2 type=del size=1593778 2024-09-12T17:44:00.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.361+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~WQJEWOHL1U1O.0 size=920603 2024-09-12T17:44:00.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.361+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=WQJEWOHL1U1O tag=HDKULN49W8FA type=write size=1969179 2024-09-12T17:44:00.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.369+0000 7f51d61a08c0 1 < suggested remove operation key=GCL7UJEJM1UV tag=9QH7X1AN65Q4 type=del 2024-09-12T17:44:00.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.377+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~ZXSWNMBZLMKH.0 size=1048576 2024-09-12T17:44:00.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.381+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~ZXSWNMBZLMKH.1 size=872432 2024-09-12T17:44:00.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.381+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=ZXSWNMBZLMKH tag=3MVHGB63A92P type=write size=2969584 2024-09-12T17:44:00.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.385+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~2QDGZE2I04V2.0 size=684422 2024-09-12T17:44:00.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.389+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=2QDGZE2I04V2 tag=LESEDWL64HK0 type=write size=1732998 2024-09-12T17:44:00.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.393+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=6X8J5KZWX88P type=write size=116035 2024-09-12T17:44:00.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.397+0000 7f51d61a08c0 1 < canceled part key=_multipart_I22NJJISU96B.2~G1529MFSGOCC.0 size=1048576 2024-09-12T17:44:00.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.397+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~G1529MFSGOCC.1 size=1048576 2024-09-12T17:44:00.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.401+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~G1529MFSGOCC.2 size=239753 2024-09-12T17:44:00.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.409+0000 7f51d61a08c0 1 < canceled multipart upload key=I22NJJISU96B upload=G1529MFSGOCC tag=HIT2X7YPWX94 type=write size=3385481 2024-09-12T17:44:00.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.421+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~01L8YBVJG4XX.0 size=13946 2024-09-12T17:44:00.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.421+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=01L8YBVJG4XX tag=IB8FCWY6APXB type=write size=1062522 2024-09-12T17:44:00.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.425+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=8I6YDKYWC9UN type=del 2024-09-12T17:44:00.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.429+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~NR5I5EK9KJIY.0 size=1048576 2024-09-12T17:44:00.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.433+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~NR5I5EK9KJIY.1 size=1048576 2024-09-12T17:44:00.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.437+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~NR5I5EK9KJIY.2 size=563684 2024-09-12T17:44:00.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.437+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=NR5I5EK9KJIY tag=3D9TAGJMRCCM type=write size=3709412 2024-09-12T17:44:00.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.441+0000 7f51d61a08c0 1 < completed write operation key=FKKV7SXZSP90 tag=DSLMP9K9MQV0 type=write size=49405 2024-09-12T17:44:00.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.449+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~2Q9PFDVQ13PI.0 size=1048576 2024-09-12T17:44:00.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.449+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~2Q9PFDVQ13PI.1 size=2095 2024-09-12T17:44:00.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.449+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=2Q9PFDVQ13PI tag=M0HRM9GPUELA type=write size=2099247 2024-09-12T17:44:00.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.453+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~PKBXFYG1P2AD.0 size=134112 2024-09-12T17:44:00.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.461+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=PKBXFYG1P2AD tag=E4K7PE3R8ZTO type=write size=1182688 2024-09-12T17:44:00.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.469+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~QOO8GKTG2K8R.0 size=1048576 2024-09-12T17:44:00.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.469+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~QOO8GKTG2K8R.1 size=1048576 2024-09-12T17:44:00.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.473+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~QOO8GKTG2K8R.2 size=943368 2024-09-12T17:44:00.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.473+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=QOO8GKTG2K8R tag=7JJDQRJ3HNMV type=write size=4089096 2024-09-12T17:44:00.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.477+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=OMOQ9TUW2YPJ type=del 2024-09-12T17:44:00.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.485+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~Y3HZPGTG3R4I.0 size=468847 2024-09-12T17:44:00.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.485+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=Y3HZPGTG3R4I tag=CCUBWOUS7U6S type=write size=1517423 2024-09-12T17:44:00.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.489+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=NAKJXRSYCXMZ type=del 2024-09-12T17:44:00.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.493+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~MCWZTZR4G7F2.0 size=1048576 2024-09-12T17:44:00.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.497+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~MCWZTZR4G7F2.1 size=1048576 2024-09-12T17:44:00.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.501+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~MCWZTZR4G7F2.2 size=913033 2024-09-12T17:44:00.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.501+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=MCWZTZR4G7F2 tag=S8R031SUYUJS type=write size=4058761 2024-09-12T17:44:00.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.505+0000 7f51d61a08c0 1 < suggested update operation key=1ZETSL5TXYSM tag=73RUBX8MHWPQ type=del size=3316498 2024-09-12T17:44:00.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.509+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=D7NWS3GPJTP9 type=del size=1029733 2024-09-12T17:44:00.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.521+0000 7f51d61a08c0 1 < suggested update operation key=3LE20KMMPH8P tag=RVOL32730P2S type=del size=1767714 2024-09-12T17:44:00.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.525+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=RJNEDNTGO70R type=del size=2040371 2024-09-12T17:44:00.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.525+0000 7f51d61a08c0 1 < canceled part key=_multipart_S292EX1P7IZA.2~1194WWQMBIY3.0 size=1048576 2024-09-12T17:44:00.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.529+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~1194WWQMBIY3.1 size=1048576 2024-09-12T17:44:00.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.529+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~1194WWQMBIY3.2 size=102120 2024-09-12T17:44:00.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.537+0000 7f51d61a08c0 1 < canceled multipart upload key=S292EX1P7IZA upload=1194WWQMBIY3 tag=I50BTWB4TWLH type=write size=3247848 2024-09-12T17:44:00.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.545+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=NIQRIQ6WL0N3 type=del size=57593 2024-09-12T17:44:00.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.549+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~IIDX1FRF5YXL.0 size=25684 2024-09-12T17:44:00.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.553+0000 7f51d61a08c0 1 < completed multipart upload key=V5KMBUNVQA0H upload=IIDX1FRF5YXL tag=RP8S31M143GD type=write size=1074260 2024-09-12T17:44:00.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.557+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=1UCHPE6ZYIEK type=write size=57543 2024-09-12T17:44:00.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.565+0000 7f51d61a08c0 1 < suggested update operation key=A7V478K2SNOF tag=IJRP9HNGJUHR type=del size=2198756 2024-09-12T17:44:00.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.569+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=189PL1PRELPY type=del size=2456732 2024-09-12T17:44:00.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.573+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~43JN8QKUY5W2.0 size=1048576 2024-09-12T17:44:00.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.577+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~43JN8QKUY5W2.1 size=36967 2024-09-12T17:44:00.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.581+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=43JN8QKUY5W2 tag=KSQB942RUL4A type=write size=2134119 2024-09-12T17:44:00.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.585+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=J6LL9DU622CR type=del size=285637 2024-09-12T17:44:00.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.589+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~2Q10IPG5U0YF.0 size=1048576 2024-09-12T17:44:00.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.589+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~2Q10IPG5U0YF.1 size=1048576 2024-09-12T17:44:00.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.593+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~2Q10IPG5U0YF.2 size=1023812 2024-09-12T17:44:00.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.601+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=2Q10IPG5U0YF tag=K8R361705HI2 type=write size=4169540 2024-09-12T17:44:00.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.605+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=7XIHWG45PWBY type=del size=2770144 2024-09-12T17:44:00.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.609+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~WQJEWOHL1U1O.0 size=920603 2024-09-12T17:44:00.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.613+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=WQJEWOHL1U1O tag=HDKULN49W8FA type=write size=1969179 2024-09-12T17:44:00.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.621+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~UK0FE12FI2L8.0 size=1048576 2024-09-12T17:44:00.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.621+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~UK0FE12FI2L8.1 size=566789 2024-09-12T17:44:00.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.621+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=UK0FE12FI2L8 tag=71X9LYQOU3TN type=write size=2663941 2024-09-12T17:44:00.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.625+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~ZXSWNMBZLMKH.0 size=1048576 2024-09-12T17:44:00.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.629+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~ZXSWNMBZLMKH.1 size=872432 2024-09-12T17:44:00.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.633+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=ZXSWNMBZLMKH tag=3MVHGB63A92P type=write size=2969584 2024-09-12T17:44:00.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.641+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~KLPC4CCCVDZD.0 size=1048576 2024-09-12T17:44:00.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.645+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~KLPC4CCCVDZD.1 size=1048576 2024-09-12T17:44:00.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.645+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~KLPC4CCCVDZD.2 size=306769 2024-09-12T17:44:00.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.645+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=KLPC4CCCVDZD tag=0M8V4ARQ332E type=write size=3452497 2024-09-12T17:44:00.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.649+0000 7f51d61a08c0 1 < completed write operation key=83V7KSWRKFMZ tag=6X8J5KZWX88P type=write size=116035 2024-09-12T17:44:00.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.657+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~4I6M1ZHABOCW.0 size=1048576 2024-09-12T17:44:00.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.657+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~4I6M1ZHABOCW.1 size=1048576 2024-09-12T17:44:00.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.661+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~4I6M1ZHABOCW.2 size=812042 2024-09-12T17:44:00.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.661+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=4I6M1ZHABOCW tag=OVPFC8M50TB0 type=write size=3957770 2024-09-12T17:44:00.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.665+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~01L8YBVJG4XX.0 size=13946 2024-09-12T17:44:00.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.669+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=01L8YBVJG4XX tag=IB8FCWY6APXB type=write size=1062522 2024-09-12T17:44:00.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.677+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~KMP675XSMHTF.0 size=1048576 2024-09-12T17:44:00.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.681+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~KMP675XSMHTF.1 size=57789 2024-09-12T17:44:00.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.681+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=KMP675XSMHTF tag=UIPSH6S55TJ7 type=write size=2154941 2024-09-12T17:44:00.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.681+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~NR5I5EK9KJIY.0 size=1048576 2024-09-12T17:44:00.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.685+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~NR5I5EK9KJIY.1 size=1048576 2024-09-12T17:44:00.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.689+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~NR5I5EK9KJIY.2 size=563684 2024-09-12T17:44:00.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.693+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=NR5I5EK9KJIY tag=3D9TAGJMRCCM type=write size=3709412 2024-09-12T17:44:00.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.697+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=UTKI2LLROGMU type=del size=3688334 2024-09-12T17:44:00.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.701+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~2Q9PFDVQ13PI.0 size=1048576 2024-09-12T17:44:00.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.705+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~2Q9PFDVQ13PI.1 size=2095 2024-09-12T17:44:00.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.709+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=2Q9PFDVQ13PI tag=M0HRM9GPUELA type=write size=2099247 2024-09-12T17:44:00.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.713+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=0OLEZST5E6YY type=write size=44685 2024-09-12T17:44:00.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.717+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~QOO8GKTG2K8R.0 size=1048576 2024-09-12T17:44:00.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.721+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~QOO8GKTG2K8R.1 size=1048576 2024-09-12T17:44:00.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.725+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~QOO8GKTG2K8R.2 size=943368 2024-09-12T17:44:00.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.729+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=QOO8GKTG2K8R tag=7JJDQRJ3HNMV type=write size=4089096 2024-09-12T17:44:00.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.737+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~WSBFYM925JDR.0 size=1048576 2024-09-12T17:44:00.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.741+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~WSBFYM925JDR.1 size=1048576 2024-09-12T17:44:00.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.741+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~WSBFYM925JDR.2 size=856878 2024-09-12T17:44:00.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.741+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=WSBFYM925JDR tag=RGND0ZLZ0ZZR type=write size=4002606 2024-09-12T17:44:00.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.745+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~Y3HZPGTG3R4I.0 size=468847 2024-09-12T17:44:00.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.757+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=Y3HZPGTG3R4I tag=CCUBWOUS7U6S type=write size=1517423 2024-09-12T17:44:00.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.761+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=XS48QWXUGFT7 type=write size=387065 2024-09-12T17:44:00.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.765+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~MCWZTZR4G7F2.0 size=1048576 2024-09-12T17:44:00.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.769+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~MCWZTZR4G7F2.1 size=1048576 2024-09-12T17:44:00.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.769+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~MCWZTZR4G7F2.2 size=913033 2024-09-12T17:44:00.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.777+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=MCWZTZR4G7F2 tag=S8R031SUYUJS type=write size=4058761 2024-09-12T17:44:00.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~VLC4G733WQDK.0 size=1048576 2024-09-12T17:44:00.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.785+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~VLC4G733WQDK.1 size=698787 2024-09-12T17:44:00.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.785+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=VLC4G733WQDK tag=9TE26WI2Y3XX type=write size=2795939 2024-09-12T17:44:00.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.789+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=D7NWS3GPJTP9 type=del 2024-09-12T17:44:00.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.793+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=V4J61CNO4002 type=del size=165514 2024-09-12T17:44:00.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.797+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=RJNEDNTGO70R type=del 2024-09-12T17:44:00.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.805+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~D3VB4UOHFMZ2.0 size=1048576 2024-09-12T17:44:00.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.805+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~D3VB4UOHFMZ2.1 size=930746 2024-09-12T17:44:00.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.805+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=D3VB4UOHFMZ2 tag=03DZVNT0HLEO type=write size=3027898 2024-09-12T17:44:00.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.809+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=NIQRIQ6WL0N3 type=del 2024-09-12T17:44:00.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.813+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=G8PMCIE42754 type=del size=1953007 2024-09-12T17:44:00.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.817+0000 7f51d61a08c0 1 < completed write operation key=ZCB4V47S38TN tag=1UCHPE6ZYIEK type=write size=57543 2024-09-12T17:44:00.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.825+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~VQRAM5YHYDDR.0 size=827902 2024-09-12T17:44:00.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.825+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=VQRAM5YHYDDR tag=GIBOKNGMDO2H type=write size=1876478 2024-09-12T17:44:00.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.829+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=189PL1PRELPY type=del 2024-09-12T17:44:00.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.833+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=QR5YP1P610J7 type=del size=2821114 2024-09-12T17:44:00.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.837+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=J6LL9DU622CR type=del 2024-09-12T17:44:00.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.845+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~19K0II1IDDJ1.0 size=1048576 2024-09-12T17:44:00.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.845+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~19K0II1IDDJ1.1 size=1048576 2024-09-12T17:44:00.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.849+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~19K0II1IDDJ1.2 size=502544 2024-09-12T17:44:00.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.849+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=19K0II1IDDJ1 tag=0KX01X1NP7GD type=write size=3648272 2024-09-12T17:44:00.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.853+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=7XIHWG45PWBY type=del 2024-09-12T17:44:00.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.857+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=U53RQDTK0UIG type=write size=761248 2024-09-12T17:44:00.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.861+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~UK0FE12FI2L8.0 size=1048576 2024-09-12T17:44:00.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.865+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~UK0FE12FI2L8.1 size=566789 2024-09-12T17:44:00.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.873+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=UK0FE12FI2L8 tag=71X9LYQOU3TN type=write size=2663941 2024-09-12T17:44:00.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.877+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=2UTL3FSN09T1 type=del size=3884172 2024-09-12T17:44:00.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.877+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~KLPC4CCCVDZD.0 size=1048576 2024-09-12T17:44:00.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.881+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~KLPC4CCCVDZD.1 size=1048576 2024-09-12T17:44:00.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.881+0000 7f51d61a08c0 1 < canceled part key=_multipart_96OWZQXI2ALM.2~KLPC4CCCVDZD.2 size=306769 2024-09-12T17:44:00.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.889+0000 7f51d61a08c0 1 < canceled multipart upload key=96OWZQXI2ALM upload=KLPC4CCCVDZD tag=0M8V4ARQ332E type=write size=3452497 2024-09-12T17:44:00.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.893+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=KQ1WY0FRKZXJ type=del size=3888544 2024-09-12T17:44:00.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.897+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~4I6M1ZHABOCW.0 size=1048576 2024-09-12T17:44:00.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.897+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~4I6M1ZHABOCW.1 size=1048576 2024-09-12T17:44:00.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.897+0000 7f51d61a08c0 1 < canceled part key=_multipart_DCLENF1A1W2Q.2~4I6M1ZHABOCW.2 size=812042 2024-09-12T17:44:00.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.905+0000 7f51d61a08c0 1 < canceled multipart upload key=DCLENF1A1W2Q upload=4I6M1ZHABOCW tag=OVPFC8M50TB0 type=write size=3957770 2024-09-12T17:44:00.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.913+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~ULNU1Z7BHUYI.0 size=1048576 2024-09-12T17:44:00.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.917+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~ULNU1Z7BHUYI.1 size=1048576 2024-09-12T17:44:00.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.917+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~ULNU1Z7BHUYI.2 size=916027 2024-09-12T17:44:00.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.917+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=ULNU1Z7BHUYI tag=WYMGFOZY6HTI type=write size=4061755 2024-09-12T17:44:00.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.921+0000 7f51d61a08c0 1 < canceled part key=_multipart_10WBH16J1AF8.2~KMP675XSMHTF.0 size=1048576 2024-09-12T17:44:00.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.921+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~KMP675XSMHTF.1 size=57789 2024-09-12T17:44:00.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.929+0000 7f51d61a08c0 1 < canceled multipart upload key=10WBH16J1AF8 upload=KMP675XSMHTF tag=UIPSH6S55TJ7 type=write size=2154941 2024-09-12T17:44:00.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.933+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=0GFF59CJ9C1J type=del size=1319405 2024-09-12T17:44:00.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.937+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=UTKI2LLROGMU type=del 2024-09-12T17:44:00.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.941+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~BSURKAJ8PI6T.0 size=17443 2024-09-12T17:44:00.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.941+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=BSURKAJ8PI6T tag=V29FDXFE4G88 type=write size=1066019 2024-09-12T17:44:00.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.945+0000 7f51d61a08c0 1 < completed write operation key=DCLENF1A1W2Q tag=0OLEZST5E6YY type=write size=44685 2024-09-12T17:44:00.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.953+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~701P6AB33SDZ.0 size=779736 2024-09-12T17:44:00.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.953+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=701P6AB33SDZ tag=QVJ33S8FWW25 type=write size=1828312 2024-09-12T17:44:00.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.957+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~WSBFYM925JDR.0 size=1048576 2024-09-12T17:44:00.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.961+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~WSBFYM925JDR.1 size=1048576 2024-09-12T17:44:00.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.965+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~WSBFYM925JDR.2 size=856878 2024-09-12T17:44:00.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.969+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=WSBFYM925JDR tag=RGND0ZLZ0ZZR type=write size=4002606 2024-09-12T17:44:00.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.973+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=92K45JQ954BW type=write size=481672 2024-09-12T17:44:00.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.977+0000 7f51d61a08c0 1 < completed write operation key=V5KMBUNVQA0H tag=XS48QWXUGFT7 type=write size=387065 2024-09-12T17:44:00.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.981+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=W8CDRQH1QQ6P type=del size=409566 2024-09-12T17:44:00.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.985+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~VLC4G733WQDK.0 size=1048576 2024-09-12T17:44:00.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.989+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~VLC4G733WQDK.1 size=698787 2024-09-12T17:44:00.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:00.993+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=VLC4G733WQDK tag=9TE26WI2Y3XX type=write size=2795939 2024-09-12T17:44:01.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.001+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~PV2G9C1M59RW.0 size=1048576 2024-09-12T17:44:01.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.005+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~PV2G9C1M59RW.1 size=487758 2024-09-12T17:44:01.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.005+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=PV2G9C1M59RW tag=42WLYHB9VNS4 type=write size=2584910 2024-09-12T17:44:01.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.009+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=V4J61CNO4002 type=del 2024-09-12T17:44:01.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.013+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=GO3PAXD6H7V1 type=del size=1265419 2024-09-12T17:44:01.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.017+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~D3VB4UOHFMZ2.0 size=1048576 2024-09-12T17:44:01.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.021+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~D3VB4UOHFMZ2.1 size=930746 2024-09-12T17:44:01.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.025+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=D3VB4UOHFMZ2 tag=03DZVNT0HLEO type=write size=3027898 2024-09-12T17:44:01.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.029+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=0SQUQG1HVK5P type=del size=48507 2024-09-12T17:44:01.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.033+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=G8PMCIE42754 type=del 2024-09-12T17:44:01.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.037+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=X6MSP008IMHI type=del size=1987983 2024-09-12T17:44:01.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.041+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~VQRAM5YHYDDR.0 size=827902 2024-09-12T17:44:01.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.049+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=VQRAM5YHYDDR tag=GIBOKNGMDO2H type=write size=1876478 2024-09-12T17:44:01.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.053+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=4FZZR1VPVZSK type=del size=18541 2024-09-12T17:44:01.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.061+0000 7f51d61a08c0 1 < suggested update operation key=8J72KCZ5WRPU tag=QR5YP1P610J7 type=del size=2821114 2024-09-12T17:44:01.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.065+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=W3W9T4TD8IE4 type=del size=2828453 2024-09-12T17:44:01.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.069+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~19K0II1IDDJ1.0 size=1048576 2024-09-12T17:44:01.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.073+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~19K0II1IDDJ1.1 size=1048576 2024-09-12T17:44:01.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.077+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~19K0II1IDDJ1.2 size=502544 2024-09-12T17:44:01.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.081+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=19K0II1IDDJ1 tag=0KX01X1NP7GD type=write size=3648272 2024-09-12T17:44:01.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.089+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~3HQ7190PIVNB.0 size=1048576 2024-09-12T17:44:01.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.093+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~3HQ7190PIVNB.1 size=365398 2024-09-12T17:44:01.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.093+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=3HQ7190PIVNB tag=JUN3ICA8ULE0 type=write size=2462550 2024-09-12T17:44:01.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.097+0000 7f51d61a08c0 1 < completed write operation key=SSOA6J297L1C tag=U53RQDTK0UIG type=write size=761248 2024-09-12T17:44:01.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.101+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=GHBH03FV8H6Y type=write size=289258 2024-09-12T17:44:01.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.109+0000 7f51d61a08c0 1 < completed delete operation key=U3GZL9YPFMZY tag=2UTL3FSN09T1 type=del 2024-09-12T17:44:01.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.113+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=CPRUH0Y8CJ6Y type=del size=1554184 2024-09-12T17:44:01.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.117+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=KQ1WY0FRKZXJ type=del 2024-09-12T17:44:01.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.121+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=ZP7UU10SVC6U type=del size=2942501 2024-09-12T17:44:01.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.125+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~ULNU1Z7BHUYI.0 size=1048576 2024-09-12T17:44:01.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.129+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~ULNU1Z7BHUYI.1 size=1048576 2024-09-12T17:44:01.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.129+0000 7f51d61a08c0 1 < canceled part key=_multipart_DCLENF1A1W2Q.2~ULNU1Z7BHUYI.2 size=916027 2024-09-12T17:44:01.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.133+0000 7f51d61a08c0 1 < canceled multipart upload key=DCLENF1A1W2Q upload=ULNU1Z7BHUYI tag=WYMGFOZY6HTI type=write size=4061755 2024-09-12T17:44:01.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.141+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~RI58WM5V1L2F.0 size=310570 2024-09-12T17:44:01.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.141+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=RI58WM5V1L2F tag=ND0LI8URQ5GC type=write size=1359146 2024-09-12T17:44:01.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.145+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=0GFF59CJ9C1J type=del 2024-09-12T17:44:01.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.153+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~KVQSO4SB5E1B.0 size=1048576 2024-09-12T17:44:01.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.153+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~KVQSO4SB5E1B.1 size=1048576 2024-09-12T17:44:01.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.157+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~KVQSO4SB5E1B.2 size=374477 2024-09-12T17:44:01.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.157+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=KVQSO4SB5E1B tag=SKYOZCU61CMJ type=write size=3520205 2024-09-12T17:44:01.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.161+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~BSURKAJ8PI6T.0 size=17443 2024-09-12T17:44:01.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.169+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=BSURKAJ8PI6T tag=V29FDXFE4G88 type=write size=1066019 2024-09-12T17:44:01.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.177+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~D7LLM9FHDNV6.0 size=1048576 2024-09-12T17:44:01.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.181+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~D7LLM9FHDNV6.1 size=234658 2024-09-12T17:44:01.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.181+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=D7LLM9FHDNV6 tag=HBTKGBENZMU2 type=write size=2331810 2024-09-12T17:44:01.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.185+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~701P6AB33SDZ.0 size=779736 2024-09-12T17:44:01.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.189+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=701P6AB33SDZ tag=QVJ33S8FWW25 type=write size=1828312 2024-09-12T17:44:01.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.197+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~TWXIY99KNMQ8.0 size=1048576 2024-09-12T17:44:01.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.201+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~TWXIY99KNMQ8.1 size=1048576 2024-09-12T17:44:01.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.205+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~TWXIY99KNMQ8.2 size=534064 2024-09-12T17:44:01.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.205+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=TWXIY99KNMQ8 tag=1XS9QKA3SUV3 type=write size=3679792 2024-09-12T17:44:01.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.209+0000 7f51d61a08c0 1 < completed write operation key=V5KMBUNVQA0H tag=92K45JQ954BW type=write size=481672 2024-09-12T17:44:01.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.213+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=K6JIOZSG2A1P type=del size=307838 2024-09-12T17:44:01.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.221+0000 7f51d61a08c0 1 < suggested update operation key=FKKV7SXZSP90 tag=W8CDRQH1QQ6P type=del size=409566 2024-09-12T17:44:01.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.225+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=YRL2N8H9ORK1 type=write size=107145 2024-09-12T17:44:01.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.229+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~PV2G9C1M59RW.0 size=1048576 2024-09-12T17:44:01.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.229+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~PV2G9C1M59RW.1 size=487758 2024-09-12T17:44:01.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.237+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=PV2G9C1M59RW tag=42WLYHB9VNS4 type=write size=2584910 2024-09-12T17:44:01.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.245+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~IPYEFFQAVDV7.0 size=531113 2024-09-12T17:44:01.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.245+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=IPYEFFQAVDV7 tag=N3HM9NMV3VSV type=write size=1579689 2024-09-12T17:44:01.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.249+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=GO3PAXD6H7V1 type=del 2024-09-12T17:44:01.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.249+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=23YBGOGQMJG1 type=del size=496324 2024-09-12T17:44:01.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.257+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=0SQUQG1HVK5P type=del 2024-09-12T17:44:01.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.261+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=GUMKYVL7GEDG type=del size=1882282 2024-09-12T17:44:01.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.265+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=X6MSP008IMHI type=del 2024-09-12T17:44:01.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.269+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=ZJQM472RBGSD type=del size=3348184 2024-09-12T17:44:01.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.273+0000 7f51d61a08c0 1 < completed delete operation key=ZCB4V47S38TN tag=4FZZR1VPVZSK type=del 2024-09-12T17:44:01.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.277+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=CL0C8I6ZQFLS type=del size=738229 2024-09-12T17:44:01.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.281+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=W3W9T4TD8IE4 type=del 2024-09-12T17:44:01.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.285+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=RL45CVXH8D49 type=write size=459385 2024-09-12T17:44:01.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.289+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~3HQ7190PIVNB.0 size=1048576 2024-09-12T17:44:01.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.289+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~3HQ7190PIVNB.1 size=365398 2024-09-12T17:44:01.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.297+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=3HQ7190PIVNB tag=JUN3ICA8ULE0 type=write size=2462550 2024-09-12T17:44:01.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.301+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=L8U22WEX8Z1F type=del size=247983 2024-09-12T17:44:01.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.305+0000 7f51d61a08c0 1 < completed write operation key=EDVAEE9FKH1T tag=GHBH03FV8H6Y type=write size=289258 2024-09-12T17:44:01.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.309+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=3UB2WA7MHWF3 type=del size=2339698 2024-09-12T17:44:01.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.313+0000 7f51d61a08c0 1 < canceled operation key=DCLENF1A1W2Q tag=CPRUH0Y8CJ6Y type=del size=1554184 2024-09-12T17:44:01.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.317+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=MPBJD2FAQ7XO type=del size=822522 2024-09-12T17:44:01.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.321+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=ZP7UU10SVC6U type=del 2024-09-12T17:44:01.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.325+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=H7XZVGQQOPKN type=del size=3016752 2024-09-12T17:44:01.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.329+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~RI58WM5V1L2F.0 size=310570 2024-09-12T17:44:01.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.337+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=RI58WM5V1L2F tag=ND0LI8URQ5GC type=write size=1359146 2024-09-12T17:44:01.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.341+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~KBGHXD8333RV.0 size=1048576 2024-09-12T17:44:01.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.345+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~KBGHXD8333RV.1 size=551620 2024-09-12T17:44:01.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.345+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=KBGHXD8333RV tag=1QR115ST2KSE type=write size=2648772 2024-09-12T17:44:01.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.349+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~KVQSO4SB5E1B.0 size=1048576 2024-09-12T17:44:01.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.353+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~KVQSO4SB5E1B.1 size=1048576 2024-09-12T17:44:01.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.353+0000 7f51d61a08c0 1 < canceled part key=_multipart_593CD3H40DFH.2~KVQSO4SB5E1B.2 size=374477 2024-09-12T17:44:01.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.361+0000 7f51d61a08c0 1 < canceled multipart upload key=593CD3H40DFH upload=KVQSO4SB5E1B tag=SKYOZCU61CMJ type=write size=3520205 2024-09-12T17:44:01.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.365+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~NLWIOFCKDMVJ.0 size=192567 2024-09-12T17:44:01.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.365+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=NLWIOFCKDMVJ tag=LOKN6HU1APNO type=write size=1241143 2024-09-12T17:44:01.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.369+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~D7LLM9FHDNV6.0 size=1048576 2024-09-12T17:44:01.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.373+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~D7LLM9FHDNV6.1 size=234658 2024-09-12T17:44:01.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.377+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=D7LLM9FHDNV6 tag=HBTKGBENZMU2 type=write size=2331810 2024-09-12T17:44:01.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.381+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=6LIOXPYMPFRI type=del size=604456 2024-09-12T17:44:01.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.385+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~TWXIY99KNMQ8.0 size=1048576 2024-09-12T17:44:01.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.389+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~TWXIY99KNMQ8.1 size=1048576 2024-09-12T17:44:01.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.393+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~TWXIY99KNMQ8.2 size=534064 2024-09-12T17:44:01.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.397+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=TWXIY99KNMQ8 tag=1XS9QKA3SUV3 type=write size=3679792 2024-09-12T17:44:01.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.401+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=3G9CQGA3GJB9 type=del size=1127612 2024-09-12T17:44:01.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.405+0000 7f51d61a08c0 -1 < failed to complete operation key=FKKV7SXZSP90 tag=K6JIOZSG2A1P type=del size=307838: (22) Invalid argument 2024-09-12T17:44:01.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.409+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=EAUCT3LDEADR type=write size=802732 2024-09-12T17:44:01.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.417+0000 7f51d61a08c0 1 < completed write operation key=SSOA6J297L1C tag=YRL2N8H9ORK1 type=write size=107145 2024-09-12T17:44:01.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.421+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~J0FLRIJN1R2R.0 size=478378 2024-09-12T17:44:01.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.421+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=J0FLRIJN1R2R tag=0M1TXRIUAA9W type=write size=1526954 2024-09-12T17:44:01.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.425+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~IPYEFFQAVDV7.0 size=531113 2024-09-12T17:44:01.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.433+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=IPYEFFQAVDV7 tag=N3HM9NMV3VSV type=write size=1579689 2024-09-12T17:44:01.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.437+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=T70MZEBG9ER1 type=write size=518874 2024-09-12T17:44:01.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.445+0000 7f51d61a08c0 1 < suggested update operation key=96OWZQXI2ALM tag=23YBGOGQMJG1 type=del size=496324 2024-09-12T17:44:01.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.449+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=PMTYBZGIAKUF type=write size=7074 2024-09-12T17:44:01.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.457+0000 7f51d61a08c0 1 < suggested remove operation key=83V7KSWRKFMZ tag=GUMKYVL7GEDG type=del 2024-09-12T17:44:01.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.461+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=Y43X87JRDYSW type=write size=628146 2024-09-12T17:44:01.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.469+0000 7f51d61a08c0 1 < suggested update operation key=XL9QDBTYSP7F tag=ZJQM472RBGSD type=del size=3348184 2024-09-12T17:44:01.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.477+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=PT1RI18N978I type=write size=659479 2024-09-12T17:44:01.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.481+0000 7f51d61a08c0 -1 < failed to complete operation key=XL9QDBTYSP7F tag=CL0C8I6ZQFLS type=del size=738229: (22) Invalid argument 2024-09-12T17:44:01.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.485+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=0OGG5S75ZINP type=del size=1168147 2024-09-12T17:44:01.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.489+0000 7f51d61a08c0 1 < completed write operation key=FKKV7SXZSP90 tag=RL45CVXH8D49 type=write size=459385 2024-09-12T17:44:01.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.493+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=VM6E8HCQ4W7M type=del size=3027839 2024-09-12T17:44:01.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.501+0000 7f51d61a08c0 1 < suggested update operation key=A7V478K2SNOF tag=L8U22WEX8Z1F type=del size=247983 2024-09-12T17:44:01.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.501+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=665TC96CK7PG type=del size=4103501 2024-09-12T17:44:01.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.505+0000 7f51d61a08c0 1 < canceled operation key=HUWVRJIZ5JYE tag=3UB2WA7MHWF3 type=del size=2339698 2024-09-12T17:44:01.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.513+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~ZIQ5KI171VUB.0 size=546366 2024-09-12T17:44:01.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.513+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=ZIQ5KI171VUB tag=75YS7OL42VGF type=write size=1594942 2024-09-12T17:44:01.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.517+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=MPBJD2FAQ7XO type=del 2024-09-12T17:44:01.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.521+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=6Z6FF7GG2XRU type=write size=817362 2024-09-12T17:44:01.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.525+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=H7XZVGQQOPKN type=del 2024-09-12T17:44:01.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.533+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~TRMNSK3S55PT.0 size=1048576 2024-09-12T17:44:01.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.533+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~TRMNSK3S55PT.1 size=1048576 2024-09-12T17:44:01.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.537+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~TRMNSK3S55PT.2 size=505901 2024-09-12T17:44:01.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.537+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=TRMNSK3S55PT tag=TF5EL4R4143R type=write size=3651629 2024-09-12T17:44:01.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.541+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~KBGHXD8333RV.0 size=1048576 2024-09-12T17:44:01.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.545+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~KBGHXD8333RV.1 size=551620 2024-09-12T17:44:01.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.549+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=KBGHXD8333RV tag=1QR115ST2KSE type=write size=2648772 2024-09-12T17:44:01.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.553+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=QFE95Y43W8OT type=del size=701268 2024-09-12T17:44:01.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.557+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~NLWIOFCKDMVJ.0 size=192567 2024-09-12T17:44:01.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.565+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=NLWIOFCKDMVJ tag=LOKN6HU1APNO type=write size=1241143 2024-09-12T17:44:01.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.569+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=ZWWQTOKQKMZS type=del size=2998903 2024-09-12T17:44:01.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.573+0000 7f51d61a08c0 1 < completed delete operation key=92CMI8Q29LB3 tag=6LIOXPYMPFRI type=del 2024-09-12T17:44:01.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.577+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=3KF7VJJMMNNP type=del size=1375755 2024-09-12T17:44:01.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.581+0000 7f51d61a08c0 1 < canceled operation key=I22NJJISU96B tag=3G9CQGA3GJB9 type=del size=1127612 2024-09-12T17:44:01.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.581+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=U4IUAMT60Q3S type=del size=1127046 2024-09-12T17:44:01.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.585+0000 7f51d61a08c0 1 < completed write operation key=7FBK3439R80H tag=EAUCT3LDEADR type=write size=802732 2024-09-12T17:44:01.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.593+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~FPVFU2XJXCW6.0 size=1048576 2024-09-12T17:44:01.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.597+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~FPVFU2XJXCW6.1 size=591977 2024-09-12T17:44:01.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.597+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=FPVFU2XJXCW6 tag=B5ASSW3XEBBB type=write size=2689129 2024-09-12T17:44:01.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.601+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~J0FLRIJN1R2R.0 size=478378 2024-09-12T17:44:01.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.609+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=J0FLRIJN1R2R tag=0M1TXRIUAA9W type=write size=1526954 2024-09-12T17:44:01.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.617+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~AG4RT5CY3G5C.0 size=863490 2024-09-12T17:44:01.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.617+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=AG4RT5CY3G5C tag=MQ1H0RIKVTLS type=write size=1912066 2024-09-12T17:44:01.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.621+0000 7f51d61a08c0 -1 < failed to complete operation key=XL9QDBTYSP7F tag=T70MZEBG9ER1 type=write size=518874: (22) Invalid argument 2024-09-12T17:44:01.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.625+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~TPBJM0W7GZHK.0 size=1048576 2024-09-12T17:44:01.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.629+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~TPBJM0W7GZHK.1 size=1048576 2024-09-12T17:44:01.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.633+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~TPBJM0W7GZHK.2 size=449393 2024-09-12T17:44:01.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.633+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=TPBJM0W7GZHK tag=Y1NBRFU1E762 type=write size=3595121 2024-09-12T17:44:01.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.637+0000 7f51d61a08c0 1 < completed write operation key=V5KMBUNVQA0H tag=PMTYBZGIAKUF type=write size=7074 2024-09-12T17:44:01.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.641+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~4B8KTOY8MMF9.0 size=1048576 2024-09-12T17:44:01.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.645+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~4B8KTOY8MMF9.1 size=1048576 2024-09-12T17:44:01.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.649+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~4B8KTOY8MMF9.2 size=92876 2024-09-12T17:44:01.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.649+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=4B8KTOY8MMF9 tag=06UBDS7PCDMV type=write size=3238604 2024-09-12T17:44:01.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.653+0000 7f51d61a08c0 1 < canceled operation key=HY2US2MMDNI4 tag=Y43X87JRDYSW type=write size=628146 2024-09-12T17:44:01.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.657+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=WFLI48KB9GZG type=write size=597804 2024-09-12T17:44:01.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.661+0000 7f51d61a08c0 1 < completed write operation key=XL9QDBTYSP7F tag=PT1RI18N978I type=write size=659479 2024-09-12T17:44:01.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.665+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~WKKGENDL7LXM.0 size=1048576 2024-09-12T17:44:01.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.669+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~WKKGENDL7LXM.1 size=646127 2024-09-12T17:44:01.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.669+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=WKKGENDL7LXM tag=CYCQ8IFS4J8M type=write size=2743279 2024-09-12T17:44:01.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.677+0000 7f51d61a08c0 1 < suggested update operation key=XL9QDBTYSP7F tag=0OGG5S75ZINP type=del size=1168147 2024-09-12T17:44:01.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.681+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=4Y0UXCUJ0BGJ type=del size=1037588 2024-09-12T17:44:01.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.685+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=VM6E8HCQ4W7M type=del 2024-09-12T17:44:01.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.689+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~ON3US8TEA3LY.0 size=1048576 2024-09-12T17:44:01.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.693+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~ON3US8TEA3LY.1 size=277960 2024-09-12T17:44:01.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.693+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=ON3US8TEA3LY tag=JRFNIP3IS95T type=write size=2375112 2024-09-12T17:44:01.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.697+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=665TC96CK7PG type=del 2024-09-12T17:44:01.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.701+0000 7f51d61a08c0 1 > prepared operation key=S292EX1P7IZA tag=SECHHJKI1V9Q type=del size=2401230 2024-09-12T17:44:01.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.705+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~ZIQ5KI171VUB.0 size=546366 2024-09-12T17:44:01.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.709+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=ZIQ5KI171VUB tag=75YS7OL42VGF type=write size=1594942 2024-09-12T17:44:01.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.713+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=X284106CQD0H type=del size=2433130 2024-09-12T17:44:01.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.717+0000 7f51d61a08c0 1 < completed write operation key=92CMI8Q29LB3 tag=6Z6FF7GG2XRU type=write size=817362 2024-09-12T17:44:01.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.721+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=SNNXFF1EZI33 type=del size=3458240 2024-09-12T17:44:01.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.725+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~TRMNSK3S55PT.0 size=1048576 2024-09-12T17:44:01.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.729+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~TRMNSK3S55PT.1 size=1048576 2024-09-12T17:44:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.733+0000 7f51d61a08c0 1 < completed part key=_multipart_3LE20KMMPH8P.2~TRMNSK3S55PT.2 size=505901 2024-09-12T17:44:01.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.737+0000 7f51d61a08c0 1 < completed multipart upload key=3LE20KMMPH8P upload=TRMNSK3S55PT tag=TF5EL4R4143R type=write size=3651629 2024-09-12T17:44:01.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.745+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~GXS7XSC99WJN.0 size=1048576 2024-09-12T17:44:01.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.749+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~GXS7XSC99WJN.1 size=1048576 2024-09-12T17:44:01.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.749+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~GXS7XSC99WJN.2 size=407191 2024-09-12T17:44:01.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.749+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=GXS7XSC99WJN tag=18LN4AGEU6BU type=write size=3552919 2024-09-12T17:44:01.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.753+0000 7f51d61a08c0 1 < canceled operation key=DCLENF1A1W2Q tag=QFE95Y43W8OT type=del size=701268 2024-09-12T17:44:01.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.761+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=JQXWH3GXRU53 type=write size=816323 2024-09-12T17:44:01.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.765+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=ZWWQTOKQKMZS type=del 2024-09-12T17:44:01.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.769+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=BYAHJ0L2O0V0 type=del size=4059037 2024-09-12T17:44:01.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.773+0000 7f51d61a08c0 1 < suggested remove operation key=IWEJXLG1CDAV tag=3KF7VJJMMNNP type=del 2024-09-12T17:44:01.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~DRDX5NLLDU6M.0 size=1048576 2024-09-12T17:44:01.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.785+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~DRDX5NLLDU6M.1 size=725804 2024-09-12T17:44:01.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.785+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=DRDX5NLLDU6M tag=HP2130DLY1EL type=write size=2822956 2024-09-12T17:44:01.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.789+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=U4IUAMT60Q3S type=del 2024-09-12T17:44:01.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.793+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=MX0ZB29BZ47D type=del size=3822228 2024-09-12T17:44:01.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.797+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~FPVFU2XJXCW6.0 size=1048576 2024-09-12T17:44:01.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.801+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~FPVFU2XJXCW6.1 size=591977 2024-09-12T17:44:01.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.805+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=FPVFU2XJXCW6 tag=B5ASSW3XEBBB type=write size=2689129 2024-09-12T17:44:01.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.809+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=T0CZ2W09381S type=del size=876891 2024-09-12T17:44:01.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.813+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~AG4RT5CY3G5C.0 size=863490 2024-09-12T17:44:01.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.821+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=AG4RT5CY3G5C tag=MQ1H0RIKVTLS type=write size=1912066 2024-09-12T17:44:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.825+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=8K6KKUATBFHK type=del size=1737470 2024-09-12T17:44:01.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.833+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~TPBJM0W7GZHK.0 size=1048576 2024-09-12T17:44:01.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.837+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~TPBJM0W7GZHK.1 size=1048576 2024-09-12T17:44:01.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.841+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~TPBJM0W7GZHK.2 size=449393 2024-09-12T17:44:01.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.845+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=TPBJM0W7GZHK tag=Y1NBRFU1E762 type=write size=3595121 2024-09-12T17:44:01.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.853+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~B3M56P641JOW.0 size=1048576 2024-09-12T17:44:01.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.857+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~B3M56P641JOW.1 size=74856 2024-09-12T17:44:01.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.857+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=B3M56P641JOW tag=UKS6A70XNDAH type=write size=2172008 2024-09-12T17:44:01.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.861+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~4B8KTOY8MMF9.0 size=1048576 2024-09-12T17:44:01.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.865+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~4B8KTOY8MMF9.1 size=1048576 2024-09-12T17:44:01.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.869+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~4B8KTOY8MMF9.2 size=92876 2024-09-12T17:44:01.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.873+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=4B8KTOY8MMF9 tag=06UBDS7PCDMV type=write size=3238604 2024-09-12T17:44:01.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.881+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=E6I0LFG60L5G type=del size=1417132 2024-09-12T17:44:01.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.885+0000 7f51d61a08c0 1 < completed write operation key=10WBH16J1AF8 tag=WFLI48KB9GZG type=write size=597804 2024-09-12T17:44:01.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.889+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~YZTR6HPK7BR2.0 size=1048576 2024-09-12T17:44:01.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.893+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~YZTR6HPK7BR2.1 size=786258 2024-09-12T17:44:01.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.893+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=YZTR6HPK7BR2 tag=RSM1194A1GOC type=write size=2883410 2024-09-12T17:44:01.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.897+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~WKKGENDL7LXM.0 size=1048576 2024-09-12T17:44:01.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.901+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~WKKGENDL7LXM.1 size=646127 2024-09-12T17:44:01.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.905+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=WKKGENDL7LXM tag=CYCQ8IFS4J8M type=write size=2743279 2024-09-12T17:44:01.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.913+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~2LTJ65IMND7R.0 size=1048576 2024-09-12T17:44:01.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.917+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~2LTJ65IMND7R.1 size=399150 2024-09-12T17:44:01.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.917+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=2LTJ65IMND7R tag=R36XDO8YQ6S7 type=write size=2496302 2024-09-12T17:44:01.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.921+0000 7f51d61a08c0 1 < completed delete operation key=10WBH16J1AF8 tag=4Y0UXCUJ0BGJ type=del 2024-09-12T17:44:01.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.925+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=PNG9UW1VX03Q type=del size=3575633 2024-09-12T17:44:01.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.929+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~ON3US8TEA3LY.0 size=1048576 2024-09-12T17:44:01.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.933+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~ON3US8TEA3LY.1 size=277960 2024-09-12T17:44:01.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.937+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=ON3US8TEA3LY tag=JRFNIP3IS95T type=write size=2375112 2024-09-12T17:44:01.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.941+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=M1HOG9BCLV0K type=del size=2651124 2024-09-12T17:44:01.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.945+0000 7f51d61a08c0 1 < completed delete operation key=S292EX1P7IZA tag=SECHHJKI1V9Q type=del 2024-09-12T17:44:01.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.949+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=IS3A28HDOLVD type=write size=523290 2024-09-12T17:44:01.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.953+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=X284106CQD0H type=del 2024-09-12T17:44:01.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.957+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=ZWQWW124WDA7 type=del size=2219641 2024-09-12T17:44:01.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.961+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=SNNXFF1EZI33 type=del 2024-09-12T17:44:01.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.969+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~W3I90Q6GB15L.0 size=1048576 2024-09-12T17:44:01.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.973+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~W3I90Q6GB15L.1 size=127906 2024-09-12T17:44:01.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.973+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=W3I90Q6GB15L tag=R1MW14DX2IEX type=write size=2225058 2024-09-12T17:44:01.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.977+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~GXS7XSC99WJN.0 size=1048576 2024-09-12T17:44:01.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.981+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~GXS7XSC99WJN.1 size=1048576 2024-09-12T17:44:01.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.981+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~GXS7XSC99WJN.2 size=407191 2024-09-12T17:44:01.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.993+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=GXS7XSC99WJN tag=18LN4AGEU6BU type=write size=3552919 2024-09-12T17:44:01.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.993+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=8UU8KK12OIVU type=del size=3918154 2024-09-12T17:44:02.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:01.997+0000 7f51d61a08c0 1 < completed write operation key=XL9QDBTYSP7F tag=JQXWH3GXRU53 type=write size=816323 2024-09-12T17:44:02.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.001+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=WVUDCIQHYGZM type=write size=578022 2024-09-12T17:44:02.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.005+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=BYAHJ0L2O0V0 type=del 2024-09-12T17:44:02.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.013+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~T503S2L2IJOH.0 size=1048576 2024-09-12T17:44:02.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.017+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~T503S2L2IJOH.1 size=1048576 2024-09-12T17:44:02.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.017+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~T503S2L2IJOH.2 size=597561 2024-09-12T17:44:02.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.017+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=T503S2L2IJOH tag=F90JA3AQVDEH type=write size=3743289 2024-09-12T17:44:02.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.021+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~DRDX5NLLDU6M.0 size=1048576 2024-09-12T17:44:02.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.021+0000 7f51d61a08c0 1 < canceled part key=_multipart_DCLENF1A1W2Q.2~DRDX5NLLDU6M.1 size=725804 2024-09-12T17:44:02.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.029+0000 7f51d61a08c0 1 < canceled multipart upload key=DCLENF1A1W2Q upload=DRDX5NLLDU6M tag=HP2130DLY1EL type=write size=2822956 2024-09-12T17:44:02.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.033+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=H02P9XS5YXK6 type=del size=367408 2024-09-12T17:44:02.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.037+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=MX0ZB29BZ47D type=del 2024-09-12T17:44:02.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.041+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=AVYM86QT253D type=del size=808451 2024-09-12T17:44:02.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.049+0000 7f51d61a08c0 1 < suggested remove operation key=JT373R4HAJZS tag=T0CZ2W09381S type=del 2024-09-12T17:44:02.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.053+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~HY21E9YXO0YX.0 size=1048576 2024-09-12T17:44:02.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.057+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~HY21E9YXO0YX.1 size=898226 2024-09-12T17:44:02.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.057+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=HY21E9YXO0YX tag=JD60I3HNGKY2 type=write size=2995378 2024-09-12T17:44:02.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.061+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=8K6KKUATBFHK type=del 2024-09-12T17:44:02.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.069+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~C9L3WJGLUPCF.0 size=671757 2024-09-12T17:44:02.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.069+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=C9L3WJGLUPCF tag=J495LYGVEKX8 type=write size=1720333 2024-09-12T17:44:02.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.069+0000 7f51d61a08c0 1 < canceled part key=_multipart_593CD3H40DFH.2~B3M56P641JOW.0 size=1048576 2024-09-12T17:44:02.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.073+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~B3M56P641JOW.1 size=74856 2024-09-12T17:44:02.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.077+0000 7f51d61a08c0 1 < canceled multipart upload key=593CD3H40DFH upload=B3M56P641JOW tag=UKS6A70XNDAH type=write size=2172008 2024-09-12T17:44:02.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.081+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=Y5ELN3ZNYT3H type=del size=1366547 2024-09-12T17:44:02.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.089+0000 7f51d61a08c0 1 < suggested update operation key=X6KC9Z6LD7VG tag=E6I0LFG60L5G type=del size=1417132 2024-09-12T17:44:02.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.093+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=BHK9JG0CU2CA type=del size=845564 2024-09-12T17:44:02.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.097+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~YZTR6HPK7BR2.0 size=1048576 2024-09-12T17:44:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.101+0000 7f51d61a08c0 1 < completed part key=_multipart_XL9QDBTYSP7F.2~YZTR6HPK7BR2.1 size=786258 2024-09-12T17:44:02.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.105+0000 7f51d61a08c0 1 < completed multipart upload key=XL9QDBTYSP7F upload=YZTR6HPK7BR2 tag=RSM1194A1GOC type=write size=2883410 2024-09-12T17:44:02.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.109+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=MO1YF0QJQI4T type=write size=550838 2024-09-12T17:44:02.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.113+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~2LTJ65IMND7R.0 size=1048576 2024-09-12T17:44:02.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.117+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~2LTJ65IMND7R.1 size=399150 2024-09-12T17:44:02.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.121+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=2LTJ65IMND7R tag=R36XDO8YQ6S7 type=write size=2496302 2024-09-12T17:44:02.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.125+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=B009S538FK4I type=del size=3129648 2024-09-12T17:44:02.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.129+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=PNG9UW1VX03Q type=del 2024-09-12T17:44:02.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.133+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~2GM69CU43XL6.0 size=1048576 2024-09-12T17:44:02.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.137+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~2GM69CU43XL6.1 size=1048576 2024-09-12T17:44:02.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.141+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~2GM69CU43XL6.2 size=383491 2024-09-12T17:44:02.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.141+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=2GM69CU43XL6 tag=L02NRQ3ZGM7T type=write size=3529219 2024-09-12T17:44:02.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.145+0000 7f51d61a08c0 1 < completed delete operation key=2WC0YDQFKAJD tag=M1HOG9BCLV0K type=del 2024-09-12T17:44:02.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.149+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=CUADPR6GPE0X type=del size=805850 2024-09-12T17:44:02.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.153+0000 7f51d61a08c0 1 < completed write operation key=A7V478K2SNOF tag=IS3A28HDOLVD type=write size=523290 2024-09-12T17:44:02.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.157+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~48GSFX2DL21L.0 size=1048576 2024-09-12T17:44:02.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.161+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~48GSFX2DL21L.1 size=1005635 2024-09-12T17:44:02.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.161+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=48GSFX2DL21L tag=58VV4HXCV74H type=write size=3102787 2024-09-12T17:44:02.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.165+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=ZWQWW124WDA7 type=del 2024-09-12T17:44:02.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.169+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=U2TFUMN26FH4 type=del size=3382501 2024-09-12T17:44:02.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.173+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~W3I90Q6GB15L.0 size=1048576 2024-09-12T17:44:02.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.177+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~W3I90Q6GB15L.1 size=127906 2024-09-12T17:44:02.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.185+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=W3I90Q6GB15L tag=R1MW14DX2IEX type=write size=2225058 2024-09-12T17:44:02.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.193+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~YA44ZTT6SXVE.0 size=592142 2024-09-12T17:44:02.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.193+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=YA44ZTT6SXVE tag=KR78Z7LK2NTP type=write size=1640718 2024-09-12T17:44:02.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.197+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=8UU8KK12OIVU type=del 2024-09-12T17:44:02.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.201+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=997ZBHF6ANEL type=write size=456064 2024-09-12T17:44:02.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.209+0000 7f51d61a08c0 1 < completed write operation key=V5KMBUNVQA0H tag=WVUDCIQHYGZM type=write size=578022 2024-09-12T17:44:02.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.209+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=9MVG63QYPBIQ type=write size=218008 2024-09-12T17:44:02.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.213+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~T503S2L2IJOH.0 size=1048576 2024-09-12T17:44:02.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.217+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~T503S2L2IJOH.1 size=1048576 2024-09-12T17:44:02.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.217+0000 7f51d61a08c0 1 < canceled part key=_multipart_HY2US2MMDNI4.2~T503S2L2IJOH.2 size=597561 2024-09-12T17:44:02.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.225+0000 7f51d61a08c0 1 < canceled multipart upload key=HY2US2MMDNI4 upload=T503S2L2IJOH tag=F90JA3AQVDEH type=write size=3743289 2024-09-12T17:44:02.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.229+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=GM39NFXL1H4I type=del size=2934788 2024-09-12T17:44:02.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.233+0000 7f51d61a08c0 -1 < failed to complete operation key=JT373R4HAJZS tag=H02P9XS5YXK6 type=del size=367408: (22) Invalid argument 2024-09-12T17:44:02.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.237+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=LVIIXHIZELVV type=write size=111848 2024-09-12T17:44:02.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.241+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=AVYM86QT253D type=del 2024-09-12T17:44:02.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.245+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=68Q9KMDKB1YP type=del size=2246006 2024-09-12T17:44:02.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.249+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~HY21E9YXO0YX.0 size=1048576 2024-09-12T17:44:02.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.249+0000 7f51d61a08c0 1 < canceled part key=_multipart_X6KC9Z6LD7VG.2~HY21E9YXO0YX.1 size=898226 2024-09-12T17:44:02.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.253+0000 7f51d61a08c0 1 < canceled multipart upload key=X6KC9Z6LD7VG upload=HY21E9YXO0YX tag=JD60I3HNGKY2 type=write size=2995378 2024-09-12T17:44:02.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.257+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=MGDAVP09E0R4 type=del size=960011 2024-09-12T17:44:02.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.261+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~C9L3WJGLUPCF.0 size=671757 2024-09-12T17:44:02.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.269+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=C9L3WJGLUPCF tag=J495LYGVEKX8 type=write size=1720333 2024-09-12T17:44:02.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.273+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=OX9S0BOFSSSO type=del size=941918 2024-09-12T17:44:02.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.277+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=Y5ELN3ZNYT3H type=del 2024-09-12T17:44:02.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.281+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=YHB713Y4OSWF type=del size=3854098 2024-09-12T17:44:02.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.285+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=BHK9JG0CU2CA type=del 2024-09-12T17:44:02.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.289+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=HH280Z1S77XA type=del size=673005 2024-09-12T17:44:02.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.293+0000 7f51d61a08c0 1 < completed write operation key=XL9QDBTYSP7F tag=MO1YF0QJQI4T type=write size=550838 2024-09-12T17:44:02.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.297+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=LNT1CLN0186C type=write size=960042 2024-09-12T17:44:02.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.301+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=B009S538FK4I type=del 2024-09-12T17:44:02.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.301+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=DDVZS93P0YMN type=del size=510631 2024-09-12T17:44:02.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.305+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~2GM69CU43XL6.0 size=1048576 2024-09-12T17:44:02.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.305+0000 7f51d61a08c0 1 < canceled part key=_multipart_593CD3H40DFH.2~2GM69CU43XL6.1 size=1048576 2024-09-12T17:44:02.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.309+0000 7f51d61a08c0 1 < completed part key=_multipart_593CD3H40DFH.2~2GM69CU43XL6.2 size=383491 2024-09-12T17:44:02.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.317+0000 7f51d61a08c0 1 < canceled multipart upload key=593CD3H40DFH upload=2GM69CU43XL6 tag=L02NRQ3ZGM7T type=write size=3529219 2024-09-12T17:44:02.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.321+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~0D9GCE6P1577.0 size=1048576 2024-09-12T17:44:02.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.325+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~0D9GCE6P1577.1 size=28730 2024-09-12T17:44:02.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.325+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=0D9GCE6P1577 tag=CNO1X61W9YGX type=write size=2125882 2024-09-12T17:44:02.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.329+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=CUADPR6GPE0X type=del 2024-09-12T17:44:02.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.333+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=XESEKW9F231C type=del size=1513728 2024-09-12T17:44:02.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.337+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~48GSFX2DL21L.0 size=1048576 2024-09-12T17:44:02.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.341+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~48GSFX2DL21L.1 size=1005635 2024-09-12T17:44:02.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.345+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=48GSFX2DL21L tag=58VV4HXCV74H type=write size=3102787 2024-09-12T17:44:02.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.349+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=AO187QDWWSTH type=del size=2764256 2024-09-12T17:44:02.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.357+0000 7f51d61a08c0 1 < canceled operation key=2WC0YDQFKAJD tag=U2TFUMN26FH4 type=del size=3382501 2024-09-12T17:44:02.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.365+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~2V73D3T6SPYO.0 size=199989 2024-09-12T17:44:02.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.365+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=2V73D3T6SPYO tag=K03ID9JOYYA4 type=write size=1248565 2024-09-12T17:44:02.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.369+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~YA44ZTT6SXVE.0 size=592142 2024-09-12T17:44:02.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.373+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=YA44ZTT6SXVE tag=KR78Z7LK2NTP type=write size=1640718 2024-09-12T17:44:02.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.377+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=J2Z340XTIN89 type=del size=3596737 2024-09-12T17:44:02.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.381+0000 7f51d61a08c0 1 < completed write operation key=96OWZQXI2ALM tag=997ZBHF6ANEL type=write size=456064 2024-09-12T17:44:02.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.389+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~YHSCRNYH9766.0 size=1048576 2024-09-12T17:44:02.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.393+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~YHSCRNYH9766.1 size=1048576 2024-09-12T17:44:02.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.397+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~YHSCRNYH9766.2 size=540054 2024-09-12T17:44:02.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.397+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=YHSCRNYH9766 tag=F262B6N5KF1Z type=write size=3685782 2024-09-12T17:44:02.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.401+0000 7f51d61a08c0 1 < completed write operation key=7FBK3439R80H tag=9MVG63QYPBIQ type=write size=218008 2024-09-12T17:44:02.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.409+0000 7f51d61a08c0 1 > prepared part key=_multipart_IWEJXLG1CDAV.2~K2TUF0I4YMG5.0 size=368310 2024-09-12T17:44:02.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.409+0000 7f51d61a08c0 1 > prepared multipart upload key=IWEJXLG1CDAV upload=K2TUF0I4YMG5 tag=74ELQBUQU48G type=write size=1416886 2024-09-12T17:44:02.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.413+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=GM39NFXL1H4I type=del 2024-09-12T17:44:02.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.417+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=Z9A1F52E57M6 type=del size=1625847 2024-09-12T17:44:02.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.421+0000 7f51d61a08c0 1 < suggested remove operation key=ZCB4V47S38TN tag=LVIIXHIZELVV type=write 2024-09-12T17:44:02.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.429+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=JZ6I0G7RFNUP type=del size=2196548 2024-09-12T17:44:02.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.433+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=68Q9KMDKB1YP type=del 2024-09-12T17:44:02.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.437+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~YY2MHSLGVCOY.0 size=792463 2024-09-12T17:44:02.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.437+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=YY2MHSLGVCOY tag=TQA91VVZRVDR type=write size=1841039 2024-09-12T17:44:02.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.441+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=MGDAVP09E0R4 type=del 2024-09-12T17:44:02.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.445+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=Y3PEH2AQVETR type=write size=706232 2024-09-12T17:44:02.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.449+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=OX9S0BOFSSSO type=del 2024-09-12T17:44:02.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.453+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=5NLD179E2C0X type=del size=3155581 2024-09-12T17:44:02.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.457+0000 7f51d61a08c0 1 < canceled operation key=XL9QDBTYSP7F tag=YHB713Y4OSWF type=del size=3854098 2024-09-12T17:44:02.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.465+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=HOJTR4ZR72P6 type=write size=388519 2024-09-12T17:44:02.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.469+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=HH280Z1S77XA type=del 2024-09-12T17:44:02.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.473+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~PXAXIVQF7A2U.0 size=1048576 2024-09-12T17:44:02.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.477+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~PXAXIVQF7A2U.1 size=341704 2024-09-12T17:44:02.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.477+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=PXAXIVQF7A2U tag=97ORWW355DVJ type=write size=2438856 2024-09-12T17:44:02.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.481+0000 7f51d61a08c0 1 < completed write operation key=92CMI8Q29LB3 tag=LNT1CLN0186C type=write size=960042 2024-09-12T17:44:02.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.485+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=26FT5OEPH646 type=del size=2067604 2024-09-12T17:44:02.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.489+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=DDVZS93P0YMN type=del 2024-09-12T17:44:02.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.497+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~3NLE7OMZETIO.0 size=1048576 2024-09-12T17:44:02.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.497+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~3NLE7OMZETIO.1 size=1048576 2024-09-12T17:44:02.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.501+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~3NLE7OMZETIO.2 size=501312 2024-09-12T17:44:02.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.501+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=3NLE7OMZETIO tag=EAXBFQ7T3ED9 type=write size=3647040 2024-09-12T17:44:02.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.505+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~0D9GCE6P1577.0 size=1048576 2024-09-12T17:44:02.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.509+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~0D9GCE6P1577.1 size=28730 2024-09-12T17:44:02.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.513+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=0D9GCE6P1577 tag=CNO1X61W9YGX type=write size=2125882 2024-09-12T17:44:02.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.517+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=AHEY7HZH4KHK type=del size=3396998 2024-09-12T17:44:02.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.521+0000 7f51d61a08c0 1 < completed delete operation key=8J72KCZ5WRPU tag=XESEKW9F231C type=del 2024-09-12T17:44:02.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.529+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~95H607906O9R.0 size=1048576 2024-09-12T17:44:02.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.533+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~95H607906O9R.1 size=1048576 2024-09-12T17:44:02.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.537+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~95H607906O9R.2 size=257150 2024-09-12T17:44:02.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.537+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=95H607906O9R tag=FRXG8R6VMX2A type=write size=3402878 2024-09-12T17:44:02.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.541+0000 7f51d61a08c0 1 < canceled operation key=593CD3H40DFH tag=AO187QDWWSTH type=del size=2764256 2024-09-12T17:44:02.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.541+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=ZW79UUP68ZMU type=del size=3401075 2024-09-12T17:44:02.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.545+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~2V73D3T6SPYO.0 size=199989 2024-09-12T17:44:02.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.557+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=2V73D3T6SPYO tag=K03ID9JOYYA4 type=write size=1248565 2024-09-12T17:44:02.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.561+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=N4C7J2DTPT1S type=del size=1856752 2024-09-12T17:44:02.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.565+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=J2Z340XTIN89 type=del 2024-09-12T17:44:02.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.573+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~RTU5ZAY6C7F3.0 size=1048576 2024-09-12T17:44:02.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~RTU5ZAY6C7F3.1 size=1048576 2024-09-12T17:44:02.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~RTU5ZAY6C7F3.2 size=216929 2024-09-12T17:44:02.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.577+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=RTU5ZAY6C7F3 tag=7GMY95OFJHO4 type=write size=3362657 2024-09-12T17:44:02.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.581+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~YHSCRNYH9766.0 size=1048576 2024-09-12T17:44:02.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.585+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~YHSCRNYH9766.1 size=1048576 2024-09-12T17:44:02.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.589+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~YHSCRNYH9766.2 size=540054 2024-09-12T17:44:02.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.593+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=YHSCRNYH9766 tag=F262B6N5KF1Z type=write size=3685782 2024-09-12T17:44:02.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.597+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=N9T2FRVKDHU9 type=del size=4131292 2024-09-12T17:44:02.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.601+0000 7f51d61a08c0 1 < completed part key=_multipart_IWEJXLG1CDAV.2~K2TUF0I4YMG5.0 size=368310 2024-09-12T17:44:02.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.609+0000 7f51d61a08c0 1 < completed multipart upload key=IWEJXLG1CDAV upload=K2TUF0I4YMG5 tag=74ELQBUQU48G type=write size=1416886 2024-09-12T17:44:02.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.617+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~708W8I81GXH1.0 size=1048576 2024-09-12T17:44:02.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.621+0000 7f51d61a08c0 1 > prepared part key=_multipart_7FBK3439R80H.2~708W8I81GXH1.1 size=409139 2024-09-12T17:44:02.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.621+0000 7f51d61a08c0 1 > prepared multipart upload key=7FBK3439R80H upload=708W8I81GXH1 tag=KMGH806H3DQ8 type=write size=2506291 2024-09-12T17:44:02.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.625+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=Z9A1F52E57M6 type=del 2024-09-12T17:44:02.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.629+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=5UE2UGPTBY8U type=write size=903288 2024-09-12T17:44:02.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.633+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=JZ6I0G7RFNUP type=del 2024-09-12T17:44:02.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.637+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=DD033PAKR47O type=del size=2391628 2024-09-12T17:44:02.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.641+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~YY2MHSLGVCOY.0 size=792463 2024-09-12T17:44:02.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.645+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=YY2MHSLGVCOY tag=TQA91VVZRVDR type=write size=1841039 2024-09-12T17:44:02.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.649+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=IH8CHVIB3IE1 type=del size=662883 2024-09-12T17:44:02.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.657+0000 7f51d61a08c0 1 < canceled operation key=V5KMBUNVQA0H tag=Y3PEH2AQVETR type=write size=706232 2024-09-12T17:44:02.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.661+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~LRCI0WMZVU70.0 size=950540 2024-09-12T17:44:02.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.661+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=LRCI0WMZVU70 tag=KL4D8F9RHS7C type=write size=1999116 2024-09-12T17:44:02.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.665+0000 7f51d61a08c0 1 < canceled operation key=GJX1YGAQFXZ2 tag=5NLD179E2C0X type=del size=3155581 2024-09-12T17:44:02.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.669+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=78N808P6KPHT type=del size=1217885 2024-09-12T17:44:02.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.673+0000 7f51d61a08c0 1 < completed write operation key=A7V478K2SNOF tag=HOJTR4ZR72P6 type=write size=388519 2024-09-12T17:44:02.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.681+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~G5O9WVTY0TGV.0 size=433793 2024-09-12T17:44:02.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.681+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=G5O9WVTY0TGV tag=U3IL3P5V4DNA type=write size=1482369 2024-09-12T17:44:02.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.685+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~PXAXIVQF7A2U.0 size=1048576 2024-09-12T17:44:02.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.685+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~PXAXIVQF7A2U.1 size=341704 2024-09-12T17:44:02.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.693+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=PXAXIVQF7A2U tag=97ORWW355DVJ type=write size=2438856 2024-09-12T17:44:02.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.697+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=948HK87SXTRB type=del size=1335957 2024-09-12T17:44:02.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.701+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=26FT5OEPH646 type=del 2024-09-12T17:44:02.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.705+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=ME50GPIAUBU4 type=del size=3325980 2024-09-12T17:44:02.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.709+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~3NLE7OMZETIO.0 size=1048576 2024-09-12T17:44:02.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.713+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~3NLE7OMZETIO.1 size=1048576 2024-09-12T17:44:02.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.717+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~3NLE7OMZETIO.2 size=501312 2024-09-12T17:44:02.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.721+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=3NLE7OMZETIO tag=EAXBFQ7T3ED9 type=write size=3647040 2024-09-12T17:44:02.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.725+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=7GWNXU6BY962 type=write size=183856 2024-09-12T17:44:02.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.733+0000 7f51d61a08c0 1 < suggested remove operation key=U3GZL9YPFMZY tag=AHEY7HZH4KHK type=del 2024-09-12T17:44:02.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.741+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~QKMNJ1Y4NL8H.0 size=1048576 2024-09-12T17:44:02.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.745+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~QKMNJ1Y4NL8H.1 size=54775 2024-09-12T17:44:02.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.745+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=QKMNJ1Y4NL8H tag=UQIRYV8TOTE7 type=write size=2151927 2024-09-12T17:44:02.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.749+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~95H607906O9R.0 size=1048576 2024-09-12T17:44:02.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.749+0000 7f51d61a08c0 1 < canceled part key=_multipart_JT373R4HAJZS.2~95H607906O9R.1 size=1048576 2024-09-12T17:44:02.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.753+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~95H607906O9R.2 size=257150 2024-09-12T17:44:02.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.757+0000 7f51d61a08c0 1 < canceled multipart upload key=JT373R4HAJZS upload=95H607906O9R tag=FRXG8R6VMX2A type=write size=3402878 2024-09-12T17:44:02.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.765+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~C6BK024SVEE8.0 size=125598 2024-09-12T17:44:02.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.765+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=C6BK024SVEE8 tag=9RWF5AMKHCH3 type=write size=1174174 2024-09-12T17:44:02.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.769+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=ZW79UUP68ZMU type=del 2024-09-12T17:44:02.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.777+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~HCIF78ES4T9F.0 size=1048576 2024-09-12T17:44:02.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.781+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~HCIF78ES4T9F.1 size=612965 2024-09-12T17:44:02.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.781+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=HCIF78ES4T9F tag=5NNRXQBH60N0 type=write size=2710117 2024-09-12T17:44:02.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.785+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=N4C7J2DTPT1S type=del 2024-09-12T17:44:02.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.789+0000 7f51d61a08c0 1 > prepared part key=_multipart_JEXD4ZU5HJ2B.2~2FLPYXLKFJVL.0 size=877278 2024-09-12T17:44:02.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.789+0000 7f51d61a08c0 1 > prepared multipart upload key=JEXD4ZU5HJ2B upload=2FLPYXLKFJVL tag=78FLXP42JAWF type=write size=1925854 2024-09-12T17:44:02.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.793+0000 7f51d61a08c0 1 < canceled part key=_multipart_DCLENF1A1W2Q.2~RTU5ZAY6C7F3.0 size=1048576 2024-09-12T17:44:02.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.793+0000 7f51d61a08c0 1 < canceled part key=_multipart_DCLENF1A1W2Q.2~RTU5ZAY6C7F3.1 size=1048576 2024-09-12T17:44:02.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.793+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~RTU5ZAY6C7F3.2 size=216929 2024-09-12T17:44:02.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.801+0000 7f51d61a08c0 1 < canceled multipart upload key=DCLENF1A1W2Q upload=RTU5ZAY6C7F3 tag=7GMY95OFJHO4 type=write size=3362657 2024-09-12T17:44:02.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.805+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=0V3PAJ7Y0QHS type=del size=3370646 2024-09-12T17:44:02.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.813+0000 7f51d61a08c0 1 < suggested update operation key=10WBH16J1AF8 tag=N9T2FRVKDHU9 type=del size=4131292 2024-09-12T17:44:02.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.817+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=X5EYSCWE01OG type=del size=3218416 2024-09-12T17:44:02.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.821+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~708W8I81GXH1.0 size=1048576 2024-09-12T17:44:02.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.825+0000 7f51d61a08c0 1 < completed part key=_multipart_7FBK3439R80H.2~708W8I81GXH1.1 size=409139 2024-09-12T17:44:02.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.833+0000 7f51d61a08c0 1 < completed multipart upload key=7FBK3439R80H upload=708W8I81GXH1 tag=KMGH806H3DQ8 type=write size=2506291 2024-09-12T17:44:02.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.841+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~5V8HDM9AIOBW.0 size=578900 2024-09-12T17:44:02.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.841+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=5V8HDM9AIOBW tag=N3VN98S7N9VP type=write size=1627476 2024-09-12T17:44:02.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.845+0000 7f51d61a08c0 1 < completed write operation key=V5KMBUNVQA0H tag=5UE2UGPTBY8U type=write size=903288 2024-09-12T17:44:02.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.849+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=GC8H11RWLVTB type=del size=3339241 2024-09-12T17:44:02.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.853+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=DD033PAKR47O type=del 2024-09-12T17:44:02.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.857+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=62CZ2PWEEE5Q type=write size=843128 2024-09-12T17:44:02.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.861+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=IH8CHVIB3IE1 type=del 2024-09-12T17:44:02.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.865+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=EVY92THIM0SB type=del size=1945789 2024-09-12T17:44:02.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.869+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~LRCI0WMZVU70.0 size=950540 2024-09-12T17:44:02.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.877+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=LRCI0WMZVU70 tag=KL4D8F9RHS7C type=write size=1999116 2024-09-12T17:44:02.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.881+0000 7f51d61a08c0 1 > prepared operation key=SSOA6J297L1C tag=VY9EJ8KYQ4NX type=del size=3469606 2024-09-12T17:44:02.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.885+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=78N808P6KPHT type=del 2024-09-12T17:44:02.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.889+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~PXSL8ISVZUPB.0 size=1036781 2024-09-12T17:44:02.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.889+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=PXSL8ISVZUPB tag=6E0M40PBLSO8 type=write size=2085357 2024-09-12T17:44:02.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.893+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~G5O9WVTY0TGV.0 size=433793 2024-09-12T17:44:02.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.901+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=G5O9WVTY0TGV tag=U3IL3P5V4DNA type=write size=1482369 2024-09-12T17:44:02.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.905+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=5NHT821IGFR4 type=write size=497853 2024-09-12T17:44:02.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.909+0000 7f51d61a08c0 1 < canceled operation key=FKKV7SXZSP90 tag=948HK87SXTRB type=del size=1335957 2024-09-12T17:44:02.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.913+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~U0Q49P44VMO7.0 size=1048576 2024-09-12T17:44:02.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.917+0000 7f51d61a08c0 1 > prepared part key=_multipart_ZCB4V47S38TN.2~U0Q49P44VMO7.1 size=239183 2024-09-12T17:44:02.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.917+0000 7f51d61a08c0 1 > prepared multipart upload key=ZCB4V47S38TN upload=U0Q49P44VMO7 tag=DOGN5CLP2J41 type=write size=2336335 2024-09-12T17:44:02.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.925+0000 7f51d61a08c0 1 < completed delete operation key=JT373R4HAJZS tag=ME50GPIAUBU4 type=del 2024-09-12T17:44:02.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.925+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=WEKQ2AUTNBA0 type=del size=1911926 2024-09-12T17:44:02.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.929+0000 7f51d61a08c0 1 < completed write operation key=BF36J1Q6CZFB tag=7GWNXU6BY962 type=write size=183856 2024-09-12T17:44:02.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.937+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~1U67CBSOR0NV.0 size=1048576 2024-09-12T17:44:02.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.941+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~1U67CBSOR0NV.1 size=1048576 2024-09-12T17:44:02.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.941+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~1U67CBSOR0NV.2 size=434934 2024-09-12T17:44:02.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.941+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=1U67CBSOR0NV tag=AE36ZFH1QD16 type=write size=3580662 2024-09-12T17:44:02.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.941+0000 7f51d61a08c0 1 < canceled part key=_multipart_26X723PN8K8T.2~QKMNJ1Y4NL8H.0 size=1048576 2024-09-12T17:44:02.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.945+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~QKMNJ1Y4NL8H.1 size=54775 2024-09-12T17:44:02.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.953+0000 7f51d61a08c0 1 < canceled multipart upload key=26X723PN8K8T upload=QKMNJ1Y4NL8H tag=UQIRYV8TOTE7 type=write size=2151927 2024-09-12T17:44:02.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.957+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~CBUY27J9AGX8.0 size=1048576 2024-09-12T17:44:02.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.961+0000 7f51d61a08c0 1 > prepared part key=_multipart_I22NJJISU96B.2~CBUY27J9AGX8.1 size=484493 2024-09-12T17:44:02.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.961+0000 7f51d61a08c0 1 > prepared multipart upload key=I22NJJISU96B upload=CBUY27J9AGX8 tag=5YEAG6CEZJP1 type=write size=2581645 2024-09-12T17:44:02.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.965+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~C6BK024SVEE8.0 size=125598 2024-09-12T17:44:02.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.969+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=C6BK024SVEE8 tag=9RWF5AMKHCH3 type=write size=1174174 2024-09-12T17:44:02.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.973+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=AB8DO3LASS1R type=del size=3786741 2024-09-12T17:44:02.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.981+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~HCIF78ES4T9F.0 size=1048576 2024-09-12T17:44:02.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.981+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~HCIF78ES4T9F.1 size=612965 2024-09-12T17:44:02.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.989+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=HCIF78ES4T9F tag=5NNRXQBH60N0 type=write size=2710117 2024-09-12T17:44:02.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.993+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=OV30WHA9D3W9 type=del size=1838247 2024-09-12T17:44:03.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:02.997+0000 7f51d61a08c0 1 < completed part key=_multipart_JEXD4ZU5HJ2B.2~2FLPYXLKFJVL.0 size=877278 2024-09-12T17:44:03.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.005+0000 7f51d61a08c0 1 < completed multipart upload key=JEXD4ZU5HJ2B upload=2FLPYXLKFJVL tag=78FLXP42JAWF type=write size=1925854 2024-09-12T17:44:03.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.009+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~7ZRJ82Z92SBL.0 size=1048576 2024-09-12T17:44:03.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.013+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~7ZRJ82Z92SBL.1 size=1048576 2024-09-12T17:44:03.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.013+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~7ZRJ82Z92SBL.2 size=1035307 2024-09-12T17:44:03.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.013+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=7ZRJ82Z92SBL tag=RTGJ8MAFQ9JW type=write size=4181035 2024-09-12T17:44:03.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.021+0000 7f51d61a08c0 1 < suggested update operation key=2WC0YDQFKAJD tag=0V3PAJ7Y0QHS type=del size=3370646 2024-09-12T17:44:03.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.029+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~8VDFU85FHJ4M.0 size=1048576 2024-09-12T17:44:03.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.029+0000 7f51d61a08c0 1 > prepared part key=_multipart_U3GZL9YPFMZY.2~8VDFU85FHJ4M.1 size=329034 2024-09-12T17:44:03.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.029+0000 7f51d61a08c0 1 > prepared multipart upload key=U3GZL9YPFMZY upload=8VDFU85FHJ4M tag=0DFWVM9ZJYFP type=write size=2426186 2024-09-12T17:44:03.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.033+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=X5EYSCWE01OG type=del 2024-09-12T17:44:03.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.041+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~J86M0BGCITCB.0 size=1048576 2024-09-12T17:44:03.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.041+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~J86M0BGCITCB.1 size=1048576 2024-09-12T17:44:03.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.045+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~J86M0BGCITCB.2 size=942583 2024-09-12T17:44:03.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.045+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=J86M0BGCITCB tag=ZUSFPY82R0WB type=write size=4088311 2024-09-12T17:44:03.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.049+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~5V8HDM9AIOBW.0 size=578900 2024-09-12T17:44:03.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.057+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=5V8HDM9AIOBW tag=N3VN98S7N9VP type=write size=1627476 2024-09-12T17:44:03.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.061+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=RXSTY4EM8T5C type=del size=3838612 2024-09-12T17:44:03.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.065+0000 7f51d61a08c0 1 < completed delete operation key=A7V478K2SNOF tag=GC8H11RWLVTB type=del 2024-09-12T17:44:03.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.069+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=23N538Q6BD45 type=del size=608891 2024-09-12T17:44:03.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.073+0000 7f51d61a08c0 1 < suggested update operation key=HY2US2MMDNI4 tag=62CZ2PWEEE5Q type=write size=843128 2024-09-12T17:44:03.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.081+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~HHMVQ566PJ23.0 size=1048576 2024-09-12T17:44:03.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.085+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~HHMVQ566PJ23.1 size=201395 2024-09-12T17:44:03.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.085+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=HHMVQ566PJ23 tag=F3ZK118GHDDH type=write size=2298547 2024-09-12T17:44:03.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.089+0000 7f51d61a08c0 1 < completed delete operation key=GJX1YGAQFXZ2 tag=EVY92THIM0SB type=del 2024-09-12T17:44:03.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.093+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=8CX2DVMVK121 type=del size=3330334 2024-09-12T17:44:03.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.097+0000 7f51d61a08c0 1 < completed delete operation key=SSOA6J297L1C tag=VY9EJ8KYQ4NX type=del 2024-09-12T17:44:03.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.101+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=SAXTO8XRWYRC type=del size=1536738 2024-09-12T17:44:03.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.105+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~PXSL8ISVZUPB.0 size=1036781 2024-09-12T17:44:03.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.113+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=PXSL8ISVZUPB tag=6E0M40PBLSO8 type=write size=2085357 2024-09-12T17:44:03.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.117+0000 7f51d61a08c0 1 > prepared operation key=X6KC9Z6LD7VG tag=LSBZW9WWRAAA type=del size=1421451 2024-09-12T17:44:03.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.125+0000 7f51d61a08c0 1 < completed write operation key=83V7KSWRKFMZ tag=5NHT821IGFR4 type=write size=497853 2024-09-12T17:44:03.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.129+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=5M0RXSQIM6HW type=del size=2629278 2024-09-12T17:44:03.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.133+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~U0Q49P44VMO7.0 size=1048576 2024-09-12T17:44:03.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.133+0000 7f51d61a08c0 1 < completed part key=_multipart_ZCB4V47S38TN.2~U0Q49P44VMO7.1 size=239183 2024-09-12T17:44:03.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.141+0000 7f51d61a08c0 1 < completed multipart upload key=ZCB4V47S38TN upload=U0Q49P44VMO7 tag=DOGN5CLP2J41 type=write size=2336335 2024-09-12T17:44:03.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.149+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~VPL2LJW5KWYD.0 size=446427 2024-09-12T17:44:03.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.149+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=VPL2LJW5KWYD tag=3YSXFS8JUXN6 type=write size=1495003 2024-09-12T17:44:03.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.153+0000 7f51d61a08c0 -1 < failed to complete operation key=HY2US2MMDNI4 tag=WEKQ2AUTNBA0 type=del size=1911926: (22) Invalid argument 2024-09-12T17:44:03.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.157+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=J5VXZT3L43JU type=del size=472779 2024-09-12T17:44:03.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.161+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~1U67CBSOR0NV.0 size=1048576 2024-09-12T17:44:03.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.165+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~1U67CBSOR0NV.1 size=1048576 2024-09-12T17:44:03.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.169+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~1U67CBSOR0NV.2 size=434934 2024-09-12T17:44:03.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.173+0000 7f51d61a08c0 1 < completed multipart upload key=83V7KSWRKFMZ upload=1U67CBSOR0NV tag=AE36ZFH1QD16 type=write size=3580662 2024-09-12T17:44:03.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.177+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=EEVWYJD80SYU type=del size=2282835 2024-09-12T17:44:03.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.181+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~CBUY27J9AGX8.0 size=1048576 2024-09-12T17:44:03.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.185+0000 7f51d61a08c0 1 < completed part key=_multipart_I22NJJISU96B.2~CBUY27J9AGX8.1 size=484493 2024-09-12T17:44:03.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.189+0000 7f51d61a08c0 1 < completed multipart upload key=I22NJJISU96B upload=CBUY27J9AGX8 tag=5YEAG6CEZJP1 type=write size=2581645 2024-09-12T17:44:03.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.193+0000 7f51d61a08c0 1 > prepared operation key=8J72KCZ5WRPU tag=90R2HR53GRPH type=del size=2557058 2024-09-12T17:44:03.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.197+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=AB8DO3LASS1R type=del 2024-09-12T17:44:03.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.205+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=Z0XR3R7UKU37 type=del size=1194515 2024-09-12T17:44:03.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.209+0000 7f51d61a08c0 1 < suggested update operation key=GCL7UJEJM1UV tag=OV30WHA9D3W9 type=del size=1838247 2024-09-12T17:44:03.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.213+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=57PIMC80H52X type=del size=3306101 2024-09-12T17:44:03.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.217+0000 7f51d61a08c0 1 < canceled part key=_multipart_NIQAUF085D97.2~7ZRJ82Z92SBL.0 size=1048576 2024-09-12T17:44:03.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.221+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~7ZRJ82Z92SBL.1 size=1048576 2024-09-12T17:44:03.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.221+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~7ZRJ82Z92SBL.2 size=1035307 2024-09-12T17:44:03.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.229+0000 7f51d61a08c0 1 < canceled multipart upload key=NIQAUF085D97 upload=7ZRJ82Z92SBL tag=RTGJ8MAFQ9JW type=write size=4181035 2024-09-12T17:44:03.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.237+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~HZCVQGSZDNRZ.0 size=887096 2024-09-12T17:44:03.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.237+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=HZCVQGSZDNRZ tag=NOOYGQZJ50XZ type=write size=1935672 2024-09-12T17:44:03.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.241+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~8VDFU85FHJ4M.0 size=1048576 2024-09-12T17:44:03.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.241+0000 7f51d61a08c0 1 < completed part key=_multipart_U3GZL9YPFMZY.2~8VDFU85FHJ4M.1 size=329034 2024-09-12T17:44:03.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.249+0000 7f51d61a08c0 1 < completed multipart upload key=U3GZL9YPFMZY upload=8VDFU85FHJ4M tag=0DFWVM9ZJYFP type=write size=2426186 2024-09-12T17:44:03.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.253+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=J2S2RL9Y1QBJ type=write size=550118 2024-09-12T17:44:03.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.253+0000 7f51d61a08c0 1 < canceled part key=_multipart_26X723PN8K8T.2~J86M0BGCITCB.0 size=1048576 2024-09-12T17:44:03.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.257+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~J86M0BGCITCB.1 size=1048576 2024-09-12T17:44:03.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.261+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~J86M0BGCITCB.2 size=942583 2024-09-12T17:44:03.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.265+0000 7f51d61a08c0 1 < canceled multipart upload key=26X723PN8K8T upload=J86M0BGCITCB tag=ZUSFPY82R0WB type=write size=4088311 2024-09-12T17:44:03.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.273+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=6BW4FVICG25F type=del size=3358473 2024-09-12T17:44:03.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.281+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=RXSTY4EM8T5C type=del 2024-09-12T17:44:03.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.285+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~E2JP2B9EEC2S.0 size=1048576 2024-09-12T17:44:03.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.289+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~E2JP2B9EEC2S.1 size=1048576 2024-09-12T17:44:03.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.293+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~E2JP2B9EEC2S.2 size=758936 2024-09-12T17:44:03.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.293+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=E2JP2B9EEC2S tag=FX2OB5RQM953 type=write size=3904664 2024-09-12T17:44:03.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.297+0000 7f51d61a08c0 1 < completed delete operation key=BF36J1Q6CZFB tag=23N538Q6BD45 type=del 2024-09-12T17:44:03.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.305+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~224SWUDUYEIL.0 size=1048576 2024-09-12T17:44:03.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.305+0000 7f51d61a08c0 1 > prepared part key=_multipart_GCL7UJEJM1UV.2~224SWUDUYEIL.1 size=691965 2024-09-12T17:44:03.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.305+0000 7f51d61a08c0 1 > prepared multipart upload key=GCL7UJEJM1UV upload=224SWUDUYEIL tag=AYKB19EXAONJ type=write size=2789117 2024-09-12T17:44:03.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.309+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~HHMVQ566PJ23.0 size=1048576 2024-09-12T17:44:03.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.313+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~HHMVQ566PJ23.1 size=201395 2024-09-12T17:44:03.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.321+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=HHMVQ566PJ23 tag=F3ZK118GHDDH type=write size=2298547 2024-09-12T17:44:03.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.325+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=ZH9EBHIGR00Y type=del size=1759359 2024-09-12T17:44:03.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.333+0000 7f51d61a08c0 1 < suggested update operation key=BF36J1Q6CZFB tag=8CX2DVMVK121 type=del size=3330334 2024-09-12T17:44:03.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.337+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~GNGDSUWEDHFN.0 size=173337 2024-09-12T17:44:03.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.337+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=GNGDSUWEDHFN tag=PR1EZQ0H101Z type=write size=1221913 2024-09-12T17:44:03.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.341+0000 7f51d61a08c0 1 < completed delete operation key=1ZETSL5TXYSM tag=SAXTO8XRWYRC type=del 2024-09-12T17:44:03.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.349+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~38G9AXY79XNT.0 size=1048576 2024-09-12T17:44:03.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.353+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~38G9AXY79XNT.1 size=471770 2024-09-12T17:44:03.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.353+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=38G9AXY79XNT tag=UN59RXJPW0KW type=write size=2568922 2024-09-12T17:44:03.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.357+0000 7f51d61a08c0 1 < completed delete operation key=X6KC9Z6LD7VG tag=LSBZW9WWRAAA type=del 2024-09-12T17:44:03.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.361+0000 7f51d61a08c0 1 > prepared operation key=EDVAEE9FKH1T tag=RGY612RR3HGY type=del size=295167 2024-09-12T17:44:03.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.365+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=5M0RXSQIM6HW type=del 2024-09-12T17:44:03.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.369+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=Z2SWSFP1K5UR type=del size=3667976 2024-09-12T17:44:03.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.369+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~VPL2LJW5KWYD.0 size=446427 2024-09-12T17:44:03.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.377+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=VPL2LJW5KWYD tag=3YSXFS8JUXN6 type=write size=1495003 2024-09-12T17:44:03.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.381+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=3CQLF0XBWEHD type=write size=368285 2024-09-12T17:44:03.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.385+0000 7f51d61a08c0 1 < completed delete operation key=IWEJXLG1CDAV tag=J5VXZT3L43JU type=del 2024-09-12T17:44:03.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.389+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=0BGVIVZAF6H0 type=write size=63739 2024-09-12T17:44:03.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.393+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=EEVWYJD80SYU type=del 2024-09-12T17:44:03.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.397+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=93QRGXMQNEHZ type=write size=68516 2024-09-12T17:44:03.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.401+0000 7f51d61a08c0 1 < canceled operation key=8J72KCZ5WRPU tag=90R2HR53GRPH type=del size=2557058 2024-09-12T17:44:03.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.405+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~BCQ656V32ZBC.0 size=1048576 2024-09-12T17:44:03.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.409+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~BCQ656V32ZBC.1 size=1013671 2024-09-12T17:44:03.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.409+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=BCQ656V32ZBC tag=4APRN6RWDWIT type=write size=3110823 2024-09-12T17:44:03.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.413+0000 7f51d61a08c0 1 < canceled operation key=DCLENF1A1W2Q tag=Z0XR3R7UKU37 type=del size=1194515 2024-09-12T17:44:03.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.413+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=G6R7LS8B5ARI type=del size=2468108 2024-09-12T17:44:03.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.417+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=57PIMC80H52X type=del 2024-09-12T17:44:03.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.421+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=XRIKY5ZICZ19 type=write size=285811 2024-09-12T17:44:03.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.421+0000 7f51d61a08c0 1 < canceled part key=_multipart_S292EX1P7IZA.2~HZCVQGSZDNRZ.0 size=887096 2024-09-12T17:44:03.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.429+0000 7f51d61a08c0 1 < canceled multipart upload key=S292EX1P7IZA upload=HZCVQGSZDNRZ tag=NOOYGQZJ50XZ type=write size=1935672 2024-09-12T17:44:03.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.433+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=T8FQC794U3V2 type=del size=1757246 2024-09-12T17:44:03.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.437+0000 7f51d61a08c0 1 < completed write operation key=I22NJJISU96B tag=J2S2RL9Y1QBJ type=write size=550118 2024-09-12T17:44:03.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.441+0000 7f51d61a08c0 1 > prepared operation key=XL9QDBTYSP7F tag=DV3Z333XQ10G type=del size=3029919 2024-09-12T17:44:03.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.445+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=6BW4FVICG25F type=del 2024-09-12T17:44:03.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.449+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~K4TB1ZD9MAZT.0 size=1048576 2024-09-12T17:44:03.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.453+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~K4TB1ZD9MAZT.1 size=1048576 2024-09-12T17:44:03.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.457+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~K4TB1ZD9MAZT.2 size=162605 2024-09-12T17:44:03.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.457+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=K4TB1ZD9MAZT tag=HJ6YCIG8IFXP type=write size=3308333 2024-09-12T17:44:03.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.461+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~E2JP2B9EEC2S.0 size=1048576 2024-09-12T17:44:03.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.461+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~E2JP2B9EEC2S.1 size=1048576 2024-09-12T17:44:03.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.465+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~E2JP2B9EEC2S.2 size=758936 2024-09-12T17:44:03.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.473+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=E2JP2B9EEC2S tag=FX2OB5RQM953 type=write size=3904664 2024-09-12T17:44:03.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.473+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=9OG4XLLQJKLX type=del size=2610598 2024-09-12T17:44:03.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.477+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~224SWUDUYEIL.0 size=1048576 2024-09-12T17:44:03.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.481+0000 7f51d61a08c0 1 < completed part key=_multipart_GCL7UJEJM1UV.2~224SWUDUYEIL.1 size=691965 2024-09-12T17:44:03.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.489+0000 7f51d61a08c0 1 < completed multipart upload key=GCL7UJEJM1UV upload=224SWUDUYEIL tag=AYKB19EXAONJ type=write size=2789117 2024-09-12T17:44:03.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.493+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=8LSUI0IRPIER type=del size=3332255 2024-09-12T17:44:03.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.497+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=ZH9EBHIGR00Y type=del 2024-09-12T17:44:03.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.501+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~Y76JD8H920HD.0 size=1048576 2024-09-12T17:44:03.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.505+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~Y76JD8H920HD.1 size=1048576 2024-09-12T17:44:03.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.509+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~Y76JD8H920HD.2 size=1045155 2024-09-12T17:44:03.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.509+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=Y76JD8H920HD tag=SUFEUKNQ2X0O type=write size=4190883 2024-09-12T17:44:03.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.513+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~GNGDSUWEDHFN.0 size=173337 2024-09-12T17:44:03.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.517+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=GNGDSUWEDHFN tag=PR1EZQ0H101Z type=write size=1221913 2024-09-12T17:44:03.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.525+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~V0M670564Z0W.0 size=512608 2024-09-12T17:44:03.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.525+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=V0M670564Z0W tag=NE0E8X2RTDFG type=write size=1561184 2024-09-12T17:44:03.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.529+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~38G9AXY79XNT.0 size=1048576 2024-09-12T17:44:03.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.529+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~38G9AXY79XNT.1 size=471770 2024-09-12T17:44:03.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.537+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=38G9AXY79XNT tag=UN59RXJPW0KW type=write size=2568922 2024-09-12T17:44:03.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.541+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=SIAS1W1BCGQV type=del size=45646 2024-09-12T17:44:03.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.545+0000 7f51d61a08c0 1 < completed delete operation key=EDVAEE9FKH1T tag=RGY612RR3HGY type=del 2024-09-12T17:44:03.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.549+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=PWFXM6VVJ45G type=del size=485930 2024-09-12T17:44:03.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.553+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=Z2SWSFP1K5UR type=del 2024-09-12T17:44:03.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.553+0000 7f51d61a08c0 1 > prepared operation key=HUWVRJIZ5JYE tag=N6SC0MLRD5A6 type=del size=802201 2024-09-12T17:44:03.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.561+0000 7f51d61a08c0 1 < suggested remove operation key=HY2US2MMDNI4 tag=3CQLF0XBWEHD type=write 2024-09-12T17:44:03.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.565+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=5WLWKFAX209B type=write size=327021 2024-09-12T17:44:03.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.569+0000 7f51d61a08c0 1 < completed write operation key=96OWZQXI2ALM tag=0BGVIVZAF6H0 type=write size=63739 2024-09-12T17:44:03.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~EI97DA7FQC4S.0 size=638270 2024-09-12T17:44:03.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.577+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=EI97DA7FQC4S tag=41B7QKSRE3M9 type=write size=1686846 2024-09-12T17:44:03.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.585+0000 7f51d61a08c0 1 < suggested update operation key=10WBH16J1AF8 tag=93QRGXMQNEHZ type=write size=68516 2024-09-12T17:44:03.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.593+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~0Q6H3H85B48P.0 size=1048576 2024-09-12T17:44:03.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.597+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~0Q6H3H85B48P.1 size=1048576 2024-09-12T17:44:03.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.601+0000 7f51d61a08c0 1 > prepared part key=_multipart_EDVAEE9FKH1T.2~0Q6H3H85B48P.2 size=813836 2024-09-12T17:44:03.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.601+0000 7f51d61a08c0 1 > prepared multipart upload key=EDVAEE9FKH1T upload=0Q6H3H85B48P tag=1YMMDXQSG1Y5 type=write size=3959564 2024-09-12T17:44:03.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.605+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~BCQ656V32ZBC.0 size=1048576 2024-09-12T17:44:03.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.605+0000 7f51d61a08c0 1 < canceled part key=_multipart_1ZETSL5TXYSM.2~BCQ656V32ZBC.1 size=1013671 2024-09-12T17:44:03.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.613+0000 7f51d61a08c0 1 < canceled multipart upload key=1ZETSL5TXYSM upload=BCQ656V32ZBC tag=4APRN6RWDWIT type=write size=3110823 2024-09-12T17:44:03.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.621+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~QMWCSML00JEZ.0 size=1048576 2024-09-12T17:44:03.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.625+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~QMWCSML00JEZ.1 size=918367 2024-09-12T17:44:03.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.625+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=QMWCSML00JEZ tag=8YCDDSN9OH8S type=write size=3015519 2024-09-12T17:44:03.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.633+0000 7f51d61a08c0 1 < completed delete operation key=XL9QDBTYSP7F tag=G6R7LS8B5ARI type=del 2024-09-12T17:44:03.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.641+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~8GPY1IENZMQU.0 size=761550 2024-09-12T17:44:03.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.641+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=8GPY1IENZMQU tag=48ER0RAF5X5M type=write size=1810126 2024-09-12T17:44:03.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.649+0000 7f51d61a08c0 1 < suggested update operation key=U3GZL9YPFMZY tag=XRIKY5ZICZ19 type=write size=285811 2024-09-12T17:44:03.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.657+0000 7f51d61a08c0 1 > prepared part key=_multipart_1ZETSL5TXYSM.2~6XA8FLT9XRE1.0 size=748206 2024-09-12T17:44:03.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.657+0000 7f51d61a08c0 1 > prepared multipart upload key=1ZETSL5TXYSM upload=6XA8FLT9XRE1 tag=03OGRB05NQGY type=write size=1796782 2024-09-12T17:44:03.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.661+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=T8FQC794U3V2 type=del 2024-09-12T17:44:03.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.665+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=HR3N6P5PWKKH type=del size=3721947 2024-09-12T17:44:03.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.669+0000 7f51d61a08c0 1 < canceled operation key=XL9QDBTYSP7F tag=DV3Z333XQ10G type=del size=3029919 2024-09-12T17:44:03.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.673+0000 7f51d61a08c0 1 > prepared operation key=83V7KSWRKFMZ tag=32WKHKJ2NDVM type=del size=2374478 2024-09-12T17:44:03.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.677+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~K4TB1ZD9MAZT.0 size=1048576 2024-09-12T17:44:03.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.677+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~K4TB1ZD9MAZT.1 size=1048576 2024-09-12T17:44:03.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.681+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~K4TB1ZD9MAZT.2 size=162605 2024-09-12T17:44:03.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.689+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=K4TB1ZD9MAZT tag=HJ6YCIG8IFXP type=write size=3308333 2024-09-12T17:44:03.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.697+0000 7f51d61a08c0 1 > prepared part key=_multipart_A7V478K2SNOF.2~3X8VG3RRBA0K.0 size=478764 2024-09-12T17:44:03.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.697+0000 7f51d61a08c0 1 > prepared multipart upload key=A7V478K2SNOF upload=3X8VG3RRBA0K tag=U5YIN5AISMUQ type=write size=1527340 2024-09-12T17:44:03.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.705+0000 7f51d61a08c0 1 < suggested remove operation key=A7V478K2SNOF tag=9OG4XLLQJKLX type=del 2024-09-12T17:44:03.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.709+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=ZOXWN45H5WRM type=del size=1852836 2024-09-12T17:44:03.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.713+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=8LSUI0IRPIER type=del 2024-09-12T17:44:03.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.721+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~5X7IRNKKWOI7.0 size=1048576 2024-09-12T17:44:03.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.725+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~5X7IRNKKWOI7.1 size=268776 2024-09-12T17:44:03.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.725+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=5X7IRNKKWOI7 tag=FITETB7DDWNP type=write size=2365928 2024-09-12T17:44:03.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.729+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~Y76JD8H920HD.0 size=1048576 2024-09-12T17:44:03.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.733+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~Y76JD8H920HD.1 size=1048576 2024-09-12T17:44:03.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.737+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~Y76JD8H920HD.2 size=1045155 2024-09-12T17:44:03.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.745+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=Y76JD8H920HD tag=SUFEUKNQ2X0O type=write size=4190883 2024-09-12T17:44:03.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.753+0000 7f51d61a08c0 1 > prepared part key=_multipart_JT373R4HAJZS.2~DSVUKWY0WR0S.0 size=667932 2024-09-12T17:44:03.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.753+0000 7f51d61a08c0 1 > prepared multipart upload key=JT373R4HAJZS upload=DSVUKWY0WR0S tag=TLMRJG8SYCOE type=write size=1716508 2024-09-12T17:44:03.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.757+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~V0M670564Z0W.0 size=512608 2024-09-12T17:44:03.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.761+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=V0M670564Z0W tag=NE0E8X2RTDFG type=write size=1561184 2024-09-12T17:44:03.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.769+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~8M1FDDV4MG3D.0 size=1048576 2024-09-12T17:44:03.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.773+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~8M1FDDV4MG3D.1 size=1048576 2024-09-12T17:44:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.777+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~8M1FDDV4MG3D.2 size=676546 2024-09-12T17:44:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.777+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=8M1FDDV4MG3D tag=CJBZWAD79F3D type=write size=3822274 2024-09-12T17:44:03.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.781+0000 7f51d61a08c0 1 < completed delete operation key=26X723PN8K8T tag=SIAS1W1BCGQV type=del 2024-09-12T17:44:03.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.789+0000 7f51d61a08c0 1 > prepared part key=_multipart_FKKV7SXZSP90.2~G3LOFSKI2QPS.0 size=593234 2024-09-12T17:44:03.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.789+0000 7f51d61a08c0 1 > prepared multipart upload key=FKKV7SXZSP90 upload=G3LOFSKI2QPS tag=E7FSTD5JVBC2 type=write size=1641810 2024-09-12T17:44:03.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.793+0000 7f51d61a08c0 1 < canceled operation key=FKKV7SXZSP90 tag=PWFXM6VVJ45G type=del size=485930 2024-09-12T17:44:03.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.797+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=A3YFFO39DZMV type=del size=1464106 2024-09-12T17:44:03.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.797+0000 7f51d61a08c0 1 < completed delete operation key=HUWVRJIZ5JYE tag=N6SC0MLRD5A6 type=del 2024-09-12T17:44:03.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.805+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~RJAD7456O2BW.0 size=1048576 2024-09-12T17:44:03.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.809+0000 7f51d61a08c0 1 > prepared part key=_multipart_10WBH16J1AF8.2~RJAD7456O2BW.1 size=153318 2024-09-12T17:44:03.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.809+0000 7f51d61a08c0 1 > prepared multipart upload key=10WBH16J1AF8 upload=RJAD7456O2BW tag=QGHNZL5OSPL7 type=write size=2250470 2024-09-12T17:44:03.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.817+0000 7f51d61a08c0 1 < suggested remove operation key=7FBK3439R80H tag=5WLWKFAX209B type=write 2024-09-12T17:44:03.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.821+0000 7f51d61a08c0 1 > prepared operation key=593CD3H40DFH tag=WD5TW5SBO3P8 type=del size=2245448 2024-09-12T17:44:03.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.825+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~EI97DA7FQC4S.0 size=638270 2024-09-12T17:44:03.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.833+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=EI97DA7FQC4S tag=41B7QKSRE3M9 type=write size=1686846 2024-09-12T17:44:03.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.837+0000 7f51d61a08c0 1 > prepared operation key=2WC0YDQFKAJD tag=MU07WWN8WKM4 type=del size=1331081 2024-09-12T17:44:03.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.841+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~0Q6H3H85B48P.0 size=1048576 2024-09-12T17:44:03.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.845+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~0Q6H3H85B48P.1 size=1048576 2024-09-12T17:44:03.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.849+0000 7f51d61a08c0 1 < completed part key=_multipart_EDVAEE9FKH1T.2~0Q6H3H85B48P.2 size=813836 2024-09-12T17:44:03.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.853+0000 7f51d61a08c0 1 < completed multipart upload key=EDVAEE9FKH1T upload=0Q6H3H85B48P tag=1YMMDXQSG1Y5 type=write size=3959564 2024-09-12T17:44:03.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.861+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~1KNIQMQOSANG.0 size=1048576 2024-09-12T17:44:03.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.865+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~1KNIQMQOSANG.1 size=1048576 2024-09-12T17:44:03.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.865+0000 7f51d61a08c0 1 > prepared part key=_multipart_X6KC9Z6LD7VG.2~1KNIQMQOSANG.2 size=540962 2024-09-12T17:44:03.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.865+0000 7f51d61a08c0 1 > prepared multipart upload key=X6KC9Z6LD7VG upload=1KNIQMQOSANG tag=R6HJMI43F4K8 type=write size=3686690 2024-09-12T17:44:03.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.869+0000 7f51d61a08c0 1 < canceled part key=_multipart_BF36J1Q6CZFB.2~QMWCSML00JEZ.0 size=1048576 2024-09-12T17:44:03.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.869+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~QMWCSML00JEZ.1 size=918367 2024-09-12T17:44:03.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.877+0000 7f51d61a08c0 1 < canceled multipart upload key=BF36J1Q6CZFB upload=QMWCSML00JEZ tag=8YCDDSN9OH8S type=write size=3015519 2024-09-12T17:44:03.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.881+0000 7f51d61a08c0 1 > prepared operation key=FKKV7SXZSP90 tag=9P4LO1Q3V71Q type=del size=3936083 2024-09-12T17:44:03.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.885+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~8GPY1IENZMQU.0 size=761550 2024-09-12T17:44:03.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.893+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=8GPY1IENZMQU tag=48ER0RAF5X5M type=write size=1810126 2024-09-12T17:44:03.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.897+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=V237494J2BRI type=del size=23391 2024-09-12T17:44:03.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.901+0000 7f51d61a08c0 1 < completed part key=_multipart_1ZETSL5TXYSM.2~6XA8FLT9XRE1.0 size=748206 2024-09-12T17:44:03.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.909+0000 7f51d61a08c0 1 < completed multipart upload key=1ZETSL5TXYSM upload=6XA8FLT9XRE1 tag=03OGRB05NQGY type=write size=1796782 2024-09-12T17:44:03.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.913+0000 7f51d61a08c0 1 > prepared operation key=A7V478K2SNOF tag=XK27YEOKUQMZ type=write size=45134 2024-09-12T17:44:03.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.917+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=HR3N6P5PWKKH type=del 2024-09-12T17:44:03.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.921+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=L6YICR2X9UMG type=del size=3350268 2024-09-12T17:44:03.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.925+0000 7f51d61a08c0 1 < completed delete operation key=83V7KSWRKFMZ tag=32WKHKJ2NDVM type=del 2024-09-12T17:44:03.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.929+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=I5NXWXLGLCPI type=del size=3356074 2024-09-12T17:44:03.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.933+0000 7f51d61a08c0 1 < completed part key=_multipart_A7V478K2SNOF.2~3X8VG3RRBA0K.0 size=478764 2024-09-12T17:44:03.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.937+0000 7f51d61a08c0 1 < completed multipart upload key=A7V478K2SNOF upload=3X8VG3RRBA0K tag=U5YIN5AISMUQ type=write size=1527340 2024-09-12T17:44:03.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.941+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=WY4FDXC1WJE6 type=write size=357527 2024-09-12T17:44:03.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.945+0000 7f51d61a08c0 1 < completed delete operation key=U3GZL9YPFMZY tag=ZOXWN45H5WRM type=del 2024-09-12T17:44:03.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.949+0000 7f51d61a08c0 1 > prepared operation key=NIQAUF085D97 tag=E6KE6CJFPIWZ type=del size=1162402 2024-09-12T17:44:03.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.957+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~5X7IRNKKWOI7.0 size=1048576 2024-09-12T17:44:03.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.957+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~5X7IRNKKWOI7.1 size=268776 2024-09-12T17:44:03.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.965+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=5X7IRNKKWOI7 tag=FITETB7DDWNP type=write size=2365928 2024-09-12T17:44:03.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.969+0000 7f51d61a08c0 1 > prepared operation key=1ZETSL5TXYSM tag=VWDQ3PZRU62M type=write size=612917 2024-09-12T17:44:03.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.973+0000 7f51d61a08c0 1 < completed part key=_multipart_JT373R4HAJZS.2~DSVUKWY0WR0S.0 size=667932 2024-09-12T17:44:03.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.977+0000 7f51d61a08c0 1 < completed multipart upload key=JT373R4HAJZS upload=DSVUKWY0WR0S tag=TLMRJG8SYCOE type=write size=1716508 2024-09-12T17:44:03.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.985+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~SB4WPUUVR1NP.0 size=1048576 2024-09-12T17:44:03.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.989+0000 7f51d61a08c0 1 > prepared part key=_multipart_83V7KSWRKFMZ.2~SB4WPUUVR1NP.1 size=796874 2024-09-12T17:44:03.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.989+0000 7f51d61a08c0 1 > prepared multipart upload key=83V7KSWRKFMZ upload=SB4WPUUVR1NP tag=HXDFGJSETZ8Q type=write size=2894026 2024-09-12T17:44:03.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.989+0000 7f51d61a08c0 1 < canceled part key=_multipart_V5KMBUNVQA0H.2~8M1FDDV4MG3D.0 size=1048576 2024-09-12T17:44:03.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.989+0000 7f51d61a08c0 1 < canceled part key=_multipart_V5KMBUNVQA0H.2~8M1FDDV4MG3D.1 size=1048576 2024-09-12T17:44:03.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:03.993+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~8M1FDDV4MG3D.2 size=676546 2024-09-12T17:44:04.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.001+0000 7f51d61a08c0 1 < canceled multipart upload key=V5KMBUNVQA0H upload=8M1FDDV4MG3D tag=CJBZWAD79F3D type=write size=3822274 2024-09-12T17:44:04.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.013+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~0XZMUH194KVO.0 size=1048576 2024-09-12T17:44:04.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.013+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~0XZMUH194KVO.1 size=578744 2024-09-12T17:44:04.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.013+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=0XZMUH194KVO tag=RWELMXEP2H6Z type=write size=2675896 2024-09-12T17:44:04.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.021+0000 7f51d61a08c0 1 < completed part key=_multipart_FKKV7SXZSP90.2~G3LOFSKI2QPS.0 size=593234 2024-09-12T17:44:04.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.025+0000 7f51d61a08c0 1 < completed multipart upload key=FKKV7SXZSP90 upload=G3LOFSKI2QPS tag=E7FSTD5JVBC2 type=write size=1641810 2024-09-12T17:44:04.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.033+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~54R6RE2V8EU6.0 size=1048576 2024-09-12T17:44:04.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.037+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~54R6RE2V8EU6.1 size=775473 2024-09-12T17:44:04.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.037+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=54R6RE2V8EU6 tag=NFCJRRUMKZJM type=write size=2872625 2024-09-12T17:44:04.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.037+0000 7f51d61a08c0 1 < completed delete operation key=GCL7UJEJM1UV tag=A3YFFO39DZMV type=del 2024-09-12T17:44:04.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.045+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~CXP6RX2UOFP2.0 size=1048576 2024-09-12T17:44:04.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.049+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~CXP6RX2UOFP2.1 size=1048576 2024-09-12T17:44:04.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.053+0000 7f51d61a08c0 1 > prepared part key=_multipart_HUWVRJIZ5JYE.2~CXP6RX2UOFP2.2 size=447860 2024-09-12T17:44:04.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.053+0000 7f51d61a08c0 1 > prepared multipart upload key=HUWVRJIZ5JYE upload=CXP6RX2UOFP2 tag=3NZACPFIO8OX type=write size=3593588 2024-09-12T17:44:04.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.057+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~RJAD7456O2BW.0 size=1048576 2024-09-12T17:44:04.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.057+0000 7f51d61a08c0 1 < completed part key=_multipart_10WBH16J1AF8.2~RJAD7456O2BW.1 size=153318 2024-09-12T17:44:04.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.065+0000 7f51d61a08c0 1 < completed multipart upload key=10WBH16J1AF8 upload=RJAD7456O2BW tag=QGHNZL5OSPL7 type=write size=2250470 2024-09-12T17:44:04.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.073+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~0P12TBH9G0XB.0 size=1048576 2024-09-12T17:44:04.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.073+0000 7f51d61a08c0 1 > prepared part key=_multipart_XL9QDBTYSP7F.2~0P12TBH9G0XB.1 size=45387 2024-09-12T17:44:04.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.073+0000 7f51d61a08c0 1 > prepared multipart upload key=XL9QDBTYSP7F upload=0P12TBH9G0XB tag=FT3ZFH3S2K9E type=write size=2142539 2024-09-12T17:44:04.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.077+0000 7f51d61a08c0 1 < completed delete operation key=593CD3H40DFH tag=WD5TW5SBO3P8 type=del 2024-09-12T17:44:04.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.085+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~P2WYKTMBV0TF.0 size=1048576 2024-09-12T17:44:04.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.089+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~P2WYKTMBV0TF.1 size=1048576 2024-09-12T17:44:04.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.093+0000 7f51d61a08c0 1 > prepared part key=_multipart_GJX1YGAQFXZ2.2~P2WYKTMBV0TF.2 size=129403 2024-09-12T17:44:04.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.093+0000 7f51d61a08c0 1 > prepared multipart upload key=GJX1YGAQFXZ2 upload=P2WYKTMBV0TF tag=M0F6300MT9UJ type=write size=3275131 2024-09-12T17:44:04.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.097+0000 7f51d61a08c0 1 < suggested update operation key=2WC0YDQFKAJD tag=MU07WWN8WKM4 type=del size=1331081 2024-09-12T17:44:04.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.105+0000 7f51d61a08c0 1 > prepared part key=_multipart_26X723PN8K8T.2~2RELOTU7NT8R.0 size=142019 2024-09-12T17:44:04.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.105+0000 7f51d61a08c0 1 > prepared multipart upload key=26X723PN8K8T upload=2RELOTU7NT8R tag=ZH5QV1Z3NUFZ type=write size=1190595 2024-09-12T17:44:04.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.109+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~1KNIQMQOSANG.0 size=1048576 2024-09-12T17:44:04.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.113+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~1KNIQMQOSANG.1 size=1048576 2024-09-12T17:44:04.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.117+0000 7f51d61a08c0 1 < completed part key=_multipart_X6KC9Z6LD7VG.2~1KNIQMQOSANG.2 size=540962 2024-09-12T17:44:04.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.121+0000 7f51d61a08c0 1 < completed multipart upload key=X6KC9Z6LD7VG upload=1KNIQMQOSANG tag=R6HJMI43F4K8 type=write size=3686690 2024-09-12T17:44:04.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.129+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~RIJ56Q9IJTO4.0 size=1048576 2024-09-12T17:44:04.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.133+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~RIJ56Q9IJTO4.1 size=1015594 2024-09-12T17:44:04.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.133+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=RIJ56Q9IJTO4 tag=0ZKK1QUSOTQI type=write size=3112746 2024-09-12T17:44:04.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.137+0000 7f51d61a08c0 1 < completed delete operation key=FKKV7SXZSP90 tag=9P4LO1Q3V71Q type=del 2024-09-12T17:44:04.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.141+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=JFXOQQU01WMX type=write size=869590 2024-09-12T17:44:04.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.145+0000 7f51d61a08c0 1 < completed delete operation key=96OWZQXI2ALM tag=V237494J2BRI type=del 2024-09-12T17:44:04.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.149+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~U5MEFC2C7RBZ.0 size=1048576 2024-09-12T17:44:04.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.153+0000 7f51d61a08c0 1 > prepared part key=_multipart_2WC0YDQFKAJD.2~U5MEFC2C7RBZ.1 size=167180 2024-09-12T17:44:04.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.153+0000 7f51d61a08c0 1 > prepared multipart upload key=2WC0YDQFKAJD upload=U5MEFC2C7RBZ tag=CM0YCJ0M8SV1 type=write size=2264332 2024-09-12T17:44:04.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.157+0000 7f51d61a08c0 1 < completed write operation key=A7V478K2SNOF tag=XK27YEOKUQMZ type=write size=45134 2024-09-12T17:44:04.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.161+0000 7f51d61a08c0 1 > prepared operation key=GJX1YGAQFXZ2 tag=00MI0WGX2I7M type=del size=3972785 2024-09-12T17:44:04.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.169+0000 7f51d61a08c0 1 < suggested remove operation key=BF36J1Q6CZFB tag=L6YICR2X9UMG type=del 2024-09-12T17:44:04.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.173+0000 7f51d61a08c0 1 > prepared operation key=V5KMBUNVQA0H tag=0QGU38DTUP32 type=del size=550315 2024-09-12T17:44:04.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.177+0000 7f51d61a08c0 1 < completed delete operation key=I22NJJISU96B tag=I5NXWXLGLCPI type=del 2024-09-12T17:44:04.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.185+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~XLYZZLWQEC90.0 size=1048576 2024-09-12T17:44:04.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.189+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~XLYZZLWQEC90.1 size=1048576 2024-09-12T17:44:04.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.189+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~XLYZZLWQEC90.2 size=929924 2024-09-12T17:44:04.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.189+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=XLYZZLWQEC90 tag=S4K93Y00WOUW type=write size=4075652 2024-09-12T17:44:04.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.193+0000 7f51d61a08c0 1 < completed write operation key=IWEJXLG1CDAV tag=WY4FDXC1WJE6 type=write size=357527 2024-09-12T17:44:04.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.201+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~2YXX1RXRP984.0 size=1048576 2024-09-12T17:44:04.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.205+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~2YXX1RXRP984.1 size=1048576 2024-09-12T17:44:04.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.209+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~2YXX1RXRP984.2 size=205491 2024-09-12T17:44:04.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.209+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=2YXX1RXRP984 tag=UH65992WOG1N type=write size=3351219 2024-09-12T17:44:04.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.213+0000 7f51d61a08c0 1 < completed delete operation key=NIQAUF085D97 tag=E6KE6CJFPIWZ type=del 2024-09-12T17:44:04.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.221+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~3SEX6P2Y21YY.0 size=1048576 2024-09-12T17:44:04.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.225+0000 7f51d61a08c0 1 > prepared part key=_multipart_92CMI8Q29LB3.2~3SEX6P2Y21YY.1 size=668640 2024-09-12T17:44:04.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.225+0000 7f51d61a08c0 1 > prepared multipart upload key=92CMI8Q29LB3 upload=3SEX6P2Y21YY tag=5XZF5NEHOETF type=write size=2765792 2024-09-12T17:44:04.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.233+0000 7f51d61a08c0 1 < suggested update operation key=1ZETSL5TXYSM tag=VWDQ3PZRU62M type=write size=612917 2024-09-12T17:44:04.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.237+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~ENR79NWVDQH5.0 size=611236 2024-09-12T17:44:04.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.237+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=ENR79NWVDQH5 tag=JE1W2NY1XYRB type=write size=1659812 2024-09-12T17:44:04.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.241+0000 7f51d61a08c0 1 < canceled part key=_multipart_83V7KSWRKFMZ.2~SB4WPUUVR1NP.0 size=1048576 2024-09-12T17:44:04.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.241+0000 7f51d61a08c0 1 < completed part key=_multipart_83V7KSWRKFMZ.2~SB4WPUUVR1NP.1 size=796874 2024-09-12T17:44:04.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.249+0000 7f51d61a08c0 1 < canceled multipart upload key=83V7KSWRKFMZ upload=SB4WPUUVR1NP tag=HXDFGJSETZ8Q type=write size=2894026 2024-09-12T17:44:04.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.257+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~SUJDGN9OQ3P1.0 size=1048576 2024-09-12T17:44:04.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.257+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~SUJDGN9OQ3P1.1 size=1048576 2024-09-12T17:44:04.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.261+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~SUJDGN9OQ3P1.2 size=172226 2024-09-12T17:44:04.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.261+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=SUJDGN9OQ3P1 tag=NOO7E9L9V1S6 type=write size=3317954 2024-09-12T17:44:04.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.265+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~0XZMUH194KVO.0 size=1048576 2024-09-12T17:44:04.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.269+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~0XZMUH194KVO.1 size=578744 2024-09-12T17:44:04.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.277+0000 7f51d61a08c0 1 < completed multipart upload key=HUWVRJIZ5JYE upload=0XZMUH194KVO tag=RWELMXEP2H6Z type=write size=2675896 2024-09-12T17:44:04.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.281+0000 7f51d61a08c0 1 > prepared operation key=BF36J1Q6CZFB tag=1K9MZIP0I6RO type=write size=210943 2024-09-12T17:44:04.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.285+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~54R6RE2V8EU6.0 size=1048576 2024-09-12T17:44:04.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.285+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~54R6RE2V8EU6.1 size=775473 2024-09-12T17:44:04.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.293+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=54R6RE2V8EU6 tag=NFCJRRUMKZJM type=write size=2872625 2024-09-12T17:44:04.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.297+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=6FBQUFKH0EJ3 type=write size=562938 2024-09-12T17:44:04.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.301+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~CXP6RX2UOFP2.0 size=1048576 2024-09-12T17:44:04.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.305+0000 7f51d61a08c0 1 < completed part key=_multipart_HUWVRJIZ5JYE.2~CXP6RX2UOFP2.1 size=1048576 2024-09-12T17:44:04.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.305+0000 7f51d61a08c0 1 < canceled part key=_multipart_HUWVRJIZ5JYE.2~CXP6RX2UOFP2.2 size=447860 2024-09-12T17:44:04.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.309+0000 7f51d61a08c0 1 < canceled multipart upload key=HUWVRJIZ5JYE upload=CXP6RX2UOFP2 tag=3NZACPFIO8OX type=write size=3593588 2024-09-12T17:44:04.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.317+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~VNGYM0R8J93K.0 size=534734 2024-09-12T17:44:04.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.317+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=VNGYM0R8J93K tag=ZIG8RM6GKIDT type=write size=1583310 2024-09-12T17:44:04.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.317+0000 7f51d61a08c0 1 < canceled part key=_multipart_XL9QDBTYSP7F.2~0P12TBH9G0XB.0 size=1048576 2024-09-12T17:44:04.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.317+0000 7f51d61a08c0 1 < canceled part key=_multipart_XL9QDBTYSP7F.2~0P12TBH9G0XB.1 size=45387 2024-09-12T17:44:04.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.325+0000 7f51d61a08c0 1 < canceled multipart upload key=XL9QDBTYSP7F upload=0P12TBH9G0XB tag=FT3ZFH3S2K9E type=write size=2142539 2024-09-12T17:44:04.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.329+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=FX255OYLRY3H type=del size=449813 2024-09-12T17:44:04.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.333+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~P2WYKTMBV0TF.0 size=1048576 2024-09-12T17:44:04.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.337+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~P2WYKTMBV0TF.1 size=1048576 2024-09-12T17:44:04.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.337+0000 7f51d61a08c0 1 < completed part key=_multipart_GJX1YGAQFXZ2.2~P2WYKTMBV0TF.2 size=129403 2024-09-12T17:44:04.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.345+0000 7f51d61a08c0 1 < completed multipart upload key=GJX1YGAQFXZ2 upload=P2WYKTMBV0TF tag=M0F6300MT9UJ type=write size=3275131 2024-09-12T17:44:04.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.349+0000 7f51d61a08c0 1 > prepared operation key=GCL7UJEJM1UV tag=THVVYNBDTWC1 type=del size=2984522 2024-09-12T17:44:04.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.353+0000 7f51d61a08c0 1 < completed part key=_multipart_26X723PN8K8T.2~2RELOTU7NT8R.0 size=142019 2024-09-12T17:44:04.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.365+0000 7f51d61a08c0 1 < completed multipart upload key=26X723PN8K8T upload=2RELOTU7NT8R tag=ZH5QV1Z3NUFZ type=write size=1190595 2024-09-12T17:44:04.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.369+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=GBSFB09OGYS4 type=del size=1567002 2024-09-12T17:44:04.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.373+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~RIJ56Q9IJTO4.0 size=1048576 2024-09-12T17:44:04.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.377+0000 7f51d61a08c0 1 < completed part key=_multipart_BF36J1Q6CZFB.2~RIJ56Q9IJTO4.1 size=1015594 2024-09-12T17:44:04.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.381+0000 7f51d61a08c0 1 < completed multipart upload key=BF36J1Q6CZFB upload=RIJ56Q9IJTO4 tag=0ZKK1QUSOTQI type=write size=3112746 2024-09-12T17:44:04.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.385+0000 7f51d61a08c0 1 > prepared operation key=JT373R4HAJZS tag=PZ6PZ279JIKI type=write size=32309 2024-09-12T17:44:04.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.393+0000 7f51d61a08c0 1 < suggested remove operation key=IWEJXLG1CDAV tag=JFXOQQU01WMX type=write 2024-09-12T17:44:04.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.397+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=UZVTOZN2DVVM type=del size=1387589 2024-09-12T17:44:04.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.401+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~U5MEFC2C7RBZ.0 size=1048576 2024-09-12T17:44:04.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.405+0000 7f51d61a08c0 1 < completed part key=_multipart_2WC0YDQFKAJD.2~U5MEFC2C7RBZ.1 size=167180 2024-09-12T17:44:04.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.413+0000 7f51d61a08c0 1 < completed multipart upload key=2WC0YDQFKAJD upload=U5MEFC2C7RBZ tag=CM0YCJ0M8SV1 type=write size=2264332 2024-09-12T17:44:04.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.417+0000 7f51d61a08c0 1 > prepared operation key=I22NJJISU96B tag=JW2Z40ITHPLV type=write size=432096 2024-09-12T17:44:04.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.421+0000 7f51d61a08c0 1 < canceled operation key=GJX1YGAQFXZ2 tag=00MI0WGX2I7M type=del size=3972785 2024-09-12T17:44:04.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.429+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~5319TZJF8UFN.0 size=1048576 2024-09-12T17:44:04.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.433+0000 7f51d61a08c0 1 > prepared part key=_multipart_96OWZQXI2ALM.2~5319TZJF8UFN.1 size=223212 2024-09-12T17:44:04.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.433+0000 7f51d61a08c0 1 > prepared multipart upload key=96OWZQXI2ALM upload=5319TZJF8UFN tag=ML84IRCC15RU type=write size=2320364 2024-09-12T17:44:04.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.437+0000 7f51d61a08c0 1 < completed delete operation key=V5KMBUNVQA0H tag=0QGU38DTUP32 type=del 2024-09-12T17:44:04.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.445+0000 7f51d61a08c0 1 > prepared part key=_multipart_NIQAUF085D97.2~ZJUIFHTE543E.0 size=773918 2024-09-12T17:44:04.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.445+0000 7f51d61a08c0 1 > prepared multipart upload key=NIQAUF085D97 upload=ZJUIFHTE543E tag=PJJVVUFC2QTO type=write size=1822494 2024-09-12T17:44:04.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.449+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~XLYZZLWQEC90.0 size=1048576 2024-09-12T17:44:04.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.449+0000 7f51d61a08c0 1 < canceled part key=_multipart_V5KMBUNVQA0H.2~XLYZZLWQEC90.1 size=1048576 2024-09-12T17:44:04.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.453+0000 7f51d61a08c0 1 < completed part key=_multipart_V5KMBUNVQA0H.2~XLYZZLWQEC90.2 size=929924 2024-09-12T17:44:04.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.457+0000 7f51d61a08c0 1 < canceled multipart upload key=V5KMBUNVQA0H upload=XLYZZLWQEC90 tag=S4K93Y00WOUW type=write size=4075652 2024-09-12T17:44:04.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.461+0000 7f51d61a08c0 1 > prepared operation key=7FBK3439R80H tag=80OCDFB7WHU2 type=del size=2012695 2024-09-12T17:44:04.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.465+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~2YXX1RXRP984.0 size=1048576 2024-09-12T17:44:04.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.469+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~2YXX1RXRP984.1 size=1048576 2024-09-12T17:44:04.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.473+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~2YXX1RXRP984.2 size=205491 2024-09-12T17:44:04.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.481+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=2YXX1RXRP984 tag=UH65992WOG1N type=write size=3351219 2024-09-12T17:44:04.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.485+0000 7f51d61a08c0 1 > prepared part key=_multipart_SSOA6J297L1C.2~LC531YFDZZ4C.0 size=758410 2024-09-12T17:44:04.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.485+0000 7f51d61a08c0 1 > prepared multipart upload key=SSOA6J297L1C upload=LC531YFDZZ4C tag=46IOQYVRPC81 type=write size=1806986 2024-09-12T17:44:04.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.489+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~3SEX6P2Y21YY.0 size=1048576 2024-09-12T17:44:04.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.493+0000 7f51d61a08c0 1 < completed part key=_multipart_92CMI8Q29LB3.2~3SEX6P2Y21YY.1 size=668640 2024-09-12T17:44:04.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.501+0000 7f51d61a08c0 1 < completed multipart upload key=92CMI8Q29LB3 upload=3SEX6P2Y21YY tag=5XZF5NEHOETF type=write size=2765792 2024-09-12T17:44:04.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.505+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=E4CKJ2BTME6W type=del size=4083210 2024-09-12T17:44:04.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.509+0000 7f51d61a08c0 1 < completed part key=_multipart_DCLENF1A1W2Q.2~ENR79NWVDQH5.0 size=611236 2024-09-12T17:44:04.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.513+0000 7f51d61a08c0 1 < completed multipart upload key=DCLENF1A1W2Q upload=ENR79NWVDQH5 tag=JE1W2NY1XYRB type=write size=1659812 2024-09-12T17:44:04.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.517+0000 7f51d61a08c0 1 > prepared operation key=10WBH16J1AF8 tag=UXIUN7D9Z2Z2 type=del size=1917439 2024-09-12T17:44:04.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.521+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~SUJDGN9OQ3P1.0 size=1048576 2024-09-12T17:44:04.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.525+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~SUJDGN9OQ3P1.1 size=1048576 2024-09-12T17:44:04.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.529+0000 7f51d61a08c0 1 < completed part key=_multipart_HY2US2MMDNI4.2~SUJDGN9OQ3P1.2 size=172226 2024-09-12T17:44:04.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.533+0000 7f51d61a08c0 1 < completed multipart upload key=HY2US2MMDNI4 upload=SUJDGN9OQ3P1 tag=NOO7E9L9V1S6 type=write size=3317954 2024-09-12T17:44:04.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.537+0000 7f51d61a08c0 1 > prepared operation key=JEXD4ZU5HJ2B tag=3XE1UVGJK4VV type=del size=3849699 2024-09-12T17:44:04.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.541+0000 7f51d61a08c0 1 < canceled operation key=BF36J1Q6CZFB tag=1K9MZIP0I6RO type=write size=210943 2024-09-12T17:44:04.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.545+0000 7f51d61a08c0 1 > prepared operation key=ZCB4V47S38TN tag=1P2AVQYXPHBY type=del size=2690879 2024-09-12T17:44:04.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.549+0000 7f51d61a08c0 1 < completed write operation key=I22NJJISU96B tag=6FBQUFKH0EJ3 type=write size=562938 2024-09-12T17:44:04.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.557+0000 7f51d61a08c0 1 > prepared operation key=DCLENF1A1W2Q tag=BQ1NYZ89HPAA type=write size=746609 2024-09-12T17:44:04.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.561+0000 7f51d61a08c0 1 < completed part key=_multipart_S292EX1P7IZA.2~VNGYM0R8J93K.0 size=534734 2024-09-12T17:44:04.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.565+0000 7f51d61a08c0 1 < completed multipart upload key=S292EX1P7IZA upload=VNGYM0R8J93K tag=ZIG8RM6GKIDT type=write size=1583310 2024-09-12T17:44:04.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.573+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~FI80MUL64R83.0 size=1048576 2024-09-12T17:44:04.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.577+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~FI80MUL64R83.1 size=578760 2024-09-12T17:44:04.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.577+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=FI80MUL64R83 tag=113YI1D9NHEB type=write size=2675912 2024-09-12T17:44:04.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.581+0000 7f51d61a08c0 1 < completed delete operation key=HY2US2MMDNI4 tag=FX255OYLRY3H type=del 2024-09-12T17:44:04.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.585+0000 7f51d61a08c0 1 > prepared operation key=92CMI8Q29LB3 tag=Y33ND75L1Z72 type=del size=1702082 2024-09-12T17:44:04.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.593+0000 7f51d61a08c0 1 < canceled operation key=GCL7UJEJM1UV tag=THVVYNBDTWC1 type=del size=2984522 2024-09-12T17:44:04.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.597+0000 7f51d61a08c0 1 > prepared part key=_multipart_BF36J1Q6CZFB.2~X6478ILTRZ1U.0 size=513685 2024-09-12T17:44:04.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.597+0000 7f51d61a08c0 1 > prepared multipart upload key=BF36J1Q6CZFB upload=X6478ILTRZ1U tag=2KRGC122DT3N type=write size=1562261 2024-09-12T17:44:04.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.601+0000 7f51d61a08c0 1 < completed delete operation key=U3GZL9YPFMZY tag=GBSFB09OGYS4 type=del 2024-09-12T17:44:04.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.605+0000 7f51d61a08c0 1 > prepared operation key=U3GZL9YPFMZY tag=4J1CFSPBSWJW type=del size=820561 2024-09-12T17:44:04.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.609+0000 7f51d61a08c0 1 < completed write operation key=JT373R4HAJZS tag=PZ6PZ279JIKI type=write size=32309 2024-09-12T17:44:04.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.613+0000 7f51d61a08c0 1 > prepared operation key=HY2US2MMDNI4 tag=D1YBI3SUS6DH type=del size=565361 2024-09-12T17:44:04.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.621+0000 7f51d61a08c0 1 < canceled operation key=7FBK3439R80H tag=UZVTOZN2DVVM type=del size=1387589 2024-09-12T17:44:04.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.629+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~MFLS1DB62C8O.0 size=1048576 2024-09-12T17:44:04.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.629+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~MFLS1DB62C8O.1 size=1048576 2024-09-12T17:44:04.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.633+0000 7f51d61a08c0 1 > prepared part key=_multipart_593CD3H40DFH.2~MFLS1DB62C8O.2 size=665663 2024-09-12T17:44:04.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.633+0000 7f51d61a08c0 1 > prepared multipart upload key=593CD3H40DFH upload=MFLS1DB62C8O tag=YJV11WFULADK type=write size=3811391 2024-09-12T17:44:04.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.641+0000 7f51d61a08c0 1 < completed write operation key=I22NJJISU96B tag=JW2Z40ITHPLV type=write size=432096 2024-09-12T17:44:04.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.645+0000 7f51d61a08c0 1 > prepared operation key=96OWZQXI2ALM tag=36943B8Y1O7L type=del size=2142918 2024-09-12T17:44:04.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.649+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~5319TZJF8UFN.0 size=1048576 2024-09-12T17:44:04.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.653+0000 7f51d61a08c0 1 < completed part key=_multipart_96OWZQXI2ALM.2~5319TZJF8UFN.1 size=223212 2024-09-12T17:44:04.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.657+0000 7f51d61a08c0 1 < completed multipart upload key=96OWZQXI2ALM upload=5319TZJF8UFN tag=ML84IRCC15RU type=write size=2320364 2024-09-12T17:44:04.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.665+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~QIJDHDD0GAEY.0 size=1048576 2024-09-12T17:44:04.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.669+0000 7f51d61a08c0 1 > prepared part key=_multipart_DCLENF1A1W2Q.2~QIJDHDD0GAEY.1 size=37418 2024-09-12T17:44:04.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.669+0000 7f51d61a08c0 1 > prepared multipart upload key=DCLENF1A1W2Q upload=QIJDHDD0GAEY tag=30ELET1JBIXN type=write size=2134570 2024-09-12T17:44:04.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.673+0000 7f51d61a08c0 1 < completed part key=_multipart_NIQAUF085D97.2~ZJUIFHTE543E.0 size=773918 2024-09-12T17:44:04.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.681+0000 7f51d61a08c0 1 < completed multipart upload key=NIQAUF085D97 upload=ZJUIFHTE543E tag=PJJVVUFC2QTO type=write size=1822494 2024-09-12T17:44:04.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.689+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~F9PEH05GX3GB.0 size=1048576 2024-09-12T17:44:04.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.689+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~F9PEH05GX3GB.1 size=1048576 2024-09-12T17:44:04.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.693+0000 7f51d61a08c0 1 > prepared part key=_multipart_S292EX1P7IZA.2~F9PEH05GX3GB.2 size=603948 2024-09-12T17:44:04.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.693+0000 7f51d61a08c0 1 > prepared multipart upload key=S292EX1P7IZA upload=F9PEH05GX3GB tag=H2ABZIV8TMZS type=write size=3749676 2024-09-12T17:44:04.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.697+0000 7f51d61a08c0 1 < completed delete operation key=7FBK3439R80H tag=80OCDFB7WHU2 type=del 2024-09-12T17:44:04.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.705+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~ARFOZ7LROWEF.0 size=1048576 2024-09-12T17:44:04.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.705+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~ARFOZ7LROWEF.1 size=1048576 2024-09-12T17:44:04.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.709+0000 7f51d61a08c0 1 > prepared part key=_multipart_HY2US2MMDNI4.2~ARFOZ7LROWEF.2 size=906815 2024-09-12T17:44:04.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.709+0000 7f51d61a08c0 1 > prepared multipart upload key=HY2US2MMDNI4 upload=ARFOZ7LROWEF tag=08OQPYHFSFIP type=write size=4052543 2024-09-12T17:44:04.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.713+0000 7f51d61a08c0 1 < completed part key=_multipart_SSOA6J297L1C.2~LC531YFDZZ4C.0 size=758410 2024-09-12T17:44:04.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.721+0000 7f51d61a08c0 1 < completed multipart upload key=SSOA6J297L1C upload=LC531YFDZZ4C tag=46IOQYVRPC81 type=write size=1806986 2024-09-12T17:44:04.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.725+0000 7f51d61a08c0 1 > prepared operation key=26X723PN8K8T tag=H4S4YV2QGDBG type=del size=3410697 2024-09-12T17:44:04.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.729+0000 7f51d61a08c0 1 < completed delete operation key=DCLENF1A1W2Q tag=E4CKJ2BTME6W type=del 2024-09-12T17:44:04.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.741+0000 7f51d61a08c0 1 > prepared part key=_multipart_V5KMBUNVQA0H.2~BXG2ZZIAG4FS.0 size=206928 2024-09-12T17:44:04.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.741+0000 7f51d61a08c0 1 > prepared multipart upload key=V5KMBUNVQA0H upload=BXG2ZZIAG4FS tag=FRLI7JWZX9MK type=write size=1255504 2024-09-12T17:44:04.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.749+0000 7f51d61a08c0 1 < suggested update operation key=10WBH16J1AF8 tag=UXIUN7D9Z2Z2 type=del size=1917439 2024-09-12T17:44:04.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.761+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~E1YM08ZPHXK6.0 size=1048576 2024-09-12T17:44:04.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.761+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~E1YM08ZPHXK6.1 size=1048576 2024-09-12T17:44:04.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.765+0000 7f51d61a08c0 1 > prepared part key=_multipart_3LE20KMMPH8P.2~E1YM08ZPHXK6.2 size=610439 2024-09-12T17:44:04.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.765+0000 7f51d61a08c0 1 > prepared multipart upload key=3LE20KMMPH8P upload=E1YM08ZPHXK6 tag=XHWRWV1OGUWT type=write size=3756167 2024-09-12T17:44:04.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.769+0000 7f51d61a08c0 1 < completed delete operation key=JEXD4ZU5HJ2B tag=3XE1UVGJK4VV type=del 2024-09-12T17:44:04.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:44:04.773+0000 7f51d61a08c0 1 > prepared operation key=IWEJXLG1CDAV tag=A64F9NVCJXE0 type=del size=722790 2024-09-12T17:44:04.777 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_stats.simulate (28685 ms) 2024-09-12T17:44:04.777 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from cls_rgw_stats (28685 ms total) 2024-09-12T17:44:04.778 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:44:04.778 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:44:05.047 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 1 test from 1 test suite ran. (30875 ms total) 2024-09-12T17:44:05.047 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 1 test. 2024-09-12T17:44:05.055 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:44:05.056 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:44:05.111 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T17:44:05.113 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T17:44:05.113 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T17:44:05.181 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-12T17:44:05.182 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T17:44:05.182 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:44:07.067 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 31 tests from CmpOmap 2024-09-12T17:44:07.068 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T17:44:07.084 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (17 ms) 2024-09-12T17:44:07.085 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T17:44:07.091 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (7 ms) 2024-09-12T17:44:07.091 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T17:44:07.094 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T17:44:07.095 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T17:44:07.101 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (7 ms) 2024-09-12T17:44:07.101 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T17:44:07.108 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-12T17:44:07.108 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T17:44:07.125 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_u64 (16 ms) 2024-09-12T17:44:07.125 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T17:44:07.132 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (7 ms) 2024-09-12T17:44:07.132 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T17:44:07.137 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (5 ms) 2024-09-12T17:44:07.137 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T17:44:07.143 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (7 ms) 2024-09-12T17:44:07.143 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T17:44:07.151 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (8 ms) 2024-09-12T17:44:07.151 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T17:44:07.152 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T17:44:07.152 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T17:44:07.154 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (2 ms) 2024-09-12T17:44:07.154 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T17:44:07.167 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (13 ms) 2024-09-12T17:44:07.167 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T17:44:07.185 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (16 ms) 2024-09-12T17:44:07.185 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T17:44:07.197 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (14 ms) 2024-09-12T17:44:07.197 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T17:44:07.216 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (18 ms) 2024-09-12T17:44:07.216 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T17:44:07.237 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_str (21 ms) 2024-09-12T17:44:07.237 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T17:44:07.252 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (16 ms) 2024-09-12T17:44:07.253 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T17:44:07.257 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (5 ms) 2024-09-12T17:44:07.258 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T17:44:07.264 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-09-12T17:44:07.264 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T17:44:07.267 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (2 ms) 2024-09-12T17:44:07.267 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T17:44:07.269 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (3 ms) 2024-09-12T17:44:07.269 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T17:44:07.286 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (16 ms) 2024-09-12T17:44:07.286 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T17:44:07.302 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (16 ms) 2024-09-12T17:44:07.302 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T17:44:07.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (21 ms) 2024-09-12T17:44:07.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T17:44:07.341 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (19 ms) 2024-09-12T17:44:07.341 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T17:44:07.346 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (5 ms) 2024-09-12T17:44:07.347 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T17:44:07.354 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (8 ms) 2024-09-12T17:44:07.354 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T17:44:07.357 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-12T17:44:07.357 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T17:44:07.359 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T17:44:07.359 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T17:44:07.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (25 ms) 2024-09-12T17:44:07.384 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 31 tests from CmpOmap (317 ms total) 2024-09-12T17:44:07.384 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:44:07.384 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:44:08.065 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 31 tests from 1 test suite ran. (2884 ms total) 2024-09-12T17:44:08.065 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 31 tests. 2024-09-12T17:44:08.071 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:44:08.072 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:44:08.127 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T17:44:08.128 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T17:44:08.129 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T17:44:08.192 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-12T17:44:08.193 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:44:08.193 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:44:08.193 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T17:44:08.193 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T17:44:11.124 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2931 ms) 2024-09-12T17:44:11.124 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T17:44:14.143 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3020 ms) 2024-09-12T17:44:14.143 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T17:44:17.156 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.Reserve (3013 ms) 2024-09-12T17:44:17.157 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T17:44:20.167 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3010 ms) 2024-09-12T17:44:20.167 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T17:44:24.232 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.Commit (4066 ms) 2024-09-12T17:44:24.233 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T17:44:28.282 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.Stats (4048 ms) 2024-09-12T17:44:28.282 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T17:44:33.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (5050 ms) 2024-09-12T17:44:33.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T17:44:36.347 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.Abort (3017 ms) 2024-09-12T17:44:36.347 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T17:44:39.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.ReserveError (3063 ms) 2024-09-12T17:44:39.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T17:44:42.435 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.CommitError (3025 ms) 2024-09-12T17:44:42.435 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T17:44:45.496 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.AbortError (3061 ms) 2024-09-12T17:44:45.496 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T17:44:48.549 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3053 ms) 2024-09-12T17:44:48.550 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T17:44:51.592 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3043 ms) 2024-09-12T17:44:51.592 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T17:44:54.598 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3005 ms) 2024-09-12T17:44:54.598 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T17:44:57.650 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3054 ms) 2024-09-12T17:44:57.651 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T17:45:00.700 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3049 ms) 2024-09-12T17:45:00.700 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T17:45:03.724 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3023 ms) 2024-09-12T17:45:03.724 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T17:45:06.777 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.Cleanup (3050 ms) 2024-09-12T17:45:06.777 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T17:45:22.055 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.MultiProducer (15278 ms) 2024-09-12T17:45:22.055 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T17:45:27.125 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5074 ms) 2024-09-12T17:45:27.125 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T17:45:40.053 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12928 ms) 2024-09-12T17:45:40.054 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T17:45:47.054 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6999 ms) 2024-09-12T17:45:47.054 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T17:45:54.123 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (7071 ms) 2024-09-12T17:45:54.123 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T17:46:02.055 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (7933 ms) 2024-09-12T17:46:02.056 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from TestCls2PCQueue (113864 ms total) 2024-09-12T17:46:02.056 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:46:02.056 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:46:02.056 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 24 tests from 1 test suite ran. (113864 ms total) 2024-09-12T17:46:02.056 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 24 tests. 2024-09-12T17:46:02.062 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:46:02.062 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:46:02.122 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T17:46:02.123 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T17:46:02.123 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T17:46:02.199 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:02.200 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:02.200 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:46:02.200 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:46:04.076 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from ClsAccount 2024-09-12T17:46:04.076 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsAccount.add 2024-09-12T17:46:04.126 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsAccount.add (51 ms) 2024-09-12T17:46:04.127 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsAccount.get 2024-09-12T17:46:04.138 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsAccount.get (12 ms) 2024-09-12T17:46:04.139 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsAccount.rm 2024-09-12T17:46:04.155 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsAccount.rm (16 ms) 2024-09-12T17:46:04.155 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsAccount.list 2024-09-12T17:46:04.188 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsAccount.list (34 ms) 2024-09-12T17:46:04.189 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from ClsAccount (113 ms total) 2024-09-12T17:46:04.189 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:46:04.189 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:46:05.087 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 4 tests from 1 test suite ran. (2888 ms total) 2024-09-12T17:46:05.087 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 4 tests. 2024-09-12T17:46:05.092 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:46:05.092 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:46:05.146 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T17:46:05.147 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T17:46:05.148 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T17:46:05.221 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:05.221 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:05.222 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T17:46:05.222 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:46:07.138 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T17:46:07.138 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T17:46:07.165 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.init_existing_queue (27 ms) 2024-09-12T17:46:07.165 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T17:46:07.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.init_existing_omap (213 ms) 2024-09-12T17:46:07.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T17:46:07.684 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (307 ms) 2024-09-12T17:46:07.684 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T17:46:07.687 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-12T17:46:07.687 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T17:46:07.693 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.defer1_after_init (6 ms) 2024-09-12T17:46:07.693 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T17:46:07.697 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.defer2_before_init (4 ms) 2024-09-12T17:46:07.697 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 6 tests from rgw_gc_log (560 ms total) 2024-09-12T17:46:07.697 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:46:07.697 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:46:08.153 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 6 tests from 1 test suite ran. (2932 ms total) 2024-09-12T17:46:08.154 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 6 tests. 2024-09-12T17:46:08.159 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:46:08.159 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:46:08.213 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T17:46:08.214 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T17:46:08.215 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i= 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i= 2024-09-12T17:46:08.321 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i= 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.322 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.323 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-12T17:46:08.324 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.325 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.325 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.325 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.325 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.325 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.325 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.325 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.325 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.325 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.325 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.325 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.326 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.326 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.326 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.326 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.326 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.326 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-12T17:46:08.326 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.326 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.327 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i= 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i= 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i= 2024-09-12T17:46:08.328 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.329 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.330 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.331 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.332 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.333 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i=v1 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i=v1 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.334 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i=v1 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.335 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.336 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.336 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.336 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.336 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.336 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.336 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.336 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.336 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.336 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-12T17:46:08.336 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.336 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.337 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.337 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.337 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.337 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.337 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.337 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.337 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.337 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.337 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.338 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.338 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.338 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.338 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.338 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.338 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.338 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-12T17:46:08.338 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.338 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.338 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.338 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.339 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.339 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.339 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.339 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.339 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.339 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.339 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.339 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.340 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.340 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.340 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.340 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.340 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.340 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-12T17:46:08.340 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.340 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.340 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.340 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.340 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.341 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.341 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.341 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.341 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.341 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.341 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.341 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.341 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.341 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.341 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.342 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.343 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.344 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.344 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.344 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.344 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-12T17:46:08.344 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.344 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.344 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.344 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.344 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.345 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.345 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.345 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.345 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.345 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.345 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.345 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.345 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.345 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.345 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.346 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.347 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.347 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.347 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.347 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.347 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.347 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.347 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-12T17:46:08.347 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.347 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.347 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.348 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.348 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.348 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.348 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.348 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.348 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.348 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.348 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.348 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestRGWObj.underscore (1 ms) 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i= 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.349 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i= 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i= 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.350 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.351 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.352 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.352 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.352 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.352 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.352 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.352 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.352 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.353 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.354 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.354 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.354 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.354 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.354 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.354 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.354 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.354 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.354 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.354 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.354 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.355 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.355 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-12T17:46:08.355 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.355 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.355 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.355 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.355 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.355 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.355 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.355 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.355 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.356 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.356 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.356 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.356 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.356 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.356 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.356 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.356 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.356 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.357 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.357 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.357 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i= 2024-09-12T17:46:08.357 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.357 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.357 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i= 2024-09-12T17:46:08.358 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.358 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-12T17:46:08.358 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i= 2024-09-12T17:46:08.358 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.358 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-12T17:46:08.358 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.358 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.359 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.359 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.359 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.359 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.359 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.359 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.360 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.360 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.360 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.360 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.360 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.360 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.360 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.361 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.362 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-12T17:46:08.363 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.364 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i=v1 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i=v1 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.365 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i=v1 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.366 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.367 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.368 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.368 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.368 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.368 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.368 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.368 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.368 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.369 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.369 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.369 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-12T17:46:08.369 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.369 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.369 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.369 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.369 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.370 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.371 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.372 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-12T17:46:08.373 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:46:08.373 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.373 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-12T17:46:08.373 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.373 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.373 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.373 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.373 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.373 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.373 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.373 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.374 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.375 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.376 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.377 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.378 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.379 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.379 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.379 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.379 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.379 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.379 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.379 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.379 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.379 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.379 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.379 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.380 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.380 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.380 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.380 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.380 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.380 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.380 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.381 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker_myobj", 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.382 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.383 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.383 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.383 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.383 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.383 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.383 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.383 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.383 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.383 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.383 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.383 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.384 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.384 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.384 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.384 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.384 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.384 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.384 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.385 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.385 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.385 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.385 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.385 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.385 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.385 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.385 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.385 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.385 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.386 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.386 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.386 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.386 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.386 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.386 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.387 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.387 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.387 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.387 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.387 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.387 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.387 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.387 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker_myobj", 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.388 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.389 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.389 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.389 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.389 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.389 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.389 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.389 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.389 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.389 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.389 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.390 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.391 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.391 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.391 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.391 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.391 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.391 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.392 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.392 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.392 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.392 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.392 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.392 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.392 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.393 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.393 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.393 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.393 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.393 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.393 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.393 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.393 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.393 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.393 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.394 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.395 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.396 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.396 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.396 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.396 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.396 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.396 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.397 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.397 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.397 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.397 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.397 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.397 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.398 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.399 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.400 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.400 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.400 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.400 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.400 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.400 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.400 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:46:08.400 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.400 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.401 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.402 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.403 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.403 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.403 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.403 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.403 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.404 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.404 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.404 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.404 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.404 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.404 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.404 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.404 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.404 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.404 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.404 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.405 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.405 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.405 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.405 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.405 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.405 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.405 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.406 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.407 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.408 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.408 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.408 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.408 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.408 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.408 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.408 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.408 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.408 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.408 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.408 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.409 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.410 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.410 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.410 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.410 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.410 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.410 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.410 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.410 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.410 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.412 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:46:08.413 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.413 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.413 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.413 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.413 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.413 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.413 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.413 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.413 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.414 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.414 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.414 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.414 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.414 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.414 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.414 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.415 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.415 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.415 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.415 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.415 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.415 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.415 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.415 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.415 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.415 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.416 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.417 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.418 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.419 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.420 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.421 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.422 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.423 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.424 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.424 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.424 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.424 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.424 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.424 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.424 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.424 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.424 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.424 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.424 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.425 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.425 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.425 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.425 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.425 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.425 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.425 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.425 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.425 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.426 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.427 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj", 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.428 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.429 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.430 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.431 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj", 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.432 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.433 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.434 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.435 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.435 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.435 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.435 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.435 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.435 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.435 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.435 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.435 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.435 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.436 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.436 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.436 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.436 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.436 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.436 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.436 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.436 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.436 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.436 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.437 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.438 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.439 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.440 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.441 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.441 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.441 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.441 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.441 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.441 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.441 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.441 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.441 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.442 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.443 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.444 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.445 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.445 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.445 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.445 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.445 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.445 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.445 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.445 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.445 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.445 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.445 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.446 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.446 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.446 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.446 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.446 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.446 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.446 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.446 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.446 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.446 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.446 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.447 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.448 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.449 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.450 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.451 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.452 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:46:08.452 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-12T17:46:08.452 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.452 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.452 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.452 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.452 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.452 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.452 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.452 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.452 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.453 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.454 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.455 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.455 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.455 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.455 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.455 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.455 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.455 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.455 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.456 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.457 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.457 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.457 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.457 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:46:08.457 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.457 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.457 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.457 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.457 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.457 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.457 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.458 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.459 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.460 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.461 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.462 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.463 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.464 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.465 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj_", 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.466 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.467 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.468 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.469 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj_", 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-12T17:46:08.470 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.471 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.472 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.473 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.474 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.475 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.476 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.477 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.478 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.479 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.480 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.481 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.482 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.483 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.484 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.485 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.486 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.487 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.488 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.488 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.488 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.488 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.488 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.488 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.489 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.489 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.489 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.489 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.489 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:46:08.489 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.490 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.491 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.491 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.491 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.491 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.491 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.491 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.491 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.491 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.492 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.492 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.492 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.492 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.492 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.492 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.492 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.492 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.492 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.492 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.493 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.493 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.493 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.493 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.493 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.493 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.493 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.493 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.494 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.495 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.496 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.497 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.497 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.497 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.497 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.497 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.497 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.497 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.498 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.498 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.498 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.498 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.498 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.498 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.499 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.500 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.501 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.501 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:46:08.501 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.501 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.501 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.501 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.501 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.501 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.501 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.501 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.501 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.502 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.503 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T17:46:08.503 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T17:46:08.503 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.503 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.503 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.503 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker_myobj", 2024-09-12T17:46:08.503 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.503 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.503 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.504 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.505 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.505 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.505 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.505 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.505 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.505 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.505 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.505 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker_myobj 2024-09-12T17:46:08.505 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.505 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.505 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.506 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker_myobj", 2024-09-12T17:46:08.506 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.506 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.506 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.506 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.506 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.506 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.506 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.506 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.506 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.506 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.507 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker_myobj 2024-09-12T17:46:08.508 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.508 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.508 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.508 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:46:08.508 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.508 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.508 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.508 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.508 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.508 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.508 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.509 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.509 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.509 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.509 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.509 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.509 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.509 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.509 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.509 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.509 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.509 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.510 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.511 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.512 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.513 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.514 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.514 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.514 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.514 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.514 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.514 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.514 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.514 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.514 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.514 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T17:46:08.514 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.515 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.516 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.517 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.517 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T17:46:08.517 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.517 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.517 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.517 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:46:08.517 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.517 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.518 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.518 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.518 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.518 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.518 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.518 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.518 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.518 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.518 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.518 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.519 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.519 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.519 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.519 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.519 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.519 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.519 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.519 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.520 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.520 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.520 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.520 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T17:46:08.520 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.521 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.522 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj", 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.523 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.524 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker___myobj 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj", 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.525 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.526 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker___myobj 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.527 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.528 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.529 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.530 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.530 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.530 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.530 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.530 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.530 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.530 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.530 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.530 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.530 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.531 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.532 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T17:46:08.533 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.534 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.535 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.536 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.537 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.538 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T17:46:08.539 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.540 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.540 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.540 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj_", 2024-09-12T17:46:08.540 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-12T17:46:08.540 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.540 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.540 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.540 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.540 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.540 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.540 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.541 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.541 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.541 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.541 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.541 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.541 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.541 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.541 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.541 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.542 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.542 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.542 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.542 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.542 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.542 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.542 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T17:46:08.542 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.542 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.542 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.542 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj_", 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.543 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.544 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.545 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:46:08.545 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.545 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.545 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.545 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.545 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.545 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.545 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.545 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.546 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.547 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.547 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T17:46:08.547 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.547 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.547 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.547 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:46:08.547 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.547 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.547 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.547 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.547 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.548 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.549 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.550 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.551 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.551 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.551 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.551 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.551 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.551 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.551 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T17:46:08.551 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.551 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.551 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.552 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T17:46:08.553 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.554 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.555 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.555 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.555 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.555 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.555 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.555 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.555 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.555 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.555 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.555 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.555 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.556 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.556 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.556 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.556 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:46:08.556 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.556 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-12T17:46:08.556 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-12T17:46:08.556 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:46:08.556 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-12T17:46:08.556 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.556 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.557 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-12T17:46:08.558 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-12T17:46:08.558 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-12T17:46:08.558 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-12T17:46:08.558 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.558 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.558 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.558 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:46:08.558 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T17:46:08.558 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T17:46:08.558 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:46:08.558 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:46:08.559 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T17:46:08.559 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 4 tests. 2024-09-12T17:46:08.559 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:46:08.559 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:46:08.574 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T17:46:08.575 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T17:46:08.575 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T17:46:08.677 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:08.677 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:08.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.740+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.744+0000 7f10019759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:08.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.744+0000 7f10019759c0 20 realm 2024-09-12T17:46:08.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.744+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.744+0000 7f10019759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:08.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.744+0000 7f10019759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:08.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.744+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.744+0000 7f10019759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:08.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.744+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.744+0000 7f10019759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:08.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.744+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.748+0000 7f10019759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:08.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.748+0000 7f10019759c0 20 searching for the correct realm 2024-09-12T17:46:08.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.756+0000 7f0fffc7c640 0 -- 172.21.15.97:0/4165409272 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x561b4f462ff0 msgr2=0x561b4f4653e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:08.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.764+0000 7f0fff47b640 0 -- 172.21.15.97:0/4165409272 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x561b4f467170 msgr2=0x561b4f4695a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.768+0000 7f10019759c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:46:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.768+0000 7f10019759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.768+0000 7f10019759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.768+0000 7f10019759c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:46:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.768+0000 7f10019759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.768+0000 7f10019759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.768+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.768+0000 7f10019759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:08.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.768+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.768+0000 7f10019759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:08.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.768+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:08.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 20 zone default found 2024-09-12T17:46:08.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 4 Realm: () 2024-09-12T17:46:08.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:46:08.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:46:08.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:08.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 20 zonegroup default 2024-09-12T17:46:08.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:08.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:08.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:08.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 20 started sync module instance, tier type = 2024-09-12T17:46:08.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.772+0000 7f10019759c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:46:08.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.788+0000 7f10019759c0 20 add_watcher() i=0 2024-09-12T17:46:08.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.788+0000 7f10019759c0 20 add_watcher() i=1 2024-09-12T17:46:08.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.788+0000 7f10019759c0 20 add_watcher() i=2 2024-09-12T17:46:08.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.788+0000 7f10019759c0 20 add_watcher() i=3 2024-09-12T17:46:08.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.788+0000 7f10019759c0 20 add_watcher() i=4 2024-09-12T17:46:08.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.788+0000 7f10019759c0 20 add_watcher() i=5 2024-09-12T17:46:08.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.788+0000 7f10019759c0 20 add_watcher() i=6 2024-09-12T17:46:08.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.792+0000 7f10019759c0 20 add_watcher() i=7 2024-09-12T17:46:08.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.792+0000 7f10019759c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:08.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f0eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:08.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:08.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:08.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 5 note: GC not initialized 2024-09-12T17:46:08.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f0eb4fe1640 20 reqs_thread_entry: start 2024-09-12T17:46:08.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 20 init_complete bucket index max shards: 11 2024-09-12T17:46:08.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 20 Filter name: none 2024-09-12T17:46:08.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f0e2e7fc640 20 reqs_thread_entry: start 2024-09-12T17:46:08.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T17:46:08.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:08.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T17:46:08.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:46:08.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T17:46:08.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.796+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:08.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T17:46:08.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:46:08.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 10 cache get: name=default.rgw.meta+users.keys+dYhPRZH/TkIoR6TNgGdR93TvtOk= : miss 2024-09-12T17:46:08.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 20 rados->read ofs=0 len=0 2024-09-12T17:46:08.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:08.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 10 cache put: name=default.rgw.meta+users.keys+dYhPRZH/TkIoR6TNgGdR93TvtOk= info.flags=0x0 2024-09-12T17:46:08.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 10 adding default.rgw.meta+users.keys+dYhPRZH/TkIoR6TNgGdR93TvtOk= to cache LRU end 2024-09-12T17:46:08.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 10 cache get: name=default.rgw.meta+users.keys+dYhPRZH/TkIoR6TNgGdR93TvtOk= : hit (negative entry) 2024-09-12T17:46:08.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 10 cache get: name=default.rgw.meta+users.keys+dYhPRZH/TkIoR6TNgGdR93TvtOk= : hit (negative entry) 2024-09-12T17:46:08.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:46:08.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:46:08.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f10019759c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T17:46:08.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f0ee2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725889 cookie 94675294112448 notifier 5550 bl.length()=697 2024-09-12T17:46:08.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f0ee2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:46:08.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.800+0000 7f0ee2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:46:08.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.804+0000 7f10019759c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:46:08.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.804+0000 7f10019759c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:46:08.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.804+0000 7f10019759c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T17:46:08.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.808+0000 7f0ee2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725888 cookie 94675294130448 notifier 5550 bl.length()=194 2024-09-12T17:46:08.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.808+0000 7f0ee2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:46:08.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.808+0000 7f0ee2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:46:08.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.812+0000 7f10019759c0 10 cache put: name=default.rgw.meta+users.keys+dYhPRZH/TkIoR6TNgGdR93TvtOk= info.flags=0x7 2024-09-12T17:46:08.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.812+0000 7f10019759c0 10 moving default.rgw.meta+users.keys+dYhPRZH/TkIoR6TNgGdR93TvtOk= to cache LRU end 2024-09-12T17:46:08.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.812+0000 7f10019759c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:dYhPRZH/TkIoR6TNgGdR93TvtOk=, ofs0, ns] 2024-09-12T17:46:08.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.812+0000 7f0ee2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725889 cookie 94675294128240 notifier 5550 bl.length()=203 2024-09-12T17:46:08.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.812+0000 7f0ee2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+dYhPRZH/TkIoR6TNgGdR93TvtOk= info.flags=0x7 2024-09-12T17:46:08.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.812+0000 7f0ee2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+dYhPRZH/TkIoR6TNgGdR93TvtOk= to cache LRU end 2024-09-12T17:46:08.817 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:46:08.817 INFO:tasks.workunit.client.0.smithi097.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T17:46:08.817 INFO:tasks.workunit.client.0.smithi097.stdout: "display_name": "librgw test user", 2024-09-12T17:46:08.817 INFO:tasks.workunit.client.0.smithi097.stdout: "email": "librgw@example.com", 2024-09-12T17:46:08.817 INFO:tasks.workunit.client.0.smithi097.stdout: "suspended": 0, 2024-09-12T17:46:08.817 INFO:tasks.workunit.client.0.smithi097.stdout: "max_buckets": 1000, 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: "subusers": [], 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: "keys": [ 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: { 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: "user": "ceph-test-librgw-file", 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: "access_key": "dYhPRZH/TkIoR6TNgGdR93TvtOk=", 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: "secret_key": "ZKhPzcnU3giWxpAgNBGkqIrVEGhNvpMMGELX9H9TwO6b8UxLuHZcCQ==", 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: "active": true, 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-12T17:46:08.804854Z" 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: ], 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: "swift_keys": [], 2024-09-12T17:46:08.818 INFO:tasks.workunit.client.0.smithi097.stdout: "caps": [], 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "default_placement": "", 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "default_storage_class": "", 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "placement_tags": [], 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_quota": { 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "user_quota": { 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-12T17:46:08.819 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: "temp_url_keys": [], 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: "type": "rgw", 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: "mfa_ids": [], 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: "account_id": "", 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: "path": "/", 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-12T17:46:08.804831Z", 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: "tags": [], 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: "group_ids": [] 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:46:08.820 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:46:08.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.816+0000 7f0eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:08.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.820+0000 7f10019759c0 20 remove_watcher() i=0 2024-09-12T17:46:08.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.820+0000 7f10019759c0 2 removed watcher, disabling cache 2024-09-12T17:46:08.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.820+0000 7f10019759c0 20 remove_watcher() i=1 2024-09-12T17:46:08.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.824+0000 7f10019759c0 20 remove_watcher() i=2 2024-09-12T17:46:08.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.824+0000 7f10019759c0 20 remove_watcher() i=3 2024-09-12T17:46:08.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.828+0000 7f10019759c0 20 remove_watcher() i=4 2024-09-12T17:46:08.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.832+0000 7f10019759c0 20 remove_watcher() i=5 2024-09-12T17:46:08.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.832+0000 7f10019759c0 20 remove_watcher() i=6 2024-09-12T17:46:08.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:08.836+0000 7f10019759c0 20 remove_watcher() i=7 2024-09-12T17:46:08.852 INFO:tasks.workunit.client.0.smithi097.stdout:phase 1.1 2024-09-12T17:46:08.869 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:46:08.870 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:46:08.870 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:46:08.870 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:46:08.882 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:08.882 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:09.182 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (312 ms) 2024-09-12T17:46:09.182 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:46:09.183 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:46:09.183 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:46:09.183 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:46:09.183 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:46:09.203 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T17:46:09.211 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/f1 2024-09-12T17:46:09.215 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/f2 2024-09-12T17:46:09.220 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T17:46:09.225 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T17:46:09.233 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T17:46:09.237 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T17:46:09.242 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T17:46:09.246 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T17:46:09.251 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T17:46:09.257 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T17:46:09.262 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T17:46:09.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_HIER1 (85 ms) 2024-09-12T17:46:09.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:46:09.502 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_DIRS1 (233 ms) 2024-09-12T17:46:09.502 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:46:09.502 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:46:09.502 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:46:09.542 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (41 ms) 2024-09-12T17:46:09.542 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:46:09.648 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (106 ms) 2024-09-12T17:46:09.648 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:46:09.648 INFO:tasks.workunit.client.0.smithi097.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T17:46:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (13 ms) 2024-09-12T17:46:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:46:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T17:46:09.676 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (14 ms) 2024-09-12T17:46:09.676 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:46:09.676 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:46:09.676 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:46:09.676 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:46:09.677 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:46:09.678 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:46:09.678 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:46:09.678 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:46:09.679 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:46:09.680 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:46:09.681 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:46:09.681 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:46:09.683 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:46:09.683 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:46:09.686 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:46:09.686 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:46:09.686 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:46:09.688 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:46:09.688 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:46:09.691 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:46:09.691 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READ_DIRS1 (16 ms) 2024-09-12T17:46:09.691 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:46:09.918 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_SETUP1 (226 ms) 2024-09-12T17:46:09.918 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:46:09.918 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:46:09.918 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:46:09.918 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:46:09.918 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:46:09.918 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:46:09.918 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:46:09.918 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:46:09.918 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:46:09.918 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:46:09.919 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:46:09.919 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:46:09.919 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:46:09.919 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:46:09.919 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:46:09.919 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:46:09.919 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:46:09.919 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:46:09.919 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:46:09.937 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:46:09.938 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:46:09.945 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:46:09.949 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:46:09.956 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:46:09.956 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:46:09.957 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:46:09.958 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:46:09.958 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:46:09.959 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:46:09.961 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:46:09.964 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:46:09.964 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:46:09.964 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:46:09.964 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:46:09.964 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.HIER1 (47 ms) 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:46:09.965 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:46:09.966 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:46:09.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:09.960+0000 7f02edc38a80 -1 shutting down 2024-09-12T17:46:09.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:09.964+0000 7f01c798a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57334, si_uid : 1000, si_addr0x3e80000dff6, si_status0 2024-09-12T17:46:39.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (29413 ms) 2024-09-12T17:46:39.378 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW (30508 ms total) 2024-09-12T17:46:39.378 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:46:39.378 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:46:39.378 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 24 tests from 1 test suite ran. (30508 ms total) 2024-09-12T17:46:39.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 24 tests. 2024-09-12T17:46:39.388 INFO:tasks.workunit.client.0.smithi097.stdout:phase 1.2 2024-09-12T17:46:39.410 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:46:39.410 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:46:39.411 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:46:39.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:46:39.420 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:39.421 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:40.171 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (761 ms) 2024-09-12T17:46:40.171 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:46:40.172 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT_NOROOT (0 ms) 2024-09-12T17:46:40.172 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:46:40.172 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:46:40.172 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:46:40.172 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T17:46:40.172 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:46:40.172 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T17:46:40.172 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:46:40.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:46:40.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:46:40.175 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:46:40.175 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:46:40.175 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:46:40.175 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:46:40.175 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:46:40.175 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:46:40.175 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:46:40.175 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:46:40.175 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:46:40.175 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:46:40.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:40.168+0000 7f31eb46aa80 -1 shutting down 2024-09-12T17:46:40.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:46:40.172+0000 7f30c51bc640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57979, si_uid : 1000, si_addr0x3e80000e27b, si_status0 2024-09-12T17:47:10.279 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30107 ms) 2024-09-12T17:47:10.280 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW (30869 ms total) 2024-09-12T17:47:10.280 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:47:10.280 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:47:10.280 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 24 tests from 1 test suite ran. (30869 ms total) 2024-09-12T17:47:10.280 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 24 tests. 2024-09-12T17:47:10.294 INFO:tasks.workunit.client.0.smithi097.stdout:phase 1.3 2024-09-12T17:47:10.317 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:47:10.317 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:47:10.317 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:47:10.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:47:10.329 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:10.329 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:10.685 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (368 ms) 2024-09-12T17:47:10.685 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:47:10.686 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:47:10.686 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:47:10.686 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:47:10.686 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:47:10.697 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_HIER1 (11 ms) 2024-09-12T17:47:10.697 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:47:10.800 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_DIRS1 (103 ms) 2024-09-12T17:47:10.800 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:47:10.800 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:47:10.800 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:47:10.800 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:47:10.800 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:47:10.801 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:47:10.802 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:47:10.803 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:47:10.803 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:47:10.804 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:47:10.804 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:47:10.804 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:47:10.805 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:47:10.806 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:47:10.808 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:47:10.808 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:47:10.808 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:47:10.809 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:47:10.809 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:47:10.811 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:47:10.811 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READ_DIRS1 (11 ms) 2024-09-12T17:47:10.811 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:47:10.812 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:47:10.813 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:47:10.813 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:47:10.813 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:47:10.813 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:47:10.813 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:47:10.813 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:47:10.813 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:47:10.813 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:47:10.829 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:47:10.829 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:47:10.837 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:47:10.840 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:47:10.847 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:47:10.847 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:47:10.848 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:47:10.848 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:47:10.849 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:47:10.850 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:47:10.851 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:47:10.855 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:47:10.855 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:47:10.855 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:47:10.855 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:47:10.855 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:47:10.855 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.HIER1 (44 ms) 2024-09-12T17:47:10.855 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:47:10.855 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:47:10.855 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:47:10.856 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:47:10.856 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:47:10.856 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:47:10.856 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:47:10.856 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:47:10.856 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:47:10.856 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:47:10.856 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:47:10.856 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:47:10.856 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:47:10.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:47:10.855+0000 7fdd3ddada80 -1 shutting down 2024-09-12T17:47:10.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:47:10.859+0000 7fdc17aff640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58624, si_uid : 1000, si_addr0x3e80000e500, si_status0 2024-09-12T17:47:40.693 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (29837 ms) 2024-09-12T17:47:40.693 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW (30375 ms total) 2024-09-12T17:47:40.693 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:47:40.693 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:47:40.693 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 24 tests from 1 test suite ran. (30375 ms total) 2024-09-12T17:47:40.693 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 24 tests. 2024-09-12T17:47:40.706 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2.1 2024-09-12T17:47:40.729 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:47:40.729 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:47:40.730 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:47:40.730 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:47:40.741 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:40.741 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:41.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (538 ms) 2024-09-12T17:47:41.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:47:41.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:47:41.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:47:41.287 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (19 ms) 2024-09-12T17:47:41.287 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:47:41.287 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:47:41.287 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:47:41.307 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave0 2024-09-12T17:47:41.325 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave1 2024-09-12T17:47:41.344 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave2 2024-09-12T17:47:41.365 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave3 2024-09-12T17:47:41.383 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave4 2024-09-12T17:47:41.403 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave5 2024-09-12T17:47:41.422 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave6 2024-09-12T17:47:41.443 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave7 2024-09-12T17:47:41.464 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave8 2024-09-12T17:47:41.485 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave9 2024-09-12T17:47:41.485 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (197 ms) 2024-09-12T17:47:41.485 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:47:42.177 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (692 ms) 2024-09-12T17:47:42.177 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:47:42.177 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:47:42.177 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:47:42.177 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:47:42.177 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:47:42.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:47:42.179+0000 7f0e77fdaa80 -1 shutting down 2024-09-12T17:47:42.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:47:42.179+0000 7f0d51d2c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59271, si_uid : 1000, si_addr0x3e80000e787, si_status0 2024-09-12T17:48:11.677 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (29500 ms) 2024-09-12T17:48:11.677 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from LibRGW (30947 ms total) 2024-09-12T17:48:11.677 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:48:11.677 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:48:11.677 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 9 tests from 1 test suite ran. (30947 ms total) 2024-09-12T17:48:11.677 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 9 tests. 2024-09-12T17:48:11.689 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2.2 2024-09-12T17:48:11.712 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:48:11.712 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:48:11.712 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:48:11.713 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:48:11.723 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:11.724 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:12.251 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (539 ms) 2024-09-12T17:48:12.251 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:48:12.252 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:48:12.252 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:48:12.252 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:48:12.252 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:48:12.312 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (60 ms) 2024-09-12T17:48:12.312 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:48:12.336 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave0 2024-09-12T17:48:12.358 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave1 2024-09-12T17:48:12.378 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave2 2024-09-12T17:48:12.403 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave3 2024-09-12T17:48:12.427 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave4 2024-09-12T17:48:12.448 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave5 2024-09-12T17:48:12.469 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave6 2024-09-12T17:48:12.490 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave7 2024-09-12T17:48:12.512 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave8 2024-09-12T17:48:12.533 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave9 2024-09-12T17:48:12.534 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (221 ms) 2024-09-12T17:48:12.534 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:48:13.359 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (826 ms) 2024-09-12T17:48:13.359 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:48:13.359 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:48:13.360 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:48:13.360 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:48:13.360 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:48:13.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:48:13.359+0000 7fd0951e8a80 -1 shutting down 2024-09-12T17:48:13.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:48:13.363+0000 7fcf6ef3a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59916, si_uid : 1000, si_addr0x3e80000ea0c, si_status0 2024-09-12T17:48:42.584 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (29225 ms) 2024-09-12T17:48:42.585 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from LibRGW (30872 ms total) 2024-09-12T17:48:42.585 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:48:42.585 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:48:42.585 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 9 tests from 1 test suite ran. (30872 ms total) 2024-09-12T17:48:42.585 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 9 tests. 2024-09-12T17:48:42.598 INFO:tasks.workunit.client.0.smithi097.stdout:phase 3.1 2024-09-12T17:48:42.940 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:48:42.941 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:48:42.941 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:48:42.941 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:48:42.951 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:42.951 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:43.889 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (949 ms) 2024-09-12T17:48:43.889 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:48:43.889 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:48:43.889 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:48:43.907 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (18 ms) 2024-09-12T17:48:43.908 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:48:43.915 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-09-12T17:48:43.915 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:48:43.918 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T17:48:43.918 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:48:44.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LARGE1 (479 ms) 2024-09-12T17:48:44.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:48:44.460 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LARGE2 (60 ms) 2024-09-12T17:48:44.460 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:48:44.460 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:48:44.460 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:48:44.460 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:48:44.460 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:48:44.460 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:48:44.461 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:48:44.461 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:48:44.461 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:48:44.461 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:48:44.461 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:48:44.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:48:44.459+0000 7fdbb8587a80 -1 shutting down 2024-09-12T17:48:44.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:48:44.459+0000 7fda922d9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60561, si_uid : 1000, si_addr0x3e80000ec91, si_status0 2024-09-12T17:49:14.200 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (29743 ms) 2024-09-12T17:49:14.201 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 13 tests from LibRGW (31260 ms total) 2024-09-12T17:49:14.201 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:49:14.201 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:49:14.201 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 13 tests from 1 test suite ran. (31260 ms total) 2024-09-12T17:49:14.201 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 13 tests. 2024-09-12T17:49:14.213 INFO:tasks.workunit.client.0.smithi097.stdout:phase 3.2 2024-09-12T17:49:14.551 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:49:14.551 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:49:14.551 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:49:14.551 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:49:14.560 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:14.560 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:14.837 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (287 ms) 2024-09-12T17:49:14.838 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:49:14.838 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:49:14.838 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:49:14.838 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:49:14.838 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:49:14.848 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-12T17:49:14.848 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:49:14.855 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (6 ms) 2024-09-12T17:49:14.855 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:49:14.929 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LARGE1 (73 ms) 2024-09-12T17:49:14.929 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:49:14.929 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T17:49:14.929 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:49:14.929 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:49:14.929 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:49:14.938 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_OBJECT (9 ms) 2024-09-12T17:49:14.938 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:49:15.003 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (65 ms) 2024-09-12T17:49:15.003 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:49:15.003 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:49:15.003 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:49:15.003 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:49:15.003 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:49:15.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:49:15.002+0000 7f646781aa80 -1 shutting down 2024-09-12T17:49:15.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:49:15.006+0000 7f634156c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61206, si_uid : 1000, si_addr0x3e80000ef16, si_status0 2024-09-12T17:49:45.097 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30093 ms) 2024-09-12T17:49:45.097 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 13 tests from LibRGW (30545 ms total) 2024-09-12T17:49:45.097 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:49:45.097 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:49:45.097 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 13 tests from 1 test suite ran. (30545 ms total) 2024-09-12T17:49:45.098 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 13 tests. 2024-09-12T17:49:45.115 INFO:tasks.workunit.client.0.smithi097.stdout:phase 4.1 2024-09-12T17:49:45.139 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:49:45.139 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:49:45.139 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:49:45.139 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:49:45.139 INFO:tasks.workunit.client.0.smithi097.stdout:read i1: 64001 2024-09-12T17:49:45.139 INFO:tasks.workunit.client.0.smithi097.stdout:read s1: blunderbuss 2024-09-12T17:49:45.139 INFO:tasks.workunit.client.0.smithi097.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:49:45.140 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:49:45.153 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:45.153 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:45.756 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (618 ms) 2024-09-12T17:49:45.757 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:49:45.757 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:49:45.757 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:49:45.789 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (31 ms) 2024-09-12T17:49:45.789 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:49:47.191 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_0 2024-09-12T17:49:47.191 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_1 2024-09-12T17:49:47.191 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_2 2024-09-12T17:49:47.192 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_3 2024-09-12T17:49:47.192 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_4 2024-09-12T17:49:47.192 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_5 2024-09-12T17:49:47.192 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_6 2024-09-12T17:49:47.192 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_7 2024-09-12T17:49:47.192 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_8 2024-09-12T17:49:47.192 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_9 2024-09-12T17:49:47.192 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_10 2024-09-12T17:49:47.193 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_11 2024-09-12T17:49:47.193 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_12 2024-09-12T17:49:47.193 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_13 2024-09-12T17:49:47.193 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_14 2024-09-12T17:49:47.193 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_15 2024-09-12T17:49:47.193 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_16 2024-09-12T17:49:47.193 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_17 2024-09-12T17:49:47.194 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_18 2024-09-12T17:49:47.194 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_19 2024-09-12T17:49:47.194 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_20 2024-09-12T17:49:47.194 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_21 2024-09-12T17:49:47.194 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_22 2024-09-12T17:49:47.194 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_23 2024-09-12T17:49:47.194 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_24 2024-09-12T17:49:47.194 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_25 2024-09-12T17:49:47.194 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_26 2024-09-12T17:49:47.194 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_27 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_28 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_29 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_30 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_31 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_32 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_33 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_34 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_35 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_36 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_37 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_38 2024-09-12T17:49:47.195 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_39 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_40 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_41 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_42 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_43 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_44 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_45 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_46 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_47 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_48 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_49 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_50 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_51 2024-09-12T17:49:47.196 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_52 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_53 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_54 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_55 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_56 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_57 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_58 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_59 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_60 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_61 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_62 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_63 2024-09-12T17:49:47.197 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_64 2024-09-12T17:49:47.198 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_65 2024-09-12T17:49:47.198 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_66 2024-09-12T17:49:47.198 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_67 2024-09-12T17:49:47.198 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_68 2024-09-12T17:49:47.198 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_69 2024-09-12T17:49:47.198 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_70 2024-09-12T17:49:47.198 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_71 2024-09-12T17:49:47.198 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_72 2024-09-12T17:49:47.198 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_73 2024-09-12T17:49:47.198 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_74 2024-09-12T17:49:47.199 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_75 2024-09-12T17:49:47.199 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_76 2024-09-12T17:49:47.199 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_77 2024-09-12T17:49:47.199 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_78 2024-09-12T17:49:47.199 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_79 2024-09-12T17:49:47.199 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_80 2024-09-12T17:49:47.199 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_81 2024-09-12T17:49:47.199 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_82 2024-09-12T17:49:47.199 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_83 2024-09-12T17:49:47.200 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_84 2024-09-12T17:49:47.200 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_85 2024-09-12T17:49:47.200 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_86 2024-09-12T17:49:47.200 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_87 2024-09-12T17:49:47.200 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_88 2024-09-12T17:49:47.200 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_89 2024-09-12T17:49:47.200 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_90 2024-09-12T17:49:47.200 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_91 2024-09-12T17:49:47.200 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_92 2024-09-12T17:49:47.200 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_93 2024-09-12T17:49:47.200 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_94 2024-09-12T17:49:47.201 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_95 2024-09-12T17:49:47.201 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_96 2024-09-12T17:49:47.201 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_97 2024-09-12T17:49:47.201 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_98 2024-09-12T17:49:47.201 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_99 2024-09-12T17:49:47.201 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1402 ms) 2024-09-12T17:49:47.201 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:49:47.202 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T17:49:47.202 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T17:49:47.202 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:49:47.203 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:49:47.203 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:49:47.203 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:49:47.203 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:49:47.203 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:49:47.203 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:49:47.203 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:49:47.203 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:49:47.203 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:49:47.203 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:49:47.204 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:49:47.204 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:49:47.204 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:49:47.204 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:49:47.204 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:49:47.204 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:49:47.204 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:49:47.204 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:49:47.204 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:49:47.204 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:49:47.205 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:49:47.205 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:49:47.205 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:49:47.205 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:49:47.205 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:49:47.205 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:49:47.205 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:49:47.205 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:49:47.205 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:49:47.205 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:49:47.205 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:49:47.206 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:49:47.207 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:49:47.208 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:49:47.208 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:49:47.208 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:49:47.208 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:49:47.208 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:49:47.208 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:49:47.208 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:49:47.208 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:49:47.208 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:49:47.208 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:49:47.209 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:49:47.210 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:49:47.210 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:49:47.210 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:49:47.210 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:49:47.210 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:49:47.210 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:49:47.210 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:49:47.210 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:49:47.210 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:49:47.211 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:49:47.211 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:49:47.211 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:49:47.211 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:49:47.211 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:49:47.211 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:49:47.211 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:49:47.211 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:49:47.211 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:49:47.211 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:49:47.211 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:49:47.212 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_READDIR (8 ms) 2024-09-12T17:49:47.212 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:49:47.213 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:49:47.213 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:49:47.213 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:49:47.213 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:49:47.213 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:49:47.214 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:49:47.214 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:49:47.214 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:49:47.214 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:49:47.214 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:49:47.214 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:49:47.214 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:49:47.214 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:49:47.215 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:49:47.215 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:49:47.215 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:49:47.215 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:49:47.215 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:49:47.215 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:49:47.215 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:49:47.215 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:49:47.215 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:49:47.215 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:49:47.215 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:49:47.216 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:49:47.216 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:49:47.216 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:49:47.216 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:49:47.216 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:49:47.216 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:49:47.216 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:49:47.216 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:49:47.216 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:49:47.217 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:49:47.218 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:49:47.218 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:49:47.218 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:49:47.218 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:49:47.218 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:49:47.218 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:49:47.218 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:49:47.218 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:49:47.218 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:49:47.219 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:49:47.220 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:49:47.221 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:49:47.221 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:49:47.221 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:49:47.221 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:49:47.221 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:49:47.221 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:49:47.221 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:49:47.221 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:49:47.221 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:49:47.221 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:49:47.222 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:49:47.222 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:49:47.222 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:49:47.222 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:49:47.222 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:49:47.222 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:49:47.222 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:49:47.222 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:49:47.222 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:49:47.223 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:49:47.223 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:49:47.223 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-12T17:49:47.223 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:49:47.223 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (1 ms) 2024-09-12T17:49:47.223 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:49:47.223 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:49:47.223 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:49:47.223 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:49:47.223 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:49:47.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:49:47.206+0000 7fc84fedca80 -1 shutting down 2024-09-12T17:49:47.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:49:47.210+0000 7fc729c2e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61851, si_uid : 1000, si_addr0x3e80000f19b, si_status0 2024-09-12T17:50:15.801 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (28595 ms) 2024-09-12T17:50:15.801 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from LibRGW (30661 ms total) 2024-09-12T17:50:15.801 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:50:15.801 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:50:15.802 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 11 tests from 1 test suite ran. (30661 ms total) 2024-09-12T17:50:15.802 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 11 tests. 2024-09-12T17:50:15.812 INFO:tasks.workunit.client.0.smithi097.stdout:phase 4.2 2024-09-12T17:50:15.834 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:50:15.834 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:50:15.834 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:50:15.834 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:50:15.834 INFO:tasks.workunit.client.0.smithi097.stdout:read i1: 64001 2024-09-12T17:50:15.834 INFO:tasks.workunit.client.0.smithi097.stdout:read s1: blunderbuss 2024-09-12T17:50:15.834 INFO:tasks.workunit.client.0.smithi097.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:50:15.834 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:50:15.844 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:15.844 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:16.613 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (780 ms) 2024-09-12T17:50:16.613 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:50:16.614 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:50:16.614 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:50:16.629 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-09-12T17:50:16.629 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:50:16.629 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:50:16.629 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:50:16.630 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:50:16.630 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:50:16.633 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:50:16.633 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:50:16.633 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:50:16.633 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:50:16.633 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:50:16.634 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:50:16.635 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:50:16.636 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:50:16.637 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:50:16.638 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:50:16.639 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:50:16.639 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:50:16.639 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:50:16.639 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:50:16.639 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:50:16.639 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:50:16.639 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:50:16.639 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:50:16.639 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:50:16.640 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T17:50:16.641 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:50:16.642 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:50:16.642 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:50:16.642 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:50:16.642 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:50:16.642 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:50:16.642 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:50:16.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:50:16.633+0000 7f55de596a80 -1 shutting down 2024-09-12T17:50:16.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:50:16.633+0000 7f54b82e8640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62496, si_uid : 1000, si_addr0x3e80000f420, si_status0 2024-09-12T17:50:46.921 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30288 ms) 2024-09-12T17:50:46.922 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from LibRGW (31087 ms total) 2024-09-12T17:50:46.922 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:50:46.922 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:50:46.922 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 11 tests from 1 test suite ran. (31087 ms total) 2024-09-12T17:50:46.922 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 11 tests. 2024-09-12T17:50:46.935 INFO:tasks.workunit.client.0.smithi097.stdout:phase 5.1 2024-09-12T17:50:46.968 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:50:46.968 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:50:46.969 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:50:46.969 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:50:46.980 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:46.980 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:47.291 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (322 ms) 2024-09-12T17:50:47.291 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:50:47.292 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:50:47.292 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:50:47.314 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (22 ms) 2024-09-12T17:50:47.314 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:50:47.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-12T17:50:47.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:50:47.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:50:47.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:50:47.324 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T17:50:47.324 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:50:47.325 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:50:47.325 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:50:47.332 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.PUT_OBJECT (8 ms) 2024-09-12T17:50:47.332 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:50:47.337 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.GET_OBJECT (5 ms) 2024-09-12T17:50:47.337 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:50:47.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:50:47.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:50:47.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:50:47.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:50:47.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:50:47.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:50:47.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:50:47.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:50:47.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:50:47.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:50:47.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:50:47.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:50:47.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:50:47.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:50:47.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:50:47.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:50:47.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:50:47.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:50:47.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:50:47.337+0000 7f330b9eda80 -1 shutting down 2024-09-12T17:50:47.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:50:47.337+0000 7f31e573f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63141, si_uid : 1000, si_addr0x3e80000f6a5, si_status0 2024-09-12T17:51:17.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30048 ms) 2024-09-12T17:51:17.387 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 19 tests from LibRGW (30417 ms total) 2024-09-12T17:51:17.387 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:51:17.387 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:51:17.387 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 19 tests from 1 test suite ran. (30417 ms total) 2024-09-12T17:51:17.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 19 tests. 2024-09-12T17:51:17.400 INFO:tasks.workunit.client.0.smithi097.stdout:phase 5.2 2024-09-12T17:51:17.434 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:51:17.434 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:51:17.435 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:51:17.435 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:51:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:17.730 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (295 ms) 2024-09-12T17:51:17.730 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:51:17.731 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:51:17.731 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:51:17.731 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:51:17.731 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:51:17.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-12T17:51:17.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:51:17.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:51:17.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:51:17.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T17:51:17.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:51:17.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:51:17.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:51:17.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T17:51:17.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:51:17.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T17:51:17.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:51:17.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:51:17.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:51:17.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:51:17.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:51:17.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:51:17.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:51:17.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:51:17.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:51:17.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:51:17.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:51:17.750 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_OBJECT (8 ms) 2024-09-12T17:51:17.750 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:51:17.807 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (57 ms) 2024-09-12T17:51:17.807 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:51:17.807 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:51:17.807 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:51:17.807 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:51:17.807 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:51:17.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:51:17.804+0000 7f244fae9a80 -1 shutting down 2024-09-12T17:51:17.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:51:17.808+0000 7f232983b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63787, si_uid : 1000, si_addr0x3e80000f92b, si_status0 2024-09-12T17:51:48.018 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30210 ms) 2024-09-12T17:51:48.018 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 19 tests from LibRGW (30582 ms total) 2024-09-12T17:51:48.018 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:51:48.019 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:51:48.019 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 19 tests from 1 test suite ran. (30582 ms total) 2024-09-12T17:51:48.019 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 19 tests. 2024-09-12T17:51:48.031 INFO:tasks.workunit.client.0.smithi097.stdout:phase 6.1 2024-09-12T17:51:48.056 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:51:48.056 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-12T17:51:48.056 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from LibRGW 2024-09-12T17:51:48.056 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:51:48.064 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:48.064 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:48.349 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (293 ms) 2024-09-12T17:51:48.350 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:51:48.350 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:51:48.350 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T17:51:48.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKETS (39 ms) 2024-09-12T17:51:48.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T17:51:48.402 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (13 ms) 2024-09-12T17:51:48.402 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T17:51:48.434 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.TOPDIR_RENAME (32 ms) 2024-09-12T17:51:48.434 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T17:51:48.484 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SUBDIR_RENAME (50 ms) 2024-09-12T17:51:48.485 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T17:51:48.533 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (49 ms) 2024-09-12T17:51:48.533 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:51:48.533 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:51:48.533 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:51:48.534 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:51:48.534 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:51:48.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:51:48.535+0000 7fb405edfa80 -1 shutting down 2024-09-12T17:51:48.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:51:48.535+0000 7fb2dfc31640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64432, si_uid : 1000, si_addr0x3e80000fbb0, si_status0 2024-09-12T17:52:18.565 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30031 ms) 2024-09-12T17:52:18.566 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from LibRGW (30508 ms total) 2024-09-12T17:52:18.566 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:52:18.566 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-12T17:52:18.566 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 10 tests from 1 test suite ran. (30508 ms total) 2024-09-12T17:52:18.566 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 10 tests. 2024-09-12T17:52:18.580 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:52:18.581 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:52:18.598 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T17:52:18.600 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T17:52:18.601 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T17:52:18.649 INFO:tasks.workunit.client.0.smithi097.stderr:+ [ -z ] 2024-09-12T17:52:18.649 INFO:tasks.workunit.client.0.smithi097.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:52:18.649 INFO:tasks.workunit.client.0.smithi097.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:52:18.650 INFO:tasks.workunit.client.0.smithi097.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T17:52:18.689 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:18.689 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:18.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.735+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:18.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 20 realm 2024-09-12T17:52:18.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:18.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:18.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:18.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:18.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:18.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.739+0000 7f6f924069c0 20 searching for the correct realm 2024-09-12T17:52:18.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.747+0000 7f6f8ff0c640 0 -- 172.21.15.97:0/2113797549 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f6f80080050 msgr2=0x7f6f8000bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:52:18.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.751+0000 7f6f8ff0c640 0 -- 172.21.15.97:0/2113797549 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f6f88025040 msgr2=0x7f6f88060930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:18.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.759+0000 7f6f924069c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:52:18.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.759+0000 7f6f924069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:18.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.759+0000 7f6f924069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:18.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.759+0000 7f6f924069c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:52:18.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.759+0000 7f6f924069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:18.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.759+0000 7f6f924069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:18.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.759+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.759+0000 7f6f924069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:18.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.759+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.759+0000 7f6f924069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:18.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.759+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:18.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 20 zone default found 2024-09-12T17:52:18.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 4 Realm: () 2024-09-12T17:52:18.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:52:18.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:52:18.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:18.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 20 zonegroup default 2024-09-12T17:52:18.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:18.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:18.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:18.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 20 started sync module instance, tier type = 2024-09-12T17:52:18.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.763+0000 7f6f924069c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:52:18.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.783+0000 7f6f924069c0 20 add_watcher() i=0 2024-09-12T17:52:18.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.783+0000 7f6f924069c0 20 add_watcher() i=1 2024-09-12T17:52:18.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.783+0000 7f6f924069c0 20 add_watcher() i=2 2024-09-12T17:52:18.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.783+0000 7f6f924069c0 20 add_watcher() i=3 2024-09-12T17:52:18.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.783+0000 7f6f924069c0 20 add_watcher() i=4 2024-09-12T17:52:18.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.783+0000 7f6f924069c0 20 add_watcher() i=5 2024-09-12T17:52:18.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.783+0000 7f6f924069c0 20 add_watcher() i=6 2024-09-12T17:52:18.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.783+0000 7f6f924069c0 20 add_watcher() i=7 2024-09-12T17:52:18.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.783+0000 7f6f924069c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:18.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6e45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:18.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:18.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:18.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 5 note: GC not initialized 2024-09-12T17:52:18.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6e44fe1640 20 reqs_thread_entry: start 2024-09-12T17:52:18.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 20 init_complete bucket index max shards: 11 2024-09-12T17:52:18.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 20 Filter name: none 2024-09-12T17:52:18.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6dbe7fc640 20 reqs_thread_entry: start 2024-09-12T17:52:18.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T17:52:18.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:18.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T17:52:18.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:52:18.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T17:52:18.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:18.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T17:52:18.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:52:18.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T17:52:18.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.791+0000 7f6f924069c0 20 rados->read ofs=0 len=0 2024-09-12T17:52:18.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.795+0000 7f6f924069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:18.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.795+0000 7f6f924069c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T17:52:18.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.795+0000 7f6f924069c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:52:18.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.795+0000 7f6f924069c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:52:18.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.795+0000 7f6f924069c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:52:18.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.795+0000 7f6f924069c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:52:18.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.795+0000 7f6f924069c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:52:18.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.795+0000 7f6f924069c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T17:52:18.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.795+0000 7f6e6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725907 cookie 94264638299536 notifier 5513 bl.length()=677 2024-09-12T17:52:18.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.795+0000 7f6e6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:52:18.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.795+0000 7f6e6effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:52:18.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.803+0000 7f6f924069c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:52:18.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.803+0000 7f6f924069c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:52:18.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.803+0000 7f6f924069c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T17:52:18.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.803+0000 7f6e6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725900 cookie 94264638286832 notifier 5513 bl.length()=187 2024-09-12T17:52:18.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.803+0000 7f6e6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:52:18.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.803+0000 7f6e6effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:52:18.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.807+0000 7f6f924069c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:52:18.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.807+0000 7f6f924069c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:52:18.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.807+0000 7f6f924069c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T17:52:18.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.807+0000 7f6e6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725901 cookie 94264638286832 notifier 5513 bl.length()=197 2024-09-12T17:52:18.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.807+0000 7f6e6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:52:18.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.807+0000 7f6e6e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: "user_id": "ceph-test-maven", 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: "display_name": "maven test user", 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: "email": "sigv4@example.com", 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: "suspended": 0, 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: "max_buckets": 1000, 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: "subusers": [], 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: "keys": [ 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: { 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: "user": "ceph-test-maven", 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T17:52:18.807 INFO:tasks.workunit.client.0.smithi097.stdout: "active": true, 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-12T17:52:18.796167Z" 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: ], 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: "swift_keys": [], 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: "caps": [], 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: "default_placement": "", 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: "default_storage_class": "", 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: "placement_tags": [], 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_quota": { 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-12T17:52:18.808 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "user_quota": { 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "temp_url_keys": [], 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "type": "rgw", 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "mfa_ids": [], 2024-09-12T17:52:18.809 INFO:tasks.workunit.client.0.smithi097.stdout: "account_id": "", 2024-09-12T17:52:18.810 INFO:tasks.workunit.client.0.smithi097.stdout: "path": "/", 2024-09-12T17:52:18.810 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-12T17:52:18.796145Z", 2024-09-12T17:52:18.810 INFO:tasks.workunit.client.0.smithi097.stdout: "tags": [], 2024-09-12T17:52:18.810 INFO:tasks.workunit.client.0.smithi097.stdout: "group_ids": [] 2024-09-12T17:52:18.810 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:52:18.810 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:52:18.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.811+0000 7f6e45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.815+0000 7f6f924069c0 20 remove_watcher() i=0 2024-09-12T17:52:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.815+0000 7f6f924069c0 2 removed watcher, disabling cache 2024-09-12T17:52:18.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.815+0000 7f6f924069c0 20 remove_watcher() i=1 2024-09-12T17:52:18.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.815+0000 7f6f924069c0 20 remove_watcher() i=2 2024-09-12T17:52:18.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.819+0000 7f6f924069c0 20 remove_watcher() i=3 2024-09-12T17:52:18.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.823+0000 7f6f924069c0 20 remove_watcher() i=4 2024-09-12T17:52:18.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.823+0000 7f6f924069c0 20 remove_watcher() i=5 2024-09-12T17:52:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.827+0000 7f6f924069c0 20 remove_watcher() i=6 2024-09-12T17:52:18.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T17:52:18.827+0000 7f6f924069c0 20 remove_watcher() i=7 2024-09-12T17:52:18.841 INFO:tasks.workunit.client.0.smithi097.stderr:+ [ -z ] 2024-09-12T17:52:18.841 INFO:tasks.workunit.client.0.smithi097.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T17:52:18.841 INFO:tasks.workunit.client.0.smithi097.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T17:52:18.842 INFO:tasks.workunit.client.0.smithi097.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi097.front.sepia.ceph.com:443 2024-09-12T17:52:18.842 INFO:tasks.workunit.client.0.smithi097.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T17:52:18.843 INFO:tasks.workunit.client.0.smithi097.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T17:52:18.843 INFO:tasks.workunit.client.0.smithi097.stderr:+ ./mvnw clean package 2024-09-12T17:52:18.848 INFO:tasks.workunit.client.0.smithi097.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:52:21.874 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Scanning for projects... 2024-09-12T17:52:22.036 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T17:52:22.149 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 48 kB/s) 2024-09-12T17:52:22.166 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T17:52:22.199 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.4 MB/s) 2024-09-12T17:52:22.207 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T17:52:22.226 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15/77 kB Progress (1): 31/77 kB Progress (1): 48/77 kB Progress (1): 64/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 4.0 MB/s) 2024-09-12T17:52:22.250 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:22.250 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:52:22.251 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:52:22.251 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] from pom.xml 2024-09-12T17:52:22.251 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:52:22.253 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T17:52:22.269 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-12T17:52:22.276 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T17:52:22.290 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-12T17:52:22.293 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T17:52:22.310 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-12T17:52:22.316 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T17:52:22.331 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-12T17:52:22.343 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T17:52:22.358 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.4 MB/s) 2024-09-12T17:52:22.366 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T17:52:22.381 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 583 kB/s) 2024-09-12T17:52:22.383 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T17:52:22.398 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-12T17:52:22.401 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T17:52:22.417 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-12T17:52:22.421 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T17:52:22.437 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-12T17:52:22.445 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T17:52:22.461 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.8 MB/s) 2024-09-12T17:52:22.469 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T17:52:22.485 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-09-12T17:52:22.494 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T17:52:22.512 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.6 MB/s) 2024-09-12T17:52:22.523 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T17:52:22.540 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-12T17:52:22.544 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T17:52:22.560 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.3 MB/s) 2024-09-12T17:52:22.566 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T17:52:22.583 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-12T17:52:22.590 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T17:52:22.608 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.3 MB/s) 2024-09-12T17:52:22.620 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T17:52:22.637 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 331 kB/s) 2024-09-12T17:52:22.644 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T17:52:22.663 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.3 MB/s) 2024-09-12T17:52:22.674 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T17:52:22.691 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-09-12T17:52:22.696 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T17:52:22.713 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 582 kB/s) 2024-09-12T17:52:22.717 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T17:52:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.1 MB/s) 2024-09-12T17:52:22.745 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T17:52:22.762 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.2 MB/s) 2024-09-12T17:52:22.771 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T17:52:22.789 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.5 MB/s) 2024-09-12T17:52:22.821 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T17:52:22.838 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 338 kB/s) 2024-09-12T17:52:22.843 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T17:52:22.860 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.2 MB/s) 2024-09-12T17:52:22.869 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T17:52:22.888 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-12T17:52:22.904 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T17:52:22.921 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-09-12T17:52:22.925 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T17:52:22.941 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-12T17:52:22.945 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T17:52:22.963 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 124 kB/s) 2024-09-12T17:52:22.971 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T17:52:22.990 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 191 kB/s) 2024-09-12T17:52:23.000 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T17:52:23.017 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 190 kB/s) 2024-09-12T17:52:23.026 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T17:52:23.044 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 609 kB/s) 2024-09-12T17:52:23.053 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T17:52:23.070 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 99 kB/s) 2024-09-12T17:52:23.077 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T17:52:23.094 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 225 kB/s) 2024-09-12T17:52:23.103 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T17:52:23.122 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/4.9 kB Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 246 kB/s) 2024-09-12T17:52:23.130 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T17:52:23.146 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 68 kB/s) 2024-09-12T17:52:23.151 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T17:52:23.167 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 240 kB/s) 2024-09-12T17:52:23.171 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T17:52:23.187 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 863 kB/s) 2024-09-12T17:52:23.194 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T17:52:23.210 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 230 kB/s) 2024-09-12T17:52:23.218 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T17:52:23.235 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-12T17:52:23.244 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T17:52:23.260 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 182 kB/s) 2024-09-12T17:52:23.269 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T17:52:23.286 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 436 kB/s) 2024-09-12T17:52:23.293 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T17:52:23.310 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 321 kB/s) 2024-09-12T17:52:23.319 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T17:52:23.339 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 174 kB/s) 2024-09-12T17:52:23.347 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T17:52:23.364 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 258 kB/s) 2024-09-12T17:52:23.368 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T17:52:23.386 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 134 kB/s) 2024-09-12T17:52:23.393 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T17:52:23.410 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 379 kB/s) 2024-09-12T17:52:23.419 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T17:52:23.434 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 379 kB/s) 2024-09-12T17:52:23.442 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T17:52:23.458 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 186 kB/s) 2024-09-12T17:52:23.466 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T17:52:23.483 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 204 kB/s) 2024-09-12T17:52:23.492 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T17:52:23.508 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-09-12T17:52:23.512 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T17:52:23.527 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 111 kB/s) 2024-09-12T17:52:23.535 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T17:52:23.551 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 413 kB/s) 2024-09-12T17:52:23.555 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T17:52:23.572 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-09-12T17:52:23.576 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T17:52:23.595 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.8 MB/s) 2024-09-12T17:52:23.602 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T17:52:23.617 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-12T17:52:23.625 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T17:52:23.641 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 310 kB/s) 2024-09-12T17:52:23.646 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T17:52:23.662 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 823 kB/s) 2024-09-12T17:52:23.672 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T17:52:23.689 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-09-12T17:52:23.694 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T17:52:23.713 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.6 MB/s) 2024-09-12T17:52:23.731 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T17:52:23.749 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 870 kB/s) 2024-09-12T17:52:23.759 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T17:52:23.775 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 965 kB/s) 2024-09-12T17:52:23.780 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T17:52:23.801 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 3.8 MB/s) 2024-09-12T17:52:23.812 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T17:52:23.829 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.0 MB/s) 2024-09-12T17:52:23.837 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T17:52:23.855 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-12T17:52:23.860 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T17:52:23.880 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.9 MB/s) 2024-09-12T17:52:23.894 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T17:52:23.911 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-09-12T17:52:23.915 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T17:52:23.933 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 767 kB/s) 2024-09-12T17:52:23.939 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T17:52:23.956 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 189 kB/s) 2024-09-12T17:52:23.962 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T17:52:23.978 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 187 kB/s) 2024-09-12T17:52:23.982 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T17:52:23.999 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-09-12T17:52:24.003 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T17:52:24.020 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 167 kB/s) 2024-09-12T17:52:24.025 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T17:52:24.041 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 95 kB/s) 2024-09-12T17:52:24.046 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T17:52:24.063 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-09-12T17:52:24.068 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T17:52:24.085 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-09-12T17:52:24.090 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T17:52:24.107 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-09-12T17:52:24.114 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T17:52:24.130 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-09-12T17:52:24.139 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T17:52:24.156 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 60 kB/s) 2024-09-12T17:52:24.162 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T17:52:24.178 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 191 kB/s) 2024-09-12T17:52:24.184 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T17:52:24.200 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 190 kB/s) 2024-09-12T17:52:24.205 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T17:52:24.222 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-12T17:52:24.227 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T17:52:24.244 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T17:52:24.248 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T17:52:24.265 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-12T17:52:24.313 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T17:52:24.437 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 27 MB/s) 2024-09-12T17:52:24.439 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T17:52:24.439 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T17:52:24.440 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T17:52:24.440 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T17:52:24.440 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T17:52:24.460 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 3.2 MB/s) 2024-09-12T17:52:24.460 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T17:52:24.478 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 433 kB/s) 2024-09-12T17:52:24.478 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T17:52:24.508 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/16 kB Progress (2): 1.4/16 kB | 1.4/49 kB Progress (3): 1.4/16 kB | 1.4/49 kB | 1.4/35 kB Progress (3): 1.4/16 kB | 2.8/49 kB | 1.4/35 kB Progress (4): 1.4/16 kB | 2.8/49 kB | 1.4/35 kB | 1.4/98 kB Progress (5): 1.4/16 kB | 2.8/49 kB | 1.4/35 kB | 1.4/98 kB | 16/782 kB Progress (5): 2.8/16 kB | 2.8/49 kB | 1.4/35 kB | 1.4/98 kB | 16/782 kB Progress (5): 2.8/16 kB | 4.1/49 kB | 1.4/35 kB | 1.4/98 kB | 16/782 kB Progress (5): 2.8/16 kB | 4.1/49 kB | 1.4/35 kB | 2.8/98 kB | 16/782 kB Progress (5): 2.8/16 kB | 4.1/49 kB | 2.8/35 kB | 2.8/98 kB | 16/782 kB Progress (5): 2.8/16 kB | 5.5/49 kB | 2.8/35 kB | 2.8/98 kB | 16/782 kB Progress (5): 2.8/16 kB | 5.5/49 kB | 2.8/35 kB | 2.8/98 kB | 33/782 kB Progress (5): 4.1/16 kB | 5.5/49 kB | 2.8/35 kB | 2.8/98 kB | 33/782 kB Progress (5): 4.1/16 kB | 6.9/49 kB | 2.8/35 kB | 2.8/98 kB | 33/782 kB Progress (5): 4.1/16 kB | 6.9/49 kB | 4.1/35 kB | 2.8/98 kB | 33/782 kB Progress (5): 4.1/16 kB | 6.9/49 kB | 4.1/35 kB | 4.1/98 kB | 33/782 kB Progress (5): 4.1/16 kB | 6.9/49 kB | 5.5/35 kB | 4.1/98 kB | 33/782 kB Progress (5): 4.1/16 kB | 8.3/49 kB | 5.5/35 kB | 4.1/98 kB | 33/782 kB Progress (5): 4.1/16 kB | 8.3/49 kB | 5.5/35 kB | 4.1/98 kB | 49/782 kB Progress (5): 5.5/16 kB | 8.3/49 kB | 5.5/35 kB | 4.1/98 kB | 49/782 kB Progress (5): 5.5/16 kB | 9.7/49 kB | 5.5/35 kB | 4.1/98 kB | 49/782 kB Progress (5): 5.5/16 kB | 9.7/49 kB | 6.9/35 kB | 4.1/98 kB | 49/782 kB Progress (5): 5.5/16 kB | 9.7/49 kB | 6.9/35 kB | 5.5/98 kB | 49/782 kB Progress (5): 5.5/16 kB | 9.7/49 kB | 8.3/35 kB | 5.5/98 kB | 49/782 kB Progress (5): 5.5/16 kB | 11/49 kB | 8.3/35 kB | 5.5/98 kB | 49/782 kB Progress (5): 5.5/16 kB | 11/49 kB | 8.3/35 kB | 5.5/98 kB | 65/782 kB Progress (5): 6.9/16 kB | 11/49 kB | 8.3/35 kB | 5.5/98 kB | 65/782 kB Progress (5): 6.9/16 kB | 12/49 kB | 8.3/35 kB | 5.5/98 kB | 65/782 kB Progress (5): 6.9/16 kB | 12/49 kB | 9.7/35 kB | 5.5/98 kB | 65/782 kB Progress (5): 6.9/16 kB | 12/49 kB | 9.7/35 kB | 6.9/98 kB | 65/782 kB Progress (5): 6.9/16 kB | 12/49 kB | 11/35 kB | 6.9/98 kB | 65/782 kB Progress (5): 6.9/16 kB | 14/49 kB | 11/35 kB | 6.9/98 kB | 65/782 kB Progress (5): 6.9/16 kB | 14/49 kB | 11/35 kB | 6.9/98 kB | 82/782 kB Progress (5): 6.9/16 kB | 15/49 kB | 11/35 kB | 6.9/98 kB | 82/782 kB Progress (5): 8.3/16 kB | 15/49 kB | 11/35 kB | 6.9/98 kB | 82/782 kB Progress (5): 8.3/16 kB | 16/49 kB | 11/35 kB | 6.9/98 kB | 82/782 kB Progress (5): 8.3/16 kB | 16/49 kB | 12/35 kB | 6.9/98 kB | 82/782 kB Progress (5): 8.3/16 kB | 16/49 kB | 12/35 kB | 8.3/98 kB | 82/782 kB Progress (5): 8.3/16 kB | 16/49 kB | 14/35 kB | 8.3/98 kB | 82/782 kB Progress (5): 8.3/16 kB | 18/49 kB | 14/35 kB | 8.3/98 kB | 82/782 kB Progress (5): 9.7/16 kB | 18/49 kB | 14/35 kB | 8.3/98 kB | 82/782 kB Progress (5): 9.7/16 kB | 18/49 kB | 14/35 kB | 8.3/98 kB | 98/782 kB Progress (5): 11/16 kB | 18/49 kB | 14/35 kB | 8.3/98 kB | 98/782 kB Progress (5): 11/16 kB | 18/49 kB | 14/35 kB | 8.3/98 kB | 115/782 kB Progress (5): 12/16 kB | 18/49 kB | 14/35 kB | 8.3/98 kB | 115/782 kB Progress (5): 12/16 kB | 19/49 kB | 14/35 kB | 8.3/98 kB | 115/782 kB Progress (5): 12/16 kB | 19/49 kB | 15/35 kB | 8.3/98 kB | 115/782 kB Progress (5): 12/16 kB | 19/49 kB | 15/35 kB | 9.7/98 kB | 115/782 kB Progress (5): 12/16 kB | 19/49 kB | 16/35 kB | 9.7/98 kB | 115/782 kB Progress (5): 12/16 kB | 21/49 kB | 16/35 kB | 9.7/98 kB | 115/782 kB Progress (5): 12/16 kB | 21/49 kB | 16/35 kB | 9.7/98 kB | 131/782 kB Progress (5): 12/16 kB | 22/49 kB | 16/35 kB | 9.7/98 kB | 131/782 kB Progress (5): 14/16 kB | 22/49 kB | 16/35 kB | 9.7/98 kB | 131/782 kB Progress (5): 14/16 kB | 23/49 kB | 16/35 kB | 9.7/98 kB | 131/782 kB Progress (5): 14/16 kB | 23/49 kB | 18/35 kB | 9.7/98 kB | 131/782 kB Progress (5): 14/16 kB | 23/49 kB | 18/35 kB | 11/98 kB | 131/782 kB Progress (5): 14/16 kB | 23/49 kB | 19/35 kB | 11/98 kB | 131/782 kB Progress (5): 14/16 kB | 25/49 kB | 19/35 kB | 11/98 kB | 131/782 kB Progress (5): 14/16 kB | 25/49 kB | 19/35 kB | 11/98 kB | 147/782 kB Progress (5): 14/16 kB | 26/49 kB | 19/35 kB | 11/98 kB | 147/782 kB Progress (5): 15/16 kB | 26/49 kB | 19/35 kB | 11/98 kB | 147/782 kB Progress (5): 15/16 kB | 26/49 kB | 21/35 kB | 11/98 kB | 147/782 kB Progress (5): 15/16 kB | 26/49 kB | 21/35 kB | 12/98 kB | 147/782 kB Progress (5): 15/16 kB | 26/49 kB | 22/35 kB | 12/98 kB | 147/782 kB Progress (5): 15/16 kB | 26/49 kB | 22/35 kB | 12/98 kB | 164/782 kB Progress (5): 16 kB | 26/49 kB | 22/35 kB | 12/98 kB | 164/782 kB Progress (5): 16 kB | 27/49 kB | 22/35 kB | 12/98 kB | 164/782 kB Progress (5): 16 kB | 27/49 kB | 23/35 kB | 12/98 kB | 164/782 kB Progress (5): 16 kB | 27/49 kB | 23/35 kB | 14/98 kB | 164/782 kB Progress (5): 16 kB | 27/49 kB | 25/35 kB | 14/98 kB | 164/782 kB Progress (5): 16 kB | 27/49 kB | 25/35 kB | 14/98 kB | 180/782 kB Progress (5): 16 kB | 29/49 kB | 25/35 kB | 14/98 kB | 180/782 kB Progress (5): 16 kB | 29/49 kB | 26/35 kB | 14/98 kB | 180/782 kB Progress (5): 16 kB | 29/49 kB | 26/35 kB | 15/98 kB | 180/782 kB Progress (5): 16 kB | 29/49 kB | 27/35 kB | 15/98 kB | 180/782 kB Progress (5): 16 kB | 30/49 kB | 27/35 kB | 15/98 kB | 180/782 kB Progress (5): 16 kB | 30/49 kB | 29/35 kB | 15/98 kB | 180/782 kB Progress (5): 16 kB | 30/49 kB | 29/35 kB | 16/98 kB | 180/782 kB Progress (5): 16 kB | 30/49 kB | 29/35 kB | 16/98 kB | 197/782 kB Progress (5): 16 kB | 30/49 kB | 30/35 kB | 16/98 kB | 197/782 kB Progress (5): 16 kB | 32/49 kB | 30/35 kB | 16/98 kB | 197/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 259 kB/s) 2024-09-12T17:52:24.508 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (4): 32/49 kB | 32/35 kB | 16/98 kB | 197/782 kB Progress (4): 32/49 kB | 32/35 kB | 18/98 kB | 197/782 kB Progress (4): 32/49 kB | 33/35 kB | 18/98 kB | 197/782 kB Progress (4): 32/49 kB | 33/35 kB | 18/98 kB | 213/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T17:52:24.508 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (4): 33/49 kB | 33/35 kB | 18/98 kB | 213/782 kB Progress (4): 33/49 kB | 34/35 kB | 18/98 kB | 213/782 kB Progress (4): 33/49 kB | 34/35 kB | 19/98 kB | 213/782 kB Progress (4): 33/49 kB | 35 kB | 19/98 kB | 213/782 kB Progress (4): 33/49 kB | 35 kB | 21/98 kB | 213/782 kB Progress (4): 33/49 kB | 35 kB | 22/98 kB | 213/782 kB Progress (4): 33/49 kB | 35 kB | 23/98 kB | 213/782 kB Progress (4): 34/49 kB | 35 kB | 23/98 kB | 213/782 kB Progress (4): 34/49 kB | 35 kB | 25/98 kB | 213/782 kB Progress (4): 34/49 kB | 35 kB | 25/98 kB | 229/782 kB Progress (4): 34/49 kB | 35 kB | 26/98 kB | 229/782 kB Progress (4): 36/49 kB | 35 kB | 26/98 kB | 229/782 kB Progress (4): 36/49 kB | 35 kB | 27/98 kB | 229/782 kB Progress (4): 37/49 kB | 35 kB | 27/98 kB | 229/782 kB Progress (4): 37/49 kB | 35 kB | 29/98 kB | 229/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 558 kB/s) 2024-09-12T17:52:24.508 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 37/49 kB | 30/98 kB | 229/782 kB Progress (3): 38/49 kB | 30/98 kB | 229/782 kB Progress (3): 38/49 kB | 32/98 kB | 229/782 kB Progress (3): 38/49 kB | 32/98 kB | 246/782 kB Progress (3): 38/49 kB | 33/98 kB | 246/782 kB Progress (3): 40/49 kB | 33/98 kB | 246/782 kB Progress (3): 40/49 kB | 34/98 kB | 246/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T17:52:24.508 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 41/49 kB | 34/98 kB | 246/782 kB Progress (3): 41/49 kB | 36/98 kB | 246/782 kB Progress (3): 43/49 kB | 36/98 kB | 246/782 kB Progress (3): 43/49 kB | 37/98 kB | 246/782 kB Progress (3): 44/49 kB | 37/98 kB | 246/782 kB Progress (3): 44/49 kB | 37/98 kB | 262/782 kB Progress (3): 45/49 kB | 37/98 kB | 262/782 kB Progress (3): 45/49 kB | 38/98 kB | 262/782 kB Progress (3): 47/49 kB | 38/98 kB | 262/782 kB Progress (3): 47/49 kB | 40/98 kB | 262/782 kB Progress (3): 48/49 kB | 40/98 kB | 262/782 kB Progress (3): 48/49 kB | 41/98 kB | 262/782 kB Progress (3): 49 kB | 41/98 kB | 262/782 kB Progress (3): 49 kB | 43/98 kB | 262/782 kB Progress (3): 49 kB | 43/98 kB | 278/782 kB Progress (3): 49 kB | 44/98 kB | 278/782 kB Progress (3): 49 kB | 45/98 kB | 278/782 kB Progress (3): 49 kB | 47/98 kB | 278/782 kB Progress (3): 49 kB | 47/98 kB | 295/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 757 kB/s) 2024-09-12T17:52:24.508 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 48/98 kB | 295/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T17:52:24.517 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 49/98 kB | 295/782 kB Progress (2): 49/98 kB | 311/782 kB Progress (2): 51/98 kB | 311/782 kB Progress (2): 52/98 kB | 311/782 kB Progress (2): 54/98 kB | 311/782 kB Progress (2): 54/98 kB | 328/782 kB Progress (2): 55/98 kB | 328/782 kB Progress (2): 56/98 kB | 328/782 kB Progress (2): 58/98 kB | 328/782 kB Progress (2): 58/98 kB | 344/782 kB Progress (2): 59/98 kB | 344/782 kB Progress (2): 61/98 kB | 344/782 kB Progress (2): 62/98 kB | 344/782 kB Progress (2): 62/98 kB | 360/782 kB Progress (2): 63/98 kB | 360/782 kB Progress (2): 63/98 kB | 377/782 kB Progress (2): 63/98 kB | 393/782 kB Progress (2): 63/98 kB | 410/782 kB Progress (2): 63/98 kB | 426/782 kB Progress (2): 63/98 kB | 442/782 kB Progress (2): 63/98 kB | 459/782 kB Progress (2): 63/98 kB | 475/782 kB Progress (2): 63/98 kB | 491/782 kB Progress (2): 63/98 kB | 508/782 kB Progress (2): 63/98 kB | 524/782 kB Progress (2): 63/98 kB | 541/782 kB Progress (2): 63/98 kB | 557/782 kB Progress (2): 63/98 kB | 573/782 kB Progress (2): 63/98 kB | 590/782 kB Progress (2): 63/98 kB | 606/782 kB Progress (2): 63/98 kB | 623/782 kB Progress (2): 63/98 kB | 639/782 kB Progress (2): 63/98 kB | 655/782 kB Progress (2): 63/98 kB | 672/782 kB Progress (2): 63/98 kB | 688/782 kB Progress (2): 63/98 kB | 704/782 kB Progress (2): 79/98 kB | 704/782 kB Progress (2): 79/98 kB | 721/782 kB Progress (2): 95/98 kB | 721/782 kB Progress (2): 95/98 kB | 737/782 kB Progress (2): 98 kB | 737/782 kB Progress (3): 98 kB | 737/782 kB | 1.4/11 kB Progress (3): 98 kB | 737/782 kB | 2.8/11 kB Progress (3): 98 kB | 754/782 kB | 2.8/11 kB Progress (3): 98 kB | 754/782 kB | 4.1/11 kB Progress (3): 98 kB | 754/782 kB | 5.5/11 kB Progress (3): 98 kB | 754/782 kB | 6.9/11 kB Progress (3): 98 kB | 754/782 kB | 8.3/11 kB Progress (3): 98 kB | 770/782 kB | 8.3/11 kB Progress (3): 98 kB | 770/782 kB | 9.7/11 kB Progress (3): 98 kB | 770/782 kB | 11/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.2 MB/s) 2024-09-12T17:52:24.517 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 770/782 kB | 11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T17:52:24.518 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 148 kB/s) 2024-09-12T17:52:24.518 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T17:52:24.518 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 10 MB/s) 2024-09-12T17:52:24.518 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T17:52:24.535 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.8/205 kB Progress (1): 4.1/205 kB Progress (1): 5.5/205 kB Progress (1): 6.9/205 kB Progress (1): 8.3/205 kB Progress (1): 9.7/205 kB Progress (1): 11/205 kB Progress (1): 12/205 kB Progress (2): 12/205 kB | 16/30 kB Progress (2): 14/205 kB | 16/30 kB Progress (3): 14/205 kB | 16/30 kB | 16/81 kB Progress (4): 14/205 kB | 16/30 kB | 16/81 kB | 1.4/798 kB Progress (4): 14/205 kB | 30 kB | 16/81 kB | 1.4/798 kB Progress (4): 15/205 kB | 30 kB | 16/81 kB | 1.4/798 kB Progress (4): 16/205 kB | 30 kB | 16/81 kB | 1.4/798 kB Progress (4): 16/205 kB | 30 kB | 33/81 kB | 1.4/798 kB Progress (4): 33/205 kB | 30 kB | 33/81 kB | 1.4/798 kB Progress (4): 33/205 kB | 30 kB | 49/81 kB | 1.4/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 332 kB/s) 2024-09-12T17:52:24.535 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 49/205 kB | 49/81 kB | 1.4/798 kB Progress (3): 49/205 kB | 49/81 kB | 2.8/798 kB Progress (3): 49/205 kB | 64/81 kB | 2.8/798 kB Progress (3): 49/205 kB | 64/81 kB | 4.1/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T17:52:24.535 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 49/205 kB | 64/81 kB | 5.5/798 kB Progress (3): 49/205 kB | 64/81 kB | 6.9/798 kB Progress (3): 49/205 kB | 80/81 kB | 6.9/798 kB Progress (3): 49/205 kB | 80/81 kB | 8.3/798 kB Progress (3): 49/205 kB | 81 kB | 8.3/798 kB Progress (3): 49/205 kB | 81 kB | 9.7/798 kB Progress (3): 49/205 kB | 81 kB | 11/798 kB Progress (3): 49/205 kB | 81 kB | 12/798 kB Progress (3): 49/205 kB | 81 kB | 14/798 kB Progress (3): 49/205 kB | 81 kB | 15/798 kB Progress (3): 49/205 kB | 81 kB | 16/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 883 kB/s) 2024-09-12T17:52:24.536 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T17:52:24.547 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 49/205 kB | 33/798 kB Progress (2): 49/205 kB | 49/798 kB Progress (2): 49/205 kB | 62/798 kB Progress (2): 66/205 kB | 62/798 kB Progress (2): 82/205 kB | 62/798 kB Progress (2): 82/205 kB | 78/798 kB Progress (2): 97/205 kB | 78/798 kB Progress (2): 97/205 kB | 95/798 kB Progress (3): 97/205 kB | 95/798 kB | 13 kB Progress (3): 97/205 kB | 111/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 127 kB/s) 2024-09-12T17:52:24.547 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T17:52:24.552 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 113/205 kB | 111/798 kB Progress (2): 113/205 kB | 128/798 kB Progress (2): 113/205 kB | 144/798 kB Progress (3): 113/205 kB | 144/798 kB | 16/182 kB Progress (3): 113/205 kB | 160/798 kB | 16/182 kB Progress (3): 113/205 kB | 160/798 kB | 33/182 kB Progress (3): 113/205 kB | 160/798 kB | 49/182 kB Progress (3): 113/205 kB | 160/798 kB | 62/182 kB Progress (3): 113/205 kB | 177/798 kB | 62/182 kB Progress (3): 113/205 kB | 177/798 kB | 78/182 kB Progress (3): 113/205 kB | 193/798 kB | 78/182 kB Progress (3): 113/205 kB | 193/798 kB | 94/182 kB Progress (3): 113/205 kB | 193/798 kB | 111/182 kB Progress (3): 113/205 kB | 193/798 kB | 127/182 kB Progress (4): 113/205 kB | 193/798 kB | 127/182 kB | 15/151 kB Progress (4): 113/205 kB | 193/798 kB | 143/182 kB | 15/151 kB Progress (4): 113/205 kB | 193/798 kB | 160/182 kB | 15/151 kB Progress (4): 113/205 kB | 193/798 kB | 176/182 kB | 15/151 kB Progress (4): 113/205 kB | 193/798 kB | 182 kB | 15/151 kB Progress (4): 113/205 kB | 193/798 kB | 182 kB | 31/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.7 MB/s) 2024-09-12T17:52:24.552 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T17:52:24.560 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 113/205 kB | 193/798 kB | 48/151 kB Progress (3): 113/205 kB | 193/798 kB | 64/151 kB Progress (3): 113/205 kB | 193/798 kB | 81/151 kB Progress (3): 129/205 kB | 193/798 kB | 81/151 kB Progress (3): 129/205 kB | 209/798 kB | 81/151 kB Progress (3): 146/205 kB | 209/798 kB | 81/151 kB Progress (3): 146/205 kB | 226/798 kB | 81/151 kB Progress (3): 146/205 kB | 242/798 kB | 81/151 kB Progress (3): 162/205 kB | 242/798 kB | 81/151 kB Progress (3): 162/205 kB | 259/798 kB | 81/151 kB Progress (3): 179/205 kB | 259/798 kB | 81/151 kB Progress (3): 179/205 kB | 275/798 kB | 81/151 kB Progress (3): 179/205 kB | 291/798 kB | 81/151 kB Progress (3): 195/205 kB | 291/798 kB | 81/151 kB Progress (3): 195/205 kB | 308/798 kB | 81/151 kB Progress (3): 205 kB | 308/798 kB | 81/151 kB Progress (3): 205 kB | 324/798 kB | 81/151 kB Progress (3): 205 kB | 341/798 kB | 81/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.7 MB/s) 2024-09-12T17:52:24.560 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 357/798 kB | 81/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T17:52:24.562 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 373/798 kB | 81/151 kB Progress (2): 390/798 kB | 81/151 kB Progress (3): 390/798 kB | 81/151 kB | 16/27 kB Progress (3): 406/798 kB | 81/151 kB | 16/27 kB Progress (3): 406/798 kB | 81/151 kB | 27 kB Progress (3): 406/798 kB | 95/151 kB | 27 kB Progress (3): 422/798 kB | 95/151 kB | 27 kB Progress (3): 422/798 kB | 111/151 kB | 27 kB Progress (3): 439/798 kB | 111/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 229 kB/s) 2024-09-12T17:52:24.562 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T17:52:24.565 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 455/798 kB | 111/151 kB Progress (2): 455/798 kB | 128/151 kB Progress (2): 455/798 kB | 144/151 kB Progress (2): 455/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-12T17:52:24.565 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T17:52:24.568 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 472/798 kB Progress (2): 472/798 kB | 16/30 kB Progress (2): 472/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 244 kB/s) 2024-09-12T17:52:24.568 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 488/798 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T17:52:24.573 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 504/798 kB Progress (1): 521/798 kB Progress (1): 537/798 kB Progress (1): 554/798 kB Progress (1): 570/798 kB Progress (1): 586/798 kB Progress (1): 603/798 kB Progress (1): 619/798 kB Progress (1): 635/798 kB Progress (1): 652/798 kB Progress (1): 668/798 kB Progress (1): 685/798 kB Progress (1): 701/798 kB Progress (1): 717/798 kB Progress (1): 734/798 kB Progress (1): 750/798 kB Progress (1): 766/798 kB Progress (1): 783/798 kB Progress (1): 798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.1 MB/s) 2024-09-12T17:52:24.573 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T17:52:24.578 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/385 kB Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 65/385 kB Progress (1): 82/385 kB Progress (1): 98/385 kB Progress (1): 114/385 kB Progress (1): 131/385 kB Progress (2): 131/385 kB | 13 kB Progress (2): 147/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 99 kB/s) 2024-09-12T17:52:24.578 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T17:52:24.580 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (2): 196/385 kB | 16/75 kB Progress (2): 213/385 kB | 16/75 kB Progress (2): 213/385 kB | 33/75 kB Progress (2): 213/385 kB | 49/75 kB Progress (2): 213/385 kB | 61/75 kB Progress (2): 213/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 548 kB/s) 2024-09-12T17:52:24.580 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T17:52:24.590 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 213/385 kB | 16/780 kB Progress (2): 213/385 kB | 33/780 kB Progress (2): 213/385 kB | 49/780 kB Progress (2): 213/385 kB | 62/780 kB Progress (2): 213/385 kB | 78/780 kB Progress (2): 213/385 kB | 95/780 kB Progress (2): 213/385 kB | 111/780 kB Progress (2): 213/385 kB | 128/780 kB Progress (2): 213/385 kB | 144/780 kB Progress (2): 213/385 kB | 160/780 kB Progress (2): 213/385 kB | 177/780 kB Progress (2): 213/385 kB | 193/780 kB Progress (2): 213/385 kB | 209/780 kB Progress (2): 213/385 kB | 226/780 kB Progress (2): 213/385 kB | 242/780 kB Progress (2): 213/385 kB | 259/780 kB Progress (2): 229/385 kB | 259/780 kB Progress (2): 229/385 kB | 275/780 kB Progress (2): 245/385 kB | 275/780 kB Progress (2): 245/385 kB | 291/780 kB Progress (2): 262/385 kB | 291/780 kB Progress (2): 262/385 kB | 308/780 kB Progress (2): 278/385 kB | 308/780 kB Progress (2): 278/385 kB | 324/780 kB Progress (3): 278/385 kB | 324/780 kB | 16/329 kB Progress (3): 278/385 kB | 341/780 kB | 16/329 kB Progress (3): 278/385 kB | 341/780 kB | 33/329 kB Progress (3): 295/385 kB | 341/780 kB | 33/329 kB Progress (3): 295/385 kB | 357/780 kB | 33/329 kB Progress (3): 295/385 kB | 357/780 kB | 49/329 kB Progress (3): 311/385 kB | 357/780 kB | 49/329 kB Progress (3): 311/385 kB | 357/780 kB | 64/329 kB Progress (3): 311/385 kB | 373/780 kB | 64/329 kB Progress (3): 311/385 kB | 373/780 kB | 81/329 kB Progress (3): 327/385 kB | 373/780 kB | 81/329 kB Progress (3): 327/385 kB | 390/780 kB | 81/329 kB Progress (3): 327/385 kB | 390/780 kB | 97/329 kB Progress (3): 344/385 kB | 390/780 kB | 97/329 kB Progress (3): 344/385 kB | 406/780 kB | 97/329 kB Progress (3): 344/385 kB | 406/780 kB | 113/329 kB Progress (3): 360/385 kB | 406/780 kB | 113/329 kB Progress (3): 360/385 kB | 406/780 kB | 130/329 kB Progress (3): 360/385 kB | 422/780 kB | 130/329 kB Progress (3): 360/385 kB | 422/780 kB | 146/329 kB Progress (3): 376/385 kB | 422/780 kB | 146/329 kB Progress (3): 376/385 kB | 439/780 kB | 146/329 kB Progress (3): 376/385 kB | 439/780 kB | 154/329 kB Progress (3): 385 kB | 439/780 kB | 154/329 kB Progress (3): 385 kB | 439/780 kB | 171/329 kB Progress (3): 385 kB | 455/780 kB | 171/329 kB Progress (3): 385 kB | 455/780 kB | 187/329 kB Progress (3): 385 kB | 472/780 kB | 187/329 kB Progress (3): 385 kB | 472/780 kB | 195/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.6 MB/s) 2024-09-12T17:52:24.590 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 488/780 kB | 195/329 kB Progress (2): 488/780 kB | 212/329 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T17:52:24.593 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 488/780 kB | 228/329 kB Progress (2): 504/780 kB | 228/329 kB Progress (3): 504/780 kB | 228/329 kB | 16/501 kB Progress (3): 504/780 kB | 244/329 kB | 16/501 kB Progress (3): 521/780 kB | 244/329 kB | 16/501 kB Progress (3): 521/780 kB | 244/329 kB | 33/501 kB Progress (3): 521/780 kB | 261/329 kB | 33/501 kB Progress (3): 537/780 kB | 261/329 kB | 33/501 kB Progress (3): 554/780 kB | 261/329 kB | 33/501 kB Progress (3): 554/780 kB | 277/329 kB | 33/501 kB Progress (3): 570/780 kB | 277/329 kB | 33/501 kB Progress (3): 570/780 kB | 277/329 kB | 49/501 kB Progress (3): 570/780 kB | 294/329 kB | 49/501 kB Progress (3): 586/780 kB | 294/329 kB | 49/501 kB Progress (3): 603/780 kB | 294/329 kB | 49/501 kB Progress (3): 603/780 kB | 310/329 kB | 49/501 kB Progress (3): 607/780 kB | 310/329 kB | 49/501 kB Progress (3): 607/780 kB | 326/329 kB | 49/501 kB Progress (3): 623/780 kB | 326/329 kB | 49/501 kB Progress (3): 623/780 kB | 326/329 kB | 66/501 kB Progress (3): 623/780 kB | 329 kB | 66/501 kB Progress (3): 640/780 kB | 329 kB | 66/501 kB Progress (3): 640/780 kB | 329 kB | 79/501 kB Progress (3): 652/780 kB | 329 kB | 79/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.2 MB/s) 2024-09-12T17:52:24.594 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T17:52:24.596 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 668/780 kB | 79/501 kB Progress (2): 685/780 kB | 79/501 kB Progress (2): 685/780 kB | 96/501 kB Progress (2): 701/780 kB | 96/501 kB Progress (2): 717/780 kB | 96/501 kB Progress (2): 734/780 kB | 96/501 kB Progress (2): 734/780 kB | 112/501 kB Progress (2): 750/780 kB | 112/501 kB Progress (3): 750/780 kB | 112/501 kB | 16/354 kB Progress (3): 767/780 kB | 112/501 kB | 16/354 kB Progress (3): 767/780 kB | 112/501 kB | 33/354 kB Progress (3): 780 kB | 112/501 kB | 33/354 kB Progress (3): 780 kB | 112/501 kB | 49/354 kB Progress (3): 780 kB | 128/501 kB | 49/354 kB Progress (3): 780 kB | 128/501 kB | 66/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.1 MB/s) 2024-09-12T17:52:24.596 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T17:52:24.605 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 128/501 kB | 82/354 kB Progress (2): 128/501 kB | 98/354 kB Progress (2): 128/501 kB | 115/354 kB Progress (2): 128/501 kB | 131/354 kB Progress (2): 128/501 kB | 147/354 kB Progress (2): 128/501 kB | 164/354 kB Progress (2): 128/501 kB | 180/354 kB Progress (2): 128/501 kB | 197/354 kB Progress (2): 128/501 kB | 213/354 kB Progress (2): 128/501 kB | 229/354 kB Progress (2): 145/501 kB | 229/354 kB Progress (2): 161/501 kB | 229/354 kB Progress (2): 177/501 kB | 229/354 kB Progress (2): 194/501 kB | 229/354 kB Progress (2): 210/501 kB | 229/354 kB Progress (3): 210/501 kB | 229/354 kB | 3.0/41 kB Progress (3): 210/501 kB | 229/354 kB | 19/41 kB Progress (3): 227/501 kB | 229/354 kB | 19/41 kB Progress (3): 227/501 kB | 229/354 kB | 36/41 kB Progress (3): 227/501 kB | 229/354 kB | 41 kB Progress (3): 243/501 kB | 229/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 257 kB/s) 2024-09-12T17:52:24.605 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T17:52:24.609 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 259/501 kB | 229/354 kB Progress (2): 259/501 kB | 246/354 kB Progress (2): 276/501 kB | 246/354 kB Progress (2): 276/501 kB | 256/354 kB Progress (2): 292/501 kB | 256/354 kB Progress (2): 292/501 kB | 272/354 kB Progress (2): 309/501 kB | 272/354 kB Progress (2): 309/501 kB | 289/354 kB Progress (2): 309/501 kB | 305/354 kB Progress (3): 309/501 kB | 305/354 kB | 6.4 kB Progress (3): 309/501 kB | 321/354 kB | 6.4 kB Progress (3): 325/501 kB | 321/354 kB | 6.4 kB Progress (3): 325/501 kB | 338/354 kB | 6.4 kB Progress (3): 341/501 kB | 338/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 39 kB/s) 2024-09-12T17:52:24.609 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 341/501 kB | 354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T17:52:24.609 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 358/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.2 MB/s) 2024-09-12T17:52:24.609 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T17:52:24.616 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 374/501 kB Progress (1): 390/501 kB Progress (1): 407/501 kB Progress (1): 423/501 kB Progress (2): 423/501 kB | 16/586 kB Progress (2): 423/501 kB | 33/586 kB Progress (2): 423/501 kB | 49/586 kB Progress (2): 423/501 kB | 62/586 kB Progress (2): 423/501 kB | 78/586 kB Progress (2): 423/501 kB | 95/586 kB Progress (2): 423/501 kB | 111/586 kB Progress (2): 423/501 kB | 127/586 kB Progress (2): 423/501 kB | 144/586 kB Progress (2): 423/501 kB | 160/586 kB Progress (2): 423/501 kB | 176/586 kB Progress (2): 423/501 kB | 193/586 kB Progress (2): 423/501 kB | 209/586 kB Progress (2): 423/501 kB | 226/586 kB Progress (2): 423/501 kB | 242/586 kB Progress (2): 440/501 kB | 242/586 kB Progress (2): 440/501 kB | 258/586 kB Progress (2): 440/501 kB | 275/586 kB Progress (2): 440/501 kB | 291/586 kB Progress (2): 440/501 kB | 308/586 kB Progress (2): 456/501 kB | 308/586 kB Progress (2): 456/501 kB | 324/586 kB Progress (2): 472/501 kB | 324/586 kB Progress (2): 472/501 kB | 340/586 kB Progress (2): 489/501 kB | 340/586 kB Progress (2): 501 kB | 340/586 kB Progress (2): 501 kB | 357/586 kB Progress (2): 501 kB | 373/586 kB Progress (2): 501 kB | 389/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.9 MB/s) 2024-09-12T17:52:24.616 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T17:52:24.620 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 406/586 kB Progress (1): 422/586 kB Progress (1): 439/586 kB Progress (1): 455/586 kB Progress (1): 471/586 kB Progress (1): 488/586 kB Progress (1): 504/586 kB Progress (1): 521/586 kB Progress (1): 537/586 kB Progress (1): 553/586 kB Progress (1): 570/586 kB Progress (1): 586 kB Progress (2): 586 kB | 16/211 kB Progress (2): 586 kB | 33/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.3 MB/s) 2024-09-12T17:52:24.620 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 49/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T17:52:24.622 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 66/211 kB Progress (1): 82/211 kB Progress (1): 98/211 kB Progress (1): 114/211 kB Progress (1): 131/211 kB Progress (2): 131/211 kB | 14 kB Progress (2): 147/211 kB | 14 kB Progress (2): 163/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 81 kB/s) 2024-09-12T17:52:24.622 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T17:52:24.624 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 163/211 kB | 16/106 kB Progress (2): 180/211 kB | 16/106 kB Progress (2): 180/211 kB | 33/106 kB Progress (2): 196/211 kB | 33/106 kB Progress (2): 196/211 kB | 49/106 kB Progress (2): 211 kB | 49/106 kB Progress (2): 211 kB | 65/106 kB Progress (2): 211 kB | 81/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-12T17:52:24.624 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T17:52:24.624 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 594 kB/s) 2024-09-12T17:52:24.624 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:52:24.630 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 37 kB/s) 2024-09-12T17:52:24.630 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T17:52:24.639 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 63/245 kB Progress (1): 79/245 kB Progress (1): 95/245 kB Progress (1): 112/245 kB Progress (1): 128/245 kB Progress (1): 145/245 kB Progress (2): 145/245 kB | 15/205 kB Progress (2): 161/245 kB | 15/205 kB Progress (2): 161/245 kB | 31/205 kB Progress (2): 177/245 kB | 31/205 kB Progress (2): 177/245 kB | 48/205 kB Progress (2): 194/245 kB | 48/205 kB Progress (2): 194/245 kB | 64/205 kB Progress (2): 210/245 kB | 64/205 kB Progress (2): 210/245 kB | 81/205 kB Progress (3): 210/245 kB | 81/205 kB | 15 kB Progress (4): 210/245 kB | 81/205 kB | 15 kB | 16/16 kB Progress (4): 210/245 kB | 81/205 kB | 15 kB | 16 kB Progress (4): 226/245 kB | 81/205 kB | 15 kB | 16 kB Progress (4): 226/245 kB | 97/205 kB | 15 kB | 16 kB Progress (4): 243/245 kB | 97/205 kB | 15 kB | 16 kB Progress (4): 243/245 kB | 113/205 kB | 15 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 85 kB/s) 2024-09-12T17:52:24.639 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 79 kB/s) 2024-09-12T17:52:24.639 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T17:52:24.640 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 245 kB | 113/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T17:52:24.640 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 245 kB | 130/205 kB Progress (2): 245 kB | 146/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.3 MB/s) 2024-09-12T17:52:24.640 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T17:52:24.640 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 162/205 kB Progress (1): 179/205 kB Progress (1): 195/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-12T17:52:24.641 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T17:52:24.645 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 32 kB/s) 2024-09-12T17:52:24.653 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/17 kB Progress (2): 16/17 kB | 16/23 kB Progress (2): 17 kB | 16/23 kB Progress (3): 17 kB | 16/23 kB | 16/24 kB Progress (3): 17 kB | 23 kB | 16/24 kB Progress (3): 17 kB | 23 kB | 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 84 kB/s) 2024-09-12T17:52:24.653 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 109 kB/s) 2024-09-12T17:52:24.654 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 117 kB/s) 2024-09-12T17:52:24.657 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 871 kB/s) 2024-09-12T17:52:24.676 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:24.676 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T17:52:24.683 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T17:52:24.697 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-12T17:52:24.700 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T17:52:24.714 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-12T17:52:24.716 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T17:52:24.730 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 3.1 MB/s) 2024-09-12T17:52:24.734 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T17:52:24.748 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-12T17:52:24.754 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T17:52:24.771 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-12T17:52:24.772 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T17:52:24.792 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-09-12T17:52:24.854 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:24.854 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:52:24.857 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T17:52:24.872 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 177 kB/s) 2024-09-12T17:52:24.874 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T17:52:24.888 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-12T17:52:24.891 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T17:52:24.905 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 674 kB/s) 2024-09-12T17:52:24.907 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T17:52:24.921 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-12T17:52:24.925 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T17:52:24.949 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 241 kB/s) 2024-09-12T17:52:24.951 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T17:52:24.965 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-12T17:52:24.968 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T17:52:24.983 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-12T17:52:24.985 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T17:52:24.999 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T17:52:25.001 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T17:52:25.015 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T17:52:25.018 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T17:52:25.031 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 246 kB/s) 2024-09-12T17:52:25.033 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T17:52:25.047 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-12T17:52:25.049 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T17:52:25.063 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-12T17:52:25.065 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T17:52:25.079 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-12T17:52:25.082 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T17:52:25.096 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-12T17:52:25.100 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T17:52:25.114 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-12T17:52:25.117 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T17:52:25.131 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-12T17:52:25.136 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T17:52:25.150 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-12T17:52:25.156 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T17:52:25.170 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-12T17:52:25.171 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T17:52:25.171 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T17:52:25.171 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T17:52:25.171 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T17:52:25.172 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T17:52:25.186 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/41 kB Progress (2): 2.5 kB | 33/41 kB Progress (2): 2.5 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 166 kB/s) 2024-09-12T17:52:25.186 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 41 kB | 8.5 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T17:52:25.187 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 41 kB | 8.5 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-12T17:52:25.187 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T17:52:25.187 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-12T17:52:25.188 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 16/269 kB | 16/55 kB Progress (2): 33/269 kB | 16/55 kB Progress (2): 33/269 kB | 33/55 kB Progress (2): 49/269 kB | 33/55 kB Progress (2): 49/269 kB | 49/55 kB Progress (2): 65/269 kB | 49/55 kB Progress (2): 65/269 kB | 55 kB Progress (2): 82/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.1 MB/s) 2024-09-12T17:52:25.195 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 98/269 kB Progress (1): 114/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 196/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 11 MB/s) 2024-09-12T17:52:25.208 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (2): 33/327 kB | 16/587 kB Progress (2): 33/327 kB | 33/587 kB Progress (2): 49/327 kB | 33/587 kB Progress (2): 49/327 kB | 49/587 kB Progress (2): 66/327 kB | 49/587 kB Progress (2): 66/327 kB | 66/587 kB Progress (2): 82/327 kB | 66/587 kB Progress (2): 82/327 kB | 82/587 kB Progress (2): 82/327 kB | 98/587 kB Progress (2): 98/327 kB | 98/587 kB Progress (2): 98/327 kB | 115/587 kB Progress (2): 115/327 kB | 115/587 kB Progress (2): 115/327 kB | 131/587 kB Progress (2): 131/327 kB | 131/587 kB Progress (2): 131/327 kB | 147/587 kB Progress (2): 147/327 kB | 147/587 kB Progress (2): 147/327 kB | 164/587 kB Progress (2): 147/327 kB | 180/587 kB Progress (2): 164/327 kB | 180/587 kB Progress (2): 164/327 kB | 197/587 kB Progress (2): 180/327 kB | 197/587 kB Progress (2): 180/327 kB | 213/587 kB Progress (2): 197/327 kB | 213/587 kB Progress (2): 197/327 kB | 229/587 kB Progress (2): 213/327 kB | 229/587 kB Progress (2): 213/327 kB | 246/587 kB Progress (2): 229/327 kB | 246/587 kB Progress (2): 229/327 kB | 262/587 kB Progress (2): 246/327 kB | 262/587 kB Progress (2): 246/327 kB | 279/587 kB Progress (2): 256/327 kB | 279/587 kB Progress (2): 256/327 kB | 295/587 kB Progress (2): 272/327 kB | 295/587 kB Progress (2): 272/327 kB | 311/587 kB Progress (2): 272/327 kB | 328/587 kB Progress (2): 289/327 kB | 328/587 kB Progress (2): 289/327 kB | 344/587 kB Progress (2): 305/327 kB | 344/587 kB Progress (2): 305/327 kB | 360/587 kB Progress (2): 321/327 kB | 360/587 kB Progress (2): 321/327 kB | 377/587 kB Progress (2): 327 kB | 377/587 kB Progress (2): 327 kB | 393/587 kB Progress (2): 327 kB | 410/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.8 MB/s) 2024-09-12T17:52:25.211 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 426/587 kB Progress (1): 442/587 kB Progress (1): 459/587 kB Progress (1): 475/587 kB Progress (1): 492/587 kB Progress (1): 508/587 kB Progress (1): 524/587 kB Progress (1): 541/587 kB Progress (1): 557/587 kB Progress (1): 573/587 kB Progress (1): 585/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-12T17:52:25.270 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:52:25.271 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:25.271 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:52:25.279 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T17:52:25.294 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-12T17:52:25.297 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T17:52:25.311 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-12T17:52:25.314 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T17:52:25.328 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-12T17:52:25.331 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T17:52:25.345 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-12T17:52:25.350 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T17:52:25.364 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-12T17:52:25.367 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T17:52:25.382 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-12T17:52:25.386 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T17:52:25.401 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T17:52:25.407 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T17:52:25.423 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 311 kB/s) 2024-09-12T17:52:25.427 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T17:52:25.442 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T17:52:25.446 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T17:52:25.461 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T17:52:25.463 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T17:52:25.478 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-12T17:52:25.480 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T17:52:25.494 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.2 MB/s) 2024-09-12T17:52:25.497 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T17:52:25.511 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-12T17:52:25.514 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T17:52:25.529 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-12T17:52:25.531 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T17:52:25.547 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 524 kB/s) 2024-09-12T17:52:25.549 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T17:52:25.564 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T17:52:25.567 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T17:52:25.581 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-12T17:52:25.585 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T17:52:25.600 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-12T17:52:25.605 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T17:52:25.618 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-12T17:52:25.621 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T17:52:25.635 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T17:52:25.637 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T17:52:25.652 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-12T17:52:25.655 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T17:52:25.670 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-12T17:52:25.672 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T17:52:25.687 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-12T17:52:25.694 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T17:52:25.709 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-12T17:52:25.709 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T17:52:25.709 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T17:52:25.709 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T17:52:25.710 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T17:52:25.710 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T17:52:25.725 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/55 kB Progress (2): 16/55 kB | 4.2 kB Progress (2): 33/55 kB | 4.2 kB Progress (2): 49/55 kB | 4.2 kB Progress (2): 55 kB | 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 281 kB/s) 2024-09-12T17:52:25.725 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-12T17:52:25.725 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/27 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T17:52:25.725 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 16/27 kB | 16/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T17:52:25.726 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 27 kB | 16/122 kB Progress (2): 27 kB | 33/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-09-12T17:52:25.726 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T17:52:25.728 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 49/122 kB Progress (2): 49/122 kB | 16/334 kB Progress (2): 66/122 kB | 16/334 kB Progress (2): 82/122 kB | 16/334 kB Progress (2): 82/122 kB | 32/334 kB Progress (2): 98/122 kB | 32/334 kB Progress (2): 115/122 kB | 32/334 kB Progress (2): 122 kB | 32/334 kB Progress (2): 122 kB | 49/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.8 MB/s) 2024-09-12T17:52:25.743 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 65/334 kB Progress (1): 65/334 kB Progress (1): 82/334 kB Progress (1): 98/334 kB Progress (1): 114/334 kB Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Progress (2): 334 kB | 16/267 kB Progress (3): 334 kB | 16/267 kB | 4.7 kB Progress (3): 334 kB | 33/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-12T17:52:25.743 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 334 kB | 49/267 kB Progress (3): 334 kB | 49/267 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 11 MB/s) 2024-09-12T17:52:25.743 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 66/267 kB | 16/23 kB Progress (2): 66/267 kB | 23 kB Progress (2): 82/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-12T17:52:25.743 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 98/267 kB Progress (1): 112/267 kB Progress (1): 129/267 kB Progress (1): 145/267 kB Progress (1): 162/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.4 MB/s) 2024-09-12T17:52:25.873 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T17:52:25.874 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T17:52:27.062 INFO:tasks.workunit.client.0.smithi097.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:52:27.062 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:27.062 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:52:27.065 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:52:27.065 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:27.065 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:52:27.070 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T17:52:27.070 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T17:52:27.237 INFO:tasks.workunit.client.0.smithi097.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:52:27.238 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:27.238 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:52:27.242 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T17:52:27.257 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T17:52:27.261 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T17:52:27.275 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-12T17:52:27.279 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T17:52:27.293 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-12T17:52:27.297 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T17:52:27.311 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-12T17:52:27.315 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T17:52:27.331 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 207 kB/s) 2024-09-12T17:52:27.335 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T17:52:27.349 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-12T17:52:27.353 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T17:52:27.367 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-12T17:52:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T17:52:27.384 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-12T17:52:27.385 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T17:52:27.400 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-12T17:52:27.401 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T17:52:27.414 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-12T17:52:27.417 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T17:52:27.431 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-12T17:52:27.434 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T17:52:27.448 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-12T17:52:27.450 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T17:52:27.464 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-12T17:52:27.466 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T17:52:27.480 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-12T17:52:27.483 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T17:52:27.497 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.2 MB/s) 2024-09-12T17:52:27.499 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T17:52:27.513 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-12T17:52:27.515 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T17:52:27.529 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-12T17:52:27.532 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T17:52:27.551 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 403 kB/s) 2024-09-12T17:52:27.554 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T17:52:27.568 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-12T17:52:27.571 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T17:52:27.584 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 200 kB/s) 2024-09-12T17:52:27.588 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T17:52:27.614 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 59 kB/s) 2024-09-12T17:52:27.617 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T17:52:27.631 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 204 kB/s) 2024-09-12T17:52:27.633 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T17:52:27.647 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.4 MB/s) 2024-09-12T17:52:27.650 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T17:52:27.665 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 451 kB/s) 2024-09-12T17:52:27.668 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T17:52:27.689 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 646 kB/s) 2024-09-12T17:52:27.695 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T17:52:27.710 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 197 kB/s) 2024-09-12T17:52:27.713 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T17:52:27.729 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 453 kB/s) 2024-09-12T17:52:27.732 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T17:52:27.746 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 560 kB/s) 2024-09-12T17:52:27.751 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T17:52:27.766 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-09-12T17:52:27.771 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T17:52:27.786 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-12T17:52:27.792 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T17:52:27.809 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-12T17:52:27.816 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T17:52:27.832 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 880 kB/s) 2024-09-12T17:52:27.836 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T17:52:27.851 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T17:52:27.858 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T17:52:27.874 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 840 kB/s) 2024-09-12T17:52:27.877 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T17:52:27.892 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 319 kB/s) 2024-09-12T17:52:27.898 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T17:52:27.913 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-09-12T17:52:27.918 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T17:52:27.934 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.9 MB/s) 2024-09-12T17:52:27.943 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T17:52:27.961 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 963 kB/s) 2024-09-12T17:52:27.965 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T17:52:27.981 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 871 kB/s) 2024-09-12T17:52:27.990 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T17:52:28.006 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 50 kB/s) 2024-09-12T17:52:28.009 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T17:52:28.024 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 320 kB/s) 2024-09-12T17:52:28.030 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T17:52:28.047 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 494 kB/s) 2024-09-12T17:52:28.053 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T17:52:28.068 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 200 kB/s) 2024-09-12T17:52:28.076 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T17:52:28.091 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 283 kB/s) 2024-09-12T17:52:28.101 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T17:52:28.117 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 128 kB/s) 2024-09-12T17:52:28.124 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T17:52:28.139 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 217 kB/s) 2024-09-12T17:52:28.146 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T17:52:28.166 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 547 kB/s) 2024-09-12T17:52:28.170 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T17:52:28.186 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 842 kB/s) 2024-09-12T17:52:28.190 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T17:52:28.205 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T17:52:28.212 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T17:52:28.227 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-12T17:52:28.230 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T17:52:28.246 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 381 kB/s) 2024-09-12T17:52:28.249 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T17:52:28.264 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 489 kB/s) 2024-09-12T17:52:28.269 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T17:52:28.284 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-09-12T17:52:28.290 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T17:52:28.305 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 487 kB/s) 2024-09-12T17:52:28.311 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T17:52:28.327 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-12T17:52:28.332 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T17:52:28.350 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.1 MB/s) 2024-09-12T17:52:28.358 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T17:52:28.374 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-12T17:52:28.380 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T17:52:28.395 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-12T17:52:28.400 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T17:52:28.415 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 285 kB/s) 2024-09-12T17:52:28.419 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T17:52:28.434 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-12T17:52:28.437 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T17:52:28.452 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.9 MB/s) 2024-09-12T17:52:28.458 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T17:52:28.474 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 148 kB/s) 2024-09-12T17:52:28.487 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T17:52:28.515 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/308 kB Progress (1): 32/308 kB Progress (1): 49/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 11 MB/s) 2024-09-12T17:52:28.516 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T17:52:28.517 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T17:52:28.517 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T17:52:28.517 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T17:52:28.518 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T17:52:28.534 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 66/171 kB Progress (1): 82/171 kB Progress (1): 97/171 kB Progress (1): 113/171 kB Progress (2): 113/171 kB | 16/26 kB Progress (2): 113/171 kB | 19/26 kB Progress (3): 113/171 kB | 19/26 kB | 14 kB Progress (3): 130/171 kB | 19/26 kB | 14 kB Progress (3): 130/171 kB | 26 kB | 14 kB Progress (3): 146/171 kB | 26 kB | 14 kB Progress (3): 163/171 kB | 26 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-09-12T17:52:28.534 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 171 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-09-12T17:52:28.535 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T17:52:28.536 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 171 kB | 16/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T17:52:28.536 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.5 MB/s) 2024-09-12T17:52:28.536 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 16/118 kB | 8.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T17:52:28.537 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 33/118 kB | 8.2 kB Progress (2): 49/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 430 kB/s) 2024-09-12T17:52:28.537 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T17:52:28.538 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 64/118 kB Progress (1): 80/118 kB Progress (1): 97/118 kB Progress (1): 113/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.6 MB/s) 2024-09-12T17:52:28.538 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T17:52:28.551 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 16/61 kB Progress (2): 33/136 kB | 16/61 kB Progress (2): 33/136 kB | 33/61 kB Progress (2): 49/136 kB | 33/61 kB Progress (2): 49/136 kB | 49/61 kB Progress (3): 49/136 kB | 49/61 kB | 15/146 kB Progress (3): 66/136 kB | 49/61 kB | 15/146 kB Progress (3): 66/136 kB | 61 kB | 15/146 kB Progress (3): 66/136 kB | 61 kB | 31/146 kB Progress (3): 82/136 kB | 61 kB | 31/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.9 MB/s) 2024-09-12T17:52:28.552 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 82/136 kB | 48/146 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T17:52:28.553 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 98/136 kB | 48/146 kB Progress (2): 98/136 kB | 64/146 kB Progress (2): 115/136 kB | 64/146 kB Progress (3): 115/136 kB | 64/146 kB | 16/501 kB Progress (3): 115/136 kB | 81/146 kB | 16/501 kB Progress (3): 131/136 kB | 81/146 kB | 16/501 kB Progress (3): 131/136 kB | 81/146 kB | 33/501 kB Progress (3): 136 kB | 81/146 kB | 33/501 kB Progress (3): 136 kB | 97/146 kB | 33/501 kB Progress (3): 136 kB | 97/146 kB | 49/501 kB Progress (3): 136 kB | 113/146 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.0 MB/s) 2024-09-12T17:52:28.553 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T17:52:28.554 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 113/146 kB | 49/501 kB | 16/58 kB Progress (3): 113/146 kB | 66/501 kB | 16/58 kB Progress (3): 130/146 kB | 66/501 kB | 16/58 kB Progress (3): 130/146 kB | 81/501 kB | 16/58 kB Progress (3): 146 kB | 81/501 kB | 16/58 kB Progress (3): 146 kB | 81/501 kB | 33/58 kB Progress (3): 146 kB | 97/501 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.1 MB/s) 2024-09-12T17:52:28.555 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 97/501 kB | 49/58 kB Progress (2): 114/501 kB | 49/58 kB Progress (2): 114/501 kB | 58 kB Progress (2): 130/501 kB | 58 kB Progress (2): 147/501 kB | 58 kB Progress (2): 163/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-12T17:52:28.561 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 179/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 261/501 kB Progress (1): 278/501 kB Progress (1): 282/501 kB Progress (1): 298/501 kB Progress (1): 315/501 kB Progress (1): 331/501 kB Progress (1): 347/501 kB Progress (1): 356/501 kB Progress (1): 372/501 kB Progress (1): 388/501 kB Progress (1): 405/501 kB Progress (1): 421/501 kB Progress (1): 437/501 kB Progress (1): 454/501 kB Progress (1): 470/501 kB Progress (1): 487/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 12 MB/s) 2024-09-12T17:52:28.565 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-12T17:52:28.612 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 26 MB/s) 2024-09-12T17:52:28.729 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:28.729 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T17:52:28.732 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T17:52:28.746 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-12T17:52:28.747 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T17:52:28.761 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-12T17:52:28.762 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T17:52:28.777 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T17:52:28.780 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T17:52:28.794 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-12T17:52:28.798 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T17:52:28.811 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 399 kB/s) 2024-09-12T17:52:28.815 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T17:52:28.829 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-12T17:52:28.833 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T17:52:28.846 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-12T17:52:28.849 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T17:52:28.863 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T17:52:28.865 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T17:52:28.879 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T17:52:28.885 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T17:52:28.899 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-12T17:52:28.902 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T17:52:28.915 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 157 kB/s) 2024-09-12T17:52:28.918 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T17:52:28.932 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-12T17:52:28.935 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T17:52:28.949 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-12T17:52:28.957 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T17:52:28.973 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-12T17:52:28.973 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T17:52:28.974 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T17:52:28.974 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T17:52:28.974 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T17:52:28.974 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T17:52:28.989 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Progress (2): 26 kB | 16/79 kB Progress (3): 26 kB | 16/79 kB | 16/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-12T17:52:28.989 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 33/79 kB | 16/211 kB Progress (2): 33/79 kB | 33/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T17:52:28.993 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 33/79 kB | 33/211 kB | 16/58 kB Progress (4): 33/79 kB | 33/211 kB | 16/58 kB | 0/1.0 MB Progress (4): 49/79 kB | 33/211 kB | 16/58 kB | 0/1.0 MB Progress (4): 49/79 kB | 49/211 kB | 16/58 kB | 0/1.0 MB Progress (4): 49/79 kB | 49/211 kB | 16/58 kB | 0/1.0 MB Progress (4): 49/79 kB | 49/211 kB | 32/58 kB | 0/1.0 MB Progress (4): 49/79 kB | 63/211 kB | 32/58 kB | 0/1.0 MB Progress (4): 63/79 kB | 63/211 kB | 32/58 kB | 0/1.0 MB Progress (4): 63/79 kB | 63/211 kB | 32/58 kB | 0/1.0 MB Progress (4): 63/79 kB | 63/211 kB | 49/58 kB | 0/1.0 MB Progress (4): 79 kB | 63/211 kB | 49/58 kB | 0/1.0 MB Progress (4): 79 kB | 79/211 kB | 49/58 kB | 0/1.0 MB Progress (4): 79 kB | 79/211 kB | 49/58 kB | 0.1/1.0 MB Progress (4): 79 kB | 79/211 kB | 58 kB | 0.1/1.0 MB Progress (4): 79 kB | 79/211 kB | 58 kB | 0.1/1.0 MB Progress (4): 79 kB | 95/211 kB | 58 kB | 0.1/1.0 MB Progress (4): 79 kB | 95/211 kB | 58 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-09-12T17:52:28.993 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 112/211 kB | 58 kB | 0.1/1.0 MB Progress (3): 112/211 kB | 58 kB | 0.1/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T17:52:28.994 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-09-12T17:52:28.996 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.2/1.0 MB Progress (2): 145/211 kB | 0.2/1.0 MB Progress (2): 161/211 kB | 0.2/1.0 MB Progress (2): 161/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 210/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.3/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 10 MB/s) 2024-09-12T17:52:29.010 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 33/116 kB Progress (2): 0.8/1.0 MB | 33/116 kB Progress (2): 0.8/1.0 MB | 49/116 kB Progress (2): 0.8/1.0 MB | 49/116 kB Progress (2): 0.8/1.0 MB | 66/116 kB Progress (2): 0.8/1.0 MB | 66/116 kB Progress (2): 0.8/1.0 MB | 82/116 kB Progress (2): 0.9/1.0 MB | 82/116 kB Progress (2): 0.9/1.0 MB | 82/116 kB Progress (2): 0.9/1.0 MB | 98/116 kB Progress (2): 0.9/1.0 MB | 98/116 kB Progress (2): 0.9/1.0 MB | 115/116 kB Progress (2): 0.9/1.0 MB | 116 kB Progress (2): 0.9/1.0 MB | 116 kB Progress (2): 0.9/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.9 MB/s) 2024-09-12T17:52:29.010 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (2): 1.0/1.0 MB | 16/267 kB Progress (2): 1.0/1.0 MB | 16/267 kB Progress (2): 1.0/1.0 MB | 16/267 kB Progress (2): 1.0/1.0 MB | 33/267 kB Progress (2): 1.0 MB | 33/267 kB Progress (2): 1.0 MB | 49/267 kB Progress (2): 1.0 MB | 63/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 31 MB/s) 2024-09-12T17:52:29.010 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 79/267 kB Progress (1): 96/267 kB Progress (1): 112/267 kB Progress (1): 128/267 kB Progress (1): 145/267 kB Progress (1): 161/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 210/267 kB Progress (1): 227/267 kB Progress (1): 243/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-12T17:52:29.198 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T17:52:29.225 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:52:29.225 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:52:29.225 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:52:29.226 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Total time: 7.389 s 2024-09-12T17:52:29.226 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Finished at: 2024-09-12T17:52:29Z 2024-09-12T17:52:29.226 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:52:29.256 INFO:tasks.workunit.client.0.smithi097.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T17:52:29.261 INFO:tasks.workunit.client.0.smithi097.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:52:30.404 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Scanning for projects... 2024-09-12T17:52:30.509 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:30.509 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:52:30.509 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:52:30.509 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] from pom.xml 2024-09-12T17:52:30.509 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:52:30.793 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:30.793 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:52:30.928 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:52:30.929 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:30.929 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:52:31.023 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:52:31.024 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:31.024 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:52:31.026 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:52:31.026 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:31.026 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:52:31.030 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:52:31.031 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:31.031 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:52:31.231 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T17:52:31.449 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T17:52:31.634 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 25 kB/s) 2024-09-12T17:52:31.642 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T17:52:31.660 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-12T17:52:31.665 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T17:52:31.682 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-12T17:52:31.687 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T17:52:31.707 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 144 kB/s) 2024-09-12T17:52:31.710 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T17:52:31.726 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-12T17:52:31.729 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T17:52:31.745 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T17:52:31.747 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T17:52:31.763 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-12T17:52:31.768 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T17:52:31.790 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-12T17:52:31.791 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T17:52:31.793 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T17:52:31.793 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T17:52:31.793 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T17:52:31.796 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T17:52:31.817 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (1): 5.5/7.7 kB Progress (1): 6.9/7.7 kB Progress (1): 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 306 kB/s) 2024-09-12T17:52:31.863 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/103 kB Progress (2): 1.4/103 kB | 1.4/18 kB Progress (3): 1.4/103 kB | 1.4/18 kB | 1.4/189 kB Progress (3): 1.4/103 kB | 2.8/18 kB | 1.4/189 kB Progress (3): 2.8/103 kB | 2.8/18 kB | 1.4/189 kB Progress (3): 2.8/103 kB | 4.1/18 kB | 1.4/189 kB Progress (3): 2.8/103 kB | 4.1/18 kB | 2.8/189 kB Progress (3): 2.8/103 kB | 5.5/18 kB | 2.8/189 kB Progress (3): 4.1/103 kB | 5.5/18 kB | 2.8/189 kB Progress (3): 4.1/103 kB | 6.9/18 kB | 2.8/189 kB Progress (3): 4.1/103 kB | 6.9/18 kB | 4.1/189 kB Progress (3): 4.1/103 kB | 8.3/18 kB | 4.1/189 kB Progress (3): 5.5/103 kB | 8.3/18 kB | 4.1/189 kB Progress (3): 5.5/103 kB | 9.7/18 kB | 4.1/189 kB Progress (3): 6.9/103 kB | 9.7/18 kB | 4.1/189 kB Progress (3): 6.9/103 kB | 9.7/18 kB | 5.5/189 kB Progress (4): 6.9/103 kB | 9.7/18 kB | 5.5/189 kB | 1.4/169 kB Progress (4): 6.9/103 kB | 9.7/18 kB | 6.9/189 kB | 1.4/169 kB Progress (4): 8.3/103 kB | 9.7/18 kB | 6.9/189 kB | 1.4/169 kB Progress (4): 8.3/103 kB | 11/18 kB | 6.9/189 kB | 1.4/169 kB Progress (4): 9.7/103 kB | 11/18 kB | 6.9/189 kB | 1.4/169 kB Progress (4): 9.7/103 kB | 11/18 kB | 8.3/189 kB | 1.4/169 kB Progress (4): 9.7/103 kB | 11/18 kB | 8.3/189 kB | 2.8/169 kB Progress (4): 9.7/103 kB | 11/18 kB | 9.7/189 kB | 2.8/169 kB Progress (4): 11/103 kB | 11/18 kB | 9.7/189 kB | 2.8/169 kB Progress (4): 11/103 kB | 12/18 kB | 9.7/189 kB | 2.8/169 kB Progress (4): 12/103 kB | 12/18 kB | 9.7/189 kB | 2.8/169 kB Progress (4): 12/103 kB | 12/18 kB | 11/189 kB | 2.8/169 kB Progress (4): 12/103 kB | 12/18 kB | 11/189 kB | 4.1/169 kB Progress (4): 12/103 kB | 12/18 kB | 12/189 kB | 4.1/169 kB Progress (4): 14/103 kB | 12/18 kB | 12/189 kB | 4.1/169 kB Progress (4): 14/103 kB | 14/18 kB | 12/189 kB | 4.1/169 kB Progress (4): 15/103 kB | 14/18 kB | 12/189 kB | 4.1/169 kB Progress (4): 15/103 kB | 14/18 kB | 14/189 kB | 4.1/169 kB Progress (4): 15/103 kB | 14/18 kB | 14/189 kB | 5.5/169 kB Progress (4): 15/103 kB | 14/18 kB | 15/189 kB | 5.5/169 kB Progress (4): 16/103 kB | 14/18 kB | 15/189 kB | 5.5/169 kB Progress (4): 16/103 kB | 15/18 kB | 15/189 kB | 5.5/169 kB Progress (4): 18/103 kB | 15/18 kB | 15/189 kB | 5.5/169 kB Progress (4): 19/103 kB | 15/18 kB | 15/189 kB | 5.5/169 kB Progress (4): 19/103 kB | 15/18 kB | 17/189 kB | 5.5/169 kB Progress (4): 19/103 kB | 15/18 kB | 17/189 kB | 6.9/169 kB Progress (4): 19/103 kB | 15/18 kB | 18/189 kB | 6.9/169 kB Progress (4): 21/103 kB | 15/18 kB | 18/189 kB | 6.9/169 kB Progress (4): 21/103 kB | 17/18 kB | 18/189 kB | 6.9/169 kB Progress (4): 22/103 kB | 17/18 kB | 18/189 kB | 6.9/169 kB Progress (4): 22/103 kB | 17/18 kB | 19/189 kB | 6.9/169 kB Progress (4): 22/103 kB | 17/18 kB | 19/189 kB | 8.3/169 kB Progress (4): 22/103 kB | 17/18 kB | 21/189 kB | 8.3/169 kB Progress (4): 23/103 kB | 17/18 kB | 21/189 kB | 8.3/169 kB Progress (4): 23/103 kB | 18 kB | 21/189 kB | 8.3/169 kB Progress (4): 25/103 kB | 18 kB | 21/189 kB | 8.3/169 kB Progress (4): 25/103 kB | 18 kB | 22/189 kB | 8.3/169 kB Progress (4): 25/103 kB | 18 kB | 22/189 kB | 9.7/169 kB Progress (4): 25/103 kB | 18 kB | 23/189 kB | 9.7/169 kB Progress (4): 26/103 kB | 18 kB | 23/189 kB | 9.7/169 kB Progress (4): 26/103 kB | 18 kB | 25/189 kB | 9.7/169 kB Progress (4): 26/103 kB | 18 kB | 25/189 kB | 11/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 247 kB/s) 2024-09-12T17:52:31.878 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 26/103 kB | 25/189 kB | 12/169 kB Progress (3): 26/103 kB | 26/189 kB | 12/169 kB Progress (3): 27/103 kB | 26/189 kB | 12/169 kB Progress (3): 27/103 kB | 28/189 kB | 12/169 kB Progress (3): 27/103 kB | 28/189 kB | 14/169 kB Progress (3): 27/103 kB | 29/189 kB | 14/169 kB Progress (3): 29/103 kB | 29/189 kB | 14/169 kB Progress (3): 29/103 kB | 30/189 kB | 14/169 kB Progress (3): 29/103 kB | 30/189 kB | 15/169 kB Progress (3): 29/103 kB | 32/189 kB | 15/169 kB Progress (3): 30/103 kB | 32/189 kB | 15/169 kB Progress (3): 30/103 kB | 33/189 kB | 15/169 kB Progress (3): 30/103 kB | 33/189 kB | 16/169 kB Progress (3): 32/103 kB | 33/189 kB | 16/169 kB Progress (3): 32/103 kB | 33/189 kB | 18/169 kB Progress (3): 33/103 kB | 33/189 kB | 18/169 kB Progress (3): 33/103 kB | 33/189 kB | 19/169 kB Progress (3): 34/103 kB | 33/189 kB | 19/169 kB Progress (3): 34/103 kB | 49/189 kB | 19/169 kB Progress (3): 36/103 kB | 49/189 kB | 19/169 kB Progress (3): 36/103 kB | 49/189 kB | 21/169 kB Progress (3): 37/103 kB | 49/189 kB | 21/169 kB Progress (3): 37/103 kB | 49/189 kB | 22/169 kB Progress (3): 38/103 kB | 49/189 kB | 22/169 kB Progress (3): 38/103 kB | 66/189 kB | 22/169 kB Progress (3): 38/103 kB | 66/189 kB | 23/169 kB Progress (3): 40/103 kB | 66/189 kB | 23/169 kB Progress (3): 40/103 kB | 66/189 kB | 25/169 kB Progress (3): 41/103 kB | 66/189 kB | 25/169 kB Progress (3): 41/103 kB | 66/189 kB | 26/169 kB Progress (3): 43/103 kB | 66/189 kB | 26/169 kB Progress (3): 43/103 kB | 82/189 kB | 26/169 kB Progress (3): 44/103 kB | 82/189 kB | 26/169 kB Progress (3): 44/103 kB | 82/189 kB | 27/169 kB Progress (3): 45/103 kB | 82/189 kB | 27/169 kB Progress (3): 45/103 kB | 82/189 kB | 29/169 kB Progress (3): 45/103 kB | 98/189 kB | 29/169 kB Progress (3): 47/103 kB | 98/189 kB | 29/169 kB Progress (3): 47/103 kB | 98/189 kB | 30/169 kB Progress (3): 48/103 kB | 98/189 kB | 30/169 kB Progress (3): 48/103 kB | 98/189 kB | 32/169 kB Progress (3): 50/103 kB | 98/189 kB | 32/169 kB Progress (3): 50/103 kB | 98/189 kB | 33/169 kB Progress (3): 51/103 kB | 98/189 kB | 33/169 kB Progress (3): 51/103 kB | 98/189 kB | 34/169 kB Progress (3): 52/103 kB | 98/189 kB | 34/169 kB Progress (3): 52/103 kB | 98/189 kB | 36/169 kB Progress (3): 54/103 kB | 98/189 kB | 36/169 kB Progress (3): 54/103 kB | 98/189 kB | 37/169 kB Progress (3): 55/103 kB | 98/189 kB | 37/169 kB Progress (3): 55/103 kB | 98/189 kB | 38/169 kB Progress (3): 56/103 kB | 98/189 kB | 38/169 kB Progress (3): 56/103 kB | 98/189 kB | 40/169 kB Progress (3): 58/103 kB | 98/189 kB | 40/169 kB Progress (3): 58/103 kB | 115/189 kB | 40/169 kB Progress (3): 59/103 kB | 115/189 kB | 40/169 kB Progress (3): 59/103 kB | 115/189 kB | 41/169 kB Progress (3): 61/103 kB | 115/189 kB | 41/169 kB Progress (3): 61/103 kB | 115/189 kB | 43/169 kB Progress (3): 62/103 kB | 115/189 kB | 43/169 kB Progress (3): 62/103 kB | 115/189 kB | 44/169 kB Progress (3): 63/103 kB | 115/189 kB | 44/169 kB Progress (3): 63/103 kB | 115/189 kB | 45/169 kB Progress (3): 64/103 kB | 115/189 kB | 45/169 kB Progress (3): 64/103 kB | 115/189 kB | 47/169 kB Progress (3): 64/103 kB | 115/189 kB | 48/169 kB Progress (3): 81/103 kB | 115/189 kB | 48/169 kB Progress (3): 81/103 kB | 115/189 kB | 49/169 kB Progress (3): 81/103 kB | 115/189 kB | 51/169 kB Progress (3): 81/103 kB | 115/189 kB | 52/169 kB Progress (3): 97/103 kB | 115/189 kB | 52/169 kB Progress (3): 97/103 kB | 115/189 kB | 54/169 kB Progress (3): 97/103 kB | 115/189 kB | 55/169 kB Progress (3): 103 kB | 115/189 kB | 55/169 kB Progress (3): 103 kB | 115/189 kB | 56/169 kB Progress (3): 103 kB | 115/189 kB | 58/169 kB Progress (3): 103 kB | 115/189 kB | 59/169 kB Progress (3): 103 kB | 115/189 kB | 61/169 kB Progress (3): 103 kB | 115/189 kB | 61/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-12T17:52:31.885 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 115/189 kB | 78/169 kB Progress (2): 131/189 kB | 78/169 kB Progress (2): 131/189 kB | 94/169 kB Progress (2): 147/189 kB | 94/169 kB Progress (2): 164/189 kB | 94/169 kB Progress (2): 180/189 kB | 94/169 kB Progress (2): 180/189 kB | 111/169 kB Progress (2): 180/189 kB | 127/169 kB Progress (2): 189 kB | 127/169 kB Progress (2): 189 kB | 143/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.0 MB/s) 2024-09-12T17:52:31.892 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 160/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.7 MB/s) 2024-09-12T17:52:31.906 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:52:31.906 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:52:31.906 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] T E S T S 2024-09-12T17:52:31.906 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:52:32.544 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T17:52:32.677 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjects.java: starting test run: 2024-09-12T17:52:32.677 INFO:tasks.workunit.client.0.smithi097.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:52:32.677 INFO:tasks.workunit.client.0.smithi097.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:52:32.677 INFO:tasks.workunit.client.0.smithi097.stdout: EndpointUrl=https://smithi097.front.sepia.ceph.com:443 2024-09-12T17:52:32.678 INFO:tasks.workunit.client.0.smithi097.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T17:52:32.772 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Environment Variables Read 2024-09-12T17:52:33.174 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: S3 Client Initialized 2024-09-12T17:52:33.174 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-12T17:52:33.174 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-12T17:52:33.174 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-12T17:52:33.174 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-12T17:52:33.174 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-12T17:52:33.276 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-12T17:52:33.276 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-12T17:52:33.276 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-12T17:52:33.276 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-12T17:52:33.277 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-12T17:52:33.277 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-12T17:52:33.277 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-12T17:52:33.277 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generated Big Files 2024-09-12T17:52:33.865 INFO:tasks.workunit.client.0.smithi097.stdout:HeadBucketResponse() 2024-09-12T17:52:33.865 INFO:tasks.workunit.client.0.smithi097.stdout:sheik is ready 2024-09-12T17:52:33.865 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Test Bucket Created 2024-09-12T17:52:33.983 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T17:52:34.283 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T17:52:34.584 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T17:52:34.885 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T17:52:35.186 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T17:52:35.587 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T17:52:36.088 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T17:52:36.489 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T17:52:37.591 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T17:52:38.493 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T17:52:44.807 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T17:52:51.420 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T17:53:53.958 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-0b 2024-09-12T17:53:53.960 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-8b 2024-09-12T17:53:53.961 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-200b 2024-09-12T17:53:53.962 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-21983b 2024-09-12T17:53:53.963 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-5519b 2024-09-12T17:53:53.964 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-204329b 2024-09-12T17:53:53.965 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-256k 2024-09-12T17:53:53.966 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-1m 2024-09-12T17:53:53.967 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-1038757b 2024-09-12T17:53:54.012 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T17:53:54.313 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-12T17:53:54.413 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T17:53:54.513 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-12T17:53:54.613 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T17:53:54.813 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-12T17:53:54.914 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T17:53:55.114 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-12T17:53:55.214 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T17:53:55.414 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-12T17:53:55.515 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T17:53:55.815 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-12T17:53:56.016 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T17:53:56.316 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-12T17:53:56.416 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T17:53:57.317 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-12T17:53:57.618 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T17:53:58.519 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-12T17:53:58.819 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T17:54:03.826 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T17:54:13.337 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T17:55:43.773 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 191.2 s -- in io.ceph.jcksum.PutObjects 2024-09-12T17:55:43.803 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:55:43.804 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Results: 2024-09-12T17:55:43.804 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:55:43.804 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T17:55:43.804 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-12T17:55:43.805 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:55:43.806 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:55:43.806 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:55:43.806 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Total time: 03:13 min 2024-09-12T17:55:43.807 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Finished at: 2024-09-12T17:55:43Z 2024-09-12T17:55:43.807 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:55:43.826 INFO:tasks.workunit.client.0.smithi097.stderr:+ exit 2024-09-12T17:55:43.827 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:55:43.827 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:55:43.878 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T17:55:43.879 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:55:44.249 DEBUG:teuthology.parallel:result is None 2024-09-12T17:55:44.250 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:55:44.262 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:55:44.262 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:55:44.308 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:55:44.309 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:55:44.323 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:55:44.323 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:55:44.323 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:55:44.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:55:44.356 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:55:44.357 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:55:44.404 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:55:44.405 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:55:44.452 INFO:tasks.workunit:timeout=3h 2024-09-12T17:55:44.453 INFO:tasks.workunit:cleanup=True 2024-09-12T17:55:44.453 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:55:44.503 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:56:41.389 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:56:41.390 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:56:41.390 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:56:41.390 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:56:41.390 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:56:41.390 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:56:41.391 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:56:41.391 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:56:41.391 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:56:41.391 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-09-12T17:56:41.391 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:56:41.391 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-09-12T17:56:41.391 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:56:41.391 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-09-12T17:56:41.391 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:56:41.392 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:56:41.392 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T17:56:41.392 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:56:41.397 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:56:41.450 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:56:41.453 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:56:41.453 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:56:41.510 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:56:41.560 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:56:41.604 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:56:41.606 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:56:41.606 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:56:41.653 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:56:41.658 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:56:41.658 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:56:41.704 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T17:56:41.705 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T17:56:41.706 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T17:56:41.760 INFO:tasks.workunit.client.0.smithi097.stdout:INFO: fully qualified domain name: smithi097.front.sepia.ceph.com 2024-09-12T17:56:41.760 INFO:tasks.workunit.client.0.smithi097.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T17:56:41.760 INFO:tasks.workunit.client.0.smithi097.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T17:56:45.189 INFO:tasks.workunit.client.0.smithi097.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:56:45.393 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting pip 2024-09-12T17:56:45.399 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:56:45.433 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: pip 2024-09-12T17:56:45.433 INFO:tasks.workunit.client.0.smithi097.stdout: Attempting uninstall: pip 2024-09-12T17:56:45.433 INFO:tasks.workunit.client.0.smithi097.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:56:45.715 INFO:tasks.workunit.client.0.smithi097.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:56:45.722 INFO:tasks.workunit.client.0.smithi097.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:56:46.706 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed pip-24.2 2024-09-12T17:56:47.744 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting boto3 2024-09-12T17:56:47.748 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:56:48.259 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:56:48.260 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:56:48.315 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:56:48.316 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:56:48.361 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:56:48.362 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:56:48.412 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:56:48.414 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:56:48.515 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:56:48.517 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:56:48.668 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:56:48.669 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:56:48.673 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:56:48.674 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:56:48.683 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:56:48.684 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:56:48.686 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:56:48.687 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:56:48.688 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:56:48.757 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:56:49.733 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:56:50.087 INFO:tasks.workunit.client.0.smithi097.stdout:INFO: creating user 2024-09-12T17:56:50.224 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-12T17:56:50.225 INFO:tasks.workunit.client.0.smithi097.stdout: "user_id": "testid", 2024-09-12T17:56:50.225 INFO:tasks.workunit.client.0.smithi097.stdout: "display_name": "M. Tester", 2024-09-12T17:56:50.225 INFO:tasks.workunit.client.0.smithi097.stdout: "email": "tester@ceph.com", 2024-09-12T17:56:50.225 INFO:tasks.workunit.client.0.smithi097.stdout: "suspended": 0, 2024-09-12T17:56:50.225 INFO:tasks.workunit.client.0.smithi097.stdout: "max_buckets": 1000, 2024-09-12T17:56:50.225 INFO:tasks.workunit.client.0.smithi097.stdout: "subusers": [], 2024-09-12T17:56:50.225 INFO:tasks.workunit.client.0.smithi097.stdout: "keys": [ 2024-09-12T17:56:50.225 INFO:tasks.workunit.client.0.smithi097.stdout: { 2024-09-12T17:56:50.225 INFO:tasks.workunit.client.0.smithi097.stdout: "user": "testid", 2024-09-12T17:56:50.225 INFO:tasks.workunit.client.0.smithi097.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T17:56:50.225 INFO:tasks.workunit.client.0.smithi097.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: "active": true, 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-12T17:56:50.216484Z" 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: ], 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: "swift_keys": [], 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: "caps": [], 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: "default_placement": "", 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: "default_storage_class": "", 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: "placement_tags": [], 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_quota": { 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-12T17:56:50.226 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "user_quota": { 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "temp_url_keys": [], 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "type": "rgw", 2024-09-12T17:56:50.227 INFO:tasks.workunit.client.0.smithi097.stdout: "mfa_ids": [], 2024-09-12T17:56:50.228 INFO:tasks.workunit.client.0.smithi097.stdout: "account_id": "", 2024-09-12T17:56:50.228 INFO:tasks.workunit.client.0.smithi097.stdout: "path": "/", 2024-09-12T17:56:50.228 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-12T17:56:50.216472Z", 2024-09-12T17:56:50.228 INFO:tasks.workunit.client.0.smithi097.stdout: "tags": [], 2024-09-12T17:56:50.228 INFO:tasks.workunit.client.0.smithi097.stdout: "group_ids": [] 2024-09-12T17:56:50.228 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-12T17:56:50.228 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-12T17:56:54.547 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:54.547 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:56:54.713 INFO:tasks.workunit.client.0.smithi097.stderr:5+0 records in 2024-09-12T17:56:54.713 INFO:tasks.workunit.client.0.smithi097.stderr:5+0 records out 2024-09-12T17:56:54.713 INFO:tasks.workunit.client.0.smithi097.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0224048 s, 234 MB/s 2024-09-12T17:56:54.718 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:54.718 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:56:54.834 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:54.834 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:56:57.238 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:57.238 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:56:59.605 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:59.605 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:01.920 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:01.921 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:04.334 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:04.334 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:06.773 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:06.773 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:09.154 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:09.155 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:11.526 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:11.526 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:14.044 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:14.044 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:16.668 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:16.669 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:19.285 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:19.286 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:21.847 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:21.847 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:24.391 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:24.391 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:26.890 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:26.890 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T17:57:27.171 INFO:tasks.workunit.client.0.smithi097.stdout:bucket nams is reupload-bkt-121643 2024-09-12T17:57:27.171 INFO:tasks.workunit.client.0.smithi097.stdout:endpoint is https://smithi097.front.sepia.ceph.com:443 2024-09-12T17:57:27.171 INFO:tasks.workunit.client.0.smithi097.stdout:start UploadId=2~8-_RKt892ypqxB82SdnaodBfHxLUnBS 2024-09-12T17:57:27.171 INFO:tasks.workunit.client.0.smithi097.stdout:phase 1 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.172 INFO:tasks.workunit.client.0.smithi097.stdout:phase 1 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 2} 2024-09-12T17:57:27.172 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.172 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.172 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.172 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.172 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.172 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.172 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.172 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.172 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.172 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.173 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1} 2024-09-12T17:57:27.173 INFO:tasks.workunit.client.0.smithi097.stdout:completing multipart upload, parts=[{'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 1}, {'ETag': '"406d738020bdded3072f370ab0938aef"', 'PartNumber': 2}] 2024-09-12T17:57:28.305 INFO:tasks.workunit.client.0.smithi097.stdout:radosgw-admin bucket radoslist: 2024-09-12T17:57:28.305 INFO:tasks.workunit.client.0.smithi097.stdout:98539659-fdaf-41ce-847d-239ff89323af.4641.3_mpu_test4 2024-09-12T17:57:28.305 INFO:tasks.workunit.client.0.smithi097.stdout:98539659-fdaf-41ce-847d-239ff89323af.4641.3__multipart_mpu_test4.2~8-_RKt892ypqxB82SdnaodBfHxLUnBS.2 2024-09-12T17:57:28.306 INFO:tasks.workunit.client.0.smithi097.stdout:98539659-fdaf-41ce-847d-239ff89323af.4641.3__multipart_mpu_test4.TuPkMU4jm7x4TBg7DZ21oAys5r5K5U7i.1 2024-09-12T17:57:28.306 INFO:tasks.workunit.client.0.smithi097.stdout:98539659-fdaf-41ce-847d-239ff89323af.4641.3__shadow_mpu_test4.2~8-_RKt892ypqxB82SdnaodBfHxLUnBS.2_1 2024-09-12T17:57:28.306 INFO:tasks.workunit.client.0.smithi097.stdout:98539659-fdaf-41ce-847d-239ff89323af.4641.3__shadow_mpu_test4.TuPkMU4jm7x4TBg7DZ21oAys5r5K5U7i.1_1 2024-09-12T17:57:28.392 INFO:tasks.workunit.client.0.smithi097.stdout:rados ls: 2024-09-12T17:57:28.392 INFO:tasks.workunit.client.0.smithi097.stdout:98539659-fdaf-41ce-847d-239ff89323af.4641.3_mpu_test4 2024-09-12T17:57:28.392 INFO:tasks.workunit.client.0.smithi097.stdout:98539659-fdaf-41ce-847d-239ff89323af.4641.3__multipart_mpu_test4.2~8-_RKt892ypqxB82SdnaodBfHxLUnBS.2 2024-09-12T17:57:28.392 INFO:tasks.workunit.client.0.smithi097.stdout:98539659-fdaf-41ce-847d-239ff89323af.4641.3__multipart_mpu_test4.TuPkMU4jm7x4TBg7DZ21oAys5r5K5U7i.1 2024-09-12T17:57:28.392 INFO:tasks.workunit.client.0.smithi097.stdout:98539659-fdaf-41ce-847d-239ff89323af.4641.3__shadow_mpu_test4.2~8-_RKt892ypqxB82SdnaodBfHxLUnBS.2_1 2024-09-12T17:57:28.392 INFO:tasks.workunit.client.0.smithi097.stdout:98539659-fdaf-41ce-847d-239ff89323af.4641.3__shadow_mpu_test4.TuPkMU4jm7x4TBg7DZ21oAys5r5K5U7i.1_1 2024-09-12T17:57:28.662 INFO:tasks.workunit.client.0.smithi097.stdout:== PASSED == 2024-09-12T17:57:28.663 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:57:28.663 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:57:28.720 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T17:57:28.720 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:57:29.161 DEBUG:teuthology.parallel:result is None 2024-09-12T17:57:29.161 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:57:29.173 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:57:29.174 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:57:29.220 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:57:29.220 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T17:57:29.237 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T17:57:29.238 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T17:57:29.238 INFO:tasks.ragweed:Using branch 'wip-rgw-meta-handlers' for ragweed 2024-09-12T17:57:29.238 DEBUG:teuthology.orchestra.run.smithi097:> git clone -b wip-rgw-meta-handlers https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:57:29.268 INFO:teuthology.orchestra.run.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:57:29.325 INFO:teuthology.orchestra.run.smithi097.stderr:fatal: Remote branch wip-rgw-meta-handlers not found in upstream origin 2024-09-12T17:57:29.326 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T17:57:29.327 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T17:57:29.328 DEBUG:teuthology.orchestra.run.smithi097:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:57:29.376 INFO:teuthology.orchestra.run.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:57:29.551 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T17:57:29.552 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T17:57:29.552 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key NZYSCWRQPCFGEHPSBWTA --secret PKnyZb+qi5wx0UGX2l6Znj+N34yISBVGK9DBiUutKHHOTZzSvYWOeQ== --email ragweed.client.0+test@test.test --system false 2024-09-12T17:57:29.646 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:29.646 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:29.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.885+0000 7f5a4353f640 0 --2- 172.21.15.97:0/419400636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x56501ac90ba0 0x56501ac98440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:57:29.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.893+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.893+0000 7f5a452389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:29.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.893+0000 7f5a452389c0 20 realm 2024-09-12T17:57:29.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.893+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.897+0000 7f5a452389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:29.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.897+0000 7f5a452389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:29.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.897+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.897+0000 7f5a452389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:29.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.897+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.897+0000 7f5a452389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:29.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.897+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.901+0000 7f5a452389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:29.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.901+0000 7f5a452389c0 20 searching for the correct realm 2024-09-12T17:57:29.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.901+0000 7f5a4353f640 0 -- 172.21.15.97:0/1966139909 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f5a30084020 msgr2=0x7f5a30063bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:29.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.909+0000 7f5a4353f640 0 -- 172.21.15.97:0/1966139909 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x7f590c07f9e0 msgr2=0x7f590c081df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:29.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:57:29.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:29.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:29.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:57:29.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:29.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:29.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:29.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:29.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 zone default found 2024-09-12T17:57:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 4 Realm: () 2024-09-12T17:57:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:57:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:57:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 zonegroup default 2024-09-12T17:57:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.921+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.925+0000 7f5a452389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.925+0000 7f5a452389c0 20 started sync module instance, tier type = 2024-09-12T17:57:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.925+0000 7f5a452389c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:57:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.941+0000 7f5a452389c0 20 add_watcher() i=0 2024-09-12T17:57:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.941+0000 7f5a452389c0 20 add_watcher() i=1 2024-09-12T17:57:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.941+0000 7f5a452389c0 20 add_watcher() i=2 2024-09-12T17:57:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.941+0000 7f5a452389c0 20 add_watcher() i=3 2024-09-12T17:57:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.941+0000 7f5a452389c0 20 add_watcher() i=4 2024-09-12T17:57:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.941+0000 7f5a452389c0 20 add_watcher() i=5 2024-09-12T17:57:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.941+0000 7f5a452389c0 20 add_watcher() i=6 2024-09-12T17:57:29.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.945+0000 7f5a452389c0 20 add_watcher() i=7 2024-09-12T17:57:29.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.945+0000 7f5a452389c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:29.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f58f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:29.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:29.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:29.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 5 note: GC not initialized 2024-09-12T17:57:29.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f58737fe640 20 reqs_thread_entry: start 2024-09-12T17:57:29.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:29.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 20 Filter name: none 2024-09-12T17:57:29.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f58717fa640 20 reqs_thread_entry: start 2024-09-12T17:57:29.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:57:29.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:29.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T17:57:29.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:57:29.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T17:57:29.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.949+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:29.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T17:57:29.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:57:29.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 10 cache get: name=default.rgw.meta+users.keys+NZYSCWRQPCFGEHPSBWTA : miss 2024-09-12T17:57:29.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:29.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:29.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 10 cache put: name=default.rgw.meta+users.keys+NZYSCWRQPCFGEHPSBWTA info.flags=0x0 2024-09-12T17:57:29.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 10 adding default.rgw.meta+users.keys+NZYSCWRQPCFGEHPSBWTA to cache LRU end 2024-09-12T17:57:29.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 10 cache get: name=default.rgw.meta+users.keys+NZYSCWRQPCFGEHPSBWTA : hit (negative entry) 2024-09-12T17:57:29.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 10 cache get: name=default.rgw.meta+users.keys+NZYSCWRQPCFGEHPSBWTA : hit (negative entry) 2024-09-12T17:57:29.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:57:29.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:57:29.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5a452389c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:57:29.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5925ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627832 cookie 94902046912656 notifier 5925 bl.length()=675 2024-09-12T17:57:29.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5925ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:57:29.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.953+0000 7f5925ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:57:29.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.957+0000 7f5a452389c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:57:29.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.957+0000 7f5a452389c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:57:29.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.957+0000 7f5a452389c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:57:29.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.957+0000 7f5925ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627790 cookie 94902046902768 notifier 5925 bl.length()=202 2024-09-12T17:57:29.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.957+0000 7f5925ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:57:29.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.957+0000 7f5925ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:57:29.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.965+0000 7f5a452389c0 10 cache put: name=default.rgw.meta+users.keys+NZYSCWRQPCFGEHPSBWTA info.flags=0x7 2024-09-12T17:57:29.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.965+0000 7f5a452389c0 10 moving default.rgw.meta+users.keys+NZYSCWRQPCFGEHPSBWTA to cache LRU end 2024-09-12T17:57:29.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.965+0000 7f5a452389c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:NZYSCWRQPCFGEHPSBWTA, ofs0, ns] 2024-09-12T17:57:29.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.965+0000 7f5925ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627833 cookie 94902046912656 notifier 5925 bl.length()=190 2024-09-12T17:57:29.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.965+0000 7f5925ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NZYSCWRQPCFGEHPSBWTA info.flags=0x7 2024-09-12T17:57:29.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.965+0000 7f5925ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NZYSCWRQPCFGEHPSBWTA to cache LRU end 2024-09-12T17:57:29.966 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "ragweed.client.0", 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "ragweed.client.0", 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "NZYSCWRQPCFGEHPSBWTA", 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "PKnyZb+qi5wx0UGX2l6Znj+N34yISBVGK9DBiUutKHHOTZzSvYWOeQ==", 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-12T17:57:29.967 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T17:57:29.956946Z" 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T17:57:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-12T17:57:29.969 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-12T17:57:29.970 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-12T17:57:29.970 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-12T17:57:29.970 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T17:57:29.956926Z", 2024-09-12T17:57:29.970 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-12T17:57:29.970 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-12T17:57:29.970 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T17:57:29.970 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:57:29.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.969+0000 7f58f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:29.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.973+0000 7f5a452389c0 20 remove_watcher() i=0 2024-09-12T17:57:29.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.973+0000 7f5a452389c0 2 removed watcher, disabling cache 2024-09-12T17:57:29.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.973+0000 7f5a452389c0 20 remove_watcher() i=1 2024-09-12T17:57:29.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.977+0000 7f5a452389c0 20 remove_watcher() i=2 2024-09-12T17:57:29.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.977+0000 7f5a452389c0 20 remove_watcher() i=3 2024-09-12T17:57:29.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.981+0000 7f5a452389c0 20 remove_watcher() i=4 2024-09-12T17:57:29.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.981+0000 7f5a452389c0 20 remove_watcher() i=5 2024-09-12T17:57:29.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.985+0000 7f5a452389c0 20 remove_watcher() i=6 2024-09-12T17:57:29.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:29.989+0000 7f5a452389c0 20 remove_watcher() i=7 2024-09-12T17:57:30.005 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T17:57:30.005 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ZHQZKDLLCNOGFOAQZTRC --secret Cv3Ttw+jcliXrv1Ehlj+YbFnE9kwpLnHFXlM4hM/NmA36Vus2jxtEQ== --email sysuser.client.0+test@test.test --system true 2024-09-12T17:57:30.045 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:30.045 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:30.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.085+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.085+0000 7f79d55519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:30.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.085+0000 7f79d55519c0 20 realm 2024-09-12T17:57:30.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.085+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.085+0000 7f79d55519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:30.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.085+0000 7f79d55519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:30.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.085+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.089+0000 7f79d55519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:30.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.089+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.089+0000 7f79d55519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:30.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.089+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.089+0000 7f79d55519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:30.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.089+0000 7f79d55519c0 20 searching for the correct realm 2024-09-12T17:57:30.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.097+0000 7f79d3858640 0 -- 172.21.15.97:0/3749030575 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5598fcf05070 msgr2=0x5598fcf07500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:30.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.105+0000 7f79d3858640 0 -- 172.21.15.97:0/3749030575 >> [v2:172.21.15.154:6808/3304684764,v1:172.21.15.154:6809/3304684764] conn(0x7f79c403a070 msgr2=0x7f79c4057910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:30.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T17:57:30.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:30.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:30.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T17:57:30.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:30.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:30.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:30.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 zone default found 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 4 Realm: () 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 zonegroup default 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.109+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.113+0000 7f79d55519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:30.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.113+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.113+0000 7f79d55519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:30.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.113+0000 7f79d55519c0 20 started sync module instance, tier type = 2024-09-12T17:57:30.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.113+0000 7f79d55519c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T17:57:30.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.129+0000 7f79d55519c0 20 add_watcher() i=0 2024-09-12T17:57:30.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.129+0000 7f79d55519c0 20 add_watcher() i=1 2024-09-12T17:57:30.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.129+0000 7f79d55519c0 20 add_watcher() i=2 2024-09-12T17:57:30.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.129+0000 7f79d55519c0 20 add_watcher() i=3 2024-09-12T17:57:30.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.129+0000 7f79d55519c0 20 add_watcher() i=4 2024-09-12T17:57:30.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.129+0000 7f79d55519c0 20 add_watcher() i=5 2024-09-12T17:57:30.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.129+0000 7f79d55519c0 20 add_watcher() i=6 2024-09-12T17:57:30.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.133+0000 7f79d55519c0 20 add_watcher() i=7 2024-09-12T17:57:30.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.133+0000 7f79d55519c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:30.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.133+0000 7f7889fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:30.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.133+0000 7f79d55519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:30.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.133+0000 7f79d55519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:30.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.133+0000 7f79d55519c0 5 note: GC not initialized 2024-09-12T17:57:30.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f7888fe1640 20 reqs_thread_entry: start 2024-09-12T17:57:30.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:30.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 20 Filter name: none 2024-09-12T17:57:30.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f78027fc640 20 reqs_thread_entry: start 2024-09-12T17:57:30.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:57:30.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 10 cache get: name=default.rgw.meta+users.keys+ZHQZKDLLCNOGFOAQZTRC : miss 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 10 cache put: name=default.rgw.meta+users.keys+ZHQZKDLLCNOGFOAQZTRC info.flags=0x0 2024-09-12T17:57:30.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 10 adding default.rgw.meta+users.keys+ZHQZKDLLCNOGFOAQZTRC to cache LRU end 2024-09-12T17:57:30.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 10 cache get: name=default.rgw.meta+users.keys+ZHQZKDLLCNOGFOAQZTRC : hit (negative entry) 2024-09-12T17:57:30.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.137+0000 7f79d55519c0 10 cache get: name=default.rgw.meta+users.keys+ZHQZKDLLCNOGFOAQZTRC : hit (negative entry) 2024-09-12T17:57:30.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.141+0000 7f79d55519c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:57:30.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.141+0000 7f79d55519c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:57:30.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.141+0000 7f79d55519c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:57:30.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.141+0000 7f78b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627791 cookie 94115567053824 notifier 5943 bl.length()=675 2024-09-12T17:57:30.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.141+0000 7f78b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:57:30.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.141+0000 7f78b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:57:30.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.145+0000 7f79d55519c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:57:30.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.145+0000 7f79d55519c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:57:30.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.145+0000 7f79d55519c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:57:30.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.145+0000 7f78b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627834 cookie 94115567058592 notifier 5943 bl.length()=202 2024-09-12T17:57:30.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.145+0000 7f78b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:57:30.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.145+0000 7f78b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:57:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.149+0000 7f79d55519c0 10 cache put: name=default.rgw.meta+users.keys+ZHQZKDLLCNOGFOAQZTRC info.flags=0x7 2024-09-12T17:57:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.149+0000 7f79d55519c0 10 moving default.rgw.meta+users.keys+ZHQZKDLLCNOGFOAQZTRC to cache LRU end 2024-09-12T17:57:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.149+0000 7f79d55519c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:ZHQZKDLLCNOGFOAQZTRC, ofs0, ns] 2024-09-12T17:57:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.149+0000 7f78b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627792 cookie 94115567053824 notifier 5943 bl.length()=190 2024-09-12T17:57:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.149+0000 7f78b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZHQZKDLLCNOGFOAQZTRC info.flags=0x7 2024-09-12T17:57:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.149+0000 7f78b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZHQZKDLLCNOGFOAQZTRC to cache LRU end 2024-09-12T17:57:30.151 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T17:57:30.151 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "sysuser.client.0", 2024-09-12T17:57:30.151 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T17:57:30.151 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T17:57:30.151 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-12T17:57:30.151 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "sysuser.client.0", 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "ZHQZKDLLCNOGFOAQZTRC", 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "Cv3Ttw+jcliXrv1Ehlj+YbFnE9kwpLnHFXlM4hM/NmA36Vus2jxtEQ==", 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T17:57:30.142407Z" 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-12T17:57:30.152 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "system": true, 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T17:57:30.153 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T17:57:30.142390Z", 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T17:57:30.154 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:57:30.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.153+0000 7f7889fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:30.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.157+0000 7f79d55519c0 20 remove_watcher() i=0 2024-09-12T17:57:30.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.157+0000 7f79d55519c0 2 removed watcher, disabling cache 2024-09-12T17:57:30.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.157+0000 7f79d55519c0 20 remove_watcher() i=1 2024-09-12T17:57:30.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.161+0000 7f79d55519c0 20 remove_watcher() i=2 2024-09-12T17:57:30.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.161+0000 7f79d55519c0 20 remove_watcher() i=3 2024-09-12T17:57:30.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.165+0000 7f79d55519c0 20 remove_watcher() i=4 2024-09-12T17:57:30.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.165+0000 7f79d55519c0 20 remove_watcher() i=5 2024-09-12T17:57:30.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.169+0000 7f79d55519c0 20 remove_watcher() i=6 2024-09-12T17:57:30.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T17:57:30.173+0000 7f79d55519c0 20 remove_watcher() i=7 2024-09-12T17:57:30.187 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T17:57:30.187 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:57:30.187 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T17:57:30.232 INFO:tasks.ragweed:Configuring boto... 2024-09-12T17:57:30.232 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T17:57:30.232 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T17:57:30.280 DEBUG:teuthology.orchestra.run.smithi097:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T17:57:30.467 INFO:teuthology.orchestra.run.smithi097.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T17:57:30.648 INFO:teuthology.orchestra.run.smithi097.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T17:57:31.254 INFO:teuthology.orchestra.run.smithi097.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:57:33.885 INFO:teuthology.orchestra.run.smithi097.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T17:57:38.385 INFO:teuthology.orchestra.run.smithi097.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=6af6f9b53b1a31ea01d9d5b690c00e29842ef7149f2eebaad8cf6e1ab9c0b394,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T17:57:38.385 INFO:teuthology.orchestra.run.smithi097.stdout:py run-test-pre: PYTHONHASHSEED='116272701' 2024-09-12T17:57:38.385 INFO:teuthology.orchestra.run.smithi097.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T17:57:38.550 INFO:teuthology.orchestra.run.smithi097.stdout:============================= test session starts ============================== 2024-09-12T17:57:38.550 INFO:teuthology.orchestra.run.smithi097.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T17:57:38.550 INFO:teuthology.orchestra.run.smithi097.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:57:38.550 INFO:teuthology.orchestra.run.smithi097.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T17:57:38.717 INFO:teuthology.orchestra.run.smithi097.stdout:collecting ... collected 9 items 2024-09-12T17:57:38.717 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T17:57:49.812 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T17:58:02.816 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T17:58:12.471 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T17:58:26.370 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T17:58:38.398 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T17:59:02.602 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T17:59:26.508 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T17:59:49.099 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T18:00:32.081 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T18:00:32.082 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:00:32.082 INFO:teuthology.orchestra.run.smithi097.stdout:=============================== warnings summary =============================== 2024-09-12T18:00:32.082 INFO:teuthology.orchestra.run.smithi097.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T18:00:32.082 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T18:00:32.082 INFO:teuthology.orchestra.run.smithi097.stdout: import imp 2024-09-12T18:00:32.082 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:00:32.082 INFO:teuthology.orchestra.run.smithi097.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T18:00:32.082 INFO:teuthology.orchestra.run.smithi097.stdout:=================== 9 passed, 1 warning in 173.53s (0:02:53) =================== 2024-09-12T18:00:32.130 INFO:teuthology.orchestra.run.smithi097.stdout:___________________________________ summary ____________________________________ 2024-09-12T18:00:32.130 INFO:teuthology.orchestra.run.smithi097.stdout: py: commands succeeded 2024-09-12T18:00:32.130 INFO:teuthology.orchestra.run.smithi097.stdout: congratulations :) 2024-09-12T18:00:32.150 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T18:00:32.150 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T18:00:32.155 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T18:00:32.236 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:32.236 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:32.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.273+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.277+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.277+0000 7f66418ed9c0 20 realm 2024-09-12T18:00:32.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.277+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.277+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.277+0000 7f66418ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:32.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.277+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.277+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.277+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.281+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:32.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.281+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.281+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:32.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.281+0000 7f66418ed9c0 20 searching for the correct realm 2024-09-12T18:00:32.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.289+0000 7f663fbf4640 0 -- 172.21.15.97:0/1162625594 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f663411dbe0 msgr2=0x7f66340f7760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:32.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.293+0000 7f663f3f3640 0 -- 172.21.15.97:0/1162625594 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f6638085040 msgr2=0x7f663805fec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:32.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:00:32.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:32.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:32.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:00:32.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:32.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:32.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:32.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:32.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 zone default found 2024-09-12T18:00:32.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 4 Realm: () 2024-09-12T18:00:32.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:00:32.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:00:32.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:32.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 zonegroup default 2024-09-12T18:00:32.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.301+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.305+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.305+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.305+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.305+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.305+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.305+0000 7f66418ed9c0 20 started sync module instance, tier type = 2024-09-12T18:00:32.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.305+0000 7f66418ed9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:00:32.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.321+0000 7f66418ed9c0 20 add_watcher() i=0 2024-09-12T18:00:32.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.321+0000 7f66418ed9c0 20 add_watcher() i=1 2024-09-12T18:00:32.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.321+0000 7f66418ed9c0 20 add_watcher() i=2 2024-09-12T18:00:32.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.321+0000 7f66418ed9c0 20 add_watcher() i=3 2024-09-12T18:00:32.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.321+0000 7f66418ed9c0 20 add_watcher() i=4 2024-09-12T18:00:32.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.321+0000 7f66418ed9c0 20 add_watcher() i=5 2024-09-12T18:00:32.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.321+0000 7f66418ed9c0 20 add_watcher() i=6 2024-09-12T18:00:32.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.325+0000 7f66418ed9c0 20 add_watcher() i=7 2024-09-12T18:00:32.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.325+0000 7f66418ed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:32.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.329+0000 7f64f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:32.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.329+0000 7f66418ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:32.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.329+0000 7f66418ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:32.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.405+0000 7f64f57e2640 20 reqs_thread_entry: start 2024-09-12T18:00:32.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.405+0000 7f66418ed9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:32.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.405+0000 7f66418ed9c0 20 Filter name: none 2024-09-12T18:00:32.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.405+0000 7f64ee7fc640 20 reqs_thread_entry: start 2024-09-12T18:00:32.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.405+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T18:00:32.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.405+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.405+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T18:00:32.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.405+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T18:00:32.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.405+0000 7f66418ed9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T18:00:32.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.405+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:32.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.409+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:98539659-fdaf-41ce-847d-239ff89323af.4641.4 : miss 2024-09-12T18:00:32.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.409+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.409+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T18:00:32.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.409+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:98539659-fdaf-41ce-847d-239ff89323af.4641.4 info.flags=0x17 2024-09-12T18:00:32.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.409+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:98539659-fdaf-41ce-847d-239ff89323af.4641.4 to cache LRU end 2024-09-12T18:00:32.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.409+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:32.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.409+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:32.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.409+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:98539659-fdaf-41ce-847d-239ff89323af.4641.4 2024-09-12T18:00:32.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.413+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T18:00:32.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.413+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T18:00:32.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.413+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T18:00:32.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.413+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T18:00:32.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.413+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T18:00:32.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.413+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T18:00:32.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.413+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T18:00:32.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.417+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T18:00:32.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.417+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T18:00:32.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.417+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324798050 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5623248a04b8 s->prefetch_data=0 2024-09-12T18:00:32.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.421+0000 7f66418ed9c0 10 manifest: total_size = 5294 2024-09-12T18:00:32.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.421+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.12759214183279829391 2024-09-12T18:00:32.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.421+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324798050 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5623248a04b8 s->prefetch_data=0 2024-09-12T18:00:32.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.421+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x5623248a04b8 2024-09-12T18:00:32.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.421+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.4.1 2024-09-12T18:00:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.425+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.425+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5294 stripe_ofs=5294 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.425+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.12759214183279829391 2024-09-12T18:00:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.425+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.425+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.EIkuYrz-LQdeGFrO7THNnW53ZQITD5h_0 2024-09-12T18:00:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.425+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.425+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.425+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.12759214183279829391 2024-09-12T18:00:32.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.429+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T18:00:32.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.429+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324798050 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.429+0000 7f66418ed9c0 10 manifest: total_size = 4894 2024-09-12T18:00:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.429+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.13484198696804575583 2024-09-12T18:00:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.429+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324798050 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.429+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x56232489ff68 2024-09-12T18:00:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.429+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.4.2 2024-09-12T18:00:32.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.433+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.433+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4894 stripe_ofs=4894 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.433+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.13484198696804575583 2024-09-12T18:00:32.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.433+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.433+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.duVZvT2aUjaKE4cv1sqRbAoTa4Rlp9a_0 2024-09-12T18:00:32.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.433+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:32.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.433+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.433+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.13484198696804575583 2024-09-12T18:00:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.437+0000 7f65227fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T18:00:32.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.437+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324798050 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.437+0000 7f66418ed9c0 10 manifest: total_size = 7759 2024-09-12T18:00:32.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.437+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.12050935855322642998 2024-09-12T18:00:32.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.437+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324798050 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.437+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x56232489ff68 2024-09-12T18:00:32.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.437+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.4.2 2024-09-12T18:00:32.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.441+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.441+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=7759 stripe_ofs=7759 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.441+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.12050935855322642998 2024-09-12T18:00:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.441+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.441+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.c_i8kWKHzmmwr6LFHTQ0JeztN2K2kE-_0 2024-09-12T18:00:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.441+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.441+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.441+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.12050935855322642998 2024-09-12T18:00:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.445+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T18:00:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.445+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324798050 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.445+0000 7f66418ed9c0 10 manifest: total_size = 5214 2024-09-12T18:00:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.445+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.7306207433552701730 2024-09-12T18:00:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.445+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324798050 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.445+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x56232489ff68 2024-09-12T18:00:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.445+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.4.3 2024-09-12T18:00:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.449+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.449+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5214 stripe_ofs=5214 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.449+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.7306207433552701730 2024-09-12T18:00:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.449+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.449+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.XcFdQXnVfeqylxmGOoJFoNtqiJjM2tD_0 2024-09-12T18:00:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.449+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.449+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.449+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.7306207433552701730 2024-09-12T18:00:32.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.449+0000 7f65227fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T18:00:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.449+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a14f0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.453+0000 7f66418ed9c0 10 manifest: total_size = 5009 2024-09-12T18:00:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.453+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.13326389104163597054 2024-09-12T18:00:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.453+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a14f0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.453+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x56232489ff68 2024-09-12T18:00:32.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.453+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.4.4 2024-09-12T18:00:32.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.457+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.457+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5009 stripe_ofs=5009 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.457+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.13326389104163597054 2024-09-12T18:00:32.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.457+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.457+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.nY9Bm5dwkJdSivJAAdUJwtTvcnkcf-X_0 2024-09-12T18:00:32.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.457+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:32.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.457+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.457+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.13326389104163597054 2024-09-12T18:00:32.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.457+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T18:00:32.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.457+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a14f0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.461+0000 7f66418ed9c0 10 manifest: total_size = 7537 2024-09-12T18:00:32.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.461+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.6833565349470747245 2024-09-12T18:00:32.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.461+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a14f0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.461+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x56232489ff68 2024-09-12T18:00:32.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.461+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.4.4 2024-09-12T18:00:32.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.465+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.465+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=7537 stripe_ofs=7537 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.465+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.6833565349470747245 2024-09-12T18:00:32.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.465+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.465+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.7zSaikDlHLPHs1XOffUSd1WimmR_grS_0 2024-09-12T18:00:32.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.465+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:32.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.465+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.465+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.6833565349470747245 2024-09-12T18:00:32.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.465+0000 7f65227fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T18:00:32.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.465+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630089df0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.469+0000 7f66418ed9c0 10 manifest: total_size = 4907 2024-09-12T18:00:32.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.469+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.11405656199075962080 2024-09-12T18:00:32.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.469+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630089df0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.469+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x56232489ff68 2024-09-12T18:00:32.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.469+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.4.5 2024-09-12T18:00:32.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.473+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.473+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4907 stripe_ofs=4907 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.473+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.11405656199075962080 2024-09-12T18:00:32.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.473+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.473+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.-D8EL2_isGP0wFTg8MC2QQRbbFRVdkG_0 2024-09-12T18:00:32.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.473+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:32.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.473+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.473+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.11405656199075962080 2024-09-12T18:00:32.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.473+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T18:00:32.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.477+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630089f00 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.477+0000 7f66418ed9c0 10 manifest: total_size = 7899 2024-09-12T18:00:32.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.477+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.1111630227578615648 2024-09-12T18:00:32.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.477+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630089f00 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.477+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x56232489ff68 2024-09-12T18:00:32.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.477+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.4.7 2024-09-12T18:00:32.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.481+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=7899 stripe_ofs=7899 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.1111630227578615648 2024-09-12T18:00:32.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.leCSbcdo_FL49MJzMzeFNam_dyO9xM0_0 2024-09-12T18:00:32.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:32.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.1111630227578615648 2024-09-12T18:00:32.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f65227fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T18:00:32.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 10 manifest: total_size = 5365 2024-09-12T18:00:32.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.2508801334625034265 2024-09-12T18:00:32.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x56232489ff68 s->prefetch_data=0 2024-09-12T18:00:32.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x56232489ff68 2024-09-12T18:00:32.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.485+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.4.8 2024-09-12T18:00:32.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.493+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.493+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5365 stripe_ofs=5365 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.493+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.2508801334625034265 2024-09-12T18:00:32.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.493+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.493+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.uq8c7yPbUx4twj4u03xdxIyIvxXTphz_0 2024-09-12T18:00:32.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.493+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:32.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.493+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.493+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.2508801334625034265 2024-09-12T18:00:32.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.497+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T18:00:32.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.497+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:32.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.497+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:32.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.497+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:32.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.497+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:32.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.497+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:32.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.497+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:32.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.497+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[98539659-fdaf-41ce-847d-239ff89323af.4641.4])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:32.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.501+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T18:00:32.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.501+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.505+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T18:00:32.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.505+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T18:00:32.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.505+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T18:00:32.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.505+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T18:00:32.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.505+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T18:00:32.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.505+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431567 cookie 94708936132192 notifier 5651 bl.length()=162 2024-09-12T18:00:32.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.513+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:98539659-fdaf-41ce-847d-239ff89323af.4641.4 from cache 2024-09-12T18:00:32.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.513+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:98539659-fdaf-41ce-847d-239ff89323af.4641.4, ofs0, ns] 2024-09-12T18:00:32.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.513+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431576 cookie 94708936160208 notifier 5651 bl.length()=219 2024-09-12T18:00:32.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.521+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/98539659-fdaf-41ce-847d-239ff89323af.4641.4 : miss 2024-09-12T18:00:32.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.521+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.521+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.521+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/98539659-fdaf-41ce-847d-239ff89323af.4641.4 info.flags=0x0 2024-09-12T18:00:32.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.521+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/98539659-fdaf-41ce-847d-239ff89323af.4641.4 to cache LRU end 2024-09-12T18:00:32.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.525+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.11 : miss 2024-09-12T18:00:32.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.525+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.529+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T18:00:32.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.529+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.11 info.flags=0x17 2024-09-12T18:00:32.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.529+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.11 to cache LRU end 2024-09-12T18:00:32.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.529+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:32.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.529+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:32.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.529+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.11 2024-09-12T18:00:32.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.541+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T18:00:32.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.541+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630089f80 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x56232482e4e8 s->prefetch_data=0 2024-09-12T18:00:32.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.541+0000 7f66418ed9c0 10 manifest: total_size = 26084 2024-09-12T18:00:32.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.541+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.5695388958250793149 2024-09-12T18:00:32.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.541+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630089f80 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x56232482e4e8 s->prefetch_data=0 2024-09-12T18:00:32.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.541+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x56232482e4e8 2024-09-12T18:00:32.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.541+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.11.10 2024-09-12T18:00:32.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T18:00:32.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2024-09-12T18:00:32.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7672 2024-09-12T18:00:32.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T18:00:32.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7672 2024-09-12T18:00:32.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=7673 2024-09-12T18:00:32.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=3 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4209648 part_ofs=15344 rule->part_size=7673 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=23017 stripe_ofs=23017 part_ofs=23017 rule->part_size=3067 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4217321 part_ofs=23017 rule->part_size=3067 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=26084 stripe_ofs=26084 part_ofs=26084 rule->part_size=3067 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.5695388958250793149 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.11__multipart_foo.2~PcoUWEQ8Wd8GW4z5OLqGXC8_xL7GXVf.1 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.11__multipart_foo.2~PcoUWEQ8Wd8GW4z5OLqGXC8_xL7GXVf.2 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.11__multipart_foo.2~PcoUWEQ8Wd8GW4z5OLqGXC8_xL7GXVf.3 2024-09-12T18:00:32.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T18:00:32.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.11__multipart_foo.2~PcoUWEQ8Wd8GW4z5OLqGXC8_xL7GXVf.4 2024-09-12T18:00:32.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T18:00:32.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.5695388958250793149 2024-09-12T18:00:32.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.545+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T18:00:32.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.549+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:32.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.549+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:32.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.549+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:32.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.549+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:32.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.549+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:32.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.549+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:32.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.549+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[98539659-fdaf-41ce-847d-239ff89323af.4641.11])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:32.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.553+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T18:00:32.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.553+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.557+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T18:00:32.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.557+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T18:00:32.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.557+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T18:00:32.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.557+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T18:00:32.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.557+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T18:00:32.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.557+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431616 cookie 94708936130288 notifier 5651 bl.length()=191 2024-09-12T18:00:32.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.561+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94708936130288 notifier 5651 bl.length()=191 2024-09-12T18:00:32.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.565+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.11 from cache 2024-09-12T18:00:32.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.565+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.11, ofs0, ns] 2024-09-12T18:00:32.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.569+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431568 cookie 94708936132192 notifier 5651 bl.length()=249 2024-09-12T18:00:32.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.577+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/98539659-fdaf-41ce-847d-239ff89323af.4641.11 : miss 2024-09-12T18:00:32.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.577+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.577+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.577+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/98539659-fdaf-41ce-847d-239ff89323af.4641.11 info.flags=0x0 2024-09-12T18:00:32.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.577+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/98539659-fdaf-41ce-847d-239ff89323af.4641.11 to cache LRU end 2024-09-12T18:00:32.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.581+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.12 : miss 2024-09-12T18:00:32.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.581+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.585+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T18:00:32.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.585+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.12 info.flags=0x17 2024-09-12T18:00:32.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.585+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.12 to cache LRU end 2024-09-12T18:00:32.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.585+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:32.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.585+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:32.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.585+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.12 2024-09-12T18:00:32.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.593+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T18:00:32.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.593+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6638061190 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x56232482a668 s->prefetch_data=0 2024-09-12T18:00:32.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.593+0000 7f66418ed9c0 10 manifest: total_size = 1667 2024-09-12T18:00:32.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.593+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.4611836723566762115 2024-09-12T18:00:32.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.593+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6638061190 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x56232482a668 s->prefetch_data=0 2024-09-12T18:00:32.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.593+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x56232482a668 2024-09-12T18:00:32.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.593+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.12.10 2024-09-12T18:00:32.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:00:32.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T18:00:32.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T18:00:32.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:00:32.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.4611836723566762115 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.12__multipart_foo.2~5LsEKCESeAsvAnwaaEcbLGCHrcj2G_1.1 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T18:00:32.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.12__multipart_foo.2~5LsEKCESeAsvAnwaaEcbLGCHrcj2G_1.2 2024-09-12T18:00:32.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T18:00:32.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.12__multipart_foo.2~5LsEKCESeAsvAnwaaEcbLGCHrcj2G_1.3 2024-09-12T18:00:32.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T18:00:32.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.12__multipart_foo.2~5LsEKCESeAsvAnwaaEcbLGCHrcj2G_1.4 2024-09-12T18:00:32.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T18:00:32.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.597+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.4611836723566762115 2024-09-12T18:00:32.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.601+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T18:00:32.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.601+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:32.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.605+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:32.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.605+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:32.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.605+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:32.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.605+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:32.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.605+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:32.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.605+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[98539659-fdaf-41ce-847d-239ff89323af.4641.12])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:32.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.609+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T18:00:32.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.609+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.609+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T18:00:32.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.609+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T18:00:32.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.609+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T18:00:32.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.613+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T18:00:32.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.613+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T18:00:32.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.613+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431577 cookie 94708936160208 notifier 5651 bl.length()=198 2024-09-12T18:00:32.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.617+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.12 from cache 2024-09-12T18:00:32.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.617+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:98539659-fdaf-41ce-847d-239ff89323af.4641.12, ofs0, ns] 2024-09-12T18:00:32.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.617+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431582 cookie 94708936167696 notifier 5651 bl.length()=256 2024-09-12T18:00:32.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.625+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/98539659-fdaf-41ce-847d-239ff89323af.4641.12 : miss 2024-09-12T18:00:32.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.625+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.625+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.625+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/98539659-fdaf-41ce-847d-239ff89323af.4641.12 info.flags=0x0 2024-09-12T18:00:32.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.625+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/98539659-fdaf-41ce-847d-239ff89323af.4641.12 to cache LRU end 2024-09-12T18:00:32.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.629+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:98539659-fdaf-41ce-847d-239ff89323af.4641.10 : miss 2024-09-12T18:00:32.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.629+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.633+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T18:00:32.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.633+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:98539659-fdaf-41ce-847d-239ff89323af.4641.10 info.flags=0x17 2024-09-12T18:00:32.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.633+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:98539659-fdaf-41ce-847d-239ff89323af.4641.10 to cache LRU end 2024-09-12T18:00:32.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.633+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:32.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.633+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:32.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.633+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:98539659-fdaf-41ce-847d-239ff89323af.4641.10 2024-09-12T18:00:32.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.641+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo[eUoOVweXRrsM2mDW8ZJmiOFw4RPROjg] 2024-09-12T18:00:32.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.641+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.10.10 2024-09-12T18:00:32.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.641+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482a400 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x56232482f648 s->prefetch_data=0 2024-09-12T18:00:32.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.641+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to w518dm2assqkqgr74x9vpkc8zn78y927 2024-09-12T18:00:32.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.641+0000 7f66418ed9c0 20 get_obj_state_impl: setting s->olh_tag to fhchdkq0bdn37cd1ktorctiebg7j9idi 2024-09-12T18:00:32.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.641+0000 7f66418ed9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fhchdkq0bdn37cd1ktorctiebg7j9idi 2024-09-12T18:00:32.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.645+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.10.10 2024-09-12T18:00:32.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.645+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.10.10 2024-09-12T18:00:32.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.649+0000 7f66418ed9c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T18:00:32.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.649+0000 7f66418ed9c0 20 olh_log_entry: epoch=3 op=3 key=foo[eUoOVweXRrsM2mDW8ZJmiOFw4RPROjg] 2024-09-12T18:00:32.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.649+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482a400 obj=test-client.0-r-test-multipart-index-versioning.1:_:eUoOVweXRrsM2mDW8ZJmiOFw4RPROjg_foo state=0x562324833c48 s->prefetch_data=0 2024-09-12T18:00:32.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.649+0000 7f66418ed9c0 10 manifest: total_size = 886297 2024-09-12T18:00:32.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.649+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.11910116807374241422 2024-09-12T18:00:32.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.649+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482a400 obj=test-client.0-r-test-multipart-index-versioning.1:_:eUoOVweXRrsM2mDW8ZJmiOFw4RPROjg_foo state=0x562324833c48 s->prefetch_data=0 2024-09-12T18:00:32.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.649+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324833c48 2024-09-12T18:00:32.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.649+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.10.10 2024-09-12T18:00:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T18:00:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T18:00:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-12T18:00:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T18:00:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T18:00:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-12T18:00:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T18:00:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.11910116807374241422 2024-09-12T18:00:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.10__multipart_foo.2~NiSfyOFPeqixwv9vpimJTzBRJo24RT0.1 2024-09-12T18:00:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T18:00:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.10__multipart_foo.2~NiSfyOFPeqixwv9vpimJTzBRJo24RT0.2 2024-09-12T18:00:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T18:00:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.10__multipart_foo.2~NiSfyOFPeqixwv9vpimJTzBRJo24RT0.3 2024-09-12T18:00:32.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T18:00:32.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.10__multipart_foo.2~NiSfyOFPeqixwv9vpimJTzBRJo24RT0.4 2024-09-12T18:00:32.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T18:00:32.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.11910116807374241422 2024-09-12T18:00:32.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.653+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo[eUoOVweXRrsM2mDW8ZJmiOFw4RPROjg] 2024-09-12T18:00:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.657+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482a400 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x56232482f648 s->prefetch_data=0 2024-09-12T18:00:32.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.661+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.10.10 2024-09-12T18:00:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.661+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.10.10 2024-09-12T18:00:32.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.661+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:32.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.661+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:32.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.665+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:32.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.665+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:32.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.665+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:32.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.665+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:32.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.665+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[98539659-fdaf-41ce-847d-239ff89323af.4641.10])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:32.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.669+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T18:00:32.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.669+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.669+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T18:00:32.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.669+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T18:00:32.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.669+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T18:00:32.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.673+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T18:00:32.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.673+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T18:00:32.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.673+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431578 cookie 94708936160208 notifier 5651 bl.length()=193 2024-09-12T18:00:32.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.681+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:98539659-fdaf-41ce-847d-239ff89323af.4641.10 from cache 2024-09-12T18:00:32.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.681+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:98539659-fdaf-41ce-847d-239ff89323af.4641.10, ofs0, ns] 2024-09-12T18:00:32.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.681+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94708936162736 notifier 5651 bl.length()=251 2024-09-12T18:00:32.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.689+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/98539659-fdaf-41ce-847d-239ff89323af.4641.10 : miss 2024-09-12T18:00:32.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.689+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.689+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.689+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/98539659-fdaf-41ce-847d-239ff89323af.4641.10 info.flags=0x0 2024-09-12T18:00:32.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.689+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/98539659-fdaf-41ce-847d-239ff89323af.4641.10 to cache LRU end 2024-09-12T18:00:32.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.693+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:98539659-fdaf-41ce-847d-239ff89323af.4641.9 : miss 2024-09-12T18:00:32.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.693+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.697+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:00:32.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.697+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:98539659-fdaf-41ce-847d-239ff89323af.4641.9 info.flags=0x17 2024-09-12T18:00:32.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.697+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:98539659-fdaf-41ce-847d-239ff89323af.4641.9 to cache LRU end 2024-09-12T18:00:32.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.697+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:32.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.697+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:32.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.697+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:98539659-fdaf-41ce-847d-239ff89323af.4641.9 2024-09-12T18:00:32.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.705+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T18:00:32.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.705+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482b180 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562324820f18 s->prefetch_data=0 2024-09-12T18:00:32.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.705+0000 7f66418ed9c0 10 manifest: total_size = 18874368 2024-09-12T18:00:32.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.705+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.8201583057673181567 2024-09-12T18:00:32.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.705+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482b180 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562324820f18 s->prefetch_data=0 2024-09-12T18:00:32.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.705+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324820f18 2024-09-12T18:00:32.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.705+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.9.10 2024-09-12T18:00:32.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T18:00:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T18:00:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T18:00:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-12T18:00:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T18:00:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T18:00:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-12T18:00:32.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T18:00:32.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.8201583057673181567 2024-09-12T18:00:32.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.9__multipart_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.1 2024-09-12T18:00:32.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-09-12T18:00:32.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.9__shadow_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.1_1 2024-09-12T18:00:32.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 586 2024-09-12T18:00:32.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.9__multipart_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.2 2024-09-12T18:00:32.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 830 2024-09-12T18:00:32.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.9__shadow_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.2_1 2024-09-12T18:00:32.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1072 2024-09-12T18:00:32.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.9__multipart_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.3 2024-09-12T18:00:32.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1316 2024-09-12T18:00:32.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.9__shadow_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.3_1 2024-09-12T18:00:32.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1558 2024-09-12T18:00:32.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.9__multipart_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.4 2024-09-12T18:00:32.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1802 2024-09-12T18:00:32.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.8201583057673181567 2024-09-12T18:00:32.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo 2024-09-12T18:00:32.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.713+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:32.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.717+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:32.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.717+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:32.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.717+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:32.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.717+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:32.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.717+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:32.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.717+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[98539659-fdaf-41ce-847d-239ff89323af.4641.9])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:32.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.721+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T18:00:32.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.721+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.721+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T18:00:32.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.721+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T18:00:32.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.721+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T18:00:32.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.725+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T18:00:32.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.725+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T18:00:32.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.725+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94708936165200 notifier 5651 bl.length()=183 2024-09-12T18:00:32.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.729+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:98539659-fdaf-41ce-847d-239ff89323af.4641.9 from cache 2024-09-12T18:00:32.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.729+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:98539659-fdaf-41ce-847d-239ff89323af.4641.9, ofs0, ns] 2024-09-12T18:00:32.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.729+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431569 cookie 94708936132192 notifier 5651 bl.length()=240 2024-09-12T18:00:32.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.737+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/98539659-fdaf-41ce-847d-239ff89323af.4641.9 : miss 2024-09-12T18:00:32.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.737+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.737+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.737+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/98539659-fdaf-41ce-847d-239ff89323af.4641.9 info.flags=0x0 2024-09-12T18:00:32.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.737+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/98539659-fdaf-41ce-847d-239ff89323af.4641.9 to cache LRU end 2024-09-12T18:00:32.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.745+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.15 : miss 2024-09-12T18:00:32.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.745+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.745+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:00:32.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.745+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.15 info.flags=0x17 2024-09-12T18:00:32.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.745+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.15 to cache LRU end 2024-09-12T18:00:32.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.745+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:32.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.745+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:32.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.745+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.15 2024-09-12T18:00:32.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.745+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T18:00:32.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.749+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T18:00:32.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.749+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:00:32.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.749+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T18:00:32.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.749+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T18:00:32.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.749+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:00:32.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.753+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T18:00:32.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.753+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:00:32.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.753+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T18:00:32.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.753+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T18:00:32.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.753+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T18:00:32.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.753+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T18:00:32.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.753+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a2750 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562324845fa8 s->prefetch_data=0 2024-09-12T18:00:32.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.757+0000 7f66418ed9c0 10 manifest: total_size = 2044 2024-09-12T18:00:32.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.757+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _nwptZiKTkNufOaV78HoJF6fzY87vWwI 2024-09-12T18:00:32.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.757+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a2750 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562324845fa8 s->prefetch_data=0 2024-09-12T18:00:32.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.757+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845fa8 2024-09-12T18:00:32.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.757+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.0 2024-09-12T18:00:32.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.761+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.761+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.761+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _nwptZiKTkNufOaV78HoJF6fzY87vWwI 2024-09-12T18:00:32.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.761+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.761+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.v239cspShSFjEHzzIJqVjX4yJ17AGUu_0 2024-09-12T18:00:32.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.761+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:00:32.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.761+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.761+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _nwptZiKTkNufOaV78HoJF6fzY87vWwI 2024-09-12T18:00:32.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.765+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T18:00:32.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.765+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a2750 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562324845fa8 s->prefetch_data=0 2024-09-12T18:00:32.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.765+0000 7f66418ed9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:32.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.765+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _fNWDalV07Zn-Ocjul6yySXCTs5oRwJi 2024-09-12T18:00:32.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.765+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a2750 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562324845fa8 s->prefetch_data=0 2024-09-12T18:00:32.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.765+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845fa8 2024-09-12T18:00:32.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.765+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.2 2024-09-12T18:00:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _fNWDalV07Zn-Ocjul6yySXCTs5oRwJi 2024-09-12T18:00:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.Z33NMGbqZUBjp4wuKgFaBxlHpjmOfyO_0 2024-09-12T18:00:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:00:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.Z33NMGbqZUBjp4wuKgFaBxlHpjmOfyO_1 2024-09-12T18:00:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:00:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _fNWDalV07Zn-Ocjul6yySXCTs5oRwJi 2024-09-12T18:00:32.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T18:00:32.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.773+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630071bf0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562324846f18 s->prefetch_data=0 2024-09-12T18:00:32.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.777+0000 7f66418ed9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:32.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.777+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.18078668305031792224 2024-09-12T18:00:32.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.777+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630071bf0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562324846f18 s->prefetch_data=0 2024-09-12T18:00:32.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.777+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324846f18 2024-09-12T18:00:32.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.777+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.3 2024-09-12T18:00:32.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.18078668305031792224 2024-09-12T18:00:32.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.MGZQWS5rK6s8EXtCxaliG5P_zKipBMf_0 2024-09-12T18:00:32.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T18:00:32.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.MGZQWS5rK6s8EXtCxaliG5P_zKipBMf_1 2024-09-12T18:00:32.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T18:00:32.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.781+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.18078668305031792224 2024-09-12T18:00:32.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.785+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630068cd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562324846f18 s->prefetch_data=0 2024-09-12T18:00:32.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.785+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:00:32.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.785+0000 7f66418ed9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:32.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.785+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _k6P9pw-bFl3CxMP5afO57HwOmJ4A7kf 2024-09-12T18:00:32.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.785+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630068cd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562324846f18 s->prefetch_data=0 2024-09-12T18:00:32.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.785+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324846f18 2024-09-12T18:00:32.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.785+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.5 2024-09-12T18:00:32.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _k6P9pw-bFl3CxMP5afO57HwOmJ4A7kf 2024-09-12T18:00:32.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.LmthZ8BiXcW2i7vAvzLMNO5AHdcR38q_0 2024-09-12T18:00:32.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:00:32.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.LmthZ8BiXcW2i7vAvzLMNO5AHdcR38q_1 2024-09-12T18:00:32.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T18:00:32.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.789+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _k6P9pw-bFl3CxMP5afO57HwOmJ4A7kf 2024-09-12T18:00:32.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.793+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6638094530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562324846f18 s->prefetch_data=0 2024-09-12T18:00:32.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.793+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T18:00:32.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.793+0000 7f66418ed9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:32.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.793+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _dJR4I-omLtfpa9L0mCFqwevKIL6Bq0U 2024-09-12T18:00:32.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.793+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6638094530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562324846f18 s->prefetch_data=0 2024-09-12T18:00:32.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.793+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324846f18 2024-09-12T18:00:32.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.793+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.5 2024-09-12T18:00:32.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _dJR4I-omLtfpa9L0mCFqwevKIL6Bq0U 2024-09-12T18:00:32.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.tbFt8UXttGU8xpN3KJkqxVydKXNWYTm_0 2024-09-12T18:00:32.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:00:32.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.tbFt8UXttGU8xpN3KJkqxVydKXNWYTm_1 2024-09-12T18:00:32.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T18:00:32.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.797+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _dJR4I-omLtfpa9L0mCFqwevKIL6Bq0U 2024-09-12T18:00:32.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.801+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T18:00:32.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.801+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630068cd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562324846f18 s->prefetch_data=0 2024-09-12T18:00:32.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.801+0000 7f66418ed9c0 10 manifest: total_size = 2044 2024-09-12T18:00:32.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.801+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.12650565731509553369 2024-09-12T18:00:32.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.801+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630068cd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562324846f18 s->prefetch_data=0 2024-09-12T18:00:32.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.801+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324846f18 2024-09-12T18:00:32.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.801+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.5 2024-09-12T18:00:32.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.805+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.805+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.805+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.12650565731509553369 2024-09-12T18:00:32.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.805+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.805+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.L91j6dMx7IqIlPg-nkXAWH8KCzRmS5I_0 2024-09-12T18:00:32.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.805+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T18:00:32.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.805+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.805+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.12650565731509553369 2024-09-12T18:00:32.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.809+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630071bf0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562324846f18 s->prefetch_data=0 2024-09-12T18:00:32.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.809+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:00:32.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.809+0000 7f66418ed9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:32.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.809+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _eWBXB6VijkNRtcxGATAEFGVUqm9ayeb 2024-09-12T18:00:32.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.809+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630071bf0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562324846f18 s->prefetch_data=0 2024-09-12T18:00:32.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.809+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324846f18 2024-09-12T18:00:32.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.809+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.7 2024-09-12T18:00:32.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _eWBXB6VijkNRtcxGATAEFGVUqm9ayeb 2024-09-12T18:00:32.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.C-RH1PHUzYHUQ9NHwRc64Sahr52MWFX_0 2024-09-12T18:00:32.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:00:32.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.C-RH1PHUzYHUQ9NHwRc64Sahr52MWFX_1 2024-09-12T18:00:32.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:00:32.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.813+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _eWBXB6VijkNRtcxGATAEFGVUqm9ayeb 2024-09-12T18:00:32.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.817+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T18:00:32.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.817+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630068cd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562324820f18 s->prefetch_data=0 2024-09-12T18:00:32.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.817+0000 7f66418ed9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:32.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.817+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.5847837060457983957 2024-09-12T18:00:32.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.817+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630068cd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562324820f18 s->prefetch_data=0 2024-09-12T18:00:32.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.817+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324820f18 2024-09-12T18:00:32.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.817+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.7 2024-09-12T18:00:32.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.5847837060457983957 2024-09-12T18:00:32.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.eoeNus6Pd1HnLn4x978F68A_9rTD3S-_0 2024-09-12T18:00:32.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T18:00:32.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.eoeNus6Pd1HnLn4x978F68A_9rTD3S-_1 2024-09-12T18:00:32.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T18:00:32.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.821+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.5847837060457983957 2024-09-12T18:00:32.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.825+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:00:32.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.825+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630071bf0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562324820f18 s->prefetch_data=0 2024-09-12T18:00:32.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.825+0000 7f66418ed9c0 10 manifest: total_size = 2044 2024-09-12T18:00:32.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.825+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.17414687546966586809 2024-09-12T18:00:32.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.825+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f6630071bf0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562324820f18 s->prefetch_data=0 2024-09-12T18:00:32.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.825+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324820f18 2024-09-12T18:00:32.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.825+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.7 2024-09-12T18:00:32.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.829+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.829+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.829+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.17414687546966586809 2024-09-12T18:00:32.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.829+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.829+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.L91j6dMx7IqIlPg-nkXAWH8KCzRmS5I_0 2024-09-12T18:00:32.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.829+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T18:00:32.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.829+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.829+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.17414687546966586809 2024-09-12T18:00:32.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.833+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T18:00:32.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.833+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562324820f18 s->prefetch_data=0 2024-09-12T18:00:32.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.833+0000 7f66418ed9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:32.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.833+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.6035023091340012167 2024-09-12T18:00:32.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.833+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562324820f18 s->prefetch_data=0 2024-09-12T18:00:32.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.833+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324820f18 2024-09-12T18:00:32.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.833+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.8 2024-09-12T18:00:32.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.6035023091340012167 2024-09-12T18:00:32.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.eoeNus6Pd1HnLn4x978F68A_9rTD3S-_0 2024-09-12T18:00:32.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T18:00:32.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.eoeNus6Pd1HnLn4x978F68A_9rTD3S-_1 2024-09-12T18:00:32.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T18:00:32.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.837+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.6035023091340012167 2024-09-12T18:00:32.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.841+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T18:00:32.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.841+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562324820f18 s->prefetch_data=0 2024-09-12T18:00:32.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.845+0000 7f66418ed9c0 10 manifest: total_size = 2044 2024-09-12T18:00:32.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.845+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _fB_oG7mK-mlKT5WDh1CHEBu5TE8VyWw 2024-09-12T18:00:32.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.845+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562324820f18 s->prefetch_data=0 2024-09-12T18:00:32.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.845+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324820f18 2024-09-12T18:00:32.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.845+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.8 2024-09-12T18:00:32.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.849+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.849+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.849+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _fB_oG7mK-mlKT5WDh1CHEBu5TE8VyWw 2024-09-12T18:00:32.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.849+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.849+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.UsoBfmg8zVcnMHe_Do0CBWPpz6stZSS_0 2024-09-12T18:00:32.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.849+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:00:32.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.849+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.849+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _fB_oG7mK-mlKT5WDh1CHEBu5TE8VyWw 2024-09-12T18:00:32.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.849+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f8b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562324833068 s->prefetch_data=0 2024-09-12T18:00:32.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.853+0000 7f66418ed9c0 10 manifest: total_size = 5242880 2024-09-12T18:00:32.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.853+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.12377350128094919491 2024-09-12T18:00:32.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.853+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f8b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562324833068 s->prefetch_data=0 2024-09-12T18:00:32.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.853+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324833068 2024-09-12T18:00:32.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.853+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.15.9 2024-09-12T18:00:32.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.853+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T18:00:32.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.12377350128094919491 2024-09-12T18:00:32.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.MGZQWS5rK6s8EXtCxaliG5P_zKipBMf_0 2024-09-12T18:00:32.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T18:00:32.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.MGZQWS5rK6s8EXtCxaliG5P_zKipBMf_1 2024-09-12T18:00:32.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T18:00:32.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.12377350128094919491 2024-09-12T18:00:32.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T18:00:32.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:32.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.857+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.861+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.861+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.861+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.861+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.861+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[98539659-fdaf-41ce-847d-239ff89323af.4641.15])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:32.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.865+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T18:00:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.865+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.865+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T18:00:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.865+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T18:00:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.865+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T18:00:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.869+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T18:00:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.869+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T18:00:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.869+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431579 cookie 94708936160208 notifier 5651 bl.length()=189 2024-09-12T18:00:32.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.873+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.15 from cache 2024-09-12T18:00:32.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.873+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.15, ofs0, ns] 2024-09-12T18:00:32.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.873+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431613 cookie 94708936162736 notifier 5651 bl.length()=247 2024-09-12T18:00:32.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.881+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/98539659-fdaf-41ce-847d-239ff89323af.4641.15 : miss 2024-09-12T18:00:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.881+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.881+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.881+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/98539659-fdaf-41ce-847d-239ff89323af.4641.15 info.flags=0x0 2024-09-12T18:00:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.881+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/98539659-fdaf-41ce-847d-239ff89323af.4641.15 to cache LRU end 2024-09-12T18:00:32.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.885+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.16 : miss 2024-09-12T18:00:32.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.885+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:32.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.889+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T18:00:32.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.889+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.16 info.flags=0x17 2024-09-12T18:00:32.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.889+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.16 to cache LRU end 2024-09-12T18:00:32.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.889+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:32.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.889+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:32.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.889+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.16 2024-09-12T18:00:32.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.889+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T18:00:32.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.889+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T18:00:32.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.889+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:00:32.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.893+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T18:00:32.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.893+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T18:00:32.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.893+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:00:32.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.893+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T18:00:32.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.893+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:00:32.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.893+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T18:00:32.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.897+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T18:00:32.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.897+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T18:00:32.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.897+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T18:00:32.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.897+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a1530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.897+0000 7f66418ed9c0 10 manifest: total_size = 541681 2024-09-12T18:00:32.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.897+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _D7npmfD37pMKGxxoHgp35H1MTTIH530 2024-09-12T18:00:32.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.897+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a1530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.897+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.897+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.0 2024-09-12T18:00:32.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.905+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.905+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.905+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _D7npmfD37pMKGxxoHgp35H1MTTIH530 2024-09-12T18:00:32.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.905+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.905+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.Czeiu0jqtgsF9-sc3Nr8ysv00LKb4Bp_0 2024-09-12T18:00:32.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.905+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:00:32.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.905+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.905+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _D7npmfD37pMKGxxoHgp35H1MTTIH530 2024-09-12T18:00:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.905+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.905+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T18:00:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.909+0000 7f66418ed9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.909+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _pAmqDUNVUFIE0Wv4ZGpaIPsNPSQ9BNl 2024-09-12T18:00:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.909+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.909+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.909+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.2 2024-09-12T18:00:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _pAmqDUNVUFIE0Wv4ZGpaIPsNPSQ9BNl 2024-09-12T18:00:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.SNVOU63oo6icjuqGDrnlPPAf09C5uOn_0 2024-09-12T18:00:32.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:00:32.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.SNVOU63oo6icjuqGDrnlPPAf09C5uOn_1 2024-09-12T18:00:32.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:00:32.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.SNVOU63oo6icjuqGDrnlPPAf09C5uOn_2 2024-09-12T18:00:32.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T18:00:32.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _pAmqDUNVUFIE0Wv4ZGpaIPsNPSQ9BNl 2024-09-12T18:00:32.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.913+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T18:00:32.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.917+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f663411ffc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.917+0000 7f66418ed9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:32.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.917+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.1864570296407102306 2024-09-12T18:00:32.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.917+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f663411ffc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.917+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.917+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.3 2024-09-12T18:00:32.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.1864570296407102306 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.1 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.1_1 2024-09-12T18:00:32.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T18:00:32.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.2 2024-09-12T18:00:32.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T18:00:32.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.2_1 2024-09-12T18:00:32.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T18:00:32.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.3 2024-09-12T18:00:32.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T18:00:32.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.921+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.1864570296407102306 2024-09-12T18:00:32.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.925+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:00:32.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.925+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482c600 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.925+0000 7f66418ed9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:32.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.925+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _p6x4v9xsIPDHKaTMMWT_w_PtLCAt-4M 2024-09-12T18:00:32.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.925+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482c600 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.925+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.925+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.5 2024-09-12T18:00:32.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _p6x4v9xsIPDHKaTMMWT_w_PtLCAt-4M 2024-09-12T18:00:32.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.s5KUHfk5lbCrBqz-oi3tqLvPkTZHk46_0 2024-09-12T18:00:32.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:00:32.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.s5KUHfk5lbCrBqz-oi3tqLvPkTZHk46_1 2024-09-12T18:00:32.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T18:00:32.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.s5KUHfk5lbCrBqz-oi3tqLvPkTZHk46_2 2024-09-12T18:00:32.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T18:00:32.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.929+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _p6x4v9xsIPDHKaTMMWT_w_PtLCAt-4M 2024-09-12T18:00:32.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.933+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T18:00:32.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.933+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66300687c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.933+0000 7f66418ed9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:32.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.933+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _f3fECEKfLin08BlkGEHpOBL0xxWItD_ 2024-09-12T18:00:32.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.933+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66300687c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.933+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.933+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.5 2024-09-12T18:00:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _f3fECEKfLin08BlkGEHpOBL0xxWItD_ 2024-09-12T18:00:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.dTOFPhnZYnPcK0vQ58bxc7unZ52AGWV_0 2024-09-12T18:00:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:00:32.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.dTOFPhnZYnPcK0vQ58bxc7unZ52AGWV_1 2024-09-12T18:00:32.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T18:00:32.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.dTOFPhnZYnPcK0vQ58bxc7unZ52AGWV_2 2024-09-12T18:00:32.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T18:00:32.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _f3fECEKfLin08BlkGEHpOBL0xxWItD_ 2024-09-12T18:00:32.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.941+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T18:00:32.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.945+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.945+0000 7f66418ed9c0 10 manifest: total_size = 541681 2024-09-12T18:00:32.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.945+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.6778653752146673780 2024-09-12T18:00:32.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.945+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.945+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.945+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.5 2024-09-12T18:00:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T18:00:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T18:00:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T18:00:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-09-12T18:00:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T18:00:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.6778653752146673780 2024-09-12T18:00:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.1 2024-09-12T18:00:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T18:00:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.2 2024-09-12T18:00:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T18:00:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.3 2024-09-12T18:00:32.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T18:00:32.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.949+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.6778653752146673780 2024-09-12T18:00:32.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.953+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a25b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.953+0000 7f66418ed9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:32.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.953+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _ol3gqyGQ-E2jzi5z4dQkWEgwGbzmEnL 2024-09-12T18:00:32.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.953+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a25b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.953+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.953+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.7 2024-09-12T18:00:32.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.953+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:00:32.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _ol3gqyGQ-E2jzi5z4dQkWEgwGbzmEnL 2024-09-12T18:00:32.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.v-89HJnHhoN_-NrBEHOqgCw1TWRGg-8_0 2024-09-12T18:00:32.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:00:32.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.v-89HJnHhoN_-NrBEHOqgCw1TWRGg-8_1 2024-09-12T18:00:32.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:00:32.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.v-89HJnHhoN_-NrBEHOqgCw1TWRGg-8_2 2024-09-12T18:00:32.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T18:00:32.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.957+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _ol3gqyGQ-E2jzi5z4dQkWEgwGbzmEnL 2024-09-12T18:00:32.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.961+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.961+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T18:00:32.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.961+0000 7f66418ed9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:32.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.961+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.13858628253598276979 2024-09-12T18:00:32.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.961+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.961+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.961+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.7 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.13858628253598276979 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.1 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.1_1 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.2 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.2_1 2024-09-12T18:00:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T18:00:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.3 2024-09-12T18:00:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T18:00:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.965+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.13858628253598276979 2024-09-12T18:00:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.969+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:00:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.969+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66300687c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.969+0000 7f66418ed9c0 10 manifest: total_size = 541681 2024-09-12T18:00:32.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.969+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.8199650380280379327 2024-09-12T18:00:32.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.969+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66300687c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.969+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.969+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.7 2024-09-12T18:00:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T18:00:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T18:00:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T18:00:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-09-12T18:00:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T18:00:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.8199650380280379327 2024-09-12T18:00:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.1 2024-09-12T18:00:32.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T18:00:32.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.2 2024-09-12T18:00:32.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T18:00:32.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.3 2024-09-12T18:00:32.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T18:00:32.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.8199650380280379327 2024-09-12T18:00:32.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T18:00:32.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f663808d470 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:32.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.1269344763259542585 2024-09-12T18:00:32.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f663808d470 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.977+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.8 2024-09-12T18:00:32.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:32.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:32.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.1269344763259542585 2024-09-12T18:00:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.1 2024-09-12T18:00:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T18:00:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.1_1 2024-09-12T18:00:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T18:00:32.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.2 2024-09-12T18:00:32.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T18:00:32.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.2_1 2024-09-12T18:00:32.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T18:00:32.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.3 2024-09-12T18:00:32.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T18:00:32.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.981+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.1269344763259542585 2024-09-12T18:00:32.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.985+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T18:00:32.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.985+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248272e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.985+0000 7f66418ed9c0 10 manifest: total_size = 541681 2024-09-12T18:00:32.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.985+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to _d1GhluD-8uQ-GIJrLVL7faJmYAD63aw 2024-09-12T18:00:32.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.985+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248272e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.985+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.985+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.8 2024-09-12T18:00:32.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.989+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:32.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.989+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-12T18:00:32.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.989+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _d1GhluD-8uQ-GIJrLVL7faJmYAD63aw 2024-09-12T18:00:32.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.989+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:32.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.989+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.6EjOYK6nfLmt7WYuWbrEg2nPYNsrTN2_0 2024-09-12T18:00:32.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.989+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:00:32.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.989+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:32.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.989+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _d1GhluD-8uQ-GIJrLVL7faJmYAD63aw 2024-09-12T18:00:32.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.993+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T18:00:32.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.993+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66300687c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.993+0000 7f66418ed9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:32.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.993+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.8118834451365374142 2024-09-12T18:00:32.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.993+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66300687c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:32.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.993+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:32.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:32.993+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.16.9 2024-09-12T18:00:33.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:33.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.8118834451365374142 2024-09-12T18:00:33.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.1 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.1_1 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.2 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.2_1 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.3 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.8118834451365374142 2024-09-12T18:00:33.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T18:00:33.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:33.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.001+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:33.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.005+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:33.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.005+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:33.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.005+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:33.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.005+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:33.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.005+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[98539659-fdaf-41ce-847d-239ff89323af.4641.16])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:33.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.009+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T18:00:33.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.009+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.009+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T18:00:33.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.009+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T18:00:33.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.009+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T18:00:33.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.013+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T18:00:33.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.013+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T18:00:33.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.013+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94708936162736 notifier 5651 bl.length()=199 2024-09-12T18:00:33.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.017+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.16 from cache 2024-09-12T18:00:33.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.017+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:98539659-fdaf-41ce-847d-239ff89323af.4641.16, ofs0, ns] 2024-09-12T18:00:33.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.017+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431583 cookie 94708936168752 notifier 5651 bl.length()=257 2024-09-12T18:00:33.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.025+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/98539659-fdaf-41ce-847d-239ff89323af.4641.16 : miss 2024-09-12T18:00:33.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.025+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.025+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.025+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/98539659-fdaf-41ce-847d-239ff89323af.4641.16 info.flags=0x0 2024-09-12T18:00:33.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.025+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/98539659-fdaf-41ce-847d-239ff89323af.4641.16 to cache LRU end 2024-09-12T18:00:33.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.033+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:98539659-fdaf-41ce-847d-239ff89323af.4641.14 : miss 2024-09-12T18:00:33.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.033+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.033+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T18:00:33.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.033+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:98539659-fdaf-41ce-847d-239ff89323af.4641.14 info.flags=0x17 2024-09-12T18:00:33.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.033+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:98539659-fdaf-41ce-847d-239ff89323af.4641.14 to cache LRU end 2024-09-12T18:00:33.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.033+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:33.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.033+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:33.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.033+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:98539659-fdaf-41ce-847d-239ff89323af.4641.14 2024-09-12T18:00:33.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.037+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:00:33.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.037+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:00:33.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.041+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:00:33.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.041+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482fb00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:33.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.041+0000 7f66418ed9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:33.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.045+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.8375536079092993533 2024-09-12T18:00:33.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.045+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482fb00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:33.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.045+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:33.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.045+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.14.3 2024-09-12T18:00:33.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:33.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:33.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.8375536079092993533 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-FROZEN.2~LcLHGGm-AZzRLkGGfd2MRBetIDLPUp2.1 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__shadow_foo-FROZEN.2~LcLHGGm-AZzRLkGGfd2MRBetIDLPUp2.1_1 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-FROZEN.2~LcLHGGm-AZzRLkGGfd2MRBetIDLPUp2.2 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__shadow_foo-FROZEN.2~LcLHGGm-AZzRLkGGfd2MRBetIDLPUp2.2_1 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-FROZEN.2~LcLHGGm-AZzRLkGGfd2MRBetIDLPUp2.3 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.049+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.8375536079092993533 2024-09-12T18:00:33.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.053+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482fb00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:33.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.053+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:00:33.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.053+0000 7f66418ed9c0 10 manifest: total_size = 541681 2024-09-12T18:00:33.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.053+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.8616589311256220041 2024-09-12T18:00:33.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.053+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482fb00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:33.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.053+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:33.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.053+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.14.5 2024-09-12T18:00:33.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:33.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T18:00:33.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:33.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:00:33.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T18:00:33.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.8616589311256220041 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-STANDARD.2~nUS9yQ6U01BoZ4ypgnGftAvL1ftZ_z3.1 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-STANDARD.2~nUS9yQ6U01BoZ4ypgnGftAvL1ftZ_z3.2 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-STANDARD.2~nUS9yQ6U01BoZ4ypgnGftAvL1ftZ_z3.3 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.8616589311256220041 2024-09-12T18:00:33.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:00:33.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.057+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a1530 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:33.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.061+0000 7f66418ed9c0 10 manifest: total_size = 11534336 2024-09-12T18:00:33.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.061+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.10172815200426381920 2024-09-12T18:00:33.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.061+0000 7f66418ed9c0 20 get_obj_state: octx=0x5623248a1530 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562324845e68 s->prefetch_data=0 2024-09-12T18:00:33.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.061+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324845e68 2024-09-12T18:00:33.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.061+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.14.7 2024-09-12T18:00:33.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:33.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:33.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:00:33.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:00:33.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.10172815200426381920 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-LUKEWARM.2~WS3ZJtNM8mXYjaDON8AukbLXHZQTwFk.1 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__shadow_foo-LUKEWARM.2~WS3ZJtNM8mXYjaDON8AukbLXHZQTwFk.1_1 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-LUKEWARM.2~WS3ZJtNM8mXYjaDON8AukbLXHZQTwFk.2 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T18:00:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__shadow_foo-LUKEWARM.2~WS3ZJtNM8mXYjaDON8AukbLXHZQTwFk.2_1 2024-09-12T18:00:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T18:00:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-LUKEWARM.2~WS3ZJtNM8mXYjaDON8AukbLXHZQTwFk.3 2024-09-12T18:00:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T18:00:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.10172815200426381920 2024-09-12T18:00:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.065+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:00:33.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.069+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:33.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.069+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:33.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.069+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:33.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.069+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:33.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.069+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:33.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.069+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:33.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.069+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[98539659-fdaf-41ce-847d-239ff89323af.4641.14])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:33.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.073+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T18:00:33.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.073+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.073+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T18:00:33.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.073+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T18:00:33.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.073+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T18:00:33.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.077+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T18:00:33.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.077+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T18:00:33.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.077+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431584 cookie 94708936167696 notifier 5651 bl.length()=194 2024-09-12T18:00:33.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.085+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:98539659-fdaf-41ce-847d-239ff89323af.4641.14 from cache 2024-09-12T18:00:33.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.085+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:98539659-fdaf-41ce-847d-239ff89323af.4641.14, ofs0, ns] 2024-09-12T18:00:33.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.085+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94708936168752 notifier 5651 bl.length()=252 2024-09-12T18:00:33.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.093+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/98539659-fdaf-41ce-847d-239ff89323af.4641.14 : miss 2024-09-12T18:00:33.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.093+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.093+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.093+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/98539659-fdaf-41ce-847d-239ff89323af.4641.14 info.flags=0x0 2024-09-12T18:00:33.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.093+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/98539659-fdaf-41ce-847d-239ff89323af.4641.14 to cache LRU end 2024-09-12T18:00:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.097+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:98539659-fdaf-41ce-847d-239ff89323af.4641.13 : miss 2024-09-12T18:00:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.097+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.097+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T18:00:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.097+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:98539659-fdaf-41ce-847d-239ff89323af.4641.13 info.flags=0x17 2024-09-12T18:00:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.097+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:98539659-fdaf-41ce-847d-239ff89323af.4641.13 to cache LRU end 2024-09-12T18:00:33.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.097+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.097+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:33.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.097+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:98539659-fdaf-41ce-847d-239ff89323af.4641.13 2024-09-12T18:00:33.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.101+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:00:33.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.101+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:00:33.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.105+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:00:33.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.105+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324857330 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562324834bf8 s->prefetch_data=0 2024-09-12T18:00:33.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.105+0000 7f66418ed9c0 10 manifest: total_size = 10485760 2024-09-12T18:00:33.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.105+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.15900655147546947474 2024-09-12T18:00:33.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.105+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324857330 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562324834bf8 s->prefetch_data=0 2024-09-12T18:00:33.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.105+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324834bf8 2024-09-12T18:00:33.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.105+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.13.3 2024-09-12T18:00:33.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.15900655147546947474 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.8pgca3IbnkRUbHgks3N2_MP8AsBVSWp_0 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.8pgca3IbnkRUbHgks3N2_MP8AsBVSWp_1 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.8pgca3IbnkRUbHgks3N2_MP8AsBVSWp_2 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.113+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.15900655147546947474 2024-09-12T18:00:33.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.117+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324826640 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562324834bf8 s->prefetch_data=0 2024-09-12T18:00:33.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.117+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:00:33.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.117+0000 7f66418ed9c0 10 manifest: total_size = 3303 2024-09-12T18:00:33.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.117+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.3553682366851779580 2024-09-12T18:00:33.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.117+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324826640 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562324834bf8 s->prefetch_data=0 2024-09-12T18:00:33.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.117+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324834bf8 2024-09-12T18:00:33.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.117+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.13.5 2024-09-12T18:00:33.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.121+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.121+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=3303 stripe_ofs=3303 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.121+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.3553682366851779580 2024-09-12T18:00:33.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.121+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.121+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.ZnOFlPjAaSNHjMP_dU5OYM4UMzl-S5h_0 2024-09-12T18:00:33.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.121+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T18:00:33.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.121+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.121+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.3553682366851779580 2024-09-12T18:00:33.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.121+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:00:33.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.125+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324843650 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5623247987c8 s->prefetch_data=0 2024-09-12T18:00:33.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.125+0000 7f66418ed9c0 10 manifest: total_size = 10485760 2024-09-12T18:00:33.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.125+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.14454745463293996772 2024-09-12T18:00:33.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.125+0000 7f66418ed9c0 20 get_obj_state: octx=0x562324843650 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5623247987c8 s->prefetch_data=0 2024-09-12T18:00:33.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.125+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x5623247987c8 2024-09-12T18:00:33.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.125+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.13.7 2024-09-12T18:00:33.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.14454745463293996772 2024-09-12T18:00:33.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.r7SoinjzzrPl0OVzlwgZ3rZMzZ4rvq__0 2024-09-12T18:00:33.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T18:00:33.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.r7SoinjzzrPl0OVzlwgZ3rZMzZ4rvq__1 2024-09-12T18:00:33.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T18:00:33.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.r7SoinjzzrPl0OVzlwgZ3rZMzZ4rvq__2 2024-09-12T18:00:33.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-09-12T18:00:33.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.129+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.14454745463293996772 2024-09-12T18:00:33.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.133+0000 7f65227fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:00:33.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.133+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:33.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.133+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:33.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.133+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:33.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.133+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:33.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.133+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:33.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.133+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:33.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.133+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[98539659-fdaf-41ce-847d-239ff89323af.4641.13])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:33.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.137+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T18:00:33.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.137+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.137+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T18:00:33.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.137+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T18:00:33.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.137+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T18:00:33.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.141+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T18:00:33.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.141+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T18:00:33.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.141+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94708936160208 notifier 5651 bl.length()=184 2024-09-12T18:00:33.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.145+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:98539659-fdaf-41ce-847d-239ff89323af.4641.13 from cache 2024-09-12T18:00:33.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.145+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:98539659-fdaf-41ce-847d-239ff89323af.4641.13, ofs0, ns] 2024-09-12T18:00:33.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.145+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94708936167696 notifier 5651 bl.length()=242 2024-09-12T18:00:33.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.153+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/98539659-fdaf-41ce-847d-239ff89323af.4641.13 : miss 2024-09-12T18:00:33.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.153+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.153+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.153+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/98539659-fdaf-41ce-847d-239ff89323af.4641.13 info.flags=0x0 2024-09-12T18:00:33.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.153+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/98539659-fdaf-41ce-847d-239ff89323af.4641.13 to cache LRU end 2024-09-12T18:00:33.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.157+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:98539659-fdaf-41ce-847d-239ff89323af.4641.6 : miss 2024-09-12T18:00:33.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.157+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.161+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T18:00:33.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.161+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:98539659-fdaf-41ce-847d-239ff89323af.4641.6 info.flags=0x17 2024-09-12T18:00:33.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.161+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:98539659-fdaf-41ce-847d-239ff89323af.4641.6 to cache LRU end 2024-09-12T18:00:33.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.161+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:33.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.161+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:33.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.161+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:98539659-fdaf-41ce-847d-239ff89323af.4641.6 2024-09-12T18:00:33.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.161+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T18:00:33.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.165+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T18:00:33.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.165+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T18:00:33.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.169+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T18:00:33.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.169+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482ca00 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562324836118 s->prefetch_data=0 2024-09-12T18:00:33.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.169+0000 7f66418ed9c0 10 manifest: total_size = 0 2024-09-12T18:00:33.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.173+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.3699585963575533191 2024-09-12T18:00:33.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.173+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482ca00 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562324836118 s->prefetch_data=0 2024-09-12T18:00:33.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.173+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324836118 2024-09-12T18:00:33.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.173+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.6.2 2024-09-12T18:00:33.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.177+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482ca00 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562324856918 s->prefetch_data=0 2024-09-12T18:00:33.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.177+0000 7f66418ed9c0 10 manifest: total_size = 0 2024-09-12T18:00:33.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.177+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.10918564892272672560 2024-09-12T18:00:33.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.177+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482ca00 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562324856918 s->prefetch_data=0 2024-09-12T18:00:33.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.177+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324856918 2024-09-12T18:00:33.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.177+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.6.3 2024-09-12T18:00:33.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.181+0000 7f65227fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T18:00:33.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.181+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482ca00 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562324856918 s->prefetch_data=0 2024-09-12T18:00:33.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.185+0000 7f66418ed9c0 10 manifest: total_size = 0 2024-09-12T18:00:33.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.185+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.9339126314219546780 2024-09-12T18:00:33.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.185+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482ca00 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562324856918 s->prefetch_data=0 2024-09-12T18:00:33.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.185+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324856918 2024-09-12T18:00:33.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.185+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.6.6 2024-09-12T18:00:33.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.185+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T18:00:33.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.189+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482ca00 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562324856918 s->prefetch_data=0 2024-09-12T18:00:33.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.189+0000 7f66418ed9c0 10 manifest: total_size = 0 2024-09-12T18:00:33.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.189+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.13665271635716720637 2024-09-12T18:00:33.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.189+0000 7f66418ed9c0 20 get_obj_state: octx=0x56232482ca00 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562324856918 s->prefetch_data=0 2024-09-12T18:00:33.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.189+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x562324856918 2024-09-12T18:00:33.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.189+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.6.8 2024-09-12T18:00:33.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.193+0000 7f65227fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T18:00:33.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.193+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:33.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.193+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:33.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.197+0000 7f65227fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T18:00:33.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.197+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:33.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.197+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:33.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.197+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:33.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.197+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:33.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.197+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[98539659-fdaf-41ce-847d-239ff89323af.4641.6])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:33.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.201+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T18:00:33.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.201+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.205+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T18:00:33.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.205+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T18:00:33.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.205+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T18:00:33.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.205+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T18:00:33.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.205+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T18:00:33.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.205+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 94708936130288 notifier 5651 bl.length()=181 2024-09-12T18:00:33.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.209+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:98539659-fdaf-41ce-847d-239ff89323af.4641.6 from cache 2024-09-12T18:00:33.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.209+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:98539659-fdaf-41ce-847d-239ff89323af.4641.6, ofs0, ns] 2024-09-12T18:00:33.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.213+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94708936167696 notifier 5651 bl.length()=238 2024-09-12T18:00:33.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.221+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/98539659-fdaf-41ce-847d-239ff89323af.4641.6 : miss 2024-09-12T18:00:33.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.221+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.221+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.221+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/98539659-fdaf-41ce-847d-239ff89323af.4641.6 info.flags=0x0 2024-09-12T18:00:33.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.221+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/98539659-fdaf-41ce-847d-239ff89323af.4641.6 to cache LRU end 2024-09-12T18:00:33.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.229+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:98539659-fdaf-41ce-847d-239ff89323af.4641.7 : miss 2024-09-12T18:00:33.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.229+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.233+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T18:00:33.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.233+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:98539659-fdaf-41ce-847d-239ff89323af.4641.7 info.flags=0x17 2024-09-12T18:00:33.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.233+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:98539659-fdaf-41ce-847d-239ff89323af.4641.7 to cache LRU end 2024-09-12T18:00:33.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.233+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:33.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.233+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:33.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.233+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:98539659-fdaf-41ce-847d-239ff89323af.4641.7 2024-09-12T18:00:33.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.233+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T18:00:33.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.233+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T18:00:33.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.237+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T18:00:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.237+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T18:00:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.241+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5623247982b8 s->prefetch_data=0 2024-09-12T18:00:33.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.241+0000 7f66418ed9c0 10 manifest: total_size = 24595 2024-09-12T18:00:33.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.241+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.312227648553834751 2024-09-12T18:00:33.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.241+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5623247982b8 s->prefetch_data=0 2024-09-12T18:00:33.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.241+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x5623247982b8 2024-09-12T18:00:33.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.241+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.7.2 2024-09-12T18:00:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.245+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.245+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.245+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.312227648553834751 2024-09-12T18:00:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.245+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.245+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.7__shadow_.2K7FYwDoZtVdvC0jkboYx1dG-xNKmy0_0 2024-09-12T18:00:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.245+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-12T18:00:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.245+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.245+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.312227648553834751 2024-09-12T18:00:33.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.249+0000 7f65227fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T18:00:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.249+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5623247982b8 s->prefetch_data=0 2024-09-12T18:00:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.249+0000 7f66418ed9c0 10 manifest: total_size = 2078 2024-09-12T18:00:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.249+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.3593117845392817534 2024-09-12T18:00:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.249+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5623247982b8 s->prefetch_data=0 2024-09-12T18:00:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.249+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x5623247982b8 2024-09-12T18:00:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.249+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.7.3 2024-09-12T18:00:33.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.253+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.253+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.253+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.3593117845392817534 2024-09-12T18:00:33.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.253+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.253+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.7__shadow_.laqFljaFTlXZjC7M3jVlB5wMH94ts3g_0 2024-09-12T18:00:33.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.253+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:33.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.253+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.253+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.3593117845392817534 2024-09-12T18:00:33.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.257+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T18:00:33.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.257+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5623247982b8 s->prefetch_data=0 2024-09-12T18:00:33.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.261+0000 7f66418ed9c0 10 manifest: total_size = 527 2024-09-12T18:00:33.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.261+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.4770996995207740836 2024-09-12T18:00:33.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.261+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5623247982b8 s->prefetch_data=0 2024-09-12T18:00:33.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.261+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x5623247982b8 2024-09-12T18:00:33.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.261+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.7.6 2024-09-12T18:00:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.265+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.265+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.265+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.4770996995207740836 2024-09-12T18:00:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.265+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.265+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.7__shadow_.SKaZNU49-nShuwK4Q8Ilov4U4xUZQ_L_0 2024-09-12T18:00:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.265+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.265+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.265+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.4770996995207740836 2024-09-12T18:00:33.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.269+0000 7f65227fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T18:00:33.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.269+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5623247982b8 s->prefetch_data=0 2024-09-12T18:00:33.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.269+0000 7f66418ed9c0 10 manifest: total_size = 38 2024-09-12T18:00:33.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.269+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.14341129183692990171 2024-09-12T18:00:33.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.269+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4e20 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5623247982b8 s->prefetch_data=0 2024-09-12T18:00:33.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.269+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x5623247982b8 2024-09-12T18:00:33.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.269+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.7.8 2024-09-12T18:00:33.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.273+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.273+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.273+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.14341129183692990171 2024-09-12T18:00:33.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.273+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.273+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.7__shadow_.7aQIgdM6ObjG4zeArliW1xbargqnEC6_0 2024-09-12T18:00:33.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.273+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:33.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.273+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.273+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.14341129183692990171 2024-09-12T18:00:33.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.277+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T18:00:33.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.277+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:33.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.277+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:33.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.277+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:33.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.277+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:33.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.277+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:33.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.277+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:33.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.277+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[98539659-fdaf-41ce-847d-239ff89323af.4641.7])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:33.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.285+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T18:00:33.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.285+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.285+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T18:00:33.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.285+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T18:00:33.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.285+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T18:00:33.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.289+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T18:00:33.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.289+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T18:00:33.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.289+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94708936130288 notifier 5651 bl.length()=181 2024-09-12T18:00:33.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.293+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:98539659-fdaf-41ce-847d-239ff89323af.4641.7 from cache 2024-09-12T18:00:33.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.293+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:98539659-fdaf-41ce-847d-239ff89323af.4641.7, ofs0, ns] 2024-09-12T18:00:33.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.293+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 94708936167696 notifier 5651 bl.length()=238 2024-09-12T18:00:33.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.301+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/98539659-fdaf-41ce-847d-239ff89323af.4641.7 : miss 2024-09-12T18:00:33.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.301+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.301+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.301+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/98539659-fdaf-41ce-847d-239ff89323af.4641.7 info.flags=0x0 2024-09-12T18:00:33.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.301+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/98539659-fdaf-41ce-847d-239ff89323af.4641.7 to cache LRU end 2024-09-12T18:00:33.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.305+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:98539659-fdaf-41ce-847d-239ff89323af.4641.8 : miss 2024-09-12T18:00:33.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.305+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.309+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T18:00:33.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.309+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:98539659-fdaf-41ce-847d-239ff89323af.4641.8 info.flags=0x17 2024-09-12T18:00:33.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.309+0000 7f66418ed9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:98539659-fdaf-41ce-847d-239ff89323af.4641.8 to cache LRU end 2024-09-12T18:00:33.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.309+0000 7f66418ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:33.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.309+0000 7f66418ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:00:33.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.309+0000 7f66418ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:98539659-fdaf-41ce-847d-239ff89323af.4641.8 2024-09-12T18:00:33.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.313+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T18:00:33.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.313+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T18:00:33.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.317+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T18:00:33.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.317+0000 7f66418ed9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T18:00:33.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.321+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4fc0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5623247992c8 s->prefetch_data=0 2024-09-12T18:00:33.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.321+0000 7f66418ed9c0 10 manifest: total_size = 1048576 2024-09-12T18:00:33.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.321+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.2913524299468264041 2024-09-12T18:00:33.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.321+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4fc0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5623247992c8 s->prefetch_data=0 2024-09-12T18:00:33.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.321+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x5623247992c8 2024-09-12T18:00:33.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.321+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.8.2 2024-09-12T18:00:33.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.325+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.325+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.325+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.2913524299468264041 2024-09-12T18:00:33.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.325+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.325+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.8__shadow_.973UGN8BYFR0e280L1IOGefJqziWid5_0 2024-09-12T18:00:33.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.325+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:33.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.325+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.325+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.2913524299468264041 2024-09-12T18:00:33.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.329+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T18:00:33.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.329+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4fc0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5623247992c8 s->prefetch_data=0 2024-09-12T18:00:33.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.329+0000 7f66418ed9c0 10 manifest: total_size = 4134 2024-09-12T18:00:33.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.329+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.2756127112814296438 2024-09-12T18:00:33.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.329+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66340f4fc0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5623247992c8 s->prefetch_data=0 2024-09-12T18:00:33.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.329+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x5623247992c8 2024-09-12T18:00:33.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.329+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.8.3 2024-09-12T18:00:33.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.333+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.333+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.333+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.2756127112814296438 2024-09-12T18:00:33.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.333+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.333+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.8__shadow_.hjm96WQBNUYXKFIelJY5wmThhHBt__N_0 2024-09-12T18:00:33.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.333+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:33.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.333+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.333+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.2756127112814296438 2024-09-12T18:00:33.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.337+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66300687c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5623247992c8 s->prefetch_data=0 2024-09-12T18:00:33.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.337+0000 7f66418ed9c0 10 manifest: total_size = 55 2024-09-12T18:00:33.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.337+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.17657419800211608556 2024-09-12T18:00:33.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.337+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f66300687c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5623247992c8 s->prefetch_data=0 2024-09-12T18:00:33.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.337+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x5623247992c8 2024-09-12T18:00:33.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.337+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.8.6 2024-09-12T18:00:33.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.337+0000 7f65227fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T18:00:33.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.341+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.341+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.341+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.17657419800211608556 2024-09-12T18:00:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.341+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.341+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.8__shadow_.B9rGU7eZFoaRdtTSLuaIO1r6rKNoXyw_0 2024-09-12T18:00:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.341+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:00:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.341+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.341+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.17657419800211608556 2024-09-12T18:00:33.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.345+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f663005f480 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5623247992c8 s->prefetch_data=0 2024-09-12T18:00:33.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.345+0000 7f6522ffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T18:00:33.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.345+0000 7f66418ed9c0 10 manifest: total_size = 49187 2024-09-12T18:00:33.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.345+0000 7f66418ed9c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.5034571182735498157 2024-09-12T18:00:33.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.345+0000 7f66418ed9c0 20 get_obj_state: octx=0x7f663005f480 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5623247992c8 s->prefetch_data=0 2024-09-12T18:00:33.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.345+0000 7f66418ed9c0 20 prepare_atomic_modification: state is not atomic. state=0x5623247992c8 2024-09-12T18:00:33.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.345+0000 7f66418ed9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.8.8 2024-09-12T18:00:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.353+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:00:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.353+0000 7f66418ed9c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T18:00:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.353+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.5034571182735498157 2024-09-12T18:00:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.353+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:00:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.353+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 98539659-fdaf-41ce-847d-239ff89323af.4641.8__shadow_.0ZvELxd58_Mdng5F2_6-3NjqaRJDGEt_0 2024-09-12T18:00:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.353+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:00:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.353+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:00:33.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.353+0000 7f66418ed9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 98539659-fdaf-41ce-847d-239ff89323af.4641.5034571182735498157 2024-09-12T18:00:33.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.353+0000 7f65227fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T18:00:33.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.353+0000 7f66418ed9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:00:33.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.353+0000 7f66418ed9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:00:33.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.357+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:00:33.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.357+0000 7f66418ed9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:00:33.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.357+0000 7f66418ed9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:00:33.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.357+0000 7f66418ed9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:00:33.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.357+0000 7f66418ed9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[98539659-fdaf-41ce-847d-239ff89323af.4641.8])"; uploads.size()=0; is_truncated=0 2024-09-12T18:00:33.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.361+0000 7f66418ed9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T18:00:33.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.361+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.365+0000 7f66418ed9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T18:00:33.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.365+0000 7f66418ed9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T18:00:33.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.365+0000 7f66418ed9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T18:00:33.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.365+0000 7f66418ed9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T18:00:33.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.365+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T18:00:33.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.369+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 94708936130288 notifier 5651 bl.length()=181 2024-09-12T18:00:33.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.373+0000 7f66418ed9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:98539659-fdaf-41ce-847d-239ff89323af.4641.8 from cache 2024-09-12T18:00:33.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.373+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:98539659-fdaf-41ce-847d-239ff89323af.4641.8, ofs0, ns] 2024-09-12T18:00:33.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.373+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94708936167696 notifier 5651 bl.length()=238 2024-09-12T18:00:33.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.381+0000 7f66418ed9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/98539659-fdaf-41ce-847d-239ff89323af.4641.8 : miss 2024-09-12T18:00:33.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.381+0000 7f66418ed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.385+0000 7f66418ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.385+0000 7f66418ed9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/98539659-fdaf-41ce-847d-239ff89323af.4641.8 info.flags=0x0 2024-09-12T18:00:33.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.385+0000 7f66418ed9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/98539659-fdaf-41ce-847d-239ff89323af.4641.8 to cache LRU end 2024-09-12T18:00:33.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.389+0000 7f66418ed9c0 10 removing key index: NZYSCWRQPCFGEHPSBWTA 2024-09-12T18:00:33.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.393+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:NZYSCWRQPCFGEHPSBWTA, ofs0, ns] 2024-09-12T18:00:33.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.393+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94708936165200 notifier 5651 bl.length()=170 2024-09-12T18:00:33.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.393+0000 7f66418ed9c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T18:00:33.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.397+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T18:00:33.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.397+0000 7f65227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431581 cookie 94708936160208 notifier 5651 bl.length()=182 2024-09-12T18:00:33.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.397+0000 7f66418ed9c0 10 removing user buckets index 2024-09-12T18:00:33.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.401+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T18:00:33.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.401+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94708936167696 notifier 5651 bl.length()=173 2024-09-12T18:00:33.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.405+0000 7f66418ed9c0 10 removing user index: ragweed.client.0 2024-09-12T18:00:33.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.405+0000 7f66418ed9c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T18:00:33.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.405+0000 7f66418ed9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T18:00:33.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.409+0000 7f6522ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 94708936165200 notifier 5651 bl.length()=165 2024-09-12T18:00:33.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.413+0000 7f64f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:33.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.417+0000 7f66418ed9c0 20 remove_watcher() i=0 2024-09-12T18:00:33.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.417+0000 7f66418ed9c0 2 removed watcher, disabling cache 2024-09-12T18:00:33.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.417+0000 7f66418ed9c0 20 remove_watcher() i=1 2024-09-12T18:00:33.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.421+0000 7f66418ed9c0 20 remove_watcher() i=2 2024-09-12T18:00:33.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.421+0000 7f66418ed9c0 20 remove_watcher() i=3 2024-09-12T18:00:33.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.425+0000 7f66418ed9c0 20 remove_watcher() i=4 2024-09-12T18:00:33.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.425+0000 7f66418ed9c0 20 remove_watcher() i=5 2024-09-12T18:00:33.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.429+0000 7f66418ed9c0 20 remove_watcher() i=6 2024-09-12T18:00:33.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.433+0000 7f66418ed9c0 20 remove_watcher() i=7 2024-09-12T18:00:33.447 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T18:00:33.527 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:33.527 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.565+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.565+0000 7fc6a14e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.565+0000 7fc6a14e39c0 20 realm 2024-09-12T18:00:33.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.565+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.565+0000 7fc6a14e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.565+0000 7fc6a14e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.565+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.565+0000 7fc6a14e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.565+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.569+0000 7fc6a14e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.569+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.569+0000 7fc6a14e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:33.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.569+0000 7fc6a14e39c0 20 searching for the correct realm 2024-09-12T18:00:33.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.573+0000 7fc69e7e8640 0 -- 172.21.15.97:0/4266553394 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fc688001c20 msgr2=0x7fc68809da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:33.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.577+0000 7fc69efe9640 0 -- 172.21.15.97:0/4266553394 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fc6900dc940 msgr2=0x7fc6900ce410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:33.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.585+0000 7fc6a14e39c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:00:33.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.585+0000 7fc6a14e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:33.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.585+0000 7fc6a14e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:33.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.585+0000 7fc6a14e39c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:00:33.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.585+0000 7fc6a14e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:33.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.585+0000 7fc6a14e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:33.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.585+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.585+0000 7fc6a14e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.585+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.585+0000 7fc6a14e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:33.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.585+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:33.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 20 zone default found 2024-09-12T18:00:33.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 4 Realm: () 2024-09-12T18:00:33.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:00:33.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:00:33.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:33.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 20 zonegroup default 2024-09-12T18:00:33.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:33.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 20 started sync module instance, tier type = 2024-09-12T18:00:33.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.589+0000 7fc6a14e39c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:00:33.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.609+0000 7fc6a14e39c0 20 add_watcher() i=0 2024-09-12T18:00:33.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.609+0000 7fc6a14e39c0 20 add_watcher() i=1 2024-09-12T18:00:33.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.609+0000 7fc6a14e39c0 20 add_watcher() i=2 2024-09-12T18:00:33.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.609+0000 7fc6a14e39c0 20 add_watcher() i=3 2024-09-12T18:00:33.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.609+0000 7fc6a14e39c0 20 add_watcher() i=4 2024-09-12T18:00:33.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.609+0000 7fc6a14e39c0 20 add_watcher() i=5 2024-09-12T18:00:33.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.609+0000 7fc6a14e39c0 20 add_watcher() i=6 2024-09-12T18:00:33.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.609+0000 7fc6a14e39c0 20 add_watcher() i=7 2024-09-12T18:00:33.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.609+0000 7fc6a14e39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:33.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.613+0000 7fc5557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:33.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.613+0000 7fc6a14e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:33.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.613+0000 7fc6a14e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:33.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.685+0000 7fc4cffff640 20 reqs_thread_entry: start 2024-09-12T18:00:33.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.685+0000 7fc6a14e39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:33.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.685+0000 7fc6a14e39c0 20 Filter name: none 2024-09-12T18:00:33.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.685+0000 7fc4cdffb640 20 reqs_thread_entry: start 2024-09-12T18:00:33.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.685+0000 7fc6a14e39c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T18:00:33.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.685+0000 7fc6a14e39c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.685+0000 7fc6a14e39c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T18:00:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.685+0000 7fc6a14e39c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T18:00:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.685+0000 7fc6a14e39c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T18:00:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.685+0000 7fc6a14e39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.685+0000 7fc6a14e39c0 10 removing key index: ZHQZKDLLCNOGFOAQZTRC 2024-09-12T18:00:33.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.689+0000 7fc6a14e39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:ZHQZKDLLCNOGFOAQZTRC, ofs0, ns] 2024-09-12T18:00:33.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.689+0000 7fc5827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431582 cookie 94512510924512 notifier 5669 bl.length()=170 2024-09-12T18:00:33.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.689+0000 7fc6a14e39c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T18:00:33.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.693+0000 7fc6a14e39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T18:00:33.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.693+0000 7fc5827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94512510925696 notifier 5669 bl.length()=182 2024-09-12T18:00:33.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.693+0000 7fc6a14e39c0 10 removing user buckets index 2024-09-12T18:00:33.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.697+0000 7fc6a14e39c0 10 removing user index: sysuser.client.0 2024-09-12T18:00:33.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.697+0000 7fc6a14e39c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T18:00:33.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.697+0000 7fc6a14e39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T18:00:33.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.697+0000 7fc581ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431583 cookie 94512510924512 notifier 5669 bl.length()=165 2024-09-12T18:00:33.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.701+0000 7fc5557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:33.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.705+0000 7fc6a14e39c0 20 remove_watcher() i=0 2024-09-12T18:00:33.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.705+0000 7fc6a14e39c0 2 removed watcher, disabling cache 2024-09-12T18:00:33.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.705+0000 7fc6a14e39c0 20 remove_watcher() i=1 2024-09-12T18:00:33.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.709+0000 7fc6a14e39c0 20 remove_watcher() i=2 2024-09-12T18:00:33.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.709+0000 7fc6a14e39c0 20 remove_watcher() i=3 2024-09-12T18:00:33.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.713+0000 7fc6a14e39c0 20 remove_watcher() i=4 2024-09-12T18:00:33.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.717+0000 7fc6a14e39c0 20 remove_watcher() i=5 2024-09-12T18:00:33.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.717+0000 7fc6a14e39c0 20 remove_watcher() i=6 2024-09-12T18:00:33.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:00:33.721+0000 7fc6a14e39c0 20 remove_watcher() i=7 2024-09-12T18:00:33.736 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T18:00:33.737 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T18:00:33.828 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:00:33.840 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:00:33.840 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:00:33.840 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:00:33.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:00:33.846 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:00:33.846 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:00:33.893 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:00:33.893 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:00:33.942 INFO:tasks.workunit:timeout=3h 2024-09-12T18:00:33.942 INFO:tasks.workunit:cleanup=True 2024-09-12T18:00:33.943 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:00:33.991 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:01:32.009 INFO:tasks.workunit.client.0.smithi097.stderr:Updating files: 98% (12450/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T18:01:32.321 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T18:01:32.321 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:01:32.321 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:01:32.321 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:01:32.321 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:01:32.322 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:01:32.323 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T18:01:32.326 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:01:32.375 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:01:32.379 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:01:32.379 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:01:32.430 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:01:32.482 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:01:32.525 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:01:32.526 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:01:32.526 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:01:32.568 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:01:32.571 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T18:01:32.572 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:01:32.621 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T18:01:32.623 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T18:01:32.623 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T18:01:32.678 INFO:tasks.workunit.client.0.smithi097.stderr:+ ulimit -c 0 2024-09-12T18:01:32.678 INFO:tasks.workunit.client.0.smithi097.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T18:01:32.678 INFO:tasks.workunit.client.0.smithi097.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:01:32.679 INFO:tasks.workunit.client.0.smithi097.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:01:35.488 INFO:tasks.workunit.client.0.smithi097.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:01:35.488 INFO:tasks.workunit.client.0.smithi097.stderr:++ deactivate nondestructive 2024-09-12T18:01:35.488 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T18:01:35.488 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T18:01:35.488 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:01:35.488 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-12T18:01:35.488 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T18:01:35.488 INFO:tasks.workunit.client.0.smithi097.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:01:35.488 INFO:tasks.workunit.client.0.smithi097.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:01:35.488 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:01:35.488 INFO:tasks.workunit.client.0.smithi097.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ export VIRTUAL_ENV 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PATH 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -z '' ']' 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ PS1='(rgw) ' 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PS1 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-12T18:01:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install pip --upgrade 2024-09-12T18:01:35.872 INFO:tasks.workunit.client.0.smithi097.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T18:01:36.069 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting pip 2024-09-12T18:01:36.076 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:01:36.109 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: pip 2024-09-12T18:01:36.109 INFO:tasks.workunit.client.0.smithi097.stdout: Attempting uninstall: pip 2024-09-12T18:01:36.110 INFO:tasks.workunit.client.0.smithi097.stdout: Found existing installation: pip 22.0.2 2024-09-12T18:01:36.369 INFO:tasks.workunit.client.0.smithi097.stdout: Uninstalling pip-22.0.2: 2024-09-12T18:01:36.375 INFO:tasks.workunit.client.0.smithi097.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T18:01:37.115 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed pip-24.2 2024-09-12T18:01:37.174 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install boto3 2024-09-12T18:01:38.147 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting boto3 2024-09-12T18:01:38.148 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:01:38.708 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:01:38.709 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:01:38.756 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:01:38.757 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:01:38.803 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:01:38.804 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:01:38.859 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:01:38.860 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:01:38.961 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:01:38.962 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T18:01:39.209 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:01:39.210 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:01:39.214 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:01:39.215 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:01:39.225 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:01:39.226 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:01:39.227 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:01:39.229 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T18:01:39.230 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:01:39.298 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:01:40.324 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T18:01:40.535 INFO:tasks.workunit.client.0.smithi097.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T18:01:40.672 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T18:01:40.708 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:40.708 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:40.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.744+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.748+0000 7fbaa982e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.748+0000 7fbaa982e9c0 20 realm 2024-09-12T18:01:40.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.748+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.748+0000 7fbaa982e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.748+0000 7fbaa982e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:40.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.748+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.748+0000 7fbaa982e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.748+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.752+0000 7fbaa982e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:40.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.752+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.752+0000 7fbaa982e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:40.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.752+0000 7fbaa982e9c0 20 searching for the correct realm 2024-09-12T18:01:40.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.760+0000 7fbaa6b33640 0 -- 172.21.15.97:0/3637814048 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55deae3c3710 msgr2=0x55deae3c5bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:40.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.764+0000 7fbaa6b33640 0 -- 172.21.15.97:0/3637814048 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x55deae3cb170 msgr2=0x55deae3cd560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:40.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:01:40.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:40.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:40.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:01:40.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:40.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:40.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:40.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:40.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 zone default found 2024-09-12T18:01:40.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 4 Realm: () 2024-09-12T18:01:40.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:01:40.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:01:40.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:40.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 zonegroup default 2024-09-12T18:01:40.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 started sync module instance, tier type = 2024-09-12T18:01:40.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.772+0000 7fbaa982e9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:01:40.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.792+0000 7fbaa982e9c0 20 add_watcher() i=0 2024-09-12T18:01:40.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.792+0000 7fbaa982e9c0 20 add_watcher() i=1 2024-09-12T18:01:40.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.792+0000 7fbaa982e9c0 20 add_watcher() i=2 2024-09-12T18:01:40.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.792+0000 7fbaa982e9c0 20 add_watcher() i=3 2024-09-12T18:01:40.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.792+0000 7fbaa982e9c0 20 add_watcher() i=4 2024-09-12T18:01:40.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.792+0000 7fbaa982e9c0 20 add_watcher() i=5 2024-09-12T18:01:40.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.792+0000 7fbaa982e9c0 20 add_watcher() i=6 2024-09-12T18:01:40.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fbaa982e9c0 20 add_watcher() i=7 2024-09-12T18:01:40.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fbaa982e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:40.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fb95dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:40.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fbaa982e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:40.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fbaa982e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:40.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fbaa982e9c0 5 note: GC not initialized 2024-09-12T18:01:40.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fb95cfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:40.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fbaa982e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:40.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fbaa982e9c0 20 Filter name: none 2024-09-12T18:01:40.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fb8d67fc640 20 reqs_thread_entry: start 2024-09-12T18:01:40.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fbaa982e9c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T18:01:40.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.796+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T18:01:40.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T18:01:40.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T18:01:40.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:40.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:40.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T18:01:40.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T18:01:40.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T18:01:40.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T18:01:40.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T18:01:40.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T18:01:40.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.800+0000 7fbaa982e9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T18:01:40.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.804+0000 7fb98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94414894337072 notifier 5684 bl.length()=569 2024-09-12T18:01:40.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.804+0000 7fb98affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T18:01:40.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.804+0000 7fb98affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T18:01:40.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.808+0000 7fbaa982e9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T18:01:40.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.808+0000 7fbaa982e9c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T18:01:40.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.808+0000 7fbaa982e9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T18:01:40.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.808+0000 7fb98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 94414894286976 notifier 5684 bl.length()=180 2024-09-12T18:01:40.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.808+0000 7fb98affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T18:01:40.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.808+0000 7fb98affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T18:01:40.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.812+0000 7fb95dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:40.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.816+0000 7fbaa982e9c0 20 remove_watcher() i=0 2024-09-12T18:01:40.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.816+0000 7fbaa982e9c0 2 removed watcher, disabling cache 2024-09-12T18:01:40.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.816+0000 7fbaa982e9c0 20 remove_watcher() i=1 2024-09-12T18:01:40.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.820+0000 7fbaa982e9c0 20 remove_watcher() i=2 2024-09-12T18:01:40.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.820+0000 7fbaa982e9c0 20 remove_watcher() i=3 2024-09-12T18:01:40.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.820+0000 7fbaa982e9c0 20 remove_watcher() i=4 2024-09-12T18:01:40.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.824+0000 7fbaa982e9c0 20 remove_watcher() i=5 2024-09-12T18:01:40.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.828+0000 7fbaa982e9c0 20 remove_watcher() i=6 2024-09-12T18:01:40.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:01:40.828+0000 7fbaa982e9c0 20 remove_watcher() i=7 2024-09-12T18:02:03.737 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:03.754 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:03.815 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:03.815 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:03.944 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:03.944 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:04.074 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:04.075 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:04.158 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:04.158 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:04.253 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:04.253 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:04.330 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard add 2024-09-12T18:02:04.330 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:04.331 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:02:04.364 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:04.364 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:04.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.411+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.411+0000 7f1f4ba249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.411+0000 7f1f4ba249c0 20 realm 2024-09-12T18:02:04.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.411+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.411+0000 7f1f4ba249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.411+0000 7f1f4ba249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:04.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.411+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.411+0000 7f1f4ba249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.415+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.415+0000 7f1f4ba249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:04.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.415+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.415+0000 7f1f4ba249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:04.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.415+0000 7f1f4ba249c0 20 searching for the correct realm 2024-09-12T18:02:04.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.423+0000 7f1f49d2b640 0 -- 172.21.15.97:0/2096011377 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5606d0f09700 msgr2=0x5606d0f0bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:04.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.427+0000 7f1f4952a640 0 -- 172.21.15.97:0/2096011377 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x5606d0f0d950 msgr2=0x5606d0f0fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:04.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:04.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:04.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:04.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:04.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:04.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:04.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:04.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:04.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 zone default found 2024-09-12T18:02:04.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 4 Realm: () 2024-09-12T18:02:04.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:04.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:04.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:04.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 zonegroup default 2024-09-12T18:02:04.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.435+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.439+0000 7f1f4ba249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.439+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.439+0000 7f1f4ba249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.439+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.439+0000 7f1f4ba249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.439+0000 7f1f4ba249c0 20 started sync module instance, tier type = 2024-09-12T18:02:04.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.439+0000 7f1f4ba249c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:04.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.459+0000 7f1f4ba249c0 20 add_watcher() i=0 2024-09-12T18:02:04.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.459+0000 7f1f4ba249c0 20 add_watcher() i=1 2024-09-12T18:02:04.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.459+0000 7f1f4ba249c0 20 add_watcher() i=2 2024-09-12T18:02:04.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.459+0000 7f1f4ba249c0 20 add_watcher() i=3 2024-09-12T18:02:04.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.459+0000 7f1f4ba249c0 20 add_watcher() i=4 2024-09-12T18:02:04.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.459+0000 7f1f4ba249c0 20 add_watcher() i=5 2024-09-12T18:02:04.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.459+0000 7f1f4ba249c0 20 add_watcher() i=6 2024-09-12T18:02:04.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.459+0000 7f1f4ba249c0 20 add_watcher() i=7 2024-09-12T18:02:04.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.459+0000 7f1f4ba249c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:04.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.463+0000 7f1dfffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:04.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.463+0000 7f1f4ba249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:04.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.463+0000 7f1f4ba249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:04.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.463+0000 7f1f4ba249c0 5 note: GC not initialized 2024-09-12T18:02:04.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.463+0000 7f1dfefe5640 20 reqs_thread_entry: start 2024-09-12T18:02:04.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.463+0000 7f1f4ba249c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:04.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.463+0000 7f1f4ba249c0 20 Filter name: none 2024-09-12T18:02:04.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.463+0000 7f1dfcfe1640 20 reqs_thread_entry: start 2024-09-12T18:02:04.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.463+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.467+0000 7f1f4ba249c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:04.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.467+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.467+0000 7f1f4ba249c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:04.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.467+0000 7f1f4ba249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:04.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.467+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.467+0000 7f1f4ba249c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:04.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.467+0000 7f1f4ba249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.467+0000 7f1f4ba249c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:04.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.467+0000 7f1f4ba249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:04.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.471+0000 7f1dfffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:04.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.475+0000 7f1f4ba249c0 20 remove_watcher() i=0 2024-09-12T18:02:04.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.475+0000 7f1f4ba249c0 2 removed watcher, disabling cache 2024-09-12T18:02:04.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.475+0000 7f1f4ba249c0 20 remove_watcher() i=1 2024-09-12T18:02:04.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.479+0000 7f1f4ba249c0 20 remove_watcher() i=2 2024-09-12T18:02:04.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.479+0000 7f1f4ba249c0 20 remove_watcher() i=3 2024-09-12T18:02:04.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.483+0000 7f1f4ba249c0 20 remove_watcher() i=4 2024-09-12T18:02:04.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.483+0000 7f1f4ba249c0 20 remove_watcher() i=5 2024-09-12T18:02:04.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.487+0000 7f1f4ba249c0 20 remove_watcher() i=6 2024-09-12T18:02:04.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.491+0000 7f1f4ba249c0 20 remove_watcher() i=7 2024-09-12T18:02:04.504 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:04.504 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:04.504 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 98539659-fdaf-41ce-847d-239ff89323af.4641.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T18:02:04.504 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:04.505 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T18:02:04.534 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:04.534 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:04.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.579+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.583+0000 7fbf65b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.583+0000 7fbf65b139c0 20 realm 2024-09-12T18:02:04.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.583+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.583+0000 7fbf65b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.583+0000 7fbf65b139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:04.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.583+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.583+0000 7fbf65b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.583+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.583+0000 7fbf65b139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:04.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.583+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.587+0000 7fbf65b139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:04.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.587+0000 7fbf65b139c0 20 searching for the correct realm 2024-09-12T18:02:04.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.591+0000 7fbf62e18640 0 -- 172.21.15.97:0/2032815567 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fbf5805f9c0 msgr2=0x7fbf58060a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:04.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.595+0000 7fbf63e1a640 0 -- 172.21.15.97:0/2032815567 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5604f75fb990 msgr2=0x5604f75fde10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:04.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:04.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:04.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:04.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:04.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:04.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:04.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:04.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:04.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 zone default found 2024-09-12T18:02:04.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 4 Realm: () 2024-09-12T18:02:04.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:04.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:04.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:04.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 zonegroup default 2024-09-12T18:02:04.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.603+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.607+0000 7fbf65b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.607+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.607+0000 7fbf65b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.607+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.607+0000 7fbf65b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.607+0000 7fbf65b139c0 20 started sync module instance, tier type = 2024-09-12T18:02:04.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.607+0000 7fbf65b139c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:04.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.623+0000 7fbf65b139c0 20 add_watcher() i=0 2024-09-12T18:02:04.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.623+0000 7fbf65b139c0 20 add_watcher() i=1 2024-09-12T18:02:04.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.623+0000 7fbf65b139c0 20 add_watcher() i=2 2024-09-12T18:02:04.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.623+0000 7fbf65b139c0 20 add_watcher() i=3 2024-09-12T18:02:04.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.623+0000 7fbf65b139c0 20 add_watcher() i=4 2024-09-12T18:02:04.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.623+0000 7fbf65b139c0 20 add_watcher() i=5 2024-09-12T18:02:04.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.623+0000 7fbf65b139c0 20 add_watcher() i=6 2024-09-12T18:02:04.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.627+0000 7fbf65b139c0 20 add_watcher() i=7 2024-09-12T18:02:04.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.627+0000 7fbf65b139c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:04.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbe19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:04.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:04.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:04.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 5 note: GC not initialized 2024-09-12T18:02:04.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbe18fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:04.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:04.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 20 Filter name: none 2024-09-12T18:02:04.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbd927fc640 20 reqs_thread_entry: start 2024-09-12T18:02:04.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:04.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:04.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:02:04.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:04.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:02:04.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:04.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:04.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:04.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:04.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:04.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.631+0000 7fbf65b139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:02:04.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.635+0000 7fbe19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:04.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.639+0000 7fbf65b139c0 20 remove_watcher() i=0 2024-09-12T18:02:04.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.639+0000 7fbf65b139c0 2 removed watcher, disabling cache 2024-09-12T18:02:04.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.643+0000 7fbf65b139c0 20 remove_watcher() i=1 2024-09-12T18:02:04.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.643+0000 7fbf65b139c0 20 remove_watcher() i=2 2024-09-12T18:02:04.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.647+0000 7fbf65b139c0 20 remove_watcher() i=3 2024-09-12T18:02:04.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.647+0000 7fbf65b139c0 20 remove_watcher() i=4 2024-09-12T18:02:04.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.651+0000 7fbf65b139c0 20 remove_watcher() i=5 2024-09-12T18:02:04.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.651+0000 7fbf65b139c0 20 remove_watcher() i=6 2024-09-12T18:02:04.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.655+0000 7fbf65b139c0 20 remove_watcher() i=7 2024-09-12T18:02:04.670 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard list 2024-09-12T18:02:04.694 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:04.695 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:04.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.739+0000 7fba6a4249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.739+0000 7fba6a4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.739+0000 7fba6a4249c0 20 realm 2024-09-12T18:02:04.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.739+0000 7fba6a4249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.743+0000 7fba6a4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.743+0000 7fba6a4249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:04.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.743+0000 7fba6a4249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.743+0000 7fba6a4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.743+0000 7fba6a4249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.743+0000 7fba6a4249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:04.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.743+0000 7fba6a4249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.743+0000 7fba6a4249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:04.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.743+0000 7fba6a4249c0 20 searching for the correct realm 2024-09-12T18:02:04.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.751+0000 7fba6872b640 0 -- 172.21.15.97:0/3905692825 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55cb15eab2b0 msgr2=0x55cb15ead6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:04.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.755+0000 7fba67f2a640 0 -- 172.21.15.97:0/3905692825 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55cb15eaf450 msgr2=0x55cb15eb1840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:04.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:04.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:04.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:04.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:04.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:04.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:04.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:04.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:04.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 zone default found 2024-09-12T18:02:04.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 4 Realm: () 2024-09-12T18:02:04.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:04.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:04.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:04.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 zonegroup default 2024-09-12T18:02:04.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.763+0000 7fba6a4249c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.767+0000 7fba6a4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.767+0000 7fba6a4249c0 20 started sync module instance, tier type = 2024-09-12T18:02:04.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.767+0000 7fba6a4249c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:04.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.783+0000 7fba6a4249c0 20 add_watcher() i=0 2024-09-12T18:02:04.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.783+0000 7fba6a4249c0 20 add_watcher() i=1 2024-09-12T18:02:04.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.783+0000 7fba6a4249c0 20 add_watcher() i=2 2024-09-12T18:02:04.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.783+0000 7fba6a4249c0 20 add_watcher() i=3 2024-09-12T18:02:04.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.783+0000 7fba6a4249c0 20 add_watcher() i=4 2024-09-12T18:02:04.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.783+0000 7fba6a4249c0 20 add_watcher() i=5 2024-09-12T18:02:04.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.783+0000 7fba6a4249c0 20 add_watcher() i=6 2024-09-12T18:02:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.787+0000 7fba6a4249c0 20 add_watcher() i=7 2024-09-12T18:02:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.787+0000 7fba6a4249c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:04.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.791+0000 7fb91dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:04.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.791+0000 7fba6a4249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:04.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.791+0000 7fba6a4249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:04.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.791+0000 7fba6a4249c0 5 note: GC not initialized 2024-09-12T18:02:04.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.791+0000 7fb91cfe1640 20 reqs_thread_entry: start 2024-09-12T18:02:04.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.791+0000 7fba6a4249c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:04.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.791+0000 7fba6a4249c0 20 Filter name: none 2024-09-12T18:02:04.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.791+0000 7fb8967fc640 20 reqs_thread_entry: start 2024-09-12T18:02:04.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.803+0000 7fb91dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:04.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.807+0000 7fba6a4249c0 20 remove_watcher() i=0 2024-09-12T18:02:04.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.807+0000 7fba6a4249c0 2 removed watcher, disabling cache 2024-09-12T18:02:04.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.807+0000 7fba6a4249c0 20 remove_watcher() i=1 2024-09-12T18:02:04.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.811+0000 7fba6a4249c0 20 remove_watcher() i=2 2024-09-12T18:02:04.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.811+0000 7fba6a4249c0 20 remove_watcher() i=3 2024-09-12T18:02:04.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.815+0000 7fba6a4249c0 20 remove_watcher() i=4 2024-09-12T18:02:04.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.815+0000 7fba6a4249c0 20 remove_watcher() i=5 2024-09-12T18:02:04.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.819+0000 7fba6a4249c0 20 remove_watcher() i=6 2024-09-12T18:02:04.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.823+0000 7fba6a4249c0 20 remove_watcher() i=7 2024-09-12T18:02:04.835 INFO:tasks.workunit.client.0.smithi097.stderr:bucket name a-bucket 2024-09-12T18:02:04.836 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard process 2024-09-12T18:02:04.836 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:04.836 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard process 2024-09-12T18:02:04.860 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:04.860 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:04.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.903+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.907+0000 7f08c24309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.907+0000 7f08c24309c0 20 realm 2024-09-12T18:02:04.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.907+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.907+0000 7f08c24309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.907+0000 7f08c24309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.907+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.907+0000 7f08c24309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.907+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.907+0000 7f08c24309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:04.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.907+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.911+0000 7f08c24309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:04.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.911+0000 7f08c24309c0 20 searching for the correct realm 2024-09-12T18:02:04.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.915+0000 7f08b7735640 0 -- 172.21.15.97:0/2479790665 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f08a80eab60 msgr2=0x7f08a80c5420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:04.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.919+0000 7f08b7735640 0 -- 172.21.15.97:0/2479790665 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55c7bf186a10 msgr2=0x55c7bf188e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:04.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:04.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:04.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:04.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:04.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:04.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:04.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:04.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:04.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 zone default found 2024-09-12T18:02:04.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 4 Realm: () 2024-09-12T18:02:04.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:04.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:04.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:04.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 zonegroup default 2024-09-12T18:02:04.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.927+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.931+0000 7f08c24309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.931+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.931+0000 7f08c24309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:04.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.931+0000 7f08c24309c0 20 started sync module instance, tier type = 2024-09-12T18:02:04.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.931+0000 7f08c24309c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:04.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.947+0000 7f08c24309c0 20 add_watcher() i=0 2024-09-12T18:02:04.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.947+0000 7f08c24309c0 20 add_watcher() i=1 2024-09-12T18:02:04.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.947+0000 7f08c24309c0 20 add_watcher() i=2 2024-09-12T18:02:04.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.947+0000 7f08c24309c0 20 add_watcher() i=3 2024-09-12T18:02:04.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.947+0000 7f08c24309c0 20 add_watcher() i=4 2024-09-12T18:02:04.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.947+0000 7f08c24309c0 20 add_watcher() i=5 2024-09-12T18:02:04.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.947+0000 7f08c24309c0 20 add_watcher() i=6 2024-09-12T18:02:04.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.951+0000 7f08c24309c0 20 add_watcher() i=7 2024-09-12T18:02:04.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.951+0000 7f08c24309c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:04.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.955+0000 7f0775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:04.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.955+0000 7f08c24309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:04.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.955+0000 7f08c24309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:04.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.955+0000 7f08c24309c0 5 note: GC not initialized 2024-09-12T18:02:04.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.955+0000 7f0774fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:04.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.955+0000 7f08c24309c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:04.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.955+0000 7f08c24309c0 20 Filter name: none 2024-09-12T18:02:04.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.955+0000 7f08c24309c0 20 processing logshard = reshard.0000000000 2024-09-12T18:02:04.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.955+0000 7f06ee7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:04.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.959+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T18:02:04.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.959+0000 7f08c24309c0 20 processing logshard = reshard.0000000001 2024-09-12T18:02:04.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.963+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T18:02:04.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.963+0000 7f08c24309c0 20 processing logshard = reshard.0000000002 2024-09-12T18:02:04.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.971+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T18:02:04.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.971+0000 7f08c24309c0 20 processing logshard = reshard.0000000003 2024-09-12T18:02:04.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.975+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T18:02:04.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.975+0000 7f08c24309c0 20 processing logshard = reshard.0000000004 2024-09-12T18:02:04.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.979+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T18:02:04.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.979+0000 7f08c24309c0 20 processing logshard = reshard.0000000005 2024-09-12T18:02:04.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.983+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T18:02:04.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.983+0000 7f08c24309c0 20 processing logshard = reshard.0000000006 2024-09-12T18:02:04.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.983+0000 7f08c24309c0 20 process_entry resharding a-bucket 2024-09-12T18:02:04.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.983+0000 7f08c24309c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:04.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.983+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.987+0000 7f08c24309c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:04.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.987+0000 7f08c24309c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T18:02:04.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.987+0000 7f08c24309c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:04.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.987+0000 7f08c24309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:02:04.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.987+0000 7f08c24309c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:04.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.987+0000 7f08c24309c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:04.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.987+0000 7f08c24309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:04.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.987+0000 7f08c24309c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:04.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.987+0000 7f08c24309c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:04.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.987+0000 7f08c24309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:04.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.987+0000 7f08c24309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:02:04.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f08c24309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:04.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f08c24309c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:04.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f08c24309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:04.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f08c24309c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:02:04.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f079e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431571 cookie 94316392909088 notifier 6090 bl.length()=827 2024-09-12T18:02:04.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f079e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:04.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f079e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:04.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f079e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:05.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:02:05.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:02:05.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:02:05.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:04.999+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:02:05.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.0 2024-09-12T18:02:05.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.0 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.1 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.1 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.2 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.2 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.3 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.3 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.4 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.4 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.5 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.5 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.6 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.6 2024-09-12T18:02:05.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.7 2024-09-12T18:02:05.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.7 2024-09-12T18:02:05.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.8 2024-09-12T18:02:05.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.8 2024-09-12T18:02:05.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.9 2024-09-12T18:02:05.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.9 2024-09-12T18:02:05.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.10 2024-09-12T18:02:05.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.10 2024-09-12T18:02:05.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.11 2024-09-12T18:02:05.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.11 2024-09-12T18:02:05.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.0 2024-09-12T18:02:05.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1 2024-09-12T18:02:05.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2 2024-09-12T18:02:05.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3 2024-09-12T18:02:05.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.4 2024-09-12T18:02:05.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.011+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.5 2024-09-12T18:02:05.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.015+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.6 2024-09-12T18:02:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.015+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.7 2024-09-12T18:02:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.015+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.8 2024-09-12T18:02:05.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.015+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.9 2024-09-12T18:02:05.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.019+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.10 2024-09-12T18:02:05.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.019+0000 7f08c24309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:05.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.019+0000 7f08c24309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:02:05.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.019+0000 7f08c24309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:05.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.019+0000 7f08c24309c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:05.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.019+0000 7f08c24309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:05.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.019+0000 7f08c24309c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:02:05.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.023+0000 7f079e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431572 cookie 94316392909088 notifier 6090 bl.length()=827 2024-09-12T18:02:05.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.023+0000 7f079e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:05.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.023+0000 7f079e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:05.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.023+0000 7f079e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:05.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.023+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:02:05.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.023+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:02:05.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.023+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:02:05.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.023+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:02:05.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.027+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.0 2024-09-12T18:02:05.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.027+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1 2024-09-12T18:02:05.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.027+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2 2024-09-12T18:02:05.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.031+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3 2024-09-12T18:02:05.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.031+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.4 2024-09-12T18:02:05.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.031+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.5 2024-09-12T18:02:05.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.031+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.6 2024-09-12T18:02:05.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.031+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.7 2024-09-12T18:02:05.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.031+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.8 2024-09-12T18:02:05.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.031+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.9 2024-09-12T18:02:05.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.031+0000 7f08c24309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.10 2024-09-12T18:02:05.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.035+0000 7f08c24309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:05.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.035+0000 7f08c24309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:02:05.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.035+0000 7f08c24309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:05.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.035+0000 7f08c24309c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:05.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.035+0000 7f08c24309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:05.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.035+0000 7f08c24309c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:02:05.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.035+0000 7f079e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431573 cookie 94316392909088 notifier 6090 bl.length()=795 2024-09-12T18:02:05.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.035+0000 7f079e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:05.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.035+0000 7f079e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:05.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.035+0000 7f079e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:05.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.039+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:02:05.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.039+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:02:05.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.039+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:02:05.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.039+0000 7f08c24309c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:02:05.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.043+0000 7f08c24309c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T18:02:05.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.043+0000 7f08c24309c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T18:02:05.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.047+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T18:02:05.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.047+0000 7f08c24309c0 20 processing logshard = reshard.0000000007 2024-09-12T18:02:05.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.055+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T18:02:05.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.055+0000 7f08c24309c0 20 processing logshard = reshard.0000000008 2024-09-12T18:02:05.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.059+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T18:02:05.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.059+0000 7f08c24309c0 20 processing logshard = reshard.0000000009 2024-09-12T18:02:05.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.063+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T18:02:05.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.063+0000 7f08c24309c0 20 processing logshard = reshard.0000000010 2024-09-12T18:02:05.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.067+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T18:02:05.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.067+0000 7f08c24309c0 20 processing logshard = reshard.0000000011 2024-09-12T18:02:05.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.071+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T18:02:05.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.071+0000 7f08c24309c0 20 processing logshard = reshard.0000000012 2024-09-12T18:02:05.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.075+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T18:02:05.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.075+0000 7f08c24309c0 20 processing logshard = reshard.0000000013 2024-09-12T18:02:05.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.083+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T18:02:05.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.083+0000 7f08c24309c0 20 processing logshard = reshard.0000000014 2024-09-12T18:02:05.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.087+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T18:02:05.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.087+0000 7f08c24309c0 20 processing logshard = reshard.0000000015 2024-09-12T18:02:05.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.091+0000 7f08c24309c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T18:02:05.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.095+0000 7f0775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:05.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.099+0000 7f08c24309c0 20 remove_watcher() i=0 2024-09-12T18:02:05.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.099+0000 7f08c24309c0 2 removed watcher, disabling cache 2024-09-12T18:02:05.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.099+0000 7f08c24309c0 20 remove_watcher() i=1 2024-09-12T18:02:05.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.103+0000 7f08c24309c0 20 remove_watcher() i=2 2024-09-12T18:02:05.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.103+0000 7f08c24309c0 20 remove_watcher() i=3 2024-09-12T18:02:05.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.107+0000 7f08c24309c0 20 remove_watcher() i=4 2024-09-12T18:02:05.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.107+0000 7f08c24309c0 20 remove_watcher() i=5 2024-09-12T18:02:05.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.111+0000 7f08c24309c0 20 remove_watcher() i=6 2024-09-12T18:02:05.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:05.115+0000 7f08c24309c0 20 remove_watcher() i=7 2024-09-12T18:02:10.138 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:02:10.172 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:10.172 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:10.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.219+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.223+0000 7f73f37e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.223+0000 7f73f37e29c0 20 realm 2024-09-12T18:02:10.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.223+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.223+0000 7f73f37e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.223+0000 7f73f37e29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:10.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.223+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.223+0000 7f73f37e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.223+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.223+0000 7f73f37e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:10.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.223+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.227+0000 7f73f37e29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:10.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.227+0000 7f73f37e29c0 20 searching for the correct realm 2024-09-12T18:02:10.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.231+0000 7f73f0ae7640 0 -- 172.21.15.97:0/3808323728 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f73dc0673e0 msgr2=0x7f73dc05f910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:10.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.235+0000 7f73f0ae7640 0 -- 172.21.15.97:0/3808323728 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55c31d4683a0 msgr2=0x55c31d46a790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:10.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.243+0000 7f73f37e29c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:10.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.243+0000 7f73f37e29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:10.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.243+0000 7f73f37e29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:10.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.243+0000 7f73f37e29c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:10.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.243+0000 7f73f37e29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:10.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.243+0000 7f73f37e29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:10.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.243+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.243+0000 7f73f37e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.243+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:10.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:10.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 zone default found 2024-09-12T18:02:10.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 4 Realm: () 2024-09-12T18:02:10.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:10.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:10.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:10.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 zonegroup default 2024-09-12T18:02:10.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:10.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 started sync module instance, tier type = 2024-09-12T18:02:10.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.247+0000 7f73f37e29c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.267+0000 7f73f37e29c0 20 add_watcher() i=0 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.267+0000 7f73f37e29c0 20 add_watcher() i=1 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.267+0000 7f73f37e29c0 20 add_watcher() i=2 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.267+0000 7f73f37e29c0 20 add_watcher() i=3 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.267+0000 7f73f37e29c0 20 add_watcher() i=4 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.267+0000 7f73f37e29c0 20 add_watcher() i=5 2024-09-12T18:02:10.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.267+0000 7f73f37e29c0 20 add_watcher() i=6 2024-09-12T18:02:10.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.271+0000 7f73f37e29c0 20 add_watcher() i=7 2024-09-12T18:02:10.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.271+0000 7f73f37e29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:10.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f72a7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f73f37e29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f73f37e29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f73f37e29c0 5 note: GC not initialized 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f72a6fe5640 20 reqs_thread_entry: start 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f73f37e29c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f73f37e29c0 20 Filter name: none 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f72a4fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:10.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f73f37e29c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:10.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f73f37e29c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:10.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f73f37e29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:10.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.275+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.279+0000 7f73f37e29c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:10.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.279+0000 7f73f37e29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:10.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.279+0000 7f73f37e29c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:10.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.279+0000 7f73f37e29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:10.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.279+0000 7f72a7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:10.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.283+0000 7f73f37e29c0 20 remove_watcher() i=0 2024-09-12T18:02:10.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.283+0000 7f73f37e29c0 2 removed watcher, disabling cache 2024-09-12T18:02:10.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.287+0000 7f73f37e29c0 20 remove_watcher() i=1 2024-09-12T18:02:10.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.287+0000 7f73f37e29c0 20 remove_watcher() i=2 2024-09-12T18:02:10.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.291+0000 7f73f37e29c0 20 remove_watcher() i=3 2024-09-12T18:02:10.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.291+0000 7f73f37e29c0 20 remove_watcher() i=4 2024-09-12T18:02:10.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.295+0000 7f73f37e29c0 20 remove_watcher() i=5 2024-09-12T18:02:10.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.295+0000 7f73f37e29c0 20 remove_watcher() i=6 2024-09-12T18:02:10.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:10.299+0000 7f73f37e29c0 20 remove_watcher() i=7 2024-09-12T18:02:10.313 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:10.313 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:10.313 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 98539659-fdaf-41ce-847d-239ff89323af.4641.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T18:02:10.313 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:10.313 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard add non empty bucket 2024-09-12T18:02:10.313 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:10.318 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:10.318 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:10.371 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:10.371 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:10.456 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:10.456 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:10.549 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:10.549 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:10.649 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:10.649 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:10.745 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:10.745 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:10.843 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:10.843 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:10.942 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:11.028 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:02:11.060 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:11.060 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:11.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.107+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.107+0000 7ff77b64d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.107+0000 7ff77b64d9c0 20 realm 2024-09-12T18:02:11.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.107+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.107+0000 7ff77b64d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.107+0000 7ff77b64d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:11.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.107+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.111+0000 7ff77b64d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.111+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.111+0000 7ff77b64d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:11.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.111+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.111+0000 7ff77b64d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:11.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.111+0000 7ff77b64d9c0 20 searching for the correct realm 2024-09-12T18:02:11.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.115+0000 7ff779153640 0 -- 172.21.15.97:0/2436804412 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7ff76c039be0 msgr2=0x7ff76c01a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:11.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.327+0000 7ff779153640 0 -- 172.21.15.97:0/2436804412 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7ff7740ca040 msgr2=0x7ff7740cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:11.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.543+0000 7ff77b64d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:11.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.543+0000 7ff77b64d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:11.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.543+0000 7ff77b64d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:11.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.543+0000 7ff77b64d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:11.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.543+0000 7ff77b64d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:11.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.543+0000 7ff77b64d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:11.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.543+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:11.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:11.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 zone default found 2024-09-12T18:02:11.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 4 Realm: () 2024-09-12T18:02:11.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:11.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:11.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:11.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 zonegroup default 2024-09-12T18:02:11.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.547+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.551+0000 7ff77b64d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.551+0000 7ff77b64d9c0 20 started sync module instance, tier type = 2024-09-12T18:02:11.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.551+0000 7ff77b64d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:11.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.575+0000 7ff77b64d9c0 20 add_watcher() i=0 2024-09-12T18:02:11.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.575+0000 7ff77b64d9c0 20 add_watcher() i=1 2024-09-12T18:02:11.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.575+0000 7ff77b64d9c0 20 add_watcher() i=2 2024-09-12T18:02:11.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.575+0000 7ff77b64d9c0 20 add_watcher() i=3 2024-09-12T18:02:11.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.575+0000 7ff77b64d9c0 20 add_watcher() i=4 2024-09-12T18:02:11.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.575+0000 7ff77b64d9c0 20 add_watcher() i=5 2024-09-12T18:02:11.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.575+0000 7ff77b64d9c0 20 add_watcher() i=6 2024-09-12T18:02:11.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.579+0000 7ff77b64d9c0 20 add_watcher() i=7 2024-09-12T18:02:11.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.579+0000 7ff77b64d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:11.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff62f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:11.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff77b64d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:11.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff77b64d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:11.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff77b64d9c0 5 note: GC not initialized 2024-09-12T18:02:11.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff62e7e4640 20 reqs_thread_entry: start 2024-09-12T18:02:11.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff77b64d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:11.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff77b64d9c0 20 Filter name: none 2024-09-12T18:02:11.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff59ffff640 20 reqs_thread_entry: start 2024-09-12T18:02:11.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff77b64d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:11.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff77b64d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:11.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff77b64d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:11.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.583+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.587+0000 7ff77b64d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:11.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.587+0000 7ff77b64d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.587+0000 7ff77b64d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:11.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.587+0000 7ff77b64d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:11.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.591+0000 7ff62f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:11.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.595+0000 7ff77b64d9c0 20 remove_watcher() i=0 2024-09-12T18:02:11.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.595+0000 7ff77b64d9c0 2 removed watcher, disabling cache 2024-09-12T18:02:11.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.595+0000 7ff77b64d9c0 20 remove_watcher() i=1 2024-09-12T18:02:11.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.599+0000 7ff77b64d9c0 20 remove_watcher() i=2 2024-09-12T18:02:11.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.599+0000 7ff77b64d9c0 20 remove_watcher() i=3 2024-09-12T18:02:11.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.603+0000 7ff77b64d9c0 20 remove_watcher() i=4 2024-09-12T18:02:11.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.603+0000 7ff77b64d9c0 20 remove_watcher() i=5 2024-09-12T18:02:11.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.607+0000 7ff77b64d9c0 20 remove_watcher() i=6 2024-09-12T18:02:11.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.611+0000 7ff77b64d9c0 20 remove_watcher() i=7 2024-09-12T18:02:11.627 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:11.627 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:11.627 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 98539659-fdaf-41ce-847d-239ff89323af.4641.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T18:02:11.627 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:11.627 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T18:02:11.656 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:11.656 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:11.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.699+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.703+0000 7f9112d059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.703+0000 7f9112d059c0 20 realm 2024-09-12T18:02:11.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.703+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.703+0000 7f9112d059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.703+0000 7f9112d059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:11.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.703+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.703+0000 7f9112d059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.703+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.703+0000 7f9112d059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:11.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.703+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.707+0000 7f9112d059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:11.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.707+0000 7f9112d059c0 20 searching for the correct realm 2024-09-12T18:02:11.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.711+0000 7f911080b640 0 -- 172.21.15.97:0/3902586224 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f91000db410 msgr2=0x7f91000fdbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:11.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.715+0000 7f911080b640 0 -- 172.21.15.97:0/3902586224 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f9108020040 msgr2=0x7f910802d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:11.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:11.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:11.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:11.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:11.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:11.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:11.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:11.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:11.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 zone default found 2024-09-12T18:02:11.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 4 Realm: () 2024-09-12T18:02:11.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:11.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:11.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:11.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 zonegroup default 2024-09-12T18:02:11.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.935+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.939+0000 7f9112d059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.939+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.939+0000 7f9112d059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.939+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.939+0000 7f9112d059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:11.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.939+0000 7f9112d059c0 20 started sync module instance, tier type = 2024-09-12T18:02:11.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.939+0000 7f9112d059c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:11.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.963+0000 7f9112d059c0 20 add_watcher() i=0 2024-09-12T18:02:11.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.963+0000 7f9112d059c0 20 add_watcher() i=1 2024-09-12T18:02:11.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.963+0000 7f9112d059c0 20 add_watcher() i=2 2024-09-12T18:02:11.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.963+0000 7f9112d059c0 20 add_watcher() i=3 2024-09-12T18:02:11.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.963+0000 7f9112d059c0 20 add_watcher() i=4 2024-09-12T18:02:11.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.963+0000 7f9112d059c0 20 add_watcher() i=5 2024-09-12T18:02:11.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.963+0000 7f9112d059c0 20 add_watcher() i=6 2024-09-12T18:02:11.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.963+0000 7f9112d059c0 20 add_watcher() i=7 2024-09-12T18:02:11.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.963+0000 7f9112d059c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:11.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.967+0000 7f8fc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:11.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:11.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:11.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 5 note: GC not initialized 2024-09-12T18:02:11.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f8fc67e4640 20 reqs_thread_entry: start 2024-09-12T18:02:11.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:11.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 20 Filter name: none 2024-09-12T18:02:11.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f8fbf7fe640 20 reqs_thread_entry: start 2024-09-12T18:02:11.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:11.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:11.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:02:11.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:11.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:02:11.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:11.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:11.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:11.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:11.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:11.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:11.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.971+0000 7f9112d059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:02:11.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.975+0000 7f8fc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:11.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.979+0000 7f9112d059c0 20 remove_watcher() i=0 2024-09-12T18:02:11.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.979+0000 7f9112d059c0 2 removed watcher, disabling cache 2024-09-12T18:02:11.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.983+0000 7f9112d059c0 20 remove_watcher() i=1 2024-09-12T18:02:11.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.987+0000 7f9112d059c0 20 remove_watcher() i=2 2024-09-12T18:02:11.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.987+0000 7f9112d059c0 20 remove_watcher() i=3 2024-09-12T18:02:11.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.991+0000 7f9112d059c0 20 remove_watcher() i=4 2024-09-12T18:02:11.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.991+0000 7f9112d059c0 20 remove_watcher() i=5 2024-09-12T18:02:11.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.995+0000 7f9112d059c0 20 remove_watcher() i=6 2024-09-12T18:02:11.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:11.999+0000 7f9112d059c0 20 remove_watcher() i=7 2024-09-12T18:02:12.015 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard list 2024-09-12T18:02:12.040 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:12.040 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:12.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.083+0000 7f21679ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.087+0000 7f21679ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.087+0000 7f21679ad9c0 20 realm 2024-09-12T18:02:12.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.087+0000 7f21679ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.087+0000 7f21679ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.087+0000 7f21679ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.087+0000 7f21679ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.087+0000 7f21679ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.087+0000 7f21679ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.087+0000 7f21679ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:12.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.087+0000 7f21679ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.091+0000 7f21679ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:12.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.091+0000 7f21679ad9c0 20 searching for the correct realm 2024-09-12T18:02:12.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.095+0000 7f215ffff640 0 -- 172.21.15.97:0/3265398681 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f2150035920 msgr2=0x7f2150025410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:12.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.311+0000 7f215ffff640 0 -- 172.21.15.97:0/3265398681 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5558ced75fb0 msgr2=0x5558ced783a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:12.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.319+0000 7f21679ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:12.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.319+0000 7f21679ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:12.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.319+0000 7f21679ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:12.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.319+0000 7f21679ad9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:12.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.319+0000 7f21679ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:12.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.319+0000 7f21679ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:12.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.319+0000 7f21679ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:12.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:12.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 zone default found 2024-09-12T18:02:12.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 4 Realm: () 2024-09-12T18:02:12.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:12.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:12.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:12.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 zonegroup default 2024-09-12T18:02:12.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.323+0000 7f21679ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.327+0000 7f21679ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.327+0000 7f21679ad9c0 20 started sync module instance, tier type = 2024-09-12T18:02:12.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.327+0000 7f21679ad9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:12.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.347+0000 7f21679ad9c0 20 add_watcher() i=0 2024-09-12T18:02:12.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.347+0000 7f21679ad9c0 20 add_watcher() i=1 2024-09-12T18:02:12.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.347+0000 7f21679ad9c0 20 add_watcher() i=2 2024-09-12T18:02:12.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.347+0000 7f21679ad9c0 20 add_watcher() i=3 2024-09-12T18:02:12.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.347+0000 7f21679ad9c0 20 add_watcher() i=4 2024-09-12T18:02:12.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.347+0000 7f21679ad9c0 20 add_watcher() i=5 2024-09-12T18:02:12.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.347+0000 7f21679ad9c0 20 add_watcher() i=6 2024-09-12T18:02:12.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.351+0000 7f21679ad9c0 20 add_watcher() i=7 2024-09-12T18:02:12.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.351+0000 7f21679ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:12.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.355+0000 7f201bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:12.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.355+0000 7f21679ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:12.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.355+0000 7f21679ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:12.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.355+0000 7f21679ad9c0 5 note: GC not initialized 2024-09-12T18:02:12.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.355+0000 7f201afe5640 20 reqs_thread_entry: start 2024-09-12T18:02:12.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.355+0000 7f21679ad9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:12.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.355+0000 7f21679ad9c0 20 Filter name: none 2024-09-12T18:02:12.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.355+0000 7f2018fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:12.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.371+0000 7f201bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:12.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.375+0000 7f21679ad9c0 20 remove_watcher() i=0 2024-09-12T18:02:12.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.375+0000 7f21679ad9c0 2 removed watcher, disabling cache 2024-09-12T18:02:12.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.379+0000 7f21679ad9c0 20 remove_watcher() i=1 2024-09-12T18:02:12.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.379+0000 7f21679ad9c0 20 remove_watcher() i=2 2024-09-12T18:02:12.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.383+0000 7f21679ad9c0 20 remove_watcher() i=3 2024-09-12T18:02:12.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.387+0000 7f21679ad9c0 20 remove_watcher() i=4 2024-09-12T18:02:12.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.387+0000 7f21679ad9c0 20 remove_watcher() i=5 2024-09-12T18:02:12.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.391+0000 7f21679ad9c0 20 remove_watcher() i=6 2024-09-12T18:02:12.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.395+0000 7f21679ad9c0 20 remove_watcher() i=7 2024-09-12T18:02:12.418 INFO:tasks.workunit.client.0.smithi097.stderr:bucket name a-bucket 2024-09-12T18:02:12.418 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard process non empty bucket 2024-09-12T18:02:12.418 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:12.419 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard process 2024-09-12T18:02:12.448 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:12.448 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:12.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.495+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 20 realm 2024-09-12T18:02:12.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:12.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:12.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:12.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.499+0000 7f20f54829c0 20 searching for the correct realm 2024-09-12T18:02:12.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.507+0000 7f20f2787640 0 -- 172.21.15.97:0/549627054 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f20e802c070 msgr2=0x7f20e80890c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:12.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.511+0000 7f20f2f88640 0 -- 172.21.15.97:0/549627054 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f20ec0c4c20 msgr2=0x7f20ec0f7560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:12.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:12.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:12.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:12.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:12.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:12.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:12.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:12.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:12.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 zone default found 2024-09-12T18:02:12.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 4 Realm: () 2024-09-12T18:02:12.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:12.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:12.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:12.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 zonegroup default 2024-09-12T18:02:12.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.519+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.523+0000 7f20f54829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.523+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.523+0000 7f20f54829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.523+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.523+0000 7f20f54829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.523+0000 7f20f54829c0 20 started sync module instance, tier type = 2024-09-12T18:02:12.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.523+0000 7f20f54829c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:12.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.539+0000 7f20f54829c0 20 add_watcher() i=0 2024-09-12T18:02:12.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.539+0000 7f20f54829c0 20 add_watcher() i=1 2024-09-12T18:02:12.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.539+0000 7f20f54829c0 20 add_watcher() i=2 2024-09-12T18:02:12.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.539+0000 7f20f54829c0 20 add_watcher() i=3 2024-09-12T18:02:12.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.539+0000 7f20f54829c0 20 add_watcher() i=4 2024-09-12T18:02:12.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.539+0000 7f20f54829c0 20 add_watcher() i=5 2024-09-12T18:02:12.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.539+0000 7f20f54829c0 20 add_watcher() i=6 2024-09-12T18:02:12.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.543+0000 7f20f54829c0 20 add_watcher() i=7 2024-09-12T18:02:12.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.543+0000 7f20f54829c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:12.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.547+0000 7f1fa97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:12.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.547+0000 7f20f54829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:12.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.547+0000 7f20f54829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:12.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.547+0000 7f20f54829c0 5 note: GC not initialized 2024-09-12T18:02:12.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.547+0000 7f1f23fff640 20 reqs_thread_entry: start 2024-09-12T18:02:12.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.547+0000 7f20f54829c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:12.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.547+0000 7f20f54829c0 20 Filter name: none 2024-09-12T18:02:12.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.547+0000 7f1f21ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:12.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.547+0000 7f20f54829c0 20 processing logshard = reshard.0000000000 2024-09-12T18:02:12.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.551+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T18:02:12.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.551+0000 7f20f54829c0 20 processing logshard = reshard.0000000001 2024-09-12T18:02:12.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.559+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T18:02:12.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.559+0000 7f20f54829c0 20 processing logshard = reshard.0000000002 2024-09-12T18:02:12.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.563+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T18:02:12.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.563+0000 7f20f54829c0 20 processing logshard = reshard.0000000003 2024-09-12T18:02:12.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.567+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T18:02:12.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.567+0000 7f20f54829c0 20 processing logshard = reshard.0000000004 2024-09-12T18:02:12.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.571+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T18:02:12.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.571+0000 7f20f54829c0 20 processing logshard = reshard.0000000005 2024-09-12T18:02:12.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.575+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T18:02:12.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.575+0000 7f20f54829c0 20 processing logshard = reshard.0000000006 2024-09-12T18:02:12.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 20 process_entry resharding a-bucket 2024-09-12T18:02:12.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:12.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:12.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T18:02:12.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:12.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:02:12.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:12.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:12.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:12.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:12.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.579+0000 7f20f54829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:02:12.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.591+0000 7f20f54829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:12.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.591+0000 7f20f54829c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:12.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.591+0000 7f20f54829c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.591+0000 7f20f54829c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:02:12.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.595+0000 7f1fd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431574 cookie 93943727885024 notifier 6183 bl.length()=827 2024-09-12T18:02:12.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.595+0000 7f1fd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:12.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.595+0000 7f1fd5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:12.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.595+0000 7f1fd5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.595+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:02:12.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.595+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:02:12.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.595+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:02:12.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.595+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:02:12.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:02:12.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:02:12.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:02:12.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.0 2024-09-12T18:02:12.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.0 2024-09-12T18:02:12.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.1 2024-09-12T18:02:12.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.1 2024-09-12T18:02:12.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.2 2024-09-12T18:02:12.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.2 2024-09-12T18:02:12.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.3 2024-09-12T18:02:12.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.3 2024-09-12T18:02:12.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.4 2024-09-12T18:02:12.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.607+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.4 2024-09-12T18:02:12.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.611+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.5 2024-09-12T18:02:12.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.611+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.5 2024-09-12T18:02:12.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.611+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.6 2024-09-12T18:02:12.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.611+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.6 2024-09-12T18:02:12.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.611+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.7 2024-09-12T18:02:12.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.611+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.7 2024-09-12T18:02:12.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.611+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.8 2024-09-12T18:02:12.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.611+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.8 2024-09-12T18:02:12.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.611+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.9 2024-09-12T18:02:12.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.611+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.9 2024-09-12T18:02:12.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.615+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.10 2024-09-12T18:02:12.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.615+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.10 2024-09-12T18:02:12.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.615+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.11 2024-09-12T18:02:12.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.615+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.11 2024-09-12T18:02:12.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.619+0000 7f20f54829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:12.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.619+0000 7f20f54829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:02:12.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.623+0000 7f20f54829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:12.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.623+0000 7f20f54829c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:12.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.623+0000 7f20f54829c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.623+0000 7f20f54829c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:02:12.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.623+0000 7f1fd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431575 cookie 93943727885024 notifier 6183 bl.length()=827 2024-09-12T18:02:12.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.623+0000 7f1fd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:12.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.623+0000 7f1fd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:12.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.623+0000 7f1fd67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.627+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:02:12.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.627+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:02:12.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.627+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:02:12.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.627+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:02:12.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.631+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.0 2024-09-12T18:02:12.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.631+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.0 2024-09-12T18:02:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.631+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.1 2024-09-12T18:02:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.631+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.1 2024-09-12T18:02:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.631+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.2 2024-09-12T18:02:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.631+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.2 2024-09-12T18:02:12.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.631+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.3 2024-09-12T18:02:12.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.631+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.3 2024-09-12T18:02:12.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.631+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.4 2024-09-12T18:02:12.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.631+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.4 2024-09-12T18:02:12.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.5 2024-09-12T18:02:12.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.5 2024-09-12T18:02:12.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.6 2024-09-12T18:02:12.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.6 2024-09-12T18:02:12.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.7 2024-09-12T18:02:12.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.7 2024-09-12T18:02:12.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.8 2024-09-12T18:02:12.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.8 2024-09-12T18:02:12.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.9 2024-09-12T18:02:12.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.9 2024-09-12T18:02:12.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.10 2024-09-12T18:02:12.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.10 2024-09-12T18:02:12.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.11 2024-09-12T18:02:12.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.635+0000 7f20f54829c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.1.11 2024-09-12T18:02:12.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.639+0000 7f20f54829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:12.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.639+0000 7f20f54829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:02:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.639+0000 7f20f54829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.639+0000 7f20f54829c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.639+0000 7f20f54829c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.639+0000 7f20f54829c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:02:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.643+0000 7f1fd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431576 cookie 93943727885024 notifier 6183 bl.length()=795 2024-09-12T18:02:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.643+0000 7f1fd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:02:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.643+0000 7f1fd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:02:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.643+0000 7f1fd67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:12.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.643+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:02:12.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.643+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:02:12.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.643+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:02:12.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.643+0000 7f20f54829c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:02:12.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.651+0000 7f20f54829c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T18:02:12.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.651+0000 7f20f54829c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T18:02:12.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.655+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T18:02:12.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.655+0000 7f20f54829c0 20 processing logshard = reshard.0000000007 2024-09-12T18:02:12.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.663+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T18:02:12.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.663+0000 7f20f54829c0 20 processing logshard = reshard.0000000008 2024-09-12T18:02:12.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.667+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T18:02:12.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.667+0000 7f20f54829c0 20 processing logshard = reshard.0000000009 2024-09-12T18:02:12.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.671+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T18:02:12.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.671+0000 7f20f54829c0 20 processing logshard = reshard.0000000010 2024-09-12T18:02:12.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.675+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T18:02:12.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.675+0000 7f20f54829c0 20 processing logshard = reshard.0000000011 2024-09-12T18:02:12.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.683+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T18:02:12.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.683+0000 7f20f54829c0 20 processing logshard = reshard.0000000012 2024-09-12T18:02:12.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.687+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T18:02:12.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.687+0000 7f20f54829c0 20 processing logshard = reshard.0000000013 2024-09-12T18:02:12.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.691+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T18:02:12.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.691+0000 7f20f54829c0 20 processing logshard = reshard.0000000014 2024-09-12T18:02:12.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.699+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T18:02:12.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.699+0000 7f20f54829c0 20 processing logshard = reshard.0000000015 2024-09-12T18:02:12.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.703+0000 7f20f54829c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T18:02:12.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.703+0000 7f1fa97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:12.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.707+0000 7f20f54829c0 20 remove_watcher() i=0 2024-09-12T18:02:12.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.707+0000 7f20f54829c0 2 removed watcher, disabling cache 2024-09-12T18:02:12.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.711+0000 7f20f54829c0 20 remove_watcher() i=1 2024-09-12T18:02:12.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.711+0000 7f20f54829c0 20 remove_watcher() i=2 2024-09-12T18:02:12.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.715+0000 7f20f54829c0 20 remove_watcher() i=3 2024-09-12T18:02:12.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.719+0000 7f20f54829c0 20 remove_watcher() i=4 2024-09-12T18:02:12.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.719+0000 7f20f54829c0 20 remove_watcher() i=5 2024-09-12T18:02:12.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.723+0000 7f20f54829c0 20 remove_watcher() i=6 2024-09-12T18:02:12.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.723+0000 7f20f54829c0 20 remove_watcher() i=7 2024-09-12T18:02:12.743 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:02:12.774 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:12.774 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:12.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.819+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.819+0000 7fb1817409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.819+0000 7fb1817409c0 20 realm 2024-09-12T18:02:12.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.819+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.823+0000 7fb1817409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.823+0000 7fb1817409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:12.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.823+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.823+0000 7fb1817409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:12.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.823+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.823+0000 7fb1817409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:12.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.823+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:12.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.823+0000 7fb1817409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:12.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.823+0000 7fb1817409c0 20 searching for the correct realm 2024-09-12T18:02:12.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:12.831+0000 7fb17ea45640 0 -- 172.21.15.97:0/1680644327 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fb1680a3c20 msgr2=0x7fb168007cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:13.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.047+0000 7fb17fa47640 0 -- 172.21.15.97:0/1680644327 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5616c36780e0 msgr2=0x5616c367a4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:13.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:13.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:13.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:13.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:13.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:13.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:13.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:13.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:13.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:13.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:13.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:13.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:13.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 zone default found 2024-09-12T18:02:13.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 4 Realm: () 2024-09-12T18:02:13.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:13.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:13.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:13.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 zonegroup default 2024-09-12T18:02:13.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:13.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:13.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.059+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:13.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.063+0000 7fb1817409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:13.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.063+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:13.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.063+0000 7fb1817409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:13.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.063+0000 7fb1817409c0 20 started sync module instance, tier type = 2024-09-12T18:02:13.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.063+0000 7fb1817409c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:13.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.087+0000 7fb1817409c0 20 add_watcher() i=0 2024-09-12T18:02:13.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.087+0000 7fb1817409c0 20 add_watcher() i=1 2024-09-12T18:02:13.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.087+0000 7fb1817409c0 20 add_watcher() i=2 2024-09-12T18:02:13.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.087+0000 7fb1817409c0 20 add_watcher() i=3 2024-09-12T18:02:13.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.087+0000 7fb1817409c0 20 add_watcher() i=4 2024-09-12T18:02:13.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.087+0000 7fb1817409c0 20 add_watcher() i=5 2024-09-12T18:02:13.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.087+0000 7fb1817409c0 20 add_watcher() i=6 2024-09-12T18:02:13.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.091+0000 7fb1817409c0 20 add_watcher() i=7 2024-09-12T18:02:13.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.091+0000 7fb1817409c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:13.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.095+0000 7fb035fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:13.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.095+0000 7fb1817409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:13.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.095+0000 7fb1817409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:13.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.095+0000 7fb1817409c0 5 note: GC not initialized 2024-09-12T18:02:13.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.095+0000 7fb034fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:13.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.095+0000 7fb1817409c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:13.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.095+0000 7fb1817409c0 20 Filter name: none 2024-09-12T18:02:13.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.095+0000 7fafae7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:13.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.095+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:13.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.095+0000 7fb1817409c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:13.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.095+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:13.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.099+0000 7fb1817409c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:13.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.099+0000 7fb1817409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:13.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.099+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:13.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.099+0000 7fb1817409c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:13.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.099+0000 7fb1817409c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:13.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.099+0000 7fb1817409c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:02:13.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.099+0000 7fb1817409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:13.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.103+0000 7fb035fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:13.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.107+0000 7fb1817409c0 20 remove_watcher() i=0 2024-09-12T18:02:13.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.107+0000 7fb1817409c0 2 removed watcher, disabling cache 2024-09-12T18:02:13.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.107+0000 7fb1817409c0 20 remove_watcher() i=1 2024-09-12T18:02:13.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.111+0000 7fb1817409c0 20 remove_watcher() i=2 2024-09-12T18:02:13.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.111+0000 7fb1817409c0 20 remove_watcher() i=3 2024-09-12T18:02:13.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.115+0000 7fb1817409c0 20 remove_watcher() i=4 2024-09-12T18:02:13.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.115+0000 7fb1817409c0 20 remove_watcher() i=5 2024-09-12T18:02:13.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.119+0000 7fb1817409c0 20 remove_watcher() i=6 2024-09-12T18:02:13.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:13.123+0000 7fb1817409c0 20 remove_watcher() i=7 2024-09-12T18:02:13.138 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:13.138 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:13.138 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 98539659-fdaf-41ce-847d-239ff89323af.4641.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T18:02:13.138 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:13.138 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T18:02:13.138 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:13.139 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:13.139 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:13.219 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:13.219 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:13.313 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:13.313 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:13.414 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:13.414 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:13.511 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:13.512 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:13.626 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:13.626 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:13.724 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:13.724 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:13.824 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:13.824 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:13.920 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:13.920 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:14.013 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:14.014 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:14.110 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:14.110 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:14.210 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:14.210 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:14.307 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:14.307 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:14.400 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:14.401 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:14.500 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:14.500 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:14.595 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:14.691 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:14.692 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:14.776 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:14.776 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:14.872 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:14.872 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:14.968 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:14.968 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:15.062 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:15.062 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:15.161 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:15.161 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:15.248 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:02:15.279 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:15.279 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:15.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.323+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.327+0000 7f5b184539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.327+0000 7f5b184539c0 20 realm 2024-09-12T18:02:15.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.327+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.327+0000 7f5b184539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.327+0000 7f5b184539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:15.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.327+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.327+0000 7f5b184539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.327+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.327+0000 7f5b184539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:15.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.327+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.331+0000 7f5b184539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:15.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.331+0000 7f5b184539c0 20 searching for the correct realm 2024-09-12T18:02:15.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.335+0000 7f5b15f59640 0 -- 172.21.15.97:0/750554810 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f5b0804c040 msgr2=0x7f5b0804c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:15.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.343+0000 7f5b15f59640 0 -- 172.21.15.97:0/750554810 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f5b10018070 msgr2=0x7f5b1005bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:15.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:15.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:15.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:15.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:15.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:15.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:15.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:15.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:15.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 zone default found 2024-09-12T18:02:15.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 4 Realm: () 2024-09-12T18:02:15.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:15.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:15.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:15.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 zonegroup default 2024-09-12T18:02:15.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.351+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.355+0000 7f5b184539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.355+0000 7f5b184539c0 20 started sync module instance, tier type = 2024-09-12T18:02:15.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.355+0000 7f5b184539c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:15.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.375+0000 7f5b184539c0 20 add_watcher() i=0 2024-09-12T18:02:15.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.375+0000 7f5b184539c0 20 add_watcher() i=1 2024-09-12T18:02:15.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.375+0000 7f5b184539c0 20 add_watcher() i=2 2024-09-12T18:02:15.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.375+0000 7f5b184539c0 20 add_watcher() i=3 2024-09-12T18:02:15.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.375+0000 7f5b184539c0 20 add_watcher() i=4 2024-09-12T18:02:15.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.375+0000 7f5b184539c0 20 add_watcher() i=5 2024-09-12T18:02:15.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.375+0000 7f5b184539c0 20 add_watcher() i=6 2024-09-12T18:02:15.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.375+0000 7f5b184539c0 20 add_watcher() i=7 2024-09-12T18:02:15.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.375+0000 7f5b184539c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:15.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.379+0000 7f59c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:15.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.379+0000 7f5b184539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:15.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.379+0000 7f5b184539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:15.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.379+0000 7f5b184539c0 5 note: GC not initialized 2024-09-12T18:02:15.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.379+0000 7f59c67fc640 20 reqs_thread_entry: start 2024-09-12T18:02:15.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.379+0000 7f5b184539c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:15.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.379+0000 7f5b184539c0 20 Filter name: none 2024-09-12T18:02:15.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.379+0000 7f5937fff640 20 reqs_thread_entry: start 2024-09-12T18:02:15.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.379+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.383+0000 7f5b184539c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:15.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.383+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.383+0000 7f5b184539c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:15.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.383+0000 7f5b184539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:15.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.383+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.383+0000 7f5b184539c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:15.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.383+0000 7f5b184539c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.383+0000 7f5b184539c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:15.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.383+0000 7f5b184539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:15.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.387+0000 7f59c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:15.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.391+0000 7f5b184539c0 20 remove_watcher() i=0 2024-09-12T18:02:15.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.391+0000 7f5b184539c0 2 removed watcher, disabling cache 2024-09-12T18:02:15.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.391+0000 7f5b184539c0 20 remove_watcher() i=1 2024-09-12T18:02:15.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.395+0000 7f5b184539c0 20 remove_watcher() i=2 2024-09-12T18:02:15.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.395+0000 7f5b184539c0 20 remove_watcher() i=3 2024-09-12T18:02:15.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.399+0000 7f5b184539c0 20 remove_watcher() i=4 2024-09-12T18:02:15.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.399+0000 7f5b184539c0 20 remove_watcher() i=5 2024-09-12T18:02:15.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.403+0000 7f5b184539c0 20 remove_watcher() i=6 2024-09-12T18:02:15.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.407+0000 7f5b184539c0 20 remove_watcher() i=7 2024-09-12T18:02:15.421 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:15.421 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:15.421 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-init-index id: 98539659-fdaf-41ce-847d-239ff89323af.4641.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:02:15.421 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:15.421 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T18:02:15.454 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:15.454 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:15.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.499+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.503+0000 7f3ec80f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.503+0000 7f3ec80f99c0 20 realm 2024-09-12T18:02:15.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.503+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.503+0000 7f3ec80f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.503+0000 7f3ec80f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:15.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.503+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.503+0000 7f3ec80f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.503+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.503+0000 7f3ec80f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:15.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.503+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.507+0000 7f3ec80f99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:15.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.507+0000 7f3ec80f99c0 20 searching for the correct realm 2024-09-12T18:02:15.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.511+0000 7f3ec53fe640 0 -- 172.21.15.97:0/70874455 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f3eb01340e0 msgr2=0x7f3eb012d560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:15.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.515+0000 7f3ec6400640 0 -- 172.21.15.97:0/70874455 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55fd97122770 msgr2=0x55fd97124c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:15.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:15.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:15.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:15.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:15.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:15.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:15.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:15.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:15.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 zone default found 2024-09-12T18:02:15.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 4 Realm: () 2024-09-12T18:02:15.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:15.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:15.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:15.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 zonegroup default 2024-09-12T18:02:15.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.523+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.527+0000 7f3ec80f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.527+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.527+0000 7f3ec80f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.527+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.527+0000 7f3ec80f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.527+0000 7f3ec80f99c0 20 started sync module instance, tier type = 2024-09-12T18:02:15.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.527+0000 7f3ec80f99c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:15.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.543+0000 7f3ec80f99c0 20 add_watcher() i=0 2024-09-12T18:02:15.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.543+0000 7f3ec80f99c0 20 add_watcher() i=1 2024-09-12T18:02:15.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.543+0000 7f3ec80f99c0 20 add_watcher() i=2 2024-09-12T18:02:15.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.543+0000 7f3ec80f99c0 20 add_watcher() i=3 2024-09-12T18:02:15.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.543+0000 7f3ec80f99c0 20 add_watcher() i=4 2024-09-12T18:02:15.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.543+0000 7f3ec80f99c0 20 add_watcher() i=5 2024-09-12T18:02:15.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.543+0000 7f3ec80f99c0 20 add_watcher() i=6 2024-09-12T18:02:15.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.547+0000 7f3ec80f99c0 20 add_watcher() i=7 2024-09-12T18:02:15.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.547+0000 7f3ec80f99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:15.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3d777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:15.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:15.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:15.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 5 note: GC not initialized 2024-09-12T18:02:15.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3d767fc640 20 reqs_thread_entry: start 2024-09-12T18:02:15.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:15.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 20 Filter name: none 2024-09-12T18:02:15.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ce7fff640 20 reqs_thread_entry: start 2024-09-12T18:02:15.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T18:02:15.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:15.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T18:02:15.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T18:02:15.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 : miss 2024-09-12T18:02:15.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:15.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 info.flags=0x17 2024-09-12T18:02:15.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 to cache LRU end 2024-09-12T18:02:15.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:15.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:15.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.551+0000 7f3ec80f99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 2024-09-12T18:02:15.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.555+0000 7f3ec80f99c0 -1 Injecting error=-5 at location=init_index 2024-09-12T18:02:15.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.555+0000 7f3ec80f99c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T18:02:15.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.555+0000 7f3d777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:15.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.559+0000 7f3ec80f99c0 20 remove_watcher() i=0 2024-09-12T18:02:15.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.559+0000 7f3ec80f99c0 2 removed watcher, disabling cache 2024-09-12T18:02:15.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.563+0000 7f3ec80f99c0 20 remove_watcher() i=1 2024-09-12T18:02:15.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.563+0000 7f3ec80f99c0 20 remove_watcher() i=2 2024-09-12T18:02:15.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.567+0000 7f3ec80f99c0 20 remove_watcher() i=3 2024-09-12T18:02:15.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.567+0000 7f3ec80f99c0 20 remove_watcher() i=4 2024-09-12T18:02:15.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.571+0000 7f3ec80f99c0 20 remove_watcher() i=5 2024-09-12T18:02:15.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.571+0000 7f3ec80f99c0 20 remove_watcher() i=6 2024-09-12T18:02:15.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.575+0000 7f3ec80f99c0 20 remove_watcher() i=7 2024-09-12T18:02:15.590 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:02:15.616 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:15.616 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:15.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.867+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.871+0000 7f8ffaeff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.871+0000 7f8ffaeff9c0 20 realm 2024-09-12T18:02:15.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.871+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.871+0000 7f8ffaeff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.871+0000 7f8ffaeff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:15.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.871+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.871+0000 7f8ffaeff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:15.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.871+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.875+0000 7f8ffaeff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:15.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.875+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:15.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.875+0000 7f8ffaeff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:15.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.875+0000 7f8ffaeff9c0 20 searching for the correct realm 2024-09-12T18:02:15.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:15.879+0000 7f8ff3fff640 0 -- 172.21.15.97:0/1913116468 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f8fe4008050 msgr2=0x7f8fe4008430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:16.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.095+0000 7f8ff9206640 0 -- 172.21.15.97:0/1913116468 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55d6d4743570 msgr2=0x55d6d4745a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:16.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:16.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:16.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:16.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:16.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:16.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:16.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:16.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:16.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 zone default found 2024-09-12T18:02:16.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 4 Realm: () 2024-09-12T18:02:16.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:16.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:16.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:16.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 zonegroup default 2024-09-12T18:02:16.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.107+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.111+0000 7f8ffaeff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.111+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.111+0000 7f8ffaeff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.111+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.111+0000 7f8ffaeff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.111+0000 7f8ffaeff9c0 20 started sync module instance, tier type = 2024-09-12T18:02:16.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.111+0000 7f8ffaeff9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:16.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.135+0000 7f8ffaeff9c0 20 add_watcher() i=0 2024-09-12T18:02:16.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.135+0000 7f8ffaeff9c0 20 add_watcher() i=1 2024-09-12T18:02:16.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.135+0000 7f8ffaeff9c0 20 add_watcher() i=2 2024-09-12T18:02:16.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.135+0000 7f8ffaeff9c0 20 add_watcher() i=3 2024-09-12T18:02:16.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.135+0000 7f8ffaeff9c0 20 add_watcher() i=4 2024-09-12T18:02:16.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.135+0000 7f8ffaeff9c0 20 add_watcher() i=5 2024-09-12T18:02:16.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.135+0000 7f8ffaeff9c0 20 add_watcher() i=6 2024-09-12T18:02:16.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.135+0000 7f8ffaeff9c0 20 add_watcher() i=7 2024-09-12T18:02:16.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.135+0000 7f8ffaeff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:16.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.139+0000 7f8eaefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:16.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8ffaeff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:16.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8ffaeff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:16.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8ffaeff9c0 5 note: GC not initialized 2024-09-12T18:02:16.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8eadfe3640 20 reqs_thread_entry: start 2024-09-12T18:02:16.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8ffaeff9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:16.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8ffaeff9c0 20 Filter name: none 2024-09-12T18:02:16.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8e1f7fe640 20 reqs_thread_entry: start 2024-09-12T18:02:16.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8ffaeff9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:16.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8ffaeff9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:16.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8ffaeff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:16.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.143+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.147+0000 7f8ffaeff9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:16.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.147+0000 7f8ffaeff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.147+0000 7f8ffaeff9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:16.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.147+0000 7f8ffaeff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:16.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.151+0000 7f8eaefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:16.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.155+0000 7f8ffaeff9c0 20 remove_watcher() i=0 2024-09-12T18:02:16.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.155+0000 7f8ffaeff9c0 2 removed watcher, disabling cache 2024-09-12T18:02:16.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.159+0000 7f8ffaeff9c0 20 remove_watcher() i=1 2024-09-12T18:02:16.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.159+0000 7f8ffaeff9c0 20 remove_watcher() i=2 2024-09-12T18:02:16.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.163+0000 7f8ffaeff9c0 20 remove_watcher() i=3 2024-09-12T18:02:16.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.163+0000 7f8ffaeff9c0 20 remove_watcher() i=4 2024-09-12T18:02:16.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.167+0000 7f8ffaeff9c0 20 remove_watcher() i=5 2024-09-12T18:02:16.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.171+0000 7f8ffaeff9c0 20 remove_watcher() i=6 2024-09-12T18:02:16.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.171+0000 7f8ffaeff9c0 20 remove_watcher() i=7 2024-09-12T18:02:16.188 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:16.188 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:16.188 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-init-index id: 98539659-fdaf-41ce-847d-239ff89323af.4641.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:02:16.188 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:16.190 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:16.190 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:16.247 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:16.247 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:16.331 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:02:16.367 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:16.367 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:16.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.411+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.415+0000 7f179f5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.415+0000 7f179f5099c0 20 realm 2024-09-12T18:02:16.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.415+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.415+0000 7f179f5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.415+0000 7f179f5099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:16.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.415+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.415+0000 7f179f5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.415+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.415+0000 7f179f5099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:16.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.415+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.419+0000 7f179f5099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:16.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.419+0000 7f179f5099c0 20 searching for the correct realm 2024-09-12T18:02:16.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.423+0000 7f179c80e640 0 -- 172.21.15.97:0/1264516705 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f17940d9910 msgr2=0x7f17940ca3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:16.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.635+0000 7f179c80e640 0 -- 172.21.15.97:0/1264516705 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55de423c6830 msgr2=0x55de423c8cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:16.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.647+0000 7f179f5099c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:16.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.647+0000 7f179f5099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:16.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.647+0000 7f179f5099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:16.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.647+0000 7f179f5099c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:16.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.647+0000 7f179f5099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:16.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.647+0000 7f179f5099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:16.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.647+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.647+0000 7f179f5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.647+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.647+0000 7f179f5099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:16.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.647+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:16.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 20 zone default found 2024-09-12T18:02:16.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 4 Realm: () 2024-09-12T18:02:16.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:16.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:16.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:16.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 20 zonegroup default 2024-09-12T18:02:16.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 20 started sync module instance, tier type = 2024-09-12T18:02:16.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.651+0000 7f179f5099c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:16.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.675+0000 7f179f5099c0 20 add_watcher() i=0 2024-09-12T18:02:16.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.675+0000 7f179f5099c0 20 add_watcher() i=1 2024-09-12T18:02:16.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.675+0000 7f179f5099c0 20 add_watcher() i=2 2024-09-12T18:02:16.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.675+0000 7f179f5099c0 20 add_watcher() i=3 2024-09-12T18:02:16.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.675+0000 7f179f5099c0 20 add_watcher() i=4 2024-09-12T18:02:16.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.675+0000 7f179f5099c0 20 add_watcher() i=5 2024-09-12T18:02:16.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.675+0000 7f179f5099c0 20 add_watcher() i=6 2024-09-12T18:02:16.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.679+0000 7f179f5099c0 20 add_watcher() i=7 2024-09-12T18:02:16.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.679+0000 7f179f5099c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:16.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.683+0000 7f16537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:16.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.683+0000 7f179f5099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:16.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.683+0000 7f179f5099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:16.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.683+0000 7f179f5099c0 5 note: GC not initialized 2024-09-12T18:02:16.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.683+0000 7f16527e4640 20 reqs_thread_entry: start 2024-09-12T18:02:16.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.683+0000 7f179f5099c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:16.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.683+0000 7f179f5099c0 20 Filter name: none 2024-09-12T18:02:16.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.683+0000 7f15c3fff640 20 reqs_thread_entry: start 2024-09-12T18:02:16.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.683+0000 7f179f5099c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T18:02:16.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.683+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.687+0000 7f179f5099c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:16.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.687+0000 7f179f5099c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T18:02:16.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.687+0000 7f179f5099c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T18:02:16.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.687+0000 7f179f5099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 : miss 2024-09-12T18:02:16.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.687+0000 7f179f5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.687+0000 7f179f5099c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:16.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.687+0000 7f179f5099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 info.flags=0x17 2024-09-12T18:02:16.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.687+0000 7f179f5099c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 to cache LRU end 2024-09-12T18:02:16.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.687+0000 7f179f5099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:16.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.687+0000 7f179f5099c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:16.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.687+0000 7f179f5099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 2024-09-12T18:02:16.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.695+0000 7f179f5099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 info.flags=0x17 2024-09-12T18:02:16.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.695+0000 7f179f5099c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 to cache LRU end 2024-09-12T18:02:16.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.695+0000 7f179f5099c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:16.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.695+0000 7f179f5099c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19, ofs0, ns] 2024-09-12T18:02:16.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.699+0000 7f1680ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94413082406288 notifier 5915 bl.length()=911 2024-09-12T18:02:16.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.699+0000 7f1680ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 info.flags=0x17 2024-09-12T18:02:16.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.699+0000 7f1680ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 to cache LRU end 2024-09-12T18:02:16.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.699+0000 7f1680ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:16.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.699+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): orig_sources= new_sources= 2024-09-12T18:02:16.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.699+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): potential sources added=[] removed=[] 2024-09-12T18:02:16.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.699+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): orig_dests= new_dests= 2024-09-12T18:02:16.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.699+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): potential dests added=[] removed=[] 2024-09-12T18:02:16.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.0 2024-09-12T18:02:16.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.0 2024-09-12T18:02:16.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.1 2024-09-12T18:02:16.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.1 2024-09-12T18:02:16.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.2 2024-09-12T18:02:16.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.2 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.3 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.3 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.4 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.4 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.5 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.5 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.6 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.6 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.7 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.7 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.8 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.8 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.9 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.9 2024-09-12T18:02:16.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.10 2024-09-12T18:02:16.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.10 2024-09-12T18:02:16.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.11 2024-09-12T18:02:16.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1.11 2024-09-12T18:02:16.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.0 2024-09-12T18:02:16.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1 2024-09-12T18:02:16.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.2 2024-09-12T18:02:16.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.3 2024-09-12T18:02:16.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.4 2024-09-12T18:02:16.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.711+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.5 2024-09-12T18:02:16.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.715+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.6 2024-09-12T18:02:16.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.715+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.7 2024-09-12T18:02:16.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.715+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.8 2024-09-12T18:02:16.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.719+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.9 2024-09-12T18:02:16.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.719+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.10 2024-09-12T18:02:16.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.727+0000 7f179f5099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:16.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.727+0000 7f179f5099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 2024-09-12T18:02:16.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.727+0000 7f179f5099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 info.flags=0x17 2024-09-12T18:02:16.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.727+0000 7f179f5099c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 to cache LRU end 2024-09-12T18:02:16.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.727+0000 7f179f5099c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:16.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.727+0000 7f179f5099c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19, ofs0, ns] 2024-09-12T18:02:16.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.731+0000 7f1680ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94413082406288 notifier 5915 bl.length()=911 2024-09-12T18:02:16.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.731+0000 7f1680ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 info.flags=0x17 2024-09-12T18:02:16.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.731+0000 7f1680ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 to cache LRU end 2024-09-12T18:02:16.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.731+0000 7f1680ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:16.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.731+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): orig_sources= new_sources= 2024-09-12T18:02:16.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.731+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): potential sources added=[] removed=[] 2024-09-12T18:02:16.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.731+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): orig_dests= new_dests= 2024-09-12T18:02:16.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.731+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): potential dests added=[] removed=[] 2024-09-12T18:02:16.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.739+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.0 2024-09-12T18:02:16.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.739+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.1 2024-09-12T18:02:16.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.739+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.2 2024-09-12T18:02:16.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.739+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.3 2024-09-12T18:02:16.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.739+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.4 2024-09-12T18:02:16.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.743+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.5 2024-09-12T18:02:16.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.743+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.6 2024-09-12T18:02:16.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.743+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.7 2024-09-12T18:02:16.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.743+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.8 2024-09-12T18:02:16.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.743+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.9 2024-09-12T18:02:16.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.747+0000 7f179f5099c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.19.10 2024-09-12T18:02:16.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.747+0000 7f179f5099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:16.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.747+0000 7f179f5099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 2024-09-12T18:02:16.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.747+0000 7f179f5099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 info.flags=0x17 2024-09-12T18:02:16.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.747+0000 7f179f5099c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 to cache LRU end 2024-09-12T18:02:16.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.747+0000 7f179f5099c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:16.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.747+0000 7f179f5099c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19, ofs0, ns] 2024-09-12T18:02:16.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.747+0000 7f1680ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94413082406288 notifier 5915 bl.length()=879 2024-09-12T18:02:16.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.747+0000 7f1680ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 info.flags=0x17 2024-09-12T18:02:16.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.747+0000 7f1680ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.19 to cache LRU end 2024-09-12T18:02:16.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.747+0000 7f1680ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:16.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.751+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): orig_sources= new_sources= 2024-09-12T18:02:16.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.751+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): potential sources added=[] removed=[] 2024-09-12T18:02:16.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.751+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): orig_dests= new_dests= 2024-09-12T18:02:16.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.751+0000 7f179f5099c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.19]): potential dests added=[] removed=[] 2024-09-12T18:02:16.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.755+0000 7f179f5099c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T18:02:16.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.759+0000 7f16537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:16.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.763+0000 7f179f5099c0 20 remove_watcher() i=0 2024-09-12T18:02:16.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.763+0000 7f179f5099c0 2 removed watcher, disabling cache 2024-09-12T18:02:16.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.763+0000 7f179f5099c0 20 remove_watcher() i=1 2024-09-12T18:02:16.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.767+0000 7f179f5099c0 20 remove_watcher() i=2 2024-09-12T18:02:16.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.771+0000 7f179f5099c0 20 remove_watcher() i=3 2024-09-12T18:02:16.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.771+0000 7f179f5099c0 20 remove_watcher() i=4 2024-09-12T18:02:16.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.775+0000 7f179f5099c0 20 remove_watcher() i=5 2024-09-12T18:02:16.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.775+0000 7f179f5099c0 20 remove_watcher() i=6 2024-09-12T18:02:16.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.779+0000 7f179f5099c0 20 remove_watcher() i=7 2024-09-12T18:02:16.794 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:02:16.821 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:16.822 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:16.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.867+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.867+0000 7f73b65419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.867+0000 7f73b65419c0 20 realm 2024-09-12T18:02:16.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.867+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.871+0000 7f73b65419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.871+0000 7f73b65419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:16.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.871+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.871+0000 7f73b65419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.871+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.871+0000 7f73b65419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:16.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.871+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.871+0000 7f73b65419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:16.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.871+0000 7f73b65419c0 20 searching for the correct realm 2024-09-12T18:02:16.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.879+0000 7f73b4047640 0 -- 172.21.15.97:0/1027629679 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f739c008040 msgr2=0x7f739c07c2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:16.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.883+0000 7f73b4047640 0 -- 172.21.15.97:0/1027629679 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f73ac022040 msgr2=0x7f73ac022420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:16.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:16.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:16.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:16.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:16.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:16.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:16.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:16.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:16.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 zone default found 2024-09-12T18:02:16.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 4 Realm: () 2024-09-12T18:02:16.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:16.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:16.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:16.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 zonegroup default 2024-09-12T18:02:16.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:16.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 started sync module instance, tier type = 2024-09-12T18:02:16.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.891+0000 7f73b65419c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:16.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.911+0000 7f73b65419c0 20 add_watcher() i=0 2024-09-12T18:02:16.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.911+0000 7f73b65419c0 20 add_watcher() i=1 2024-09-12T18:02:16.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.911+0000 7f73b65419c0 20 add_watcher() i=2 2024-09-12T18:02:16.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.911+0000 7f73b65419c0 20 add_watcher() i=3 2024-09-12T18:02:16.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.911+0000 7f73b65419c0 20 add_watcher() i=4 2024-09-12T18:02:16.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.911+0000 7f73b65419c0 20 add_watcher() i=5 2024-09-12T18:02:16.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.911+0000 7f73b65419c0 20 add_watcher() i=6 2024-09-12T18:02:16.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.915+0000 7f73b65419c0 20 add_watcher() i=7 2024-09-12T18:02:16.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.915+0000 7f73b65419c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:16.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f7269fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:16.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:16.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:16.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 5 note: GC not initialized 2024-09-12T18:02:16.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f7268fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:16.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:16.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 Filter name: none 2024-09-12T18:02:16.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f71e27fc640 20 reqs_thread_entry: start 2024-09-12T18:02:16.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:16.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:16.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:16.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:16.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:16.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:16.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.919+0000 7f73b65419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:16.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.923+0000 7f7269fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:16.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.927+0000 7f73b65419c0 20 remove_watcher() i=0 2024-09-12T18:02:16.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.927+0000 7f73b65419c0 2 removed watcher, disabling cache 2024-09-12T18:02:16.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.931+0000 7f73b65419c0 20 remove_watcher() i=1 2024-09-12T18:02:16.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.931+0000 7f73b65419c0 20 remove_watcher() i=2 2024-09-12T18:02:16.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.935+0000 7f73b65419c0 20 remove_watcher() i=3 2024-09-12T18:02:16.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.935+0000 7f73b65419c0 20 remove_watcher() i=4 2024-09-12T18:02:16.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.939+0000 7f73b65419c0 20 remove_watcher() i=5 2024-09-12T18:02:16.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.943+0000 7f73b65419c0 20 remove_watcher() i=6 2024-09-12T18:02:16.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:16.947+0000 7f73b65419c0 20 remove_watcher() i=7 2024-09-12T18:02:16.959 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:16.960 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:16.960 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-init-index id: 98539659-fdaf-41ce-847d-239ff89323af.4641.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:02:16.960 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:16.961 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:16.961 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:16.982 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:16.982 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:17.431 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:17.810 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T18:02:17.811 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:17.812 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:17.813 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:17.944 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:18.028 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:18.029 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:18.125 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:18.125 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:18.224 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:18.224 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:18.322 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:18.322 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:18.413 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:18.413 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:18.495 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:18.495 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:18.585 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:18.585 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:18.703 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:18.703 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:18.799 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:18.799 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:18.891 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:18.892 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:18.990 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:18.990 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:19.081 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:19.081 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:19.178 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:19.178 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:19.270 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:19.270 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:19.364 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:19.364 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:19.458 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:19.458 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:19.551 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:19.551 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:19.645 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:19.645 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:19.734 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:19.734 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:19.825 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:19.825 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:19.890 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:02:19.924 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:19.924 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:19.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.971+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:19.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.975+0000 7ff5bd11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:19.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.975+0000 7ff5bd11d9c0 20 realm 2024-09-12T18:02:19.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.975+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:19.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.975+0000 7ff5bd11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:19.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.975+0000 7ff5bd11d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:19.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.975+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:19.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.975+0000 7ff5bd11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:19.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.975+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:19.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.975+0000 7ff5bd11d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:19.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.975+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:19.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.979+0000 7ff5bd11d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:19.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.979+0000 7ff5bd11d9c0 20 searching for the correct realm 2024-09-12T18:02:19.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.983+0000 7ff5ba422640 0 -- 172.21.15.97:0/3084955037 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7ff5a407e070 msgr2=0x7ff5a40129f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:19.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.987+0000 7ff5bac23640 0 -- 172.21.15.97:0/3084955037 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7ff5b40ed040 msgr2=0x7ff5b40bd950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:19.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.995+0000 7ff5bd11d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:19.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.995+0000 7ff5bd11d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:19.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.995+0000 7ff5bd11d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:19.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.995+0000 7ff5bd11d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:19.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.995+0000 7ff5bd11d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:19.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.995+0000 7ff5bd11d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:19.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.995+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:19.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.995+0000 7ff5bd11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:19.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.995+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:19.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.995+0000 7ff5bd11d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:19.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.995+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:19.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:19.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 20 zone default found 2024-09-12T18:02:19.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 4 Realm: () 2024-09-12T18:02:19.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:19.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:19.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:19.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 20 zonegroup default 2024-09-12T18:02:19.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:19.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:19.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:19.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:19.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:19.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:19.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 20 started sync module instance, tier type = 2024-09-12T18:02:19.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:19.999+0000 7ff5bd11d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:20.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.023+0000 7ff5bd11d9c0 20 add_watcher() i=0 2024-09-12T18:02:20.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.023+0000 7ff5bd11d9c0 20 add_watcher() i=1 2024-09-12T18:02:20.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.023+0000 7ff5bd11d9c0 20 add_watcher() i=2 2024-09-12T18:02:20.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.023+0000 7ff5bd11d9c0 20 add_watcher() i=3 2024-09-12T18:02:20.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.023+0000 7ff5bd11d9c0 20 add_watcher() i=4 2024-09-12T18:02:20.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.023+0000 7ff5bd11d9c0 20 add_watcher() i=5 2024-09-12T18:02:20.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.023+0000 7ff5bd11d9c0 20 add_watcher() i=6 2024-09-12T18:02:20.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.023+0000 7ff5bd11d9c0 20 add_watcher() i=7 2024-09-12T18:02:20.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.023+0000 7ff5bd11d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:20.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.027+0000 7ff4717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:20.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:20.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:20.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 5 note: GC not initialized 2024-09-12T18:02:20.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff3ebfff640 20 reqs_thread_entry: start 2024-09-12T18:02:20.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:20.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 Filter name: none 2024-09-12T18:02:20.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff3e9ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:20.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:20.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:20.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:20.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:20.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:20.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.031+0000 7ff5bd11d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:20.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.035+0000 7ff4717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:20.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.043+0000 7ff5bd11d9c0 20 remove_watcher() i=0 2024-09-12T18:02:20.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.043+0000 7ff5bd11d9c0 2 removed watcher, disabling cache 2024-09-12T18:02:20.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.047+0000 7ff5bd11d9c0 20 remove_watcher() i=1 2024-09-12T18:02:20.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.047+0000 7ff5bd11d9c0 20 remove_watcher() i=2 2024-09-12T18:02:20.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.051+0000 7ff5bd11d9c0 20 remove_watcher() i=3 2024-09-12T18:02:20.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.051+0000 7ff5bd11d9c0 20 remove_watcher() i=4 2024-09-12T18:02:20.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.055+0000 7ff5bd11d9c0 20 remove_watcher() i=5 2024-09-12T18:02:20.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.055+0000 7ff5bd11d9c0 20 remove_watcher() i=6 2024-09-12T18:02:20.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.059+0000 7ff5bd11d9c0 20 remove_watcher() i=7 2024-09-12T18:02:20.074 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:20.075 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:20.075 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-init-index id: 98539659-fdaf-41ce-847d-239ff89323af.4641.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:02:20.075 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:20.075 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T18:02:20.110 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:20.110 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:20.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.155+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.159+0000 7fce58cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.159+0000 7fce58cc29c0 20 realm 2024-09-12T18:02:20.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.159+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.159+0000 7fce58cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.159+0000 7fce58cc29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:20.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.159+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.159+0000 7fce58cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.159+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.159+0000 7fce58cc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:20.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.159+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.163+0000 7fce58cc29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:20.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.163+0000 7fce58cc29c0 20 searching for the correct realm 2024-09-12T18:02:20.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.167+0000 7fce55fc7640 0 -- 172.21.15.97:0/608707697 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fce4c051350 msgr2=0x7fce4c05b590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:20.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.175+0000 7fce55fc7640 0 -- 172.21.15.97:0/608707697 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55b98da8c4d0 msgr2=0x55b98da8e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:20.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:20.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:20.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:20.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:20.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:20.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:20.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:20.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:20.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 zone default found 2024-09-12T18:02:20.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 4 Realm: () 2024-09-12T18:02:20.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:20.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:20.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:20.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 zonegroup default 2024-09-12T18:02:20.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 started sync module instance, tier type = 2024-09-12T18:02:20.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.183+0000 7fce58cc29c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:20.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.207+0000 7fce58cc29c0 20 add_watcher() i=0 2024-09-12T18:02:20.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.207+0000 7fce58cc29c0 20 add_watcher() i=1 2024-09-12T18:02:20.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.207+0000 7fce58cc29c0 20 add_watcher() i=2 2024-09-12T18:02:20.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.207+0000 7fce58cc29c0 20 add_watcher() i=3 2024-09-12T18:02:20.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.207+0000 7fce58cc29c0 20 add_watcher() i=4 2024-09-12T18:02:20.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.207+0000 7fce58cc29c0 20 add_watcher() i=5 2024-09-12T18:02:20.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.207+0000 7fce58cc29c0 20 add_watcher() i=6 2024-09-12T18:02:20.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.211+0000 7fce58cc29c0 20 add_watcher() i=7 2024-09-12T18:02:20.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.211+0000 7fce58cc29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:20.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.211+0000 7fcd0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:20.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.211+0000 7fce58cc29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:20.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.211+0000 7fce58cc29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:20.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 5 note: GC not initialized 2024-09-12T18:02:20.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fcc877fe640 20 reqs_thread_entry: start 2024-09-12T18:02:20.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:20.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 20 Filter name: none 2024-09-12T18:02:20.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fcc857fa640 20 reqs_thread_entry: start 2024-09-12T18:02:20.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T18:02:20.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:20.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T18:02:20.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T18:02:20.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 : miss 2024-09-12T18:02:20.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:20.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 info.flags=0x17 2024-09-12T18:02:20.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 to cache LRU end 2024-09-12T18:02:20.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:20.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:20.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 2024-09-12T18:02:20.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 -1 Injecting error=-95 at location=init_index 2024-09-12T18:02:20.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.215+0000 7fce58cc29c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T18:02:20.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fce58cc29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 info.flags=0x17 2024-09-12T18:02:20.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fce58cc29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 to cache LRU end 2024-09-12T18:02:20.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fce58cc29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:20.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fce58cc29c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20, ofs0, ns] 2024-09-12T18:02:20.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fcd39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94255434010128 notifier 6324 bl.length()=911 2024-09-12T18:02:20.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fcd39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 info.flags=0x17 2024-09-12T18:02:20.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fcd39ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 to cache LRU end 2024-09-12T18:02:20.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fcd39ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:20.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fce58cc29c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.20]): orig_sources= new_sources= 2024-09-12T18:02:20.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fce58cc29c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.20]): potential sources added=[] removed=[] 2024-09-12T18:02:20.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fce58cc29c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.20]): orig_dests= new_dests= 2024-09-12T18:02:20.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.227+0000 7fce58cc29c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.20]): potential dests added=[] removed=[] 2024-09-12T18:02:20.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.0 2024-09-12T18:02:20.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.0 2024-09-12T18:02:20.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.1 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.1 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.2 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.2 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.3 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.3 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.4 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.4 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.5 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.5 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.6 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.6 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.7 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.7 2024-09-12T18:02:20.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.8 2024-09-12T18:02:20.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.8 2024-09-12T18:02:20.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.9 2024-09-12T18:02:20.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.9 2024-09-12T18:02:20.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.10 2024-09-12T18:02:20.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.10 2024-09-12T18:02:20.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.11 2024-09-12T18:02:20.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1.11 2024-09-12T18:02:20.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.0 2024-09-12T18:02:20.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.1 2024-09-12T18:02:20.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.235+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.2 2024-09-12T18:02:20.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.239+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.3 2024-09-12T18:02:20.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.239+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.4 2024-09-12T18:02:20.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.239+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.5 2024-09-12T18:02:20.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.239+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.6 2024-09-12T18:02:20.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.239+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.7 2024-09-12T18:02:20.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.243+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.8 2024-09-12T18:02:20.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.243+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.9 2024-09-12T18:02:20.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.243+0000 7fce58cc29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.20.10 2024-09-12T18:02:20.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.251+0000 7fce58cc29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:20.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.251+0000 7fce58cc29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 2024-09-12T18:02:20.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fce58cc29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 info.flags=0x17 2024-09-12T18:02:20.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fce58cc29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 to cache LRU end 2024-09-12T18:02:20.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fce58cc29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:20.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fce58cc29c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20, ofs0, ns] 2024-09-12T18:02:20.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fcd39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94255434010128 notifier 6324 bl.length()=879 2024-09-12T18:02:20.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fcd39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 info.flags=0x17 2024-09-12T18:02:20.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fcd39ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:98539659-fdaf-41ce-847d-239ff89323af.4641.20 to cache LRU end 2024-09-12T18:02:20.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fcd39ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:20.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fce58cc29c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.20]): orig_sources= new_sources= 2024-09-12T18:02:20.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fce58cc29c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.20]): potential sources added=[] removed=[] 2024-09-12T18:02:20.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fce58cc29c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.20]): orig_dests= new_dests= 2024-09-12T18:02:20.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.255+0000 7fce58cc29c0 20 handle_bi_update(): bucket=:error-at-init-index[98539659-fdaf-41ce-847d-239ff89323af.4641.20]): potential dests added=[] removed=[] 2024-09-12T18:02:20.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.263+0000 7fce58cc29c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T18:02:20.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.263+0000 7fcd0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:20.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.267+0000 7fce58cc29c0 20 remove_watcher() i=0 2024-09-12T18:02:20.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.267+0000 7fce58cc29c0 2 removed watcher, disabling cache 2024-09-12T18:02:20.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.271+0000 7fce58cc29c0 20 remove_watcher() i=1 2024-09-12T18:02:20.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.271+0000 7fce58cc29c0 20 remove_watcher() i=2 2024-09-12T18:02:20.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.275+0000 7fce58cc29c0 20 remove_watcher() i=3 2024-09-12T18:02:20.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.275+0000 7fce58cc29c0 20 remove_watcher() i=4 2024-09-12T18:02:20.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.279+0000 7fce58cc29c0 20 remove_watcher() i=5 2024-09-12T18:02:20.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.279+0000 7fce58cc29c0 20 remove_watcher() i=6 2024-09-12T18:02:20.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.283+0000 7fce58cc29c0 20 remove_watcher() i=7 2024-09-12T18:02:20.298 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:02:20.326 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:20.326 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:20.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.371+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.375+0000 7f17ec5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.375+0000 7f17ec5059c0 20 realm 2024-09-12T18:02:20.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.375+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.375+0000 7f17ec5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.375+0000 7f17ec5059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:20.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.375+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.375+0000 7f17ec5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.375+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.375+0000 7f17ec5059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:20.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.375+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.379+0000 7f17ec5059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:20.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.379+0000 7f17ec5059c0 20 searching for the correct realm 2024-09-12T18:02:20.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.383+0000 7f17e980a640 0 -- 172.21.15.97:0/2508396664 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f17e0045920 msgr2=0x7f17e003a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:20.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.387+0000 7f17ea80c640 0 -- 172.21.15.97:0/2508396664 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x56387bf441c0 msgr2=0x56387bf46610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:20.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.607+0000 7f17ec5059c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:20.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.607+0000 7f17ec5059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:20.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.607+0000 7f17ec5059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:20.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.607+0000 7f17ec5059c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:20.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.607+0000 7f17ec5059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:20.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.607+0000 7f17ec5059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:20.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.607+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.607+0000 7f17ec5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.607+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.607+0000 7f17ec5059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:20.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.607+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:20.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 20 zone default found 2024-09-12T18:02:20.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 4 Realm: () 2024-09-12T18:02:20.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:20.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:20.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:20.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 20 zonegroup default 2024-09-12T18:02:20.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:20.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 20 started sync module instance, tier type = 2024-09-12T18:02:20.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.611+0000 7f17ec5059c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:20.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.635+0000 7f17ec5059c0 20 add_watcher() i=0 2024-09-12T18:02:20.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.635+0000 7f17ec5059c0 20 add_watcher() i=1 2024-09-12T18:02:20.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.635+0000 7f17ec5059c0 20 add_watcher() i=2 2024-09-12T18:02:20.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.635+0000 7f17ec5059c0 20 add_watcher() i=3 2024-09-12T18:02:20.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.635+0000 7f17ec5059c0 20 add_watcher() i=4 2024-09-12T18:02:20.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.635+0000 7f17ec5059c0 20 add_watcher() i=5 2024-09-12T18:02:20.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.635+0000 7f17ec5059c0 20 add_watcher() i=6 2024-09-12T18:02:20.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.639+0000 7f17ec5059c0 20 add_watcher() i=7 2024-09-12T18:02:20.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.639+0000 7f17ec5059c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:20.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.643+0000 7f16a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:20.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.643+0000 7f17ec5059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:20.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.643+0000 7f17ec5059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:20.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.643+0000 7f17ec5059c0 5 note: GC not initialized 2024-09-12T18:02:20.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.643+0000 7f161b7fe640 20 reqs_thread_entry: start 2024-09-12T18:02:20.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.643+0000 7f17ec5059c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:20.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f17ec5059c0 20 Filter name: none 2024-09-12T18:02:20.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f16197fa640 20 reqs_thread_entry: start 2024-09-12T18:02:20.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f17ec5059c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:20.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f17ec5059c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:20.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f17ec5059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:20.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f17ec5059c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:02:20.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f17ec5059c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:20.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f17ec5059c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:02:20.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.647+0000 7f17ec5059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:20.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.651+0000 7f16a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:20.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.655+0000 7f17ec5059c0 20 remove_watcher() i=0 2024-09-12T18:02:20.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.655+0000 7f17ec5059c0 2 removed watcher, disabling cache 2024-09-12T18:02:20.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.659+0000 7f17ec5059c0 20 remove_watcher() i=1 2024-09-12T18:02:20.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.659+0000 7f17ec5059c0 20 remove_watcher() i=2 2024-09-12T18:02:20.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.663+0000 7f17ec5059c0 20 remove_watcher() i=3 2024-09-12T18:02:20.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.663+0000 7f17ec5059c0 20 remove_watcher() i=4 2024-09-12T18:02:20.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.667+0000 7f17ec5059c0 20 remove_watcher() i=5 2024-09-12T18:02:20.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.667+0000 7f17ec5059c0 20 remove_watcher() i=6 2024-09-12T18:02:20.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:20.671+0000 7f17ec5059c0 20 remove_watcher() i=7 2024-09-12T18:02:20.687 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:20.687 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:20.687 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-init-index id: 98539659-fdaf-41ce-847d-239ff89323af.4641.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T18:02:20.687 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:20.688 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:20.689 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:20.714 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:20.714 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:21.291 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:21.291 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:21.659 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T18:02:21.659 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:21.662 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:21.663 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:21.790 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:21.790 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:21.877 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:21.980 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:21.981 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:22.078 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:22.078 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:22.174 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:22.174 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:22.274 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:22.274 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:22.361 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:22.361 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:22.460 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:22.460 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:22.555 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:22.555 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:22.653 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:22.653 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:22.751 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:22.752 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:22.850 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:22.850 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:22.948 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:22.948 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:23.038 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:23.038 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:23.131 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:23.131 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:23.229 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:23.229 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:23.322 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:23.322 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:23.422 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:23.422 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:23.518 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:23.519 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:23.617 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:23.617 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:23.722 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:23.813 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T18:02:23.847 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:23.847 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:23.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.891+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.895+0000 7fcdf52bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:23.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.895+0000 7fcdf52bd9c0 20 realm 2024-09-12T18:02:23.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.895+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.895+0000 7fcdf52bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:23.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.895+0000 7fcdf52bd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:23.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.895+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.895+0000 7fcdf52bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:23.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.895+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.899+0000 7fcdf52bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:23.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.899+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.899+0000 7fcdf52bd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:23.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.899+0000 7fcdf52bd9c0 20 searching for the correct realm 2024-09-12T18:02:23.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.903+0000 7fcdf35c4640 0 -- 172.21.15.97:0/2058108417 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fcde80de410 msgr2=0x7fcde80de890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:23.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.911+0000 7fcdf2dc3640 0 -- 172.21.15.97:0/2058108417 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fcdec060fd0 msgr2=0x7fcdec05fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:23.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.915+0000 7fcdf52bd9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:23.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.915+0000 7fcdf52bd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:23.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.915+0000 7fcdf52bd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:23.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.915+0000 7fcdf52bd9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:23.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.915+0000 7fcdf52bd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:23.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.915+0000 7fcdf52bd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:23.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.915+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:23.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:23.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:23.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 zone default found 2024-09-12T18:02:23.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 4 Realm: () 2024-09-12T18:02:23.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:23.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:23.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:23.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 zonegroup default 2024-09-12T18:02:23.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:23.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:23.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:23.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 started sync module instance, tier type = 2024-09-12T18:02:23.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.919+0000 7fcdf52bd9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:23.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.939+0000 7fcdf52bd9c0 20 add_watcher() i=0 2024-09-12T18:02:23.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.939+0000 7fcdf52bd9c0 20 add_watcher() i=1 2024-09-12T18:02:23.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.939+0000 7fcdf52bd9c0 20 add_watcher() i=2 2024-09-12T18:02:23.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.939+0000 7fcdf52bd9c0 20 add_watcher() i=3 2024-09-12T18:02:23.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.939+0000 7fcdf52bd9c0 20 add_watcher() i=4 2024-09-12T18:02:23.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.939+0000 7fcdf52bd9c0 20 add_watcher() i=5 2024-09-12T18:02:23.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.939+0000 7fcdf52bd9c0 20 add_watcher() i=6 2024-09-12T18:02:23.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.939+0000 7fcdf52bd9c0 20 add_watcher() i=7 2024-09-12T18:02:23.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.939+0000 7fcdf52bd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:23.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.943+0000 7fcca97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:23.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.943+0000 7fcdf52bd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:23.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.943+0000 7fcdf52bd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:23.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.943+0000 7fcdf52bd9c0 5 note: GC not initialized 2024-09-12T18:02:23.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.943+0000 7fcc23fff640 20 reqs_thread_entry: start 2024-09-12T18:02:23.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.943+0000 7fcdf52bd9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:23.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcdf52bd9c0 20 Filter name: none 2024-09-12T18:02:23.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcc21ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:23.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcdf52bd9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:23.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcdf52bd9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:23.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcdf52bd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:23.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcdf52bd9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:23.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcdf52bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcdf52bd9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.947+0000 7fcdf52bd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:23.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.951+0000 7fcca97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:23.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.955+0000 7fcdf52bd9c0 20 remove_watcher() i=0 2024-09-12T18:02:23.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.955+0000 7fcdf52bd9c0 2 removed watcher, disabling cache 2024-09-12T18:02:23.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.959+0000 7fcdf52bd9c0 20 remove_watcher() i=1 2024-09-12T18:02:23.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.959+0000 7fcdf52bd9c0 20 remove_watcher() i=2 2024-09-12T18:02:23.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.959+0000 7fcdf52bd9c0 20 remove_watcher() i=3 2024-09-12T18:02:23.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.963+0000 7fcdf52bd9c0 20 remove_watcher() i=4 2024-09-12T18:02:23.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.963+0000 7fcdf52bd9c0 20 remove_watcher() i=5 2024-09-12T18:02:23.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.967+0000 7fcdf52bd9c0 20 remove_watcher() i=6 2024-09-12T18:02:23.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:23.971+0000 7fcdf52bd9c0 20 remove_watcher() i=7 2024-09-12T18:02:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-init-indext id: 98539659-fdaf-41ce-847d-239ff89323af.4641.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:02:23.984 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T18:02:24.016 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:24.016 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:24.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.059+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.063+0000 7fabacde89c0 20 realm 2024-09-12T18:02:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.063+0000 7fabacde89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:24.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.067+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:24.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.067+0000 7fabacde89c0 20 searching for the correct realm 2024-09-12T18:02:24.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.071+0000 7fabab0ef640 0 -- 172.21.15.97:0/3161527387 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7faba0043060 msgr2=0x7faba009e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:24.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.075+0000 7fabaa8ee640 0 -- 172.21.15.97:0/3161527387 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fab9c01a040 msgr2=0x7fab9c05d270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:24.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:24.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 zone default found 2024-09-12T18:02:24.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 4 Realm: () 2024-09-12T18:02:24.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:24.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:24.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:24.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 zonegroup default 2024-09-12T18:02:24.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.087+0000 7fabacde89c0 20 started sync module instance, tier type = 2024-09-12T18:02:24.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.087+0000 7fabacde89c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=0 2024-09-12T18:02:24.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=1 2024-09-12T18:02:24.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=2 2024-09-12T18:02:24.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=3 2024-09-12T18:02:24.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=4 2024-09-12T18:02:24.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=5 2024-09-12T18:02:24.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=6 2024-09-12T18:02:24.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.107+0000 7fabacde89c0 20 add_watcher() i=7 2024-09-12T18:02:24.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.107+0000 7fabacde89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:24.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7faa61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:24.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:24.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:24.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 5 note: GC not initialized 2024-09-12T18:02:24.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7faa60fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:24.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:24.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 20 Filter name: none 2024-09-12T18:02:24.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7faa59ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:24.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:02:24.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:24.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:02:24.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:02:24.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 : miss 2024-09-12T18:02:24.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:24.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 info.flags=0x17 2024-09-12T18:02:24.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to cache LRU end 2024-09-12T18:02:24.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:24.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:24.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.111+0000 7fabacde89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 2024-09-12T18:02:24.114 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fabacde89c0 time 2024-09-12T18:02:24.117698+0000 2024-09-12T18:02:24.114 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:24.116 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:24.116 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fabb06c22eb] 2024-09-12T18:02:24.116 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabb06c249f] 2024-09-12T18:02:24.116 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4e7fc60c1] 2024-09-12T18:02:24.116 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x140f572) [0x55e4e8a1b572] 2024-09-12T18:02:24.116 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e4e7fd818d] 2024-09-12T18:02:24.116 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:02:24.116 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabaf528d90] 2024-09-12T18:02:24.116 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:02:24.116 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:02:24.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.115+0000 7fabacde89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fabacde89c0 time 2024-09-12T18:02:24.117698+0000 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fabb06c22eb] 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabb06c249f] 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4e7fc60c1] 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x140f572) [0x55e4e8a1b572] 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e4e7fd818d] 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabaf528d90] 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:02:24.117 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.118 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:02:24.118 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fabacde89c0 thread_name:radosgw-admin 2024-09-12T18:02:24.136 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:24.136 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fabaf541520] 2024-09-12T18:02:24.136 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:02:24.136 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fabb06c2345] 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabb06c249f] 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4e7fc60c1] 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x140f572) [0x55e4e8a1b572] 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e4e7fd818d] 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabaf528d90] 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.119+0000 7fabacde89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:24.137 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fabacde89c0 thread_name:radosgw-admin 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fabaf541520] 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fabb06c2345] 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabb06c249f] 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4e7fc60c1] 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x140f572) [0x55e4e8a1b572] 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e4e7fd818d] 2024-09-12T18:02:24.138 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabaf528d90] 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): get_auth_request con 0x55e4ea9bcbb0 auth_method 0 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): get_auth_request con 0x55e4ea9046a0 auth_method 0 2024-09-12T18:02:24.139 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): handle_auth_done global_id 6005 payload 274 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient: _finish_hunting 0 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:02:24.039+0000 7fabab0ef640 1 monclient: found mon.noname-c 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.140 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: dump: 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.141 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: _finish_auth 0 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: _check_auth_tickets 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 monclient: authenticate success, global_id 6005 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:02:24.039+0000 7fabacde89c0 4 set_mon_vals no callback set 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: dump: 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.142 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: shutdown 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) unregister_commands rotate-key 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: build_initial_monmap 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: monmap: 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:02:24.143 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding auth protocol: cephx 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding auth protocol: cephx 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding auth protocol: cephx 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.144 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:02:24.039+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 librados: starting msgr at 2024-09-12T18:02:24.145 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 librados: starting objecter 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command objecter_requests hook 0x55e4ea895970 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 librados: setting wanted keys 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 librados: calling monclient init 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: init 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding auth protocol: cephx 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding auth protocol: cephx 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding auth protocol: cephx 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.146 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:02:24.039+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:02:24.039+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command rotate-key hook 0x55e4eaa772c8 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-b con 0x55e4ea9046a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-c con 0x55e4ea92fb30 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:02:24.147 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-a con 0x55e4ea9bcbb0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): authenticate will time out at 2573.450533s 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request con 0x55e4ea92fb30 auth_method 0 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): get_auth_request con 0x55e4ea9bcbb0 auth_method 0 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.148 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): handle_auth_done global_id 6372 payload 824 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient: _finish_hunting 0 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:02:24.039+0000 7fabab0ef640 1 monclient: found mon.noname-a 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:02:24.039+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x55e4ea9046a0 auth_method 0 2024-09-12T18:02:24.149 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: dump: 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.150 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: _finish_auth 0 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: _check_auth_tickets 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: dump: 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.151 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:02:24.039+0000 7faa98e09640 4 set_mon_vals no callback set 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 monclient: authenticate success, global_id 6372 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 librados: init done 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:02:24.043+0000 7faa97606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:02:24.043+0000 7faa97606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:02:24.043+0000 7faa97606640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:02:24.043+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x7faa90070b10 auth_method 0 2024-09-12T18:02:24.152 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:02:24.043+0000 7fabaa0ed640 10 monclient: get_auth_request con 0x55e4eaab6a50 auth_method 0 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:02:24.047+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x55e4eaac19f0 auth_method 0 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:02:24.047+0000 7fabaa0ed640 10 monclient: get_auth_request con 0x55e4eaac5d50 auth_method 0 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:02:24.047+0000 7fabacde89c0 10 monclient: build_initial_monmap 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:02:24.047+0000 7fabacde89c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:02:24.047+0000 7fabacde89c0 10 monclient: monmap: 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:02:24.153 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding auth protocol: cephx 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding auth protocol: cephx 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding auth protocol: cephx 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.154 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:02:24.051+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e4eaace570 EEXIST 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: init 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding auth protocol: cephx 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding auth protocol: cephx 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding auth protocol: cephx 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.155 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:02:24.051+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:02:24.051+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.156 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command rotate-key cmddesc rotate-key hook 0x55e4eaac9360 EEXIST 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-a con 0x55e4eaaf2720 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-c con 0x55e4eaaf2050 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-b con 0x55e4eaaf0a30 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): authenticate will time out at 2573.460929s 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): get_auth_request con 0x55e4eaaf2720 auth_method 0 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.157 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request con 0x55e4eaaf2050 auth_method 0 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:02:24.051+0000 7fabab0ef640 10 monclient(hunting): get_auth_request con 0x55e4eaaf0a30 auth_method 0 2024-09-12T18:02:24.158 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:02:24.051+0000 7fabab0ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:02:24.051+0000 7fabab0ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:02:24.051+0000 7fabab0ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_done global_id 6375 payload 824 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient: _finish_hunting 0 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 1 monclient: found mon.noname-a 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: dump: 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.159 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: _finish_auth 0 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: _check_auth_tickets 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: dump: 2024-09-12T18:02:24.160 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 monclient: authenticate success, global_id 6375 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:02:24.051+0000 7fabab8f0640 4 set_mon_vals no callback set 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.161 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:02:24.051+0000 7faa94e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:02:24.051+0000 7faa94e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:02:24.051+0000 7faa94e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient: get_auth_request con 0x7faa84070a20 auth_method 0 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: get_monmap_and_config 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: build_initial_monmap 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: monmap: 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:02:24.162 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding auth protocol: cephx 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding auth protocol: cephx 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding auth protocol: cephx 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.163 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: init 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding auth protocol: cephx 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding auth protocol: cephx 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding auth protocol: cephx 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.164 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdc634f6f8 EEXIST 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:24.165 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-b con 0x55e4eab40660 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-a con 0x55e4eab40a40 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-c con 0x55e4eab41f00 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): authenticate will time out at 2573.465128s 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): get_auth_request con 0x55e4eab41f00 auth_method 0 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request con 0x55e4eab40a40 auth_method 0 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.166 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_done global_id 6014 payload 274 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient: _finish_hunting 0 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:02:24.055+0000 7fabab0ef640 1 monclient: found mon.noname-c 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:24.167 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: dump: 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:02:24.168 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 monclient: authenticate success, global_id 6014 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:02:24.055+0000 7fabacde89c0 4 set_mon_vals no callback set 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: dump: 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.169 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: shutdown 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: build_initial_monmap 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: monmap: 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:02:24.170 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding auth protocol: cephx 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding auth protocol: cephx 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding auth protocol: cephx 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.171 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 librados: starting msgr at 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 librados: starting objecter 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e4eab148d0 EEXIST 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 librados: setting wanted keys 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 librados: calling monclient init 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: init 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding auth protocol: cephx 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding auth protocol: cephx 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding auth protocol: cephx 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.172 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.173 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command rotate-key cmddesc rotate-key hook 0x55e4eaaf4688 EEXIST 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-b con 0x55e4eab40660 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-c con 0x55e4eab41f00 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-a con 0x55e4eab31c90 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): authenticate will time out at 2573.467703s 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request con 0x55e4eab41f00 auth_method 0 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.174 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): get_auth_request con 0x55e4eab31c90 auth_method 0 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:02:24.059+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_done global_id 6017 payload 824 2024-09-12T18:02:24.175 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:02:24.059+0000 7fabaa0ed640 10 monclient: _finish_hunting 0 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:02:24.059+0000 7fabaa0ed640 1 monclient: found mon.noname-c 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:02:24.059+0000 7fabaa0ed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: dump: 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.176 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: _finish_auth 0 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: _check_auth_tickets 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: dump: 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.177 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:02:24.059+0000 7faa8e7fc640 4 set_mon_vals no callback set 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:02:24.059+0000 7fabacde89c0 5 monclient: authenticate success, global_id 6017 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:02:24.059+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:02:24.059+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:02:24.059+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:02:24.059+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:02:24.059+0000 7fabacde89c0 1 librados: init done 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:02:24.059+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command cr dump hook 0x55e4eab348a8 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:02:24.059+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.178 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:02:24.059+0000 7faa8cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:02:24.059+0000 7faa8cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:02:24.059+0000 7faa8cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:02:24.059+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x7faa74070b10 auth_method 0 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:02:24.059+0000 7fabab0ef640 10 monclient: get_auth_request con 0x55e4eab60770 auth_method 0 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 realm 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:02:24.063+0000 7fabacde89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:02:24.063+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x55e4eab64840 auth_method 0 2024-09-12T18:02:24.179 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:02:24.063+0000 7fabaa0ed640 10 monclient: get_auth_request con 0x55e4eab68110 auth_method 0 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:02:24.067+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:02:24.067+0000 7fabacde89c0 20 searching for the correct realm 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:02:24.067+0000 7fabab0ef640 10 monclient: get_auth_request con 0x7faba0043060 auth_method 0 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:02:24.067+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x7faba40dc060 auth_method 0 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:02:24.071+0000 7fabaa0ed640 10 monclient: get_auth_request con 0x7faba0030040 auth_method 0 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:02:24.071+0000 7fabab0ef640 0 -- 172.21.15.97:0/3161527387 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7faba0043060 msgr2=0x7faba009e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:02:24.071+0000 7faa8cff9640 1 client.6017.objecter ms_handle_reset 0x7faba0043060 session 0x7faba0027070 osd.2 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:02:24.071+0000 7faa8cff9640 10 monclient: _renew_subs 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:02:24.071+0000 7faa8cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:02:24.071+0000 7fabab0ef640 10 monclient: get_auth_request con 0x7faa74080630 auth_method 0 2024-09-12T18:02:24.180 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:02:24.071+0000 7fabab0ef640 10 monclient: get_auth_request con 0x7faba4131210 auth_method 0 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:02:24.075+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x7fab9c01a040 auth_method 0 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:02:24.075+0000 7fabaa8ee640 0 -- 172.21.15.97:0/3161527387 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fab9c01a040 msgr2=0x7fab9c05d270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:02:24.075+0000 7faa8cff9640 1 client.6017.objecter ms_handle_reset 0x7fab9c01a040 session 0x7fab9c091040 osd.3 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:02:24.075+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x7faba0043060 auth_method 0 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.181 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 zone default found 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:02:24.083+0000 7fabacde89c0 4 Realm: () 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:02:24.083+0000 7fabacde89c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:02:24.083+0000 7fabacde89c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:02:24.083+0000 7fabacde89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 zonegroup default 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.182 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 started sync module instance, tier type = 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=0 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=1 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=2 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=3 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=4 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=5 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=6 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:02:24.107+0000 7fabacde89c0 20 add_watcher() i=7 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:02:24.107+0000 7fabacde89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding auth protocol: cephx 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding auth protocol: cephx 2024-09-12T18:02:24.183 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding auth protocol: cephx 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:02:24.111+0000 7faa61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.184 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:02:24.111+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command cache list hook 0x55e4eab44c60 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command cache inspect hook 0x55e4eab44c60 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command cache erase hook 0x55e4eab44c60 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command cache zap hook 0x55e4eab44c60 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 note: GC not initialized 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:02:24.111+0000 7faa60fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command sync trace show hook 0x7fab9c05abf0 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command sync trace history hook 0x7fab9c05abf0 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command sync trace active hook 0x7fab9c05abf0 2024-09-12T18:02:24.185 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command sync trace active_short hook 0x7fab9c05abf0 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 Filter name: none 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:02:24.111+0000 7faa59ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 : miss 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 info.flags=0x17 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to cache LRU end 2024-09-12T18:02:24.186 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:02:24.115+0000 7fabacde89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fabacde89c0 time 2024-09-12T18:02:24.117698+0000 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fabb06c22eb] 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabb06c249f] 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4e7fc60c1] 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x140f572) [0x55e4e8a1b572] 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e4e7fd818d] 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabaf528d90] 2024-09-12T18:02:24.187 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:02:24.119+0000 7fabacde89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fabacde89c0 thread_name:radosgw-admin 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fabaf541520] 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fabb06c2345] 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabb06c249f] 2024-09-12T18:02:24.188 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4e7fc60c1] 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x140f572) [0x55e4e8a1b572] 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e4e7fd818d] 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabaf528d90] 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:02:24.189 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:02:24.190 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:02:24.191 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:02:24.192 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:02:24.193 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:02:24.194 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:02:24.195 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa59ffb640 / http_manager 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa60fe1640 / http_manager 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa61fe3640 / rgw_dt_lg_renew 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa8cff9640 / ms_dispatch 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa8e7fc640 / io_context_pool 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa94e01640 / ms_dispatch 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa97606640 / ms_dispatch 2024-09-12T18:02:24.196 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa98e09640 / io_context_pool 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: 7fabaa0ed640 / msgr-worker-2 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: 7fabaa8ee640 / msgr-worker-1 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: 7fabab0ef640 / msgr-worker-0 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: 7fabab8f0640 / io_context_pool 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: 7fabacde89c0 / radosgw-admin 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.83325.log 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): get_auth_request con 0x55e4ea9bcbb0 auth_method 0 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.197 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): get_auth_request con 0x55e4ea9046a0 auth_method 0 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:02:24.035+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:02:24.035+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): handle_auth_done global_id 6005 payload 274 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient: _finish_hunting 0 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:02:24.039+0000 7fabab0ef640 1 monclient: found mon.noname-c 2024-09-12T18:02:24.198 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: dump: 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.199 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: _finish_auth 0 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: _check_auth_tickets 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 monclient: authenticate success, global_id 6005 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:02:24.039+0000 7fabacde89c0 4 set_mon_vals no callback set 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:02:24.039+0000 7faa98e09640 10 monclient: dump: 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.200 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: shutdown 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) unregister_commands rotate-key 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: build_initial_monmap 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: monmap: 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:02:24.201 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding auth protocol: cephx 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding auth protocol: cephx 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding auth protocol: cephx 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.202 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: crc 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa7c700) adding con mode: secure 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:02:24.039+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 librados: starting msgr at 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 librados: starting objecter 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command objecter_requests hook 0x55e4ea895970 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 librados: setting wanted keys 2024-09-12T18:02:24.203 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 librados: calling monclient init 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: init 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding auth protocol: cephx 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding auth protocol: cephx 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding auth protocol: cephx 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.204 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: crc 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaa77180) adding con mode: secure 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:02:24.039+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:02:24.039+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command rotate-key hook 0x55e4eaa772c8 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-b con 0x55e4ea9046a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-c con 0x55e4ea92fb30 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-a con 0x55e4ea9bcbb0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.205 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient(hunting): authenticate will time out at 2573.450533s 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request con 0x55e4ea92fb30 auth_method 0 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): get_auth_request con 0x55e4ea9bcbb0 auth_method 0 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:02:24.039+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.206 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient(hunting): handle_auth_done global_id 6372 payload 824 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient: _finish_hunting 0 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:02:24.039+0000 7fabab0ef640 1 monclient: found mon.noname-a 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:02:24.039+0000 7fabab0ef640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:02:24.039+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x55e4ea9046a0 auth_method 0 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: dump: 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: _finish_auth 0 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: _check_auth_tickets 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:02:24.039+0000 7faa97606640 10 monclient: dump: 2024-09-12T18:02:24.208 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:02:24.039+0000 7faa98e09640 4 set_mon_vals no callback set 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:02:24.039+0000 7fabacde89c0 5 monclient: authenticate success, global_id 6372 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.209 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:02:24.039+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:02:24.039+0000 7fabacde89c0 1 librados: init done 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:02:24.043+0000 7faa97606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:02:24.043+0000 7faa97606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:02:24.043+0000 7faa97606640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:02:24.043+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x7faa90070b10 auth_method 0 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:02:24.043+0000 7fabaa0ed640 10 monclient: get_auth_request con 0x55e4eaab6a50 auth_method 0 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:02:24.047+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x55e4eaac19f0 auth_method 0 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:02:24.047+0000 7fabaa0ed640 10 monclient: get_auth_request con 0x55e4eaac5d50 auth_method 0 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:02:24.047+0000 7fabacde89c0 10 monclient: build_initial_monmap 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:02:24.047+0000 7fabacde89c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:02:24.047+0000 7fabacde89c0 10 monclient: monmap: 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:02:24.210 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding auth protocol: cephx 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding auth protocol: cephx 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding auth protocol: cephx 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.211 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: crc 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:02:24.047+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaacab40) adding con mode: secure 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:02:24.051+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e4eaace570 EEXIST 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: init 2024-09-12T18:02:24.212 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding auth protocol: cephx 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding auth protocol: cephx 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding auth protocol: cephx 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: crc 2024-09-12T18:02:24.213 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaac9218) adding con mode: secure 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:02:24.051+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:02:24.051+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command rotate-key cmddesc rotate-key hook 0x55e4eaac9360 EEXIST 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-a con 0x55e4eaaf2720 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-c con 0x55e4eaaf2050 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-b con 0x55e4eaaf0a30 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient(hunting): authenticate will time out at 2573.460929s 2024-09-12T18:02:24.214 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): get_auth_request con 0x55e4eaaf2720 auth_method 0 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request con 0x55e4eaaf2050 auth_method 0 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.215 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:02:24.051+0000 7fabab0ef640 10 monclient(hunting): get_auth_request con 0x55e4eaaf0a30 auth_method 0 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:02:24.051+0000 7fabab0ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:02:24.051+0000 7fabab0ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:02:24.051+0000 7fabab0ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient(hunting): handle_auth_done global_id 6375 payload 824 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient: _finish_hunting 0 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 1 monclient: found mon.noname-a 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:02:24.051+0000 7fabaa8ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: dump: 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.216 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: _finish_auth 0 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: _check_auth_tickets 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:02:24.051+0000 7faa94e01640 10 monclient: dump: 2024-09-12T18:02:24.217 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:02:24.051+0000 7fabacde89c0 5 monclient: authenticate success, global_id 6375 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:02:24.051+0000 7fabab8f0640 4 set_mon_vals no callback set 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.218 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:02:24.051+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:02:24.051+0000 7faa94e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:02:24.051+0000 7faa94e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:02:24.051+0000 7faa94e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:02:24.051+0000 7fabaa0ed640 10 monclient: get_auth_request con 0x7faa84070a20 auth_method 0 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: get_monmap_and_config 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: build_initial_monmap 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: monmap: 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:02:24.219 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding auth protocol: cephx 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding auth protocol: cephx 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding auth protocol: cephx 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.220 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: crc 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12070) adding con mode: secure 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: init 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding auth protocol: cephx 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding auth protocol: cephx 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding auth protocol: cephx 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.221 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: crc 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634f5b0) adding con mode: secure 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdc634f6f8 EEXIST 2024-09-12T18:02:24.222 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-b con 0x55e4eab40660 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-a con 0x55e4eab40a40 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-c con 0x55e4eab41f00 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): authenticate will time out at 2573.465128s 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): get_auth_request con 0x55e4eab41f00 auth_method 0 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.223 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request con 0x55e4eab40a40 auth_method 0 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_done global_id 6014 payload 274 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient: _finish_hunting 0 2024-09-12T18:02:24.224 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:02:24.055+0000 7fabab0ef640 1 monclient: found mon.noname-c 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: dump: 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.225 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 monclient: authenticate success, global_id 6014 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:02:24.055+0000 7fabacde89c0 4 set_mon_vals no callback set 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:02:24.055+0000 7faa8e7fc640 10 monclient: dump: 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.226 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: shutdown 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: build_initial_monmap 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: monmap: 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:02:24.227 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding auth protocol: cephx 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding auth protocol: cephx 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding auth protocol: cephx 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.228 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: crc 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eab12020) adding con mode: secure 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 librados: starting msgr at 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 librados: starting objecter 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e4eab148d0 EEXIST 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 librados: setting wanted keys 2024-09-12T18:02:24.229 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:02:24.055+0000 7fabacde89c0 1 librados: calling monclient init 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: init 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding auth protocol: cephx 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding auth protocol: cephx 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding auth protocol: cephx 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.230 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: crc 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 AuthRegistry(0x55e4eaaf4540) adding con mode: secure 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:02:24.055+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:02:24.055+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command rotate-key cmddesc rotate-key hook 0x55e4eaaf4688 EEXIST 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-b con 0x55e4eab40660 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-c con 0x55e4eab41f00 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): picked mon.noname-a con 0x55e4eab31c90 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.231 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:02:24.055+0000 7fabacde89c0 10 monclient(hunting): authenticate will time out at 2573.467703s 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request con 0x55e4eab41f00 auth_method 0 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): get_auth_request con 0x55e4eab31c90 auth_method 0 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:02:24.055+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.232 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:02:24.055+0000 7fabab0ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:02:24.059+0000 7fabaa0ed640 10 monclient(hunting): handle_auth_done global_id 6017 payload 824 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:02:24.059+0000 7fabaa0ed640 10 monclient: _finish_hunting 0 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:02:24.059+0000 7fabaa0ed640 1 monclient: found mon.noname-c 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:02:24.059+0000 7fabaa0ed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: dump: 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.233 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: _finish_auth 0 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: _check_auth_tickets 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:02:24.059+0000 7faa8cff9640 10 monclient: dump: 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:02:24.234 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:02:24.059+0000 7faa8e7fc640 4 set_mon_vals no callback set 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:02:24.059+0000 7fabacde89c0 5 monclient: authenticate success, global_id 6017 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:02:24.059+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:02:24.059+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:02:24.059+0000 7fabacde89c0 10 monclient: _renew_subs 2024-09-12T18:02:24.235 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:02:24.059+0000 7fabacde89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:02:24.059+0000 7fabacde89c0 1 librados: init done 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:02:24.059+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command cr dump hook 0x55e4eab348a8 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:02:24.059+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:02:24.059+0000 7faa8cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:02:24.059+0000 7faa8cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:02:24.059+0000 7faa8cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:02:24.059+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x7faa74070b10 auth_method 0 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:02:24.059+0000 7fabab0ef640 10 monclient: get_auth_request con 0x55e4eab60770 auth_method 0 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 realm 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:02:24.063+0000 7fabacde89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:24.236 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:02:24.063+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x55e4eab64840 auth_method 0 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:02:24.063+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:02:24.063+0000 7fabaa0ed640 10 monclient: get_auth_request con 0x55e4eab68110 auth_method 0 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:02:24.067+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:02:24.067+0000 7fabacde89c0 20 searching for the correct realm 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:02:24.067+0000 7fabab0ef640 10 monclient: get_auth_request con 0x7faba0043060 auth_method 0 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:02:24.067+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x7faba40dc060 auth_method 0 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:02:24.071+0000 7fabaa0ed640 10 monclient: get_auth_request con 0x7faba0030040 auth_method 0 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:02:24.071+0000 7fabab0ef640 0 -- 172.21.15.97:0/3161527387 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7faba0043060 msgr2=0x7faba009e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:24.237 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:02:24.071+0000 7faa8cff9640 1 client.6017.objecter ms_handle_reset 0x7faba0043060 session 0x7faba0027070 osd.2 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:02:24.071+0000 7faa8cff9640 10 monclient: _renew_subs 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:02:24.071+0000 7faa8cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:02:24.071+0000 7fabab0ef640 10 monclient: get_auth_request con 0x7faa74080630 auth_method 0 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:02:24.071+0000 7fabab0ef640 10 monclient: get_auth_request con 0x7faba4131210 auth_method 0 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:02:24.075+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x7fab9c01a040 auth_method 0 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:02:24.075+0000 7fabaa8ee640 0 -- 172.21.15.97:0/3161527387 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fab9c01a040 msgr2=0x7fab9c05d270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:02:24.075+0000 7faa8cff9640 1 client.6017.objecter ms_handle_reset 0x7fab9c01a040 session 0x7fab9c091040 osd.3 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:02:24.075+0000 7fabaa8ee640 10 monclient: get_auth_request con 0x7faba0043060 auth_method 0 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:24.238 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 zone default found 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:02:24.083+0000 7fabacde89c0 4 Realm: () 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:02:24.083+0000 7fabacde89c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:02:24.083+0000 7fabacde89c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:02:24.083+0000 7fabacde89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 zonegroup default 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:02:24.083+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.239 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 started sync module instance, tier type = 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:02:24.087+0000 7fabacde89c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=0 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=1 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=2 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=3 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=4 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=5 2024-09-12T18:02:24.240 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:02:24.103+0000 7fabacde89c0 20 add_watcher() i=6 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:02:24.107+0000 7fabacde89c0 20 add_watcher() i=7 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:02:24.107+0000 7fabacde89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding auth protocol: cephx 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding auth protocol: cephx 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding auth protocol: cephx 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:02:24.111+0000 7faa61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.241 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: crc 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 AuthRegistry(0x7ffdc634fa80) adding con mode: secure 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:02:24.111+0000 7fabacde89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command cache list hook 0x55e4eab44c60 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command cache inspect hook 0x55e4eab44c60 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command cache erase hook 0x55e4eab44c60 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command cache zap hook 0x55e4eab44c60 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 note: GC not initialized 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:02:24.111+0000 7faa60fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:24.242 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command sync trace show hook 0x7fab9c05abf0 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command sync trace history hook 0x7fab9c05abf0 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command sync trace active hook 0x7fab9c05abf0 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:02:24.111+0000 7fabacde89c0 5 asok(0x55e4ea86c2b0) register_command sync trace active_short hook 0x7fab9c05abf0 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 Filter name: none 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:02:24.111+0000 7faa59ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 : miss 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.243 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:02:24.111+0000 7fabacde89c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 info.flags=0x17 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to cache LRU end 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:02:24.111+0000 7fabacde89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:02:24.115+0000 7fabacde89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fabacde89c0 time 2024-09-12T18:02:24.117698+0000 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fabb06c22eb] 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabb06c249f] 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4e7fc60c1] 2024-09-12T18:02:24.244 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x140f572) [0x55e4e8a1b572] 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e4e7fd818d] 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabaf528d90] 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:02:24.119+0000 7fabacde89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fabacde89c0 thread_name:radosgw-admin 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fabaf541520] 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:02:24.245 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fabb06c2345] 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabb06c249f] 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4e7fc60c1] 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x140f572) [0x55e4e8a1b572] 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e4e7fd818d] 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabaf528d90] 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:02:24.246 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:02:24.247 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:02:24.248 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:02:24.249 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:02:24.250 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:02:24.251 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:02:24.252 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa59ffb640 / http_manager 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa60fe1640 / http_manager 2024-09-12T18:02:24.253 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa61fe3640 / rgw_dt_lg_renew 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa8cff9640 / ms_dispatch 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa8e7fc640 / io_context_pool 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa94e01640 / ms_dispatch 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa97606640 / ms_dispatch 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: 7faa98e09640 / io_context_pool 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: 7fabaa0ed640 / msgr-worker-2 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: 7fabaa8ee640 / msgr-worker-1 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: 7fabab0ef640 / msgr-worker-0 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: 7fabab8f0640 / io_context_pool 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: 7fabacde89c0 / radosgw-admin 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:02:24.120274Z_699b23f1-53a2-4b20-9698-52d12d31e3d9/log 2024-09-12T18:02:24.254 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:02:24.255 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:02:24.255 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T18:02:24.258 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.199+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.203+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.203+0000 7f5e4cdaf9c0 20 realm 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.203+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.203+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.203+0000 7f5e4cdaf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.203+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.203+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.203+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.203+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.203+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.207+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.207+0000 7f5e4cdaf9c0 20 searching for the correct realm 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.211+0000 7f5e4a0b4640 0 -- 172.21.15.97:0/4139516655 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f5e341150c0 msgr2=0x7f5e340f64f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.219+0000 7f5e4b0b6640 0 -- 172.21.15.97:0/4139516655 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55c1f0940c00 msgr2=0x55c1f0942ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.223+0000 7f5e4cdaf9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.223+0000 7f5e4cdaf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.223+0000 7f5e4cdaf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.223+0000 7f5e4cdaf9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.223+0000 7f5e4cdaf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.223+0000 7f5e4cdaf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.223+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.223+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.223+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.223+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.223+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 20 zone default found 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 4 Realm: () 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 20 zonegroup default 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 20 started sync module instance, tier type = 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.227+0000 7f5e4cdaf9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.243+0000 7f5e4cdaf9c0 20 add_watcher() i=0 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.243+0000 7f5e4cdaf9c0 20 add_watcher() i=1 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.243+0000 7f5e4cdaf9c0 20 add_watcher() i=2 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.243+0000 7f5e4cdaf9c0 20 add_watcher() i=3 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.243+0000 7f5e4cdaf9c0 20 add_watcher() i=4 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.243+0000 7f5e4cdaf9c0 20 add_watcher() i=5 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.243+0000 7f5e4cdaf9c0 20 add_watcher() i=6 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.247+0000 7f5e4cdaf9c0 20 add_watcher() i=7 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.247+0000 7f5e4cdaf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5d017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:24.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5e4cdaf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5e4cdaf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5e4cdaf9c0 5 note: GC not initialized 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5c7bfff640 20 reqs_thread_entry: start 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5e4cdaf9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5e4cdaf9c0 20 Filter name: none 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5c79ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5e4cdaf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.251+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.255+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.255+0000 7f5e4cdaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.255+0000 7f5e4cdaf9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:24.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.255+0000 7f5e4cdaf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:24.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.255+0000 7f5d017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:24.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.259+0000 7f5e4cdaf9c0 20 remove_watcher() i=0 2024-09-12T18:02:24.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.259+0000 7f5e4cdaf9c0 2 removed watcher, disabling cache 2024-09-12T18:02:24.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.263+0000 7f5e4cdaf9c0 20 remove_watcher() i=1 2024-09-12T18:02:24.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.263+0000 7f5e4cdaf9c0 20 remove_watcher() i=2 2024-09-12T18:02:24.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.267+0000 7f5e4cdaf9c0 20 remove_watcher() i=3 2024-09-12T18:02:24.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.267+0000 7f5e4cdaf9c0 20 remove_watcher() i=4 2024-09-12T18:02:24.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.271+0000 7f5e4cdaf9c0 20 remove_watcher() i=5 2024-09-12T18:02:24.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.275+0000 7f5e4cdaf9c0 20 remove_watcher() i=6 2024-09-12T18:02:24.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.275+0000 7f5e4cdaf9c0 20 remove_watcher() i=7 2024-09-12T18:02:24.290 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.290 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:24.290 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-init-indext id: 98539659-fdaf-41ce-847d-239ff89323af.4641.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:02:24.290 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:24.291 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:24.292 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:24.330 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:24.330 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:24.390 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:02:24.420 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:24.420 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:24.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.463+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.463+0000 7f86e4cc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.463+0000 7f86e4cc09c0 20 realm 2024-09-12T18:02:24.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.463+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.467+0000 7f86e4cc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.467+0000 7f86e4cc09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:24.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.467+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.467+0000 7f86e4cc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.467+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.467+0000 7f86e4cc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:24.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.467+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.467+0000 7f86e4cc09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:24.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.467+0000 7f86e4cc09c0 20 searching for the correct realm 2024-09-12T18:02:24.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.475+0000 7f86e2fc7640 0 -- 172.21.15.97:0/1525146722 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f86d80ea040 msgr2=0x7f86d80b8440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:24.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.479+0000 7f86e27c6640 0 -- 172.21.15.97:0/1525146722 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f86d80ea040 msgr2=0x7f85ac085390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:24.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.487+0000 7f86e4cc09c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:24.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.487+0000 7f86e4cc09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:24.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.487+0000 7f86e4cc09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:24.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.487+0000 7f86e4cc09c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:24.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.487+0000 7f86e4cc09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:24.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.487+0000 7f86e4cc09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:24.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.487+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.487+0000 7f86e4cc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.487+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.487+0000 7f86e4cc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:24.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:24.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 zone default found 2024-09-12T18:02:24.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 4 Realm: () 2024-09-12T18:02:24.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:24.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:24.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:24.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 zonegroup default 2024-09-12T18:02:24.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:24.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 started sync module instance, tier type = 2024-09-12T18:02:24.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.491+0000 7f86e4cc09c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:24.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.507+0000 7f86e4cc09c0 20 add_watcher() i=0 2024-09-12T18:02:24.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.507+0000 7f86e4cc09c0 20 add_watcher() i=1 2024-09-12T18:02:24.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.507+0000 7f86e4cc09c0 20 add_watcher() i=2 2024-09-12T18:02:24.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.507+0000 7f86e4cc09c0 20 add_watcher() i=3 2024-09-12T18:02:24.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.507+0000 7f86e4cc09c0 20 add_watcher() i=4 2024-09-12T18:02:24.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.507+0000 7f86e4cc09c0 20 add_watcher() i=5 2024-09-12T18:02:24.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.507+0000 7f86e4cc09c0 20 add_watcher() i=6 2024-09-12T18:02:24.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.511+0000 7f86e4cc09c0 20 add_watcher() i=7 2024-09-12T18:02:24.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.511+0000 7f86e4cc09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:24.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.515+0000 7f8598fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:24.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.515+0000 7f86e4cc09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:24.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.515+0000 7f86e4cc09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:24.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.515+0000 7f86e4cc09c0 5 note: GC not initialized 2024-09-12T18:02:24.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.515+0000 7f85137fe640 20 reqs_thread_entry: start 2024-09-12T18:02:24.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:24.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 20 Filter name: none 2024-09-12T18:02:24.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f85117fa640 20 reqs_thread_entry: start 2024-09-12T18:02:24.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:02:24.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:24.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:02:24.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:02:24.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 : miss 2024-09-12T18:02:24.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:24.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:24.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 info.flags=0x17 2024-09-12T18:02:24.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to cache LRU end 2024-09-12T18:02:24.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:24.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:24.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 2024-09-12T18:02:24.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.519+0000 7f86e4cc09c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to be held by another RGW process; skipping for now 2024-09-12T18:02:24.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.523+0000 7f8598fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:24.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.527+0000 7f86e4cc09c0 20 remove_watcher() i=0 2024-09-12T18:02:24.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.527+0000 7f86e4cc09c0 2 removed watcher, disabling cache 2024-09-12T18:02:24.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.527+0000 7f86e4cc09c0 20 remove_watcher() i=1 2024-09-12T18:02:24.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.531+0000 7f86e4cc09c0 20 remove_watcher() i=2 2024-09-12T18:02:24.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.531+0000 7f86e4cc09c0 20 remove_watcher() i=3 2024-09-12T18:02:24.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.535+0000 7f86e4cc09c0 20 remove_watcher() i=4 2024-09-12T18:02:24.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.535+0000 7f86e4cc09c0 20 remove_watcher() i=5 2024-09-12T18:02:24.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.539+0000 7f86e4cc09c0 20 remove_watcher() i=6 2024-09-12T18:02:24.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:24.543+0000 7f86e4cc09c0 20 remove_watcher() i=7 2024-09-12T18:02:24.557 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:02:54.573 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:02:54.610 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:54.610 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:54.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.654+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.658+0000 7f069a7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.658+0000 7f069a7219c0 20 realm 2024-09-12T18:02:54.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.658+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.658+0000 7f069a7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.658+0000 7f069a7219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:54.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.658+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.658+0000 7f069a7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.658+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.658+0000 7f069a7219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:54.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.658+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.662+0000 7f069a7219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:54.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.662+0000 7f069a7219c0 20 searching for the correct realm 2024-09-12T18:02:54.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.666+0000 7f0698227640 0 -- 172.21.15.97:0/1052696139 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f0688058070 msgr2=0x7f0688014b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:54.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.674+0000 7f0698227640 0 -- 172.21.15.97:0/1052696139 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55c12f166fa0 msgr2=0x55c12f169390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:54.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.678+0000 7f069a7219c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:54.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.678+0000 7f069a7219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:54.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.678+0000 7f069a7219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:54.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.678+0000 7f069a7219c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:54.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.678+0000 7f069a7219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:54.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.678+0000 7f069a7219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:54.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.678+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.678+0000 7f069a7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.678+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:54.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:54.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 zone default found 2024-09-12T18:02:54.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 4 Realm: () 2024-09-12T18:02:54.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:54.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:54.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:54.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 zonegroup default 2024-09-12T18:02:54.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 started sync module instance, tier type = 2024-09-12T18:02:54.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.682+0000 7f069a7219c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:54.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.702+0000 7f069a7219c0 20 add_watcher() i=0 2024-09-12T18:02:54.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.702+0000 7f069a7219c0 20 add_watcher() i=1 2024-09-12T18:02:54.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.702+0000 7f069a7219c0 20 add_watcher() i=2 2024-09-12T18:02:54.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.702+0000 7f069a7219c0 20 add_watcher() i=3 2024-09-12T18:02:54.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.702+0000 7f069a7219c0 20 add_watcher() i=4 2024-09-12T18:02:54.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.702+0000 7f069a7219c0 20 add_watcher() i=5 2024-09-12T18:02:54.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.702+0000 7f069a7219c0 20 add_watcher() i=6 2024-09-12T18:02:54.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.706+0000 7f069a7219c0 20 add_watcher() i=7 2024-09-12T18:02:54.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.706+0000 7f069a7219c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:54.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.706+0000 7f054efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:54.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.706+0000 7f069a7219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:54.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.706+0000 7f069a7219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:54.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.706+0000 7f069a7219c0 5 note: GC not initialized 2024-09-12T18:02:54.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f054dfdb640 20 reqs_thread_entry: start 2024-09-12T18:02:54.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:54.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 20 Filter name: none 2024-09-12T18:02:54.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f04bf7fe640 20 reqs_thread_entry: start 2024-09-12T18:02:54.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:02:54.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:54.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:02:54.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:02:54.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 : miss 2024-09-12T18:02:54.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:54.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 info.flags=0x17 2024-09-12T18:02:54.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to cache LRU end 2024-09-12T18:02:54.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:54.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:54.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.710+0000 7f069a7219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 2024-09-12T18:02:54.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f069a7219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 info.flags=0x17 2024-09-12T18:02:54.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f069a7219c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to cache LRU end 2024-09-12T18:02:54.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f069a7219c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:54.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f069a7219c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21, ofs0, ns] 2024-09-12T18:02:54.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f056effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94288207086592 notifier 6435 bl.length()=913 2024-09-12T18:02:54.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f056effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 info.flags=0x17 2024-09-12T18:02:54.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f056effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to cache LRU end 2024-09-12T18:02:54.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f056effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:54.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): orig_sources= new_sources= 2024-09-12T18:02:54.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): potential sources added=[] removed=[] 2024-09-12T18:02:54.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): orig_dests= new_dests= 2024-09-12T18:02:54.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.722+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): potential dests added=[] removed=[] 2024-09-12T18:02:54.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.0 2024-09-12T18:02:54.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.0 2024-09-12T18:02:54.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.1 2024-09-12T18:02:54.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.1 2024-09-12T18:02:54.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.2 2024-09-12T18:02:54.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.2 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.3 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.3 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.4 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.4 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.5 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.5 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.6 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.6 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.7 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.7 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.8 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.8 2024-09-12T18:02:54.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.9 2024-09-12T18:02:54.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.9 2024-09-12T18:02:54.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.10 2024-09-12T18:02:54.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.10 2024-09-12T18:02:54.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.11 2024-09-12T18:02:54.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1.11 2024-09-12T18:02:54.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.0 2024-09-12T18:02:54.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.730+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1 2024-09-12T18:02:54.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.734+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.2 2024-09-12T18:02:54.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.734+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.3 2024-09-12T18:02:54.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.734+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.4 2024-09-12T18:02:54.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.734+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.5 2024-09-12T18:02:54.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.734+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.6 2024-09-12T18:02:54.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.738+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.7 2024-09-12T18:02:54.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.738+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.8 2024-09-12T18:02:54.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.738+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.9 2024-09-12T18:02:54.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.738+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.10 2024-09-12T18:02:54.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.746+0000 7f069a7219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:54.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.746+0000 7f069a7219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 2024-09-12T18:02:54.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.746+0000 7f069a7219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 info.flags=0x17 2024-09-12T18:02:54.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.746+0000 7f069a7219c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to cache LRU end 2024-09-12T18:02:54.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.746+0000 7f069a7219c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:54.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.746+0000 7f069a7219c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21, ofs0, ns] 2024-09-12T18:02:54.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.746+0000 7f056f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94288207086592 notifier 6435 bl.length()=913 2024-09-12T18:02:54.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.746+0000 7f056f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 info.flags=0x17 2024-09-12T18:02:54.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.746+0000 7f056f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to cache LRU end 2024-09-12T18:02:54.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.746+0000 7f056f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:54.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.750+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): orig_sources= new_sources= 2024-09-12T18:02:54.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.750+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): potential sources added=[] removed=[] 2024-09-12T18:02:54.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.750+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): orig_dests= new_dests= 2024-09-12T18:02:54.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.750+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): potential dests added=[] removed=[] 2024-09-12T18:02:54.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.754+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.0 2024-09-12T18:02:54.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.754+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.1 2024-09-12T18:02:54.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.754+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.2 2024-09-12T18:02:54.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.754+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.3 2024-09-12T18:02:54.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.754+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.4 2024-09-12T18:02:54.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.758+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.5 2024-09-12T18:02:54.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.758+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.6 2024-09-12T18:02:54.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.758+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.7 2024-09-12T18:02:54.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.758+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.8 2024-09-12T18:02:54.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.758+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.9 2024-09-12T18:02:54.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.758+0000 7f069a7219c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.21.10 2024-09-12T18:02:54.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.758+0000 7f069a7219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:54.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.758+0000 7f069a7219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 2024-09-12T18:02:54.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f069a7219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 info.flags=0x17 2024-09-12T18:02:54.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f069a7219c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to cache LRU end 2024-09-12T18:02:54.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f069a7219c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:54.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f069a7219c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21, ofs0, ns] 2024-09-12T18:02:54.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f056effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 94288207086592 notifier 6435 bl.length()=881 2024-09-12T18:02:54.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f056effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 info.flags=0x17 2024-09-12T18:02:54.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f056effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:98539659-fdaf-41ce-847d-239ff89323af.4641.21 to cache LRU end 2024-09-12T18:02:54.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f056effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:54.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): orig_sources= new_sources= 2024-09-12T18:02:54.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): potential sources added=[] removed=[] 2024-09-12T18:02:54.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): orig_dests= new_dests= 2024-09-12T18:02:54.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.762+0000 7f069a7219c0 20 handle_bi_update(): bucket=:abort-at-init-indext[98539659-fdaf-41ce-847d-239ff89323af.4641.21]): potential dests added=[] removed=[] 2024-09-12T18:02:54.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.766+0000 7f069a7219c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T18:02:54.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.770+0000 7f054efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:54.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.774+0000 7f069a7219c0 20 remove_watcher() i=0 2024-09-12T18:02:54.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.774+0000 7f069a7219c0 2 removed watcher, disabling cache 2024-09-12T18:02:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.778+0000 7f069a7219c0 20 remove_watcher() i=1 2024-09-12T18:02:54.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.778+0000 7f069a7219c0 20 remove_watcher() i=2 2024-09-12T18:02:54.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.782+0000 7f069a7219c0 20 remove_watcher() i=3 2024-09-12T18:02:54.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.782+0000 7f069a7219c0 20 remove_watcher() i=4 2024-09-12T18:02:54.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.786+0000 7f069a7219c0 20 remove_watcher() i=5 2024-09-12T18:02:54.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.786+0000 7f069a7219c0 20 remove_watcher() i=6 2024-09-12T18:02:54.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.790+0000 7f069a7219c0 20 remove_watcher() i=7 2024-09-12T18:02:54.806 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T18:02:54.834 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:54.834 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:54.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.878+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.878+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.878+0000 7fb2ca9ab9c0 20 realm 2024-09-12T18:02:54.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.878+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.882+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.882+0000 7fb2ca9ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:54.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.882+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.882+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.882+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.882+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:54.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.882+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.882+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:54.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.882+0000 7fb2ca9ab9c0 20 searching for the correct realm 2024-09-12T18:02:54.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.890+0000 7fb2c7cb0640 0 -- 172.21.15.97:0/2888270715 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fb2bc008050 msgr2=0x7fb2bc047150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:54.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.894+0000 7fb2c8cb2640 0 -- 172.21.15.97:0/2888270715 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x562d0b153e00 msgr2=0x562d0b1561f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:54.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.902+0000 7fb2ca9ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:54.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.902+0000 7fb2ca9ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:54.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.902+0000 7fb2ca9ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:54.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.902+0000 7fb2ca9ab9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:54.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.902+0000 7fb2ca9ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:54.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.902+0000 7fb2ca9ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:54.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.902+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.902+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.902+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.902+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:54.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.902+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:54.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 20 zone default found 2024-09-12T18:02:54.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 4 Realm: () 2024-09-12T18:02:54.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:54.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:54.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:54.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 20 zonegroup default 2024-09-12T18:02:54.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:54.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 20 started sync module instance, tier type = 2024-09-12T18:02:54.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.906+0000 7fb2ca9ab9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:54.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.926+0000 7fb2ca9ab9c0 20 add_watcher() i=0 2024-09-12T18:02:54.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.926+0000 7fb2ca9ab9c0 20 add_watcher() i=1 2024-09-12T18:02:54.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.926+0000 7fb2ca9ab9c0 20 add_watcher() i=2 2024-09-12T18:02:54.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.926+0000 7fb2ca9ab9c0 20 add_watcher() i=3 2024-09-12T18:02:54.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.926+0000 7fb2ca9ab9c0 20 add_watcher() i=4 2024-09-12T18:02:54.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.926+0000 7fb2ca9ab9c0 20 add_watcher() i=5 2024-09-12T18:02:54.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.926+0000 7fb2ca9ab9c0 20 add_watcher() i=6 2024-09-12T18:02:54.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.926+0000 7fb2ca9ab9c0 20 add_watcher() i=7 2024-09-12T18:02:54.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.926+0000 7fb2ca9ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:54.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.930+0000 7fb17efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:54.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.930+0000 7fb2ca9ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:54.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.930+0000 7fb2ca9ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:54.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.930+0000 7fb2ca9ab9c0 5 note: GC not initialized 2024-09-12T18:02:54.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.930+0000 7fb17dfdb640 20 reqs_thread_entry: start 2024-09-12T18:02:54.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.930+0000 7fb2ca9ab9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:54.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.930+0000 7fb2ca9ab9c0 20 Filter name: none 2024-09-12T18:02:54.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.930+0000 7fb0ef7fe640 20 reqs_thread_entry: start 2024-09-12T18:02:54.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.930+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.930+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:54.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.930+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.934+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:54.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.934+0000 7fb2ca9ab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:54.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.934+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.934+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:02:54.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.934+0000 7fb2ca9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:54.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.934+0000 7fb2ca9ab9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:02:54.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.934+0000 7fb2ca9ab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:54.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.938+0000 7fb17efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:54.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.942+0000 7fb2ca9ab9c0 20 remove_watcher() i=0 2024-09-12T18:02:54.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.942+0000 7fb2ca9ab9c0 2 removed watcher, disabling cache 2024-09-12T18:02:54.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.942+0000 7fb2ca9ab9c0 20 remove_watcher() i=1 2024-09-12T18:02:54.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.946+0000 7fb2ca9ab9c0 20 remove_watcher() i=2 2024-09-12T18:02:54.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.946+0000 7fb2ca9ab9c0 20 remove_watcher() i=3 2024-09-12T18:02:54.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.946+0000 7fb2ca9ab9c0 20 remove_watcher() i=4 2024-09-12T18:02:54.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.950+0000 7fb2ca9ab9c0 20 remove_watcher() i=5 2024-09-12T18:02:54.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.954+0000 7fb2ca9ab9c0 20 remove_watcher() i=6 2024-09-12T18:02:54.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:54.954+0000 7fb2ca9ab9c0 20 remove_watcher() i=7 2024-09-12T18:02:54.971 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:54.971 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:54.971 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-init-indext id: 98539659-fdaf-41ce-847d-239ff89323af.4641.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:02:54.971 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:54.973 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:54.973 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:54.995 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:54.995 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:55.519 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:55.520 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:55.891 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T18:02:55.891 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:55.894 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:55.894 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:56.033 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:56.033 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:56.121 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:56.121 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:56.235 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:56.235 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:56.345 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:56.346 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:56.441 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:56.535 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:56.630 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:56.631 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:56.724 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:56.724 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:56.819 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:56.819 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:56.914 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:56.915 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:57.008 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:57.008 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:57.104 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:57.104 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:57.198 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:57.198 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:57.292 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:57.292 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:57.384 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:57.385 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:57.483 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:57.483 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:57.578 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:57.578 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:57.671 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:57.672 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:57.769 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:57.769 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:57.867 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:57.868 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:57.967 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:57.968 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:58.074 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:02:58.107 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:58.107 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:58.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.154+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.154+0000 7fd0b54c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:58.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.154+0000 7fd0b54c09c0 20 realm 2024-09-12T18:02:58.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.154+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.154+0000 7fd0b54c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:58.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.154+0000 7fd0b54c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:58.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.154+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.154+0000 7fd0b54c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:58.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.154+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.158+0000 7fd0b54c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:58.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.158+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.158+0000 7fd0b54c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:58.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.158+0000 7fd0b54c09c0 20 searching for the correct realm 2024-09-12T18:02:58.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.162+0000 7fd0b2fc6640 0 -- 172.21.15.97:0/1955946935 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fd0a403a060 msgr2=0x7fd0a4063c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:58.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.374+0000 7fd0b2fc6640 0 -- 172.21.15.97:0/1955946935 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fd09c003ac0 msgr2=0x7fd0ac05fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:02:58.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.590+0000 7fd0b54c09c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:58.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.590+0000 7fd0b54c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:58.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.590+0000 7fd0b54c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:58.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.590+0000 7fd0b54c09c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:58.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.590+0000 7fd0b54c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:58.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.590+0000 7fd0b54c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:58.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.590+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:58.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:58.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:58.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 zone default found 2024-09-12T18:02:58.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 4 Realm: () 2024-09-12T18:02:58.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:58.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:58.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:58.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 zonegroup default 2024-09-12T18:02:58.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:58.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:58.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.594+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.598+0000 7fd0b54c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:58.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.598+0000 7fd0b54c09c0 20 started sync module instance, tier type = 2024-09-12T18:02:58.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.598+0000 7fd0b54c09c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:58.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.618+0000 7fd0b54c09c0 20 add_watcher() i=0 2024-09-12T18:02:58.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.618+0000 7fd0b54c09c0 20 add_watcher() i=1 2024-09-12T18:02:58.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.618+0000 7fd0b54c09c0 20 add_watcher() i=2 2024-09-12T18:02:58.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.618+0000 7fd0b54c09c0 20 add_watcher() i=3 2024-09-12T18:02:58.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.618+0000 7fd0b54c09c0 20 add_watcher() i=4 2024-09-12T18:02:58.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.618+0000 7fd0b54c09c0 20 add_watcher() i=5 2024-09-12T18:02:58.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.618+0000 7fd0b54c09c0 20 add_watcher() i=6 2024-09-12T18:02:58.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.622+0000 7fd0b54c09c0 20 add_watcher() i=7 2024-09-12T18:02:58.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.622+0000 7fd0b54c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:58.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.626+0000 7fcf697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:58.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.626+0000 7fd0b54c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:58.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.626+0000 7fd0b54c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:58.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.626+0000 7fd0b54c09c0 5 note: GC not initialized 2024-09-12T18:02:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.626+0000 7fcee3fff640 20 reqs_thread_entry: start 2024-09-12T18:02:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.630+0000 7fd0b54c09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.630+0000 7fd0b54c09c0 20 Filter name: none 2024-09-12T18:02:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.630+0000 7fcee1ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:58.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.630+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.630+0000 7fd0b54c09c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:58.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.630+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.630+0000 7fd0b54c09c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:58.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.630+0000 7fd0b54c09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:58.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.630+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.634+0000 7fd0b54c09c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:58.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.634+0000 7fd0b54c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.634+0000 7fd0b54c09c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:58.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.634+0000 7fd0b54c09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:58.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.638+0000 7fcf697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:58.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.642+0000 7fd0b54c09c0 20 remove_watcher() i=0 2024-09-12T18:02:58.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.642+0000 7fd0b54c09c0 2 removed watcher, disabling cache 2024-09-12T18:02:58.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.642+0000 7fd0b54c09c0 20 remove_watcher() i=1 2024-09-12T18:02:58.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.646+0000 7fd0b54c09c0 20 remove_watcher() i=2 2024-09-12T18:02:58.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.646+0000 7fd0b54c09c0 20 remove_watcher() i=3 2024-09-12T18:02:58.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.650+0000 7fd0b54c09c0 20 remove_watcher() i=4 2024-09-12T18:02:58.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.650+0000 7fd0b54c09c0 20 remove_watcher() i=5 2024-09-12T18:02:58.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.654+0000 7fd0b54c09c0 20 remove_watcher() i=6 2024-09-12T18:02:58.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.658+0000 7fd0b54c09c0 20 remove_watcher() i=7 2024-09-12T18:02:58.673 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:58.673 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:58.673 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-set-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:02:58.674 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:58.674 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T18:02:58.707 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:58.708 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:58.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.750+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.754+0000 7fddd2c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:58.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.754+0000 7fddd2c1e9c0 20 realm 2024-09-12T18:02:58.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.754+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.754+0000 7fddd2c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:58.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.754+0000 7fddd2c1e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:58.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.754+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.754+0000 7fddd2c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:58.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.754+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.754+0000 7fddd2c1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:58.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.754+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:58.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.758+0000 7fddd2c1e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:58.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.758+0000 7fddd2c1e9c0 20 searching for the correct realm 2024-09-12T18:02:58.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.758+0000 7fddd0724640 0 -- 172.21.15.97:0/2863010173 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fddc00990b0 msgr2=0x7fddc0062b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:58.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:58.970+0000 7fddd0724640 0 -- 172.21.15.97:0/2863010173 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x55d00c6e3ec0 msgr2=0x7fddc800a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:59.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.186+0000 7fddd2c1e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:59.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.186+0000 7fddd2c1e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:59.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.186+0000 7fddd2c1e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:59.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.186+0000 7fddd2c1e9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:59.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.186+0000 7fddd2c1e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:59.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.186+0000 7fddd2c1e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:59.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.186+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:59.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:59.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 zone default found 2024-09-12T18:02:59.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 4 Realm: () 2024-09-12T18:02:59.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:59.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:59.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:59.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 zonegroup default 2024-09-12T18:02:59.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.190+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.194+0000 7fddd2c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.194+0000 7fddd2c1e9c0 20 started sync module instance, tier type = 2024-09-12T18:02:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.194+0000 7fddd2c1e9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:59.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.214+0000 7fddd2c1e9c0 20 add_watcher() i=0 2024-09-12T18:02:59.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.214+0000 7fddd2c1e9c0 20 add_watcher() i=1 2024-09-12T18:02:59.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.214+0000 7fddd2c1e9c0 20 add_watcher() i=2 2024-09-12T18:02:59.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.214+0000 7fddd2c1e9c0 20 add_watcher() i=3 2024-09-12T18:02:59.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.214+0000 7fddd2c1e9c0 20 add_watcher() i=4 2024-09-12T18:02:59.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.214+0000 7fddd2c1e9c0 20 add_watcher() i=5 2024-09-12T18:02:59.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.214+0000 7fddd2c1e9c0 20 add_watcher() i=6 2024-09-12T18:02:59.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.218+0000 7fddd2c1e9c0 20 add_watcher() i=7 2024-09-12T18:02:59.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.218+0000 7fddd2c1e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:59.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.222+0000 7fdc86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:59.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.222+0000 7fddd2c1e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:59.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.222+0000 7fddd2c1e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:59.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.222+0000 7fddd2c1e9c0 5 note: GC not initialized 2024-09-12T18:02:59.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.222+0000 7fdc85fdb640 20 reqs_thread_entry: start 2024-09-12T18:02:59.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:59.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 20 Filter name: none 2024-09-12T18:02:59.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fdbf77fe640 20 reqs_thread_entry: start 2024-09-12T18:02:59.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T18:02:59.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T18:02:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T18:02:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 : miss 2024-09-12T18:02:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 info.flags=0x17 2024-09-12T18:02:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 to cache LRU end 2024-09-12T18:02:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:59.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:59.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.226+0000 7fddd2c1e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 2024-09-12T18:02:59.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.238+0000 7fddd2c1e9c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T18:02:59.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.238+0000 7fddd2c1e9c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T18:02:59.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.246+0000 7fdc86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:59.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.250+0000 7fddd2c1e9c0 20 remove_watcher() i=0 2024-09-12T18:02:59.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.250+0000 7fddd2c1e9c0 2 removed watcher, disabling cache 2024-09-12T18:02:59.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.254+0000 7fddd2c1e9c0 20 remove_watcher() i=1 2024-09-12T18:02:59.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.254+0000 7fddd2c1e9c0 20 remove_watcher() i=2 2024-09-12T18:02:59.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.258+0000 7fddd2c1e9c0 20 remove_watcher() i=3 2024-09-12T18:02:59.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.258+0000 7fddd2c1e9c0 20 remove_watcher() i=4 2024-09-12T18:02:59.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.262+0000 7fddd2c1e9c0 20 remove_watcher() i=5 2024-09-12T18:02:59.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.262+0000 7fddd2c1e9c0 20 remove_watcher() i=6 2024-09-12T18:02:59.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.266+0000 7fddd2c1e9c0 20 remove_watcher() i=7 2024-09-12T18:02:59.283 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:02:59.314 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:59.314 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:59.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.358+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.362+0000 7f3c6d4069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.362+0000 7f3c6d4069c0 20 realm 2024-09-12T18:02:59.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.362+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.362+0000 7f3c6d4069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.362+0000 7f3c6d4069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:59.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.362+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.362+0000 7f3c6d4069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.362+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.362+0000 7f3c6d4069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:59.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.362+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.362+0000 7f3c6d4069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:59.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.366+0000 7f3c6d4069c0 20 searching for the correct realm 2024-09-12T18:02:59.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.370+0000 7f3c6b70d640 0 -- 172.21.15.97:0/2641945895 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5609df84d9a0 msgr2=0x5609df84fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:59.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.378+0000 7f3c6af0c640 0 -- 172.21.15.97:0/2641945895 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x5609df851a20 msgr2=0x5609df853e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:59.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.382+0000 7f3c6d4069c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:59.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.382+0000 7f3c6d4069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:59.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.382+0000 7f3c6d4069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:59.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.382+0000 7f3c6d4069c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:59.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.382+0000 7f3c6d4069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:59.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.382+0000 7f3c6d4069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:59.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.382+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.382+0000 7f3c6d4069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.382+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.382+0000 7f3c6d4069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.382+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 20 zone default found 2024-09-12T18:02:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 4 Realm: () 2024-09-12T18:02:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 20 zonegroup default 2024-09-12T18:02:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 20 started sync module instance, tier type = 2024-09-12T18:02:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.386+0000 7f3c6d4069c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:59.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.402+0000 7f3c6d4069c0 20 add_watcher() i=0 2024-09-12T18:02:59.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.402+0000 7f3c6d4069c0 20 add_watcher() i=1 2024-09-12T18:02:59.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.402+0000 7f3c6d4069c0 20 add_watcher() i=2 2024-09-12T18:02:59.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.402+0000 7f3c6d4069c0 20 add_watcher() i=3 2024-09-12T18:02:59.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.402+0000 7f3c6d4069c0 20 add_watcher() i=4 2024-09-12T18:02:59.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.402+0000 7f3c6d4069c0 20 add_watcher() i=5 2024-09-12T18:02:59.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.402+0000 7f3c6d4069c0 20 add_watcher() i=6 2024-09-12T18:02:59.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.406+0000 7f3c6d4069c0 20 add_watcher() i=7 2024-09-12T18:02:59.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.406+0000 7f3c6d4069c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:59.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3b217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:59.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3c6d4069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:59.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3c6d4069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:59.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3c6d4069c0 5 note: GC not initialized 2024-09-12T18:02:59.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3a9bfff640 20 reqs_thread_entry: start 2024-09-12T18:02:59.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3c6d4069c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:59.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3c6d4069c0 20 Filter name: none 2024-09-12T18:02:59.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3a99ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:59.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3c6d4069c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:59.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3c6d4069c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:59.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3c6d4069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:59.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.410+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.414+0000 7f3c6d4069c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:59.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.414+0000 7f3c6d4069c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.414+0000 7f3c6d4069c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:59.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.414+0000 7f3c6d4069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:59.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.414+0000 7f3b217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:59.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.418+0000 7f3c6d4069c0 20 remove_watcher() i=0 2024-09-12T18:02:59.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.418+0000 7f3c6d4069c0 2 removed watcher, disabling cache 2024-09-12T18:02:59.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.422+0000 7f3c6d4069c0 20 remove_watcher() i=1 2024-09-12T18:02:59.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.422+0000 7f3c6d4069c0 20 remove_watcher() i=2 2024-09-12T18:02:59.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.426+0000 7f3c6d4069c0 20 remove_watcher() i=3 2024-09-12T18:02:59.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.426+0000 7f3c6d4069c0 20 remove_watcher() i=4 2024-09-12T18:02:59.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.430+0000 7f3c6d4069c0 20 remove_watcher() i=5 2024-09-12T18:02:59.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.430+0000 7f3c6d4069c0 20 remove_watcher() i=6 2024-09-12T18:02:59.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.434+0000 7f3c6d4069c0 20 remove_watcher() i=7 2024-09-12T18:02:59.449 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:59.449 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:59.449 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-set-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:02:59.450 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:59.450 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:59.451 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:59.488 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:59.488 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:59.547 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:02:59.582 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:59.582 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:59.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.626+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.626+0000 7f7c4f66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.626+0000 7f7c4f66b9c0 20 realm 2024-09-12T18:02:59.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.626+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.626+0000 7f7c4f66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.626+0000 7f7c4f66b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:59.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.626+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.630+0000 7f7c4f66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.630+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.630+0000 7f7c4f66b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:59.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.630+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.630+0000 7f7c4f66b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:59.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.630+0000 7f7c4f66b9c0 20 searching for the correct realm 2024-09-12T18:02:59.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.634+0000 7f7c4c970640 0 -- 172.21.15.97:0/2802050198 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f7c44013030 msgr2=0x7f7c4404f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:59.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.642+0000 7f7c4d171640 0 -- 172.21.15.97:0/2802050198 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f7c48065f20 msgr2=0x7f7c4805bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:59.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:59.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:59.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:59.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:59.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:59.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:59.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:59.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:59.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 zone default found 2024-09-12T18:02:59.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 4 Realm: () 2024-09-12T18:02:59.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:59.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:59.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:59.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 zonegroup default 2024-09-12T18:02:59.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 started sync module instance, tier type = 2024-09-12T18:02:59.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.650+0000 7f7c4f66b9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:59.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.670+0000 7f7c4f66b9c0 20 add_watcher() i=0 2024-09-12T18:02:59.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.670+0000 7f7c4f66b9c0 20 add_watcher() i=1 2024-09-12T18:02:59.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.670+0000 7f7c4f66b9c0 20 add_watcher() i=2 2024-09-12T18:02:59.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.670+0000 7f7c4f66b9c0 20 add_watcher() i=3 2024-09-12T18:02:59.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.670+0000 7f7c4f66b9c0 20 add_watcher() i=4 2024-09-12T18:02:59.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.670+0000 7f7c4f66b9c0 20 add_watcher() i=5 2024-09-12T18:02:59.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.670+0000 7f7c4f66b9c0 20 add_watcher() i=6 2024-09-12T18:02:59.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.674+0000 7f7c4f66b9c0 20 add_watcher() i=7 2024-09-12T18:02:59.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.674+0000 7f7c4f66b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:59.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7b03fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:59.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:59.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:59.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 5 note: GC not initialized 2024-09-12T18:02:59.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7b02fe5640 20 reqs_thread_entry: start 2024-09-12T18:02:59.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:59.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 20 Filter name: none 2024-09-12T18:02:59.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7b00fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:59.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T18:02:59.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:59.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T18:02:59.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T18:02:59.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 : miss 2024-09-12T18:02:59.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:59.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 info.flags=0x17 2024-09-12T18:02:59.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 to cache LRU end 2024-09-12T18:02:59.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:59.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:59.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.678+0000 7f7c4f66b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 2024-09-12T18:02:59.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.686+0000 7f7c4f66b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 info.flags=0x17 2024-09-12T18:02:59.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.686+0000 7f7c4f66b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 to cache LRU end 2024-09-12T18:02:59.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.686+0000 7f7c4f66b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:59.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.686+0000 7f7c4f66b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22, ofs0, ns] 2024-09-12T18:02:59.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.686+0000 7f7b1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431578 cookie 94917592191456 notifier 6525 bl.length()=925 2024-09-12T18:02:59.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.686+0000 7f7b1ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 info.flags=0x17 2024-09-12T18:02:59.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.686+0000 7f7b1ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 to cache LRU end 2024-09-12T18:02:59.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.686+0000 7f7b1ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:59.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.690+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): orig_sources= new_sources= 2024-09-12T18:02:59.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.690+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): potential sources added=[] removed=[] 2024-09-12T18:02:59.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.690+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): orig_dests= new_dests= 2024-09-12T18:02:59.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.690+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): potential dests added=[] removed=[] 2024-09-12T18:02:59.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.0 2024-09-12T18:02:59.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.0 2024-09-12T18:02:59.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.1 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.1 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.2 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.2 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.3 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.3 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.4 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.4 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.5 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.5 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.6 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.6 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.7 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.7 2024-09-12T18:02:59.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.8 2024-09-12T18:02:59.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.8 2024-09-12T18:02:59.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.9 2024-09-12T18:02:59.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.9 2024-09-12T18:02:59.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.10 2024-09-12T18:02:59.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.10 2024-09-12T18:02:59.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.11 2024-09-12T18:02:59.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1.11 2024-09-12T18:02:59.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.698+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.0 2024-09-12T18:02:59.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.702+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1 2024-09-12T18:02:59.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.702+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.2 2024-09-12T18:02:59.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.702+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.3 2024-09-12T18:02:59.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.702+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.4 2024-09-12T18:02:59.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.702+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.5 2024-09-12T18:02:59.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.702+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.6 2024-09-12T18:02:59.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.706+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.7 2024-09-12T18:02:59.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.706+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.8 2024-09-12T18:02:59.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.706+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.9 2024-09-12T18:02:59.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.710+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.10 2024-09-12T18:02:59.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.714+0000 7f7c4f66b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:59.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.714+0000 7f7c4f66b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 2024-09-12T18:02:59.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7c4f66b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 info.flags=0x17 2024-09-12T18:02:59.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7c4f66b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 to cache LRU end 2024-09-12T18:02:59.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7c4f66b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:59.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7c4f66b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22, ofs0, ns] 2024-09-12T18:02:59.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7b30ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431579 cookie 94917592191456 notifier 6525 bl.length()=925 2024-09-12T18:02:59.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7b30ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 info.flags=0x17 2024-09-12T18:02:59.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7b30ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 to cache LRU end 2024-09-12T18:02:59.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7b30ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:59.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): orig_sources= new_sources= 2024-09-12T18:02:59.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): potential sources added=[] removed=[] 2024-09-12T18:02:59.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): orig_dests= new_dests= 2024-09-12T18:02:59.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.718+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): potential dests added=[] removed=[] 2024-09-12T18:02:59.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.726+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.0 2024-09-12T18:02:59.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.726+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.1 2024-09-12T18:02:59.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.726+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.2 2024-09-12T18:02:59.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.726+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.3 2024-09-12T18:02:59.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.726+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.4 2024-09-12T18:02:59.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.726+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.5 2024-09-12T18:02:59.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.726+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.6 2024-09-12T18:02:59.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.730+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.7 2024-09-12T18:02:59.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.730+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.8 2024-09-12T18:02:59.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.730+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.9 2024-09-12T18:02:59.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.730+0000 7f7c4f66b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.22.10 2024-09-12T18:02:59.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.730+0000 7f7c4f66b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 : hit (requested=0x17, cached=0x17) 2024-09-12T18:02:59.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.730+0000 7f7c4f66b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 2024-09-12T18:02:59.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7c4f66b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 info.flags=0x17 2024-09-12T18:02:59.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7c4f66b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 to cache LRU end 2024-09-12T18:02:59.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7c4f66b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:59.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7c4f66b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22, ofs0, ns] 2024-09-12T18:02:59.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7b1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94917592191456 notifier 6525 bl.length()=893 2024-09-12T18:02:59.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7b1ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 info.flags=0x17 2024-09-12T18:02:59.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7b1ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.22 to cache LRU end 2024-09-12T18:02:59.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7b1ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:02:59.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): orig_sources= new_sources= 2024-09-12T18:02:59.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): potential sources added=[] removed=[] 2024-09-12T18:02:59.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): orig_dests= new_dests= 2024-09-12T18:02:59.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.734+0000 7f7c4f66b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.22]): potential dests added=[] removed=[] 2024-09-12T18:02:59.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.738+0000 7f7c4f66b9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:02:59.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.742+0000 7f7b03fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:59.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.746+0000 7f7c4f66b9c0 20 remove_watcher() i=0 2024-09-12T18:02:59.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.746+0000 7f7c4f66b9c0 2 removed watcher, disabling cache 2024-09-12T18:02:59.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.746+0000 7f7c4f66b9c0 20 remove_watcher() i=1 2024-09-12T18:02:59.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.750+0000 7f7c4f66b9c0 20 remove_watcher() i=2 2024-09-12T18:02:59.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.754+0000 7f7c4f66b9c0 20 remove_watcher() i=3 2024-09-12T18:02:59.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.754+0000 7f7c4f66b9c0 20 remove_watcher() i=4 2024-09-12T18:02:59.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.758+0000 7f7c4f66b9c0 20 remove_watcher() i=5 2024-09-12T18:02:59.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.758+0000 7f7c4f66b9c0 20 remove_watcher() i=6 2024-09-12T18:02:59.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.762+0000 7f7c4f66b9c0 20 remove_watcher() i=7 2024-09-12T18:02:59.777 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:02:59.804 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:59.805 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:59.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.846+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.850+0000 7f2dd085f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.850+0000 7f2dd085f9c0 20 realm 2024-09-12T18:02:59.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.850+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.850+0000 7f2dd085f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.850+0000 7f2dd085f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:59.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.850+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.850+0000 7f2dd085f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.850+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.850+0000 7f2dd085f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:59.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.850+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.854+0000 7f2dd085f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:59.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.854+0000 7f2dd085f9c0 20 searching for the correct realm 2024-09-12T18:02:59.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.858+0000 7f2dce365640 0 -- 172.21.15.97:0/1445639406 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f2dc0028040 msgr2=0x7f2dc0029430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:59.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.866+0000 7f2dce365640 0 -- 172.21.15.97:0/1445639406 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x5639a4b00cf0 msgr2=0x5639a4b030e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:59.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.870+0000 7f2dd085f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:02:59.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.870+0000 7f2dd085f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:59.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.870+0000 7f2dd085f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:59.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.870+0000 7f2dd085f9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:02:59.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.870+0000 7f2dd085f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:59.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.870+0000 7f2dd085f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:59.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.870+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.870+0000 7f2dd085f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.870+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.870+0000 7f2dd085f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:59.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.870+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:59.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 20 zone default found 2024-09-12T18:02:59.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 4 Realm: () 2024-09-12T18:02:59.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:02:59.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:02:59.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:59.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 20 zonegroup default 2024-09-12T18:02:59.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:59.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 20 started sync module instance, tier type = 2024-09-12T18:02:59.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.874+0000 7f2dd085f9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:02:59.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.890+0000 7f2dd085f9c0 20 add_watcher() i=0 2024-09-12T18:02:59.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.890+0000 7f2dd085f9c0 20 add_watcher() i=1 2024-09-12T18:02:59.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.890+0000 7f2dd085f9c0 20 add_watcher() i=2 2024-09-12T18:02:59.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.890+0000 7f2dd085f9c0 20 add_watcher() i=3 2024-09-12T18:02:59.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.890+0000 7f2dd085f9c0 20 add_watcher() i=4 2024-09-12T18:02:59.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.890+0000 7f2dd085f9c0 20 add_watcher() i=5 2024-09-12T18:02:59.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.890+0000 7f2dd085f9c0 20 add_watcher() i=6 2024-09-12T18:02:59.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.894+0000 7f2dd085f9c0 20 add_watcher() i=7 2024-09-12T18:02:59.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.894+0000 7f2dd085f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:59.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2c84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:59.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2dd085f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:59.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2dd085f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:59.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2dd085f9c0 5 note: GC not initialized 2024-09-12T18:02:59.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2bff7fe640 20 reqs_thread_entry: start 2024-09-12T18:02:59.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2dd085f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:59.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2dd085f9c0 20 Filter name: none 2024-09-12T18:02:59.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2bfd7fa640 20 reqs_thread_entry: start 2024-09-12T18:02:59.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2dd085f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:59.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2dd085f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:59.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2dd085f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:59.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.898+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.902+0000 7f2dd085f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:02:59.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.902+0000 7f2dd085f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:59.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.902+0000 7f2dd085f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:02:59.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.902+0000 7f2dd085f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:59.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.902+0000 7f2c84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:59.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.906+0000 7f2dd085f9c0 20 remove_watcher() i=0 2024-09-12T18:02:59.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.906+0000 7f2dd085f9c0 2 removed watcher, disabling cache 2024-09-12T18:02:59.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.910+0000 7f2dd085f9c0 20 remove_watcher() i=1 2024-09-12T18:02:59.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.910+0000 7f2dd085f9c0 20 remove_watcher() i=2 2024-09-12T18:02:59.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.914+0000 7f2dd085f9c0 20 remove_watcher() i=3 2024-09-12T18:02:59.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.914+0000 7f2dd085f9c0 20 remove_watcher() i=4 2024-09-12T18:02:59.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.918+0000 7f2dd085f9c0 20 remove_watcher() i=5 2024-09-12T18:02:59.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.918+0000 7f2dd085f9c0 20 remove_watcher() i=6 2024-09-12T18:02:59.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:02:59.922+0000 7f2dd085f9c0 20 remove_watcher() i=7 2024-09-12T18:02:59.937 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:59.937 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:02:59.937 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-set-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:02:59.937 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:02:59.938 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:59.939 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:02:59.960 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:59.960 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:00.502 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:00.502 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:00.882 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T18:03:00.882 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:00.884 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:00.884 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:01.020 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:01.021 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:01.104 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:01.105 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:01.197 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:01.197 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:01.297 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:01.297 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:01.394 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:01.395 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:01.490 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:01.490 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:01.582 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:01.582 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:01.677 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:01.677 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:01.776 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:01.776 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:01.871 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:01.871 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:01.965 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:01.965 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:02.061 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:02.061 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:02.163 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:02.163 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:02.258 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:02.258 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:02.344 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:02.344 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:02.436 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:02.436 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:02.529 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:02.530 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:02.624 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:02.624 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:02.719 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:02.719 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:02.813 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:02.813 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:02.912 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:02.913 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:03.009 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:03:03.043 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:03.043 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:03.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.090+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.090+0000 7f4993bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.090+0000 7f4993bdc9c0 20 realm 2024-09-12T18:03:03.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.090+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.090+0000 7f4993bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.090+0000 7f4993bdc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:03.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.094+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.094+0000 7f4993bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.094+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.094+0000 7f4993bdc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:03.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.094+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.094+0000 7f4993bdc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:03.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.094+0000 7f4993bdc9c0 20 searching for the correct realm 2024-09-12T18:03:03.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.102+0000 7f4990ee1640 0 -- 172.21.15.97:0/1043158636 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f498802e410 msgr2=0x7f498802e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:03.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.106+0000 7f4990ee1640 0 -- 172.21.15.97:0/1043158636 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x559be8824660 msgr2=0x559be8826a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:03.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:03.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:03.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:03.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:03.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:03.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:03.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:03.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:03.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 zone default found 2024-09-12T18:03:03.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 4 Realm: () 2024-09-12T18:03:03.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:03.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:03.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:03.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 zonegroup default 2024-09-12T18:03:03.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.114+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.118+0000 7f4993bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.118+0000 7f4993bdc9c0 20 started sync module instance, tier type = 2024-09-12T18:03:03.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.118+0000 7f4993bdc9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:03.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.134+0000 7f4993bdc9c0 20 add_watcher() i=0 2024-09-12T18:03:03.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.134+0000 7f4993bdc9c0 20 add_watcher() i=1 2024-09-12T18:03:03.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.134+0000 7f4993bdc9c0 20 add_watcher() i=2 2024-09-12T18:03:03.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.134+0000 7f4993bdc9c0 20 add_watcher() i=3 2024-09-12T18:03:03.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.134+0000 7f4993bdc9c0 20 add_watcher() i=4 2024-09-12T18:03:03.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.134+0000 7f4993bdc9c0 20 add_watcher() i=5 2024-09-12T18:03:03.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.134+0000 7f4993bdc9c0 20 add_watcher() i=6 2024-09-12T18:03:03.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.138+0000 7f4993bdc9c0 20 add_watcher() i=7 2024-09-12T18:03:03.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.138+0000 7f4993bdc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:03.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.142+0000 7f4847fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:03.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.142+0000 7f4993bdc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:03.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.142+0000 7f4993bdc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:03.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.142+0000 7f4993bdc9c0 5 note: GC not initialized 2024-09-12T18:03:03.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.142+0000 7f4846fe5640 20 reqs_thread_entry: start 2024-09-12T18:03:03.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.142+0000 7f4993bdc9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:03.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.142+0000 7f4993bdc9c0 20 Filter name: none 2024-09-12T18:03:03.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.142+0000 7f4844fe1640 20 reqs_thread_entry: start 2024-09-12T18:03:03.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.142+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.146+0000 7f4993bdc9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:03.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.146+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.146+0000 7f4993bdc9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:03.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.146+0000 7f4993bdc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:03.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.146+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.146+0000 7f4993bdc9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:03.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.146+0000 7f4993bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.146+0000 7f4993bdc9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:03.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.146+0000 7f4993bdc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:03.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.150+0000 7f4847fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:03.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.154+0000 7f4993bdc9c0 20 remove_watcher() i=0 2024-09-12T18:03:03.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.154+0000 7f4993bdc9c0 2 removed watcher, disabling cache 2024-09-12T18:03:03.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.154+0000 7f4993bdc9c0 20 remove_watcher() i=1 2024-09-12T18:03:03.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.158+0000 7f4993bdc9c0 20 remove_watcher() i=2 2024-09-12T18:03:03.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.158+0000 7f4993bdc9c0 20 remove_watcher() i=3 2024-09-12T18:03:03.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.162+0000 7f4993bdc9c0 20 remove_watcher() i=4 2024-09-12T18:03:03.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.162+0000 7f4993bdc9c0 20 remove_watcher() i=5 2024-09-12T18:03:03.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.166+0000 7f4993bdc9c0 20 remove_watcher() i=6 2024-09-12T18:03:03.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.170+0000 7f4993bdc9c0 20 remove_watcher() i=7 2024-09-12T18:03:03.184 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:03.184 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:03.184 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-set-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:03:03.184 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:03.184 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T18:03:03.219 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:03.220 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:03.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.266+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.270+0000 7fb629d2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.270+0000 7fb629d2e9c0 20 realm 2024-09-12T18:03:03.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.270+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.270+0000 7fb629d2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.270+0000 7fb629d2e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:03.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.270+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.270+0000 7fb629d2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.270+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.270+0000 7fb629d2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:03.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.270+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.274+0000 7fb629d2e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:03.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.274+0000 7fb629d2e9c0 20 searching for the correct realm 2024-09-12T18:03:03.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.274+0000 7fb627834640 0 -- 172.21.15.97:0/3677682253 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fb618069510 msgr2=0x7fb61809e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:03.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.486+0000 7fb627834640 0 -- 172.21.15.97:0/3677682253 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x55e0c101f420 msgr2=0x7fb6200f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:03.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.702+0000 7fb629d2e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:03.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.702+0000 7fb629d2e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:03.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.702+0000 7fb629d2e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:03.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.702+0000 7fb629d2e9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:03.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.702+0000 7fb629d2e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:03.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.702+0000 7fb629d2e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:03.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.702+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:03.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:03.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 20 zone default found 2024-09-12T18:03:03.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 4 Realm: () 2024-09-12T18:03:03.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:03.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:03.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:03.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 20 zonegroup default 2024-09-12T18:03:03.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.706+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.710+0000 7fb629d2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.710+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.710+0000 7fb629d2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.710+0000 7fb629d2e9c0 20 started sync module instance, tier type = 2024-09-12T18:03:03.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.710+0000 7fb629d2e9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:03.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.734+0000 7fb629d2e9c0 20 add_watcher() i=0 2024-09-12T18:03:03.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.734+0000 7fb629d2e9c0 20 add_watcher() i=1 2024-09-12T18:03:03.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.734+0000 7fb629d2e9c0 20 add_watcher() i=2 2024-09-12T18:03:03.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.734+0000 7fb629d2e9c0 20 add_watcher() i=3 2024-09-12T18:03:03.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.734+0000 7fb629d2e9c0 20 add_watcher() i=4 2024-09-12T18:03:03.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.734+0000 7fb629d2e9c0 20 add_watcher() i=5 2024-09-12T18:03:03.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.734+0000 7fb629d2e9c0 20 add_watcher() i=6 2024-09-12T18:03:03.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.734+0000 7fb629d2e9c0 20 add_watcher() i=7 2024-09-12T18:03:03.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.734+0000 7fb629d2e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:03.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb4de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:03.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:03.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:03.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 5 note: GC not initialized 2024-09-12T18:03:03.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb4dd7e2640 20 reqs_thread_entry: start 2024-09-12T18:03:03.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:03.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 20 Filter name: none 2024-09-12T18:03:03.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb4d67fc640 20 reqs_thread_entry: start 2024-09-12T18:03:03.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T18:03:03.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:03.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T18:03:03.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T18:03:03.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 : miss 2024-09-12T18:03:03.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.742+0000 7fb629d2e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.746+0000 7fb629d2e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:03.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.746+0000 7fb629d2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 info.flags=0x17 2024-09-12T18:03:03.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.746+0000 7fb629d2e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 to cache LRU end 2024-09-12T18:03:03.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.746+0000 7fb629d2e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:03.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.746+0000 7fb629d2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:03.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.746+0000 7fb629d2e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 2024-09-12T18:03:03.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.754+0000 7fb629d2e9c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T18:03:03.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.758+0000 7fb629d2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 info.flags=0x17 2024-09-12T18:03:03.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.758+0000 7fb629d2e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 to cache LRU end 2024-09-12T18:03:03.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.758+0000 7fb629d2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:03.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.758+0000 7fb629d2e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23, ofs0, ns] 2024-09-12T18:03:03.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.758+0000 7fb506ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431583 cookie 94423801689008 notifier 6197 bl.length()=925 2024-09-12T18:03:03.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.758+0000 7fb506ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 info.flags=0x17 2024-09-12T18:03:03.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.758+0000 7fb506ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 to cache LRU end 2024-09-12T18:03:03.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.758+0000 7fb506ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:03.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.762+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): orig_sources= new_sources= 2024-09-12T18:03:03.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.762+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): potential sources added=[] removed=[] 2024-09-12T18:03:03.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.762+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): orig_dests= new_dests= 2024-09-12T18:03:03.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.762+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): potential dests added=[] removed=[] 2024-09-12T18:03:03.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.0 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.0 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.1 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.1 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.2 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.2 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.3 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.3 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.4 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.4 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.5 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.5 2024-09-12T18:03:03.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.6 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.6 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.7 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.7 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.8 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.8 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.9 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.9 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.10 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.10 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.11 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1.11 2024-09-12T18:03:03.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.0 2024-09-12T18:03:03.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1 2024-09-12T18:03:03.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.2 2024-09-12T18:03:03.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.3 2024-09-12T18:03:03.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.778+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.4 2024-09-12T18:03:03.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.782+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.5 2024-09-12T18:03:03.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.782+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.6 2024-09-12T18:03:03.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.782+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.7 2024-09-12T18:03:03.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.782+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.8 2024-09-12T18:03:03.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.786+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.9 2024-09-12T18:03:03.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.786+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.10 2024-09-12T18:03:03.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.798+0000 7fb629d2e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:03.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.798+0000 7fb629d2e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 2024-09-12T18:03:03.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.798+0000 7fb629d2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 info.flags=0x17 2024-09-12T18:03:03.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.798+0000 7fb629d2e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 to cache LRU end 2024-09-12T18:03:03.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.798+0000 7fb629d2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:03.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.798+0000 7fb629d2e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23, ofs0, ns] 2024-09-12T18:03:03.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.798+0000 7fb506ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431584 cookie 94423801689008 notifier 6197 bl.length()=925 2024-09-12T18:03:03.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.798+0000 7fb506ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 info.flags=0x17 2024-09-12T18:03:03.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.798+0000 7fb506ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 to cache LRU end 2024-09-12T18:03:03.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.798+0000 7fb506ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:03.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.802+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): orig_sources= new_sources= 2024-09-12T18:03:03.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.802+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): potential sources added=[] removed=[] 2024-09-12T18:03:03.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.802+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): orig_dests= new_dests= 2024-09-12T18:03:03.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.802+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): potential dests added=[] removed=[] 2024-09-12T18:03:03.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.810+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.0 2024-09-12T18:03:03.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.810+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.1 2024-09-12T18:03:03.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.810+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.2 2024-09-12T18:03:03.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.810+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.3 2024-09-12T18:03:03.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.810+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.4 2024-09-12T18:03:03.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.814+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.5 2024-09-12T18:03:03.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.814+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.6 2024-09-12T18:03:03.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.814+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.7 2024-09-12T18:03:03.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.814+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.8 2024-09-12T18:03:03.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.814+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.9 2024-09-12T18:03:03.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.814+0000 7fb629d2e9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.23.10 2024-09-12T18:03:03.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.818+0000 7fb629d2e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:03.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.818+0000 7fb629d2e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 2024-09-12T18:03:03.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.818+0000 7fb629d2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 info.flags=0x17 2024-09-12T18:03:03.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.818+0000 7fb629d2e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 to cache LRU end 2024-09-12T18:03:03.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.818+0000 7fb629d2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:03.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.818+0000 7fb629d2e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23, ofs0, ns] 2024-09-12T18:03:03.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.818+0000 7fb5067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94423801689008 notifier 6197 bl.length()=893 2024-09-12T18:03:03.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.818+0000 7fb5067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 info.flags=0x17 2024-09-12T18:03:03.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.818+0000 7fb5067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.23 to cache LRU end 2024-09-12T18:03:03.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.818+0000 7fb5067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:03.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.822+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): orig_sources= new_sources= 2024-09-12T18:03:03.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.822+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): potential sources added=[] removed=[] 2024-09-12T18:03:03.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.822+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): orig_dests= new_dests= 2024-09-12T18:03:03.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.822+0000 7fb629d2e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.23]): potential dests added=[] removed=[] 2024-09-12T18:03:03.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.826+0000 7fb629d2e9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:03:03.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.830+0000 7fb4de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:03.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.834+0000 7fb629d2e9c0 20 remove_watcher() i=0 2024-09-12T18:03:03.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.834+0000 7fb629d2e9c0 2 removed watcher, disabling cache 2024-09-12T18:03:03.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.838+0000 7fb629d2e9c0 20 remove_watcher() i=1 2024-09-12T18:03:03.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.838+0000 7fb629d2e9c0 20 remove_watcher() i=2 2024-09-12T18:03:03.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.842+0000 7fb629d2e9c0 20 remove_watcher() i=3 2024-09-12T18:03:03.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.846+0000 7fb629d2e9c0 20 remove_watcher() i=4 2024-09-12T18:03:03.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.846+0000 7fb629d2e9c0 20 remove_watcher() i=5 2024-09-12T18:03:03.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.850+0000 7fb629d2e9c0 20 remove_watcher() i=6 2024-09-12T18:03:03.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.854+0000 7fb629d2e9c0 20 remove_watcher() i=7 2024-09-12T18:03:03.871 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:03:03.901 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:03.901 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:03.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.946+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.946+0000 7f0c305ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.946+0000 7f0c305ff9c0 20 realm 2024-09-12T18:03:03.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.946+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.950+0000 7f0c305ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.950+0000 7f0c305ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:03.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.950+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.950+0000 7f0c305ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.950+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.950+0000 7f0c305ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:03.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.950+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.950+0000 7f0c305ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:03.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.950+0000 7f0c305ff9c0 20 searching for the correct realm 2024-09-12T18:03:03.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.958+0000 7f0c2e105640 0 -- 172.21.15.97:0/684885488 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f0c200e1040 msgr2=0x7f0c200e0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:03.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.962+0000 7f0c2e105640 0 -- 172.21.15.97:0/684885488 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55852b5d2770 msgr2=0x55852b5d4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:03.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:03.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:03.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:03.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:03.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:03.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:03.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:03.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:03.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 zone default found 2024-09-12T18:03:03.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 4 Realm: () 2024-09-12T18:03:03.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:03.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:03.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:03.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 zonegroup default 2024-09-12T18:03:03.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:03.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 started sync module instance, tier type = 2024-09-12T18:03:03.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.970+0000 7f0c305ff9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:03.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.990+0000 7f0c305ff9c0 20 add_watcher() i=0 2024-09-12T18:03:03.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.990+0000 7f0c305ff9c0 20 add_watcher() i=1 2024-09-12T18:03:03.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.990+0000 7f0c305ff9c0 20 add_watcher() i=2 2024-09-12T18:03:03.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.990+0000 7f0c305ff9c0 20 add_watcher() i=3 2024-09-12T18:03:03.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.990+0000 7f0c305ff9c0 20 add_watcher() i=4 2024-09-12T18:03:03.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.990+0000 7f0c305ff9c0 20 add_watcher() i=5 2024-09-12T18:03:03.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.990+0000 7f0c305ff9c0 20 add_watcher() i=6 2024-09-12T18:03:03.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.994+0000 7f0c305ff9c0 20 add_watcher() i=7 2024-09-12T18:03:03.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.994+0000 7f0c305ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:03.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0ae57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:03.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:03.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:03.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 5 note: GC not initialized 2024-09-12T18:03:03.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0adf7fe640 20 reqs_thread_entry: start 2024-09-12T18:03:03.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:03.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 Filter name: none 2024-09-12T18:03:03.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0add7fa640 20 reqs_thread_entry: start 2024-09-12T18:03:03.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:03.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:03.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:04.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:04.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:04.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:04.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:04.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:03.998+0000 7f0c305ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:04.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.002+0000 7f0c305ff9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:04.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.002+0000 7f0c305ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:04.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.002+0000 7f0ae57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:04.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.006+0000 7f0c305ff9c0 20 remove_watcher() i=0 2024-09-12T18:03:04.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.006+0000 7f0c305ff9c0 2 removed watcher, disabling cache 2024-09-12T18:03:04.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.010+0000 7f0c305ff9c0 20 remove_watcher() i=1 2024-09-12T18:03:04.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.010+0000 7f0c305ff9c0 20 remove_watcher() i=2 2024-09-12T18:03:04.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.014+0000 7f0c305ff9c0 20 remove_watcher() i=3 2024-09-12T18:03:04.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.014+0000 7f0c305ff9c0 20 remove_watcher() i=4 2024-09-12T18:03:04.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.018+0000 7f0c305ff9c0 20 remove_watcher() i=5 2024-09-12T18:03:04.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.022+0000 7f0c305ff9c0 20 remove_watcher() i=6 2024-09-12T18:03:04.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:04.022+0000 7f0c305ff9c0 20 remove_watcher() i=7 2024-09-12T18:03:04.040 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:04.040 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:04.040 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-set-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T18:03:04.041 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:04.042 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:04.042 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:04.062 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:04.062 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:04.616 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:04.616 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:04.998 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T18:03:04.998 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:05.001 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:05.001 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:05.134 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:05.134 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:05.221 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:05.222 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:05.327 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:05.327 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:05.428 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:05.428 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:05.521 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:05.521 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:05.619 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:05.619 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:05.714 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:05.714 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:05.807 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:05.807 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:05.902 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:05.902 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:05.996 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:05.997 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:06.091 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:06.092 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:06.186 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:06.187 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:06.290 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:06.290 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:06.385 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:06.386 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:06.479 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:06.479 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:06.577 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:06.577 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:06.674 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:06.674 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:06.771 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:06.771 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:06.872 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:06.872 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:06.969 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:06.969 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:07.064 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:07.064 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:07.155 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T18:03:07.188 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:07.188 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:07.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.234+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.234+0000 7f01a1d1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.234+0000 7f01a1d1d9c0 20 realm 2024-09-12T18:03:07.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.234+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.234+0000 7f01a1d1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.234+0000 7f01a1d1d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:07.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.234+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.234+0000 7f01a1d1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.234+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.238+0000 7f01a1d1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:07.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.238+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.238+0000 7f01a1d1d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:07.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.238+0000 7f01a1d1d9c0 20 searching for the correct realm 2024-09-12T18:03:07.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.246+0000 7f01a0024640 0 -- 172.21.15.97:0/1621969477 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x559d4dad7a30 msgr2=0x559d4dad9e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:07.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.250+0000 7f019f823640 0 -- 172.21.15.97:0/1621969477 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x559d4dadbc30 msgr2=0x559d4dade020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:07.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:07.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:07.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:07.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:07.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:07.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:07.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:07.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:07.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 zone default found 2024-09-12T18:03:07.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 4 Realm: () 2024-09-12T18:03:07.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:07.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:07.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:07.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 zonegroup default 2024-09-12T18:03:07.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.258+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.262+0000 7f01a1d1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.262+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.262+0000 7f01a1d1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.262+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.262+0000 7f01a1d1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.262+0000 7f01a1d1d9c0 20 started sync module instance, tier type = 2024-09-12T18:03:07.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.262+0000 7f01a1d1d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:07.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.282+0000 7f01a1d1d9c0 20 add_watcher() i=0 2024-09-12T18:03:07.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.282+0000 7f01a1d1d9c0 20 add_watcher() i=1 2024-09-12T18:03:07.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.282+0000 7f01a1d1d9c0 20 add_watcher() i=2 2024-09-12T18:03:07.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.282+0000 7f01a1d1d9c0 20 add_watcher() i=3 2024-09-12T18:03:07.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.282+0000 7f01a1d1d9c0 20 add_watcher() i=4 2024-09-12T18:03:07.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.282+0000 7f01a1d1d9c0 20 add_watcher() i=5 2024-09-12T18:03:07.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.282+0000 7f01a1d1d9c0 20 add_watcher() i=6 2024-09-12T18:03:07.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.282+0000 7f01a1d1d9c0 20 add_watcher() i=7 2024-09-12T18:03:07.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.282+0000 7f01a1d1d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:07.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.286+0000 7f0055fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:07.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.286+0000 7f01a1d1d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:07.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.286+0000 7f01a1d1d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:07.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.286+0000 7f01a1d1d9c0 5 note: GC not initialized 2024-09-12T18:03:07.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.286+0000 7f0054fe1640 20 reqs_thread_entry: start 2024-09-12T18:03:07.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.286+0000 7f01a1d1d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:07.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.286+0000 7f01a1d1d9c0 20 Filter name: none 2024-09-12T18:03:07.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.286+0000 7effce7fc640 20 reqs_thread_entry: start 2024-09-12T18:03:07.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.286+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.290+0000 7f01a1d1d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:07.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.290+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.290+0000 7f01a1d1d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:07.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.290+0000 7f01a1d1d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:07.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.290+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.290+0000 7f01a1d1d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:07.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.290+0000 7f01a1d1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.290+0000 7f01a1d1d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:07.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.290+0000 7f01a1d1d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:07.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.294+0000 7f0055fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:07.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.298+0000 7f01a1d1d9c0 20 remove_watcher() i=0 2024-09-12T18:03:07.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.298+0000 7f01a1d1d9c0 2 removed watcher, disabling cache 2024-09-12T18:03:07.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.298+0000 7f01a1d1d9c0 20 remove_watcher() i=1 2024-09-12T18:03:07.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.302+0000 7f01a1d1d9c0 20 remove_watcher() i=2 2024-09-12T18:03:07.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.302+0000 7f01a1d1d9c0 20 remove_watcher() i=3 2024-09-12T18:03:07.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.306+0000 7f01a1d1d9c0 20 remove_watcher() i=4 2024-09-12T18:03:07.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.310+0000 7f01a1d1d9c0 20 remove_watcher() i=5 2024-09-12T18:03:07.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.310+0000 7f01a1d1d9c0 20 remove_watcher() i=6 2024-09-12T18:03:07.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.314+0000 7f01a1d1d9c0 20 remove_watcher() i=7 2024-09-12T18:03:07.329 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.329 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:07.329 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-set-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:03:07.329 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.330 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T18:03:07.362 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:07.362 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:07.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.406+0000 7fe928f609c0 20 realm 2024-09-12T18:03:07.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.406+0000 7fe928f609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:07.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:07.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.410+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:07.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.410+0000 7fe928f609c0 20 searching for the correct realm 2024-09-12T18:03:07.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.414+0000 7fe926265640 0 -- 172.21.15.97:0/3110045445 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fe91c0e47f0 msgr2=0x7fe91c0c1970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:07.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.422+0000 7fe926a66640 0 -- 172.21.15.97:0/3110045445 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fe91c0e47f0 msgr2=0x7fe7f0085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:07.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:07.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:07.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:07.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:07.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:07.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:07.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.638+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:07.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:07.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 zone default found 2024-09-12T18:03:07.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 4 Realm: () 2024-09-12T18:03:07.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:07.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:07.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:07.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 zonegroup default 2024-09-12T18:03:07.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.646+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.646+0000 7fe928f609c0 20 started sync module instance, tier type = 2024-09-12T18:03:07.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.646+0000 7fe928f609c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:07.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=0 2024-09-12T18:03:07.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=1 2024-09-12T18:03:07.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=2 2024-09-12T18:03:07.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=3 2024-09-12T18:03:07.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=4 2024-09-12T18:03:07.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=5 2024-09-12T18:03:07.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=6 2024-09-12T18:03:07.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=7 2024-09-12T18:03:07.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.670+0000 7fe928f609c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:07.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.674+0000 7fe7ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:07.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.674+0000 7fe928f609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:07.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.674+0000 7fe928f609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:07.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 5 note: GC not initialized 2024-09-12T18:03:07.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe7dcfe1640 20 reqs_thread_entry: start 2024-09-12T18:03:07.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:07.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 20 Filter name: none 2024-09-12T18:03:07.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe7d5ffb640 20 reqs_thread_entry: start 2024-09-12T18:03:07.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:03:07.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:07.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:03:07.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:03:07.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 : miss 2024-09-12T18:03:07.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:07.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 info.flags=0x17 2024-09-12T18:03:07.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to cache LRU end 2024-09-12T18:03:07.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:07.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:07.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.678+0000 7fe928f609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 2024-09-12T18:03:07.688 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe928f609c0 time 2024-09-12T18:03:07.691460+0000 2024-09-12T18:03:07.688 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:07.690 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:07.690 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe92c83a2eb] 2024-09-12T18:03:07.690 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe92c83a49f] 2024-09-12T18:03:07.690 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbdc8a50c1] 2024-09-12T18:03:07.690 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x140f6b8) [0x55dbdd2fa6b8] 2024-09-12T18:03:07.690 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbdc8b718d] 2024-09-12T18:03:07.690 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:03:07.690 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe92b6a0d90] 2024-09-12T18:03:07.690 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:03:07.690 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:03:07.690 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:03:07.691 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fe928f609c0 thread_name:radosgw-admin 2024-09-12T18:03:07.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.690+0000 7fe928f609c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe928f609c0 time 2024-09-12T18:03:07.691460+0000 2024-09-12T18:03:07.691 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:07.691 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.691 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:07.691 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe92c83a2eb] 2024-09-12T18:03:07.691 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe92c83a49f] 2024-09-12T18:03:07.691 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbdc8a50c1] 2024-09-12T18:03:07.692 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x140f6b8) [0x55dbdd2fa6b8] 2024-09-12T18:03:07.692 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbdc8b718d] 2024-09-12T18:03:07.692 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:03:07.692 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe92b6a0d90] 2024-09-12T18:03:07.692 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:03:07.692 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:03:07.692 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.713 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:07.713 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe92b6b9520] 2024-09-12T18:03:07.713 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:03:07.713 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:03:07.713 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:03:07.713 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe92c83a345] 2024-09-12T18:03:07.713 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe92c83a49f] 2024-09-12T18:03:07.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbdc8a50c1] 2024-09-12T18:03:07.713 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x140f6b8) [0x55dbdd2fa6b8] 2024-09-12T18:03:07.713 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbdc8b718d] 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe92b6a0d90] 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.690+0000 7fe928f609c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fe928f609c0 thread_name:radosgw-admin 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe92b6b9520] 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:03:07.714 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe92c83a345] 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe92c83a49f] 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbdc8a50c1] 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x140f6b8) [0x55dbdd2fa6b8] 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbdc8b718d] 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe92b6a0d90] 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:03:07.715 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.716 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.716 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.716 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.716 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.716 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.717 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.717 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.717 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.717 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient(hunting): handle_auth_done global_id 6239 payload 274 2024-09-12T18:03:07.717 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient: _finish_hunting 0 2024-09-12T18:03:07.717 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:03:07.382+0000 7fe926a66640 1 monclient: found mon.noname-c 2024-09-12T18:03:07.717 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.717 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:03:07.382+0000 7fe926265640 10 monclient: get_auth_request con 0x55dbddbce1e0 auth_method 0 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: dump: 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.718 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: _finish_auth 0 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: _check_auth_tickets 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: dump: 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.719 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 monclient: authenticate success, global_id 6239 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:03:07.382+0000 7fe928f609c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:03:07.382+0000 7fe928f609c0 4 set_mon_vals no callback set 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:03:07.382+0000 7fe928f609c0 10 monclient: shutdown 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 asok(0x55dbdda782b0) unregister_commands rotate-key 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:03:07.382+0000 7fe928f609c0 10 monclient: build_initial_monmap 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:03:07.382+0000 7fe928f609c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:03:07.382+0000 7fe928f609c0 10 monclient: monmap: 2024-09-12T18:03:07.720 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding auth protocol: cephx 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding auth protocol: cephx 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding auth protocol: cephx 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.721 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:03:07.382+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:03:07.382+0000 7fe928f609c0 1 librados: starting msgr at 2024-09-12T18:03:07.722 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:03:07.382+0000 7fe928f609c0 1 librados: starting objecter 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command objecter_requests hook 0x55dbddc87790 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:03:07.386+0000 7fe928f609c0 1 librados: setting wanted keys 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:03:07.386+0000 7fe928f609c0 1 librados: calling monclient init 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: init 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding auth protocol: cephx 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding auth protocol: cephx 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding auth protocol: cephx 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.723 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:03:07.386+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:03:07.386+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command rotate-key hook 0x55dbddc85298 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:03:07.724 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-c con 0x55dbddb352b0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-a con 0x55dbddbce1e0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-b con 0x55dbddbd0db0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): authenticate will time out at 2616.796609s 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): get_auth_request con 0x55dbddbce1e0 auth_method 0 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): get_auth_request con 0x55dbddb352b0 auth_method 0 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.725 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): handle_auth_done global_id 6621 payload 824 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient: _finish_hunting 0 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:03:07.386+0000 7fe926265640 1 monclient: found mon.noname-a 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.726 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: dump: 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: _finish_auth 0 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: _check_auth_tickets 2024-09-12T18:03:07.727 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: dump: 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.728 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:03:07.386+0000 7fe814e09640 4 set_mon_vals no callback set 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 monclient: authenticate success, global_id 6621 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:03:07.386+0000 7fe928f609c0 1 librados: init done 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:03:07.386+0000 7fe813606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:03:07.386+0000 7fe813606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:03:07.386+0000 7fe813606640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:03:07.390+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe80c070ae0 auth_method 0 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:03:07.390+0000 7fe927267640 10 monclient: get_auth_request con 0x55dbddcc3230 auth_method 0 2024-09-12T18:03:07.729 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:03:07.390+0000 7fe926a66640 10 monclient: get_auth_request con 0x55dbddccfc20 auth_method 0 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:03:07.390+0000 7fe926265640 10 monclient: get_auth_request con 0x55dbddcd3f80 auth_method 0 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: build_initial_monmap 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:03:07.394+0000 7fe928f609c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: monmap: 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:07.730 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding auth protocol: cephx 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding auth protocol: cephx 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding auth protocol: cephx 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.731 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:03:07.394+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command objecter_requests cmddesc objecter_requests hook 0x55dbddcdc770 EEXIST 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: init 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding auth protocol: cephx 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding auth protocol: cephx 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding auth protocol: cephx 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.732 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:03:07.394+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:03:07.394+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command rotate-key cmddesc rotate-key hook 0x55dbddcd7550 EEXIST 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-b con 0x55dbddd00920 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:07.733 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-c con 0x55dbddd00250 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-a con 0x55dbddcfec30 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): authenticate will time out at 2616.807080s 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): get_auth_request con 0x55dbddcfec30 auth_method 0 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): get_auth_request con 0x55dbddd00250 auth_method 0 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.734 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:03:07.394+0000 7fe926a66640 10 monclient(hunting): get_auth_request con 0x55dbddd00920 auth_method 0 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:03:07.394+0000 7fe926a66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:03:07.394+0000 7fe926a66640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:03:07.394+0000 7fe926a66640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): handle_auth_done global_id 6245 payload 824 2024-09-12T18:03:07.735 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient: _finish_hunting 0 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:03:07.394+0000 7fe926265640 1 monclient: found mon.noname-c 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: dump: 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.736 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: _finish_auth 0 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: _check_auth_tickets 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: dump: 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.737 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 monclient: authenticate success, global_id 6245 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:03:07.394+0000 7fe927a68640 4 set_mon_vals no callback set 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.738 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:03:07.398+0000 7fe810e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:03:07.398+0000 7fe810e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:03:07.398+0000 7fe810e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:03:07.398+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe800070a20 auth_method 0 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: get_monmap_and_config 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: build_initial_monmap 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:03:07.398+0000 7fe928f609c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: monmap: 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.739 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding auth protocol: cephx 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding auth protocol: cephx 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding auth protocol: cephx 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.740 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:03:07.398+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: init 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding auth protocol: cephx 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding auth protocol: cephx 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding auth protocol: cephx 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.741 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:03:07.398+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:03:07.398+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc568fd0b8 EEXIST 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:03:07.742 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-b con 0x55dbddd54480 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-c con 0x55dbddd25260 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-a con 0x55dbddd45f70 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): authenticate will time out at 2616.810990s 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): get_auth_request con 0x55dbddd25260 auth_method 0 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): get_auth_request con 0x55dbddd45f70 auth_method 0 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.743 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:03:07.398+0000 7fe926a66640 10 monclient(hunting): get_auth_request con 0x55dbddd54480 auth_method 0 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:03:07.398+0000 7fe926a66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:03:07.398+0000 7fe926a66640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:03:07.398+0000 7fe926a66640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): handle_auth_done global_id 6627 payload 274 2024-09-12T18:03:07.744 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient: _finish_hunting 0 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:03:07.398+0000 7fe927267640 1 monclient: found mon.noname-a 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: dump: 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.745 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: _finish_auth 0 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 monclient: authenticate success, global_id 6627 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:03:07.398+0000 7fe928f609c0 4 set_mon_vals no callback set 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: dump: 2024-09-12T18:03:07.746 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: shutdown 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: build_initial_monmap 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:07.747 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: monmap: 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding auth protocol: cephx 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding auth protocol: cephx 2024-09-12T18:03:07.748 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding auth protocol: cephx 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:03:07.402+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.749 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 librados: starting msgr at 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 librados: starting objecter 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command objecter_requests cmddesc objecter_requests hook 0x55dbddd4dee0 EEXIST 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 librados: setting wanted keys 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 librados: calling monclient init 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: init 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding auth protocol: cephx 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding auth protocol: cephx 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding auth protocol: cephx 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.750 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:03:07.402+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:03:07.402+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command rotate-key cmddesc rotate-key hook 0x55dbddd02888 EEXIST 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-a con 0x55dbddd25260 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:07.751 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-c con 0x55dbddd45f70 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-b con 0x55dbddd54480 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): authenticate will time out at 2616.813618s 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): get_auth_request con 0x55dbddd45f70 auth_method 0 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): get_auth_request con 0x55dbddd25260 auth_method 0 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.752 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): handle_auth_done global_id 6251 payload 824 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient: _finish_hunting 0 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:03:07.402+0000 7fe926265640 1 monclient: found mon.noname-c 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:07.753 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: dump: 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: _finish_auth 0 2024-09-12T18:03:07.754 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 monclient: authenticate success, global_id 6251 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: dump: 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.755 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:03:07.402+0000 7fe80a7fc640 4 set_mon_vals no callback set 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 librados: init done 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command cr dump hook 0x55dbddd25768 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:03:07.406+0000 7fe808ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:03:07.406+0000 7fe808ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:03:07.406+0000 7fe808ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.756 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:03:07.406+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe7f0070ae0 auth_method 0 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:03:07.406+0000 7fe927267640 10 monclient: get_auth_request con 0x55dbddd6da10 auth_method 0 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 realm 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:03:07.406+0000 7fe928f609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:03:07.406+0000 7fe926a66640 10 monclient: get_auth_request con 0x55dbddd71d70 auth_method 0 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.757 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:03:07.410+0000 7fe926265640 10 monclient: get_auth_request con 0x55dbddd75500 auth_method 0 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:03:07.410+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:03:07.410+0000 7fe928f609c0 20 searching for the correct realm 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:03:07.410+0000 7fe927267640 10 monclient: get_auth_request con 0x7fe91c0c0070 auth_method 0 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:03:07.414+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe91801f070 auth_method 0 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:03:07.414+0000 7fe926265640 10 monclient: get_auth_request con 0x7fe91c0e47f0 auth_method 0 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:03:07.414+0000 7fe926265640 0 -- 172.21.15.97:0/3110045445 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fe91c0e47f0 msgr2=0x7fe91c0c1970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:03:07.414+0000 7fe808ff9640 1 client.6251.objecter ms_handle_reset 0x7fe91c0e47f0 session 0x7fe91c0c3e80 osd.5 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:03:07.414+0000 7fe808ff9640 10 monclient: _renew_subs 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:03:07.414+0000 7fe808ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:03:07.414+0000 7fe926265640 10 monclient: get_auth_request con 0x7fe7f0080600 auth_method 0 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:03:07.418+0000 7fe927267640 10 monclient: get_auth_request con 0x7fe918008050 auth_method 0 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:03:07.422+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe920030400 auth_method 0 2024-09-12T18:03:07.758 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:03:07.422+0000 7fe808ff9640 1 client.6251.objecter ms_handle_reset 0x7fe920030400 session 0x7fe92001abf0 osd.3 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:03:07.422+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe91c0e47f0 auth_method 0 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:03:07.422+0000 7fe926a66640 0 -- 172.21.15.97:0/3110045445 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fe91c0e47f0 msgr2=0x7fe7f0085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:03:07.626+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe91c0e47f0 auth_method 0 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.759 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 zone default found 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:03:07.642+0000 7fe928f609c0 4 Realm: () 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:03:07.642+0000 7fe928f609c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:03:07.642+0000 7fe928f609c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:03:07.642+0000 7fe928f609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 zonegroup default 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.760 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:03:07.646+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:03:07.646+0000 7fe928f609c0 20 started sync module instance, tier type = 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:03:07.646+0000 7fe928f609c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=0 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=1 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=2 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=3 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=4 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=5 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=6 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=7 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:03:07.670+0000 7fe928f609c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding auth protocol: cephx 2024-09-12T18:03:07.761 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding auth protocol: cephx 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding auth protocol: cephx 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:03:07.674+0000 7fe7ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.762 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:03:07.674+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:03:07.674+0000 7fe928f609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:03:07.674+0000 7fe928f609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command cache list hook 0x55dbddd49c50 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command cache inspect hook 0x55dbddd49c50 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command cache erase hook 0x55dbddd49c50 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command cache zap hook 0x55dbddd49c50 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:03:07.678+0000 7fe928f609c0 5 note: GC not initialized 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:03:07.678+0000 7fe7dcfe1640 20 reqs_thread_entry: start 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:03:07.678+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command sync trace show hook 0x7fe920005d60 2024-09-12T18:03:07.763 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:03:07.678+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command sync trace history hook 0x7fe920005d60 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:03:07.678+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command sync trace active hook 0x7fe920005d60 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:03:07.678+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command sync trace active_short hook 0x7fe920005d60 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 Filter name: none 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:03:07.678+0000 7fe7d5ffb640 20 reqs_thread_entry: start 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 : miss 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.764 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 info.flags=0x17 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to cache LRU end 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:03:07.690+0000 7fe928f609c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe928f609c0 time 2024-09-12T18:03:07.691460+0000 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe92c83a2eb] 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe92c83a49f] 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbdc8a50c1] 2024-09-12T18:03:07.765 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x140f6b8) [0x55dbdd2fa6b8] 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbdc8b718d] 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe92b6a0d90] 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:03:07.690+0000 7fe928f609c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fe928f609c0 thread_name:radosgw-admin 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe92b6b9520] 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:03:07.766 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:03:07.767 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:03:07.767 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe92c83a345] 2024-09-12T18:03:07.767 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe92c83a49f] 2024-09-12T18:03:07.767 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbdc8a50c1] 2024-09-12T18:03:07.767 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x140f6b8) [0x55dbdd2fa6b8] 2024-09-12T18:03:07.767 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbdc8b718d] 2024-09-12T18:03:07.767 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:03:07.767 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe92b6a0d90] 2024-09-12T18:03:07.767 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:03:07.767 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:03:07.767 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:03:07.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:03:07.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:03:07.770 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:03:07.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:03:07.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:03:07.773 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:03:07.774 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe7d5ffb640 / http_manager 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe7dcfe1640 / http_manager 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe7ddfe3640 / rgw_dt_lg_renew 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe808ff9640 / ms_dispatch 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe80a7fc640 / io_context_pool 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe810e01640 / ms_dispatch 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe813606640 / ms_dispatch 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe814e09640 / io_context_pool 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe926265640 / msgr-worker-2 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe926a66640 / msgr-worker-1 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe927267640 / msgr-worker-0 2024-09-12T18:03:07.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe927a68640 / io_context_pool 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe928f609c0 / radosgw-admin 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.91587.log 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.776 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:03:07.382+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient(hunting): handle_auth_done global_id 6239 payload 274 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient: _finish_hunting 0 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:03:07.382+0000 7fe926a66640 1 monclient: found mon.noname-c 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:03:07.382+0000 7fe926a66640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:03:07.382+0000 7fe926265640 10 monclient: get_auth_request con 0x55dbddbce1e0 auth_method 0 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: dump: 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.777 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: _finish_auth 0 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: _check_auth_tickets 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:03:07.382+0000 7fe814e09640 10 monclient: dump: 2024-09-12T18:03:07.778 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 monclient: authenticate success, global_id 6239 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:03:07.382+0000 7fe928f609c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:03:07.382+0000 7fe928f609c0 4 set_mon_vals no callback set 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:03:07.382+0000 7fe928f609c0 10 monclient: shutdown 2024-09-12T18:03:07.779 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 asok(0x55dbdda782b0) unregister_commands rotate-key 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:03:07.382+0000 7fe928f609c0 10 monclient: build_initial_monmap 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:03:07.382+0000 7fe928f609c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:03:07.382+0000 7fe928f609c0 10 monclient: monmap: 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.780 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding auth protocol: cephx 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding auth protocol: cephx 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding auth protocol: cephx 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: crc 2024-09-12T18:03:07.781 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcb2280) adding con mode: secure 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:03:07.382+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:03:07.382+0000 7fe928f609c0 1 librados: starting msgr at 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:03:07.382+0000 7fe928f609c0 1 librados: starting objecter 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:03:07.382+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command objecter_requests hook 0x55dbddc87790 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:03:07.386+0000 7fe928f609c0 1 librados: setting wanted keys 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:03:07.386+0000 7fe928f609c0 1 librados: calling monclient init 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: init 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding auth protocol: cephx 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding auth protocol: cephx 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding auth protocol: cephx 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.782 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: crc 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 AuthRegistry(0x55dbddc85150) adding con mode: secure 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:03:07.386+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:03:07.386+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command rotate-key hook 0x55dbddc85298 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:07.783 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-c con 0x55dbddb352b0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-a con 0x55dbddbce1e0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-b con 0x55dbddbd0db0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient(hunting): authenticate will time out at 2616.796609s 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): get_auth_request con 0x55dbddbce1e0 auth_method 0 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.784 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): get_auth_request con 0x55dbddb352b0 auth_method 0 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:03:07.386+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient(hunting): handle_auth_done global_id 6621 payload 824 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient: _finish_hunting 0 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:03:07.386+0000 7fe926265640 1 monclient: found mon.noname-a 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:03:07.386+0000 7fe926265640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:03:07.785 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: dump: 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: _finish_auth 0 2024-09-12T18:03:07.786 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: _check_auth_tickets 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:03:07.386+0000 7fe813606640 10 monclient: dump: 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.787 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:03:07.386+0000 7fe814e09640 4 set_mon_vals no callback set 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:03:07.386+0000 7fe928f609c0 5 monclient: authenticate success, global_id 6621 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:03:07.386+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:03:07.386+0000 7fe928f609c0 1 librados: init done 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:03:07.386+0000 7fe813606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:03:07.386+0000 7fe813606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:03:07.386+0000 7fe813606640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:03:07.390+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe80c070ae0 auth_method 0 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:03:07.390+0000 7fe927267640 10 monclient: get_auth_request con 0x55dbddcc3230 auth_method 0 2024-09-12T18:03:07.788 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:03:07.390+0000 7fe926a66640 10 monclient: get_auth_request con 0x55dbddccfc20 auth_method 0 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:03:07.390+0000 7fe926265640 10 monclient: get_auth_request con 0x55dbddcd3f80 auth_method 0 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: build_initial_monmap 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:03:07.394+0000 7fe928f609c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: monmap: 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:07.789 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.790 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding auth protocol: cephx 2024-09-12T18:03:07.790 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding auth protocol: cephx 2024-09-12T18:03:07.790 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding auth protocol: cephx 2024-09-12T18:03:07.790 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.790 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.790 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.790 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.790 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.790 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.790 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: crc 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd8de0) adding con mode: secure 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:03:07.394+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command objecter_requests cmddesc objecter_requests hook 0x55dbddcdc770 EEXIST 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: init 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding auth protocol: cephx 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding auth protocol: cephx 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding auth protocol: cephx 2024-09-12T18:03:07.791 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.792 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.792 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.792 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.792 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.792 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.792 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.792 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.792 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.792 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.792 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: crc 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 AuthRegistry(0x55dbddcd7408) adding con mode: secure 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:03:07.394+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:03:07.394+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command rotate-key cmddesc rotate-key hook 0x55dbddcd7550 EEXIST 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-b con 0x55dbddd00920 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-c con 0x55dbddd00250 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-a con 0x55dbddcfec30 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.793 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient(hunting): authenticate will time out at 2616.807080s 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): get_auth_request con 0x55dbddcfec30 auth_method 0 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): get_auth_request con 0x55dbddd00250 auth_method 0 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:03:07.394+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.794 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:03:07.394+0000 7fe926a66640 10 monclient(hunting): get_auth_request con 0x55dbddd00920 auth_method 0 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:03:07.394+0000 7fe926a66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:03:07.394+0000 7fe926a66640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:03:07.394+0000 7fe926a66640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient(hunting): handle_auth_done global_id 6245 payload 824 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient: _finish_hunting 0 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:03:07.394+0000 7fe926265640 1 monclient: found mon.noname-c 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:03:07.394+0000 7fe926265640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: dump: 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.795 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: _finish_auth 0 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: _check_auth_tickets 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.796 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:03:07.394+0000 7fe810e01640 10 monclient: dump: 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:03:07.394+0000 7fe928f609c0 5 monclient: authenticate success, global_id 6245 2024-09-12T18:03:07.797 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:03:07.394+0000 7fe927a68640 4 set_mon_vals no callback set 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:03:07.394+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:03:07.398+0000 7fe810e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:03:07.398+0000 7fe810e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:03:07.398+0000 7fe810e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:03:07.398+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe800070a20 auth_method 0 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: get_monmap_and_config 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: build_initial_monmap 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:03:07.398+0000 7fe928f609c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: monmap: 2024-09-12T18:03:07.798 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding auth protocol: cephx 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding auth protocol: cephx 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding auth protocol: cephx 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.799 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: crc 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd20000) adding con mode: secure 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:03:07.398+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: init 2024-09-12T18:03:07.800 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding auth protocol: cephx 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding auth protocol: cephx 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding auth protocol: cephx 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.801 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: crc 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fcf70) adding con mode: secure 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:03:07.398+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:03:07.398+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc568fd0b8 EEXIST 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-b con 0x55dbddd54480 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-c con 0x55dbddd25260 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-a con 0x55dbddd45f70 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.802 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient(hunting): authenticate will time out at 2616.810990s 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): get_auth_request con 0x55dbddd25260 auth_method 0 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): get_auth_request con 0x55dbddd45f70 auth_method 0 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.803 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:03:07.398+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:03:07.398+0000 7fe926a66640 10 monclient(hunting): get_auth_request con 0x55dbddd54480 auth_method 0 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:03:07.398+0000 7fe926a66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:03:07.398+0000 7fe926a66640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:03:07.398+0000 7fe926a66640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient(hunting): handle_auth_done global_id 6627 payload 274 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient: _finish_hunting 0 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:03:07.398+0000 7fe927267640 1 monclient: found mon.noname-a 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:03:07.398+0000 7fe927267640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.804 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: dump: 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: _finish_auth 0 2024-09-12T18:03:07.805 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:03:07.398+0000 7fe928f609c0 5 monclient: authenticate success, global_id 6627 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:03:07.398+0000 7fe928f609c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:03:07.398+0000 7fe928f609c0 4 set_mon_vals no callback set 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:03:07.398+0000 7fe80a7fc640 10 monclient: dump: 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.806 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: shutdown 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: build_initial_monmap 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: monmap: 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:07.807 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding auth protocol: cephx 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding auth protocol: cephx 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding auth protocol: cephx 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.808 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: crc 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd506e0) adding con mode: secure 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:03:07.402+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 librados: starting msgr at 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 librados: starting objecter 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command objecter_requests cmddesc objecter_requests hook 0x55dbddd4dee0 EEXIST 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 librados: setting wanted keys 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 librados: calling monclient init 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: init 2024-09-12T18:03:07.809 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding auth protocol: cephx 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding auth protocol: cephx 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding auth protocol: cephx 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.810 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: crc 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 AuthRegistry(0x55dbddd02740) adding con mode: secure 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:03:07.402+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:03:07.402+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command rotate-key cmddesc rotate-key hook 0x55dbddd02888 EEXIST 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-a con 0x55dbddd25260 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-c con 0x55dbddd45f70 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): picked mon.noname-b con 0x55dbddd54480 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:07.811 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient(hunting): authenticate will time out at 2616.813618s 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): get_auth_request con 0x55dbddd45f70 auth_method 0 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): get_auth_request con 0x55dbddd25260 auth_method 0 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:07.812 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:03:07.402+0000 7fe926a66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient(hunting): handle_auth_done global_id 6251 payload 824 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient: _finish_hunting 0 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:03:07.402+0000 7fe926265640 1 monclient: found mon.noname-c 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:03:07.402+0000 7fe926265640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: dump: 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.813 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: _finish_auth 0 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 monclient: authenticate success, global_id 6251 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:07.814 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:03:07.402+0000 7fe808ff9640 10 monclient: dump: 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:03:07.402+0000 7fe80a7fc640 4 set_mon_vals no callback set 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _renew_subs 2024-09-12T18:03:07.815 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:03:07.402+0000 7fe928f609c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:03:07.402+0000 7fe928f609c0 1 librados: init done 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:03:07.402+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command cr dump hook 0x55dbddd25768 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:03:07.406+0000 7fe808ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:03:07.406+0000 7fe808ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:03:07.406+0000 7fe808ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:03:07.406+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe7f0070ae0 auth_method 0 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:03:07.406+0000 7fe927267640 10 monclient: get_auth_request con 0x55dbddd6da10 auth_method 0 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 realm 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.816 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:03:07.406+0000 7fe928f609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:03:07.406+0000 7fe926a66640 10 monclient: get_auth_request con 0x55dbddd71d70 auth_method 0 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:03:07.406+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:03:07.410+0000 7fe926265640 10 monclient: get_auth_request con 0x55dbddd75500 auth_method 0 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:03:07.410+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:03:07.410+0000 7fe928f609c0 20 searching for the correct realm 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:03:07.410+0000 7fe927267640 10 monclient: get_auth_request con 0x7fe91c0c0070 auth_method 0 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:03:07.414+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe91801f070 auth_method 0 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:03:07.414+0000 7fe926265640 10 monclient: get_auth_request con 0x7fe91c0e47f0 auth_method 0 2024-09-12T18:03:07.817 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:03:07.414+0000 7fe926265640 0 -- 172.21.15.97:0/3110045445 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fe91c0e47f0 msgr2=0x7fe91c0c1970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:03:07.414+0000 7fe808ff9640 1 client.6251.objecter ms_handle_reset 0x7fe91c0e47f0 session 0x7fe91c0c3e80 osd.5 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:03:07.414+0000 7fe808ff9640 10 monclient: _renew_subs 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:03:07.414+0000 7fe808ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:03:07.414+0000 7fe926265640 10 monclient: get_auth_request con 0x7fe7f0080600 auth_method 0 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:03:07.418+0000 7fe927267640 10 monclient: get_auth_request con 0x7fe918008050 auth_method 0 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:03:07.422+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe920030400 auth_method 0 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:03:07.422+0000 7fe808ff9640 1 client.6251.objecter ms_handle_reset 0x7fe920030400 session 0x7fe92001abf0 osd.3 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:03:07.422+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe91c0e47f0 auth_method 0 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:03:07.422+0000 7fe926a66640 0 -- 172.21.15.97:0/3110045445 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fe91c0e47f0 msgr2=0x7fe7f0085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:03:07.626+0000 7fe926a66640 10 monclient: get_auth_request con 0x7fe91c0e47f0 auth_method 0 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:07.818 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:03:07.638+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 zone default found 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:03:07.642+0000 7fe928f609c0 4 Realm: () 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:03:07.642+0000 7fe928f609c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:03:07.642+0000 7fe928f609c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:07.819 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:03:07.642+0000 7fe928f609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 zonegroup default 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:03:07.642+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:03:07.646+0000 7fe928f609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:03:07.646+0000 7fe928f609c0 20 started sync module instance, tier type = 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:03:07.646+0000 7fe928f609c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=0 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=1 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=2 2024-09-12T18:03:07.820 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=3 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=4 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=5 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=6 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:03:07.670+0000 7fe928f609c0 20 add_watcher() i=7 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:03:07.670+0000 7fe928f609c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding auth protocol: cephx 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding auth protocol: cephx 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding auth protocol: cephx 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.821 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:03:07.674+0000 7fe7ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: crc 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 AuthRegistry(0x7ffc568fd440) adding con mode: secure 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:03:07.674+0000 7fe928f609c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:03:07.674+0000 7fe928f609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:03:07.674+0000 7fe928f609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command cache list hook 0x55dbddd49c50 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command cache inspect hook 0x55dbddd49c50 2024-09-12T18:03:07.822 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command cache erase hook 0x55dbddd49c50 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:03:07.674+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command cache zap hook 0x55dbddd49c50 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:03:07.678+0000 7fe928f609c0 5 note: GC not initialized 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:03:07.678+0000 7fe7dcfe1640 20 reqs_thread_entry: start 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:03:07.678+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command sync trace show hook 0x7fe920005d60 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:03:07.678+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command sync trace history hook 0x7fe920005d60 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:03:07.678+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command sync trace active hook 0x7fe920005d60 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:03:07.678+0000 7fe928f609c0 5 asok(0x55dbdda782b0) register_command sync trace active_short hook 0x7fe920005d60 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 Filter name: none 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:03:07.678+0000 7fe7d5ffb640 20 reqs_thread_entry: start 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:07.823 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 : miss 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:03:07.678+0000 7fe928f609c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 info.flags=0x17 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to cache LRU end 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:03:07.678+0000 7fe928f609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:03:07.690+0000 7fe928f609c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe928f609c0 time 2024-09-12T18:03:07.691460+0000 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.824 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe92c83a2eb] 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe92c83a49f] 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbdc8a50c1] 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x140f6b8) [0x55dbdd2fa6b8] 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbdc8b718d] 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe92b6a0d90] 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:03:07.690+0000 7fe928f609c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fe928f609c0 thread_name:radosgw-admin 2024-09-12T18:03:07.825 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe92b6b9520] 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe92c83a345] 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe92c83a49f] 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbdc8a50c1] 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x140f6b8) [0x55dbdd2fa6b8] 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55dbdc8b718d] 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe92b6a0d90] 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:03:07.826 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:03:07.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:03:07.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:03:07.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:03:07.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:03:07.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:03:07.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:03:07.833 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:03:07.834 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:03:07.834 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe7d5ffb640 / http_manager 2024-09-12T18:03:07.834 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe7dcfe1640 / http_manager 2024-09-12T18:03:07.834 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe7ddfe3640 / rgw_dt_lg_renew 2024-09-12T18:03:07.834 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe808ff9640 / ms_dispatch 2024-09-12T18:03:07.834 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe80a7fc640 / io_context_pool 2024-09-12T18:03:07.834 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe810e01640 / ms_dispatch 2024-09-12T18:03:07.834 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe813606640 / ms_dispatch 2024-09-12T18:03:07.834 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe814e09640 / io_context_pool 2024-09-12T18:03:07.836 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe926265640 / msgr-worker-2 2024-09-12T18:03:07.836 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe926a66640 / msgr-worker-1 2024-09-12T18:03:07.836 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe927267640 / msgr-worker-0 2024-09-12T18:03:07.836 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe927a68640 / io_context_pool 2024-09-12T18:03:07.836 INFO:tasks.workunit.client.0.smithi097.stderr: 7fe928f609c0 / radosgw-admin 2024-09-12T18:03:07.836 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:03:07.836 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:03:07.836 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:03:07.693933Z_a2d06125-1cc8-4e9e-af7d-4d740e067697/log 2024-09-12T18:03:07.837 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:03:07.837 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:03:07.837 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T18:03:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.774+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.778+0000 7f9f5ff889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.778+0000 7f9f5ff889c0 20 realm 2024-09-12T18:03:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.778+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.778+0000 7f9f5ff889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.778+0000 7f9f5ff889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.778+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.778+0000 7f9f5ff889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.778+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.778+0000 7f9f5ff889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.778+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.782+0000 7f9f5ff889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.782+0000 7f9f5ff889c0 20 searching for the correct realm 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.786+0000 7f9f5d28d640 0 -- 172.21.15.97:0/489137204 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55c98c48a0b0 msgr2=0x55c98c48c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.794+0000 7f9f5da8e640 0 -- 172.21.15.97:0/489137204 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55c98c48e230 msgr2=0x55c98c490620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.798+0000 7f9f5ff889c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.798+0000 7f9f5ff889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.798+0000 7f9f5ff889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.798+0000 7f9f5ff889c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.798+0000 7f9f5ff889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.798+0000 7f9f5ff889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.798+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.798+0000 7f9f5ff889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.798+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.798+0000 7f9f5ff889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.798+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 20 zone default found 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 4 Realm: () 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:07.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 20 zonegroup default 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 20 started sync module instance, tier type = 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.802+0000 7f9f5ff889c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.822+0000 7f9f5ff889c0 20 add_watcher() i=0 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.822+0000 7f9f5ff889c0 20 add_watcher() i=1 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.822+0000 7f9f5ff889c0 20 add_watcher() i=2 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.822+0000 7f9f5ff889c0 20 add_watcher() i=3 2024-09-12T18:03:07.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.822+0000 7f9f5ff889c0 20 add_watcher() i=4 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.822+0000 7f9f5ff889c0 20 add_watcher() i=5 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.822+0000 7f9f5ff889c0 20 add_watcher() i=6 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.822+0000 7f9f5ff889c0 20 add_watcher() i=7 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.822+0000 7f9f5ff889c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.826+0000 7f9e0ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.826+0000 7f9f5ff889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.826+0000 7f9f5ff889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.826+0000 7f9f5ff889c0 5 note: GC not initialized 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.826+0000 7f9e0effd640 20 reqs_thread_entry: start 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.826+0000 7f9f5ff889c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.826+0000 7f9f5ff889c0 20 Filter name: none 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.826+0000 7f9e0cff9640 20 reqs_thread_entry: start 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.826+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.826+0000 7f9f5ff889c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.826+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.830+0000 7f9f5ff889c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.830+0000 7f9f5ff889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.830+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.830+0000 7f9f5ff889c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.830+0000 7f9f5ff889c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.830+0000 7f9f5ff889c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.830+0000 7f9f5ff889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.834+0000 7f9e0ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.838+0000 7f9f5ff889c0 20 remove_watcher() i=0 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.838+0000 7f9f5ff889c0 2 removed watcher, disabling cache 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.838+0000 7f9f5ff889c0 20 remove_watcher() i=1 2024-09-12T18:03:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.842+0000 7f9f5ff889c0 20 remove_watcher() i=2 2024-09-12T18:03:07.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.842+0000 7f9f5ff889c0 20 remove_watcher() i=3 2024-09-12T18:03:07.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.842+0000 7f9f5ff889c0 20 remove_watcher() i=4 2024-09-12T18:03:07.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.846+0000 7f9f5ff889c0 20 remove_watcher() i=5 2024-09-12T18:03:07.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.850+0000 7f9f5ff889c0 20 remove_watcher() i=6 2024-09-12T18:03:07.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:07.850+0000 7f9f5ff889c0 20 remove_watcher() i=7 2024-09-12T18:03:07.865 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.865 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:07.865 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-set-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:03:07.865 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:07.866 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:07.867 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:07.906 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:07.907 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:07.967 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:03:08.002 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:08.002 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:08.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.046+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.046+0000 7f4f0a96e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.046+0000 7f4f0a96e9c0 20 realm 2024-09-12T18:03:08.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.046+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.050+0000 7f4f0a96e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.050+0000 7f4f0a96e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:08.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.050+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.050+0000 7f4f0a96e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.050+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.050+0000 7f4f0a96e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:08.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.050+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.050+0000 7f4f0a96e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:08.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.050+0000 7f4f0a96e9c0 20 searching for the correct realm 2024-09-12T18:03:08.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.058+0000 7f4f08474640 0 -- 172.21.15.97:0/3386745248 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x555fbef342a0 msgr2=0x7f4ef80f6590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:08.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.062+0000 7f4f08474640 0 -- 172.21.15.97:0/3386745248 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x555fbf171c10 msgr2=0x555fbf174020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:08.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.070+0000 7f4f0a96e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:08.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.070+0000 7f4f0a96e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:08.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.070+0000 7f4f0a96e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:08.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.070+0000 7f4f0a96e9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:08.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.070+0000 7f4f0a96e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:08.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.070+0000 7f4f0a96e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:08.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.070+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.070+0000 7f4f0a96e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.070+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.070+0000 7f4f0a96e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:08.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.070+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:08.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 20 zone default found 2024-09-12T18:03:08.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 4 Realm: () 2024-09-12T18:03:08.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:08.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:08.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:08.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 20 zonegroup default 2024-09-12T18:03:08.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 20 started sync module instance, tier type = 2024-09-12T18:03:08.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.074+0000 7f4f0a96e9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:08.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.094+0000 7f4f0a96e9c0 20 add_watcher() i=0 2024-09-12T18:03:08.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.094+0000 7f4f0a96e9c0 20 add_watcher() i=1 2024-09-12T18:03:08.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.094+0000 7f4f0a96e9c0 20 add_watcher() i=2 2024-09-12T18:03:08.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.094+0000 7f4f0a96e9c0 20 add_watcher() i=3 2024-09-12T18:03:08.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.094+0000 7f4f0a96e9c0 20 add_watcher() i=4 2024-09-12T18:03:08.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.094+0000 7f4f0a96e9c0 20 add_watcher() i=5 2024-09-12T18:03:08.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.094+0000 7f4f0a96e9c0 20 add_watcher() i=6 2024-09-12T18:03:08.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.094+0000 7f4f0a96e9c0 20 add_watcher() i=7 2024-09-12T18:03:08.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.094+0000 7f4f0a96e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:08.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4dbf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:08.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:08.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:08.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 5 note: GC not initialized 2024-09-12T18:03:08.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4dbe7dc640 20 reqs_thread_entry: start 2024-09-12T18:03:08.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:08.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 20 Filter name: none 2024-09-12T18:03:08.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4db77fe640 20 reqs_thread_entry: start 2024-09-12T18:03:08.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:03:08.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:08.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:03:08.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:03:08.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 : miss 2024-09-12T18:03:08.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.098+0000 7f4f0a96e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.102+0000 7f4f0a96e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:08.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.102+0000 7f4f0a96e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 info.flags=0x17 2024-09-12T18:03:08.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.102+0000 7f4f0a96e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to cache LRU end 2024-09-12T18:03:08.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.102+0000 7f4f0a96e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:08.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.102+0000 7f4f0a96e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:08.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.102+0000 7f4f0a96e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 2024-09-12T18:03:08.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.102+0000 7f4f0a96e9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to be held by another RGW process; skipping for now 2024-09-12T18:03:08.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.106+0000 7f4dbf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:08.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.110+0000 7f4f0a96e9c0 20 remove_watcher() i=0 2024-09-12T18:03:08.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.110+0000 7f4f0a96e9c0 2 removed watcher, disabling cache 2024-09-12T18:03:08.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.110+0000 7f4f0a96e9c0 20 remove_watcher() i=1 2024-09-12T18:03:08.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.110+0000 7f4f0a96e9c0 20 remove_watcher() i=2 2024-09-12T18:03:08.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.114+0000 7f4f0a96e9c0 20 remove_watcher() i=3 2024-09-12T18:03:08.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.114+0000 7f4f0a96e9c0 20 remove_watcher() i=4 2024-09-12T18:03:08.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.118+0000 7f4f0a96e9c0 20 remove_watcher() i=5 2024-09-12T18:03:08.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.122+0000 7f4f0a96e9c0 20 remove_watcher() i=6 2024-09-12T18:03:08.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:08.122+0000 7f4f0a96e9c0 20 remove_watcher() i=7 2024-09-12T18:03:08.139 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:03:38.167 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:03:38.203 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:38.203 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:38.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.245+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.249+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.249+0000 7fd5ca3ec9c0 20 realm 2024-09-12T18:03:38.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.249+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.249+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.249+0000 7fd5ca3ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:38.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.249+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.249+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.249+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.249+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:38.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.249+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.253+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:38.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.253+0000 7fd5ca3ec9c0 20 searching for the correct realm 2024-09-12T18:03:38.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.257+0000 7fd5c76f1640 0 -- 172.21.15.97:0/1697136254 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fd5bc1017d0 msgr2=0x7fd5bc0f6da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:38.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.469+0000 7fd5c86f3640 0 -- 172.21.15.97:0/1697136254 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55abc5ed3340 msgr2=0x55abc5ed57b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:38.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.481+0000 7fd5ca3ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:38.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.481+0000 7fd5ca3ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:38.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.481+0000 7fd5ca3ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:38.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.481+0000 7fd5ca3ec9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:38.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.481+0000 7fd5ca3ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:38.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.481+0000 7fd5ca3ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:38.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.481+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:38.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:38.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 zone default found 2024-09-12T18:03:38.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 4 Realm: () 2024-09-12T18:03:38.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:38.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:38.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:38.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 zonegroup default 2024-09-12T18:03:38.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.485+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.489+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.489+0000 7fd5ca3ec9c0 20 started sync module instance, tier type = 2024-09-12T18:03:38.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.489+0000 7fd5ca3ec9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:38.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.513+0000 7fd5ca3ec9c0 20 add_watcher() i=0 2024-09-12T18:03:38.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.513+0000 7fd5ca3ec9c0 20 add_watcher() i=1 2024-09-12T18:03:38.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.513+0000 7fd5ca3ec9c0 20 add_watcher() i=2 2024-09-12T18:03:38.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.513+0000 7fd5ca3ec9c0 20 add_watcher() i=3 2024-09-12T18:03:38.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.513+0000 7fd5ca3ec9c0 20 add_watcher() i=4 2024-09-12T18:03:38.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.513+0000 7fd5ca3ec9c0 20 add_watcher() i=5 2024-09-12T18:03:38.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.513+0000 7fd5ca3ec9c0 20 add_watcher() i=6 2024-09-12T18:03:38.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.513+0000 7fd5ca3ec9c0 20 add_watcher() i=7 2024-09-12T18:03:38.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.513+0000 7fd5ca3ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:38.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.517+0000 7fd47dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:38.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.517+0000 7fd5ca3ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:38.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:38.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 5 note: GC not initialized 2024-09-12T18:03:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd47cfe1640 20 reqs_thread_entry: start 2024-09-12T18:03:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 20 Filter name: none 2024-09-12T18:03:38.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd3f67fc640 20 reqs_thread_entry: start 2024-09-12T18:03:38.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:03:38.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:38.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:03:38.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:03:38.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 : miss 2024-09-12T18:03:38.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:38.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 info.flags=0x17 2024-09-12T18:03:38.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to cache LRU end 2024-09-12T18:03:38.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:38.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:38.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.521+0000 7fd5ca3ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 2024-09-12T18:03:38.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.533+0000 7fd5ca3ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 info.flags=0x17 2024-09-12T18:03:38.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.533+0000 7fd5ca3ec9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to cache LRU end 2024-09-12T18:03:38.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.533+0000 7fd5ca3ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:38.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.533+0000 7fd5ca3ec9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24, ofs0, ns] 2024-09-12T18:03:38.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.533+0000 7fd4a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431598 cookie 94196248482624 notifier 6681 bl.length()=925 2024-09-12T18:03:38.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.533+0000 7fd4a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 info.flags=0x17 2024-09-12T18:03:38.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.533+0000 7fd4a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to cache LRU end 2024-09-12T18:03:38.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.533+0000 7fd4a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:38.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.537+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): orig_sources= new_sources= 2024-09-12T18:03:38.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.537+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): potential sources added=[] removed=[] 2024-09-12T18:03:38.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.537+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): orig_dests= new_dests= 2024-09-12T18:03:38.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.537+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): potential dests added=[] removed=[] 2024-09-12T18:03:38.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.0 2024-09-12T18:03:38.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.0 2024-09-12T18:03:38.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.1 2024-09-12T18:03:38.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.1 2024-09-12T18:03:38.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.2 2024-09-12T18:03:38.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.2 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.3 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.3 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.4 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.4 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.5 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.5 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.6 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.6 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.7 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.7 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.8 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.8 2024-09-12T18:03:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.9 2024-09-12T18:03:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.9 2024-09-12T18:03:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.10 2024-09-12T18:03:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.10 2024-09-12T18:03:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.11 2024-09-12T18:03:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.545+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1.11 2024-09-12T18:03:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.549+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.0 2024-09-12T18:03:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.549+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1 2024-09-12T18:03:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.549+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.2 2024-09-12T18:03:38.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.549+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.3 2024-09-12T18:03:38.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.549+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.4 2024-09-12T18:03:38.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.553+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.5 2024-09-12T18:03:38.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.553+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.6 2024-09-12T18:03:38.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.553+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.7 2024-09-12T18:03:38.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.553+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.8 2024-09-12T18:03:38.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.553+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.9 2024-09-12T18:03:38.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.557+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.10 2024-09-12T18:03:38.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.565+0000 7fd5ca3ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:38.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.565+0000 7fd5ca3ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 2024-09-12T18:03:38.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.565+0000 7fd5ca3ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 info.flags=0x17 2024-09-12T18:03:38.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.565+0000 7fd5ca3ec9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to cache LRU end 2024-09-12T18:03:38.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.565+0000 7fd5ca3ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:38.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.565+0000 7fd5ca3ec9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24, ofs0, ns] 2024-09-12T18:03:38.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.569+0000 7fd4a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431599 cookie 94196248482624 notifier 6681 bl.length()=925 2024-09-12T18:03:38.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.569+0000 7fd4a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 info.flags=0x17 2024-09-12T18:03:38.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.569+0000 7fd4a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to cache LRU end 2024-09-12T18:03:38.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.569+0000 7fd4a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:38.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.569+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): orig_sources= new_sources= 2024-09-12T18:03:38.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.569+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): potential sources added=[] removed=[] 2024-09-12T18:03:38.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.569+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): orig_dests= new_dests= 2024-09-12T18:03:38.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.569+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): potential dests added=[] removed=[] 2024-09-12T18:03:38.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.577+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.0 2024-09-12T18:03:38.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.577+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.1 2024-09-12T18:03:38.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.577+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.2 2024-09-12T18:03:38.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.577+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.3 2024-09-12T18:03:38.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.577+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.4 2024-09-12T18:03:38.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.581+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.5 2024-09-12T18:03:38.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.581+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.6 2024-09-12T18:03:38.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.581+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.7 2024-09-12T18:03:38.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.581+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.8 2024-09-12T18:03:38.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.581+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.9 2024-09-12T18:03:38.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.581+0000 7fd5ca3ec9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.24.10 2024-09-12T18:03:38.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.585+0000 7fd5ca3ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:38.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.585+0000 7fd5ca3ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 2024-09-12T18:03:38.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.585+0000 7fd5ca3ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 info.flags=0x17 2024-09-12T18:03:38.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.585+0000 7fd5ca3ec9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to cache LRU end 2024-09-12T18:03:38.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.585+0000 7fd5ca3ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:38.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.585+0000 7fd5ca3ec9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24, ofs0, ns] 2024-09-12T18:03:38.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.589+0000 7fd4a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431600 cookie 94196248482624 notifier 6681 bl.length()=893 2024-09-12T18:03:38.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.589+0000 7fd4a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 info.flags=0x17 2024-09-12T18:03:38.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.589+0000 7fd4a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.24 to cache LRU end 2024-09-12T18:03:38.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.589+0000 7fd4a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:38.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.589+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): orig_sources= new_sources= 2024-09-12T18:03:38.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.589+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): potential sources added=[] removed=[] 2024-09-12T18:03:38.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.589+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): orig_dests= new_dests= 2024-09-12T18:03:38.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.589+0000 7fd5ca3ec9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.24]): potential dests added=[] removed=[] 2024-09-12T18:03:38.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.597+0000 7fd5ca3ec9c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:03:38.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.601+0000 7fd47dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:38.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.605+0000 7fd5ca3ec9c0 20 remove_watcher() i=0 2024-09-12T18:03:38.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.605+0000 7fd5ca3ec9c0 2 removed watcher, disabling cache 2024-09-12T18:03:38.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.605+0000 7fd5ca3ec9c0 20 remove_watcher() i=1 2024-09-12T18:03:38.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.609+0000 7fd5ca3ec9c0 20 remove_watcher() i=2 2024-09-12T18:03:38.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.609+0000 7fd5ca3ec9c0 20 remove_watcher() i=3 2024-09-12T18:03:38.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.613+0000 7fd5ca3ec9c0 20 remove_watcher() i=4 2024-09-12T18:03:38.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.617+0000 7fd5ca3ec9c0 20 remove_watcher() i=5 2024-09-12T18:03:38.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.617+0000 7fd5ca3ec9c0 20 remove_watcher() i=6 2024-09-12T18:03:38.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.621+0000 7fd5ca3ec9c0 20 remove_watcher() i=7 2024-09-12T18:03:38.640 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T18:03:38.667 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:38.667 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:38.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.713+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.713+0000 7f706a5bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.713+0000 7f706a5bf9c0 20 realm 2024-09-12T18:03:38.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.713+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.713+0000 7f706a5bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.713+0000 7f706a5bf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:38.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.713+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.713+0000 7f706a5bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.713+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.717+0000 7f706a5bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:38.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.717+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.717+0000 7f706a5bf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:38.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.717+0000 7f706a5bf9c0 20 searching for the correct realm 2024-09-12T18:03:38.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.721+0000 7f70678c4640 0 -- 172.21.15.97:0/181793912 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f705c1077a0 msgr2=0x7f705c107040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:38.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.933+0000 7f70678c4640 0 -- 172.21.15.97:0/181793912 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55f56c8c8e60 msgr2=0x55f56c8cb250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:38.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:38.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:38.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:38.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:38.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:38.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:38.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:38.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:38.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 zone default found 2024-09-12T18:03:38.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 4 Realm: () 2024-09-12T18:03:38.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:38.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:38.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:38.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 zonegroup default 2024-09-12T18:03:38.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.949+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.953+0000 7f706a5bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.953+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.953+0000 7f706a5bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.953+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.953+0000 7f706a5bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:38.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.953+0000 7f706a5bf9c0 20 started sync module instance, tier type = 2024-09-12T18:03:38.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.953+0000 7f706a5bf9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:38.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.977+0000 7f706a5bf9c0 20 add_watcher() i=0 2024-09-12T18:03:38.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.977+0000 7f706a5bf9c0 20 add_watcher() i=1 2024-09-12T18:03:38.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.977+0000 7f706a5bf9c0 20 add_watcher() i=2 2024-09-12T18:03:38.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.977+0000 7f706a5bf9c0 20 add_watcher() i=3 2024-09-12T18:03:38.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.977+0000 7f706a5bf9c0 20 add_watcher() i=4 2024-09-12T18:03:38.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.977+0000 7f706a5bf9c0 20 add_watcher() i=5 2024-09-12T18:03:38.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.977+0000 7f706a5bf9c0 20 add_watcher() i=6 2024-09-12T18:03:38.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.977+0000 7f706a5bf9c0 20 add_watcher() i=7 2024-09-12T18:03:38.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.977+0000 7f706a5bf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:38.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.981+0000 7f6f1efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:38.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.981+0000 7f706a5bf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:38.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.981+0000 7f706a5bf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:38.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.981+0000 7f706a5bf9c0 5 note: GC not initialized 2024-09-12T18:03:38.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.981+0000 7f6f1dfdb640 20 reqs_thread_entry: start 2024-09-12T18:03:38.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.981+0000 7f706a5bf9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:38.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.981+0000 7f706a5bf9c0 20 Filter name: none 2024-09-12T18:03:38.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.981+0000 7f6e8f7fe640 20 reqs_thread_entry: start 2024-09-12T18:03:38.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.985+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.985+0000 7f706a5bf9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:38.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.985+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.985+0000 7f706a5bf9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:38.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.985+0000 7f706a5bf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:38.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.985+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.985+0000 7f706a5bf9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:03:38.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.985+0000 7f706a5bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:38.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.985+0000 7f706a5bf9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:03:38.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.985+0000 7f706a5bf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:38.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.989+0000 7f6f1efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:38.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.993+0000 7f706a5bf9c0 20 remove_watcher() i=0 2024-09-12T18:03:38.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.993+0000 7f706a5bf9c0 2 removed watcher, disabling cache 2024-09-12T18:03:38.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.997+0000 7f706a5bf9c0 20 remove_watcher() i=1 2024-09-12T18:03:39.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:38.997+0000 7f706a5bf9c0 20 remove_watcher() i=2 2024-09-12T18:03:39.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:39.001+0000 7f706a5bf9c0 20 remove_watcher() i=3 2024-09-12T18:03:39.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:39.001+0000 7f706a5bf9c0 20 remove_watcher() i=4 2024-09-12T18:03:39.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:39.005+0000 7f706a5bf9c0 20 remove_watcher() i=5 2024-09-12T18:03:39.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:39.005+0000 7f706a5bf9c0 20 remove_watcher() i=6 2024-09-12T18:03:39.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:39.009+0000 7f706a5bf9c0 20 remove_watcher() i=7 2024-09-12T18:03:39.026 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:39.026 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:39.026 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-set-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:03:39.026 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:39.029 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:39.029 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:39.052 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:39.052 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:39.585 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:39.585 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:39.956 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T18:03:39.956 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:39.961 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:39.961 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:40.097 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:40.097 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:40.185 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:40.186 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:40.288 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:40.288 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:40.385 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:40.385 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:40.488 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:40.488 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:40.578 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:40.578 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:40.680 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:40.680 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:40.776 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:40.776 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:40.873 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:40.873 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:40.971 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:40.971 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:41.072 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:41.072 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:41.167 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:41.167 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:41.317 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:41.317 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:41.412 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:41.412 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:41.509 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:41.510 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:41.608 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:41.608 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:41.705 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:41.706 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:41.798 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:41.798 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:41.893 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:41.893 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:41.992 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:41.992 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:42.086 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:42.086 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:42.180 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:03:42.212 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:42.212 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:42.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.257+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.257+0000 7efe8305a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.257+0000 7efe8305a9c0 20 realm 2024-09-12T18:03:42.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.257+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.257+0000 7efe8305a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.257+0000 7efe8305a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:42.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.261+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.261+0000 7efe8305a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.261+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.261+0000 7efe8305a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:42.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.261+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.261+0000 7efe8305a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:42.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.261+0000 7efe8305a9c0 20 searching for the correct realm 2024-09-12T18:03:42.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.265+0000 7efe7bfff640 0 -- 172.21.15.97:0/1542985132 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7efe6c01a040 msgr2=0x7efe6c027910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:42.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.477+0000 7efe81361640 0 -- 172.21.15.97:0/1542985132 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x557c909baed0 msgr2=0x557c909bd2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:42.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.489+0000 7efe8305a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:42.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.489+0000 7efe8305a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:42.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.489+0000 7efe8305a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:42.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.489+0000 7efe8305a9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:42.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.489+0000 7efe8305a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:42.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.489+0000 7efe8305a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:42.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.489+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.489+0000 7efe8305a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.489+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:42.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:42.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 zone default found 2024-09-12T18:03:42.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 4 Realm: () 2024-09-12T18:03:42.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:42.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:42.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:42.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 zonegroup default 2024-09-12T18:03:42.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 started sync module instance, tier type = 2024-09-12T18:03:42.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.493+0000 7efe8305a9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:42.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.517+0000 7efe8305a9c0 20 add_watcher() i=0 2024-09-12T18:03:42.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.517+0000 7efe8305a9c0 20 add_watcher() i=1 2024-09-12T18:03:42.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.517+0000 7efe8305a9c0 20 add_watcher() i=2 2024-09-12T18:03:42.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.517+0000 7efe8305a9c0 20 add_watcher() i=3 2024-09-12T18:03:42.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.517+0000 7efe8305a9c0 20 add_watcher() i=4 2024-09-12T18:03:42.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.517+0000 7efe8305a9c0 20 add_watcher() i=5 2024-09-12T18:03:42.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.517+0000 7efe8305a9c0 20 add_watcher() i=6 2024-09-12T18:03:42.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.521+0000 7efe8305a9c0 20 add_watcher() i=7 2024-09-12T18:03:42.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.521+0000 7efe8305a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:42.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.525+0000 7efd36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:42.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.525+0000 7efe8305a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:42.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.525+0000 7efe8305a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:42.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.525+0000 7efe8305a9c0 5 note: GC not initialized 2024-09-12T18:03:42.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.525+0000 7efd35fe3640 20 reqs_thread_entry: start 2024-09-12T18:03:42.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.525+0000 7efe8305a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:42.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.529+0000 7efe8305a9c0 20 Filter name: none 2024-09-12T18:03:42.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.529+0000 7efca77fe640 20 reqs_thread_entry: start 2024-09-12T18:03:42.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.529+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.529+0000 7efe8305a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:42.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.529+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.529+0000 7efe8305a9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:42.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.529+0000 7efe8305a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:42.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.529+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.529+0000 7efe8305a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:42.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.529+0000 7efe8305a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.533+0000 7efe8305a9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:42.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.533+0000 7efe8305a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:42.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.533+0000 7efd36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:42.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.537+0000 7efe8305a9c0 20 remove_watcher() i=0 2024-09-12T18:03:42.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.537+0000 7efe8305a9c0 2 removed watcher, disabling cache 2024-09-12T18:03:42.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.541+0000 7efe8305a9c0 20 remove_watcher() i=1 2024-09-12T18:03:42.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.545+0000 7efe8305a9c0 20 remove_watcher() i=2 2024-09-12T18:03:42.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.545+0000 7efe8305a9c0 20 remove_watcher() i=3 2024-09-12T18:03:42.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.549+0000 7efe8305a9c0 20 remove_watcher() i=4 2024-09-12T18:03:42.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.549+0000 7efe8305a9c0 20 remove_watcher() i=5 2024-09-12T18:03:42.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.553+0000 7efe8305a9c0 20 remove_watcher() i=6 2024-09-12T18:03:42.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.557+0000 7efe8305a9c0 20 remove_watcher() i=7 2024-09-12T18:03:42.573 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:42.573 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:42.573 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-trim-reshard-log-entries id: 98539659-fdaf-41ce-847d-239ff89323af.4641.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:03:42.573 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:42.574 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T18:03:42.612 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:42.612 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:42.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.653+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.657+0000 7fed4ed7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.657+0000 7fed4ed7d9c0 20 realm 2024-09-12T18:03:42.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.657+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.657+0000 7fed4ed7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.657+0000 7fed4ed7d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:42.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.657+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.657+0000 7fed4ed7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.657+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.661+0000 7fed4ed7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:42.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.661+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.661+0000 7fed4ed7d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:42.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.661+0000 7fed4ed7d9c0 20 searching for the correct realm 2024-09-12T18:03:42.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.665+0000 7fed4c883640 0 -- 172.21.15.97:0/366591465 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fed40040040 msgr2=0x7fed4003f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:42.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.673+0000 7fed4c883640 0 -- 172.21.15.97:0/366591465 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55ff72fbb270 msgr2=0x55ff72fbd6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:42.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:42.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:42.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:42.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:42.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:42.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:42.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:42.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:42.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 zone default found 2024-09-12T18:03:42.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 4 Realm: () 2024-09-12T18:03:42.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:42.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:42.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:42.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 zonegroup default 2024-09-12T18:03:42.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.681+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.685+0000 7fed4ed7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.685+0000 7fed4ed7d9c0 20 started sync module instance, tier type = 2024-09-12T18:03:42.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.685+0000 7fed4ed7d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:42.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.701+0000 7fed4ed7d9c0 20 add_watcher() i=0 2024-09-12T18:03:42.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.701+0000 7fed4ed7d9c0 20 add_watcher() i=1 2024-09-12T18:03:42.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.701+0000 7fed4ed7d9c0 20 add_watcher() i=2 2024-09-12T18:03:42.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.701+0000 7fed4ed7d9c0 20 add_watcher() i=3 2024-09-12T18:03:42.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.701+0000 7fed4ed7d9c0 20 add_watcher() i=4 2024-09-12T18:03:42.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.701+0000 7fed4ed7d9c0 20 add_watcher() i=5 2024-09-12T18:03:42.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.701+0000 7fed4ed7d9c0 20 add_watcher() i=6 2024-09-12T18:03:42.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.705+0000 7fed4ed7d9c0 20 add_watcher() i=7 2024-09-12T18:03:42.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.705+0000 7fed4ed7d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:42.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fec02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:42.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:42.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:42.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 5 note: GC not initialized 2024-09-12T18:03:42.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fec01fe3640 20 reqs_thread_entry: start 2024-09-12T18:03:42.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:42.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 20 Filter name: none 2024-09-12T18:03:42.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7feb737fe640 20 reqs_thread_entry: start 2024-09-12T18:03:42.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T18:03:42.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:42.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:42.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:42.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 : miss 2024-09-12T18:03:42.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:42.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 info.flags=0x17 2024-09-12T18:03:42.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 to cache LRU end 2024-09-12T18:03:42.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:42.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:42.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.713+0000 7fed4ed7d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 2024-09-12T18:03:42.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.733+0000 7fed4ed7d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 info.flags=0x17 2024-09-12T18:03:42.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.733+0000 7fed4ed7d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 to cache LRU end 2024-09-12T18:03:42.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.733+0000 7fed4ed7d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:42.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.733+0000 7fed4ed7d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25, ofs0, ns] 2024-09-12T18:03:42.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.737+0000 7fec237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94555634165808 notifier 6738 bl.length()=939 2024-09-12T18:03:42.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.737+0000 7fec237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 info.flags=0x17 2024-09-12T18:03:42.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.737+0000 7fec237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 to cache LRU end 2024-09-12T18:03:42.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.737+0000 7fec237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:42.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.737+0000 7fed4ed7d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): orig_sources= new_sources= 2024-09-12T18:03:42.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.737+0000 7fed4ed7d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): potential sources added=[] removed=[] 2024-09-12T18:03:42.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.737+0000 7fed4ed7d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): orig_dests= new_dests= 2024-09-12T18:03:42.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.737+0000 7fed4ed7d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): potential dests added=[] removed=[] 2024-09-12T18:03:42.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.737+0000 7fed4ed7d9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T18:03:42.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.737+0000 7fed4ed7d9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T18:03:42.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.741+0000 7fec02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:42.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.745+0000 7fed4ed7d9c0 20 remove_watcher() i=0 2024-09-12T18:03:42.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.745+0000 7fed4ed7d9c0 2 removed watcher, disabling cache 2024-09-12T18:03:42.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.749+0000 7fed4ed7d9c0 20 remove_watcher() i=1 2024-09-12T18:03:42.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.749+0000 7fed4ed7d9c0 20 remove_watcher() i=2 2024-09-12T18:03:42.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.753+0000 7fed4ed7d9c0 20 remove_watcher() i=3 2024-09-12T18:03:42.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.753+0000 7fed4ed7d9c0 20 remove_watcher() i=4 2024-09-12T18:03:42.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.757+0000 7fed4ed7d9c0 20 remove_watcher() i=5 2024-09-12T18:03:42.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.757+0000 7fed4ed7d9c0 20 remove_watcher() i=6 2024-09-12T18:03:42.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.761+0000 7fed4ed7d9c0 20 remove_watcher() i=7 2024-09-12T18:03:42.777 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:03:42.803 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:42.803 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:42.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.845+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 20 realm 2024-09-12T18:03:42.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:42.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:42.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:42.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:42.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:42.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.849+0000 7f010cd279c0 20 searching for the correct realm 2024-09-12T18:03:42.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.853+0000 7f010a82d640 0 -- 172.21.15.97:0/3651927211 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f00fc02b3c0 msgr2=0x7f00fc02b800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:42.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:42.861+0000 7f010a82d640 0 -- 172.21.15.97:0/3651927211 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f0104029020 msgr2=0x7f01040830c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:43.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:43.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:43.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:43.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:43.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:43.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:43.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:43.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:43.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 zone default found 2024-09-12T18:03:43.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 4 Realm: () 2024-09-12T18:03:43.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:43.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:43.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:43.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 zonegroup default 2024-09-12T18:03:43.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.081+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.085+0000 7f010cd279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.085+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.085+0000 7f010cd279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.085+0000 7f010cd279c0 20 started sync module instance, tier type = 2024-09-12T18:03:43.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.085+0000 7f010cd279c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:43.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.109+0000 7f010cd279c0 20 add_watcher() i=0 2024-09-12T18:03:43.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.109+0000 7f010cd279c0 20 add_watcher() i=1 2024-09-12T18:03:43.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.109+0000 7f010cd279c0 20 add_watcher() i=2 2024-09-12T18:03:43.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.109+0000 7f010cd279c0 20 add_watcher() i=3 2024-09-12T18:03:43.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.109+0000 7f010cd279c0 20 add_watcher() i=4 2024-09-12T18:03:43.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.109+0000 7f010cd279c0 20 add_watcher() i=5 2024-09-12T18:03:43.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.109+0000 7f010cd279c0 20 add_watcher() i=6 2024-09-12T18:03:43.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.109+0000 7f010cd279c0 20 add_watcher() i=7 2024-09-12T18:03:43.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.109+0000 7f010cd279c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:43.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.113+0000 7effc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:43.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.117+0000 7f010cd279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:43.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.117+0000 7f010cd279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:43.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.117+0000 7f010cd279c0 5 note: GC not initialized 2024-09-12T18:03:43.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.117+0000 7eff3bfff640 20 reqs_thread_entry: start 2024-09-12T18:03:43.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.117+0000 7f010cd279c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:43.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.117+0000 7f010cd279c0 20 Filter name: none 2024-09-12T18:03:43.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.117+0000 7eff39ffb640 20 reqs_thread_entry: start 2024-09-12T18:03:43.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.117+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.117+0000 7f010cd279c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:43.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.117+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.121+0000 7f010cd279c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:43.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.121+0000 7f010cd279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:43.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.121+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.121+0000 7f010cd279c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:43.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.121+0000 7f010cd279c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.121+0000 7f010cd279c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:43.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.121+0000 7f010cd279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:43.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.125+0000 7effc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:43.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.129+0000 7f010cd279c0 20 remove_watcher() i=0 2024-09-12T18:03:43.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.129+0000 7f010cd279c0 2 removed watcher, disabling cache 2024-09-12T18:03:43.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.133+0000 7f010cd279c0 20 remove_watcher() i=1 2024-09-12T18:03:43.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.133+0000 7f010cd279c0 20 remove_watcher() i=2 2024-09-12T18:03:43.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.137+0000 7f010cd279c0 20 remove_watcher() i=3 2024-09-12T18:03:43.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.137+0000 7f010cd279c0 20 remove_watcher() i=4 2024-09-12T18:03:43.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.141+0000 7f010cd279c0 20 remove_watcher() i=5 2024-09-12T18:03:43.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.141+0000 7f010cd279c0 20 remove_watcher() i=6 2024-09-12T18:03:43.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.145+0000 7f010cd279c0 20 remove_watcher() i=7 2024-09-12T18:03:43.162 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:43.162 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:43.162 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-trim-reshard-log-entries id: 98539659-fdaf-41ce-847d-239ff89323af.4641.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:03:43.163 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:43.164 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:43.164 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:43.216 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:43.216 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:43.283 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:03:43.319 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:43.319 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:43.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.361+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.365+0000 7f254270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.365+0000 7f254270c9c0 20 realm 2024-09-12T18:03:43.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.365+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.365+0000 7f254270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.365+0000 7f254270c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:43.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.365+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.365+0000 7f254270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.365+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.365+0000 7f254270c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:43.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.365+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.369+0000 7f254270c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:43.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.369+0000 7f254270c9c0 20 searching for the correct realm 2024-09-12T18:03:43.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.373+0000 7f253fa11640 0 -- 172.21.15.97:0/1836821836 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x559a7192cde0 msgr2=0x559a7192f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:43.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.377+0000 7f2540212640 0 -- 172.21.15.97:0/1836821836 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f2538008040 msgr2=0x7f253803a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:43.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:43.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:43.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:43.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:43.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:43.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:43.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:43.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:43.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 zone default found 2024-09-12T18:03:43.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 4 Realm: () 2024-09-12T18:03:43.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:43.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:43.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:43.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 zonegroup default 2024-09-12T18:03:43.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.597+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.601+0000 7f254270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.601+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.601+0000 7f254270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.601+0000 7f254270c9c0 20 started sync module instance, tier type = 2024-09-12T18:03:43.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.601+0000 7f254270c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:43.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.621+0000 7f254270c9c0 20 add_watcher() i=0 2024-09-12T18:03:43.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.621+0000 7f254270c9c0 20 add_watcher() i=1 2024-09-12T18:03:43.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.621+0000 7f254270c9c0 20 add_watcher() i=2 2024-09-12T18:03:43.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.621+0000 7f254270c9c0 20 add_watcher() i=3 2024-09-12T18:03:43.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.621+0000 7f254270c9c0 20 add_watcher() i=4 2024-09-12T18:03:43.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.621+0000 7f254270c9c0 20 add_watcher() i=5 2024-09-12T18:03:43.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.621+0000 7f254270c9c0 20 add_watcher() i=6 2024-09-12T18:03:43.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.625+0000 7f254270c9c0 20 add_watcher() i=7 2024-09-12T18:03:43.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.625+0000 7f254270c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:43.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.629+0000 7f23f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:43.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.629+0000 7f254270c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:43.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.629+0000 7f254270c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:43.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 5 note: GC not initialized 2024-09-12T18:03:43.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f23f5fdb640 20 reqs_thread_entry: start 2024-09-12T18:03:43.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:43.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 20 Filter name: none 2024-09-12T18:03:43.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f23677fe640 20 reqs_thread_entry: start 2024-09-12T18:03:43.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T18:03:43.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:43.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:43.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:43.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 : miss 2024-09-12T18:03:43.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:43.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 info.flags=0x17 2024-09-12T18:03:43.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 to cache LRU end 2024-09-12T18:03:43.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:43.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:43.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.633+0000 7f254270c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 2024-09-12T18:03:43.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.637+0000 7f254270c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:03:43.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.653+0000 7f254270c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 info.flags=0x17 2024-09-12T18:03:43.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.653+0000 7f254270c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 to cache LRU end 2024-09-12T18:03:43.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.653+0000 7f254270c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:43.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.653+0000 7f254270c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25, ofs0, ns] 2024-09-12T18:03:43.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.653+0000 7f2416ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431604 cookie 94121818800784 notifier 6389 bl.length()=939 2024-09-12T18:03:43.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.653+0000 7f2416ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 info.flags=0x17 2024-09-12T18:03:43.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.653+0000 7f2416ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 to cache LRU end 2024-09-12T18:03:43.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.653+0000 7f2416ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:43.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.657+0000 7f24177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431605 cookie 94121818800784 notifier 6389 bl.length()=939 2024-09-12T18:03:43.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.657+0000 7f24177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 info.flags=0x17 2024-09-12T18:03:43.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.657+0000 7f24177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 to cache LRU end 2024-09-12T18:03:43.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.657+0000 7f24177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:43.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.661+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): orig_sources= new_sources= 2024-09-12T18:03:43.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.661+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): potential sources added=[] removed=[] 2024-09-12T18:03:43.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.661+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): orig_dests= new_dests= 2024-09-12T18:03:43.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.661+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): potential dests added=[] removed=[] 2024-09-12T18:03:43.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.0 2024-09-12T18:03:43.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.0 2024-09-12T18:03:43.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.1 2024-09-12T18:03:43.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.1 2024-09-12T18:03:43.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.2 2024-09-12T18:03:43.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.2 2024-09-12T18:03:43.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.3 2024-09-12T18:03:43.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.3 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.4 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.4 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.5 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.5 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.6 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.6 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.7 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.7 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.8 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.8 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.9 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.9 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.10 2024-09-12T18:03:43.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.10 2024-09-12T18:03:43.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.11 2024-09-12T18:03:43.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2.11 2024-09-12T18:03:43.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.669+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.0 2024-09-12T18:03:43.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.673+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.1 2024-09-12T18:03:43.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.673+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2 2024-09-12T18:03:43.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.673+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.3 2024-09-12T18:03:43.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.677+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.4 2024-09-12T18:03:43.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.677+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.5 2024-09-12T18:03:43.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.677+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.6 2024-09-12T18:03:43.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.677+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.7 2024-09-12T18:03:43.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.681+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.8 2024-09-12T18:03:43.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.681+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.9 2024-09-12T18:03:43.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.681+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.10 2024-09-12T18:03:43.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.689+0000 7f254270c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:43.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.689+0000 7f254270c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 2024-09-12T18:03:43.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.693+0000 7f254270c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 info.flags=0x17 2024-09-12T18:03:43.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.693+0000 7f254270c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 to cache LRU end 2024-09-12T18:03:43.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.693+0000 7f254270c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:43.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.693+0000 7f254270c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25, ofs0, ns] 2024-09-12T18:03:43.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.693+0000 7f24177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431606 cookie 94121818800784 notifier 6389 bl.length()=939 2024-09-12T18:03:43.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.693+0000 7f24177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 info.flags=0x17 2024-09-12T18:03:43.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.693+0000 7f24177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 to cache LRU end 2024-09-12T18:03:43.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.693+0000 7f24177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:43.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.697+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): orig_sources= new_sources= 2024-09-12T18:03:43.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.697+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): potential sources added=[] removed=[] 2024-09-12T18:03:43.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.697+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): orig_dests= new_dests= 2024-09-12T18:03:43.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.697+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): potential dests added=[] removed=[] 2024-09-12T18:03:43.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.705+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.0 2024-09-12T18:03:43.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.705+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.1 2024-09-12T18:03:43.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.705+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.2 2024-09-12T18:03:43.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.705+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.3 2024-09-12T18:03:43.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.709+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.4 2024-09-12T18:03:43.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.709+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.5 2024-09-12T18:03:43.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.709+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.6 2024-09-12T18:03:43.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.709+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.7 2024-09-12T18:03:43.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.709+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.8 2024-09-12T18:03:43.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.713+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.9 2024-09-12T18:03:43.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.713+0000 7f254270c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.25.10 2024-09-12T18:03:43.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.713+0000 7f254270c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:43.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.713+0000 7f254270c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 2024-09-12T18:03:43.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.717+0000 7f254270c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 info.flags=0x17 2024-09-12T18:03:43.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.717+0000 7f254270c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 to cache LRU end 2024-09-12T18:03:43.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.717+0000 7f254270c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:43.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.717+0000 7f254270c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25, ofs0, ns] 2024-09-12T18:03:43.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.717+0000 7f2416ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431607 cookie 94121818800784 notifier 6389 bl.length()=907 2024-09-12T18:03:43.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.717+0000 7f2416ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 info.flags=0x17 2024-09-12T18:03:43.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.717+0000 7f2416ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.25 to cache LRU end 2024-09-12T18:03:43.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.717+0000 7f2416ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:43.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.721+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): orig_sources= new_sources= 2024-09-12T18:03:43.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.721+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): potential sources added=[] removed=[] 2024-09-12T18:03:43.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.721+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): orig_dests= new_dests= 2024-09-12T18:03:43.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.721+0000 7f254270c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.25]): potential dests added=[] removed=[] 2024-09-12T18:03:43.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.729+0000 7f254270c9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T18:03:43.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.733+0000 7f23f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:43.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.737+0000 7f254270c9c0 20 remove_watcher() i=0 2024-09-12T18:03:43.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.737+0000 7f254270c9c0 2 removed watcher, disabling cache 2024-09-12T18:03:43.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.737+0000 7f254270c9c0 20 remove_watcher() i=1 2024-09-12T18:03:43.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.741+0000 7f254270c9c0 20 remove_watcher() i=2 2024-09-12T18:03:43.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.741+0000 7f254270c9c0 20 remove_watcher() i=3 2024-09-12T18:03:43.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.745+0000 7f254270c9c0 20 remove_watcher() i=4 2024-09-12T18:03:43.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.749+0000 7f254270c9c0 20 remove_watcher() i=5 2024-09-12T18:03:43.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.749+0000 7f254270c9c0 20 remove_watcher() i=6 2024-09-12T18:03:43.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.753+0000 7f254270c9c0 20 remove_watcher() i=7 2024-09-12T18:03:43.773 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:03:43.803 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:43.803 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:43.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.845+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.849+0000 7f00fce289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.849+0000 7f00fce289c0 20 realm 2024-09-12T18:03:43.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.849+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.849+0000 7f00fce289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.849+0000 7f00fce289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:43.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.849+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.849+0000 7f00fce289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.849+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.849+0000 7f00fce289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:43.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.849+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.853+0000 7f00fce289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:43.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.853+0000 7f00fce289c0 20 searching for the correct realm 2024-09-12T18:03:43.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.861+0000 7f00fa12d640 0 -- 172.21.15.97:0/1810238400 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55ce92d42ec0 msgr2=0x55ce92d452e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:43.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.865+0000 7f00fa12d640 0 -- 172.21.15.97:0/1810238400 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x55ce92d4a930 msgr2=0x55ce92d4cd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:43.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:43.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:43.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:43.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:43.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:43.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:43.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:43.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:43.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 zone default found 2024-09-12T18:03:43.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 4 Realm: () 2024-09-12T18:03:43.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:43.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:43.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:43.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 zonegroup default 2024-09-12T18:03:43.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.873+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.877+0000 7f00fce289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.877+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.877+0000 7f00fce289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:43.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.877+0000 7f00fce289c0 20 started sync module instance, tier type = 2024-09-12T18:03:43.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.877+0000 7f00fce289c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:43.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.893+0000 7f00fce289c0 20 add_watcher() i=0 2024-09-12T18:03:43.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.893+0000 7f00fce289c0 20 add_watcher() i=1 2024-09-12T18:03:43.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.893+0000 7f00fce289c0 20 add_watcher() i=2 2024-09-12T18:03:43.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.893+0000 7f00fce289c0 20 add_watcher() i=3 2024-09-12T18:03:43.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.893+0000 7f00fce289c0 20 add_watcher() i=4 2024-09-12T18:03:43.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.893+0000 7f00fce289c0 20 add_watcher() i=5 2024-09-12T18:03:43.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.893+0000 7f00fce289c0 20 add_watcher() i=6 2024-09-12T18:03:43.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.897+0000 7f00fce289c0 20 add_watcher() i=7 2024-09-12T18:03:43.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.897+0000 7f00fce289c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:43.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7effb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:43.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 5 note: GC not initialized 2024-09-12T18:03:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7eff2bfff640 20 reqs_thread_entry: start 2024-09-12T18:03:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 Filter name: none 2024-09-12T18:03:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7eff29ffb640 20 reqs_thread_entry: start 2024-09-12T18:03:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:43.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:43.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:43.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:43.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.901+0000 7f00fce289c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:43.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.905+0000 7f00fce289c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:43.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.905+0000 7f00fce289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:43.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.905+0000 7effb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:43.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.913+0000 7f00fce289c0 20 remove_watcher() i=0 2024-09-12T18:03:43.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.913+0000 7f00fce289c0 2 removed watcher, disabling cache 2024-09-12T18:03:43.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.913+0000 7f00fce289c0 20 remove_watcher() i=1 2024-09-12T18:03:43.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.913+0000 7f00fce289c0 20 remove_watcher() i=2 2024-09-12T18:03:43.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.917+0000 7f00fce289c0 20 remove_watcher() i=3 2024-09-12T18:03:43.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.917+0000 7f00fce289c0 20 remove_watcher() i=4 2024-09-12T18:03:43.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.921+0000 7f00fce289c0 20 remove_watcher() i=5 2024-09-12T18:03:43.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.925+0000 7f00fce289c0 20 remove_watcher() i=6 2024-09-12T18:03:43.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:43.925+0000 7f00fce289c0 20 remove_watcher() i=7 2024-09-12T18:03:43.942 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:43.943 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:43.943 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-trim-reshard-log-entries id: 98539659-fdaf-41ce-847d-239ff89323af.4641.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:03:43.943 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:43.944 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:43.944 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:43.966 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:43.967 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:44.460 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:44.460 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:44.854 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T18:03:44.854 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:44.856 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:44.856 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:44.986 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:44.986 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:45.072 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:45.073 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:45.167 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:45.167 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:45.262 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:45.262 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:45.357 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:45.357 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:45.456 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:45.457 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:45.554 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:45.554 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:45.650 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:45.650 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:45.747 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:45.747 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:45.850 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:45.850 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:45.942 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:45.942 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:46.039 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:46.039 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:46.129 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:46.129 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:46.219 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:46.219 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:46.318 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:46.319 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:46.411 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:46.412 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:46.513 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:46.513 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:46.609 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:46.609 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:46.707 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:46.707 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:46.809 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:46.809 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:46.911 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:46.911 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:47.002 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:03:47.035 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:47.035 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:47.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.077+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.081+0000 7fe0553e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.081+0000 7fe0553e19c0 20 realm 2024-09-12T18:03:47.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.081+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.081+0000 7fe0553e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.081+0000 7fe0553e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:47.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.081+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.081+0000 7fe0553e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.081+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.081+0000 7fe0553e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:47.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.081+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.085+0000 7fe0553e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:47.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.085+0000 7fe0553e19c0 20 searching for the correct realm 2024-09-12T18:03:47.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.093+0000 7fe0536e8640 0 -- 172.21.15.97:0/4025136893 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x559de739b560 msgr2=0x559de739d9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:47.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.097+0000 7fe052ee7640 0 -- 172.21.15.97:0/4025136893 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x559de739f780 msgr2=0x559de73a1b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:47.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:47.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:47.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:47.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:47.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:47.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:47.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:47.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:47.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 zone default found 2024-09-12T18:03:47.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 4 Realm: () 2024-09-12T18:03:47.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:47.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:47.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:47.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 zonegroup default 2024-09-12T18:03:47.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.105+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.109+0000 7fe0553e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.109+0000 7fe0553e19c0 20 started sync module instance, tier type = 2024-09-12T18:03:47.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.109+0000 7fe0553e19c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:47.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.125+0000 7fe0553e19c0 20 add_watcher() i=0 2024-09-12T18:03:47.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.125+0000 7fe0553e19c0 20 add_watcher() i=1 2024-09-12T18:03:47.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.125+0000 7fe0553e19c0 20 add_watcher() i=2 2024-09-12T18:03:47.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.125+0000 7fe0553e19c0 20 add_watcher() i=3 2024-09-12T18:03:47.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.125+0000 7fe0553e19c0 20 add_watcher() i=4 2024-09-12T18:03:47.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.125+0000 7fe0553e19c0 20 add_watcher() i=5 2024-09-12T18:03:47.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.125+0000 7fe0553e19c0 20 add_watcher() i=6 2024-09-12T18:03:47.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.129+0000 7fe0553e19c0 20 add_watcher() i=7 2024-09-12T18:03:47.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.129+0000 7fe0553e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:47.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fdf09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:47.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fe0553e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:47.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fe0553e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:47.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fe0553e19c0 5 note: GC not initialized 2024-09-12T18:03:47.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fdf08fe1640 20 reqs_thread_entry: start 2024-09-12T18:03:47.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fe0553e19c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:47.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fe0553e19c0 20 Filter name: none 2024-09-12T18:03:47.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fdf01ffb640 20 reqs_thread_entry: start 2024-09-12T18:03:47.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fe0553e19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:47.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fe0553e19c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:47.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fe0553e19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:47.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.133+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.137+0000 7fe0553e19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:47.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.137+0000 7fe0553e19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.137+0000 7fe0553e19c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:47.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.137+0000 7fe0553e19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:47.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.141+0000 7fdf09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:47.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.145+0000 7fe0553e19c0 20 remove_watcher() i=0 2024-09-12T18:03:47.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.145+0000 7fe0553e19c0 2 removed watcher, disabling cache 2024-09-12T18:03:47.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.145+0000 7fe0553e19c0 20 remove_watcher() i=1 2024-09-12T18:03:47.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.149+0000 7fe0553e19c0 20 remove_watcher() i=2 2024-09-12T18:03:47.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.149+0000 7fe0553e19c0 20 remove_watcher() i=3 2024-09-12T18:03:47.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.153+0000 7fe0553e19c0 20 remove_watcher() i=4 2024-09-12T18:03:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.153+0000 7fe0553e19c0 20 remove_watcher() i=5 2024-09-12T18:03:47.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.157+0000 7fe0553e19c0 20 remove_watcher() i=6 2024-09-12T18:03:47.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.161+0000 7fe0553e19c0 20 remove_watcher() i=7 2024-09-12T18:03:47.176 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:47.176 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:47.176 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-trim-reshard-log-entries id: 98539659-fdaf-41ce-847d-239ff89323af.4641.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:03:47.176 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:47.177 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T18:03:47.212 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:47.212 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:47.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.253+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.257+0000 7f9a92a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.257+0000 7f9a92a6d9c0 20 realm 2024-09-12T18:03:47.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.257+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.257+0000 7f9a92a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.257+0000 7f9a92a6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:47.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.257+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.257+0000 7f9a92a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.257+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.257+0000 7f9a92a6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:47.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.257+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.261+0000 7f9a92a6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:47.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.261+0000 7f9a92a6d9c0 20 searching for the correct realm 2024-09-12T18:03:47.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.269+0000 7f9a90573640 0 -- 172.21.15.97:0/2389728379 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x5571e9fd6070 msgr2=0x5571e9fd84a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:47.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.273+0000 7f9a90573640 0 -- 172.21.15.97:0/2389728379 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f9a88029060 msgr2=0x7f9a8805e760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:47.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:47.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:47.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:47.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:47.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:47.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:47.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:47.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:47.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 zone default found 2024-09-12T18:03:47.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 4 Realm: () 2024-09-12T18:03:47.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:47.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:47.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:47.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 zonegroup default 2024-09-12T18:03:47.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 started sync module instance, tier type = 2024-09-12T18:03:47.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.281+0000 7f9a92a6d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:47.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.301+0000 7f9a92a6d9c0 20 add_watcher() i=0 2024-09-12T18:03:47.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.301+0000 7f9a92a6d9c0 20 add_watcher() i=1 2024-09-12T18:03:47.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.301+0000 7f9a92a6d9c0 20 add_watcher() i=2 2024-09-12T18:03:47.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.301+0000 7f9a92a6d9c0 20 add_watcher() i=3 2024-09-12T18:03:47.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.301+0000 7f9a92a6d9c0 20 add_watcher() i=4 2024-09-12T18:03:47.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.301+0000 7f9a92a6d9c0 20 add_watcher() i=5 2024-09-12T18:03:47.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.301+0000 7f9a92a6d9c0 20 add_watcher() i=6 2024-09-12T18:03:47.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.305+0000 7f9a92a6d9c0 20 add_watcher() i=7 2024-09-12T18:03:47.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.305+0000 7f9a92a6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:47.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9946fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:47.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:47.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:47.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 5 note: GC not initialized 2024-09-12T18:03:47.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9945fdb640 20 reqs_thread_entry: start 2024-09-12T18:03:47.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:47.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 20 Filter name: none 2024-09-12T18:03:47.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f98b77fe640 20 reqs_thread_entry: start 2024-09-12T18:03:47.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T18:03:47.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:47.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:47.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:47.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 : miss 2024-09-12T18:03:47.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.309+0000 7f9a92a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.313+0000 7f9a92a6d9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:47.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.313+0000 7f9a92a6d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 info.flags=0x17 2024-09-12T18:03:47.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.313+0000 7f9a92a6d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 to cache LRU end 2024-09-12T18:03:47.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.313+0000 7f9a92a6d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:47.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.313+0000 7f9a92a6d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:47.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.313+0000 7f9a92a6d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 2024-09-12T18:03:47.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9a92a6d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 info.flags=0x17 2024-09-12T18:03:47.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9a92a6d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 to cache LRU end 2024-09-12T18:03:47.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9a92a6d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:47.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9a92a6d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26, ofs0, ns] 2024-09-12T18:03:47.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9966ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431610 cookie 93947745406624 notifier 6437 bl.length()=939 2024-09-12T18:03:47.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9966ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 info.flags=0x17 2024-09-12T18:03:47.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9966ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 to cache LRU end 2024-09-12T18:03:47.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9966ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:47.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9a92a6d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.26]): orig_sources= new_sources= 2024-09-12T18:03:47.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9a92a6d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.26]): potential sources added=[] removed=[] 2024-09-12T18:03:47.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9a92a6d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.26]): orig_dests= new_dests= 2024-09-12T18:03:47.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9a92a6d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.26]): potential dests added=[] removed=[] 2024-09-12T18:03:47.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9a92a6d9c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T18:03:47.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.325+0000 7f9a92a6d9c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T18:03:47.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.0 2024-09-12T18:03:47.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.0 2024-09-12T18:03:47.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.1 2024-09-12T18:03:47.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.1 2024-09-12T18:03:47.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.2 2024-09-12T18:03:47.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.2 2024-09-12T18:03:47.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.3 2024-09-12T18:03:47.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.3 2024-09-12T18:03:47.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.4 2024-09-12T18:03:47.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.4 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.5 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.5 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.6 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.6 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.7 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.7 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.8 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.8 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.9 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.9 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.10 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.10 2024-09-12T18:03:47.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.11 2024-09-12T18:03:47.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1.11 2024-09-12T18:03:47.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.0 2024-09-12T18:03:47.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.1 2024-09-12T18:03:47.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.2 2024-09-12T18:03:47.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.3 2024-09-12T18:03:47.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.333+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.4 2024-09-12T18:03:47.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.337+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.5 2024-09-12T18:03:47.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.337+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.6 2024-09-12T18:03:47.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.337+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.7 2024-09-12T18:03:47.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.337+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.8 2024-09-12T18:03:47.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.337+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.9 2024-09-12T18:03:47.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.341+0000 7f9a92a6d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.26.10 2024-09-12T18:03:47.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.349+0000 7f9a92a6d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:47.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.349+0000 7f9a92a6d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 2024-09-12T18:03:47.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f9a92a6d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 info.flags=0x17 2024-09-12T18:03:47.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f9a92a6d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 to cache LRU end 2024-09-12T18:03:47.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f9a92a6d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:47.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f9a92a6d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26, ofs0, ns] 2024-09-12T18:03:47.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f99677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431611 cookie 93947745406624 notifier 6437 bl.length()=907 2024-09-12T18:03:47.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f99677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 info.flags=0x17 2024-09-12T18:03:47.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f99677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.26 to cache LRU end 2024-09-12T18:03:47.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f99677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:47.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f9a92a6d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.26]): orig_sources= new_sources= 2024-09-12T18:03:47.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f9a92a6d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.26]): potential sources added=[] removed=[] 2024-09-12T18:03:47.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f9a92a6d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.26]): orig_dests= new_dests= 2024-09-12T18:03:47.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.353+0000 7f9a92a6d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.26]): potential dests added=[] removed=[] 2024-09-12T18:03:47.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.361+0000 7f9a92a6d9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T18:03:47.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.365+0000 7f9946fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:47.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.369+0000 7f9a92a6d9c0 20 remove_watcher() i=0 2024-09-12T18:03:47.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.369+0000 7f9a92a6d9c0 2 removed watcher, disabling cache 2024-09-12T18:03:47.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.369+0000 7f9a92a6d9c0 20 remove_watcher() i=1 2024-09-12T18:03:47.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.373+0000 7f9a92a6d9c0 20 remove_watcher() i=2 2024-09-12T18:03:47.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.373+0000 7f9a92a6d9c0 20 remove_watcher() i=3 2024-09-12T18:03:47.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.377+0000 7f9a92a6d9c0 20 remove_watcher() i=4 2024-09-12T18:03:47.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.377+0000 7f9a92a6d9c0 20 remove_watcher() i=5 2024-09-12T18:03:47.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.381+0000 7f9a92a6d9c0 20 remove_watcher() i=6 2024-09-12T18:03:47.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.385+0000 7f9a92a6d9c0 20 remove_watcher() i=7 2024-09-12T18:03:47.403 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:03:47.430 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:47.430 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.473+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.473+0000 7f8a8670a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.473+0000 7f8a8670a9c0 20 realm 2024-09-12T18:03:47.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.473+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.473+0000 7f8a8670a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.473+0000 7f8a8670a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:47.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.473+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.477+0000 7f8a8670a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.477+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.477+0000 7f8a8670a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:47.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.477+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.477+0000 7f8a8670a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:47.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.477+0000 7f8a8670a9c0 20 searching for the correct realm 2024-09-12T18:03:47.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.485+0000 7f8a84210640 0 -- 172.21.15.97:0/1659213767 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f8a74008050 msgr2=0x7f8a7406d9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:47.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.489+0000 7f8a84210640 0 -- 172.21.15.97:0/1659213767 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x5593ffe9bb90 msgr2=0x5593ffe9df80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:47.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:47.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:47.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:47.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:47.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:47.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:47.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:47.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:47.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 zone default found 2024-09-12T18:03:47.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 4 Realm: () 2024-09-12T18:03:47.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:47.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:47.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:47.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 zonegroup default 2024-09-12T18:03:47.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.497+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.501+0000 7f8a8670a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:47.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.501+0000 7f8a8670a9c0 20 started sync module instance, tier type = 2024-09-12T18:03:47.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.501+0000 7f8a8670a9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:47.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.517+0000 7f8a8670a9c0 20 add_watcher() i=0 2024-09-12T18:03:47.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.517+0000 7f8a8670a9c0 20 add_watcher() i=1 2024-09-12T18:03:47.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.517+0000 7f8a8670a9c0 20 add_watcher() i=2 2024-09-12T18:03:47.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.517+0000 7f8a8670a9c0 20 add_watcher() i=3 2024-09-12T18:03:47.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.517+0000 7f8a8670a9c0 20 add_watcher() i=4 2024-09-12T18:03:47.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.517+0000 7f8a8670a9c0 20 add_watcher() i=5 2024-09-12T18:03:47.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.517+0000 7f8a8670a9c0 20 add_watcher() i=6 2024-09-12T18:03:47.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.521+0000 7f8a8670a9c0 20 add_watcher() i=7 2024-09-12T18:03:47.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.521+0000 7f8a8670a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:47.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f893afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:47.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8a8670a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:47.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8a8670a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:47.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8a8670a9c0 5 note: GC not initialized 2024-09-12T18:03:47.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8939fdb640 20 reqs_thread_entry: start 2024-09-12T18:03:47.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8a8670a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:47.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8a8670a9c0 20 Filter name: none 2024-09-12T18:03:47.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f88ab7fe640 20 reqs_thread_entry: start 2024-09-12T18:03:47.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8a8670a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:47.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8a8670a9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:47.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8a8670a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:47.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.525+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.529+0000 7f8a8670a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:47.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.529+0000 7f8a8670a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:47.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.529+0000 7f8a8670a9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:47.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.529+0000 7f8a8670a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:47.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.533+0000 7f893afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:47.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.537+0000 7f8a8670a9c0 20 remove_watcher() i=0 2024-09-12T18:03:47.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.537+0000 7f8a8670a9c0 2 removed watcher, disabling cache 2024-09-12T18:03:47.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.537+0000 7f8a8670a9c0 20 remove_watcher() i=1 2024-09-12T18:03:47.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.537+0000 7f8a8670a9c0 20 remove_watcher() i=2 2024-09-12T18:03:47.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.541+0000 7f8a8670a9c0 20 remove_watcher() i=3 2024-09-12T18:03:47.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.541+0000 7f8a8670a9c0 20 remove_watcher() i=4 2024-09-12T18:03:47.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.545+0000 7f8a8670a9c0 20 remove_watcher() i=5 2024-09-12T18:03:47.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.549+0000 7f8a8670a9c0 20 remove_watcher() i=6 2024-09-12T18:03:47.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:47.549+0000 7f8a8670a9c0 20 remove_watcher() i=7 2024-09-12T18:03:47.567 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:47.567 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:47.568 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-trim-reshard-log-entries id: 98539659-fdaf-41ce-847d-239ff89323af.4641.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T18:03:47.568 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:47.569 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:47.569 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:47.591 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:47.591 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:48.120 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:48.120 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:48.496 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T18:03:48.496 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:48.499 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:48.611 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:48.611 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:48.701 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:48.702 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:48.823 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:48.823 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:48.921 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:48.922 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:49.014 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:49.014 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:49.106 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:49.106 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:49.197 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:49.197 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:49.290 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:49.290 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:49.385 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:49.385 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:49.483 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:49.483 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:49.578 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:49.578 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:49.677 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:49.677 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:49.775 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:49.775 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:49.875 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:49.876 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:49.972 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:49.972 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:50.069 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:50.069 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:50.164 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:50.164 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:50.255 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:50.255 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:50.353 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:50.353 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:50.445 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:50.445 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:50.541 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:50.636 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T18:03:50.668 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:50.668 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:50.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.713+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.717+0000 7fcd068069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.717+0000 7fcd068069c0 20 realm 2024-09-12T18:03:50.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.717+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.717+0000 7fcd068069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.717+0000 7fcd068069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:50.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.717+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.717+0000 7fcd068069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.717+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.721+0000 7fcd068069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:50.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.721+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.721+0000 7fcd068069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:50.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.721+0000 7fcd068069c0 20 searching for the correct realm 2024-09-12T18:03:50.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.725+0000 7fcd03b0b640 0 -- 172.21.15.97:0/1195606566 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fccf80dd040 msgr2=0x7fccf80ea930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:50.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.733+0000 7fcd04b0d640 0 -- 172.21.15.97:0/1195606566 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x558076d71a90 msgr2=0x558076d73f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:50.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:50.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:50.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:50.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:50.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:50.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:50.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:50.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 zone default found 2024-09-12T18:03:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 4 Realm: () 2024-09-12T18:03:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 zonegroup default 2024-09-12T18:03:50.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.741+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.745+0000 7fcd068069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.745+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.745+0000 7fcd068069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.745+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.745+0000 7fcd068069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.745+0000 7fcd068069c0 20 started sync module instance, tier type = 2024-09-12T18:03:50.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.745+0000 7fcd068069c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:50.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.765+0000 7fcd068069c0 20 add_watcher() i=0 2024-09-12T18:03:50.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.765+0000 7fcd068069c0 20 add_watcher() i=1 2024-09-12T18:03:50.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.765+0000 7fcd068069c0 20 add_watcher() i=2 2024-09-12T18:03:50.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.765+0000 7fcd068069c0 20 add_watcher() i=3 2024-09-12T18:03:50.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.765+0000 7fcd068069c0 20 add_watcher() i=4 2024-09-12T18:03:50.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.765+0000 7fcd068069c0 20 add_watcher() i=5 2024-09-12T18:03:50.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.765+0000 7fcd068069c0 20 add_watcher() i=6 2024-09-12T18:03:50.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.765+0000 7fcd068069c0 20 add_watcher() i=7 2024-09-12T18:03:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.765+0000 7fcd068069c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.769+0000 7fcbbafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.769+0000 7fcd068069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.769+0000 7fcd068069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.769+0000 7fcd068069c0 5 note: GC not initialized 2024-09-12T18:03:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.769+0000 7fcbb9fdb640 20 reqs_thread_entry: start 2024-09-12T18:03:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.769+0000 7fcd068069c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.769+0000 7fcd068069c0 20 Filter name: none 2024-09-12T18:03:50.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.769+0000 7fcb2b7fe640 20 reqs_thread_entry: start 2024-09-12T18:03:50.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.769+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.769+0000 7fcd068069c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.769+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.773+0000 7fcd068069c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.773+0000 7fcd068069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.773+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.773+0000 7fcd068069c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.773+0000 7fcd068069c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.773+0000 7fcd068069c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:50.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.773+0000 7fcd068069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:50.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.777+0000 7fcbbafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:50.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.781+0000 7fcd068069c0 20 remove_watcher() i=0 2024-09-12T18:03:50.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.781+0000 7fcd068069c0 2 removed watcher, disabling cache 2024-09-12T18:03:50.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.781+0000 7fcd068069c0 20 remove_watcher() i=1 2024-09-12T18:03:50.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.785+0000 7fcd068069c0 20 remove_watcher() i=2 2024-09-12T18:03:50.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.785+0000 7fcd068069c0 20 remove_watcher() i=3 2024-09-12T18:03:50.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.789+0000 7fcd068069c0 20 remove_watcher() i=4 2024-09-12T18:03:50.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.789+0000 7fcd068069c0 20 remove_watcher() i=5 2024-09-12T18:03:50.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.793+0000 7fcd068069c0 20 remove_watcher() i=6 2024-09-12T18:03:50.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.797+0000 7fcd068069c0 20 remove_watcher() i=7 2024-09-12T18:03:50.812 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:50.812 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:50.812 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-trim-reshard-log-entries id: 98539659-fdaf-41ce-847d-239ff89323af.4641.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:03:50.812 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:50.813 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T18:03:50.846 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:50.846 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:50.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 realm 2024-09-12T18:03:50.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:50.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:50.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:50.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 searching for the correct realm 2024-09-12T18:03:50.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.901+0000 7fd99fdeb640 0 -- 172.21.15.97:0/44696427 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fd9880bf040 msgr2=0x7fd9880b5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:50.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.905+0000 7fd99fdeb640 0 -- 172.21.15.97:0/44696427 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x564d0f65c190 msgr2=0x564d0f65e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:50.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:50.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:50.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:50.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:50.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:50.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:50.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:50.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 zone default found 2024-09-12T18:03:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 4 Realm: () 2024-09-12T18:03:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:50.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 zonegroup default 2024-09-12T18:03:50.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 started sync module instance, tier type = 2024-09-12T18:03:50.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:50.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=0 2024-09-12T18:03:50.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=1 2024-09-12T18:03:50.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=2 2024-09-12T18:03:50.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=3 2024-09-12T18:03:50.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=4 2024-09-12T18:03:50.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=5 2024-09-12T18:03:50.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=6 2024-09-12T18:03:50.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.937+0000 7fd9a2ae69c0 20 add_watcher() i=7 2024-09-12T18:03:50.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.937+0000 7fd9a2ae69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:50.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd856fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:50.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:50.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:50.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 note: GC not initialized 2024-09-12T18:03:50.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd855fdb640 20 reqs_thread_entry: start 2024-09-12T18:03:50.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:50.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 Filter name: none 2024-09-12T18:03:50.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd7c77fe640 20 reqs_thread_entry: start 2024-09-12T18:03:50.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:03:50.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:50.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:50.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:50.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 : miss 2024-09-12T18:03:50.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:50.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:03:50.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:03:50.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:50.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:50.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 2024-09-12T18:03:50.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:03:50.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:03:50.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:50.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27, ofs0, ns] 2024-09-12T18:03:50.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94888970859488 notifier 6488 bl.length()=939 2024-09-12T18:03:50.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:03:50.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:03:50.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:50.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_sources= new_sources= 2024-09-12T18:03:50.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential sources added=[] removed=[] 2024-09-12T18:03:50.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_dests= new_dests= 2024-09-12T18:03:50.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential dests added=[] removed=[] 2024-09-12T18:03:50.960 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9a2ae69c0 time 2024-09-12T18:03:50.963069+0000 2024-09-12T18:03:50.960 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:50.961 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:50.961 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd9a63c02eb] 2024-09-12T18:03:50.961 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd9a63c049f] 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d0d45f0c1] 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x141007e) [0x564d0deb507e] 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d0d47118d] 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9a5226d90] 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.961+0000 7fd9a2ae69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9a2ae69c0 time 2024-09-12T18:03:50.963069+0000 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:50.962 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd9a63c02eb] 2024-09-12T18:03:50.963 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd9a63c049f] 2024-09-12T18:03:50.963 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d0d45f0c1] 2024-09-12T18:03:50.963 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x141007e) [0x564d0deb507e] 2024-09-12T18:03:50.963 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d0d47118d] 2024-09-12T18:03:50.963 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:03:50.963 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9a5226d90] 2024-09-12T18:03:50.963 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:03:50.963 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:03:50.963 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:50.963 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:03:50.963 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fd9a2ae69c0 thread_name:radosgw-admin 2024-09-12T18:03:50.986 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:50.986 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9a523f520] 2024-09-12T18:03:50.986 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:03:50.986 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd9a63c0345] 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd9a63c049f] 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d0d45f0c1] 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x141007e) [0x564d0deb507e] 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d0d47118d] 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9a5226d90] 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:50.961+0000 7fd9a2ae69c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fd9a2ae69c0 thread_name:radosgw-admin 2024-09-12T18:03:50.987 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9a523f520] 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd9a63c0345] 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd9a63c049f] 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d0d45f0c1] 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x141007e) [0x564d0deb507e] 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d0d47118d] 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:03:50.988 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9a5226d90] 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:03:50.865+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:03:50.865+0000 7fd9a05ec640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:03:50.865+0000 7fd9a05ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:03:50.865+0000 7fd99fdeb640 10 monclient(hunting): handle_auth_done global_id 6870 payload 274 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:03:50.865+0000 7fd99fdeb640 10 monclient: _finish_hunting 0 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:03:50.865+0000 7fd99fdeb640 1 monclient: found mon.noname-a 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:03:50.865+0000 7fd99fdeb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:50.989 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: dump: 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: _finish_auth 0 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: _check_auth_tickets 2024-09-12T18:03:50.990 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: dump: 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:50.991 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:03:50.865+0000 7fd9a2ae69c0 5 monclient: authenticate success, global_id 6870 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:03:50.865+0000 7fd9a2ae69c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:03:50.865+0000 7fd9a2ae69c0 4 set_mon_vals no callback set 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:03:50.865+0000 7fd9a2ae69c0 10 monclient: shutdown 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:03:50.865+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) unregister_commands rotate-key 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: build_initial_monmap 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: monmap: 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:50.992 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding auth protocol: cephx 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding auth protocol: cephx 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding auth protocol: cephx 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:50.993 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 librados: starting msgr at 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 librados: starting objecter 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command objecter_requests hook 0x564d0f4b95f0 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 librados: setting wanted keys 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 librados: calling monclient init 2024-09-12T18:03:50.994 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: init 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding auth protocol: cephx 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding auth protocol: cephx 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding auth protocol: cephx 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:50.995 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command rotate-key hook 0x564d0f573088 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-c con 0x564d0f3eddc0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-b con 0x564d0f428350 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-a con 0x564d0f4287e0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:50.996 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): authenticate will time out at 2660.281236s 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request con 0x564d0f3eddc0 auth_method 0 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request con 0x564d0f4287e0 auth_method 0 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:50.997 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_done global_id 6479 payload 824 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient: _finish_hunting 0 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 1 monclient: found mon.noname-c 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: dump: 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:50.998 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: _finish_auth 0 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: _check_auth_tickets 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:50.999 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: dump: 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:03:50.869+0000 7fd88e60c640 4 set_mon_vals no callback set 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 monclient: authenticate success, global_id 6479 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.000 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 librados: init done 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:03:50.873+0000 7fd88ce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:03:50.873+0000 7fd88ce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:03:50.873+0000 7fd88ce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:03:50.873+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x7fd888070ae0 auth_method 0 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:03:50.873+0000 7fd9a0ded640 10 monclient: get_auth_request con 0x564d0f5b24c0 auth_method 0 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:03:50.873+0000 7fd9a05ec640 10 monclient: get_auth_request con 0x564d0f5bdae0 auth_method 0 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:03:50.873+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x564d0f5c1e40 auth_method 0 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient: build_initial_monmap 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:51.001 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient: monmap: 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding auth protocol: cephx 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding auth protocol: cephx 2024-09-12T18:03:51.002 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding auth protocol: cephx 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.003 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command objecter_requests cmddesc objecter_requests hook 0x564d0f5ca720 EEXIST 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient: init 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding auth protocol: cephx 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding auth protocol: cephx 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding auth protocol: cephx 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.004 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command rotate-key cmddesc rotate-key hook 0x564d0f5c5280 EEXIST 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-c con 0x564d0f5ee8d0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-b con 0x564d0f5ee200 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-a con 0x564d0f5ecbe0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.005 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): authenticate will time out at 2660.291637s 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request con 0x564d0f5ee8d0 auth_method 0 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request con 0x564d0f5ecbe0 auth_method 0 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.006 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): get_auth_request con 0x564d0f5ee200 auth_method 0 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:03:50.881+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_done global_id 6482 payload 824 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:03:50.881+0000 7fd9a05ec640 10 monclient: _finish_hunting 0 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:03:50.881+0000 7fd9a05ec640 1 monclient: found mon.noname-c 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:03:50.881+0000 7fd9a05ec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:51.007 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: dump: 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: _finish_auth 0 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:51.008 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: dump: 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.009 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 monclient: authenticate success, global_id 6482 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:03:50.881+0000 7fd99f5ea640 4 set_mon_vals no callback set 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:03:50.881+0000 7fd885ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:03:50.881+0000 7fd885ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:03:50.881+0000 7fd885ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x7fd878070a20 auth_method 0 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: get_monmap_and_config 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: build_initial_monmap 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:51.010 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: monmap: 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding auth protocol: cephx 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding auth protocol: cephx 2024-09-12T18:03:51.011 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding auth protocol: cephx 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.012 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: init 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding auth protocol: cephx 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding auth protocol: cephx 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding auth protocol: cephx 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.013 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command rotate-key cmddesc rotate-key hook 0x7ffffba9a898 EEXIST 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-b con 0x564d0f6427a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-c con 0x564d0f63db90 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-a con 0x564d0f63e510 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.014 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): authenticate will time out at 2660.295803s 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): get_auth_request con 0x564d0f63db90 auth_method 0 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:03:50.881+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request con 0x564d0f63e510 auth_method 0 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:03:50.881+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:03:50.881+0000 7fd9a0ded640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:03:50.881+0000 7fd9a0ded640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.015 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient(hunting): handle_auth_done global_id 6485 payload 274 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient: _finish_hunting 0 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 1 monclient: found mon.noname-c 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: dump: 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.016 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: _finish_auth 0 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: _check_auth_tickets 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: dump: 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.017 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 monclient: authenticate success, global_id 6485 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 4 set_mon_vals no callback set 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: shutdown 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: build_initial_monmap 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:51.018 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: monmap: 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding auth protocol: cephx 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding auth protocol: cephx 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding auth protocol: cephx 2024-09-12T18:03:51.019 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.020 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 librados: starting msgr at 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 librados: starting objecter 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command objecter_requests cmddesc objecter_requests hook 0x564d0f613a40 EEXIST 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 librados: setting wanted keys 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 librados: calling monclient init 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: init 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding auth protocol: cephx 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding auth protocol: cephx 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding auth protocol: cephx 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.021 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command rotate-key cmddesc rotate-key hook 0x564d0f5f0838 EEXIST 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-a con 0x564d0f63db90 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:51.022 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-b con 0x564d0f63e510 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-c con 0x564d0f6427a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): authenticate will time out at 2660.298454s 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request con 0x564d0f6427a0 auth_method 0 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request con 0x564d0f63db90 auth_method 0 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.023 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_done global_id 6488 payload 824 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient: _finish_hunting 0 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 1 monclient: found mon.noname-c 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:51.024 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: dump: 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: _finish_auth 0 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:03:51.025 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: dump: 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.026 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:03:50.885+0000 7fd8777fe640 4 set_mon_vals no callback set 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 monclient: authenticate success, global_id 6488 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 librados: init done 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command cr dump hook 0x564d0f631828 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:03:50.889+0000 7fd875ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:03:50.889+0000 7fd875ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:03:50.889+0000 7fd875ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:03:50.889+0000 7fd9a05ec640 10 monclient: get_auth_request con 0x7fd868070ae0 auth_method 0 2024-09-12T18:03:51.027 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:03:50.889+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x564d0f65c190 auth_method 0 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 realm 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:03:50.893+0000 7fd9a05ec640 10 monclient: get_auth_request con 0x564d0f660390 auth_method 0 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:03:50.893+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x564d0f663bf0 auth_method 0 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:51.028 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 searching for the correct realm 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:03:50.897+0000 7fd9a0ded640 10 monclient: get_auth_request con 0x7fd9880cc040 auth_method 0 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:03:50.897+0000 7fd9a05ec640 10 monclient: get_auth_request con 0x7fd99006abd0 auth_method 0 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:03:50.897+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x7fd9880bf040 auth_method 0 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:03:50.901+0000 7fd99fdeb640 0 -- 172.21.15.97:0/44696427 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fd9880bf040 msgr2=0x7fd9880b5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:03:50.901+0000 7fd875ffb640 1 client.6488.objecter ms_handle_reset 0x7fd9880bf040 session 0x7fd9880a6070 osd.5 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:03:50.901+0000 7fd875ffb640 10 monclient: _renew_subs 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:03:50.901+0000 7fd875ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:03:50.901+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x7fd868080580 auth_method 0 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:03:50.901+0000 7fd9a0ded640 10 monclient: get_auth_request con 0x7fd99004fb80 auth_method 0 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:03:50.905+0000 7fd9a05ec640 10 monclient: get_auth_request con 0x7fd9980620a0 auth_method 0 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:03:50.905+0000 7fd99fdeb640 0 -- 172.21.15.97:0/44696427 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x564d0f65c190 msgr2=0x564d0f65e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:51.029 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:03:50.905+0000 7fd875ffb640 1 client.6488.objecter ms_handle_reset 0x564d0f65c190 session 0x564d0f65bac0 osd.6 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:03:50.905+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x7fd9880bf040 auth_method 0 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:51.030 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 zone default found 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 4 Realm: () 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 zonegroup default 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.031 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 started sync module instance, tier type = 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=0 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=1 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=2 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=3 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=4 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=5 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=6 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:03:50.937+0000 7fd9a2ae69c0 20 add_watcher() i=7 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:03:50.937+0000 7fd9a2ae69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding auth protocol: cephx 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding auth protocol: cephx 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding auth protocol: cephx 2024-09-12T18:03:51.032 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:03:50.941+0000 7fd856fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.033 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command cache list hook 0x564d0f612670 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command cache inspect hook 0x564d0f612670 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command cache erase hook 0x564d0f612670 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command cache zap hook 0x564d0f612670 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 note: GC not initialized 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:03:50.941+0000 7fd855fdb640 20 reqs_thread_entry: start 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command sync trace show hook 0x7fd998001320 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command sync trace history hook 0x7fd998001320 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command sync trace active hook 0x7fd998001320 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command sync trace active_short hook 0x7fd998001320 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:51.034 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 Filter name: none 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:03:50.941+0000 7fd7c77fe640 20 reqs_thread_entry: start 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 : miss 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:51.035 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27, ofs0, ns] 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94888970859488 notifier 6488 bl.length()=939 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_sources= new_sources= 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential sources added=[] removed=[] 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_dests= new_dests= 2024-09-12T18:03:51.036 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential dests added=[] removed=[] 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:03:50.961+0000 7fd9a2ae69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9a2ae69c0 time 2024-09-12T18:03:50.963069+0000 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd9a63c02eb] 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd9a63c049f] 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d0d45f0c1] 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x141007e) [0x564d0deb507e] 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d0d47118d] 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9a5226d90] 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:03:51.037 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:03:50.961+0000 7fd9a2ae69c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fd9a2ae69c0 thread_name:radosgw-admin 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9a523f520] 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd9a63c0345] 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd9a63c049f] 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d0d45f0c1] 2024-09-12T18:03:51.038 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x141007e) [0x564d0deb507e] 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d0d47118d] 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9a5226d90] 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:03:51.039 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:03:51.040 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:03:51.041 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:03:51.042 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:03:51.043 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:03:51.044 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:03:51.045 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd7c77fe640 / http_manager 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd855fdb640 / http_manager 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd856fdd640 / rgw_dt_lg_renew 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd875ffb640 / ms_dispatch 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd876ffd640 / io_context_pool 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd8777fe640 / io_context_pool 2024-09-12T18:03:51.046 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd885ffb640 / ms_dispatch 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd88ce09640 / ms_dispatch 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd88e60c640 / io_context_pool 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd99f5ea640 / io_context_pool 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd99fdeb640 / msgr-worker-2 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd9a05ec640 / msgr-worker-1 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd9a0ded640 / msgr-worker-0 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd9a2ae69c0 / radosgw-admin 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.99849.log 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:03:50.865+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:03:50.865+0000 7fd9a05ec640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.047 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:03:50.865+0000 7fd9a05ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:03:50.865+0000 7fd99fdeb640 10 monclient(hunting): handle_auth_done global_id 6870 payload 274 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:03:50.865+0000 7fd99fdeb640 10 monclient: _finish_hunting 0 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:03:50.865+0000 7fd99fdeb640 1 monclient: found mon.noname-a 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:03:50.865+0000 7fd99fdeb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: dump: 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.048 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: _finish_auth 0 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: _check_auth_tickets 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:03:50.865+0000 7fd88e60c640 10 monclient: dump: 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.049 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:03:50.865+0000 7fd9a2ae69c0 5 monclient: authenticate success, global_id 6870 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:03:50.865+0000 7fd9a2ae69c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:03:50.865+0000 7fd9a2ae69c0 4 set_mon_vals no callback set 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:03:50.865+0000 7fd9a2ae69c0 10 monclient: shutdown 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:03:50.865+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) unregister_commands rotate-key 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: build_initial_monmap 2024-09-12T18:03:51.050 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: monmap: 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding auth protocol: cephx 2024-09-12T18:03:51.051 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding auth protocol: cephx 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding auth protocol: cephx 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: crc 2024-09-12T18:03:51.052 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f578580) adding con mode: secure 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 librados: starting msgr at 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 librados: starting objecter 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command objecter_requests hook 0x564d0f4b95f0 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 librados: setting wanted keys 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 librados: calling monclient init 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: init 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding auth protocol: cephx 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding auth protocol: cephx 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding auth protocol: cephx 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:51.053 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: crc 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f572f40) adding con mode: secure 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command rotate-key hook 0x564d0f573088 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:51.054 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-c con 0x564d0f3eddc0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-b con 0x564d0f428350 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-a con 0x564d0f4287e0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient(hunting): authenticate will time out at 2660.281236s 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request con 0x564d0f3eddc0 auth_method 0 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.055 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request con 0x564d0f4287e0 auth_method 0 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:03:50.869+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_done global_id 6479 payload 824 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient: _finish_hunting 0 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 1 monclient: found mon.noname-c 2024-09-12T18:03:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:03:50.869+0000 7fd9a05ec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: dump: 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.057 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: _finish_auth 0 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: _check_auth_tickets 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:03:50.869+0000 7fd88ce09640 10 monclient: dump: 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.058 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:03:50.869+0000 7fd88e60c640 4 set_mon_vals no callback set 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 5 monclient: authenticate success, global_id 6479 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:03:50.869+0000 7fd9a2ae69c0 1 librados: init done 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:03:50.873+0000 7fd88ce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:03:50.873+0000 7fd88ce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:03:50.873+0000 7fd88ce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:03:50.873+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x7fd888070ae0 auth_method 0 2024-09-12T18:03:51.059 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:03:50.873+0000 7fd9a0ded640 10 monclient: get_auth_request con 0x564d0f5b24c0 auth_method 0 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:03:50.873+0000 7fd9a05ec640 10 monclient: get_auth_request con 0x564d0f5bdae0 auth_method 0 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:03:50.873+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x564d0f5c1e40 auth_method 0 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient: build_initial_monmap 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient: monmap: 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:51.060 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding auth protocol: cephx 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding auth protocol: cephx 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding auth protocol: cephx 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.061 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: crc 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c6bd0) adding con mode: secure 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command objecter_requests cmddesc objecter_requests hook 0x564d0f5ca720 EEXIST 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient: init 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding auth protocol: cephx 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding auth protocol: cephx 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding auth protocol: cephx 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.062 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: crc 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5c5138) adding con mode: secure 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command rotate-key cmddesc rotate-key hook 0x564d0f5c5280 EEXIST 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:03:51.063 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-c con 0x564d0f5ee8d0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-b con 0x564d0f5ee200 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-a con 0x564d0f5ecbe0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:03:50.877+0000 7fd9a2ae69c0 10 monclient(hunting): authenticate will time out at 2660.291637s 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request con 0x564d0f5ee8d0 auth_method 0 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request con 0x564d0f5ecbe0 auth_method 0 2024-09-12T18:03:51.064 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:03:50.877+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:03:50.877+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): get_auth_request con 0x564d0f5ee200 auth_method 0 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.065 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:03:50.881+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_done global_id 6482 payload 824 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:03:50.881+0000 7fd9a05ec640 10 monclient: _finish_hunting 0 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:03:50.881+0000 7fd9a05ec640 1 monclient: found mon.noname-c 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:03:50.881+0000 7fd9a05ec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: dump: 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.066 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: _finish_auth 0 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:03:50.881+0000 7fd885ffb640 10 monclient: dump: 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.067 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 monclient: authenticate success, global_id 6482 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:03:50.881+0000 7fd99f5ea640 4 set_mon_vals no callback set 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:03:50.881+0000 7fd885ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:51.068 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:03:50.881+0000 7fd885ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:03:50.881+0000 7fd885ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x7fd878070a20 auth_method 0 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: get_monmap_and_config 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: build_initial_monmap 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: monmap: 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:51.069 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding auth protocol: cephx 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding auth protocol: cephx 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding auth protocol: cephx 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.070 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: crc 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f60e280) adding con mode: secure 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: init 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding auth protocol: cephx 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding auth protocol: cephx 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding auth protocol: cephx 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.071 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: crc 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9a750) adding con mode: secure 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command rotate-key cmddesc rotate-key hook 0x7ffffba9a898 EEXIST 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-b con 0x564d0f6427a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-c con 0x564d0f63db90 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:51.072 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-a con 0x564d0f63e510 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:03:50.881+0000 7fd9a2ae69c0 10 monclient(hunting): authenticate will time out at 2660.295803s 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): get_auth_request con 0x564d0f63db90 auth_method 0 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:03:50.881+0000 7fd99fdeb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:03:50.881+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request con 0x564d0f63e510 auth_method 0 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:03:50.881+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:03:50.881+0000 7fd9a0ded640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:03:50.881+0000 7fd9a0ded640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.073 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient(hunting): handle_auth_done global_id 6485 payload 274 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient: _finish_hunting 0 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 1 monclient: found mon.noname-c 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:03:50.885+0000 7fd99fdeb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: dump: 2024-09-12T18:03:51.074 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: _finish_auth 0 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: _check_auth_tickets 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.075 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:03:50.885+0000 7fd8777fe640 10 monclient: dump: 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 monclient: authenticate success, global_id 6485 2024-09-12T18:03:51.076 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: get_monmap_and_config success 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 4 set_mon_vals no callback set 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: shutdown 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: build_initial_monmap 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 build_initial for_mkfs: 0 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: monmap: 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:03:51.077 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding auth protocol: cephx 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding auth protocol: cephx 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding auth protocol: cephx 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.078 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: crc 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f63e9e0) adding con mode: secure 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 librados: starting msgr at 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 librados: starting objecter 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command objecter_requests cmddesc objecter_requests hook 0x564d0f613a40 EEXIST 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 librados: setting wanted keys 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 librados: calling monclient init 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: init 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding auth protocol: cephx 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding auth protocol: cephx 2024-09-12T18:03:51.079 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding auth protocol: cephx 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: crc 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 AuthRegistry(0x564d0f5f06f0) adding con mode: secure 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.080 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command rotate-key cmddesc rotate-key hook 0x564d0f5f0838 EEXIST 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _reopen_session rank -1 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-a con 0x564d0f63db90 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-b con 0x564d0f63e510 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): picked mon.noname-c con 0x564d0f6427a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): _renew_subs 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient(hunting): authenticate will time out at 2660.298454s 2024-09-12T18:03:51.081 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request con 0x564d0f6427a0 auth_method 0 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request con 0x564d0f63db90 auth_method 0 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:03:50.885+0000 7fd9a05ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:03:51.082 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient(hunting): handle_auth_done global_id 6488 payload 824 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient: _finish_hunting 0 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 1 monclient: found mon.noname-c 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:03:50.885+0000 7fd9a0ded640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: dump: 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.083 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.084 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.084 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.084 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: _finish_auth 0 2024-09-12T18:03:51.084 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:03:51.084 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:03:51.085 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:03:51.085 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:03:51.085 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:03:50.885+0000 7fd875ffb640 10 monclient: dump: 2024-09-12T18:03:51.085 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:03:51.085 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:03:50.885+0000 7fd8777fe640 4 set_mon_vals no callback set 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 monclient: authenticate success, global_id 6488 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.086 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _renew_subs 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 1 librados: init done 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:03:50.885+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command cr dump hook 0x564d0f631828 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:03:50.889+0000 7fd875ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:03:50.889+0000 7fd875ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:03:50.889+0000 7fd875ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:03:50.889+0000 7fd9a05ec640 10 monclient: get_auth_request con 0x7fd868070ae0 auth_method 0 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:03:50.889+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x564d0f65c190 auth_method 0 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 realm 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:03:50.889+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.087 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:03:50.893+0000 7fd9a05ec640 10 monclient: get_auth_request con 0x564d0f660390 auth_method 0 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:03:50.893+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x564d0f663bf0 auth_method 0 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:03:50.893+0000 7fd9a2ae69c0 20 searching for the correct realm 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:03:50.897+0000 7fd9a0ded640 10 monclient: get_auth_request con 0x7fd9880cc040 auth_method 0 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:03:50.897+0000 7fd9a05ec640 10 monclient: get_auth_request con 0x7fd99006abd0 auth_method 0 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:03:50.897+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x7fd9880bf040 auth_method 0 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:03:50.901+0000 7fd99fdeb640 0 -- 172.21.15.97:0/44696427 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fd9880bf040 msgr2=0x7fd9880b5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:51.088 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:03:50.901+0000 7fd875ffb640 1 client.6488.objecter ms_handle_reset 0x7fd9880bf040 session 0x7fd9880a6070 osd.5 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:03:50.901+0000 7fd875ffb640 10 monclient: _renew_subs 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:03:50.901+0000 7fd875ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:03:50.901+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x7fd868080580 auth_method 0 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:03:50.901+0000 7fd9a0ded640 10 monclient: get_auth_request con 0x7fd99004fb80 auth_method 0 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:03:50.905+0000 7fd9a05ec640 10 monclient: get_auth_request con 0x7fd9980620a0 auth_method 0 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:03:50.905+0000 7fd99fdeb640 0 -- 172.21.15.97:0/44696427 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x564d0f65c190 msgr2=0x564d0f65e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:03:50.905+0000 7fd875ffb640 1 client.6488.objecter ms_handle_reset 0x564d0f65c190 session 0x564d0f65bac0 osd.6 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:03:50.905+0000 7fd99fdeb640 10 monclient: get_auth_request con 0x7fd9880bf040 auth_method 0 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:51.089 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 zone default found 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 4 Realm: () 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:51.090 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 zonegroup default 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:03:50.913+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 started sync module instance, tier type = 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:03:50.917+0000 7fd9a2ae69c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=0 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=1 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=2 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=3 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=4 2024-09-12T18:03:51.091 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=5 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:03:50.933+0000 7fd9a2ae69c0 20 add_watcher() i=6 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:03:50.937+0000 7fd9a2ae69c0 20 add_watcher() i=7 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:03:50.937+0000 7fd9a2ae69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding auth protocol: cephx 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding auth protocol: cephx 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding auth protocol: cephx 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:03:50.941+0000 7fd856fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.092 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: crc 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 AuthRegistry(0x7ffffba9ac20) adding con mode: secure 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command cache list hook 0x564d0f612670 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command cache inspect hook 0x564d0f612670 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command cache erase hook 0x564d0f612670 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command cache zap hook 0x564d0f612670 2024-09-12T18:03:51.093 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 note: GC not initialized 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:03:50.941+0000 7fd855fdb640 20 reqs_thread_entry: start 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command sync trace show hook 0x7fd998001320 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command sync trace history hook 0x7fd998001320 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command sync trace active hook 0x7fd998001320 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 5 asok(0x564d0f3662b0) register_command sync trace active_short hook 0x7fd998001320 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 Filter name: none 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:03:50.941+0000 7fd7c77fe640 20 reqs_thread_entry: start 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:51.094 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 : miss 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:03:50.941+0000 7fd9a2ae69c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:03:50.945+0000 7fd9a2ae69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:03:50.953+0000 7fd9a2ae69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27, ofs0, ns] 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94888970859488 notifier 6488 bl.length()=939 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:03:51.095 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:03:50.957+0000 7fd876ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_sources= new_sources= 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential sources added=[] removed=[] 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_dests= new_dests= 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:03:50.957+0000 7fd9a2ae69c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential dests added=[] removed=[] 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:03:50.961+0000 7fd9a2ae69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9a2ae69c0 time 2024-09-12T18:03:50.963069+0000 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd9a63c02eb] 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd9a63c049f] 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d0d45f0c1] 2024-09-12T18:03:51.096 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x141007e) [0x564d0deb507e] 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d0d47118d] 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9a5226d90] 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:03:50.961+0000 7fd9a2ae69c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fd9a2ae69c0 thread_name:radosgw-admin 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9a523f520] 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:03:51.097 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd9a63c0345] 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd9a63c049f] 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d0d45f0c1] 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x141007e) [0x564d0deb507e] 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d0d47118d] 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9a5226d90] 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:03:51.098 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:03:51.099 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:03:51.100 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:03:51.101 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:03:51.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:03:51.103 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:03:51.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd7c77fe640 / http_manager 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd855fdb640 / http_manager 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd856fdd640 / rgw_dt_lg_renew 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd875ffb640 / ms_dispatch 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd876ffd640 / io_context_pool 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd8777fe640 / io_context_pool 2024-09-12T18:03:51.105 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd885ffb640 / ms_dispatch 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd88ce09640 / ms_dispatch 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd88e60c640 / io_context_pool 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd99f5ea640 / io_context_pool 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd99fdeb640 / msgr-worker-2 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd9a05ec640 / msgr-worker-1 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd9a0ded640 / msgr-worker-0 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr: 7fd9a2ae69c0 / radosgw-admin 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:03:50.965609Z_6fc1e3be-3b3a-4844-b779-7073f4d2e2af/log 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:03:51.106 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T18:03:51.107 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:51.107 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:51.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.249+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.253+0000 7f97f9ce19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.253+0000 7f97f9ce19c0 20 realm 2024-09-12T18:03:51.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.253+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.253+0000 7f97f9ce19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.253+0000 7f97f9ce19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:51.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.253+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.253+0000 7f97f9ce19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.253+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.253+0000 7f97f9ce19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:51.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.253+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.257+0000 7f97f9ce19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:51.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.257+0000 7f97f9ce19c0 20 searching for the correct realm 2024-09-12T18:03:51.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.257+0000 7f97f77e7640 0 -- 172.21.15.97:0/4248122179 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f97e8017070 msgr2=0x7f97e8078850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:51.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.469+0000 7f97f77e7640 0 -- 172.21.15.97:0/4248122179 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f97f0030910 msgr2=0x7f97f0039400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:51.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.689+0000 7f97f9ce19c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:51.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.689+0000 7f97f9ce19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:51.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.689+0000 7f97f9ce19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:51.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.689+0000 7f97f9ce19c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:51.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.689+0000 7f97f9ce19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:51.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.689+0000 7f97f9ce19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:51.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.689+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.689+0000 7f97f9ce19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.689+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.689+0000 7f97f9ce19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:51.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.689+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 20 zone default found 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 4 Realm: () 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:51.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:51.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:51.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 20 zonegroup default 2024-09-12T18:03:51.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 20 started sync module instance, tier type = 2024-09-12T18:03:51.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.693+0000 7f97f9ce19c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:51.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.725+0000 7f97f9ce19c0 20 add_watcher() i=0 2024-09-12T18:03:51.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.725+0000 7f97f9ce19c0 20 add_watcher() i=1 2024-09-12T18:03:51.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.725+0000 7f97f9ce19c0 20 add_watcher() i=2 2024-09-12T18:03:51.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.725+0000 7f97f9ce19c0 20 add_watcher() i=3 2024-09-12T18:03:51.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.725+0000 7f97f9ce19c0 20 add_watcher() i=4 2024-09-12T18:03:51.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.725+0000 7f97f9ce19c0 20 add_watcher() i=5 2024-09-12T18:03:51.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.725+0000 7f97f9ce19c0 20 add_watcher() i=6 2024-09-12T18:03:51.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.729+0000 7f97f9ce19c0 20 add_watcher() i=7 2024-09-12T18:03:51.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.729+0000 7f97f9ce19c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:51.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.733+0000 7f96adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:51.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.733+0000 7f97f9ce19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:51.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.733+0000 7f97f9ce19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:51.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.733+0000 7f97f9ce19c0 5 note: GC not initialized 2024-09-12T18:03:51.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.733+0000 7f96acfe1640 20 reqs_thread_entry: start 2024-09-12T18:03:51.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.733+0000 7f97f9ce19c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:51.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.733+0000 7f97f9ce19c0 20 Filter name: none 2024-09-12T18:03:51.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.733+0000 7f96267fc640 20 reqs_thread_entry: start 2024-09-12T18:03:51.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.733+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.737+0000 7f97f9ce19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:51.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.737+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.737+0000 7f97f9ce19c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:51.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.737+0000 7f97f9ce19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:51.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.737+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.737+0000 7f97f9ce19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:51.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.737+0000 7f97f9ce19c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.737+0000 7f97f9ce19c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:51.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.737+0000 7f97f9ce19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:51.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.741+0000 7f96adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:51.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.749+0000 7f97f9ce19c0 20 remove_watcher() i=0 2024-09-12T18:03:51.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.749+0000 7f97f9ce19c0 2 removed watcher, disabling cache 2024-09-12T18:03:51.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.749+0000 7f97f9ce19c0 20 remove_watcher() i=1 2024-09-12T18:03:51.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.753+0000 7f97f9ce19c0 20 remove_watcher() i=2 2024-09-12T18:03:51.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.757+0000 7f97f9ce19c0 20 remove_watcher() i=3 2024-09-12T18:03:51.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.757+0000 7f97f9ce19c0 20 remove_watcher() i=4 2024-09-12T18:03:51.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.761+0000 7f97f9ce19c0 20 remove_watcher() i=5 2024-09-12T18:03:51.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.765+0000 7f97f9ce19c0 20 remove_watcher() i=6 2024-09-12T18:03:51.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.765+0000 7f97f9ce19c0 20 remove_watcher() i=7 2024-09-12T18:03:51.782 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.783 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:03:51.783 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-trim-reshard-log-entries id: 98539659-fdaf-41ce-847d-239ff89323af.4641.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:03:51.783 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:03:51.784 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:51.784 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:51.824 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:51.824 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:03:51.891 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:03:51.927 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:51.927 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:51.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.969+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.973+0000 7f099274b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.973+0000 7f099274b9c0 20 realm 2024-09-12T18:03:51.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.973+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.973+0000 7f099274b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.973+0000 7f099274b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:51.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.973+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.973+0000 7f099274b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:51.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.973+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.973+0000 7f099274b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:51.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.973+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:51.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.977+0000 7f099274b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:51.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.977+0000 7f099274b9c0 20 searching for the correct realm 2024-09-12T18:03:51.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.981+0000 7f098fa50640 0 -- 172.21.15.97:0/1256828369 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f098400e070 msgr2=0x7f098401b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:51.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.989+0000 7f0990a52640 0 -- 172.21.15.97:0/1256828369 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55cf5ba8dc10 msgr2=0x55cf5ba90060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:52.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:03:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:03:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:52.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 zone default found 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 4 Realm: () 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 zonegroup default 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:51.997+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:52.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.001+0000 7f099274b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:52.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.001+0000 7f099274b9c0 20 started sync module instance, tier type = 2024-09-12T18:03:52.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.001+0000 7f099274b9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:03:52.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.021+0000 7f099274b9c0 20 add_watcher() i=0 2024-09-12T18:03:52.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.021+0000 7f099274b9c0 20 add_watcher() i=1 2024-09-12T18:03:52.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.021+0000 7f099274b9c0 20 add_watcher() i=2 2024-09-12T18:03:52.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.021+0000 7f099274b9c0 20 add_watcher() i=3 2024-09-12T18:03:52.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.021+0000 7f099274b9c0 20 add_watcher() i=4 2024-09-12T18:03:52.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.021+0000 7f099274b9c0 20 add_watcher() i=5 2024-09-12T18:03:52.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.021+0000 7f099274b9c0 20 add_watcher() i=6 2024-09-12T18:03:52.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.025+0000 7f099274b9c0 20 add_watcher() i=7 2024-09-12T18:03:52.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.025+0000 7f099274b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:52.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f0846fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:52.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:52.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:52.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 5 note: GC not initialized 2024-09-12T18:03:52.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f0845fdb640 20 reqs_thread_entry: start 2024-09-12T18:03:52.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:52.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 20 Filter name: none 2024-09-12T18:03:52.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f07b77fe640 20 reqs_thread_entry: start 2024-09-12T18:03:52.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:03:52.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:52.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:03:52.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:03:52.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:03:52.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 : miss 2024-09-12T18:03:52.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:52.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:03:52.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:03:52.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:03:52.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:52.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:03:52.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.029+0000 7f099274b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 2024-09-12T18:03:52.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.033+0000 7f099274b9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to be held by another RGW process; skipping for now 2024-09-12T18:03:52.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.033+0000 7f0846fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:52.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.037+0000 7f099274b9c0 20 remove_watcher() i=0 2024-09-12T18:03:52.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.037+0000 7f099274b9c0 2 removed watcher, disabling cache 2024-09-12T18:03:52.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.041+0000 7f099274b9c0 20 remove_watcher() i=1 2024-09-12T18:03:52.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.041+0000 7f099274b9c0 20 remove_watcher() i=2 2024-09-12T18:03:52.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.045+0000 7f099274b9c0 20 remove_watcher() i=3 2024-09-12T18:03:52.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.049+0000 7f099274b9c0 20 remove_watcher() i=4 2024-09-12T18:03:52.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.049+0000 7f099274b9c0 20 remove_watcher() i=5 2024-09-12T18:03:52.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.053+0000 7f099274b9c0 20 remove_watcher() i=6 2024-09-12T18:03:52.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:03:52.057+0000 7f099274b9c0 20 remove_watcher() i=7 2024-09-12T18:03:52.073 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:04:22.101 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:04:22.138 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:22.138 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:22.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.185+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.185+0000 7fa98a40c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.185+0000 7fa98a40c9c0 20 realm 2024-09-12T18:04:22.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.185+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.185+0000 7fa98a40c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.185+0000 7fa98a40c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:22.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.185+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.185+0000 7fa98a40c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.185+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.189+0000 7fa98a40c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:22.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.189+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.189+0000 7fa98a40c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:22.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.189+0000 7fa98a40c9c0 20 searching for the correct realm 2024-09-12T18:04:22.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.193+0000 7fa987f12640 0 -- 172.21.15.97:0/3886263500 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fa978068930 msgr2=0x7fa9780a0040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:04:22.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.405+0000 7fa987f12640 0 -- 172.21.15.97:0/3886263500 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fa9800b8070 msgr2=0x7fa9800da430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:04:22.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:22.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:22.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:22.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:22.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:22.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:22.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:22.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:22.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 zone default found 2024-09-12T18:04:22.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 4 Realm: () 2024-09-12T18:04:22.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:22.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:22.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:22.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 zonegroup default 2024-09-12T18:04:22.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.625+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.629+0000 7fa98a40c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.629+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.629+0000 7fa98a40c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.629+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.629+0000 7fa98a40c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.629+0000 7fa98a40c9c0 20 started sync module instance, tier type = 2024-09-12T18:04:22.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.629+0000 7fa98a40c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:22.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.657+0000 7fa98a40c9c0 20 add_watcher() i=0 2024-09-12T18:04:22.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.657+0000 7fa98a40c9c0 20 add_watcher() i=1 2024-09-12T18:04:22.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.657+0000 7fa98a40c9c0 20 add_watcher() i=2 2024-09-12T18:04:22.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.657+0000 7fa98a40c9c0 20 add_watcher() i=3 2024-09-12T18:04:22.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.657+0000 7fa98a40c9c0 20 add_watcher() i=4 2024-09-12T18:04:22.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.657+0000 7fa98a40c9c0 20 add_watcher() i=5 2024-09-12T18:04:22.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.657+0000 7fa98a40c9c0 20 add_watcher() i=6 2024-09-12T18:04:22.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.657+0000 7fa98a40c9c0 20 add_watcher() i=7 2024-09-12T18:04:22.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.657+0000 7fa98a40c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:22.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.661+0000 7fa83dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:22.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.661+0000 7fa98a40c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:22.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.661+0000 7fa98a40c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:22.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.661+0000 7fa98a40c9c0 5 note: GC not initialized 2024-09-12T18:04:22.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa83cfe1640 20 reqs_thread_entry: start 2024-09-12T18:04:22.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:22.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 20 Filter name: none 2024-09-12T18:04:22.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa7b67fc640 20 reqs_thread_entry: start 2024-09-12T18:04:22.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:04:22.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:04:22.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:04:22.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:04:22.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 : miss 2024-09-12T18:04:22.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:04:22.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:04:22.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:04:22.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:22.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:22.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.665+0000 7fa98a40c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 2024-09-12T18:04:22.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.669+0000 7fa98a40c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:04:22.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.685+0000 7fa98a40c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:04:22.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.685+0000 7fa98a40c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:04:22.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.685+0000 7fa98a40c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:22.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.685+0000 7fa98a40c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27, ofs0, ns] 2024-09-12T18:04:22.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.685+0000 7fa8667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431615 cookie 94396799478736 notifier 6536 bl.length()=939 2024-09-12T18:04:22.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.685+0000 7fa8667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:04:22.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.685+0000 7fa8667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:04:22.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.685+0000 7fa8667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:22.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.689+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_sources= new_sources= 2024-09-12T18:04:22.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.689+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential sources added=[] removed=[] 2024-09-12T18:04:22.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.689+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_dests= new_dests= 2024-09-12T18:04:22.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.689+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential dests added=[] removed=[] 2024-09-12T18:04:22.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.0 2024-09-12T18:04:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.0 2024-09-12T18:04:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.1 2024-09-12T18:04:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.1 2024-09-12T18:04:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.2 2024-09-12T18:04:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.2 2024-09-12T18:04:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.3 2024-09-12T18:04:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.3 2024-09-12T18:04:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.4 2024-09-12T18:04:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.4 2024-09-12T18:04:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.5 2024-09-12T18:04:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.5 2024-09-12T18:04:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.6 2024-09-12T18:04:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.6 2024-09-12T18:04:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.7 2024-09-12T18:04:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.7 2024-09-12T18:04:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.8 2024-09-12T18:04:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.8 2024-09-12T18:04:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.9 2024-09-12T18:04:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.9 2024-09-12T18:04:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.10 2024-09-12T18:04:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.10 2024-09-12T18:04:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.11 2024-09-12T18:04:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2.11 2024-09-12T18:04:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.697+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.0 2024-09-12T18:04:22.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.701+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.1 2024-09-12T18:04:22.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.701+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2 2024-09-12T18:04:22.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.701+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.3 2024-09-12T18:04:22.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.701+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.4 2024-09-12T18:04:22.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.705+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.5 2024-09-12T18:04:22.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.705+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.6 2024-09-12T18:04:22.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.705+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.7 2024-09-12T18:04:22.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.709+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.8 2024-09-12T18:04:22.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.709+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.9 2024-09-12T18:04:22.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.709+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.10 2024-09-12T18:04:22.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.713+0000 7fa98a40c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:22.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.713+0000 7fa98a40c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 2024-09-12T18:04:22.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.717+0000 7fa98a40c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:04:22.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.717+0000 7fa98a40c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:04:22.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.717+0000 7fa98a40c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:22.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.717+0000 7fa98a40c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27, ofs0, ns] 2024-09-12T18:04:22.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.717+0000 7fa8667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431616 cookie 94396799478736 notifier 6536 bl.length()=939 2024-09-12T18:04:22.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.717+0000 7fa8667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:04:22.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.717+0000 7fa8667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:04:22.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.717+0000 7fa8667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:22.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.721+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_sources= new_sources= 2024-09-12T18:04:22.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.721+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential sources added=[] removed=[] 2024-09-12T18:04:22.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.721+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_dests= new_dests= 2024-09-12T18:04:22.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.721+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential dests added=[] removed=[] 2024-09-12T18:04:22.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.725+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.0 2024-09-12T18:04:22.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.725+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.1 2024-09-12T18:04:22.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.729+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.2 2024-09-12T18:04:22.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.729+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.3 2024-09-12T18:04:22.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.729+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.4 2024-09-12T18:04:22.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.729+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.5 2024-09-12T18:04:22.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.733+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.6 2024-09-12T18:04:22.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.733+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.7 2024-09-12T18:04:22.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.733+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.8 2024-09-12T18:04:22.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.733+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.9 2024-09-12T18:04:22.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.733+0000 7fa98a40c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.27.10 2024-09-12T18:04:22.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.733+0000 7fa98a40c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:22.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.733+0000 7fa98a40c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 2024-09-12T18:04:22.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.737+0000 7fa98a40c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:04:22.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.737+0000 7fa98a40c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:04:22.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.737+0000 7fa98a40c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:22.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.737+0000 7fa98a40c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27, ofs0, ns] 2024-09-12T18:04:22.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.737+0000 7fa866ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94396799478736 notifier 6536 bl.length()=907 2024-09-12T18:04:22.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.737+0000 7fa866ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 info.flags=0x17 2024-09-12T18:04:22.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.737+0000 7fa866ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:98539659-fdaf-41ce-847d-239ff89323af.4641.27 to cache LRU end 2024-09-12T18:04:22.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.737+0000 7fa866ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:22.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.741+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_sources= new_sources= 2024-09-12T18:04:22.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.741+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential sources added=[] removed=[] 2024-09-12T18:04:22.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.741+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): orig_dests= new_dests= 2024-09-12T18:04:22.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.741+0000 7fa98a40c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[98539659-fdaf-41ce-847d-239ff89323af.4641.27]): potential dests added=[] removed=[] 2024-09-12T18:04:22.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.745+0000 7fa98a40c9c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T18:04:22.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.749+0000 7fa83dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:22.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.753+0000 7fa98a40c9c0 20 remove_watcher() i=0 2024-09-12T18:04:22.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.753+0000 7fa98a40c9c0 2 removed watcher, disabling cache 2024-09-12T18:04:22.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.757+0000 7fa98a40c9c0 20 remove_watcher() i=1 2024-09-12T18:04:22.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.761+0000 7fa98a40c9c0 20 remove_watcher() i=2 2024-09-12T18:04:22.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.761+0000 7fa98a40c9c0 20 remove_watcher() i=3 2024-09-12T18:04:22.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.765+0000 7fa98a40c9c0 20 remove_watcher() i=4 2024-09-12T18:04:22.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.765+0000 7fa98a40c9c0 20 remove_watcher() i=5 2024-09-12T18:04:22.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.769+0000 7fa98a40c9c0 20 remove_watcher() i=6 2024-09-12T18:04:22.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.773+0000 7fa98a40c9c0 20 remove_watcher() i=7 2024-09-12T18:04:22.791 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T18:04:22.822 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:22.822 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:22.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.865+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.865+0000 7fa4df99c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.865+0000 7fa4df99c9c0 20 realm 2024-09-12T18:04:22.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.865+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.865+0000 7fa4df99c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.865+0000 7fa4df99c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:22.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.865+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.865+0000 7fa4df99c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.865+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.869+0000 7fa4df99c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:22.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.869+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.869+0000 7fa4df99c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:22.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.869+0000 7fa4df99c9c0 20 searching for the correct realm 2024-09-12T18:04:22.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.877+0000 7fa4dd4a2640 0 -- 172.21.15.97:0/4143513773 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x556a75ca0e20 msgr2=0x7fa4d00f75a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:22.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.881+0000 7fa4dd4a2640 0 -- 172.21.15.97:0/4143513773 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x556a75efe2d0 msgr2=0x556a75f00700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:22.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:22.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:22.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:22.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:22.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:22.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:22.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:22.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:22.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 zone default found 2024-09-12T18:04:22.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 4 Realm: () 2024-09-12T18:04:22.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:22.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:22.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:22.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 zonegroup default 2024-09-12T18:04:22.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.889+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.893+0000 7fa4df99c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.893+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.893+0000 7fa4df99c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:22.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.893+0000 7fa4df99c9c0 20 started sync module instance, tier type = 2024-09-12T18:04:22.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.893+0000 7fa4df99c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:22.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.909+0000 7fa4df99c9c0 20 add_watcher() i=0 2024-09-12T18:04:22.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.909+0000 7fa4df99c9c0 20 add_watcher() i=1 2024-09-12T18:04:22.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.909+0000 7fa4df99c9c0 20 add_watcher() i=2 2024-09-12T18:04:22.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.909+0000 7fa4df99c9c0 20 add_watcher() i=3 2024-09-12T18:04:22.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.909+0000 7fa4df99c9c0 20 add_watcher() i=4 2024-09-12T18:04:22.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.909+0000 7fa4df99c9c0 20 add_watcher() i=5 2024-09-12T18:04:22.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.909+0000 7fa4df99c9c0 20 add_watcher() i=6 2024-09-12T18:04:22.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.913+0000 7fa4df99c9c0 20 add_watcher() i=7 2024-09-12T18:04:22.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.913+0000 7fa4df99c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:22.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.917+0000 7fa3937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:22.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.917+0000 7fa4df99c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:22.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.917+0000 7fa4df99c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:22.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.917+0000 7fa4df99c9c0 5 note: GC not initialized 2024-09-12T18:04:22.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.917+0000 7fa3927e4640 20 reqs_thread_entry: start 2024-09-12T18:04:22.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.917+0000 7fa4df99c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:22.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.917+0000 7fa4df99c9c0 20 Filter name: none 2024-09-12T18:04:22.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.917+0000 7fa303fff640 20 reqs_thread_entry: start 2024-09-12T18:04:22.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.917+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.917+0000 7fa4df99c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:04:22.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.917+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.921+0000 7fa4df99c9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:04:22.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.921+0000 7fa4df99c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:22.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.921+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.921+0000 7fa4df99c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:04:22.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.921+0000 7fa4df99c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:22.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.921+0000 7fa4df99c9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:04:22.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.921+0000 7fa4df99c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:22.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.925+0000 7fa3937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:22.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.929+0000 7fa4df99c9c0 20 remove_watcher() i=0 2024-09-12T18:04:22.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.929+0000 7fa4df99c9c0 2 removed watcher, disabling cache 2024-09-12T18:04:22.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.929+0000 7fa4df99c9c0 20 remove_watcher() i=1 2024-09-12T18:04:22.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.933+0000 7fa4df99c9c0 20 remove_watcher() i=2 2024-09-12T18:04:22.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.933+0000 7fa4df99c9c0 20 remove_watcher() i=3 2024-09-12T18:04:22.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.937+0000 7fa4df99c9c0 20 remove_watcher() i=4 2024-09-12T18:04:22.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.937+0000 7fa4df99c9c0 20 remove_watcher() i=5 2024-09-12T18:04:22.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.941+0000 7fa4df99c9c0 20 remove_watcher() i=6 2024-09-12T18:04:22.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:22.941+0000 7fa4df99c9c0 20 remove_watcher() i=7 2024-09-12T18:04:22.958 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:22.958 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:04:22.958 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-trim-reshard-log-entries id: 98539659-fdaf-41ce-847d-239ff89323af.4641.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:04:22.958 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:22.960 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:22.960 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:22.983 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:22.983 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:23.490 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:23.490 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:23.886 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T18:04:23.886 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:23.889 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:23.890 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:24.024 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:24.109 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:24.109 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:24.209 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:24.210 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:24.306 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:24.306 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:24.407 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:24.407 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:24.504 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:24.504 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:24.603 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:24.604 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:24.695 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:24.695 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:24.790 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:24.791 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:24.882 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:24.882 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:24.983 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:24.983 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:25.082 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:25.082 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:25.174 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:25.174 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:25.270 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:25.270 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:25.364 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:25.364 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:25.463 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:25.464 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:25.551 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:25.551 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:25.648 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:25.649 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:25.746 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:25.746 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:25.845 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:25.845 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:25.941 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:25.941 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:26.029 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T18:04:26.062 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:26.062 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:26.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.105+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.109+0000 7ff485c829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.109+0000 7ff485c829c0 20 realm 2024-09-12T18:04:26.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.109+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.109+0000 7ff485c829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.109+0000 7ff485c829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:26.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.109+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.109+0000 7ff485c829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.109+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.109+0000 7ff485c829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:26.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.109+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.113+0000 7ff485c829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:26.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.113+0000 7ff485c829c0 20 searching for the correct realm 2024-09-12T18:04:26.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.117+0000 7ff483788640 0 -- 172.21.15.97:0/3920070016 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7ff4740dcbb0 msgr2=0x7ff4740e8920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:26.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.125+0000 7ff483788640 0 -- 172.21.15.97:0/3920070016 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55d1d647fad0 msgr2=0x55d1d6481ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:26.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.129+0000 7ff485c829c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:26.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.129+0000 7ff485c829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:26.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.129+0000 7ff485c829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:26.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.129+0000 7ff485c829c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:26.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.129+0000 7ff485c829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:26.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.129+0000 7ff485c829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:26.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.129+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.129+0000 7ff485c829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.129+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.129+0000 7ff485c829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.129+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 20 zone default found 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 4 Realm: () 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 20 zonegroup default 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 20 started sync module instance, tier type = 2024-09-12T18:04:26.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.133+0000 7ff485c829c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:26.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.149+0000 7ff485c829c0 20 add_watcher() i=0 2024-09-12T18:04:26.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.149+0000 7ff485c829c0 20 add_watcher() i=1 2024-09-12T18:04:26.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.149+0000 7ff485c829c0 20 add_watcher() i=2 2024-09-12T18:04:26.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.149+0000 7ff485c829c0 20 add_watcher() i=3 2024-09-12T18:04:26.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.149+0000 7ff485c829c0 20 add_watcher() i=4 2024-09-12T18:04:26.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.149+0000 7ff485c829c0 20 add_watcher() i=5 2024-09-12T18:04:26.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.149+0000 7ff485c829c0 20 add_watcher() i=6 2024-09-12T18:04:26.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.153+0000 7ff485c829c0 20 add_watcher() i=7 2024-09-12T18:04:26.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.153+0000 7ff485c829c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:26.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.157+0000 7ff339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:26.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.157+0000 7ff485c829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:26.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.157+0000 7ff485c829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:26.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.157+0000 7ff485c829c0 5 note: GC not initialized 2024-09-12T18:04:26.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.157+0000 7ff338fe1640 20 reqs_thread_entry: start 2024-09-12T18:04:26.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.157+0000 7ff485c829c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:26.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.157+0000 7ff485c829c0 20 Filter name: none 2024-09-12T18:04:26.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.157+0000 7ff2b27fc640 20 reqs_thread_entry: start 2024-09-12T18:04:26.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.157+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.157+0000 7ff485c829c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:26.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.157+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.161+0000 7ff485c829c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:26.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.161+0000 7ff485c829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:26.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.161+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.161+0000 7ff485c829c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:26.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.161+0000 7ff485c829c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.161+0000 7ff485c829c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:26.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.161+0000 7ff485c829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:26.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.161+0000 7ff339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:26.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.165+0000 7ff485c829c0 20 remove_watcher() i=0 2024-09-12T18:04:26.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.165+0000 7ff485c829c0 2 removed watcher, disabling cache 2024-09-12T18:04:26.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.169+0000 7ff485c829c0 20 remove_watcher() i=1 2024-09-12T18:04:26.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.169+0000 7ff485c829c0 20 remove_watcher() i=2 2024-09-12T18:04:26.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.173+0000 7ff485c829c0 20 remove_watcher() i=3 2024-09-12T18:04:26.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.173+0000 7ff485c829c0 20 remove_watcher() i=4 2024-09-12T18:04:26.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.177+0000 7ff485c829c0 20 remove_watcher() i=5 2024-09-12T18:04:26.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.181+0000 7ff485c829c0 20 remove_watcher() i=6 2024-09-12T18:04:26.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.181+0000 7ff485c829c0 20 remove_watcher() i=7 2024-09-12T18:04:26.200 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:26.200 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:04:26.201 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-block-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:04:26.201 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:26.201 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T18:04:26.234 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:26.234 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:26.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.273+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.277+0000 7f2ec858b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.277+0000 7f2ec858b9c0 20 realm 2024-09-12T18:04:26.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.277+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.277+0000 7f2ec858b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.277+0000 7f2ec858b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:26.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.277+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.277+0000 7f2ec858b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.277+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.281+0000 7f2ec858b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:26.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.281+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.281+0000 7f2ec858b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:26.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.281+0000 7f2ec858b9c0 20 searching for the correct realm 2024-09-12T18:04:26.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.285+0000 7f2ec6892640 0 -- 172.21.15.97:0/125912598 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f2ebc013030 msgr2=0x7f2ebc038460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:26.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.293+0000 7f2ec6892640 0 -- 172.21.15.97:0/125912598 >> [v2:172.21.15.154:6808/3304684764,v1:172.21.15.154:6809/3304684764] conn(0x7f2eb80694c0 msgr2=0x7f2eb8071400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:26.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.493+0000 7f2ec858b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:26.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.493+0000 7f2ec858b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:26.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.493+0000 7f2ec858b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:26.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.493+0000 7f2ec858b9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:26.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.493+0000 7f2ec858b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:26.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.493+0000 7f2ec858b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:26.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.493+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.493+0000 7f2ec858b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.493+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.493+0000 7f2ec858b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:26.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:26.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 zone default found 2024-09-12T18:04:26.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 4 Realm: () 2024-09-12T18:04:26.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:26.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:26.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:26.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 zonegroup default 2024-09-12T18:04:26.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 started sync module instance, tier type = 2024-09-12T18:04:26.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.497+0000 7f2ec858b9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:26.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.521+0000 7f2ec858b9c0 20 add_watcher() i=0 2024-09-12T18:04:26.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.521+0000 7f2ec858b9c0 20 add_watcher() i=1 2024-09-12T18:04:26.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.521+0000 7f2ec858b9c0 20 add_watcher() i=2 2024-09-12T18:04:26.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.521+0000 7f2ec858b9c0 20 add_watcher() i=3 2024-09-12T18:04:26.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.521+0000 7f2ec858b9c0 20 add_watcher() i=4 2024-09-12T18:04:26.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.521+0000 7f2ec858b9c0 20 add_watcher() i=5 2024-09-12T18:04:26.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.521+0000 7f2ec858b9c0 20 add_watcher() i=6 2024-09-12T18:04:26.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.525+0000 7f2ec858b9c0 20 add_watcher() i=7 2024-09-12T18:04:26.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.525+0000 7f2ec858b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:26.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.529+0000 7f2d7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:26.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.529+0000 7f2ec858b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:26.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.529+0000 7f2ec858b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:26.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.529+0000 7f2ec858b9c0 5 note: GC not initialized 2024-09-12T18:04:26.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.529+0000 7f2cf77fe640 20 reqs_thread_entry: start 2024-09-12T18:04:26.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.529+0000 7f2ec858b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:26.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.529+0000 7f2ec858b9c0 20 Filter name: none 2024-09-12T18:04:26.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2cf57fa640 20 reqs_thread_entry: start 2024-09-12T18:04:26.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T18:04:26.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:26.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T18:04:26.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T18:04:26.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 : miss 2024-09-12T18:04:26.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:26.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:26.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:26.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:26.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:26.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.533+0000 7f2ec858b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 2024-09-12T18:04:26.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.545+0000 7f2ec858b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:26.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.545+0000 7f2ec858b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:26.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.545+0000 7f2ec858b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:26.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.545+0000 7f2ec858b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28, ofs0, ns] 2024-09-12T18:04:26.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.545+0000 7f2da9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94337257345264 notifier 6990 bl.length()=915 2024-09-12T18:04:26.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.545+0000 7f2da9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:26.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.545+0000 7f2da9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:26.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.545+0000 7f2da9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:26.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.549+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_sources= new_sources= 2024-09-12T18:04:26.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.549+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential sources added=[] removed=[] 2024-09-12T18:04:26.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.549+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_dests= new_dests= 2024-09-12T18:04:26.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.549+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential dests added=[] removed=[] 2024-09-12T18:04:26.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.0 2024-09-12T18:04:26.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.0 2024-09-12T18:04:26.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.1 2024-09-12T18:04:26.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.1 2024-09-12T18:04:26.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.2 2024-09-12T18:04:26.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.2 2024-09-12T18:04:26.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.3 2024-09-12T18:04:26.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.3 2024-09-12T18:04:26.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.4 2024-09-12T18:04:26.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.4 2024-09-12T18:04:26.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.5 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.5 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.6 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.6 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.7 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.7 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.8 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.8 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.9 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.9 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.10 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.10 2024-09-12T18:04:26.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.11 2024-09-12T18:04:26.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.11 2024-09-12T18:04:26.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.557+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.0 2024-09-12T18:04:26.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.561+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1 2024-09-12T18:04:26.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.561+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.2 2024-09-12T18:04:26.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.561+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.3 2024-09-12T18:04:26.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.561+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.4 2024-09-12T18:04:26.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.565+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.5 2024-09-12T18:04:26.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.565+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.6 2024-09-12T18:04:26.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.565+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.7 2024-09-12T18:04:26.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.565+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.8 2024-09-12T18:04:26.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.565+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.9 2024-09-12T18:04:26.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.569+0000 7f2ec858b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.10 2024-09-12T18:04:26.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.573+0000 7f2ec858b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:26.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.573+0000 7f2ec858b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 2024-09-12T18:04:26.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.577+0000 7f2ec858b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:26.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.577+0000 7f2ec858b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:26.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.577+0000 7f2ec858b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:26.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.577+0000 7f2ec858b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28, ofs0, ns] 2024-09-12T18:04:26.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.577+0000 7f2da9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 94337257345264 notifier 6990 bl.length()=915 2024-09-12T18:04:26.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.577+0000 7f2da9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:26.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.577+0000 7f2da9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:26.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.577+0000 7f2da9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:26.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.581+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_sources= new_sources= 2024-09-12T18:04:26.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.581+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential sources added=[] removed=[] 2024-09-12T18:04:26.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.581+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_dests= new_dests= 2024-09-12T18:04:26.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.581+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential dests added=[] removed=[] 2024-09-12T18:04:26.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.581+0000 7f2ec858b9c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T18:04:26.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.581+0000 7f2ec858b9c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T18:04:26.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.593+0000 7f2ec858b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:26.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.593+0000 7f2ec858b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 2024-09-12T18:04:26.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.593+0000 7f2ec858b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:26.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.593+0000 7f2ec858b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:26.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.593+0000 7f2ec858b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:26.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.593+0000 7f2ec858b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28, ofs0, ns] 2024-09-12T18:04:26.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.593+0000 7f2da9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94337257345264 notifier 6990 bl.length()=883 2024-09-12T18:04:26.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.593+0000 7f2da9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:26.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.593+0000 7f2da9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:26.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.593+0000 7f2da9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:26.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.597+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_sources= new_sources= 2024-09-12T18:04:26.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.597+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential sources added=[] removed=[] 2024-09-12T18:04:26.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.597+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_dests= new_dests= 2024-09-12T18:04:26.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.597+0000 7f2ec858b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential dests added=[] removed=[] 2024-09-12T18:04:26.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.605+0000 7f2ec858b9c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T18:04:26.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.609+0000 7f2d7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:26.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.613+0000 7f2ec858b9c0 20 remove_watcher() i=0 2024-09-12T18:04:26.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.613+0000 7f2ec858b9c0 2 removed watcher, disabling cache 2024-09-12T18:04:26.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.617+0000 7f2ec858b9c0 20 remove_watcher() i=1 2024-09-12T18:04:26.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.617+0000 7f2ec858b9c0 20 remove_watcher() i=2 2024-09-12T18:04:26.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.621+0000 7f2ec858b9c0 20 remove_watcher() i=3 2024-09-12T18:04:26.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.621+0000 7f2ec858b9c0 20 remove_watcher() i=4 2024-09-12T18:04:26.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.625+0000 7f2ec858b9c0 20 remove_watcher() i=5 2024-09-12T18:04:26.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.625+0000 7f2ec858b9c0 20 remove_watcher() i=6 2024-09-12T18:04:26.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.629+0000 7f2ec858b9c0 20 remove_watcher() i=7 2024-09-12T18:04:26.650 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T18:04:26.677 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:26.677 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:26.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.721+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.725+0000 7f696112c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.725+0000 7f696112c9c0 20 realm 2024-09-12T18:04:26.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.725+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.725+0000 7f696112c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.725+0000 7f696112c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:26.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.725+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.725+0000 7f696112c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:26.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.725+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.725+0000 7f696112c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:26.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.725+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:26.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.729+0000 7f696112c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:26.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.729+0000 7f696112c9c0 20 searching for the correct realm 2024-09-12T18:04:26.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.729+0000 7f695ec32640 0 -- 172.21.15.97:0/3564090854 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f69500dab90 msgr2=0x7f695012bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:26.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:26.941+0000 7f695ec32640 0 -- 172.21.15.97:0/3564090854 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f6948003b10 msgr2=0x7f695805a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:04:27.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:27.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:27.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:27.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:27.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:27.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:27.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:27.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:27.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 zone default found 2024-09-12T18:04:27.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 4 Realm: () 2024-09-12T18:04:27.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:27.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:27.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:27.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 zonegroup default 2024-09-12T18:04:27.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.161+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.165+0000 7f696112c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.165+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.165+0000 7f696112c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.165+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.165+0000 7f696112c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.165+0000 7f696112c9c0 20 started sync module instance, tier type = 2024-09-12T18:04:27.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.165+0000 7f696112c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:27.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.185+0000 7f696112c9c0 20 add_watcher() i=0 2024-09-12T18:04:27.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.185+0000 7f696112c9c0 20 add_watcher() i=1 2024-09-12T18:04:27.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.185+0000 7f696112c9c0 20 add_watcher() i=2 2024-09-12T18:04:27.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.185+0000 7f696112c9c0 20 add_watcher() i=3 2024-09-12T18:04:27.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.185+0000 7f696112c9c0 20 add_watcher() i=4 2024-09-12T18:04:27.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.185+0000 7f696112c9c0 20 add_watcher() i=5 2024-09-12T18:04:27.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.189+0000 7f696112c9c0 20 add_watcher() i=6 2024-09-12T18:04:27.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.189+0000 7f696112c9c0 20 add_watcher() i=7 2024-09-12T18:04:27.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.189+0000 7f696112c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:27.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.193+0000 7f68157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:27.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.193+0000 7f696112c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:27.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.193+0000 7f696112c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:27.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.193+0000 7f696112c9c0 5 note: GC not initialized 2024-09-12T18:04:27.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f678ffff640 20 reqs_thread_entry: start 2024-09-12T18:04:27.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:27.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 Filter name: none 2024-09-12T18:04:27.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f678dffb640 20 reqs_thread_entry: start 2024-09-12T18:04:27.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:27.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:27.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:27.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:27.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:27.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.197+0000 7f696112c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:27.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.201+0000 7f68157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:27.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.205+0000 7f696112c9c0 20 remove_watcher() i=0 2024-09-12T18:04:27.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.205+0000 7f696112c9c0 2 removed watcher, disabling cache 2024-09-12T18:04:27.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.209+0000 7f696112c9c0 20 remove_watcher() i=1 2024-09-12T18:04:27.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.209+0000 7f696112c9c0 20 remove_watcher() i=2 2024-09-12T18:04:27.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.213+0000 7f696112c9c0 20 remove_watcher() i=3 2024-09-12T18:04:27.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.213+0000 7f696112c9c0 20 remove_watcher() i=4 2024-09-12T18:04:27.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.217+0000 7f696112c9c0 20 remove_watcher() i=5 2024-09-12T18:04:27.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.217+0000 7f696112c9c0 20 remove_watcher() i=6 2024-09-12T18:04:27.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.221+0000 7f696112c9c0 20 remove_watcher() i=7 2024-09-12T18:04:27.238 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:27.238 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:04:27.239 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-block-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:04:27.239 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:27.240 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:27.240 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:27.282 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:27.282 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:27.351 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:04:27.387 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:27.387 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:27.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.429+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.433+0000 7fe7061519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.433+0000 7fe7061519c0 20 realm 2024-09-12T18:04:27.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.433+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.437+0000 7fe7061519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.437+0000 7fe7061519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:27.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.437+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.437+0000 7fe7061519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.437+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.437+0000 7fe7061519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:27.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.437+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.441+0000 7fe7061519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:27.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.441+0000 7fe7061519c0 20 searching for the correct realm 2024-09-12T18:04:27.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.445+0000 7fe703456640 0 -- 172.21.15.97:0/1811696943 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fe6f802e070 msgr2=0x7fe6f8069930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:27.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.449+0000 7fe704458640 0 -- 172.21.15.97:0/1811696943 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55d40d683100 msgr2=0x55d40d685560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:27.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.457+0000 7fe7061519c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:27.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.457+0000 7fe7061519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:27.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.457+0000 7fe7061519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:27.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.457+0000 7fe7061519c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:27.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.457+0000 7fe7061519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:27.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.457+0000 7fe7061519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:27.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.457+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.457+0000 7fe7061519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.457+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.457+0000 7fe7061519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.457+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 20 zone default found 2024-09-12T18:04:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 4 Realm: () 2024-09-12T18:04:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 20 zonegroup default 2024-09-12T18:04:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 20 started sync module instance, tier type = 2024-09-12T18:04:27.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.461+0000 7fe7061519c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:27.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.477+0000 7fe7061519c0 20 add_watcher() i=0 2024-09-12T18:04:27.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.477+0000 7fe7061519c0 20 add_watcher() i=1 2024-09-12T18:04:27.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.477+0000 7fe7061519c0 20 add_watcher() i=2 2024-09-12T18:04:27.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.477+0000 7fe7061519c0 20 add_watcher() i=3 2024-09-12T18:04:27.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.477+0000 7fe7061519c0 20 add_watcher() i=4 2024-09-12T18:04:27.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.477+0000 7fe7061519c0 20 add_watcher() i=5 2024-09-12T18:04:27.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.477+0000 7fe7061519c0 20 add_watcher() i=6 2024-09-12T18:04:27.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.481+0000 7fe7061519c0 20 add_watcher() i=7 2024-09-12T18:04:27.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.481+0000 7fe7061519c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:27.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe5ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:27.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:27.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:27.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 5 note: GC not initialized 2024-09-12T18:04:27.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe5b97e2640 20 reqs_thread_entry: start 2024-09-12T18:04:27.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:27.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 20 Filter name: none 2024-09-12T18:04:27.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe5b27fc640 20 reqs_thread_entry: start 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 : miss 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.485+0000 7fe7061519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 2024-09-12T18:04:27.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.497+0000 7fe7061519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:27.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.497+0000 7fe7061519c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:27.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.497+0000 7fe7061519c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:27.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.497+0000 7fe7061519c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28, ofs0, ns] 2024-09-12T18:04:27.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.497+0000 7fe5e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 94369246426896 notifier 7026 bl.length()=915 2024-09-12T18:04:27.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.497+0000 7fe5e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:27.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.497+0000 7fe5e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:27.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.497+0000 7fe5e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:27.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.501+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_sources= new_sources= 2024-09-12T18:04:27.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.501+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential sources added=[] removed=[] 2024-09-12T18:04:27.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.501+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_dests= new_dests= 2024-09-12T18:04:27.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.501+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential dests added=[] removed=[] 2024-09-12T18:04:27.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.0 2024-09-12T18:04:27.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.0 2024-09-12T18:04:27.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.1 2024-09-12T18:04:27.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.1 2024-09-12T18:04:27.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.2 2024-09-12T18:04:27.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.2 2024-09-12T18:04:27.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.3 2024-09-12T18:04:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.3 2024-09-12T18:04:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.4 2024-09-12T18:04:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.4 2024-09-12T18:04:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.5 2024-09-12T18:04:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.5 2024-09-12T18:04:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.6 2024-09-12T18:04:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.6 2024-09-12T18:04:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.7 2024-09-12T18:04:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.7 2024-09-12T18:04:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.8 2024-09-12T18:04:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.8 2024-09-12T18:04:27.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.9 2024-09-12T18:04:27.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.9 2024-09-12T18:04:27.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.10 2024-09-12T18:04:27.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.10 2024-09-12T18:04:27.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.11 2024-09-12T18:04:27.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1.11 2024-09-12T18:04:27.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.0 2024-09-12T18:04:27.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1 2024-09-12T18:04:27.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.509+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.2 2024-09-12T18:04:27.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.513+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.3 2024-09-12T18:04:27.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.513+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.4 2024-09-12T18:04:27.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.513+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.5 2024-09-12T18:04:27.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.513+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.6 2024-09-12T18:04:27.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.513+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.7 2024-09-12T18:04:27.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.513+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.8 2024-09-12T18:04:27.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.513+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.9 2024-09-12T18:04:27.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.517+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.10 2024-09-12T18:04:27.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.525+0000 7fe7061519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:27.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.525+0000 7fe7061519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 2024-09-12T18:04:27.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.525+0000 7fe7061519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:27.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.525+0000 7fe7061519c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:27.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.525+0000 7fe7061519c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:27.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.525+0000 7fe7061519c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28, ofs0, ns] 2024-09-12T18:04:27.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.525+0000 7fe5e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94369246426896 notifier 7026 bl.length()=915 2024-09-12T18:04:27.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.525+0000 7fe5e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:27.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.525+0000 7fe5e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:27.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.525+0000 7fe5e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:27.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.529+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_sources= new_sources= 2024-09-12T18:04:27.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.529+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential sources added=[] removed=[] 2024-09-12T18:04:27.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.529+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_dests= new_dests= 2024-09-12T18:04:27.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.529+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential dests added=[] removed=[] 2024-09-12T18:04:27.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.533+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.0 2024-09-12T18:04:27.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.533+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.1 2024-09-12T18:04:27.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.533+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.2 2024-09-12T18:04:27.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.533+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.3 2024-09-12T18:04:27.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.533+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.4 2024-09-12T18:04:27.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.537+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.5 2024-09-12T18:04:27.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.537+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.6 2024-09-12T18:04:27.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.537+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.7 2024-09-12T18:04:27.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.537+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.8 2024-09-12T18:04:27.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.537+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.9 2024-09-12T18:04:27.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.537+0000 7fe7061519c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.28.10 2024-09-12T18:04:27.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.537+0000 7fe7061519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:27.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.537+0000 7fe7061519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 2024-09-12T18:04:27.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.541+0000 7fe7061519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:27.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.541+0000 7fe7061519c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:27.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.541+0000 7fe7061519c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:27.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.541+0000 7fe7061519c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28, ofs0, ns] 2024-09-12T18:04:27.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.541+0000 7fe5e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 94369246426896 notifier 7026 bl.length()=883 2024-09-12T18:04:27.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.541+0000 7fe5e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 info.flags=0x17 2024-09-12T18:04:27.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.541+0000 7fe5e27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.28 to cache LRU end 2024-09-12T18:04:27.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.541+0000 7fe5e27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:27.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.545+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_sources= new_sources= 2024-09-12T18:04:27.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.545+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential sources added=[] removed=[] 2024-09-12T18:04:27.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.545+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): orig_dests= new_dests= 2024-09-12T18:04:27.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.545+0000 7fe7061519c0 20 handle_bi_update(): bucket=:error-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.28]): potential dests added=[] removed=[] 2024-09-12T18:04:27.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.549+0000 7fe7061519c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T18:04:27.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.553+0000 7fe5ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:27.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.557+0000 7fe7061519c0 20 remove_watcher() i=0 2024-09-12T18:04:27.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.557+0000 7fe7061519c0 2 removed watcher, disabling cache 2024-09-12T18:04:27.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.557+0000 7fe7061519c0 20 remove_watcher() i=1 2024-09-12T18:04:27.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.561+0000 7fe7061519c0 20 remove_watcher() i=2 2024-09-12T18:04:27.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.561+0000 7fe7061519c0 20 remove_watcher() i=3 2024-09-12T18:04:27.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.565+0000 7fe7061519c0 20 remove_watcher() i=4 2024-09-12T18:04:27.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.565+0000 7fe7061519c0 20 remove_watcher() i=5 2024-09-12T18:04:27.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.569+0000 7fe7061519c0 20 remove_watcher() i=6 2024-09-12T18:04:27.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.573+0000 7fe7061519c0 20 remove_watcher() i=7 2024-09-12T18:04:27.588 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T18:04:27.617 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:27.617 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:27.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.657+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.661+0000 7fe91efa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.661+0000 7fe91efa49c0 20 realm 2024-09-12T18:04:27.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.661+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.661+0000 7fe91efa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.661+0000 7fe91efa49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:27.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.661+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.661+0000 7fe91efa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.661+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.661+0000 7fe91efa49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:27.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.661+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.665+0000 7fe91efa49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:27.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.665+0000 7fe91efa49c0 20 searching for the correct realm 2024-09-12T18:04:27.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.669+0000 7fe91c2a9640 0 -- 172.21.15.97:0/588121104 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fe910008030 msgr2=0x7fe910064c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:27.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.677+0000 7fe91d2ab640 0 -- 172.21.15.97:0/588121104 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x561dcc546f10 msgr2=0x561dcc549390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:04:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:27.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 zone default found 2024-09-12T18:04:27.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 4 Realm: () 2024-09-12T18:04:27.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:27.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:27.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:27.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 zonegroup default 2024-09-12T18:04:27.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.685+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.689+0000 7fe91efa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:27.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.689+0000 7fe91efa49c0 20 started sync module instance, tier type = 2024-09-12T18:04:27.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.689+0000 7fe91efa49c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:27.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.705+0000 7fe91efa49c0 20 add_watcher() i=0 2024-09-12T18:04:27.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.705+0000 7fe91efa49c0 20 add_watcher() i=1 2024-09-12T18:04:27.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.705+0000 7fe91efa49c0 20 add_watcher() i=2 2024-09-12T18:04:27.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.705+0000 7fe91efa49c0 20 add_watcher() i=3 2024-09-12T18:04:27.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.705+0000 7fe91efa49c0 20 add_watcher() i=4 2024-09-12T18:04:27.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.705+0000 7fe91efa49c0 20 add_watcher() i=5 2024-09-12T18:04:27.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.705+0000 7fe91efa49c0 20 add_watcher() i=6 2024-09-12T18:04:27.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.709+0000 7fe91efa49c0 20 add_watcher() i=7 2024-09-12T18:04:27.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.709+0000 7fe91efa49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:27.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe7d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 5 note: GC not initialized 2024-09-12T18:04:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe7d1fe3640 20 reqs_thread_entry: start 2024-09-12T18:04:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 Filter name: none 2024-09-12T18:04:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe7437fe640 20 reqs_thread_entry: start 2024-09-12T18:04:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:27.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:27.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:27.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:27.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:27.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:27.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.713+0000 7fe91efa49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:27.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.717+0000 7fe7d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:27.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.721+0000 7fe91efa49c0 20 remove_watcher() i=0 2024-09-12T18:04:27.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.721+0000 7fe91efa49c0 2 removed watcher, disabling cache 2024-09-12T18:04:27.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.725+0000 7fe91efa49c0 20 remove_watcher() i=1 2024-09-12T18:04:27.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.725+0000 7fe91efa49c0 20 remove_watcher() i=2 2024-09-12T18:04:27.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.725+0000 7fe91efa49c0 20 remove_watcher() i=3 2024-09-12T18:04:27.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.729+0000 7fe91efa49c0 20 remove_watcher() i=4 2024-09-12T18:04:27.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.729+0000 7fe91efa49c0 20 remove_watcher() i=5 2024-09-12T18:04:27.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.733+0000 7fe91efa49c0 20 remove_watcher() i=6 2024-09-12T18:04:27.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:27.737+0000 7fe91efa49c0 20 remove_watcher() i=7 2024-09-12T18:04:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:27.752 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:04:27.752 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-block-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:04:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:27.753 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:27.773 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:27.773 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:28.277 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:28.278 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:28.645 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T18:04:28.645 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:28.648 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:28.648 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:28.789 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:28.789 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:28.877 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:28.878 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:28.979 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:28.980 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:29.080 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:29.080 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:29.178 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:29.178 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:29.268 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:29.269 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:29.367 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:29.368 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:29.460 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:29.461 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:29.553 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:29.553 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:29.649 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:29.649 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:29.743 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:29.744 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:29.841 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:29.841 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:29.938 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:29.938 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:30.035 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:30.035 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:30.133 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:30.133 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:30.226 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:30.226 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:30.326 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:30.327 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:30.427 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:30.427 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:30.520 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:30.520 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:30.614 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:30.615 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:30.709 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:30.709 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:30.797 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T18:04:30.830 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:30.830 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:30.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.873+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.877+0000 7f92060289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.877+0000 7f92060289c0 20 realm 2024-09-12T18:04:30.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.877+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.877+0000 7f92060289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.877+0000 7f92060289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.877+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.877+0000 7f92060289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.877+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.877+0000 7f92060289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:30.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.877+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.877+0000 7f92060289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:30.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.881+0000 7f92060289c0 20 searching for the correct realm 2024-09-12T18:04:30.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.885+0000 7f920432f640 0 -- 172.21.15.97:0/1044930394 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f91f8031060 msgr2=0x7f91f8061060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:30.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.889+0000 7f9203b2e640 0 -- 172.21.15.97:0/1044930394 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f91fc06bb70 msgr2=0x7f91fc090a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:30.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:30.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:30.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:30.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:30.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:30.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:30.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:30.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:30.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 zone default found 2024-09-12T18:04:30.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 4 Realm: () 2024-09-12T18:04:30.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:30.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:30.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:30.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 zonegroup default 2024-09-12T18:04:30.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.897+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.901+0000 7f92060289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.901+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.901+0000 7f92060289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.901+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.901+0000 7f92060289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:30.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.901+0000 7f92060289c0 20 started sync module instance, tier type = 2024-09-12T18:04:30.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.901+0000 7f92060289c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:30.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.917+0000 7f92060289c0 20 add_watcher() i=0 2024-09-12T18:04:30.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.917+0000 7f92060289c0 20 add_watcher() i=1 2024-09-12T18:04:30.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.917+0000 7f92060289c0 20 add_watcher() i=2 2024-09-12T18:04:30.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.917+0000 7f92060289c0 20 add_watcher() i=3 2024-09-12T18:04:30.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.917+0000 7f92060289c0 20 add_watcher() i=4 2024-09-12T18:04:30.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.917+0000 7f92060289c0 20 add_watcher() i=5 2024-09-12T18:04:30.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.921+0000 7f92060289c0 20 add_watcher() i=6 2024-09-12T18:04:30.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.921+0000 7f92060289c0 20 add_watcher() i=7 2024-09-12T18:04:30.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.921+0000 7f92060289c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:30.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.925+0000 7f90b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:30.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.925+0000 7f92060289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:30.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.925+0000 7f92060289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:30.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.925+0000 7f92060289c0 5 note: GC not initialized 2024-09-12T18:04:30.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.925+0000 7f90b8fe1640 20 reqs_thread_entry: start 2024-09-12T18:04:30.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.925+0000 7f92060289c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:30.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.925+0000 7f92060289c0 20 Filter name: none 2024-09-12T18:04:30.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.925+0000 7f90327fc640 20 reqs_thread_entry: start 2024-09-12T18:04:30.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.925+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.925+0000 7f92060289c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:30.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.925+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.929+0000 7f92060289c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:30.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.929+0000 7f92060289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:30.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.929+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.929+0000 7f92060289c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:30.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.929+0000 7f92060289c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:30.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.929+0000 7f92060289c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:30.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.929+0000 7f92060289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:30.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.933+0000 7f90b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:30.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.937+0000 7f92060289c0 20 remove_watcher() i=0 2024-09-12T18:04:30.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.937+0000 7f92060289c0 2 removed watcher, disabling cache 2024-09-12T18:04:30.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.937+0000 7f92060289c0 20 remove_watcher() i=1 2024-09-12T18:04:30.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.941+0000 7f92060289c0 20 remove_watcher() i=2 2024-09-12T18:04:30.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.941+0000 7f92060289c0 20 remove_watcher() i=3 2024-09-12T18:04:30.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.945+0000 7f92060289c0 20 remove_watcher() i=4 2024-09-12T18:04:30.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.945+0000 7f92060289c0 20 remove_watcher() i=5 2024-09-12T18:04:30.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.949+0000 7f92060289c0 20 remove_watcher() i=6 2024-09-12T18:04:30.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:30.953+0000 7f92060289c0 20 remove_watcher() i=7 2024-09-12T18:04:30.967 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:30.968 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:04:30.968 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-block-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:04:30.968 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:30.968 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T18:04:30.999 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:31.000 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:31.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 realm 2024-09-12T18:04:31.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.045+0000 7f7c199e89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:31.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:31.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:31.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 searching for the correct realm 2024-09-12T18:04:31.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.053+0000 7f7c17cef640 0 -- 172.21.15.97:0/3484037995 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55ee51ff1510 msgr2=0x55ee51ff39b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:31.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.057+0000 7f7c174ee640 0 -- 172.21.15.97:0/3484037995 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55ee51ff5760 msgr2=0x55ee51ff7b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:31.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:31.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:31.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:31.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:31.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:31.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:31.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:31.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:31.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 zone default found 2024-09-12T18:04:31.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 4 Realm: () 2024-09-12T18:04:31.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:31.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:31.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:31.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 zonegroup default 2024-09-12T18:04:31.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 started sync module instance, tier type = 2024-09-12T18:04:31.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:31.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=0 2024-09-12T18:04:31.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=1 2024-09-12T18:04:31.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=2 2024-09-12T18:04:31.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=3 2024-09-12T18:04:31.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=4 2024-09-12T18:04:31.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=5 2024-09-12T18:04:31.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=6 2024-09-12T18:04:31.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.089+0000 7f7c199e89c0 20 add_watcher() i=7 2024-09-12T18:04:31.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.089+0000 7f7c199e89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:31.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.089+0000 7f7acdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:31.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:31.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:31.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 note: GC not initialized 2024-09-12T18:04:31.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7accfe1640 20 reqs_thread_entry: start 2024-09-12T18:04:31.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:31.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 Filter name: none 2024-09-12T18:04:31.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7a467fc640 20 reqs_thread_entry: start 2024-09-12T18:04:31.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:04:31.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:31.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:04:31.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:04:31.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 : miss 2024-09-12T18:04:31.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:31.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:31.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 2024-09-12T18:04:31.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29, ofs0, ns] 2024-09-12T18:04:31.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 94482066299968 notifier 7074 bl.length()=915 2024-09-12T18:04:31.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_sources= new_sources= 2024-09-12T18:04:31.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential sources added=[] removed=[] 2024-09-12T18:04:31.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_dests= new_dests= 2024-09-12T18:04:31.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential dests added=[] removed=[] 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.0 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.0 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.1 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.1 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.2 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.2 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.3 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.3 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.4 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.4 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.5 2024-09-12T18:04:31.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.5 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.6 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.6 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.7 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.7 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.8 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.8 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.9 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.9 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.10 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.10 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.11 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.11 2024-09-12T18:04:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.0 2024-09-12T18:04:31.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1 2024-09-12T18:04:31.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2 2024-09-12T18:04:31.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.3 2024-09-12T18:04:31.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.4 2024-09-12T18:04:31.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.5 2024-09-12T18:04:31.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.6 2024-09-12T18:04:31.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.7 2024-09-12T18:04:31.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.125+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.8 2024-09-12T18:04:31.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.125+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.9 2024-09-12T18:04:31.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.125+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.10 2024-09-12T18:04:31.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:31.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 2024-09-12T18:04:31.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29, ofs0, ns] 2024-09-12T18:04:31.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 94482066299968 notifier 7074 bl.length()=915 2024-09-12T18:04:31.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_sources= new_sources= 2024-09-12T18:04:31.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential sources added=[] removed=[] 2024-09-12T18:04:31.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_dests= new_dests= 2024-09-12T18:04:31.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential dests added=[] removed=[] 2024-09-12T18:04:31.138 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7c199e89c0 time 2024-09-12T18:04:31.140700+0000 2024-09-12T18:04:31.138 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:04:31.139 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:31.140 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7c1d2c22eb] 2024-09-12T18:04:31.140 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1d2c249f] 2024-09-12T18:04:31.140 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee500dd0c1] 2024-09-12T18:04:31.140 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55ee500ee55b] 2024-09-12T18:04:31.140 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee500efb44] 2024-09-12T18:04:31.140 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:04:31.140 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1c128d90] 2024-09-12T18:04:31.140 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:04:31.140 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:04:31.140 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:04:31.140 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7c199e89c0 thread_name:radosgw-admin 2024-09-12T18:04:31.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.137+0000 7f7c199e89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7c199e89c0 time 2024-09-12T18:04:31.140700+0000 2024-09-12T18:04:31.141 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:04:31.141 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.141 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:31.141 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7c1d2c22eb] 2024-09-12T18:04:31.141 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1d2c249f] 2024-09-12T18:04:31.141 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee500dd0c1] 2024-09-12T18:04:31.141 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55ee500ee55b] 2024-09-12T18:04:31.142 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee500efb44] 2024-09-12T18:04:31.142 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:04:31.142 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1c128d90] 2024-09-12T18:04:31.142 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:04:31.142 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:04:31.142 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.176 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:31.176 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7c1c141520] 2024-09-12T18:04:31.176 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:04:31.176 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:04:31.176 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:04:31.176 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7c1d2c2345] 2024-09-12T18:04:31.176 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1d2c249f] 2024-09-12T18:04:31.176 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee500dd0c1] 2024-09-12T18:04:31.176 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55ee500ee55b] 2024-09-12T18:04:31.176 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee500efb44] 2024-09-12T18:04:31.177 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:04:31.177 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1c128d90] 2024-09-12T18:04:31.177 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:04:31.177 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:04:31.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.141+0000 7f7c199e89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:04:31.177 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7c199e89c0 thread_name:radosgw-admin 2024-09-12T18:04:31.177 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.177 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:31.177 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7c1c141520] 2024-09-12T18:04:31.177 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:04:31.177 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7c1d2c2345] 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1d2c249f] 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee500dd0c1] 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55ee500ee55b] 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee500efb44] 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1c128d90] 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.178 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.179 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.180 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command rotate-key hook 0x55ee51f07e58 2024-09-12T18:04:31.180 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:31.180 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:04:31.180 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-b con 0x55ee51d84b50 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:04:31.180 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-a con 0x55ee51db84c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:04:31.180 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-c con 0x55ee51f368b0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:04:31.180 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.180 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.180 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.180 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:31.181 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): authenticate will time out at 2700.434210s 2024-09-12T18:04:31.181 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): get_auth_request con 0x55ee51db84c0 auth_method 0 2024-09-12T18:04:31.181 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.181 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.181 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.181 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): get_auth_request con 0x55ee51f368b0 auth_method 0 2024-09-12T18:04:31.181 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.181 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.181 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.181 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.181 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.182 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.182 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.182 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.182 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.182 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): handle_auth_done global_id 7065 payload 824 2024-09-12T18:04:31.182 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient: _finish_hunting 0 2024-09-12T18:04:31.182 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:04:31.021+0000 7f7c16ced640 1 monclient: found mon.noname-a 2024-09-12T18:04:31.182 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.182 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.182 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:04:31.182 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: dump: 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: _finish_auth 0 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: _check_auth_tickets 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 monclient: authenticate success, global_id 7065 2024-09-12T18:04:31.183 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.184 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.184 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:31.184 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.184 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:04:31.184 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: dump: 2024-09-12T18:04:31.184 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.184 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:04:31.021+0000 7f7b0560a640 4 set_mon_vals no callback set 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 1 librados: init done 2024-09-12T18:04:31.185 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:04:31.025+0000 7f7b03e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:31.186 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:04:31.025+0000 7f7b03e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.186 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:04:31.025+0000 7f7b03e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.186 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:04:31.025+0000 7f7c174ee640 10 monclient: get_auth_request con 0x7f7afc070ae0 auth_method 0 2024-09-12T18:04:31.186 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:04:31.025+0000 7f7c17cef640 10 monclient: get_auth_request con 0x55ee51f495c0 auth_method 0 2024-09-12T18:04:31.186 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:04:31.025+0000 7f7c174ee640 10 monclient: get_auth_request con 0x55ee51f52c70 auth_method 0 2024-09-12T18:04:31.186 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:04:31.029+0000 7f7c16ced640 10 monclient: get_auth_request con 0x55ee51f57020 auth_method 0 2024-09-12T18:04:31.186 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient: build_initial_monmap 2024-09-12T18:04:31.186 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:31.186 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient: monmap: 2024-09-12T18:04:31.186 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:04:31.186 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding auth protocol: cephx 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding auth protocol: cephx 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding auth protocol: cephx 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.187 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ee51f5f8a0 EEXIST 2024-09-12T18:04:31.188 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient: init 2024-09-12T18:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding auth protocol: cephx 2024-09-12T18:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding auth protocol: cephx 2024-09-12T18:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding auth protocol: cephx 2024-09-12T18:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command rotate-key cmddesc rotate-key hook 0x55ee51f5a6a0 EEXIST 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-a con 0x55ee51f83a50 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-b con 0x55ee51f83380 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-c con 0x55ee51f81d60 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): authenticate will time out at 2700.443883s 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): get_auth_request con 0x55ee51f83a50 auth_method 0 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): get_auth_request con 0x55ee51f81d60 auth_method 0 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:04:31.033+0000 7f7c16ced640 10 monclient(hunting): get_auth_request con 0x55ee51f83380 auth_method 0 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:04:31.033+0000 7f7c16ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:04:31.033+0000 7f7c16ced640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:04:31.033+0000 7f7c16ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): handle_auth_done global_id 7068 payload 824 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient: _finish_hunting 0 2024-09-12T18:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:04:31.033+0000 7f7c174ee640 1 monclient: found mon.noname-a 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: dump: 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: _finish_auth 0 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: _check_auth_tickets 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: dump: 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.194 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.195 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.195 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.195 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.195 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.195 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.195 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 monclient: authenticate success, global_id 7068 2024-09-12T18:04:31.195 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.195 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:04:31.033+0000 7f7c184f0640 4 set_mon_vals no callback set 2024-09-12T18:04:31.195 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:04:31.033+0000 7f7b01602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:04:31.033+0000 7f7b01602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:04:31.033+0000 7f7b01602640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:04:31.033+0000 7f7c16ced640 10 monclient: get_auth_request con 0x7f7af0070a20 auth_method 0 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: get_monmap_and_config 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: build_initial_monmap 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: monmap: 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:31.196 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding auth protocol: cephx 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding auth protocol: cephx 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding auth protocol: cephx 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.197 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: init 2024-09-12T18:04:31.198 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding auth protocol: cephx 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding auth protocol: cephx 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding auth protocol: cephx 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd366caac8 EEXIST 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-b con 0x55ee51fd7660 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-a con 0x55ee51fd7a40 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-c con 0x55ee51fd1de0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): authenticate will time out at 2700.448022s 2024-09-12T18:04:31.201 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): get_auth_request con 0x55ee51fd1de0 auth_method 0 2024-09-12T18:04:31.201 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.201 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.201 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.201 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): get_auth_request con 0x55ee51fd7a40 auth_method 0 2024-09-12T18:04:31.201 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.201 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.201 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.201 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.201 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_done global_id 6668 payload 274 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient: _finish_hunting 0 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:04:31.037+0000 7f7c17cef640 1 monclient: found mon.noname-c 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: dump: 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.203 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.203 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.203 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.203 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.203 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.203 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: _finish_auth 0 2024-09-12T18:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: _check_auth_tickets 2024-09-12T18:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:31.205 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 monclient: authenticate success, global_id 6668 2024-09-12T18:04:31.205 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: get_monmap_and_config success 2024-09-12T18:04:31.205 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 4 set_mon_vals no callback set 2024-09-12T18:04:31.205 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.205 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:04:31.206 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: dump: 2024-09-12T18:04:31.206 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.206 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.206 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.206 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.206 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.207 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.207 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.207 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.207 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.207 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.207 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: shutdown 2024-09-12T18:04:31.208 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: build_initial_monmap 2024-09-12T18:04:31.208 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:31.208 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: monmap: 2024-09-12T18:04:31.208 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:04:31.208 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:31.209 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:04:31.209 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:04:31.209 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:31.209 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.209 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:04:31.210 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:04:31.210 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:04:31.210 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.210 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding auth protocol: cephx 2024-09-12T18:04:31.210 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding auth protocol: cephx 2024-09-12T18:04:31.211 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding auth protocol: cephx 2024-09-12T18:04:31.211 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.211 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.211 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.211 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.211 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.212 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.212 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.212 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.212 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.212 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 librados: starting msgr at 2024-09-12T18:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 librados: starting objecter 2024-09-12T18:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ee51fd3180 EEXIST 2024-09-12T18:04:31.214 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 librados: setting wanted keys 2024-09-12T18:04:31.214 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 librados: calling monclient init 2024-09-12T18:04:31.214 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: init 2024-09-12T18:04:31.214 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding auth protocol: cephx 2024-09-12T18:04:31.214 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding auth protocol: cephx 2024-09-12T18:04:31.215 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding auth protocol: cephx 2024-09-12T18:04:31.215 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.215 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.215 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.215 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.215 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command rotate-key cmddesc rotate-key hook 0x55ee51f859b8 EEXIST 2024-09-12T18:04:31.218 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:31.218 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:04:31.218 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-b con 0x55ee51fd1de0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:04:31.218 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-a con 0x55ee51fd7660 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:04:31.218 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-c con 0x55ee51fcd640 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:04:31.218 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): authenticate will time out at 2700.450563s 2024-09-12T18:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): get_auth_request con 0x55ee51fcd640 auth_method 0 2024-09-12T18:04:31.220 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.220 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.220 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.220 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): get_auth_request con 0x55ee51fd7660 auth_method 0 2024-09-12T18:04:31.220 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.221 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.221 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.221 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.221 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.221 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.221 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.222 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.222 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.222 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_done global_id 7074 payload 824 2024-09-12T18:04:31.222 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient: _finish_hunting 0 2024-09-12T18:04:31.222 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:04:31.037+0000 7f7c16ced640 1 monclient: found mon.noname-a 2024-09-12T18:04:31.223 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.223 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.223 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:04:31.223 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: dump: 2024-09-12T18:04:31.223 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.223 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.224 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.224 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.224 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.224 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.224 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.224 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: _finish_auth 0 2024-09-12T18:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: _check_auth_tickets 2024-09-12T18:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:31.226 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.226 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:04:31.226 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: dump: 2024-09-12T18:04:31.226 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.226 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.226 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.227 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.227 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.227 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.227 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.227 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.228 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.228 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.228 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:04:31.037+0000 7f7afaffd640 4 set_mon_vals no callback set 2024-09-12T18:04:31.228 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 monclient: authenticate success, global_id 7074 2024-09-12T18:04:31.228 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.228 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.229 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.229 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.229 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 librados: init done 2024-09-12T18:04:31.229 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command cr dump hook 0x55ee51fcc638 2024-09-12T18:04:31.230 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.230 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:04:31.041+0000 7f7af97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:31.230 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:04:31.041+0000 7f7af97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.230 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:04:31.041+0000 7f7af97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.230 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:04:31.041+0000 7f7c174ee640 10 monclient: get_auth_request con 0x7f7ae0070b10 auth_method 0 2024-09-12T18:04:31.230 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:04:31.041+0000 7f7c17cef640 10 monclient: get_auth_request con 0x55ee51ff1510 auth_method 0 2024-09-12T18:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 realm 2024-09-12T18:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:31.232 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.232 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.232 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.232 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:04:31.045+0000 7f7c174ee640 10 monclient: get_auth_request con 0x55ee51ff5760 auth_method 0 2024-09-12T18:04:31.232 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:31.232 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.233 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:04:31.045+0000 7f7c16ced640 10 monclient: get_auth_request con 0x55ee51ff8fc0 auth_method 0 2024-09-12T18:04:31.233 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:31.233 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 searching for the correct realm 2024-09-12T18:04:31.233 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:04:31.045+0000 7f7c17cef640 10 monclient: get_auth_request con 0x7f7c0001e060 auth_method 0 2024-09-12T18:04:31.233 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:04:31.049+0000 7f7c174ee640 10 monclient: get_auth_request con 0x7f7c0801c040 auth_method 0 2024-09-12T18:04:31.234 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:04:31.049+0000 7f7c16ced640 10 monclient: get_auth_request con 0x7f7c00071960 auth_method 0 2024-09-12T18:04:31.234 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:04:31.053+0000 7f7c17cef640 0 -- 172.21.15.97:0/3484037995 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55ee51ff1510 msgr2=0x55ee51ff39b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:31.234 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:04:31.053+0000 7f7af97fa640 1 client.7074.objecter ms_handle_reset 0x55ee51ff1510 session 0x55ee51ff0e40 osd.6 2024-09-12T18:04:31.234 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:04:31.053+0000 7f7af97fa640 10 monclient: _renew_subs 2024-09-12T18:04:31.234 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:04:31.053+0000 7f7af97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.235 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:04:31.053+0000 7f7c17cef640 10 monclient: get_auth_request con 0x7f7ae0080630 auth_method 0 2024-09-12T18:04:31.235 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:04:31.053+0000 7f7c17cef640 10 monclient: get_auth_request con 0x7f7c0807a870 auth_method 0 2024-09-12T18:04:31.235 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:04:31.057+0000 7f7c174ee640 10 monclient: get_auth_request con 0x7f7c100ca400 auth_method 0 2024-09-12T18:04:31.235 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:04:31.057+0000 7f7c174ee640 0 -- 172.21.15.97:0/3484037995 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55ee51ff5760 msgr2=0x55ee51ff7b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:31.235 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:04:31.057+0000 7f7af97fa640 1 client.7074.objecter ms_handle_reset 0x55ee51ff5760 session 0x55ee51ff50e0 osd.1 2024-09-12T18:04:31.235 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:04:31.057+0000 7f7c174ee640 10 monclient: get_auth_request con 0x55ee51ff1510 auth_method 0 2024-09-12T18:04:31.236 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:31.236 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:31.236 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:31.236 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:31.236 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:31.237 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:31.237 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.237 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.237 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.237 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:31.238 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.238 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:31.238 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 zone default found 2024-09-12T18:04:31.238 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 4 Realm: () 2024-09-12T18:04:31.238 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:31.239 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:31.239 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:31.239 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 zonegroup default 2024-09-12T18:04:31.239 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.239 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.240 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.240 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.240 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.240 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.240 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 started sync module instance, tier type = 2024-09-12T18:04:31.241 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:31.241 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=0 2024-09-12T18:04:31.241 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=1 2024-09-12T18:04:31.241 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=2 2024-09-12T18:04:31.241 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=3 2024-09-12T18:04:31.242 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=4 2024-09-12T18:04:31.242 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=5 2024-09-12T18:04:31.242 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=6 2024-09-12T18:04:31.242 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 20 add_watcher() i=7 2024-09-12T18:04:31.242 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:31.243 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding auth protocol: cephx 2024-09-12T18:04:31.243 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding auth protocol: cephx 2024-09-12T18:04:31.243 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding auth protocol: cephx 2024-09-12T18:04:31.243 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.243 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.244 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.244 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.244 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.244 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.244 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.244 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.245 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.245 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.245 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.245 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.245 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:04:31.089+0000 7f7acdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:31.246 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.246 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:31.246 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:31.246 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command cache list hook 0x55ee51fcda40 2024-09-12T18:04:31.246 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command cache inspect hook 0x55ee51fcda40 2024-09-12T18:04:31.247 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command cache erase hook 0x55ee51fcda40 2024-09-12T18:04:31.247 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command cache zap hook 0x55ee51fcda40 2024-09-12T18:04:31.247 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 note: GC not initialized 2024-09-12T18:04:31.247 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:04:31.093+0000 7f7accfe1640 20 reqs_thread_entry: start 2024-09-12T18:04:31.247 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command sync trace show hook 0x7f7c100abb40 2024-09-12T18:04:31.247 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command sync trace history hook 0x7f7c100abb40 2024-09-12T18:04:31.248 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command sync trace active hook 0x7f7c100abb40 2024-09-12T18:04:31.248 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command sync trace active_short hook 0x7f7c100abb40 2024-09-12T18:04:31.248 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:31.248 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 Filter name: none 2024-09-12T18:04:31.248 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:04:31.093+0000 7f7a467fc640 20 reqs_thread_entry: start 2024-09-12T18:04:31.249 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:04:31.249 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.249 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:31.249 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:04:31.249 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:04:31.250 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 : miss 2024-09-12T18:04:31.250 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.250 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:31.250 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.250 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.250 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:31.251 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.251 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 2024-09-12T18:04:31.251 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.251 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.251 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.252 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29, ofs0, ns] 2024-09-12T18:04:31.252 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 94482066299968 notifier 7074 bl.length()=915 2024-09-12T18:04:31.252 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.252 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.252 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.253 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_sources= new_sources= 2024-09-12T18:04:31.253 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential sources added=[] removed=[] 2024-09-12T18:04:31.253 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_dests= new_dests= 2024-09-12T18:04:31.253 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential dests added=[] removed=[] 2024-09-12T18:04:31.253 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.0 2024-09-12T18:04:31.254 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.0 2024-09-12T18:04:31.254 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.1 2024-09-12T18:04:31.254 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.1 2024-09-12T18:04:31.254 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.2 2024-09-12T18:04:31.254 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.2 2024-09-12T18:04:31.254 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.3 2024-09-12T18:04:31.255 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.3 2024-09-12T18:04:31.255 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.4 2024-09-12T18:04:31.255 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.4 2024-09-12T18:04:31.255 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.5 2024-09-12T18:04:31.255 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.5 2024-09-12T18:04:31.256 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.6 2024-09-12T18:04:31.256 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.6 2024-09-12T18:04:31.256 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.7 2024-09-12T18:04:31.256 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.7 2024-09-12T18:04:31.256 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.8 2024-09-12T18:04:31.257 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.8 2024-09-12T18:04:31.257 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.9 2024-09-12T18:04:31.257 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.9 2024-09-12T18:04:31.257 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.10 2024-09-12T18:04:31.258 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.10 2024-09-12T18:04:31.258 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.11 2024-09-12T18:04:31.258 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.11 2024-09-12T18:04:31.258 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.0 2024-09-12T18:04:31.258 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1 2024-09-12T18:04:31.258 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2 2024-09-12T18:04:31.259 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.3 2024-09-12T18:04:31.259 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.4 2024-09-12T18:04:31.259 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.5 2024-09-12T18:04:31.259 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.6 2024-09-12T18:04:31.260 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.7 2024-09-12T18:04:31.260 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:04:31.125+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.8 2024-09-12T18:04:31.260 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:04:31.125+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.9 2024-09-12T18:04:31.260 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:04:31.125+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.10 2024-09-12T18:04:31.260 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:31.260 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 2024-09-12T18:04:31.261 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.261 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.261 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.261 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29, ofs0, ns] 2024-09-12T18:04:31.261 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 94482066299968 notifier 7074 bl.length()=915 2024-09-12T18:04:31.262 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.262 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.262 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.262 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_sources= new_sources= 2024-09-12T18:04:31.262 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential sources added=[] removed=[] 2024-09-12T18:04:31.263 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_dests= new_dests= 2024-09-12T18:04:31.263 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential dests added=[] removed=[] 2024-09-12T18:04:31.263 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:04:31.137+0000 7f7c199e89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7c199e89c0 time 2024-09-12T18:04:31.140700+0000 2024-09-12T18:04:31.263 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:04:31.263 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.263 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:31.264 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7c1d2c22eb] 2024-09-12T18:04:31.264 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1d2c249f] 2024-09-12T18:04:31.264 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee500dd0c1] 2024-09-12T18:04:31.264 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55ee500ee55b] 2024-09-12T18:04:31.264 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee500efb44] 2024-09-12T18:04:31.265 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:04:31.265 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1c128d90] 2024-09-12T18:04:31.265 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:04:31.265 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:04:31.265 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.266 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:04:31.141+0000 7f7c199e89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:04:31.266 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7c199e89c0 thread_name:radosgw-admin 2024-09-12T18:04:31.266 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.266 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:31.266 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7c1c141520] 2024-09-12T18:04:31.266 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:04:31.267 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:04:31.267 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:04:31.267 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7c1d2c2345] 2024-09-12T18:04:31.267 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1d2c249f] 2024-09-12T18:04:31.267 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee500dd0c1] 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55ee500ee55b] 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee500efb44] 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1c128d90] 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:04:31.268 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:04:31.269 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:04:31.270 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:04:31.271 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:04:31.272 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:04:31.273 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:04:31.274 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7a467fc640 / http_manager 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7accfe1640 / http_manager 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7acdfe3640 / rgw_dt_lg_renew 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7af97fa640 / ms_dispatch 2024-09-12T18:04:31.275 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7afa7fc640 / io_context_pool 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7afaffd640 / io_context_pool 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7b01602640 / ms_dispatch 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7b03e07640 / ms_dispatch 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7b0560a640 / io_context_pool 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c16ced640 / msgr-worker-2 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c174ee640 / msgr-worker-1 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c17cef640 / msgr-worker-0 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c184f0640 / io_context_pool 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c199e89c0 / radosgw-admin 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.106339.log 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:04:31.276 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: crc 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f07d10) adding con mode: secure 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.277 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.278 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command rotate-key hook 0x55ee51f07e58 2024-09-12T18:04:31.278 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:31.278 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:04:31.278 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-b con 0x55ee51d84b50 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:04:31.278 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-a con 0x55ee51db84c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:04:31.278 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-c con 0x55ee51f368b0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:04:31.278 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.278 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.278 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.278 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:31.278 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient(hunting): authenticate will time out at 2700.434210s 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): get_auth_request con 0x55ee51db84c0 auth_method 0 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): get_auth_request con 0x55ee51f368b0 auth_method 0 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:04:31.021+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.279 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient(hunting): handle_auth_done global_id 7065 payload 824 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient: _finish_hunting 0 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:04:31.021+0000 7f7c16ced640 1 monclient: found mon.noname-a 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:04:31.021+0000 7f7c16ced640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: dump: 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.280 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: _finish_auth 0 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: _check_auth_tickets 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 5 monclient: authenticate success, global_id 7065 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:04:31.281 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:04:31.021+0000 7f7b03e07640 10 monclient: dump: 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:04:31.021+0000 7f7b0560a640 4 set_mon_vals no callback set 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.282 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:04:31.021+0000 7f7c199e89c0 1 librados: init done 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:04:31.025+0000 7f7b03e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:04:31.025+0000 7f7b03e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:04:31.025+0000 7f7b03e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:04:31.025+0000 7f7c174ee640 10 monclient: get_auth_request con 0x7f7afc070ae0 auth_method 0 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:04:31.025+0000 7f7c17cef640 10 monclient: get_auth_request con 0x55ee51f495c0 auth_method 0 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:04:31.025+0000 7f7c174ee640 10 monclient: get_auth_request con 0x55ee51f52c70 auth_method 0 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:04:31.029+0000 7f7c16ced640 10 monclient: get_auth_request con 0x55ee51f57020 auth_method 0 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient: build_initial_monmap 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient: monmap: 2024-09-12T18:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding auth protocol: cephx 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding auth protocol: cephx 2024-09-12T18:04:31.284 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding auth protocol: cephx 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: crc 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5bf30) adding con mode: secure 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.285 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ee51f5f8a0 EEXIST 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient: init 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding auth protocol: cephx 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding auth protocol: cephx 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding auth protocol: cephx 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.286 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: crc 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f5a558) adding con mode: secure 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command rotate-key cmddesc rotate-key hook 0x55ee51f5a6a0 EEXIST 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-a con 0x55ee51f83a50 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-b con 0x55ee51f83380 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-c con 0x55ee51f81d60 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.287 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:04:31.029+0000 7f7c199e89c0 10 monclient(hunting): authenticate will time out at 2700.443883s 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): get_auth_request con 0x55ee51f83a50 auth_method 0 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): get_auth_request con 0x55ee51f81d60 auth_method 0 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.288 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:04:31.033+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:04:31.033+0000 7f7c16ced640 10 monclient(hunting): get_auth_request con 0x55ee51f83380 auth_method 0 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:04:31.033+0000 7f7c16ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:04:31.033+0000 7f7c16ced640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:04:31.033+0000 7f7c16ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient(hunting): handle_auth_done global_id 7068 payload 824 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient: _finish_hunting 0 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:04:31.033+0000 7f7c174ee640 1 monclient: found mon.noname-a 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:04:31.033+0000 7f7c174ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:04:31.289 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: dump: 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: _finish_auth 0 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: _check_auth_tickets 2024-09-12T18:04:31.290 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:04:31.033+0000 7f7b01602640 10 monclient: dump: 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.291 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 monclient: authenticate success, global_id 7068 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:04:31.033+0000 7f7c184f0640 4 set_mon_vals no callback set 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:04:31.033+0000 7f7b01602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:04:31.033+0000 7f7b01602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:04:31.033+0000 7f7b01602640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:04:31.033+0000 7f7c16ced640 10 monclient: get_auth_request con 0x7f7af0070a20 auth_method 0 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: get_monmap_and_config 2024-09-12T18:04:31.292 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: build_initial_monmap 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: monmap: 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.293 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding auth protocol: cephx 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding auth protocol: cephx 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding auth protocol: cephx 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: crc 2024-09-12T18:04:31.294 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa33a0) adding con mode: secure 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: init 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding auth protocol: cephx 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding auth protocol: cephx 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding auth protocol: cephx 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.295 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: crc 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366ca980) adding con mode: secure 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd366caac8 EEXIST 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-b con 0x55ee51fd7660 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:04:31.033+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-a con 0x55ee51fd7a40 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:04:31.296 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-c con 0x55ee51fd1de0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): authenticate will time out at 2700.448022s 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): get_auth_request con 0x55ee51fd1de0 auth_method 0 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): get_auth_request con 0x55ee51fd7a40 auth_method 0 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.297 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_done global_id 6668 payload 274 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient: _finish_hunting 0 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:04:31.037+0000 7f7c17cef640 1 monclient: found mon.noname-c 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.298 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: dump: 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: _finish_auth 0 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: _check_auth_tickets 2024-09-12T18:04:31.299 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 monclient: authenticate success, global_id 6668 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: get_monmap_and_config success 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 4 set_mon_vals no callback set 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:04:31.037+0000 7f7afaffd640 10 monclient: dump: 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.300 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: shutdown 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: build_initial_monmap 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 build_initial for_mkfs: 0 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: monmap: 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:04:31.301 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding auth protocol: cephx 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding auth protocol: cephx 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding auth protocol: cephx 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.302 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: crc 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51fa8440) adding con mode: secure 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 librados: starting msgr at 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 librados: starting objecter 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ee51fd3180 EEXIST 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 librados: setting wanted keys 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 librados: calling monclient init 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: init 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding auth protocol: cephx 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding auth protocol: cephx 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding auth protocol: cephx 2024-09-12T18:04:31.303 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: crc 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 AuthRegistry(0x55ee51f85870) adding con mode: secure 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.304 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command rotate-key cmddesc rotate-key hook 0x55ee51f859b8 EEXIST 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-b con 0x55ee51fd1de0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-a con 0x55ee51fd7660 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): picked mon.noname-c con 0x55ee51fcd640 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient(hunting): authenticate will time out at 2700.450563s 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): get_auth_request con 0x55ee51fcd640 auth_method 0 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.305 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): get_auth_request con 0x55ee51fd7660 auth_method 0 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:04:31.037+0000 7f7c17cef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient(hunting): handle_auth_done global_id 7074 payload 824 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient: _finish_hunting 0 2024-09-12T18:04:31.306 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:04:31.037+0000 7f7c16ced640 1 monclient: found mon.noname-a 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:04:31.037+0000 7f7c16ced640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: dump: 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.307 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: _finish_auth 0 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: _check_auth_tickets 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:04:31.037+0000 7f7af97fa640 10 monclient: dump: 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:04:31.308 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:04:31.037+0000 7f7afaffd640 4 set_mon_vals no callback set 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 monclient: authenticate success, global_id 7074 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _renew_subs 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 1 librados: init done 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:04:31.037+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command cr dump hook 0x55ee51fcc638 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:04:31.041+0000 7f7af97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:04:31.309 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:04:31.041+0000 7f7af97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:04:31.041+0000 7f7af97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:04:31.041+0000 7f7c174ee640 10 monclient: get_auth_request con 0x7f7ae0070b10 auth_method 0 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:04:31.041+0000 7f7c17cef640 10 monclient: get_auth_request con 0x55ee51ff1510 auth_method 0 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 realm 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:04:31.041+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:04:31.045+0000 7f7c174ee640 10 monclient: get_auth_request con 0x55ee51ff5760 auth_method 0 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:31.310 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:04:31.045+0000 7f7c16ced640 10 monclient: get_auth_request con 0x55ee51ff8fc0 auth_method 0 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:04:31.045+0000 7f7c199e89c0 20 searching for the correct realm 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:04:31.045+0000 7f7c17cef640 10 monclient: get_auth_request con 0x7f7c0001e060 auth_method 0 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:04:31.049+0000 7f7c174ee640 10 monclient: get_auth_request con 0x7f7c0801c040 auth_method 0 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:04:31.049+0000 7f7c16ced640 10 monclient: get_auth_request con 0x7f7c00071960 auth_method 0 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:04:31.053+0000 7f7c17cef640 0 -- 172.21.15.97:0/3484037995 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55ee51ff1510 msgr2=0x55ee51ff39b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:04:31.053+0000 7f7af97fa640 1 client.7074.objecter ms_handle_reset 0x55ee51ff1510 session 0x55ee51ff0e40 osd.6 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:04:31.053+0000 7f7af97fa640 10 monclient: _renew_subs 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:04:31.053+0000 7f7af97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:04:31.053+0000 7f7c17cef640 10 monclient: get_auth_request con 0x7f7ae0080630 auth_method 0 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:04:31.053+0000 7f7c17cef640 10 monclient: get_auth_request con 0x7f7c0807a870 auth_method 0 2024-09-12T18:04:31.311 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:04:31.057+0000 7f7c174ee640 10 monclient: get_auth_request con 0x7f7c100ca400 auth_method 0 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:04:31.057+0000 7f7c174ee640 0 -- 172.21.15.97:0/3484037995 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55ee51ff5760 msgr2=0x55ee51ff7b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:04:31.057+0000 7f7af97fa640 1 client.7074.objecter ms_handle_reset 0x55ee51ff5760 session 0x55ee51ff50e0 osd.1 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:04:31.057+0000 7f7c174ee640 10 monclient: get_auth_request con 0x55ee51ff1510 auth_method 0 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.312 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 zone default found 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 4 Realm: () 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 zonegroup default 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.313 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 started sync module instance, tier type = 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:04:31.065+0000 7f7c199e89c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=0 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=1 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=2 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=3 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=4 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=5 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:04:31.085+0000 7f7c199e89c0 20 add_watcher() i=6 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 20 add_watcher() i=7 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:31.314 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding auth protocol: cephx 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding auth protocol: cephx 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding auth protocol: cephx 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.315 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: crc 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:04:31.089+0000 7f7c199e89c0 5 AuthRegistry(0x7ffd366cae50) adding con mode: secure 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:04:31.089+0000 7f7acdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command cache list hook 0x55ee51fcda40 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command cache inspect hook 0x55ee51fcda40 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command cache erase hook 0x55ee51fcda40 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command cache zap hook 0x55ee51fcda40 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 note: GC not initialized 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:04:31.093+0000 7f7accfe1640 20 reqs_thread_entry: start 2024-09-12T18:04:31.316 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command sync trace show hook 0x7f7c100abb40 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command sync trace history hook 0x7f7c100abb40 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command sync trace active hook 0x7f7c100abb40 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 5 asok(0x55ee51cfd2b0) register_command sync trace active_short hook 0x7f7c100abb40 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 Filter name: none 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:04:31.093+0000 7f7a467fc640 20 reqs_thread_entry: start 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 : miss 2024-09-12T18:04:31.317 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:04:31.093+0000 7f7c199e89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29, ofs0, ns] 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 94482066299968 notifier 7074 bl.length()=915 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.318 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:04:31.105+0000 7f7afa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_sources= new_sources= 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential sources added=[] removed=[] 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_dests= new_dests= 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:04:31.105+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential dests added=[] removed=[] 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.0 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.0 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.1 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.1 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.2 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.2 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.3 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.3 2024-09-12T18:04:31.319 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.4 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.4 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.5 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.5 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.6 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.6 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.7 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.7 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.8 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.8 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.9 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.9 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.10 2024-09-12T18:04:31.320 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.10 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.11 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1.11 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.0 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:04:31.117+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.3 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.4 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.5 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.6 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:04:31.121+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.7 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:04:31.125+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.8 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:04:31.125+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.9 2024-09-12T18:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:04:31.125+0000 7f7c199e89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.10 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:04:31.133+0000 7f7c199e89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29, ofs0, ns] 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 94482066299968 notifier 7074 bl.length()=915 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:04:31.133+0000 7f7afa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_sources= new_sources= 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential sources added=[] removed=[] 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_dests= new_dests= 2024-09-12T18:04:31.322 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:04:31.137+0000 7f7c199e89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential dests added=[] removed=[] 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:04:31.137+0000 7f7c199e89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7c199e89c0 time 2024-09-12T18:04:31.140700+0000 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7c1d2c22eb] 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1d2c249f] 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee500dd0c1] 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55ee500ee55b] 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee500efb44] 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1c128d90] 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:04:31.141+0000 7f7c199e89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7c199e89c0 thread_name:radosgw-admin 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7c1c141520] 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7c1d2c2345] 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1d2c249f] 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee500dd0c1] 2024-09-12T18:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55ee500ee55b] 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee500efb44] 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1c128d90] 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:04:31.327 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:04:31.328 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:04:31.329 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:04:31.330 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:04:31.331 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7a467fc640 / http_manager 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7accfe1640 / http_manager 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7acdfe3640 / rgw_dt_lg_renew 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7af97fa640 / ms_dispatch 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7afa7fc640 / io_context_pool 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7afaffd640 / io_context_pool 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7b01602640 / ms_dispatch 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7b03e07640 / ms_dispatch 2024-09-12T18:04:31.332 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7b0560a640 / io_context_pool 2024-09-12T18:04:31.333 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c16ced640 / msgr-worker-2 2024-09-12T18:04:31.333 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c174ee640 / msgr-worker-1 2024-09-12T18:04:31.333 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c17cef640 / msgr-worker-0 2024-09-12T18:04:31.333 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c184f0640 / io_context_pool 2024-09-12T18:04:31.333 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c199e89c0 / radosgw-admin 2024-09-12T18:04:31.333 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:04:31.333 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:04:31.333 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:04:31.144712Z_964882f2-991f-46d9-8e3d-eb1eaccc019b/log 2024-09-12T18:04:31.333 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:04:31.333 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:04:31.333 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T18:04:31.338 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:31.338 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.225+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.229+0000 7f800c5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.229+0000 7f800c5e49c0 20 realm 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.229+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.229+0000 7f800c5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.229+0000 7f800c5e49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.229+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.229+0000 7f800c5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.229+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.229+0000 7f800c5e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.229+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.233+0000 7f800c5e49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:31.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.233+0000 7f800c5e49c0 20 searching for the correct realm 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.237+0000 7f800a0ea640 0 -- 172.21.15.97:0/3645547553 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f7ffc052030 msgr2=0x7f7ffc053a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.241+0000 7f800a0ea640 0 -- 172.21.15.97:0/3645547553 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f80040691d0 msgr2=0x7f800405f0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.249+0000 7f800c5e49c0 20 zone default found 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 4 Realm: () 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 20 zonegroup default 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 20 started sync module instance, tier type = 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.253+0000 7f800c5e49c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.269+0000 7f800c5e49c0 20 add_watcher() i=0 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.269+0000 7f800c5e49c0 20 add_watcher() i=1 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.269+0000 7f800c5e49c0 20 add_watcher() i=2 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.269+0000 7f800c5e49c0 20 add_watcher() i=3 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.269+0000 7f800c5e49c0 20 add_watcher() i=4 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.269+0000 7f800c5e49c0 20 add_watcher() i=5 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.269+0000 7f800c5e49c0 20 add_watcher() i=6 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.273+0000 7f800c5e49c0 20 add_watcher() i=7 2024-09-12T18:04:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.273+0000 7f800c5e49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.277+0000 7f7ec0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.277+0000 7f800c5e49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.277+0000 7f800c5e49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.277+0000 7f800c5e49c0 5 note: GC not initialized 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.277+0000 7f7e3b7fe640 20 reqs_thread_entry: start 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.277+0000 7f800c5e49c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.277+0000 7f800c5e49c0 20 Filter name: none 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.277+0000 7f7e397fa640 20 reqs_thread_entry: start 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.277+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.277+0000 7f800c5e49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.277+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.281+0000 7f800c5e49c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:04:31.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.281+0000 7f800c5e49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.281+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.281+0000 7f800c5e49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.281+0000 7f800c5e49c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.281+0000 7f800c5e49c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.281+0000 7f800c5e49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.285+0000 7f7ec0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.289+0000 7f800c5e49c0 20 remove_watcher() i=0 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.289+0000 7f800c5e49c0 2 removed watcher, disabling cache 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.289+0000 7f800c5e49c0 20 remove_watcher() i=1 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.293+0000 7f800c5e49c0 20 remove_watcher() i=2 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.293+0000 7f800c5e49c0 20 remove_watcher() i=3 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.297+0000 7f800c5e49c0 20 remove_watcher() i=4 2024-09-12T18:04:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.297+0000 7f800c5e49c0 20 remove_watcher() i=5 2024-09-12T18:04:31.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.301+0000 7f800c5e49c0 20 remove_watcher() i=6 2024-09-12T18:04:31.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.301+0000 7f800c5e49c0 20 remove_watcher() i=7 2024-09-12T18:04:31.345 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.345 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:04:31.345 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-block-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:04:31.345 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:04:31.345 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:31.345 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:31.361 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:04:31.361 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:04:31.423 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:04:31.458 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:04:31.458 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:04:31.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.501+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.505+0000 7f7a08a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.505+0000 7f7a08a0d9c0 20 realm 2024-09-12T18:04:31.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.505+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.505+0000 7f7a08a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.505+0000 7f7a08a0d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:04:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.505+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.505+0000 7f7a08a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.505+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.505+0000 7f7a08a0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:31.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.505+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.509+0000 7f7a08a0d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:04:31.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.509+0000 7f7a08a0d9c0 20 searching for the correct realm 2024-09-12T18:04:31.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.513+0000 7f7a05d12640 0 -- 172.21.15.97:0/3544481386 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f79fc0e9c60 msgr2=0x7f79fc0e5a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:31.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.725+0000 7f7a06d14640 0 -- 172.21.15.97:0/3544481386 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55645f0694a0 msgr2=0x55645f06b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:04:31.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:04:31.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:04:31.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:04:31.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:04:31.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:04:31.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 zone default found 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 4 Realm: () 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 zonegroup default 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.741+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.745+0000 7f7a08a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.745+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.745+0000 7f7a08a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:04:31.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.745+0000 7f7a08a0d9c0 20 started sync module instance, tier type = 2024-09-12T18:04:31.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.745+0000 7f7a08a0d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:04:31.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.765+0000 7f7a08a0d9c0 20 add_watcher() i=0 2024-09-12T18:04:31.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.765+0000 7f7a08a0d9c0 20 add_watcher() i=1 2024-09-12T18:04:31.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.765+0000 7f7a08a0d9c0 20 add_watcher() i=2 2024-09-12T18:04:31.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.765+0000 7f7a08a0d9c0 20 add_watcher() i=3 2024-09-12T18:04:31.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.765+0000 7f7a08a0d9c0 20 add_watcher() i=4 2024-09-12T18:04:31.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.765+0000 7f7a08a0d9c0 20 add_watcher() i=5 2024-09-12T18:04:31.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.765+0000 7f7a08a0d9c0 20 add_watcher() i=6 2024-09-12T18:04:31.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.769+0000 7f7a08a0d9c0 20 add_watcher() i=7 2024-09-12T18:04:31.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.769+0000 7f7a08a0d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:04:31.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f78bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:31.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:04:31.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:04:31.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 5 note: GC not initialized 2024-09-12T18:04:31.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f78377fe640 20 reqs_thread_entry: start 2024-09-12T18:04:31.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:04:31.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 20 Filter name: none 2024-09-12T18:04:31.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f78357fa640 20 reqs_thread_entry: start 2024-09-12T18:04:31.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:04:31.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:04:31.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:04:31.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:04:31.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 : miss 2024-09-12T18:04:31.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.773+0000 7f7a08a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:04:31.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.777+0000 7f7a08a0d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:04:31.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.777+0000 7f7a08a0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:04:31.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.777+0000 7f7a08a0d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:04:31.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.777+0000 7f7a08a0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:04:31.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.777+0000 7f7a08a0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:04:31.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.777+0000 7f7a08a0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 2024-09-12T18:04:31.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.777+0000 7f7a08a0d9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to be held by another RGW process; skipping for now 2024-09-12T18:04:31.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.777+0000 7f78bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:04:31.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.781+0000 7f7a08a0d9c0 20 remove_watcher() i=0 2024-09-12T18:04:31.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.781+0000 7f7a08a0d9c0 2 removed watcher, disabling cache 2024-09-12T18:04:31.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.785+0000 7f7a08a0d9c0 20 remove_watcher() i=1 2024-09-12T18:04:31.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.785+0000 7f7a08a0d9c0 20 remove_watcher() i=2 2024-09-12T18:04:31.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.789+0000 7f7a08a0d9c0 20 remove_watcher() i=3 2024-09-12T18:04:31.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.793+0000 7f7a08a0d9c0 20 remove_watcher() i=4 2024-09-12T18:04:31.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.793+0000 7f7a08a0d9c0 20 remove_watcher() i=5 2024-09-12T18:04:31.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.797+0000 7f7a08a0d9c0 20 remove_watcher() i=6 2024-09-12T18:04:31.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:04:31.801+0000 7f7a08a0d9c0 20 remove_watcher() i=7 2024-09-12T18:04:31.817 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:05:01.848 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:05:01.882 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:01.882 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:01.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.924+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:01.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.928+0000 7f03a1a179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:01.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.928+0000 7f03a1a179c0 20 realm 2024-09-12T18:05:01.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.928+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:01.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.928+0000 7f03a1a179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:01.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.928+0000 7f03a1a179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:01.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.928+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:01.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.928+0000 7f03a1a179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:01.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.928+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:01.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.928+0000 7f03a1a179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:01.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.928+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:01.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.932+0000 7f03a1a179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:01.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.932+0000 7f03a1a179c0 20 searching for the correct realm 2024-09-12T18:05:01.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:01.932+0000 7f039ed1c640 0 -- 172.21.15.97:0/2300008815 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f03940c23e0 msgr2=0x7f03940c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:02.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.152+0000 7f039ed1c640 0 -- 172.21.15.97:0/2300008815 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x557404afd140 msgr2=0x557404aff5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:02.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:02.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:02.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:02.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:02.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:02.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:02.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:02.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:02.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:02.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 zone default found 2024-09-12T18:05:02.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 4 Realm: () 2024-09-12T18:05:02.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:02.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:02.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:02.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 zonegroup default 2024-09-12T18:05:02.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:02.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.164+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.168+0000 7f03a1a179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:02.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.168+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.168+0000 7f03a1a179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:02.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.168+0000 7f03a1a179c0 20 started sync module instance, tier type = 2024-09-12T18:05:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.168+0000 7f03a1a179c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:02.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.188+0000 7f03a1a179c0 20 add_watcher() i=0 2024-09-12T18:05:02.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.188+0000 7f03a1a179c0 20 add_watcher() i=1 2024-09-12T18:05:02.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.188+0000 7f03a1a179c0 20 add_watcher() i=2 2024-09-12T18:05:02.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.188+0000 7f03a1a179c0 20 add_watcher() i=3 2024-09-12T18:05:02.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.188+0000 7f03a1a179c0 20 add_watcher() i=4 2024-09-12T18:05:02.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.188+0000 7f03a1a179c0 20 add_watcher() i=5 2024-09-12T18:05:02.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.188+0000 7f03a1a179c0 20 add_watcher() i=6 2024-09-12T18:05:02.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.192+0000 7f03a1a179c0 20 add_watcher() i=7 2024-09-12T18:05:02.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.192+0000 7f03a1a179c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:02.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.196+0000 7f02567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:02.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.196+0000 7f03a1a179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:02.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.196+0000 7f03a1a179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:02.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.196+0000 7f03a1a179c0 5 note: GC not initialized 2024-09-12T18:05:02.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.196+0000 7f02557e2640 20 reqs_thread_entry: start 2024-09-12T18:05:02.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.196+0000 7f03a1a179c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:02.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.196+0000 7f03a1a179c0 20 Filter name: none 2024-09-12T18:05:02.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.196+0000 7f024e7fc640 20 reqs_thread_entry: start 2024-09-12T18:05:02.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.196+0000 7f03a1a179c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:05:02.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.196+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:05:02.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:05:02.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:05:02.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 : miss 2024-09-12T18:05:02.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:05:02.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:05:02.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:05:02.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:02.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:02.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 2024-09-12T18:05:02.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.200+0000 7f03a1a179c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:05:02.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.216+0000 7f03a1a179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:05:02.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.216+0000 7f03a1a179c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:05:02.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.216+0000 7f03a1a179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:02.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.216+0000 7f03a1a179c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29, ofs0, ns] 2024-09-12T18:05:02.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.216+0000 7f0282ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 93956783260656 notifier 6722 bl.length()=915 2024-09-12T18:05:02.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.216+0000 7f0282ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:05:02.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.216+0000 7f0282ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:05:02.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.216+0000 7f0282ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:02.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.220+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_sources= new_sources= 2024-09-12T18:05:02.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.220+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential sources added=[] removed=[] 2024-09-12T18:05:02.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.220+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_dests= new_dests= 2024-09-12T18:05:02.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.220+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential dests added=[] removed=[] 2024-09-12T18:05:02.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.0 2024-09-12T18:05:02.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.0 2024-09-12T18:05:02.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.1 2024-09-12T18:05:02.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.1 2024-09-12T18:05:02.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.2 2024-09-12T18:05:02.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.2 2024-09-12T18:05:02.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.3 2024-09-12T18:05:02.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.3 2024-09-12T18:05:02.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.4 2024-09-12T18:05:02.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.4 2024-09-12T18:05:02.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.5 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.5 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.6 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.6 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.7 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.7 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.8 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.8 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.9 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.9 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.10 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.10 2024-09-12T18:05:02.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.11 2024-09-12T18:05:02.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2.11 2024-09-12T18:05:02.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.0 2024-09-12T18:05:02.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1 2024-09-12T18:05:02.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.232+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2 2024-09-12T18:05:02.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.236+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.3 2024-09-12T18:05:02.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.236+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.4 2024-09-12T18:05:02.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.236+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.5 2024-09-12T18:05:02.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.240+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.6 2024-09-12T18:05:02.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.240+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.7 2024-09-12T18:05:02.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.240+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.8 2024-09-12T18:05:02.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.240+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.9 2024-09-12T18:05:02.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.240+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.10 2024-09-12T18:05:02.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.248+0000 7f03a1a179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:02.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.248+0000 7f03a1a179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 2024-09-12T18:05:02.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.252+0000 7f03a1a179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:05:02.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.252+0000 7f03a1a179c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:05:02.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.252+0000 7f03a1a179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:02.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.252+0000 7f03a1a179c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29, ofs0, ns] 2024-09-12T18:05:02.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.252+0000 7f02827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 93956783260656 notifier 6722 bl.length()=915 2024-09-12T18:05:02.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.252+0000 7f02827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:05:02.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.252+0000 7f02827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:05:02.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.252+0000 7f02827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:02.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.256+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_sources= new_sources= 2024-09-12T18:05:02.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.256+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential sources added=[] removed=[] 2024-09-12T18:05:02.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.256+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_dests= new_dests= 2024-09-12T18:05:02.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.256+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential dests added=[] removed=[] 2024-09-12T18:05:02.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.260+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.0 2024-09-12T18:05:02.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.260+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.1 2024-09-12T18:05:02.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.260+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.2 2024-09-12T18:05:02.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.264+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.3 2024-09-12T18:05:02.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.264+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.4 2024-09-12T18:05:02.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.264+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.5 2024-09-12T18:05:02.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.264+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.6 2024-09-12T18:05:02.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.264+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.7 2024-09-12T18:05:02.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.264+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.8 2024-09-12T18:05:02.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.268+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.9 2024-09-12T18:05:02.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.268+0000 7f03a1a179c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.29.10 2024-09-12T18:05:02.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.268+0000 7f03a1a179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:02.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.268+0000 7f03a1a179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 2024-09-12T18:05:02.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.272+0000 7f03a1a179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:05:02.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.272+0000 7f03a1a179c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:05:02.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.272+0000 7f03a1a179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:02.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.272+0000 7f03a1a179c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29, ofs0, ns] 2024-09-12T18:05:02.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.272+0000 7f02827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431632 cookie 93956783260656 notifier 6722 bl.length()=883 2024-09-12T18:05:02.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.272+0000 7f02827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 info.flags=0x17 2024-09-12T18:05:02.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.272+0000 7f02827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.29 to cache LRU end 2024-09-12T18:05:02.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.272+0000 7f02827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:02.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.276+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_sources= new_sources= 2024-09-12T18:05:02.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.276+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential sources added=[] removed=[] 2024-09-12T18:05:02.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.276+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): orig_dests= new_dests= 2024-09-12T18:05:02.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.276+0000 7f03a1a179c0 20 handle_bi_update(): bucket=:abort-at-block-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.29]): potential dests added=[] removed=[] 2024-09-12T18:05:02.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.280+0000 7f03a1a179c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T18:05:02.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.284+0000 7f02567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:02.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.292+0000 7f03a1a179c0 20 remove_watcher() i=0 2024-09-12T18:05:02.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.292+0000 7f03a1a179c0 2 removed watcher, disabling cache 2024-09-12T18:05:02.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.292+0000 7f03a1a179c0 20 remove_watcher() i=1 2024-09-12T18:05:02.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.296+0000 7f03a1a179c0 20 remove_watcher() i=2 2024-09-12T18:05:02.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.296+0000 7f03a1a179c0 20 remove_watcher() i=3 2024-09-12T18:05:02.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.300+0000 7f03a1a179c0 20 remove_watcher() i=4 2024-09-12T18:05:02.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.300+0000 7f03a1a179c0 20 remove_watcher() i=5 2024-09-12T18:05:02.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.304+0000 7f03a1a179c0 20 remove_watcher() i=6 2024-09-12T18:05:02.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.304+0000 7f03a1a179c0 20 remove_watcher() i=7 2024-09-12T18:05:02.325 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T18:05:02.357 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:02.357 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:02.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.396+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.400+0000 7f46a3bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:02.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.400+0000 7f46a3bdc9c0 20 realm 2024-09-12T18:05:02.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.400+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.400+0000 7f46a3bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:02.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.400+0000 7f46a3bdc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:02.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.400+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.400+0000 7f46a3bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:02.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.400+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.400+0000 7f46a3bdc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:02.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.400+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.404+0000 7f46a3bdc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:02.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.404+0000 7f46a3bdc9c0 20 searching for the correct realm 2024-09-12T18:05:02.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.408+0000 7f46a16e2640 0 -- 172.21.15.97:0/33319761 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f469411f070 msgr2=0x7f469410da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:02.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.412+0000 7f46a16e2640 0 -- 172.21.15.97:0/33319761 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f469c066940 msgr2=0x7f469c05c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:02.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.420+0000 7f46a3bdc9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:02.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.420+0000 7f46a3bdc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:02.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.420+0000 7f46a3bdc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:02.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.420+0000 7f46a3bdc9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:02.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.420+0000 7f46a3bdc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:02.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.420+0000 7f46a3bdc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:02.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.420+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.420+0000 7f46a3bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:02.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.420+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.420+0000 7f46a3bdc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:02.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.420+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:02.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 20 zone default found 2024-09-12T18:05:02.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 4 Realm: () 2024-09-12T18:05:02.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:02.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:02.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:02.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 20 zonegroup default 2024-09-12T18:05:02.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:02.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:02.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:02.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 20 started sync module instance, tier type = 2024-09-12T18:05:02.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.424+0000 7f46a3bdc9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:02.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.444+0000 7f46a3bdc9c0 20 add_watcher() i=0 2024-09-12T18:05:02.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.444+0000 7f46a3bdc9c0 20 add_watcher() i=1 2024-09-12T18:05:02.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.444+0000 7f46a3bdc9c0 20 add_watcher() i=2 2024-09-12T18:05:02.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.444+0000 7f46a3bdc9c0 20 add_watcher() i=3 2024-09-12T18:05:02.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.444+0000 7f46a3bdc9c0 20 add_watcher() i=4 2024-09-12T18:05:02.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.444+0000 7f46a3bdc9c0 20 add_watcher() i=5 2024-09-12T18:05:02.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.444+0000 7f46a3bdc9c0 20 add_watcher() i=6 2024-09-12T18:05:02.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.444+0000 7f46a3bdc9c0 20 add_watcher() i=7 2024-09-12T18:05:02.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.444+0000 7f46a3bdc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:02.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.448+0000 7f4557fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:02.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.448+0000 7f46a3bdc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:02.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.448+0000 7f46a3bdc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:02.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.448+0000 7f46a3bdc9c0 5 note: GC not initialized 2024-09-12T18:05:02.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.448+0000 7f4556fe5640 20 reqs_thread_entry: start 2024-09-12T18:05:02.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.448+0000 7f46a3bdc9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:02.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.448+0000 7f46a3bdc9c0 20 Filter name: none 2024-09-12T18:05:02.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.448+0000 7f4554fe1640 20 reqs_thread_entry: start 2024-09-12T18:05:02.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.448+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.452+0000 7f46a3bdc9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:05:02.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.452+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.452+0000 7f46a3bdc9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:05:02.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.452+0000 7f46a3bdc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:02.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.452+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.452+0000 7f46a3bdc9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:05:02.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.452+0000 7f46a3bdc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:02.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.452+0000 7f46a3bdc9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:05:02.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.452+0000 7f46a3bdc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:02.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.456+0000 7f4557fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:02.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.460+0000 7f46a3bdc9c0 20 remove_watcher() i=0 2024-09-12T18:05:02.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.460+0000 7f46a3bdc9c0 2 removed watcher, disabling cache 2024-09-12T18:05:02.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.460+0000 7f46a3bdc9c0 20 remove_watcher() i=1 2024-09-12T18:05:02.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.464+0000 7f46a3bdc9c0 20 remove_watcher() i=2 2024-09-12T18:05:02.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.464+0000 7f46a3bdc9c0 20 remove_watcher() i=3 2024-09-12T18:05:02.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.468+0000 7f46a3bdc9c0 20 remove_watcher() i=4 2024-09-12T18:05:02.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.472+0000 7f46a3bdc9c0 20 remove_watcher() i=5 2024-09-12T18:05:02.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.476+0000 7f46a3bdc9c0 20 remove_watcher() i=6 2024-09-12T18:05:02.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:02.476+0000 7f46a3bdc9c0 20 remove_watcher() i=7 2024-09-12T18:05:02.493 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:02.493 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:02.493 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-block-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:05:02.493 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:02.494 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:02.495 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:02.518 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:02.518 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:03.039 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:03.039 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:03.421 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T18:05:03.422 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:03.424 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:03.424 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:03.556 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:03.556 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:03.646 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:03.646 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:03.748 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:03.748 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:03.851 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:03.851 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:03.960 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:03.960 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:04.057 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:04.057 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:04.154 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:04.154 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:04.254 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:04.254 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:04.353 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:04.353 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:04.446 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:04.446 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:04.538 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:04.539 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:04.633 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:04.633 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:04.727 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:04.727 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:04.821 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:04.821 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:04.915 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:04.915 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:05.011 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:05.012 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:05.106 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:05.106 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:05.199 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:05.199 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:05.297 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:05.297 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:05.394 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:05.394 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:05.486 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:05.486 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:05.580 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:05:05.612 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:05.612 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:05.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.864+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.864+0000 7fa1e6bec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:05.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.864+0000 7fa1e6bec9c0 20 realm 2024-09-12T18:05:05.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.864+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.864+0000 7fa1e6bec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:05.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.864+0000 7fa1e6bec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:05.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.864+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.864+0000 7fa1e6bec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:05.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.864+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.868+0000 7fa1e6bec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:05.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.868+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.868+0000 7fa1e6bec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:05.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.868+0000 7fa1e6bec9c0 20 searching for the correct realm 2024-09-12T18:05:05.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.872+0000 7fa1e3ef1640 0 -- 172.21.15.97:0/1551628443 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fa1d80eec00 msgr2=0x7fa1d80d8910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:05:05.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.880+0000 7fa1e4ef3640 0 -- 172.21.15.97:0/1551628443 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55fa70559340 msgr2=0x55fa7055b730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:05.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:05.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:05.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:05.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:05.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:05.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:05.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:05.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:05.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:05.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 zone default found 2024-09-12T18:05:05.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 4 Realm: () 2024-09-12T18:05:05.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:05.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:05.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:05.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 zonegroup default 2024-09-12T18:05:05.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.888+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.892+0000 7fa1e6bec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:05.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.892+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.892+0000 7fa1e6bec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:05.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.892+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.892+0000 7fa1e6bec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:05.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.892+0000 7fa1e6bec9c0 20 started sync module instance, tier type = 2024-09-12T18:05:05.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.892+0000 7fa1e6bec9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:05.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.908+0000 7fa1e6bec9c0 20 add_watcher() i=0 2024-09-12T18:05:05.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.908+0000 7fa1e6bec9c0 20 add_watcher() i=1 2024-09-12T18:05:05.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.908+0000 7fa1e6bec9c0 20 add_watcher() i=2 2024-09-12T18:05:05.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.908+0000 7fa1e6bec9c0 20 add_watcher() i=3 2024-09-12T18:05:05.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.908+0000 7fa1e6bec9c0 20 add_watcher() i=4 2024-09-12T18:05:05.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.908+0000 7fa1e6bec9c0 20 add_watcher() i=5 2024-09-12T18:05:05.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.912+0000 7fa1e6bec9c0 20 add_watcher() i=6 2024-09-12T18:05:05.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.912+0000 7fa1e6bec9c0 20 add_watcher() i=7 2024-09-12T18:05:05.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.912+0000 7fa1e6bec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:05.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.916+0000 7fa09b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:05.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.916+0000 7fa1e6bec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:05.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.916+0000 7fa1e6bec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:05.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.916+0000 7fa1e6bec9c0 5 note: GC not initialized 2024-09-12T18:05:05.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.916+0000 7fa09a7dc640 20 reqs_thread_entry: start 2024-09-12T18:05:05.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.916+0000 7fa1e6bec9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:05.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.916+0000 7fa1e6bec9c0 20 Filter name: none 2024-09-12T18:05:05.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.916+0000 7fa0937fe640 20 reqs_thread_entry: start 2024-09-12T18:05:05.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.916+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.916+0000 7fa1e6bec9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:05.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.916+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.920+0000 7fa1e6bec9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:05.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.920+0000 7fa1e6bec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:05.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.920+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.920+0000 7fa1e6bec9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:05.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.920+0000 7fa1e6bec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:05.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.920+0000 7fa1e6bec9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:05.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.920+0000 7fa1e6bec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:05.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.924+0000 7fa09b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:05.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.928+0000 7fa1e6bec9c0 20 remove_watcher() i=0 2024-09-12T18:05:05.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.928+0000 7fa1e6bec9c0 2 removed watcher, disabling cache 2024-09-12T18:05:05.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.928+0000 7fa1e6bec9c0 20 remove_watcher() i=1 2024-09-12T18:05:05.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.932+0000 7fa1e6bec9c0 20 remove_watcher() i=2 2024-09-12T18:05:05.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.932+0000 7fa1e6bec9c0 20 remove_watcher() i=3 2024-09-12T18:05:05.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.936+0000 7fa1e6bec9c0 20 remove_watcher() i=4 2024-09-12T18:05:05.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.936+0000 7fa1e6bec9c0 20 remove_watcher() i=5 2024-09-12T18:05:05.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.940+0000 7fa1e6bec9c0 20 remove_watcher() i=6 2024-09-12T18:05:05.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:05.944+0000 7fa1e6bec9c0 20 remove_watcher() i=7 2024-09-12T18:05:05.960 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:05.960 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:05.961 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-commit-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:05:05.961 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:05.961 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T18:05:05.994 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:05.994 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:06.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.036+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.036+0000 7fa5bff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.036+0000 7fa5bff059c0 20 realm 2024-09-12T18:05:06.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.036+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.036+0000 7fa5bff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.036+0000 7fa5bff059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:06.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.036+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.040+0000 7fa5bff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.040+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.040+0000 7fa5bff059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:06.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.040+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.040+0000 7fa5bff059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:06.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.040+0000 7fa5bff059c0 20 searching for the correct realm 2024-09-12T18:05:06.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.044+0000 7fa5bd20a640 0 -- 172.21.15.97:0/36178418 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fa5b40b6020 msgr2=0x7fa5b40c7a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:05:06.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.256+0000 7fa5be20c640 0 -- 172.21.15.97:0/36178418 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55cc751f5d70 msgr2=0x55cc751f8160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:06.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.268+0000 7fa5bff059c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:06.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.268+0000 7fa5bff059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:06.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.268+0000 7fa5bff059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:06.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.268+0000 7fa5bff059c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:06.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.268+0000 7fa5bff059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:06.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.268+0000 7fa5bff059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:06.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.268+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.268+0000 7fa5bff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.268+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:06.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 20 zone default found 2024-09-12T18:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 4 Realm: () 2024-09-12T18:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 20 zonegroup default 2024-09-12T18:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.272+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.276+0000 7fa5bff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.276+0000 7fa5bff059c0 20 started sync module instance, tier type = 2024-09-12T18:05:06.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.276+0000 7fa5bff059c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:06.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.300+0000 7fa5bff059c0 20 add_watcher() i=0 2024-09-12T18:05:06.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.300+0000 7fa5bff059c0 20 add_watcher() i=1 2024-09-12T18:05:06.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.300+0000 7fa5bff059c0 20 add_watcher() i=2 2024-09-12T18:05:06.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.300+0000 7fa5bff059c0 20 add_watcher() i=3 2024-09-12T18:05:06.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.300+0000 7fa5bff059c0 20 add_watcher() i=4 2024-09-12T18:05:06.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.300+0000 7fa5bff059c0 20 add_watcher() i=5 2024-09-12T18:05:06.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.300+0000 7fa5bff059c0 20 add_watcher() i=6 2024-09-12T18:05:06.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.300+0000 7fa5bff059c0 20 add_watcher() i=7 2024-09-12T18:05:06.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.300+0000 7fa5bff059c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:06.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.304+0000 7fa46ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:06.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.304+0000 7fa5bff059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:06.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.304+0000 7fa5bff059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:06.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 5 note: GC not initialized 2024-09-12T18:05:06.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa46effd640 20 reqs_thread_entry: start 2024-09-12T18:05:06.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:06.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 20 Filter name: none 2024-09-12T18:05:06.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa46cff9640 20 reqs_thread_entry: start 2024-09-12T18:05:06.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T18:05:06.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:06.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T18:05:06.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T18:05:06.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 : miss 2024-09-12T18:05:06.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:06.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:06.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.308+0000 7fa5bff059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 2024-09-12T18:05:06.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa5bff059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa5bff059c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa5bff059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa5bff059c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30, ofs0, ns] 2024-09-12T18:05:06.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa4a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431632 cookie 94336626687040 notifier 7188 bl.length()=931 2024-09-12T18:05:06.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa4a0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa4a0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa4a0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa5bff059c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): orig_sources= new_sources= 2024-09-12T18:05:06.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa5bff059c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): potential sources added=[] removed=[] 2024-09-12T18:05:06.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa5bff059c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): orig_dests= new_dests= 2024-09-12T18:05:06.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.320+0000 7fa5bff059c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): potential dests added=[] removed=[] 2024-09-12T18:05:06.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.0 2024-09-12T18:05:06.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.0 2024-09-12T18:05:06.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.1 2024-09-12T18:05:06.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.1 2024-09-12T18:05:06.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.2 2024-09-12T18:05:06.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.2 2024-09-12T18:05:06.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.3 2024-09-12T18:05:06.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.3 2024-09-12T18:05:06.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.4 2024-09-12T18:05:06.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.4 2024-09-12T18:05:06.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.5 2024-09-12T18:05:06.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.5 2024-09-12T18:05:06.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.6 2024-09-12T18:05:06.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.6 2024-09-12T18:05:06.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.7 2024-09-12T18:05:06.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.7 2024-09-12T18:05:06.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.8 2024-09-12T18:05:06.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.8 2024-09-12T18:05:06.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.9 2024-09-12T18:05:06.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.9 2024-09-12T18:05:06.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.10 2024-09-12T18:05:06.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.10 2024-09-12T18:05:06.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.11 2024-09-12T18:05:06.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1.11 2024-09-12T18:05:06.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.336+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.0 2024-09-12T18:05:06.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.340+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1 2024-09-12T18:05:06.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.340+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2 2024-09-12T18:05:06.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.340+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.3 2024-09-12T18:05:06.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.344+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.4 2024-09-12T18:05:06.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.344+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.5 2024-09-12T18:05:06.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.344+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.6 2024-09-12T18:05:06.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.344+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.7 2024-09-12T18:05:06.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.348+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.8 2024-09-12T18:05:06.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.348+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.9 2024-09-12T18:05:06.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.352+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.10 2024-09-12T18:05:06.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.356+0000 7fa5bff059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:06.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.356+0000 7fa5bff059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 2024-09-12T18:05:06.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.356+0000 7fa5bff059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.356+0000 7fa5bff059c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.356+0000 7fa5bff059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.356+0000 7fa5bff059c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30, ofs0, ns] 2024-09-12T18:05:06.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.360+0000 7fa4a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431633 cookie 94336626687040 notifier 7188 bl.length()=931 2024-09-12T18:05:06.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.360+0000 7fa4a0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.360+0000 7fa4a0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.360+0000 7fa4a0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.360+0000 7fa5bff059c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): orig_sources= new_sources= 2024-09-12T18:05:06.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.360+0000 7fa5bff059c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): potential sources added=[] removed=[] 2024-09-12T18:05:06.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.360+0000 7fa5bff059c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): orig_dests= new_dests= 2024-09-12T18:05:06.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.360+0000 7fa5bff059c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): potential dests added=[] removed=[] 2024-09-12T18:05:06.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.368+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.0 2024-09-12T18:05:06.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.368+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1 2024-09-12T18:05:06.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.368+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2 2024-09-12T18:05:06.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.368+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.3 2024-09-12T18:05:06.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.372+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.4 2024-09-12T18:05:06.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.372+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.5 2024-09-12T18:05:06.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.372+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.6 2024-09-12T18:05:06.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.372+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.7 2024-09-12T18:05:06.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.372+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.8 2024-09-12T18:05:06.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.372+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.9 2024-09-12T18:05:06.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.376+0000 7fa5bff059c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.10 2024-09-12T18:05:06.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.376+0000 7fa5bff059c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T18:05:06.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.376+0000 7fa5bff059c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T18:05:06.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.384+0000 7fa46ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:06.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.388+0000 7fa5bff059c0 20 remove_watcher() i=0 2024-09-12T18:05:06.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.388+0000 7fa5bff059c0 2 removed watcher, disabling cache 2024-09-12T18:05:06.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.392+0000 7fa5bff059c0 20 remove_watcher() i=1 2024-09-12T18:05:06.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.392+0000 7fa5bff059c0 20 remove_watcher() i=2 2024-09-12T18:05:06.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.396+0000 7fa5bff059c0 20 remove_watcher() i=3 2024-09-12T18:05:06.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.400+0000 7fa5bff059c0 20 remove_watcher() i=4 2024-09-12T18:05:06.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.400+0000 7fa5bff059c0 20 remove_watcher() i=5 2024-09-12T18:05:06.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.404+0000 7fa5bff059c0 20 remove_watcher() i=6 2024-09-12T18:05:06.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.404+0000 7fa5bff059c0 20 remove_watcher() i=7 2024-09-12T18:05:06.427 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:05:06.455 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:06.456 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:06.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.496+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.500+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.500+0000 7f7e0c2cc9c0 20 realm 2024-09-12T18:05:06.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.500+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.500+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.500+0000 7f7e0c2cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:06.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.500+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.500+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.500+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.500+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:06.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.500+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.504+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:06.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.504+0000 7f7e0c2cc9c0 20 searching for the correct realm 2024-09-12T18:05:06.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.508+0000 7f7e0a5d3640 0 -- 172.21.15.97:0/1798960258 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f7e00032060 msgr2=0x7f7e00062910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:06.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.516+0000 7f7e09dd2640 0 -- 172.21.15.97:0/1798960258 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f7e04008030 msgr2=0x7f7e0406c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:06.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:06.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:06.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:06.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:06.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:06.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:06.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:06.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:06.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 zone default found 2024-09-12T18:05:06.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 4 Realm: () 2024-09-12T18:05:06.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:06.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:06.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:06.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 zonegroup default 2024-09-12T18:05:06.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.524+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.528+0000 7f7e0c2cc9c0 20 started sync module instance, tier type = 2024-09-12T18:05:06.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.528+0000 7f7e0c2cc9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:06.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.544+0000 7f7e0c2cc9c0 20 add_watcher() i=0 2024-09-12T18:05:06.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.544+0000 7f7e0c2cc9c0 20 add_watcher() i=1 2024-09-12T18:05:06.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.544+0000 7f7e0c2cc9c0 20 add_watcher() i=2 2024-09-12T18:05:06.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.544+0000 7f7e0c2cc9c0 20 add_watcher() i=3 2024-09-12T18:05:06.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.544+0000 7f7e0c2cc9c0 20 add_watcher() i=4 2024-09-12T18:05:06.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.544+0000 7f7e0c2cc9c0 20 add_watcher() i=5 2024-09-12T18:05:06.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.544+0000 7f7e0c2cc9c0 20 add_watcher() i=6 2024-09-12T18:05:06.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.548+0000 7f7e0c2cc9c0 20 add_watcher() i=7 2024-09-12T18:05:06.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.548+0000 7f7e0c2cc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:06.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7cbffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:06.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:06.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:06.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 5 note: GC not initialized 2024-09-12T18:05:06.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7cbefe5640 20 reqs_thread_entry: start 2024-09-12T18:05:06.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:06.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 Filter name: none 2024-09-12T18:05:06.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7cbcfe1640 20 reqs_thread_entry: start 2024-09-12T18:05:06.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:06.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:05:06.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:06.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:06.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:05:06.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.552+0000 7f7e0c2cc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:06.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.556+0000 7f7cbffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:06.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.560+0000 7f7e0c2cc9c0 20 remove_watcher() i=0 2024-09-12T18:05:06.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.560+0000 7f7e0c2cc9c0 2 removed watcher, disabling cache 2024-09-12T18:05:06.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.564+0000 7f7e0c2cc9c0 20 remove_watcher() i=1 2024-09-12T18:05:06.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.564+0000 7f7e0c2cc9c0 20 remove_watcher() i=2 2024-09-12T18:05:06.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.568+0000 7f7e0c2cc9c0 20 remove_watcher() i=3 2024-09-12T18:05:06.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.568+0000 7f7e0c2cc9c0 20 remove_watcher() i=4 2024-09-12T18:05:06.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.572+0000 7f7e0c2cc9c0 20 remove_watcher() i=5 2024-09-12T18:05:06.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.572+0000 7f7e0c2cc9c0 20 remove_watcher() i=6 2024-09-12T18:05:06.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.576+0000 7f7e0c2cc9c0 20 remove_watcher() i=7 2024-09-12T18:05:06.592 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:06.593 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:06.593 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-commit-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:05:06.593 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:06.594 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:06.594 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:06.631 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:06.631 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:06.691 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:05:06.726 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:06.727 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:06.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.764+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.768+0000 7f4b4c0b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.768+0000 7f4b4c0b29c0 20 realm 2024-09-12T18:05:06.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.768+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.768+0000 7f4b4c0b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.768+0000 7f4b4c0b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:06.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.768+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.768+0000 7f4b4c0b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.768+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.772+0000 7f4b4c0b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:06.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.772+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.772+0000 7f4b4c0b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:06.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.772+0000 7f4b4c0b29c0 20 searching for the correct realm 2024-09-12T18:05:06.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.776+0000 7f4b49bb8640 0 -- 172.21.15.97:0/1315358407 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f4b44020040 msgr2=0x7f4b44031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:06.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.784+0000 7f4b49bb8640 0 -- 172.21.15.97:0/1315358407 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x558a2a122f30 msgr2=0x558a2a125340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:06.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.788+0000 7f4b4c0b29c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:06.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.788+0000 7f4b4c0b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:06.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.788+0000 7f4b4c0b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:06.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.788+0000 7f4b4c0b29c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:06.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.788+0000 7f4b4c0b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:06.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.788+0000 7f4b4c0b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:06.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.788+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.788+0000 7f4b4c0b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.788+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.788+0000 7f4b4c0b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:06.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.788+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:06.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 20 zone default found 2024-09-12T18:05:06.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 4 Realm: () 2024-09-12T18:05:06.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:06.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:06.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:06.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 20 zonegroup default 2024-09-12T18:05:06.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:06.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 20 started sync module instance, tier type = 2024-09-12T18:05:06.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.792+0000 7f4b4c0b29c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:06.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.812+0000 7f4b4c0b29c0 20 add_watcher() i=0 2024-09-12T18:05:06.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.812+0000 7f4b4c0b29c0 20 add_watcher() i=1 2024-09-12T18:05:06.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.812+0000 7f4b4c0b29c0 20 add_watcher() i=2 2024-09-12T18:05:06.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.812+0000 7f4b4c0b29c0 20 add_watcher() i=3 2024-09-12T18:05:06.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.812+0000 7f4b4c0b29c0 20 add_watcher() i=4 2024-09-12T18:05:06.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.812+0000 7f4b4c0b29c0 20 add_watcher() i=5 2024-09-12T18:05:06.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.812+0000 7f4b4c0b29c0 20 add_watcher() i=6 2024-09-12T18:05:06.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.812+0000 7f4b4c0b29c0 20 add_watcher() i=7 2024-09-12T18:05:06.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.812+0000 7f4b4c0b29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:06.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.816+0000 7f49fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:06.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.816+0000 7f4b4c0b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:06.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.816+0000 7f4b4c0b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:06.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.816+0000 7f4b4c0b29c0 5 note: GC not initialized 2024-09-12T18:05:06.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.816+0000 7f49fa7fc640 20 reqs_thread_entry: start 2024-09-12T18:05:06.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.816+0000 7f4b4c0b29c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:06.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.816+0000 7f4b4c0b29c0 20 Filter name: none 2024-09-12T18:05:06.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.816+0000 7f496bfff640 20 reqs_thread_entry: start 2024-09-12T18:05:06.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.816+0000 7f4b4c0b29c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T18:05:06.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.816+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:06.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T18:05:06.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T18:05:06.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 : miss 2024-09-12T18:05:06.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:06.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:05:06.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:06.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 2024-09-12T18:05:06.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.820+0000 7f4b4c0b29c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:05:06.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4b4c0b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4b4c0b29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4b4c0b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4b4c0b29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30, ofs0, ns] 2024-09-12T18:05:06.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4a2cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431634 cookie 94051899713952 notifier 7227 bl.length()=931 2024-09-12T18:05:06.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4a2cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4a2cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4a2cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): orig_sources= new_sources= 2024-09-12T18:05:06.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): potential sources added=[] removed=[] 2024-09-12T18:05:06.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): orig_dests= new_dests= 2024-09-12T18:05:06.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.836+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): potential dests added=[] removed=[] 2024-09-12T18:05:06.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.0 2024-09-12T18:05:06.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.0 2024-09-12T18:05:06.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.1 2024-09-12T18:05:06.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.1 2024-09-12T18:05:06.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.2 2024-09-12T18:05:06.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.2 2024-09-12T18:05:06.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.3 2024-09-12T18:05:06.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.3 2024-09-12T18:05:06.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.4 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.4 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.5 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.5 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.6 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.6 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.7 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.7 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.8 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.8 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.9 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.9 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.10 2024-09-12T18:05:06.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.10 2024-09-12T18:05:06.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.11 2024-09-12T18:05:06.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2.11 2024-09-12T18:05:06.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.848+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.0 2024-09-12T18:05:06.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.852+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1 2024-09-12T18:05:06.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.852+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2 2024-09-12T18:05:06.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.852+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.3 2024-09-12T18:05:06.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.856+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.4 2024-09-12T18:05:06.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.856+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.5 2024-09-12T18:05:06.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.856+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.6 2024-09-12T18:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.856+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.7 2024-09-12T18:05:06.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.860+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.8 2024-09-12T18:05:06.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.860+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.9 2024-09-12T18:05:06.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.860+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.10 2024-09-12T18:05:06.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.868+0000 7f4b4c0b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:06.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.868+0000 7f4b4c0b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 2024-09-12T18:05:06.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4b4c0b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4b4c0b29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4b4c0b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4b4c0b29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30, ofs0, ns] 2024-09-12T18:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4a2cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431635 cookie 94051899713952 notifier 7227 bl.length()=931 2024-09-12T18:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4a2cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4a2cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4a2cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): orig_sources= new_sources= 2024-09-12T18:05:06.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): potential sources added=[] removed=[] 2024-09-12T18:05:06.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): orig_dests= new_dests= 2024-09-12T18:05:06.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.872+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): potential dests added=[] removed=[] 2024-09-12T18:05:06.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.880+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.0 2024-09-12T18:05:06.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.880+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.1 2024-09-12T18:05:06.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.880+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.2 2024-09-12T18:05:06.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.884+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.3 2024-09-12T18:05:06.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.884+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.4 2024-09-12T18:05:06.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.884+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.5 2024-09-12T18:05:06.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.884+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.6 2024-09-12T18:05:06.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.888+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.7 2024-09-12T18:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.888+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.8 2024-09-12T18:05:06.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.888+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.9 2024-09-12T18:05:06.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.888+0000 7f4b4c0b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.30.10 2024-09-12T18:05:06.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.888+0000 7f4b4c0b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:06.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.888+0000 7f4b4c0b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 2024-09-12T18:05:06.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.892+0000 7f4b4c0b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.892+0000 7f4b4c0b29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.892+0000 7f4b4c0b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.892+0000 7f4b4c0b29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30, ofs0, ns] 2024-09-12T18:05:06.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.892+0000 7f4a2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431636 cookie 94051899713952 notifier 7227 bl.length()=899 2024-09-12T18:05:06.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.892+0000 7f4a2d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 info.flags=0x17 2024-09-12T18:05:06.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.892+0000 7f4a2d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.30 to cache LRU end 2024-09-12T18:05:06.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.892+0000 7f4a2d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:06.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.896+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): orig_sources= new_sources= 2024-09-12T18:05:06.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.896+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): potential sources added=[] removed=[] 2024-09-12T18:05:06.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.896+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): orig_dests= new_dests= 2024-09-12T18:05:06.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.896+0000 7f4b4c0b29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.30]): potential dests added=[] removed=[] 2024-09-12T18:05:06.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.904+0000 7f4b4c0b29c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:05:06.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.908+0000 7f49fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:06.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.912+0000 7f4b4c0b29c0 20 remove_watcher() i=0 2024-09-12T18:05:06.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.912+0000 7f4b4c0b29c0 2 removed watcher, disabling cache 2024-09-12T18:05:06.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.916+0000 7f4b4c0b29c0 20 remove_watcher() i=1 2024-09-12T18:05:06.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.916+0000 7f4b4c0b29c0 20 remove_watcher() i=2 2024-09-12T18:05:06.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.920+0000 7f4b4c0b29c0 20 remove_watcher() i=3 2024-09-12T18:05:06.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.920+0000 7f4b4c0b29c0 20 remove_watcher() i=4 2024-09-12T18:05:06.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.924+0000 7f4b4c0b29c0 20 remove_watcher() i=5 2024-09-12T18:05:06.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.928+0000 7f4b4c0b29c0 20 remove_watcher() i=6 2024-09-12T18:05:06.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:06.928+0000 7f4b4c0b29c0 20 remove_watcher() i=7 2024-09-12T18:05:06.948 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:05:06.978 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:06.978 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:07.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.020+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.020+0000 7f38307f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:07.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.020+0000 7f38307f79c0 20 realm 2024-09-12T18:05:07.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.020+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.020+0000 7f38307f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:07.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.020+0000 7f38307f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:07.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.020+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.024+0000 7f38307f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:07.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.024+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.024+0000 7f38307f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:07.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.024+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.024+0000 7f38307f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:07.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.024+0000 7f38307f79c0 20 searching for the correct realm 2024-09-12T18:05:07.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.028+0000 7f382dafc640 0 -- 172.21.15.97:0/21037019 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f382404e060 msgr2=0x7f3824071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:07.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.036+0000 7f382e2fd640 0 -- 172.21.15.97:0/21037019 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f382800f430 msgr2=0x7f382800f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:07.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:07.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:07.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:07.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:07.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:07.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:07.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:07.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:07.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:07.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 zone default found 2024-09-12T18:05:07.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 4 Realm: () 2024-09-12T18:05:07.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:07.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:07.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:07.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 zonegroup default 2024-09-12T18:05:07.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:07.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.044+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.048+0000 7f38307f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:07.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.048+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.048+0000 7f38307f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:07.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.048+0000 7f38307f79c0 20 started sync module instance, tier type = 2024-09-12T18:05:07.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.048+0000 7f38307f79c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:07.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.064+0000 7f38307f79c0 20 add_watcher() i=0 2024-09-12T18:05:07.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.064+0000 7f38307f79c0 20 add_watcher() i=1 2024-09-12T18:05:07.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.064+0000 7f38307f79c0 20 add_watcher() i=2 2024-09-12T18:05:07.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.064+0000 7f38307f79c0 20 add_watcher() i=3 2024-09-12T18:05:07.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.064+0000 7f38307f79c0 20 add_watcher() i=4 2024-09-12T18:05:07.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.064+0000 7f38307f79c0 20 add_watcher() i=5 2024-09-12T18:05:07.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.064+0000 7f38307f79c0 20 add_watcher() i=6 2024-09-12T18:05:07.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.068+0000 7f38307f79c0 20 add_watcher() i=7 2024-09-12T18:05:07.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.068+0000 7f38307f79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:07.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f36e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:07.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:07.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:07.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 5 note: GC not initialized 2024-09-12T18:05:07.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f365f7fe640 20 reqs_thread_entry: start 2024-09-12T18:05:07.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:07.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 20 Filter name: none 2024-09-12T18:05:07.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f365d7fa640 20 reqs_thread_entry: start 2024-09-12T18:05:07.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:07.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:07.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:07.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.072+0000 7f38307f79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:07.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.076+0000 7f38307f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:07.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.076+0000 7f38307f79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:07.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.076+0000 7f38307f79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:07.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.076+0000 7f36e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:07.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.080+0000 7f38307f79c0 20 remove_watcher() i=0 2024-09-12T18:05:07.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.080+0000 7f38307f79c0 2 removed watcher, disabling cache 2024-09-12T18:05:07.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.084+0000 7f38307f79c0 20 remove_watcher() i=1 2024-09-12T18:05:07.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.084+0000 7f38307f79c0 20 remove_watcher() i=2 2024-09-12T18:05:07.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.088+0000 7f38307f79c0 20 remove_watcher() i=3 2024-09-12T18:05:07.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.088+0000 7f38307f79c0 20 remove_watcher() i=4 2024-09-12T18:05:07.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.092+0000 7f38307f79c0 20 remove_watcher() i=5 2024-09-12T18:05:07.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.092+0000 7f38307f79c0 20 remove_watcher() i=6 2024-09-12T18:05:07.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:07.096+0000 7f38307f79c0 20 remove_watcher() i=7 2024-09-12T18:05:07.112 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:07.112 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:07.113 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-commit-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:05:07.113 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:07.114 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:07.114 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:07.136 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:07.136 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:07.677 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:07.680 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:08.053 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T18:05:08.053 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:08.055 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:08.055 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:08.193 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:08.193 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:08.280 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:08.280 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:08.372 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:08.373 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:08.467 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:08.467 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:08.564 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:08.564 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:08.660 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:08.660 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:08.752 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:08.753 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:08.853 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:08.854 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:08.967 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:08.967 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:09.067 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:09.067 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:09.163 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:09.163 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:09.255 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:09.255 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:09.352 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:09.352 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:09.448 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:09.449 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:09.542 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:09.543 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:09.638 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:09.638 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:09.834 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:09.834 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:09.928 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:09.929 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:10.019 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:10.019 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:10.111 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:10.111 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:10.204 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:05:10.236 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:10.236 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:10.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.280+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.280+0000 7fddc1bda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.280+0000 7fddc1bda9c0 20 realm 2024-09-12T18:05:10.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.280+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.284+0000 7fddc1bda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.284+0000 7fddc1bda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:10.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.284+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.284+0000 7fddc1bda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.284+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.284+0000 7fddc1bda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:10.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.284+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.284+0000 7fddc1bda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:10.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.284+0000 7fddc1bda9c0 20 searching for the correct realm 2024-09-12T18:05:10.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.292+0000 7fddbeedf640 0 -- 172.21.15.97:0/1240460392 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fddb4003070 msgr2=0x7fddb407da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:05:10.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.504+0000 7fddbeedf640 0 -- 172.21.15.97:0/1240460392 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x556ab609be40 msgr2=0x556ab609e300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:10.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.516+0000 7fddc1bda9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:10.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.516+0000 7fddc1bda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:10.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.516+0000 7fddc1bda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:10.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.516+0000 7fddc1bda9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:10.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.516+0000 7fddc1bda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:10.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.516+0000 7fddc1bda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:10.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.516+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.516+0000 7fddc1bda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.516+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:10.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:10.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 zone default found 2024-09-12T18:05:10.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 4 Realm: () 2024-09-12T18:05:10.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:10.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:10.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:10.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 zonegroup default 2024-09-12T18:05:10.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 started sync module instance, tier type = 2024-09-12T18:05:10.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.520+0000 7fddc1bda9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:10.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.544+0000 7fddc1bda9c0 20 add_watcher() i=0 2024-09-12T18:05:10.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.544+0000 7fddc1bda9c0 20 add_watcher() i=1 2024-09-12T18:05:10.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.544+0000 7fddc1bda9c0 20 add_watcher() i=2 2024-09-12T18:05:10.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.544+0000 7fddc1bda9c0 20 add_watcher() i=3 2024-09-12T18:05:10.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.544+0000 7fddc1bda9c0 20 add_watcher() i=4 2024-09-12T18:05:10.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.544+0000 7fddc1bda9c0 20 add_watcher() i=5 2024-09-12T18:05:10.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.544+0000 7fddc1bda9c0 20 add_watcher() i=6 2024-09-12T18:05:10.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.544+0000 7fddc1bda9c0 20 add_watcher() i=7 2024-09-12T18:05:10.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.544+0000 7fddc1bda9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:10.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.548+0000 7fdc75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:10.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.552+0000 7fddc1bda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:10.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.552+0000 7fddc1bda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:10.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.552+0000 7fddc1bda9c0 5 note: GC not initialized 2024-09-12T18:05:10.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.552+0000 7fdc74fe1640 20 reqs_thread_entry: start 2024-09-12T18:05:10.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.552+0000 7fddc1bda9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:10.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.552+0000 7fddc1bda9c0 20 Filter name: none 2024-09-12T18:05:10.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.552+0000 7fdbee7fc640 20 reqs_thread_entry: start 2024-09-12T18:05:10.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.552+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.552+0000 7fddc1bda9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:10.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.552+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.556+0000 7fddc1bda9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:10.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.556+0000 7fddc1bda9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:10.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.556+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.556+0000 7fddc1bda9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:10.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.556+0000 7fddc1bda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.556+0000 7fddc1bda9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:10.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.556+0000 7fddc1bda9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:10.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.560+0000 7fdc75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:10.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.564+0000 7fddc1bda9c0 20 remove_watcher() i=0 2024-09-12T18:05:10.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.564+0000 7fddc1bda9c0 2 removed watcher, disabling cache 2024-09-12T18:05:10.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.564+0000 7fddc1bda9c0 20 remove_watcher() i=1 2024-09-12T18:05:10.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.568+0000 7fddc1bda9c0 20 remove_watcher() i=2 2024-09-12T18:05:10.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.568+0000 7fddc1bda9c0 20 remove_watcher() i=3 2024-09-12T18:05:10.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.572+0000 7fddc1bda9c0 20 remove_watcher() i=4 2024-09-12T18:05:10.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.572+0000 7fddc1bda9c0 20 remove_watcher() i=5 2024-09-12T18:05:10.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.576+0000 7fddc1bda9c0 20 remove_watcher() i=6 2024-09-12T18:05:10.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.580+0000 7fddc1bda9c0 20 remove_watcher() i=7 2024-09-12T18:05:10.595 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:10.595 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:10.595 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-commit-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:05:10.596 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:10.596 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T18:05:10.632 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:10.632 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:10.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.676+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.676+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.676+0000 7f8fe9bfc9c0 20 realm 2024-09-12T18:05:10.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.676+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.676+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.676+0000 7f8fe9bfc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:10.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.676+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.676+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.676+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.680+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:10.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.680+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.680+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:10.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.680+0000 7f8fe9bfc9c0 20 searching for the correct realm 2024-09-12T18:05:10.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.684+0000 7f8fe6f01640 0 -- 172.21.15.97:0/1502115051 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f8fdc09aa00 msgr2=0x7f8fdc0639f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:10.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.692+0000 7f8fe7f03640 0 -- 172.21.15.97:0/1502115051 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x563a631ab7c0 msgr2=0x563a631adc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:05:10.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:10.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:10.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:10.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:10.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:10.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:10.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:10.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:10.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 zone default found 2024-09-12T18:05:10.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 4 Realm: () 2024-09-12T18:05:10.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:10.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:10.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:10.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 zonegroup default 2024-09-12T18:05:10.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.700+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.704+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.704+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.704+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.704+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.704+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.704+0000 7f8fe9bfc9c0 20 started sync module instance, tier type = 2024-09-12T18:05:10.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.704+0000 7f8fe9bfc9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:10.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.720+0000 7f8fe9bfc9c0 20 add_watcher() i=0 2024-09-12T18:05:10.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.720+0000 7f8fe9bfc9c0 20 add_watcher() i=1 2024-09-12T18:05:10.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.720+0000 7f8fe9bfc9c0 20 add_watcher() i=2 2024-09-12T18:05:10.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.720+0000 7f8fe9bfc9c0 20 add_watcher() i=3 2024-09-12T18:05:10.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.720+0000 7f8fe9bfc9c0 20 add_watcher() i=4 2024-09-12T18:05:10.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.720+0000 7f8fe9bfc9c0 20 add_watcher() i=5 2024-09-12T18:05:10.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.720+0000 7f8fe9bfc9c0 20 add_watcher() i=6 2024-09-12T18:05:10.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.724+0000 7f8fe9bfc9c0 20 add_watcher() i=7 2024-09-12T18:05:10.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.724+0000 7f8fe9bfc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:10.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8e9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:10.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:10.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:10.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 5 note: GC not initialized 2024-09-12T18:05:10.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8e9cfe1640 20 reqs_thread_entry: start 2024-09-12T18:05:10.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:10.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 20 Filter name: none 2024-09-12T18:05:10.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8e167fc640 20 reqs_thread_entry: start 2024-09-12T18:05:10.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T18:05:10.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:10.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T18:05:10.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T18:05:10.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 : miss 2024-09-12T18:05:10.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:10.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 info.flags=0x17 2024-09-12T18:05:10.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 to cache LRU end 2024-09-12T18:05:10.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:10.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:10.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.728+0000 7f8fe9bfc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 2024-09-12T18:05:10.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.740+0000 7f8fe9bfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 info.flags=0x17 2024-09-12T18:05:10.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.740+0000 7f8fe9bfc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 to cache LRU end 2024-09-12T18:05:10.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.740+0000 7f8fe9bfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:10.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.740+0000 7f8fe9bfc9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31, ofs0, ns] 2024-09-12T18:05:10.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.740+0000 7f8eca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431641 cookie 94808770792000 notifier 6857 bl.length()=931 2024-09-12T18:05:10.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.740+0000 7f8eca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 info.flags=0x17 2024-09-12T18:05:10.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.740+0000 7f8eca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 to cache LRU end 2024-09-12T18:05:10.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.740+0000 7f8eca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:10.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.744+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): orig_sources= new_sources= 2024-09-12T18:05:10.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.744+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): potential sources added=[] removed=[] 2024-09-12T18:05:10.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.744+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): orig_dests= new_dests= 2024-09-12T18:05:10.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.744+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): potential dests added=[] removed=[] 2024-09-12T18:05:10.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.0 2024-09-12T18:05:10.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.0 2024-09-12T18:05:10.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.1 2024-09-12T18:05:10.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.1 2024-09-12T18:05:10.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.2 2024-09-12T18:05:10.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.2 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.3 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.3 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.4 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.4 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.5 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.5 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.6 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.6 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.7 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.7 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.8 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.8 2024-09-12T18:05:10.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.9 2024-09-12T18:05:10.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.9 2024-09-12T18:05:10.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.10 2024-09-12T18:05:10.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.10 2024-09-12T18:05:10.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.11 2024-09-12T18:05:10.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1.11 2024-09-12T18:05:10.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.0 2024-09-12T18:05:10.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1 2024-09-12T18:05:10.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.2 2024-09-12T18:05:10.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.756+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.3 2024-09-12T18:05:10.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.760+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.4 2024-09-12T18:05:10.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.760+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.5 2024-09-12T18:05:10.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.760+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.6 2024-09-12T18:05:10.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.760+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.7 2024-09-12T18:05:10.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.764+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.8 2024-09-12T18:05:10.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.764+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.9 2024-09-12T18:05:10.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.764+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.10 2024-09-12T18:05:10.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.772+0000 7f8fe9bfc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:10.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.772+0000 7f8fe9bfc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 2024-09-12T18:05:10.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.772+0000 7f8fe9bfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 info.flags=0x17 2024-09-12T18:05:10.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.772+0000 7f8fe9bfc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 to cache LRU end 2024-09-12T18:05:10.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.772+0000 7f8fe9bfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:10.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.772+0000 7f8fe9bfc9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31, ofs0, ns] 2024-09-12T18:05:10.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.772+0000 7f8eca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431642 cookie 94808770792000 notifier 6857 bl.length()=931 2024-09-12T18:05:10.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.772+0000 7f8eca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 info.flags=0x17 2024-09-12T18:05:10.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.772+0000 7f8eca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 to cache LRU end 2024-09-12T18:05:10.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.772+0000 7f8eca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:10.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.776+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): orig_sources= new_sources= 2024-09-12T18:05:10.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.776+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): potential sources added=[] removed=[] 2024-09-12T18:05:10.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.776+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): orig_dests= new_dests= 2024-09-12T18:05:10.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.776+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): potential dests added=[] removed=[] 2024-09-12T18:05:10.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.780+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.0 2024-09-12T18:05:10.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.780+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.1 2024-09-12T18:05:10.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.784+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.2 2024-09-12T18:05:10.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.784+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.3 2024-09-12T18:05:10.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.784+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.4 2024-09-12T18:05:10.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.784+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.5 2024-09-12T18:05:10.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.784+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.6 2024-09-12T18:05:10.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.784+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.7 2024-09-12T18:05:10.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.788+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.8 2024-09-12T18:05:10.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.788+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.9 2024-09-12T18:05:10.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.788+0000 7f8fe9bfc9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.31.10 2024-09-12T18:05:10.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.788+0000 7f8fe9bfc9c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T18:05:10.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.788+0000 7f8fe9bfc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:10.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.788+0000 7f8fe9bfc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 2024-09-12T18:05:10.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.792+0000 7f8fe9bfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 info.flags=0x17 2024-09-12T18:05:10.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.792+0000 7f8fe9bfc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 to cache LRU end 2024-09-12T18:05:10.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.792+0000 7f8fe9bfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:10.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.792+0000 7f8fe9bfc9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31, ofs0, ns] 2024-09-12T18:05:10.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.792+0000 7f8ecaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431643 cookie 94808770792000 notifier 6857 bl.length()=899 2024-09-12T18:05:10.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.792+0000 7f8ecaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 info.flags=0x17 2024-09-12T18:05:10.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.792+0000 7f8ecaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.31 to cache LRU end 2024-09-12T18:05:10.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.792+0000 7f8ecaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:10.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.796+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): orig_sources= new_sources= 2024-09-12T18:05:10.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.796+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): potential sources added=[] removed=[] 2024-09-12T18:05:10.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.796+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): orig_dests= new_dests= 2024-09-12T18:05:10.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.796+0000 7f8fe9bfc9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.31]): potential dests added=[] removed=[] 2024-09-12T18:05:10.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.800+0000 7f8fe9bfc9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:05:10.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.804+0000 7f8e9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:10.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.808+0000 7f8fe9bfc9c0 20 remove_watcher() i=0 2024-09-12T18:05:10.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.808+0000 7f8fe9bfc9c0 2 removed watcher, disabling cache 2024-09-12T18:05:10.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.808+0000 7f8fe9bfc9c0 20 remove_watcher() i=1 2024-09-12T18:05:10.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.812+0000 7f8fe9bfc9c0 20 remove_watcher() i=2 2024-09-12T18:05:10.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.812+0000 7f8fe9bfc9c0 20 remove_watcher() i=3 2024-09-12T18:05:10.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.816+0000 7f8fe9bfc9c0 20 remove_watcher() i=4 2024-09-12T18:05:10.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.820+0000 7f8fe9bfc9c0 20 remove_watcher() i=5 2024-09-12T18:05:10.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.820+0000 7f8fe9bfc9c0 20 remove_watcher() i=6 2024-09-12T18:05:10.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.824+0000 7f8fe9bfc9c0 20 remove_watcher() i=7 2024-09-12T18:05:10.844 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:05:10.874 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:10.874 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.916+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 20 realm 2024-09-12T18:05:10.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:10.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:10.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:10.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.920+0000 7fafd09cc9c0 20 searching for the correct realm 2024-09-12T18:05:10.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.928+0000 7fafcdcd1640 0 -- 172.21.15.97:0/2077357029 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fafc4107c10 msgr2=0x7fafc4123a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:10.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.932+0000 7fafce4d2640 0 -- 172.21.15.97:0/2077357029 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fafc800e040 msgr2=0x7fafc8021980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:05:10.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:10.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:10.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:10.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:10.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:10.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:10.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:10.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 zone default found 2024-09-12T18:05:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 4 Realm: () 2024-09-12T18:05:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 zonegroup default 2024-09-12T18:05:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.940+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.944+0000 7fafd09cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.944+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.944+0000 7fafd09cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.944+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.944+0000 7fafd09cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.944+0000 7fafd09cc9c0 20 started sync module instance, tier type = 2024-09-12T18:05:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.944+0000 7fafd09cc9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:10.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.960+0000 7fafd09cc9c0 20 add_watcher() i=0 2024-09-12T18:05:10.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.960+0000 7fafd09cc9c0 20 add_watcher() i=1 2024-09-12T18:05:10.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.960+0000 7fafd09cc9c0 20 add_watcher() i=2 2024-09-12T18:05:10.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.960+0000 7fafd09cc9c0 20 add_watcher() i=3 2024-09-12T18:05:10.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.960+0000 7fafd09cc9c0 20 add_watcher() i=4 2024-09-12T18:05:10.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.960+0000 7fafd09cc9c0 20 add_watcher() i=5 2024-09-12T18:05:10.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.960+0000 7fafd09cc9c0 20 add_watcher() i=6 2024-09-12T18:05:10.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.964+0000 7fafd09cc9c0 20 add_watcher() i=7 2024-09-12T18:05:10.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.964+0000 7fafd09cc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:10.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fae84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:10.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:10.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:10.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 5 note: GC not initialized 2024-09-12T18:05:10.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fadff7fe640 20 reqs_thread_entry: start 2024-09-12T18:05:10.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:10.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 Filter name: none 2024-09-12T18:05:10.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fadfd7fa640 20 reqs_thread_entry: start 2024-09-12T18:05:10.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:10.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:10.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:10.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:10.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.968+0000 7fafd09cc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:10.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.972+0000 7fafd09cc9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:10.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.972+0000 7fafd09cc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:10.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.972+0000 7fae84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:10.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.976+0000 7fafd09cc9c0 20 remove_watcher() i=0 2024-09-12T18:05:10.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.976+0000 7fafd09cc9c0 2 removed watcher, disabling cache 2024-09-12T18:05:10.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.980+0000 7fafd09cc9c0 20 remove_watcher() i=1 2024-09-12T18:05:10.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.980+0000 7fafd09cc9c0 20 remove_watcher() i=2 2024-09-12T18:05:10.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.984+0000 7fafd09cc9c0 20 remove_watcher() i=3 2024-09-12T18:05:10.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.984+0000 7fafd09cc9c0 20 remove_watcher() i=4 2024-09-12T18:05:10.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.988+0000 7fafd09cc9c0 20 remove_watcher() i=5 2024-09-12T18:05:10.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.992+0000 7fafd09cc9c0 20 remove_watcher() i=6 2024-09-12T18:05:10.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:10.992+0000 7fafd09cc9c0 20 remove_watcher() i=7 2024-09-12T18:05:11.010 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:11.010 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:11.010 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-commit-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T18:05:11.010 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:11.011 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:11.011 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:11.031 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:11.032 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:11.551 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:11.551 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:11.935 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T18:05:11.936 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:11.938 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:11.939 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:12.067 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:12.067 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:12.158 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:12.158 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:12.259 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:12.260 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:12.358 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:12.358 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:12.453 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:12.453 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:12.547 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:12.547 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:12.640 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:12.640 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:12.741 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:12.741 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:12.834 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:12.834 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:12.933 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:12.933 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:13.030 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:13.030 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:13.125 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:13.125 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:13.222 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:13.222 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:13.321 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:13.321 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:13.418 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:13.419 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:13.518 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:13.519 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:13.620 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:13.620 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:13.718 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:13.718 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:13.810 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:13.810 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:13.914 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:13.914 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:14.026 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:14.026 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:14.119 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T18:05:14.153 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:14.153 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:14.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.196+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.196+0000 7f9f97deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.196+0000 7f9f97deb9c0 20 realm 2024-09-12T18:05:14.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.196+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.196+0000 7f9f97deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.196+0000 7f9f97deb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:14.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.196+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.200+0000 7f9f97deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.200+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.200+0000 7f9f97deb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.200+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.200+0000 7f9f97deb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:14.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.200+0000 7f9f97deb9c0 20 searching for the correct realm 2024-09-12T18:05:14.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.208+0000 7f9f960f2640 0 -- 172.21.15.97:0/899196810 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f9f8c037070 msgr2=0x7f9f8c037450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.212+0000 7f9f958f1640 0 -- 172.21.15.97:0/899196810 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f9f90046040 msgr2=0x7f9f90017420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:14.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:14.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:14.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:14.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:14.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:14.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:14.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 zone default found 2024-09-12T18:05:14.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 4 Realm: () 2024-09-12T18:05:14.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:14.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:14.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:14.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 zonegroup default 2024-09-12T18:05:14.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.220+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.224+0000 7f9f97deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.224+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.224+0000 7f9f97deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.224+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.224+0000 7f9f97deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.224+0000 7f9f97deb9c0 20 started sync module instance, tier type = 2024-09-12T18:05:14.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.224+0000 7f9f97deb9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:14.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.244+0000 7f9f97deb9c0 20 add_watcher() i=0 2024-09-12T18:05:14.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.244+0000 7f9f97deb9c0 20 add_watcher() i=1 2024-09-12T18:05:14.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.244+0000 7f9f97deb9c0 20 add_watcher() i=2 2024-09-12T18:05:14.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.244+0000 7f9f97deb9c0 20 add_watcher() i=3 2024-09-12T18:05:14.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.244+0000 7f9f97deb9c0 20 add_watcher() i=4 2024-09-12T18:05:14.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.244+0000 7f9f97deb9c0 20 add_watcher() i=5 2024-09-12T18:05:14.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.244+0000 7f9f97deb9c0 20 add_watcher() i=6 2024-09-12T18:05:14.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.244+0000 7f9f97deb9c0 20 add_watcher() i=7 2024-09-12T18:05:14.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.244+0000 7f9f97deb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:14.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.248+0000 7f9e477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.248+0000 7f9f97deb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.248+0000 7f9f97deb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.248+0000 7f9f97deb9c0 5 note: GC not initialized 2024-09-12T18:05:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.248+0000 7f9e467fc640 20 reqs_thread_entry: start 2024-09-12T18:05:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.248+0000 7f9f97deb9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.248+0000 7f9f97deb9c0 20 Filter name: none 2024-09-12T18:05:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.248+0000 7f9db7fff640 20 reqs_thread_entry: start 2024-09-12T18:05:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.248+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.252+0000 7f9f97deb9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:14.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.252+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.252+0000 7f9f97deb9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:14.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.252+0000 7f9f97deb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:14.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.252+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.252+0000 7f9f97deb9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:14.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.252+0000 7f9f97deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.256+0000 7f9f97deb9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:14.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.256+0000 7f9f97deb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:14.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.256+0000 7f9e477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:14.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.260+0000 7f9f97deb9c0 20 remove_watcher() i=0 2024-09-12T18:05:14.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.260+0000 7f9f97deb9c0 2 removed watcher, disabling cache 2024-09-12T18:05:14.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.264+0000 7f9f97deb9c0 20 remove_watcher() i=1 2024-09-12T18:05:14.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.264+0000 7f9f97deb9c0 20 remove_watcher() i=2 2024-09-12T18:05:14.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.268+0000 7f9f97deb9c0 20 remove_watcher() i=3 2024-09-12T18:05:14.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.268+0000 7f9f97deb9c0 20 remove_watcher() i=4 2024-09-12T18:05:14.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.272+0000 7f9f97deb9c0 20 remove_watcher() i=5 2024-09-12T18:05:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.272+0000 7f9f97deb9c0 20 remove_watcher() i=6 2024-09-12T18:05:14.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.276+0000 7f9f97deb9c0 20 remove_watcher() i=7 2024-09-12T18:05:14.294 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.294 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:14.294 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-commit-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:05:14.294 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.294 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T18:05:14.326 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:14.326 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:14.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 realm 2024-09-12T18:05:14.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.372+0000 7f87b62b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:14.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:14.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 searching for the correct realm 2024-09-12T18:05:14.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.380+0000 7f87b3db8640 0 -- 172.21.15.97:0/1495637206 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f87a4044040 msgr2=0x7f87a400c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.384+0000 7f87b3db8640 0 -- 172.21.15.97:0/1495637206 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x555df7c0f030 msgr2=0x555df7c11460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:14.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:14.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:14.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:14.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:14.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:14.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:14.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 zone default found 2024-09-12T18:05:14.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 4 Realm: () 2024-09-12T18:05:14.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:14.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:14.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:14.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 zonegroup default 2024-09-12T18:05:14.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 started sync module instance, tier type = 2024-09-12T18:05:14.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:14.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=0 2024-09-12T18:05:14.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=1 2024-09-12T18:05:14.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=2 2024-09-12T18:05:14.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=3 2024-09-12T18:05:14.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=4 2024-09-12T18:05:14.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=5 2024-09-12T18:05:14.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=6 2024-09-12T18:05:14.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=7 2024-09-12T18:05:14.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.412+0000 7f87b62b29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:14.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.416+0000 7f8669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:14.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.416+0000 7f87b62b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:14.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.416+0000 7f87b62b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:14.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 note: GC not initialized 2024-09-12T18:05:14.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.416+0000 7f8668fe1640 20 reqs_thread_entry: start 2024-09-12T18:05:14.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:14.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 Filter name: none 2024-09-12T18:05:14.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f85e27fc640 20 reqs_thread_entry: start 2024-09-12T18:05:14.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:05:14.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:14.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:05:14.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:05:14.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 : miss 2024-09-12T18:05:14.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:14.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:14.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 2024-09-12T18:05:14.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32, ofs0, ns] 2024-09-12T18:05:14.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 93862076940336 notifier 6908 bl.length()=931 2024-09-12T18:05:14.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_sources= new_sources= 2024-09-12T18:05:14.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential sources added=[] removed=[] 2024-09-12T18:05:14.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_dests= new_dests= 2024-09-12T18:05:14.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential dests added=[] removed=[] 2024-09-12T18:05:14.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.0 2024-09-12T18:05:14.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.0 2024-09-12T18:05:14.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.1 2024-09-12T18:05:14.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.1 2024-09-12T18:05:14.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.2 2024-09-12T18:05:14.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.2 2024-09-12T18:05:14.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.3 2024-09-12T18:05:14.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.3 2024-09-12T18:05:14.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.4 2024-09-12T18:05:14.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.4 2024-09-12T18:05:14.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.5 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.5 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.6 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.6 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.7 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.7 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.8 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.8 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.9 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.9 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.10 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.10 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.11 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.11 2024-09-12T18:05:14.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.0 2024-09-12T18:05:14.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1 2024-09-12T18:05:14.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.2 2024-09-12T18:05:14.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.3 2024-09-12T18:05:14.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.4 2024-09-12T18:05:14.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.5 2024-09-12T18:05:14.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.6 2024-09-12T18:05:14.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.7 2024-09-12T18:05:14.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.456+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.8 2024-09-12T18:05:14.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.456+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.9 2024-09-12T18:05:14.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.456+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.10 2024-09-12T18:05:14.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:14.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 2024-09-12T18:05:14.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32, ofs0, ns] 2024-09-12T18:05:14.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 93862076940336 notifier 6908 bl.length()=931 2024-09-12T18:05:14.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_sources= new_sources= 2024-09-12T18:05:14.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential sources added=[] removed=[] 2024-09-12T18:05:14.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_dests= new_dests= 2024-09-12T18:05:14.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential dests added=[] removed=[] 2024-09-12T18:05:14.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.0 2024-09-12T18:05:14.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1 2024-09-12T18:05:14.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.2 2024-09-12T18:05:14.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.3 2024-09-12T18:05:14.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.4 2024-09-12T18:05:14.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.5 2024-09-12T18:05:14.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.6 2024-09-12T18:05:14.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.7 2024-09-12T18:05:14.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.8 2024-09-12T18:05:14.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.9 2024-09-12T18:05:14.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.10 2024-09-12T18:05:14.485 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f87b62b29c0 time 2024-09-12T18:05:14.487877+0000 2024-09-12T18:05:14.485 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f87b9b8c2eb] 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f87b9b8c49f] 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555df50540c1] 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555df5066467] 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f87b89f2d90] 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.484+0000 7f87b62b29c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f87b62b29c0 time 2024-09-12T18:05:14.487877+0000 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.486 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:14.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f87b9b8c2eb] 2024-09-12T18:05:14.487 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f87b9b8c49f] 2024-09-12T18:05:14.487 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555df50540c1] 2024-09-12T18:05:14.487 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555df5066467] 2024-09-12T18:05:14.487 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:05:14.487 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f87b89f2d90] 2024-09-12T18:05:14.487 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:05:14.487 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:05:14.487 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.487 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:05:14.487 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f87b62b29c0 thread_name:radosgw-admin 2024-09-12T18:05:14.502 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:14.502 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f87b8a0b520] 2024-09-12T18:05:14.502 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:05:14.502 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:05:14.502 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:05:14.502 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f87b9b8c345] 2024-09-12T18:05:14.502 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f87b9b8c49f] 2024-09-12T18:05:14.502 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555df50540c1] 2024-09-12T18:05:14.502 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555df5066467] 2024-09-12T18:05:14.503 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:05:14.503 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f87b89f2d90] 2024-09-12T18:05:14.503 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:05:14.503 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:05:14.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.484+0000 7f87b62b29c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:05:14.503 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f87b62b29c0 thread_name:radosgw-admin 2024-09-12T18:05:14.503 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f87b8a0b520] 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f87b9b8c345] 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f87b9b8c49f] 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555df50540c1] 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555df5066467] 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f87b89f2d90] 2024-09-12T18:05:14.504 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b21b20) adding con mode: secure 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command rotate-key hook 0x555df7b21c68 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-b con 0x555df79af430 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-a con 0x555df79b00c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:14.505 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-c con 0x555df7b24bb0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): authenticate will time out at 2743.761132s 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): get_auth_request con 0x555df79b00c0 auth_method 0 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): get_auth_request con 0x555df7b24bb0 auth_method 0 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.506 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): handle_auth_done global_id 7341 payload 824 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient: _finish_hunting 0 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:05:14.348+0000 7f87b35b7640 1 monclient: found mon.noname-a 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.507 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: dump: 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: _finish_auth 0 2024-09-12T18:05:14.508 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: _check_auth_tickets 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: dump: 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.509 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:05:14.348+0000 7f86a1e0b640 4 set_mon_vals no callback set 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 5 monclient: authenticate success, global_id 7341 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 1 librados: init done 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:05:14.352+0000 7f869bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:05:14.352+0000 7f869bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:05:14.352+0000 7f869bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:05:14.352+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f869c070b10 auth_method 0 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:05:14.352+0000 7f87b45b9640 10 monclient: get_auth_request con 0x555df7b49c30 auth_method 0 2024-09-12T18:05:14.510 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:05:14.352+0000 7f87b3db8640 10 monclient: get_auth_request con 0x555df7b6cc00 auth_method 0 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:05:14.352+0000 7f87b35b7640 10 monclient: get_auth_request con 0x555df7b71350 auth_method 0 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 10 monclient: build_initial_monmap 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 10 monclient: monmap: 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:14.511 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding auth protocol: cephx 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding auth protocol: cephx 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding auth protocol: cephx 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.512 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command objecter_requests cmddesc objecter_requests hook 0x555df7b79a30 EEXIST 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 10 monclient: init 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding auth protocol: cephx 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding auth protocol: cephx 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding auth protocol: cephx 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.513 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command rotate-key cmddesc rotate-key hook 0x555df7b747b0 EEXIST 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:14.514 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-c con 0x555df7b9dbe0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-b con 0x555df7b9d510 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-a con 0x555df7b9bef0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): authenticate will time out at 2743.772055s 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): get_auth_request con 0x555df7b9bef0 auth_method 0 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): get_auth_request con 0x555df7b9dbe0 auth_method 0 2024-09-12T18:05:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:05:14.360+0000 7f87b35b7640 10 monclient(hunting): get_auth_request con 0x555df7b9d510 auth_method 0 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:05:14.360+0000 7f87b35b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:05:14.360+0000 7f87b35b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:05:14.360+0000 7f87b35b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.516 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): handle_auth_done global_id 7344 payload 824 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient: _finish_hunting 0 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:05:14.360+0000 7f87b45b9640 1 monclient: found mon.noname-a 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: dump: 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.517 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: _finish_auth 0 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: _check_auth_tickets 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 monclient: authenticate success, global_id 7344 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: dump: 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.518 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:05:14.360+0000 7f87b4dba640 4 set_mon_vals no callback set 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:05:14.360+0000 7f86997fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:05:14.360+0000 7f86997fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.519 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:05:14.360+0000 7f86997fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f868c070a20 auth_method 0 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: get_monmap_and_config 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: build_initial_monmap 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: monmap: 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:14.520 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding auth protocol: cephx 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding auth protocol: cephx 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding auth protocol: cephx 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.521 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: init 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding auth protocol: cephx 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding auth protocol: cephx 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding auth protocol: cephx 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.522 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.523 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.523 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.523 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.523 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.523 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.523 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.523 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.523 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.523 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.523 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcdd05f638 EEXIST 2024-09-12T18:05:14.524 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:14.524 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:05:14.524 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-b con 0x555df7bf19e0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:14.524 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-c con 0x555df7becdd0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:14.524 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-a con 0x555df7bed750 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:14.524 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.524 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.524 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): authenticate will time out at 2743.776402s 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): get_auth_request con 0x555df7becdd0 auth_method 0 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): get_auth_request con 0x555df7bed750 auth_method 0 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.525 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_done global_id 6905 payload 274 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient: _finish_hunting 0 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:05:14.364+0000 7f87b35b7640 1 monclient: found mon.noname-c 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: dump: 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.526 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: _finish_auth 0 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: dump: 2024-09-12T18:05:14.527 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 monclient: authenticate success, global_id 6905 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: get_monmap_and_config success 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 4 set_mon_vals no callback set 2024-09-12T18:05:14.528 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: shutdown 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: build_initial_monmap 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: monmap: 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:14.529 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding auth protocol: cephx 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding auth protocol: cephx 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding auth protocol: cephx 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.530 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 1 librados: starting msgr at 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 1 librados: starting objecter 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command objecter_requests cmddesc objecter_requests hook 0x555df7bc37e0 EEXIST 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 1 librados: setting wanted keys 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 1 librados: calling monclient init 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: init 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding auth protocol: cephx 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding auth protocol: cephx 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding auth protocol: cephx 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.531 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command rotate-key cmddesc rotate-key hook 0x555df7b9fb48 EEXIST 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:14.532 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-b con 0x555df7becdd0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-c con 0x555df7bed750 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-a con 0x555df7bf19e0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): authenticate will time out at 2743.778974s 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): get_auth_request con 0x555df7bed750 auth_method 0 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.533 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): get_auth_request con 0x555df7bf19e0 auth_method 0 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_done global_id 6908 payload 824 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient: _finish_hunting 0 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:05:14.364+0000 7f87b35b7640 1 monclient: found mon.noname-c 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:14.534 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: dump: 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: _finish_auth 0 2024-09-12T18:05:14.535 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: _check_auth_tickets 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: dump: 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.536 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:05:14.364+0000 7f8692ffd640 4 set_mon_vals no callback set 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 5 monclient: authenticate success, global_id 6908 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 1 librados: init done 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command cr dump hook 0x555df7be7978 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:05:14.368+0000 7f86917fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:05:14.368+0000 7f86917fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:05:14.368+0000 7f86917fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:05:14.368+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f867c070ae0 auth_method 0 2024-09-12T18:05:14.537 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:05:14.368+0000 7f87b45b9640 10 monclient: get_auth_request con 0x555df7c0add0 auth_method 0 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 realm 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:05:14.372+0000 7f87b3db8640 10 monclient: get_auth_request con 0x555df7c0f030 auth_method 0 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:05:14.372+0000 7f87b35b7640 10 monclient: get_auth_request con 0x555df7c12890 auth_method 0 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:14.538 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 searching for the correct realm 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:05:14.376+0000 7f87b45b9640 10 monclient: get_auth_request con 0x7f87a80c1060 auth_method 0 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:05:14.376+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f87a4044040 auth_method 0 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:05:14.376+0000 7f87b35b7640 10 monclient: get_auth_request con 0x7f87a812c030 auth_method 0 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:05:14.380+0000 7f87b3db8640 0 -- 172.21.15.97:0/1495637206 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f87a4044040 msgr2=0x7f87a400c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:05:14.380+0000 7f86917fa640 1 client.6908.objecter ms_handle_reset 0x7f87a4044040 session 0x7f87a4030040 osd.0 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:05:14.380+0000 7f86917fa640 10 monclient: _renew_subs 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:05:14.380+0000 7f86917fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:05:14.380+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f867c080580 auth_method 0 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:05:14.380+0000 7f87b45b9640 10 monclient: get_auth_request con 0x7f87a4055410 auth_method 0 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:05:14.380+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f87ac061be0 auth_method 0 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:05:14.384+0000 7f87b3db8640 0 -- 172.21.15.97:0/1495637206 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x555df7c0f030 msgr2=0x555df7c11460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:05:14.384+0000 7f86917fa640 1 client.6908.objecter ms_handle_reset 0x555df7c0f030 session 0x555df7c0e9b0 osd.1 2024-09-12T18:05:14.539 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:05:14.384+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f87a4044040 auth_method 0 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 zone default found 2024-09-12T18:05:14.540 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 4 Realm: () 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 zonegroup default 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 started sync module instance, tier type = 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:14.541 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=0 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=1 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=2 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=3 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=4 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=5 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=6 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=7 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding auth protocol: cephx 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding auth protocol: cephx 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding auth protocol: cephx 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.542 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:05:14.416+0000 7f8669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:14.543 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command cache list hook 0x555df7bc03d0 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command cache inspect hook 0x555df7bc03d0 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command cache erase hook 0x555df7bc03d0 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command cache zap hook 0x555df7bc03d0 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 note: GC not initialized 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:05:14.416+0000 7f8668fe1640 20 reqs_thread_entry: start 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command sync trace show hook 0x7f87a80f6750 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command sync trace history hook 0x7f87a80f6750 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command sync trace active hook 0x7f87a80f6750 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command sync trace active_short hook 0x7f87a80f6750 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 Filter name: none 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:05:14.420+0000 7f85e27fc640 20 reqs_thread_entry: start 2024-09-12T18:05:14.544 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 : miss 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.545 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32, ofs0, ns] 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 93862076940336 notifier 6908 bl.length()=931 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_sources= new_sources= 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential sources added=[] removed=[] 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_dests= new_dests= 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential dests added=[] removed=[] 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.0 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.0 2024-09-12T18:05:14.546 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.1 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.1 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.2 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.2 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.3 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.3 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.4 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.4 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.5 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.5 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.6 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.6 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.7 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.7 2024-09-12T18:05:14.547 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.8 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.8 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.9 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.9 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.10 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.10 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.11 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.11 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.0 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.2 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.3 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.4 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.5 2024-09-12T18:05:14.548 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.6 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.7 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:05:14.456+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.8 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:05:14.456+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.9 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:05:14.456+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.10 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32, ofs0, ns] 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 93862076940336 notifier 6908 bl.length()=931 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.549 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_sources= new_sources= 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential sources added=[] removed=[] 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_dests= new_dests= 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential dests added=[] removed=[] 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.0 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.2 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.3 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.4 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.5 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.6 2024-09-12T18:05:14.550 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.7 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.8 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.9 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.10 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:05:14.484+0000 7f87b62b29c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f87b62b29c0 time 2024-09-12T18:05:14.487877+0000 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f87b9b8c2eb] 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f87b9b8c49f] 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555df50540c1] 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555df5066467] 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f87b89f2d90] 2024-09-12T18:05:14.551 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:05:14.484+0000 7f87b62b29c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f87b62b29c0 thread_name:radosgw-admin 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f87b8a0b520] 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f87b9b8c345] 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f87b9b8c49f] 2024-09-12T18:05:14.552 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555df50540c1] 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555df5066467] 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f87b89f2d90] 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:05:14.553 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:05:14.554 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:05:14.555 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:05:14.556 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:05:14.557 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:05:14.558 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:05:14.559 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 7f85e27fc640 / http_manager 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8668fe1640 / http_manager 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8669fe3640 / rgw_dt_lg_renew 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 7f86917fa640 / ms_dispatch 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8692ffd640 / io_context_pool 2024-09-12T18:05:14.560 INFO:tasks.workunit.client.0.smithi097.stderr: 7f86997fa640 / ms_dispatch 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: 7f869bfff640 / ms_dispatch 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: 7f86a1e0b640 / io_context_pool 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: 7f87b35b7640 / msgr-worker-2 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: 7f87b3db8640 / msgr-worker-1 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: 7f87b45b9640 / msgr-worker-0 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: 7f87b4dba640 / io_context_pool 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: 7f87b62b29c0 / radosgw-admin 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.114602.log 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b21b20) adding con mode: secure 2024-09-12T18:05:14.561 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.562 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.562 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command rotate-key hook 0x555df7b21c68 2024-09-12T18:05:14.562 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:14.562 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:05:14.562 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-b con 0x555df79af430 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:14.562 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-a con 0x555df79b00c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:14.562 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-c con 0x555df7b24bb0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:14.562 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.562 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient(hunting): authenticate will time out at 2743.761132s 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): get_auth_request con 0x555df79b00c0 auth_method 0 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): get_auth_request con 0x555df7b24bb0 auth_method 0 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.563 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:05:14.348+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient(hunting): handle_auth_done global_id 7341 payload 824 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient: _finish_hunting 0 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:05:14.348+0000 7f87b35b7640 1 monclient: found mon.noname-a 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:05:14.348+0000 7f87b35b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: dump: 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.564 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: _finish_auth 0 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: _check_auth_tickets 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:05:14.348+0000 7f869bfff640 10 monclient: dump: 2024-09-12T18:05:14.565 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:05:14.348+0000 7f86a1e0b640 4 set_mon_vals no callback set 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 5 monclient: authenticate success, global_id 7341 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.566 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:05:14.348+0000 7f87b62b29c0 1 librados: init done 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:05:14.352+0000 7f869bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:05:14.352+0000 7f869bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:05:14.352+0000 7f869bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:05:14.352+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f869c070b10 auth_method 0 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:05:14.352+0000 7f87b45b9640 10 monclient: get_auth_request con 0x555df7b49c30 auth_method 0 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:05:14.352+0000 7f87b3db8640 10 monclient: get_auth_request con 0x555df7b6cc00 auth_method 0 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:05:14.352+0000 7f87b35b7640 10 monclient: get_auth_request con 0x555df7b71350 auth_method 0 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 10 monclient: build_initial_monmap 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:14.567 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 10 monclient: monmap: 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding auth protocol: cephx 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding auth protocol: cephx 2024-09-12T18:05:14.568 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding auth protocol: cephx 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: crc 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b75fe0) adding con mode: secure 2024-09-12T18:05:14.569 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command objecter_requests cmddesc objecter_requests hook 0x555df7b79a30 EEXIST 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 10 monclient: init 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding auth protocol: cephx 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding auth protocol: cephx 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding auth protocol: cephx 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.570 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: crc 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b74668) adding con mode: secure 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command rotate-key cmddesc rotate-key hook 0x555df7b747b0 EEXIST 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:05:14.356+0000 7f87b62b29c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-c con 0x555df7b9dbe0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-b con 0x555df7b9d510 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-a con 0x555df7b9bef0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.571 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient(hunting): authenticate will time out at 2743.772055s 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): get_auth_request con 0x555df7b9bef0 auth_method 0 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): get_auth_request con 0x555df7b9dbe0 auth_method 0 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.572 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:05:14.360+0000 7f87b35b7640 10 monclient(hunting): get_auth_request con 0x555df7b9d510 auth_method 0 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:05:14.360+0000 7f87b35b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:05:14.360+0000 7f87b35b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:05:14.360+0000 7f87b35b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient(hunting): handle_auth_done global_id 7344 payload 824 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient: _finish_hunting 0 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:05:14.360+0000 7f87b45b9640 1 monclient: found mon.noname-a 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:05:14.360+0000 7f87b45b9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.573 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: dump: 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.574 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: _finish_auth 0 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: _check_auth_tickets 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 monclient: authenticate success, global_id 7344 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:05:14.360+0000 7f86997fa640 10 monclient: dump: 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.575 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:05:14.360+0000 7f87b4dba640 4 set_mon_vals no callback set 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:05:14.360+0000 7f86997fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:05:14.360+0000 7f86997fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:05:14.360+0000 7f86997fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:05:14.360+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f868c070a20 auth_method 0 2024-09-12T18:05:14.576 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: get_monmap_and_config 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: build_initial_monmap 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: monmap: 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.577 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding auth protocol: cephx 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding auth protocol: cephx 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding auth protocol: cephx 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.578 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: crc 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x555df7bbd4c0) adding con mode: secure 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 10 monclient: init 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding auth protocol: cephx 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding auth protocol: cephx 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding auth protocol: cephx 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.579 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: crc 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:05:14.360+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f4f0) adding con mode: secure 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcdd05f638 EEXIST 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-b con 0x555df7bf19e0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-c con 0x555df7becdd0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-a con 0x555df7bed750 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:14.580 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): authenticate will time out at 2743.776402s 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): get_auth_request con 0x555df7becdd0 auth_method 0 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): get_auth_request con 0x555df7bed750 auth_method 0 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.581 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_done global_id 6905 payload 274 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient: _finish_hunting 0 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:05:14.364+0000 7f87b35b7640 1 monclient: found mon.noname-c 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: dump: 2024-09-12T18:05:14.582 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: _finish_auth 0 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.583 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:05:14.364+0000 7f8692ffd640 10 monclient: dump: 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 monclient: authenticate success, global_id 6905 2024-09-12T18:05:14.584 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: get_monmap_and_config success 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 4 set_mon_vals no callback set 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: shutdown 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: build_initial_monmap 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: monmap: 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:14.585 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding auth protocol: cephx 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding auth protocol: cephx 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding auth protocol: cephx 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.586 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: crc 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7be3d30) adding con mode: secure 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 1 librados: starting msgr at 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 1 librados: starting objecter 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command objecter_requests cmddesc objecter_requests hook 0x555df7bc37e0 EEXIST 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 1 librados: setting wanted keys 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 1 librados: calling monclient init 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: init 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding auth protocol: cephx 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding auth protocol: cephx 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding auth protocol: cephx 2024-09-12T18:05:14.587 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: crc 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 AuthRegistry(0x555df7b9fa00) adding con mode: secure 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.588 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command rotate-key cmddesc rotate-key hook 0x555df7b9fb48 EEXIST 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-b con 0x555df7becdd0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-c con 0x555df7bed750 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): picked mon.noname-a con 0x555df7bf19e0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:05:14.364+0000 7f87b62b29c0 10 monclient(hunting): authenticate will time out at 2743.778974s 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): get_auth_request con 0x555df7bed750 auth_method 0 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.589 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): get_auth_request con 0x555df7bf19e0 auth_method 0 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:05:14.364+0000 7f87b45b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient(hunting): handle_auth_done global_id 6908 payload 824 2024-09-12T18:05:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient: _finish_hunting 0 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:05:14.364+0000 7f87b35b7640 1 monclient: found mon.noname-c 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:05:14.364+0000 7f87b35b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: dump: 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.591 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: _finish_auth 0 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: _check_auth_tickets 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:05:14.364+0000 7f86917fa640 10 monclient: dump: 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:14.592 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:05:14.364+0000 7f8692ffd640 4 set_mon_vals no callback set 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 5 monclient: authenticate success, global_id 6908 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 10 monclient: _renew_subs 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 1 librados: init done 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command cr dump hook 0x555df7be7978 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.593 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:05:14.368+0000 7f86917fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:05:14.368+0000 7f86917fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:05:14.368+0000 7f86917fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:05:14.368+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f867c070ae0 auth_method 0 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:05:14.368+0000 7f87b45b9640 10 monclient: get_auth_request con 0x555df7c0add0 auth_method 0 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 realm 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:05:14.368+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.594 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:05:14.372+0000 7f87b3db8640 10 monclient: get_auth_request con 0x555df7c0f030 auth_method 0 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:05:14.372+0000 7f87b35b7640 10 monclient: get_auth_request con 0x555df7c12890 auth_method 0 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:05:14.372+0000 7f87b62b29c0 20 searching for the correct realm 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:05:14.376+0000 7f87b45b9640 10 monclient: get_auth_request con 0x7f87a80c1060 auth_method 0 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:05:14.376+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f87a4044040 auth_method 0 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:05:14.376+0000 7f87b35b7640 10 monclient: get_auth_request con 0x7f87a812c030 auth_method 0 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:05:14.380+0000 7f87b3db8640 0 -- 172.21.15.97:0/1495637206 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f87a4044040 msgr2=0x7f87a400c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:05:14.380+0000 7f86917fa640 1 client.6908.objecter ms_handle_reset 0x7f87a4044040 session 0x7f87a4030040 osd.0 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:05:14.380+0000 7f86917fa640 10 monclient: _renew_subs 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:05:14.380+0000 7f86917fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:14.595 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:05:14.380+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f867c080580 auth_method 0 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:05:14.380+0000 7f87b45b9640 10 monclient: get_auth_request con 0x7f87a4055410 auth_method 0 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:05:14.380+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f87ac061be0 auth_method 0 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:05:14.384+0000 7f87b3db8640 0 -- 172.21.15.97:0/1495637206 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x555df7c0f030 msgr2=0x555df7c11460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:05:14.384+0000 7f86917fa640 1 client.6908.objecter ms_handle_reset 0x555df7c0f030 session 0x555df7c0e9b0 osd.1 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:05:14.384+0000 7f87b3db8640 10 monclient: get_auth_request con 0x7f87a4044040 auth_method 0 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.596 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 zone default found 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 4 Realm: () 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 zonegroup default 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.597 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 started sync module instance, tier type = 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:05:14.392+0000 7f87b62b29c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=0 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=1 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=2 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=3 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=4 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=5 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=6 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 20 add_watcher() i=7 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:05:14.412+0000 7f87b62b29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:14.598 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding auth protocol: cephx 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding auth protocol: cephx 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding auth protocol: cephx 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:05:14.416+0000 7f8669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.599 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: crc 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 AuthRegistry(0x7ffcdd05f9c0) adding con mode: secure 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command cache list hook 0x555df7bc03d0 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command cache inspect hook 0x555df7bc03d0 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command cache erase hook 0x555df7bc03d0 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command cache zap hook 0x555df7bc03d0 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 note: GC not initialized 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:05:14.416+0000 7f8668fe1640 20 reqs_thread_entry: start 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command sync trace show hook 0x7f87a80f6750 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command sync trace history hook 0x7f87a80f6750 2024-09-12T18:05:14.600 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:05:14.416+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command sync trace active hook 0x7f87a80f6750 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 5 asok(0x555df79172b0) register_command sync trace active_short hook 0x7f87a80f6750 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 Filter name: none 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:05:14.420+0000 7f85e27fc640 20 reqs_thread_entry: start 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 : miss 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:14.601 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:05:14.420+0000 7f87b62b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:05:14.432+0000 7f87b62b29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32, ofs0, ns] 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 93862076940336 notifier 6908 bl.length()=931 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:05:14.432+0000 7f8692ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.602 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_sources= new_sources= 2024-09-12T18:05:14.603 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential sources added=[] removed=[] 2024-09-12T18:05:14.603 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_dests= new_dests= 2024-09-12T18:05:14.603 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:05:14.436+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential dests added=[] removed=[] 2024-09-12T18:05:14.603 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.0 2024-09-12T18:05:14.603 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.0 2024-09-12T18:05:14.603 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.1 2024-09-12T18:05:14.603 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.1 2024-09-12T18:05:14.603 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.2 2024-09-12T18:05:14.603 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.2 2024-09-12T18:05:14.603 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.3 2024-09-12T18:05:14.604 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.3 2024-09-12T18:05:14.604 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.4 2024-09-12T18:05:14.604 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.4 2024-09-12T18:05:14.604 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.5 2024-09-12T18:05:14.604 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.5 2024-09-12T18:05:14.604 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.6 2024-09-12T18:05:14.604 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.6 2024-09-12T18:05:14.604 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.7 2024-09-12T18:05:14.604 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.7 2024-09-12T18:05:14.604 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.8 2024-09-12T18:05:14.604 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.8 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.9 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.9 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.10 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.10 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.11 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.11 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.0 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:05:14.448+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.2 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.3 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.4 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.5 2024-09-12T18:05:14.605 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.6 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:05:14.452+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.7 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:05:14.456+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.8 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:05:14.456+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.9 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:05:14.456+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.10 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:05:14.464+0000 7f87b62b29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32, ofs0, ns] 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 93862076940336 notifier 6908 bl.length()=931 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:14.606 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:05:14.468+0000 7f8692ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_sources= new_sources= 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential sources added=[] removed=[] 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_dests= new_dests= 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:05:14.468+0000 7f87b62b29c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential dests added=[] removed=[] 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.0 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.2 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.3 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.4 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.5 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:05:14.476+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.6 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.7 2024-09-12T18:05:14.607 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.8 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.9 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:05:14.480+0000 7f87b62b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.10 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:05:14.484+0000 7f87b62b29c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f87b62b29c0 time 2024-09-12T18:05:14.487877+0000 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f87b9b8c2eb] 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f87b9b8c49f] 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555df50540c1] 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555df5066467] 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f87b89f2d90] 2024-09-12T18:05:14.608 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:05:14.484+0000 7f87b62b29c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f87b62b29c0 thread_name:radosgw-admin 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f87b8a0b520] 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f87b9b8c345] 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f87b9b8c49f] 2024-09-12T18:05:14.609 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555df50540c1] 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555df5066467] 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f87b89f2d90] 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:05:14.610 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:05:14.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:05:14.612 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:05:14.613 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:05:14.614 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:05:14.615 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:05:14.616 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: 7f85e27fc640 / http_manager 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8668fe1640 / http_manager 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8669fe3640 / rgw_dt_lg_renew 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: 7f86917fa640 / ms_dispatch 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8692ffd640 / io_context_pool 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: 7f86997fa640 / ms_dispatch 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: 7f869bfff640 / ms_dispatch 2024-09-12T18:05:14.617 INFO:tasks.workunit.client.0.smithi097.stderr: 7f86a1e0b640 / io_context_pool 2024-09-12T18:05:14.618 INFO:tasks.workunit.client.0.smithi097.stderr: 7f87b35b7640 / msgr-worker-2 2024-09-12T18:05:14.618 INFO:tasks.workunit.client.0.smithi097.stderr: 7f87b3db8640 / msgr-worker-1 2024-09-12T18:05:14.618 INFO:tasks.workunit.client.0.smithi097.stderr: 7f87b45b9640 / msgr-worker-0 2024-09-12T18:05:14.618 INFO:tasks.workunit.client.0.smithi097.stderr: 7f87b4dba640 / io_context_pool 2024-09-12T18:05:14.618 INFO:tasks.workunit.client.0.smithi097.stderr: 7f87b62b29c0 / radosgw-admin 2024-09-12T18:05:14.618 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:05:14.618 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:05:14.618 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:05:14.489880Z_bf5c186c-256b-4001-806d-25477f2a4e6f/log 2024-09-12T18:05:14.618 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:05:14.618 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:05:14.618 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.564+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.568+0000 7f28e28299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.568+0000 7f28e28299c0 20 realm 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.568+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.568+0000 7f28e28299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.568+0000 7f28e28299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.568+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.568+0000 7f28e28299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.568+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.568+0000 7f28e28299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.568+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.572+0000 7f28e28299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:14.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.572+0000 7f28e28299c0 20 searching for the correct realm 2024-09-12T18:05:14.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.576+0000 7f28dfb2e640 0 -- 172.21.15.97:0/3411461704 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f28d408ad60 msgr2=0x7f28d40621a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.788+0000 7f28e0b30640 0 -- 172.21.15.97:0/3411461704 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55818de14820 msgr2=0x55818de16c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:14.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.800+0000 7f28e28299c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:14.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.800+0000 7f28e28299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:14.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.800+0000 7f28e28299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:14.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.800+0000 7f28e28299c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:14.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.800+0000 7f28e28299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:14.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.800+0000 7f28e28299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:14.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.800+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.800+0000 7f28e28299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.800+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:14.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 zone default found 2024-09-12T18:05:14.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 4 Realm: () 2024-09-12T18:05:14.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:14.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:14.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:14.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 zonegroup default 2024-09-12T18:05:14.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 started sync module instance, tier type = 2024-09-12T18:05:14.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.804+0000 7f28e28299c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:14.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.828+0000 7f28e28299c0 20 add_watcher() i=0 2024-09-12T18:05:14.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.828+0000 7f28e28299c0 20 add_watcher() i=1 2024-09-12T18:05:14.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.828+0000 7f28e28299c0 20 add_watcher() i=2 2024-09-12T18:05:14.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.828+0000 7f28e28299c0 20 add_watcher() i=3 2024-09-12T18:05:14.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.828+0000 7f28e28299c0 20 add_watcher() i=4 2024-09-12T18:05:14.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.828+0000 7f28e28299c0 20 add_watcher() i=5 2024-09-12T18:05:14.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.828+0000 7f28e28299c0 20 add_watcher() i=6 2024-09-12T18:05:14.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.832+0000 7f28e28299c0 20 add_watcher() i=7 2024-09-12T18:05:14.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.832+0000 7f28e28299c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:14.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.836+0000 7f2796fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:14.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f28e28299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:14.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f28e28299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:14.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f28e28299c0 5 note: GC not initialized 2024-09-12T18:05:14.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f2795fdb640 20 reqs_thread_entry: start 2024-09-12T18:05:14.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f28e28299c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:14.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f28e28299c0 20 Filter name: none 2024-09-12T18:05:14.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f27077fe640 20 reqs_thread_entry: start 2024-09-12T18:05:14.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f28e28299c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:14.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f28e28299c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:05:14.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f28e28299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:14.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.840+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.844+0000 7f28e28299c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:14.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.844+0000 7f28e28299c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:14.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.844+0000 7f28e28299c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:05:14.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.844+0000 7f28e28299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:14.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.848+0000 7f2796fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:14.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.852+0000 7f28e28299c0 20 remove_watcher() i=0 2024-09-12T18:05:14.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.852+0000 7f28e28299c0 2 removed watcher, disabling cache 2024-09-12T18:05:14.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.852+0000 7f28e28299c0 20 remove_watcher() i=1 2024-09-12T18:05:14.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.856+0000 7f28e28299c0 20 remove_watcher() i=2 2024-09-12T18:05:14.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.856+0000 7f28e28299c0 20 remove_watcher() i=3 2024-09-12T18:05:14.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.860+0000 7f28e28299c0 20 remove_watcher() i=4 2024-09-12T18:05:14.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.860+0000 7f28e28299c0 20 remove_watcher() i=5 2024-09-12T18:05:14.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.864+0000 7f28e28299c0 20 remove_watcher() i=6 2024-09-12T18:05:14.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:14.868+0000 7f28e28299c0 20 remove_watcher() i=7 2024-09-12T18:05:14.886 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.886 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:14.886 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-commit-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:05:14.886 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:14.888 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:14.888 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:45.202 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:45.202 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:45.291 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:05:45.328 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:45.328 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:45.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.375+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.375+0000 7fd2f98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.375+0000 7fd2f98649c0 20 realm 2024-09-12T18:05:45.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.375+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.375+0000 7fd2f98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.375+0000 7fd2f98649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.375+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.375+0000 7fd2f98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.375+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.379+0000 7fd2f98649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:45.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.379+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.379+0000 7fd2f98649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:45.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.379+0000 7fd2f98649c0 20 searching for the correct realm 2024-09-12T18:05:45.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.383+0000 7fd2f7b6b640 0 -- 172.21.15.97:0/2369805468 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fd2e003f060 msgr2=0x7fd2e0063740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:05:45.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.391+0000 7fd2f736a640 0 -- 172.21.15.97:0/2369805468 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fd2f0060fc0 msgr2=0x7fd2f005fa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:45.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:45.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:45.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:45.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:45.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:45.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:45.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:45.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:45.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 zone default found 2024-09-12T18:05:45.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 4 Realm: () 2024-09-12T18:05:45.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:45.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:45.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:45.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 zonegroup default 2024-09-12T18:05:45.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.399+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.403+0000 7fd2f98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.403+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.403+0000 7fd2f98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.403+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.403+0000 7fd2f98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.403+0000 7fd2f98649c0 20 started sync module instance, tier type = 2024-09-12T18:05:45.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.403+0000 7fd2f98649c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:45.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.423+0000 7fd2f98649c0 20 add_watcher() i=0 2024-09-12T18:05:45.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.423+0000 7fd2f98649c0 20 add_watcher() i=1 2024-09-12T18:05:45.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.423+0000 7fd2f98649c0 20 add_watcher() i=2 2024-09-12T18:05:45.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.423+0000 7fd2f98649c0 20 add_watcher() i=3 2024-09-12T18:05:45.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.423+0000 7fd2f98649c0 20 add_watcher() i=4 2024-09-12T18:05:45.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.423+0000 7fd2f98649c0 20 add_watcher() i=5 2024-09-12T18:05:45.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.423+0000 7fd2f98649c0 20 add_watcher() i=6 2024-09-12T18:05:45.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.423+0000 7fd2f98649c0 20 add_watcher() i=7 2024-09-12T18:05:45.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.423+0000 7fd2f98649c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:45.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.427+0000 7fd1adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:45.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.427+0000 7fd2f98649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:45.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.427+0000 7fd2f98649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:45.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.427+0000 7fd2f98649c0 5 note: GC not initialized 2024-09-12T18:05:45.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.427+0000 7fd1acfe1640 20 reqs_thread_entry: start 2024-09-12T18:05:45.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.427+0000 7fd2f98649c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:45.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 20 Filter name: none 2024-09-12T18:05:45.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd1267fc640 20 reqs_thread_entry: start 2024-09-12T18:05:45.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:05:45.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:45.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:05:45.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:05:45.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 : miss 2024-09-12T18:05:45.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:45.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:45.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:45.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:45.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:45.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.431+0000 7fd2f98649c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 2024-09-12T18:05:45.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd2f98649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:45.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd2f98649c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:45.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd2f98649c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:45.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd2f98649c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32, ofs0, ns] 2024-09-12T18:05:45.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd1da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94275488850400 notifier 7389 bl.length()=931 2024-09-12T18:05:45.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd1da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:45.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd1da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:45.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd1da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:45.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_sources= new_sources= 2024-09-12T18:05:45.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential sources added=[] removed=[] 2024-09-12T18:05:45.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_dests= new_dests= 2024-09-12T18:05:45.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.443+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential dests added=[] removed=[] 2024-09-12T18:05:45.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.0 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.0 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.1 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.1 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.2 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.2 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.3 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.3 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.4 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.4 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.5 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.5 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.6 2024-09-12T18:05:45.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.6 2024-09-12T18:05:45.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.7 2024-09-12T18:05:45.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.7 2024-09-12T18:05:45.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.8 2024-09-12T18:05:45.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.8 2024-09-12T18:05:45.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.9 2024-09-12T18:05:45.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.9 2024-09-12T18:05:45.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.10 2024-09-12T18:05:45.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.10 2024-09-12T18:05:45.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.11 2024-09-12T18:05:45.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1.11 2024-09-12T18:05:45.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.0 2024-09-12T18:05:45.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.459+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1 2024-09-12T18:05:45.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.463+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.2 2024-09-12T18:05:45.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.463+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.3 2024-09-12T18:05:45.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.463+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.4 2024-09-12T18:05:45.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.463+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.5 2024-09-12T18:05:45.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.463+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.6 2024-09-12T18:05:45.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.467+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.7 2024-09-12T18:05:45.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.467+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.8 2024-09-12T18:05:45.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.467+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.9 2024-09-12T18:05:45.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.471+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.10 2024-09-12T18:05:45.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.475+0000 7fd2f98649c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:45.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.475+0000 7fd2f98649c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 2024-09-12T18:05:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.479+0000 7fd2f98649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.479+0000 7fd2f98649c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.479+0000 7fd2f98649c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.479+0000 7fd2f98649c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32, ofs0, ns] 2024-09-12T18:05:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.479+0000 7fd1da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 94275488850400 notifier 7389 bl.length()=931 2024-09-12T18:05:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.479+0000 7fd1da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:45.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.479+0000 7fd1da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:45.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.479+0000 7fd1da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:45.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.483+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_sources= new_sources= 2024-09-12T18:05:45.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.483+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential sources added=[] removed=[] 2024-09-12T18:05:45.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.483+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_dests= new_dests= 2024-09-12T18:05:45.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.483+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential dests added=[] removed=[] 2024-09-12T18:05:45.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.491+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.0 2024-09-12T18:05:45.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.491+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.1 2024-09-12T18:05:45.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.491+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.2 2024-09-12T18:05:45.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.491+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.3 2024-09-12T18:05:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.491+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.4 2024-09-12T18:05:45.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.491+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.5 2024-09-12T18:05:45.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.495+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.6 2024-09-12T18:05:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.495+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.7 2024-09-12T18:05:45.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.495+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.8 2024-09-12T18:05:45.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.495+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.9 2024-09-12T18:05:45.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.499+0000 7fd2f98649c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.32.10 2024-09-12T18:05:45.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.499+0000 7fd2f98649c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:45.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.499+0000 7fd2f98649c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 2024-09-12T18:05:45.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd2f98649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:45.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd2f98649c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:45.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd2f98649c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:45.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd2f98649c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32, ofs0, ns] 2024-09-12T18:05:45.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd1da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431597 cookie 94275488850400 notifier 7389 bl.length()=899 2024-09-12T18:05:45.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd1da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 info.flags=0x17 2024-09-12T18:05:45.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd1da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:98539659-fdaf-41ce-847d-239ff89323af.4641.32 to cache LRU end 2024-09-12T18:05:45.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd1da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:45.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_sources= new_sources= 2024-09-12T18:05:45.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential sources added=[] removed=[] 2024-09-12T18:05:45.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): orig_dests= new_dests= 2024-09-12T18:05:45.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.503+0000 7fd2f98649c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[98539659-fdaf-41ce-847d-239ff89323af.4641.32]): potential dests added=[] removed=[] 2024-09-12T18:05:45.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.511+0000 7fd2f98649c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:05:45.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.515+0000 7fd1adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:45.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.519+0000 7fd2f98649c0 20 remove_watcher() i=0 2024-09-12T18:05:45.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.519+0000 7fd2f98649c0 2 removed watcher, disabling cache 2024-09-12T18:05:45.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.523+0000 7fd2f98649c0 20 remove_watcher() i=1 2024-09-12T18:05:45.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.523+0000 7fd2f98649c0 20 remove_watcher() i=2 2024-09-12T18:05:45.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.527+0000 7fd2f98649c0 20 remove_watcher() i=3 2024-09-12T18:05:45.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.527+0000 7fd2f98649c0 20 remove_watcher() i=4 2024-09-12T18:05:45.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.531+0000 7fd2f98649c0 20 remove_watcher() i=5 2024-09-12T18:05:45.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.531+0000 7fd2f98649c0 20 remove_watcher() i=6 2024-09-12T18:05:45.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.535+0000 7fd2f98649c0 20 remove_watcher() i=7 2024-09-12T18:05:45.554 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T18:05:45.585 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:45.586 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:45.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.631+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.631+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.631+0000 7f3ce0a8f9c0 20 realm 2024-09-12T18:05:45.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.631+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.635+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.635+0000 7f3ce0a8f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:45.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.635+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.635+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.635+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.635+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:45.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.635+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.635+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:45.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.635+0000 7f3ce0a8f9c0 20 searching for the correct realm 2024-09-12T18:05:45.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.643+0000 7f3cde595640 0 -- 172.21.15.97:0/2952774815 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f3cd00c1750 msgr2=0x7f3cd00f74a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:45.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.647+0000 7f3cde595640 0 -- 172.21.15.97:0/2952774815 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55ba55f15430 msgr2=0x55ba55f17820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:45.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:45.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:45.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:45.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:45.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:45.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:45.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:45.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:45.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 zone default found 2024-09-12T18:05:45.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 4 Realm: () 2024-09-12T18:05:45.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:45.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:45.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:45.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 zonegroup default 2024-09-12T18:05:45.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.655+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.659+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.659+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.659+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.659+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.659+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:45.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.659+0000 7f3ce0a8f9c0 20 started sync module instance, tier type = 2024-09-12T18:05:45.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.659+0000 7f3ce0a8f9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:45.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.675+0000 7f3ce0a8f9c0 20 add_watcher() i=0 2024-09-12T18:05:45.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.675+0000 7f3ce0a8f9c0 20 add_watcher() i=1 2024-09-12T18:05:45.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.675+0000 7f3ce0a8f9c0 20 add_watcher() i=2 2024-09-12T18:05:45.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.675+0000 7f3ce0a8f9c0 20 add_watcher() i=3 2024-09-12T18:05:45.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.675+0000 7f3ce0a8f9c0 20 add_watcher() i=4 2024-09-12T18:05:45.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.675+0000 7f3ce0a8f9c0 20 add_watcher() i=5 2024-09-12T18:05:45.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.679+0000 7f3ce0a8f9c0 20 add_watcher() i=6 2024-09-12T18:05:45.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.679+0000 7f3ce0a8f9c0 20 add_watcher() i=7 2024-09-12T18:05:45.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.679+0000 7f3ce0a8f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:45.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.683+0000 7f3b94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:45.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.683+0000 7f3ce0a8f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:45.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.683+0000 7f3ce0a8f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:45.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.683+0000 7f3ce0a8f9c0 5 note: GC not initialized 2024-09-12T18:05:45.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.683+0000 7f3b0f7fe640 20 reqs_thread_entry: start 2024-09-12T18:05:45.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.683+0000 7f3ce0a8f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:45.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.683+0000 7f3ce0a8f9c0 20 Filter name: none 2024-09-12T18:05:45.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.683+0000 7f3b0d7fa640 20 reqs_thread_entry: start 2024-09-12T18:05:45.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.683+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.683+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:45.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.683+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.687+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:45.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.687+0000 7f3ce0a8f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:45.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.687+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.687+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:05:45.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.687+0000 7f3ce0a8f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:45.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.687+0000 7f3ce0a8f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:05:45.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.687+0000 7f3ce0a8f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:45.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.691+0000 7f3b94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:45.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.695+0000 7f3ce0a8f9c0 20 remove_watcher() i=0 2024-09-12T18:05:45.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.695+0000 7f3ce0a8f9c0 2 removed watcher, disabling cache 2024-09-12T18:05:45.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.695+0000 7f3ce0a8f9c0 20 remove_watcher() i=1 2024-09-12T18:05:45.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.699+0000 7f3ce0a8f9c0 20 remove_watcher() i=2 2024-09-12T18:05:45.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.699+0000 7f3ce0a8f9c0 20 remove_watcher() i=3 2024-09-12T18:05:45.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.703+0000 7f3ce0a8f9c0 20 remove_watcher() i=4 2024-09-12T18:05:45.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.703+0000 7f3ce0a8f9c0 20 remove_watcher() i=5 2024-09-12T18:05:45.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.707+0000 7f3ce0a8f9c0 20 remove_watcher() i=6 2024-09-12T18:05:45.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:45.711+0000 7f3ce0a8f9c0 20 remove_watcher() i=7 2024-09-12T18:05:45.724 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:45.725 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:45.725 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-commit-target-layout id: 98539659-fdaf-41ce-847d-239ff89323af.4641.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:05:45.725 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:45.726 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:45.726 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:45.748 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:45.749 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:46.288 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:46.288 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:46.673 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T18:05:46.673 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:46.676 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:46.676 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:46.810 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:46.810 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:46.897 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:46.897 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:46.999 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:47.000 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:47.101 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:47.101 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:47.193 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:47.193 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:47.344 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:47.344 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:47.438 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:47.438 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:47.530 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:47.530 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:47.626 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:47.626 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:47.726 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:47.727 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:47.822 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:47.822 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:47.918 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:47.919 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:48.012 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:48.012 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:48.109 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:48.109 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:48.211 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:48.211 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:48.308 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:48.308 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:48.410 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:48.410 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:48.502 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:48.598 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:48.598 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:48.697 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:48.697 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:48.792 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:48.792 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:48.885 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T18:05:48.919 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:48.919 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:48.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.967+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:48.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.967+0000 7fe62c3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:48.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.967+0000 7fe62c3349c0 20 realm 2024-09-12T18:05:48.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.967+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:48.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.967+0000 7fe62c3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:48.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.967+0000 7fe62c3349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:48.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.967+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:48.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.967+0000 7fe62c3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:48.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.967+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:48.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.971+0000 7fe62c3349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:48.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.971+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:48.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.971+0000 7fe62c3349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:48.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.971+0000 7fe62c3349c0 20 searching for the correct realm 2024-09-12T18:05:48.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.975+0000 7fe629e3a640 0 -- 172.21.15.97:0/3732967413 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fe61c029070 msgr2=0x7fe61c08aa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:48.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:48.979+0000 7fe629e3a640 0 -- 172.21.15.97:0/3732967413 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fe62401e970 msgr2=0x7fe624015430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:49.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:49.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:49.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:49.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:49.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:49.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:49.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:49.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:49.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 zone default found 2024-09-12T18:05:49.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 4 Realm: () 2024-09-12T18:05:49.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:49.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:49.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:49.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 zonegroup default 2024-09-12T18:05:49.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.199+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.203+0000 7fe62c3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.203+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.203+0000 7fe62c3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.203+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.203+0000 7fe62c3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.203+0000 7fe62c3349c0 20 started sync module instance, tier type = 2024-09-12T18:05:49.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.203+0000 7fe62c3349c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:49.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.223+0000 7fe62c3349c0 20 add_watcher() i=0 2024-09-12T18:05:49.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.223+0000 7fe62c3349c0 20 add_watcher() i=1 2024-09-12T18:05:49.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.223+0000 7fe62c3349c0 20 add_watcher() i=2 2024-09-12T18:05:49.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.223+0000 7fe62c3349c0 20 add_watcher() i=3 2024-09-12T18:05:49.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.223+0000 7fe62c3349c0 20 add_watcher() i=4 2024-09-12T18:05:49.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.223+0000 7fe62c3349c0 20 add_watcher() i=5 2024-09-12T18:05:49.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.227+0000 7fe62c3349c0 20 add_watcher() i=6 2024-09-12T18:05:49.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.227+0000 7fe62c3349c0 20 add_watcher() i=7 2024-09-12T18:05:49.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.227+0000 7fe62c3349c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:49.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.231+0000 7fe4db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:49.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.231+0000 7fe62c3349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:49.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.235+0000 7fe62c3349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:49.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.235+0000 7fe62c3349c0 5 note: GC not initialized 2024-09-12T18:05:49.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.235+0000 7fe4da7fc640 20 reqs_thread_entry: start 2024-09-12T18:05:49.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.235+0000 7fe62c3349c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:49.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.235+0000 7fe62c3349c0 20 Filter name: none 2024-09-12T18:05:49.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.235+0000 7fe44bfff640 20 reqs_thread_entry: start 2024-09-12T18:05:49.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.235+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.235+0000 7fe62c3349c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:49.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.235+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.239+0000 7fe62c3349c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:49.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.239+0000 7fe62c3349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:49.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.239+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.239+0000 7fe62c3349c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:49.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.239+0000 7fe62c3349c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.239+0000 7fe62c3349c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:49.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.239+0000 7fe62c3349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:49.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.243+0000 7fe4db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:49.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.247+0000 7fe62c3349c0 20 remove_watcher() i=0 2024-09-12T18:05:49.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.247+0000 7fe62c3349c0 2 removed watcher, disabling cache 2024-09-12T18:05:49.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.251+0000 7fe62c3349c0 20 remove_watcher() i=1 2024-09-12T18:05:49.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.251+0000 7fe62c3349c0 20 remove_watcher() i=2 2024-09-12T18:05:49.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.255+0000 7fe62c3349c0 20 remove_watcher() i=3 2024-09-12T18:05:49.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.255+0000 7fe62c3349c0 20 remove_watcher() i=4 2024-09-12T18:05:49.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.259+0000 7fe62c3349c0 20 remove_watcher() i=5 2024-09-12T18:05:49.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.259+0000 7fe62c3349c0 20 remove_watcher() i=6 2024-09-12T18:05:49.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.263+0000 7fe62c3349c0 20 remove_watcher() i=7 2024-09-12T18:05:49.279 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:49.279 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:49.279 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-do-reshard id: 98539659-fdaf-41ce-847d-239ff89323af.4641.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:05:49.279 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:49.280 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T18:05:49.316 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:49.316 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:49.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.359+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.363+0000 7f40588629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.363+0000 7f40588629c0 20 realm 2024-09-12T18:05:49.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.363+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.363+0000 7f40588629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.363+0000 7f40588629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:49.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.363+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.363+0000 7f40588629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.363+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.363+0000 7f40588629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:49.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.363+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.367+0000 7f40588629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:49.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.367+0000 7f40588629c0 20 searching for the correct realm 2024-09-12T18:05:49.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.371+0000 7f4056b69640 0 -- 172.21.15.97:0/3036838266 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f4040027040 msgr2=0x7f4040067a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:49.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.379+0000 7f4056368640 0 -- 172.21.15.97:0/3036838266 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f40500d2040 msgr2=0x7f40500b9450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:49.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.383+0000 7f40588629c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:49.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.383+0000 7f40588629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:49.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.383+0000 7f40588629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:49.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.383+0000 7f40588629c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:49.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.383+0000 7f40588629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:49.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.383+0000 7f40588629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:49.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.383+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.383+0000 7f40588629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.383+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.383+0000 7f40588629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:49.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.383+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:49.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 20 zone default found 2024-09-12T18:05:49.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 4 Realm: () 2024-09-12T18:05:49.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:49.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:49.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:49.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 20 zonegroup default 2024-09-12T18:05:49.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 20 started sync module instance, tier type = 2024-09-12T18:05:49.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.387+0000 7f40588629c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:49.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.407+0000 7f40588629c0 20 add_watcher() i=0 2024-09-12T18:05:49.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.407+0000 7f40588629c0 20 add_watcher() i=1 2024-09-12T18:05:49.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.407+0000 7f40588629c0 20 add_watcher() i=2 2024-09-12T18:05:49.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.407+0000 7f40588629c0 20 add_watcher() i=3 2024-09-12T18:05:49.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.407+0000 7f40588629c0 20 add_watcher() i=4 2024-09-12T18:05:49.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.407+0000 7f40588629c0 20 add_watcher() i=5 2024-09-12T18:05:49.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.407+0000 7f40588629c0 20 add_watcher() i=6 2024-09-12T18:05:49.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.407+0000 7f40588629c0 20 add_watcher() i=7 2024-09-12T18:05:49.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.407+0000 7f40588629c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:49.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f3f0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:49.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:49.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:49.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 5 note: GC not initialized 2024-09-12T18:05:49.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f3e877fe640 20 reqs_thread_entry: start 2024-09-12T18:05:49.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:49.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 20 Filter name: none 2024-09-12T18:05:49.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f3e857fa640 20 reqs_thread_entry: start 2024-09-12T18:05:49.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T18:05:49.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:49.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T18:05:49.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T18:05:49.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 : miss 2024-09-12T18:05:49.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:49.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:49.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.415+0000 7f40588629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 2024-09-12T18:05:49.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f40588629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f40588629c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f40588629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f40588629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33, ofs0, ns] 2024-09-12T18:05:49.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f3f397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431635 cookie 94558880918672 notifier 7446 bl.length()=911 2024-09-12T18:05:49.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f3f397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f3f397fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f3f397fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f40588629c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): orig_sources= new_sources= 2024-09-12T18:05:49.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f40588629c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): potential sources added=[] removed=[] 2024-09-12T18:05:49.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f40588629c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): orig_dests= new_dests= 2024-09-12T18:05:49.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.431+0000 7f40588629c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): potential dests added=[] removed=[] 2024-09-12T18:05:49.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.443+0000 7f40588629c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T18:05:49.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.463+0000 7f40588629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:49.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.463+0000 7f40588629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 2024-09-12T18:05:49.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f40588629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f40588629c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f40588629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f40588629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33, ofs0, ns] 2024-09-12T18:05:49.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f3f39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431636 cookie 94558880918672 notifier 7446 bl.length()=879 2024-09-12T18:05:49.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f3f39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f3f39ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f3f39ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f40588629c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): orig_sources= new_sources= 2024-09-12T18:05:49.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f40588629c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): potential sources added=[] removed=[] 2024-09-12T18:05:49.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f40588629c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): orig_dests= new_dests= 2024-09-12T18:05:49.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f40588629c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): potential dests added=[] removed=[] 2024-09-12T18:05:49.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.467+0000 7f40588629c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T18:05:49.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.471+0000 7f3f0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:49.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.475+0000 7f40588629c0 20 remove_watcher() i=0 2024-09-12T18:05:49.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.475+0000 7f40588629c0 2 removed watcher, disabling cache 2024-09-12T18:05:49.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.479+0000 7f40588629c0 20 remove_watcher() i=1 2024-09-12T18:05:49.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.479+0000 7f40588629c0 20 remove_watcher() i=2 2024-09-12T18:05:49.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.483+0000 7f40588629c0 20 remove_watcher() i=3 2024-09-12T18:05:49.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.487+0000 7f40588629c0 20 remove_watcher() i=4 2024-09-12T18:05:49.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.487+0000 7f40588629c0 20 remove_watcher() i=5 2024-09-12T18:05:49.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.491+0000 7f40588629c0 20 remove_watcher() i=6 2024-09-12T18:05:49.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.491+0000 7f40588629c0 20 remove_watcher() i=7 2024-09-12T18:05:49.508 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T18:05:49.535 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:49.536 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:49.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.579+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.583+0000 7f261cad39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.583+0000 7f261cad39c0 20 realm 2024-09-12T18:05:49.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.583+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.583+0000 7f261cad39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.583+0000 7f261cad39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.583+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.583+0000 7f261cad39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.583+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.583+0000 7f261cad39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.583+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.587+0000 7f261cad39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:49.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.587+0000 7f261cad39c0 20 searching for the correct realm 2024-09-12T18:05:49.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.591+0000 7f261adda640 0 -- 172.21.15.97:0/2751182028 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x558ac8c1c670 msgr2=0x558ac8c1eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:49.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.599+0000 7f261a5d9640 0 -- 172.21.15.97:0/2751182028 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x558ac8c207e0 msgr2=0x558ac8c22ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:49.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.603+0000 7f261cad39c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:49.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.603+0000 7f261cad39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:49.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.603+0000 7f261cad39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:49.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.603+0000 7f261cad39c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:49.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.603+0000 7f261cad39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:49.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.603+0000 7f261cad39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:49.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.603+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:49.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:49.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 zone default found 2024-09-12T18:05:49.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 4 Realm: () 2024-09-12T18:05:49.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:49.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:49.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:49.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 zonegroup default 2024-09-12T18:05:49.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 started sync module instance, tier type = 2024-09-12T18:05:49.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.607+0000 7f261cad39c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:49.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.627+0000 7f261cad39c0 20 add_watcher() i=0 2024-09-12T18:05:49.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.627+0000 7f261cad39c0 20 add_watcher() i=1 2024-09-12T18:05:49.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.627+0000 7f261cad39c0 20 add_watcher() i=2 2024-09-12T18:05:49.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.627+0000 7f261cad39c0 20 add_watcher() i=3 2024-09-12T18:05:49.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.627+0000 7f261cad39c0 20 add_watcher() i=4 2024-09-12T18:05:49.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.627+0000 7f261cad39c0 20 add_watcher() i=5 2024-09-12T18:05:49.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.627+0000 7f261cad39c0 20 add_watcher() i=6 2024-09-12T18:05:49.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.631+0000 7f261cad39c0 20 add_watcher() i=7 2024-09-12T18:05:49.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.631+0000 7f261cad39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:49.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.631+0000 7f24d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:49.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.631+0000 7f261cad39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:49.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.631+0000 7f261cad39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:49.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.631+0000 7f261cad39c0 5 note: GC not initialized 2024-09-12T18:05:49.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.631+0000 7f24cb7fe640 20 reqs_thread_entry: start 2024-09-12T18:05:49.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.631+0000 7f261cad39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:49.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.631+0000 7f261cad39c0 20 Filter name: none 2024-09-12T18:05:49.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.631+0000 7f24c97fa640 20 reqs_thread_entry: start 2024-09-12T18:05:49.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.635+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.635+0000 7f261cad39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:49.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.635+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.635+0000 7f261cad39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:49.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.635+0000 7f261cad39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:49.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.635+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.635+0000 7f261cad39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:49.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.635+0000 7f261cad39c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.639+0000 7f261cad39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:49.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.639+0000 7f261cad39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:49.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.639+0000 7f24d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:49.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.643+0000 7f261cad39c0 20 remove_watcher() i=0 2024-09-12T18:05:49.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.643+0000 7f261cad39c0 2 removed watcher, disabling cache 2024-09-12T18:05:49.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.647+0000 7f261cad39c0 20 remove_watcher() i=1 2024-09-12T18:05:49.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.647+0000 7f261cad39c0 20 remove_watcher() i=2 2024-09-12T18:05:49.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.651+0000 7f261cad39c0 20 remove_watcher() i=3 2024-09-12T18:05:49.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.651+0000 7f261cad39c0 20 remove_watcher() i=4 2024-09-12T18:05:49.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.655+0000 7f261cad39c0 20 remove_watcher() i=5 2024-09-12T18:05:49.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.655+0000 7f261cad39c0 20 remove_watcher() i=6 2024-09-12T18:05:49.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.659+0000 7f261cad39c0 20 remove_watcher() i=7 2024-09-12T18:05:49.674 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:49.674 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:49.674 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-do-reshard id: 98539659-fdaf-41ce-847d-239ff89323af.4641.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:05:49.674 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:49.675 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:49.675 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:49.716 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:49.716 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:49.775 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:05:49.809 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:49.809 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:49.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.855+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.855+0000 7f6f726819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.855+0000 7f6f726819c0 20 realm 2024-09-12T18:05:49.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.855+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.855+0000 7f6f726819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.855+0000 7f6f726819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:49.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.855+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.855+0000 7f6f726819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.855+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.859+0000 7f6f726819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:49.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.859+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.859+0000 7f6f726819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:49.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.859+0000 7f6f726819c0 20 searching for the correct realm 2024-09-12T18:05:49.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.867+0000 7f6f70187640 0 -- 172.21.15.97:0/169439155 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f6f60033060 msgr2=0x7f6f60061f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:49.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.871+0000 7f6f70187640 0 -- 172.21.15.97:0/169439155 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55f0be333440 msgr2=0x55f0be335870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:49.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:49.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:49.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:49.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:49.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:49.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:49.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:49.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:49.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 zone default found 2024-09-12T18:05:49.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 4 Realm: () 2024-09-12T18:05:49.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:49.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:49.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:49.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 zonegroup default 2024-09-12T18:05:49.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.879+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.883+0000 7f6f726819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:49.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.883+0000 7f6f726819c0 20 started sync module instance, tier type = 2024-09-12T18:05:49.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.883+0000 7f6f726819c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:49.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.899+0000 7f6f726819c0 20 add_watcher() i=0 2024-09-12T18:05:49.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.899+0000 7f6f726819c0 20 add_watcher() i=1 2024-09-12T18:05:49.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.899+0000 7f6f726819c0 20 add_watcher() i=2 2024-09-12T18:05:49.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.899+0000 7f6f726819c0 20 add_watcher() i=3 2024-09-12T18:05:49.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.899+0000 7f6f726819c0 20 add_watcher() i=4 2024-09-12T18:05:49.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.899+0000 7f6f726819c0 20 add_watcher() i=5 2024-09-12T18:05:49.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.899+0000 7f6f726819c0 20 add_watcher() i=6 2024-09-12T18:05:49.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.903+0000 7f6f726819c0 20 add_watcher() i=7 2024-09-12T18:05:49.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.903+0000 7f6f726819c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:49.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6e277de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:49.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:49.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:49.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 5 note: GC not initialized 2024-09-12T18:05:49.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6e267dc640 20 reqs_thread_entry: start 2024-09-12T18:05:49.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:49.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 20 Filter name: none 2024-09-12T18:05:49.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6e1f7fe640 20 reqs_thread_entry: start 2024-09-12T18:05:49.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T18:05:49.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:49.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T18:05:49.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T18:05:49.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 : miss 2024-09-12T18:05:49.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:49.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:49.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:49.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.907+0000 7f6f726819c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 2024-09-12T18:05:49.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.919+0000 7f6f726819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.919+0000 7f6f726819c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.919+0000 7f6f726819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.919+0000 7f6f726819c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33, ofs0, ns] 2024-09-12T18:05:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.919+0000 7f6e477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431637 cookie 94492471583568 notifier 7031 bl.length()=911 2024-09-12T18:05:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.919+0000 7f6e477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.919+0000 7f6e477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.919+0000 7f6e477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.923+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): orig_sources= new_sources= 2024-09-12T18:05:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.923+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): potential sources added=[] removed=[] 2024-09-12T18:05:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.923+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): orig_dests= new_dests= 2024-09-12T18:05:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.923+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): potential dests added=[] removed=[] 2024-09-12T18:05:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.0 2024-09-12T18:05:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.0 2024-09-12T18:05:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.1 2024-09-12T18:05:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.1 2024-09-12T18:05:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.2 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.2 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.3 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.3 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.4 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.4 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.5 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.5 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.6 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.6 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.7 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.7 2024-09-12T18:05:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.8 2024-09-12T18:05:49.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.8 2024-09-12T18:05:49.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.9 2024-09-12T18:05:49.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.9 2024-09-12T18:05:49.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.10 2024-09-12T18:05:49.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.10 2024-09-12T18:05:49.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.11 2024-09-12T18:05:49.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1.11 2024-09-12T18:05:49.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.935+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.0 2024-09-12T18:05:49.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.939+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1 2024-09-12T18:05:49.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.939+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.2 2024-09-12T18:05:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.939+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.3 2024-09-12T18:05:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.939+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.4 2024-09-12T18:05:49.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.943+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.5 2024-09-12T18:05:49.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.943+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.6 2024-09-12T18:05:49.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.943+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.7 2024-09-12T18:05:49.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.943+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.8 2024-09-12T18:05:49.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.943+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.9 2024-09-12T18:05:49.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.947+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.10 2024-09-12T18:05:49.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.955+0000 7f6f726819c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:49.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.955+0000 7f6f726819c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 2024-09-12T18:05:49.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.955+0000 7f6f726819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.955+0000 7f6f726819c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.955+0000 7f6f726819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.955+0000 7f6f726819c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33, ofs0, ns] 2024-09-12T18:05:49.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.959+0000 7f6e477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431638 cookie 94492471583568 notifier 7031 bl.length()=911 2024-09-12T18:05:49.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.959+0000 7f6e477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.959+0000 7f6e477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.959+0000 7f6e477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.959+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): orig_sources= new_sources= 2024-09-12T18:05:49.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.959+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): potential sources added=[] removed=[] 2024-09-12T18:05:49.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.959+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): orig_dests= new_dests= 2024-09-12T18:05:49.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.959+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): potential dests added=[] removed=[] 2024-09-12T18:05:49.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.967+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.0 2024-09-12T18:05:49.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.967+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.1 2024-09-12T18:05:49.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.967+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.2 2024-09-12T18:05:49.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.967+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.3 2024-09-12T18:05:49.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.967+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.4 2024-09-12T18:05:49.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.967+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.5 2024-09-12T18:05:49.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.971+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.6 2024-09-12T18:05:49.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.971+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.7 2024-09-12T18:05:49.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.971+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.8 2024-09-12T18:05:49.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.971+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.9 2024-09-12T18:05:49.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.971+0000 7f6f726819c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.33.10 2024-09-12T18:05:49.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.975+0000 7f6f726819c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 : hit (requested=0x17, cached=0x17) 2024-09-12T18:05:49.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.975+0000 7f6f726819c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 2024-09-12T18:05:49.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.979+0000 7f6f726819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.979+0000 7f6f726819c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.979+0000 7f6f726819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.979+0000 7f6f726819c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33, ofs0, ns] 2024-09-12T18:05:49.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.979+0000 7f6e477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431639 cookie 94492471583568 notifier 7031 bl.length()=879 2024-09-12T18:05:49.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.979+0000 7f6e477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 info.flags=0x17 2024-09-12T18:05:49.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.979+0000 7f6e477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.33 to cache LRU end 2024-09-12T18:05:49.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.979+0000 7f6e477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.983+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): orig_sources= new_sources= 2024-09-12T18:05:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.983+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): potential sources added=[] removed=[] 2024-09-12T18:05:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.983+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): orig_dests= new_dests= 2024-09-12T18:05:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.983+0000 7f6f726819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.33]): potential dests added=[] removed=[] 2024-09-12T18:05:49.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.987+0000 7f6f726819c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T18:05:49.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.991+0000 7f6e277de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:49.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.995+0000 7f6f726819c0 20 remove_watcher() i=0 2024-09-12T18:05:49.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.995+0000 7f6f726819c0 2 removed watcher, disabling cache 2024-09-12T18:05:49.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.999+0000 7f6f726819c0 20 remove_watcher() i=1 2024-09-12T18:05:49.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:49.999+0000 7f6f726819c0 20 remove_watcher() i=2 2024-09-12T18:05:50.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.003+0000 7f6f726819c0 20 remove_watcher() i=3 2024-09-12T18:05:50.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.003+0000 7f6f726819c0 20 remove_watcher() i=4 2024-09-12T18:05:50.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.007+0000 7f6f726819c0 20 remove_watcher() i=5 2024-09-12T18:05:50.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.007+0000 7f6f726819c0 20 remove_watcher() i=6 2024-09-12T18:05:50.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.011+0000 7f6f726819c0 20 remove_watcher() i=7 2024-09-12T18:05:50.026 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T18:05:50.057 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:50.057 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:50.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.103+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.103+0000 7f0f10cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.103+0000 7f0f10cb59c0 20 realm 2024-09-12T18:05:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.103+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.107+0000 7f0f10cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:50.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.107+0000 7f0f10cb59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:50.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.107+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.107+0000 7f0f10cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:50.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.107+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.107+0000 7f0f10cb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:50.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.107+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.107+0000 7f0f10cb59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.107+0000 7f0f10cb59c0 20 searching for the correct realm 2024-09-12T18:05:50.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.111+0000 7f0f0dfba640 0 -- 172.21.15.97:0/3016663963 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f0f040d9910 msgr2=0x7f0f040ca3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:50.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.323+0000 7f0f0dfba640 0 -- 172.21.15.97:0/3016663963 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x56501c7ad5b0 msgr2=0x56501c7af9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:50.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.335+0000 7f0f10cb59c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:50.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.335+0000 7f0f10cb59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:50.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.335+0000 7f0f10cb59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:50.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.335+0000 7f0f10cb59c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:50.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.335+0000 7f0f10cb59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:50.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.335+0000 7f0f10cb59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:50.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.335+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:50.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:50.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:50.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 zone default found 2024-09-12T18:05:50.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 4 Realm: () 2024-09-12T18:05:50.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:50.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:50.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:50.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 zonegroup default 2024-09-12T18:05:50.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:50.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:50.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.339+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.343+0000 7f0f10cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:50.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.343+0000 7f0f10cb59c0 20 started sync module instance, tier type = 2024-09-12T18:05:50.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.343+0000 7f0f10cb59c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:50.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.363+0000 7f0f10cb59c0 20 add_watcher() i=0 2024-09-12T18:05:50.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.363+0000 7f0f10cb59c0 20 add_watcher() i=1 2024-09-12T18:05:50.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.363+0000 7f0f10cb59c0 20 add_watcher() i=2 2024-09-12T18:05:50.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.363+0000 7f0f10cb59c0 20 add_watcher() i=3 2024-09-12T18:05:50.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.363+0000 7f0f10cb59c0 20 add_watcher() i=4 2024-09-12T18:05:50.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.363+0000 7f0f10cb59c0 20 add_watcher() i=5 2024-09-12T18:05:50.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.363+0000 7f0f10cb59c0 20 add_watcher() i=6 2024-09-12T18:05:50.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.367+0000 7f0f10cb59c0 20 add_watcher() i=7 2024-09-12T18:05:50.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.367+0000 7f0f10cb59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:50.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.371+0000 7f0dc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:50.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.371+0000 7f0f10cb59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:50.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.371+0000 7f0f10cb59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:50.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.371+0000 7f0f10cb59c0 5 note: GC not initialized 2024-09-12T18:05:50.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.371+0000 7f0d3f7fe640 20 reqs_thread_entry: start 2024-09-12T18:05:50.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.371+0000 7f0f10cb59c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:50.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.371+0000 7f0f10cb59c0 20 Filter name: none 2024-09-12T18:05:50.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.371+0000 7f0d3d7fa640 20 reqs_thread_entry: start 2024-09-12T18:05:50.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.371+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.375+0000 7f0f10cb59c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:50.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.375+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.375+0000 7f0f10cb59c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:50.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.375+0000 7f0f10cb59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:50.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.375+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.375+0000 7f0f10cb59c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:50.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.375+0000 7f0f10cb59c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:50.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.379+0000 7f0f10cb59c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:50.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.379+0000 7f0f10cb59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:50.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.383+0000 7f0dc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:50.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.387+0000 7f0f10cb59c0 20 remove_watcher() i=0 2024-09-12T18:05:50.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.387+0000 7f0f10cb59c0 2 removed watcher, disabling cache 2024-09-12T18:05:50.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.387+0000 7f0f10cb59c0 20 remove_watcher() i=1 2024-09-12T18:05:50.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.391+0000 7f0f10cb59c0 20 remove_watcher() i=2 2024-09-12T18:05:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.391+0000 7f0f10cb59c0 20 remove_watcher() i=3 2024-09-12T18:05:50.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.395+0000 7f0f10cb59c0 20 remove_watcher() i=4 2024-09-12T18:05:50.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.395+0000 7f0f10cb59c0 20 remove_watcher() i=5 2024-09-12T18:05:50.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.403+0000 7f0f10cb59c0 20 remove_watcher() i=6 2024-09-12T18:05:50.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:50.407+0000 7f0f10cb59c0 20 remove_watcher() i=7 2024-09-12T18:05:50.419 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:50.419 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:50.419 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-do-reshard id: 98539659-fdaf-41ce-847d-239ff89323af.4641.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:05:50.420 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:50.421 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:50.421 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:50.445 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:50.445 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:50.945 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:50.945 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:51.315 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T18:05:51.315 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:51.318 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:51.318 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:51.441 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:51.441 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:51.529 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:51.529 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:51.629 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:51.630 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:51.728 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:51.728 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:51.825 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:51.825 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:51.921 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:51.921 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:52.022 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:52.022 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:52.118 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:52.118 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:52.222 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:52.222 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:52.310 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:52.310 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:52.402 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:52.403 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:52.495 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:52.495 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:52.582 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:52.582 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:52.679 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:52.782 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:52.880 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:52.974 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:52.975 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:53.072 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:53.073 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:53.170 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:53.170 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:53.262 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:53.262 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:53.357 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:53.357 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:53.445 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T18:05:53.478 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:53.478 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:53.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.523+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.527+0000 7f901967b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:53.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.527+0000 7f901967b9c0 20 realm 2024-09-12T18:05:53.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.527+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.527+0000 7f901967b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:53.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.527+0000 7f901967b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:53.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.527+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.527+0000 7f901967b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:53.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.527+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.527+0000 7f901967b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:53.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.527+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.531+0000 7f901967b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:53.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.531+0000 7f901967b9c0 20 searching for the correct realm 2024-09-12T18:05:53.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.531+0000 7f9017181640 0 -- 172.21.15.97:0/1782337568 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f900801b070 msgr2=0x7f9008003400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:53.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.747+0000 7f9017181640 0 -- 172.21.15.97:0/1782337568 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x5582b1d213d0 msgr2=0x7f90100d4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:53.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:53.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:53.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:53.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:53.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:53.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:53.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:53.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:53.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:53.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 zone default found 2024-09-12T18:05:53.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 4 Realm: () 2024-09-12T18:05:53.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:53.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:53.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:53.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 zonegroup default 2024-09-12T18:05:53.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:53.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.967+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.971+0000 7f901967b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:53.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.971+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:53.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.971+0000 7f901967b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:53.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.971+0000 7f901967b9c0 20 started sync module instance, tier type = 2024-09-12T18:05:53.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.971+0000 7f901967b9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:53.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.995+0000 7f901967b9c0 20 add_watcher() i=0 2024-09-12T18:05:53.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.995+0000 7f901967b9c0 20 add_watcher() i=1 2024-09-12T18:05:53.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.995+0000 7f901967b9c0 20 add_watcher() i=2 2024-09-12T18:05:53.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.995+0000 7f901967b9c0 20 add_watcher() i=3 2024-09-12T18:05:53.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.995+0000 7f901967b9c0 20 add_watcher() i=4 2024-09-12T18:05:53.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.995+0000 7f901967b9c0 20 add_watcher() i=5 2024-09-12T18:05:53.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.995+0000 7f901967b9c0 20 add_watcher() i=6 2024-09-12T18:05:53.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.999+0000 7f901967b9c0 20 add_watcher() i=7 2024-09-12T18:05:53.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:53.999+0000 7f901967b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.003+0000 7f8ecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.003+0000 7f901967b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:54.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.003+0000 7f901967b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:54.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.003+0000 7f901967b9c0 5 note: GC not initialized 2024-09-12T18:05:54.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.007+0000 7f8eccfe1640 20 reqs_thread_entry: start 2024-09-12T18:05:54.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.007+0000 7f901967b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:54.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.007+0000 7f901967b9c0 20 Filter name: none 2024-09-12T18:05:54.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.007+0000 7f8e467fc640 20 reqs_thread_entry: start 2024-09-12T18:05:54.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.007+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.007+0000 7f901967b9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:54.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.007+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.007+0000 7f901967b9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:54.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.007+0000 7f901967b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:54.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.007+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.011+0000 7f901967b9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:54.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.011+0000 7f901967b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.011+0000 7f901967b9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:54.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.011+0000 7f901967b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:54.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.015+0000 7f8ecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.019+0000 7f901967b9c0 20 remove_watcher() i=0 2024-09-12T18:05:54.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.019+0000 7f901967b9c0 2 removed watcher, disabling cache 2024-09-12T18:05:54.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.023+0000 7f901967b9c0 20 remove_watcher() i=1 2024-09-12T18:05:54.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.027+0000 7f901967b9c0 20 remove_watcher() i=2 2024-09-12T18:05:54.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.027+0000 7f901967b9c0 20 remove_watcher() i=3 2024-09-12T18:05:54.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.031+0000 7f901967b9c0 20 remove_watcher() i=4 2024-09-12T18:05:54.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.031+0000 7f901967b9c0 20 remove_watcher() i=5 2024-09-12T18:05:54.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.035+0000 7f901967b9c0 20 remove_watcher() i=6 2024-09-12T18:05:54.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.039+0000 7f901967b9c0 20 remove_watcher() i=7 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-do-reshard id: 98539659-fdaf-41ce-847d-239ff89323af.4641.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:05:54.053 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.054 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:05:54.088 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:54.088 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:54.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.131+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 realm 2024-09-12T18:05:54.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.135+0000 7f76bd2849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:54.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.139+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:54.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.139+0000 7f76bd2849c0 20 searching for the correct realm 2024-09-12T18:05:54.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.143+0000 7f76bb58b640 0 -- 172.21.15.97:0/1761709300 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x563bb61116e0 msgr2=0x563bb6113b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:05:54.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.151+0000 7f76bad8a640 0 -- 172.21.15.97:0/1761709300 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x563bb6115940 msgr2=0x563bb6117d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:54.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:54.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:54.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:54.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:54.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:54.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:54.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:54.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 zone default found 2024-09-12T18:05:54.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 4 Realm: () 2024-09-12T18:05:54.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:54.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:54.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:54.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 zonegroup default 2024-09-12T18:05:54.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.163+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.163+0000 7f76bd2849c0 20 started sync module instance, tier type = 2024-09-12T18:05:54.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.163+0000 7f76bd2849c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:54.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=0 2024-09-12T18:05:54.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=1 2024-09-12T18:05:54.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=2 2024-09-12T18:05:54.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=3 2024-09-12T18:05:54.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=4 2024-09-12T18:05:54.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=5 2024-09-12T18:05:54.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=6 2024-09-12T18:05:54.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.187+0000 7f76bd2849c0 20 add_watcher() i=7 2024-09-12T18:05:54.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.187+0000 7f76bd2849c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:54.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.187+0000 7f75717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.187+0000 7f76bd2849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:54.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.187+0000 7f76bd2849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:54.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 note: GC not initialized 2024-09-12T18:05:54.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f74ebfff640 20 reqs_thread_entry: start 2024-09-12T18:05:54.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:54.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 Filter name: none 2024-09-12T18:05:54.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f74e9ffb640 20 reqs_thread_entry: start 2024-09-12T18:05:54.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:05:54.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:54.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:05:54.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:05:54.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 : miss 2024-09-12T18:05:54.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:54.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:05:54.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:05:54.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:54.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 2024-09-12T18:05:54.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:05:54.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:05:54.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34, ofs0, ns] 2024-09-12T18:05:54.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431649 cookie 94814457638944 notifier 7082 bl.length()=911 2024-09-12T18:05:54.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:05:54.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:05:54.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_sources= new_sources= 2024-09-12T18:05:54.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential sources added=[] removed=[] 2024-09-12T18:05:54.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_dests= new_dests= 2024-09-12T18:05:54.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential dests added=[] removed=[] 2024-09-12T18:05:54.214 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f76bd2849c0 time 2024-09-12T18:05:54.217875+0000 2024-09-12T18:05:54.215 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:54.216 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:54.216 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f76c0b5e2eb] 2024-09-12T18:05:54.216 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f76c0b5e49f] 2024-09-12T18:05:54.216 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563bb43570c1] 2024-09-12T18:05:54.216 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563bb43691fa] 2024-09-12T18:05:54.216 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:05:54.216 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f76bf9c4d90] 2024-09-12T18:05:54.216 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:05:54.216 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:05:54.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.215+0000 7f76bd2849c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f76bd2849c0 time 2024-09-12T18:05:54.217875+0000 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f76c0b5e2eb] 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f76c0b5e49f] 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563bb43570c1] 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563bb43691fa] 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f76bf9c4d90] 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.217 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:05:54.218 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f76bd2849c0 thread_name:radosgw-admin 2024-09-12T18:05:54.235 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:54.235 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f76bf9dd520] 2024-09-12T18:05:54.235 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:05:54.236 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:05:54.236 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:05:54.236 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f76c0b5e345] 2024-09-12T18:05:54.236 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f76c0b5e49f] 2024-09-12T18:05:54.236 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563bb43570c1] 2024-09-12T18:05:54.236 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563bb43691fa] 2024-09-12T18:05:54.236 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:05:54.236 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f76bf9c4d90] 2024-09-12T18:05:54.236 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:05:54.236 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.215+0000 7f76bd2849c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f76bd2849c0 thread_name:radosgw-admin 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f76bf9dd520] 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f76c0b5e345] 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f76c0b5e49f] 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563bb43570c1] 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563bb43691fa] 2024-09-12T18:05:54.237 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f76bf9c4d90] 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient(hunting): handle_auth_done global_id 7070 payload 274 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient: _finish_hunting 0 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:05:54.111+0000 7f76b2589640 1 monclient: found mon.noname-c 2024-09-12T18:05:54.238 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: dump: 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.239 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: _finish_auth 0 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: _check_auth_tickets 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: dump: 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.240 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 monclient: authenticate success, global_id 7070 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 10 monclient: get_monmap_and_config success 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 4 set_mon_vals no callback set 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 10 monclient: shutdown 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) unregister_commands rotate-key 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 10 monclient: build_initial_monmap 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 10 monclient: monmap: 2024-09-12T18:05:54.241 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding auth protocol: cephx 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding auth protocol: cephx 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding auth protocol: cephx 2024-09-12T18:05:54.242 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.243 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 1 librados: starting msgr at 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 1 librados: starting objecter 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command objecter_requests hook 0x563bb602d3f0 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 1 librados: setting wanted keys 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 1 librados: calling monclient init 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 10 monclient: init 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding auth protocol: cephx 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding auth protocol: cephx 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding auth protocol: cephx 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.244 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command rotate-key hook 0x563bb60285d8 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:05:54.245 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-b con 0x563bb5ed7d60 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-c con 0x563bb5ed8140 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-a con 0x563bb5ee1710 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): authenticate will time out at 2783.524290s 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): get_auth_request con 0x563bb5ed8140 auth_method 0 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.246 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): get_auth_request con 0x563bb5ee1710 auth_method 0 2024-09-12T18:05:54.247 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.247 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.247 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.247 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.247 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.247 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.247 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.247 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.247 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.247 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): handle_auth_done global_id 7073 payload 824 2024-09-12T18:05:54.247 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient: _finish_hunting 0 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:05:54.115+0000 7f76b2589640 1 monclient: found mon.noname-c 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: dump: 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.248 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: _finish_auth 0 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: _check_auth_tickets 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: dump: 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.249 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:05:54.115+0000 7f75a8e09640 4 set_mon_vals no callback set 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 5 monclient: authenticate success, global_id 7073 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 1 librados: init done 2024-09-12T18:05:54.250 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:05:54.115+0000 7f75a7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:05:54.115+0000 7f75a7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:05:54.115+0000 7f75a7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:05:54.115+0000 7f76bad8a640 10 monclient: get_auth_request con 0x7f75a0070b10 auth_method 0 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient: get_auth_request con 0x563bb6053010 auth_method 0 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:05:54.119+0000 7f76bad8a640 10 monclient: get_auth_request con 0x563bb6072fa0 auth_method 0 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:05:54.119+0000 7f76b2589640 10 monclient: get_auth_request con 0x563bb6077300 auth_method 0 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: build_initial_monmap 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: monmap: 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:54.251 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:54.252 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:54.252 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.252 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:54.252 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:54.252 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:54.252 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.252 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding auth protocol: cephx 2024-09-12T18:05:54.252 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding auth protocol: cephx 2024-09-12T18:05:54.252 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding auth protocol: cephx 2024-09-12T18:05:54.252 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.252 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563bb607fb20 EEXIST 2024-09-12T18:05:54.253 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: init 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding auth protocol: cephx 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding auth protocol: cephx 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding auth protocol: cephx 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.254 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command rotate-key cmddesc rotate-key hook 0x563bb607a910 EEXIST 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-c con 0x563bb60a3cd0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-b con 0x563bb60a3600 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-a con 0x563bb60a1fe0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.255 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): authenticate will time out at 2783.534587s 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): get_auth_request con 0x563bb60a3cd0 auth_method 0 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): get_auth_request con 0x563bb60a1fe0 auth_method 0 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.256 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:05:54.123+0000 7f76b2589640 10 monclient(hunting): get_auth_request con 0x563bb60a3600 auth_method 0 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:05:54.123+0000 7f76b2589640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:05:54.123+0000 7f76b2589640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:05:54.123+0000 7f76b2589640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): handle_auth_done global_id 7076 payload 824 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient: _finish_hunting 0 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:05:54.123+0000 7f76bad8a640 1 monclient: found mon.noname-c 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.257 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: dump: 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.258 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: _finish_auth 0 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: _check_auth_tickets 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: dump: 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.259 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 monclient: authenticate success, global_id 7076 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:05:54.123+0000 7f76ba589640 4 set_mon_vals no callback set 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:05:54.127+0000 7f75a4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:05:54.127+0000 7f75a4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:05:54.127+0000 7f75a4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient: get_auth_request con 0x7f7594070a20 auth_method 0 2024-09-12T18:05:54.260 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: get_monmap_and_config 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: build_initial_monmap 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: monmap: 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:54.261 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding auth protocol: cephx 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding auth protocol: cephx 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding auth protocol: cephx 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.262 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: init 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding auth protocol: cephx 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding auth protocol: cephx 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding auth protocol: cephx 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.263 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff0ee3a0c8 EEXIST 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-c con 0x563bb60f79a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-a con 0x563bb60f7d80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:54.264 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-b con 0x563bb60f2140 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): authenticate will time out at 2783.538791s 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): get_auth_request con 0x563bb60f79a0 auth_method 0 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): get_auth_request con 0x563bb60f7d80 auth_method 0 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.265 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): handle_auth_done global_id 7079 payload 274 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient: _finish_hunting 0 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:05:54.127+0000 7f76bad8a640 1 monclient: found mon.noname-c 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: dump: 2024-09-12T18:05:54.266 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.267 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: dump: 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 monclient: authenticate success, global_id 7079 2024-09-12T18:05:54.268 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: get_monmap_and_config success 2024-09-12T18:05:54.269 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 4 set_mon_vals no callback set 2024-09-12T18:05:54.269 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: shutdown 2024-09-12T18:05:54.269 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: build_initial_monmap 2024-09-12T18:05:54.269 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:54.269 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: monmap: 2024-09-12T18:05:54.269 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:54.269 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:54.269 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:54.269 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:54.269 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:54.269 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding auth protocol: cephx 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding auth protocol: cephx 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding auth protocol: cephx 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.270 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 librados: starting msgr at 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 librados: starting objecter 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563bb60f34a0 EEXIST 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 librados: setting wanted keys 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 librados: calling monclient init 2024-09-12T18:05:54.271 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: init 2024-09-12T18:05:54.272 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding auth protocol: cephx 2024-09-12T18:05:54.272 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding auth protocol: cephx 2024-09-12T18:05:54.272 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding auth protocol: cephx 2024-09-12T18:05:54.272 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.272 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.272 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.272 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.272 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.272 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.272 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.272 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command rotate-key cmddesc rotate-key hook 0x563bb60a5c38 EEXIST 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-c con 0x563bb60f2140 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-b con 0x563bb60f79a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:54.273 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-a con 0x563bb6101ac0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): authenticate will time out at 2783.541341s 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): get_auth_request con 0x563bb60f2140 auth_method 0 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): get_auth_request con 0x563bb6101ac0 auth_method 0 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.274 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): handle_auth_done global_id 7082 payload 824 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient: _finish_hunting 0 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:05:54.131+0000 7f76bad8a640 1 monclient: found mon.noname-c 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:54.275 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: dump: 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: _finish_auth 0 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: _check_auth_tickets 2024-09-12T18:05:54.276 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: dump: 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.277 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:05:54.131+0000 7f759e7fc640 4 set_mon_vals no callback set 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 monclient: authenticate success, global_id 7082 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 librados: init done 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command cr dump hook 0x563bb60efd18 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:05:54.135+0000 7f759cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:05:54.135+0000 7f759cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:05:54.135+0000 7f759cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:05:54.135+0000 7f76b2589640 10 monclient: get_auth_request con 0x7f7584070ae0 auth_method 0 2024-09-12T18:05:54.278 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:05:54.135+0000 7f76bb58b640 10 monclient: get_auth_request con 0x563bb61116e0 auth_method 0 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 realm 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:05:54.135+0000 7f76bad8a640 10 monclient: get_auth_request con 0x563bb6115940 auth_method 0 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:05:54.139+0000 7f76b2589640 10 monclient: get_auth_request con 0x563bb61191a0 auth_method 0 2024-09-12T18:05:54.279 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:05:54.139+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:05:54.139+0000 7f76bd2849c0 20 searching for the correct realm 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:05:54.139+0000 7f76bb58b640 10 monclient: get_auth_request con 0x7f76a4008050 auth_method 0 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:05:54.143+0000 7f76bad8a640 10 monclient: get_auth_request con 0x7f76ac008040 auth_method 0 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:05:54.143+0000 7f76b2589640 10 monclient: get_auth_request con 0x7f76a408aa80 auth_method 0 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:05:54.143+0000 7f76bb58b640 0 -- 172.21.15.97:0/1761709300 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x563bb61116e0 msgr2=0x563bb6113b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:05:54.143+0000 7f759cff9640 1 client.7082.objecter ms_handle_reset 0x563bb61116e0 session 0x563bb6111060 osd.6 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:05:54.143+0000 7f759cff9640 10 monclient: _renew_subs 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:05:54.143+0000 7f759cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:05:54.143+0000 7f76bb58b640 10 monclient: get_auth_request con 0x7f7584080600 auth_method 0 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:05:54.147+0000 7f76bb58b640 10 monclient: get_auth_request con 0x7f76ac089b30 auth_method 0 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:05:54.147+0000 7f76bad8a640 10 monclient: get_auth_request con 0x7f76b40d7040 auth_method 0 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:05:54.151+0000 7f76bad8a640 0 -- 172.21.15.97:0/1761709300 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x563bb6115940 msgr2=0x563bb6117d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:54.280 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:05:54.151+0000 7f759cff9640 1 client.7082.objecter ms_handle_reset 0x563bb6115940 session 0x563bb61152c0 osd.1 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:05:54.151+0000 7f76bad8a640 10 monclient: get_auth_request con 0x563bb61116e0 auth_method 0 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:54.281 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 zone default found 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 4 Realm: () 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 zonegroup default 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:05:54.163+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:05:54.163+0000 7f76bd2849c0 20 started sync module instance, tier type = 2024-09-12T18:05:54.282 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:05:54.163+0000 7f76bd2849c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=0 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=1 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=2 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=3 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=4 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=5 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=6 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 20 add_watcher() i=7 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding auth protocol: cephx 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding auth protocol: cephx 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding auth protocol: cephx 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.283 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:05:54.187+0000 7f75717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:54.284 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command cache list hook 0x563bb6101ec0 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command cache inspect hook 0x563bb6101ec0 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command cache erase hook 0x563bb6101ec0 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command cache zap hook 0x563bb6101ec0 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 note: GC not initialized 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:05:54.191+0000 7f74ebfff640 20 reqs_thread_entry: start 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command sync trace show hook 0x7f76b40bb210 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command sync trace history hook 0x7f76b40bb210 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command sync trace active hook 0x7f76b40bb210 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command sync trace active_short hook 0x7f76b40bb210 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 Filter name: none 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:05:54.191+0000 7f74e9ffb640 20 reqs_thread_entry: start 2024-09-12T18:05:54.285 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 : miss 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 2024-09-12T18:05:54.286 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34, ofs0, ns] 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431649 cookie 94814457638944 notifier 7082 bl.length()=911 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_sources= new_sources= 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential sources added=[] removed=[] 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_dests= new_dests= 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential dests added=[] removed=[] 2024-09-12T18:05:54.287 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:05:54.215+0000 7f76bd2849c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f76bd2849c0 time 2024-09-12T18:05:54.217875+0000 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f76c0b5e2eb] 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f76c0b5e49f] 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563bb43570c1] 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563bb43691fa] 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f76bf9c4d90] 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.288 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:05:54.215+0000 7f76bd2849c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f76bd2849c0 thread_name:radosgw-admin 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f76bf9dd520] 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f76c0b5e345] 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f76c0b5e49f] 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563bb43570c1] 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563bb43691fa] 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:05:54.289 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f76bf9c4d90] 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:05:54.290 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:05:54.291 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:05:54.292 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:05:54.293 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:05:54.294 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:05:54.294 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:05:54.294 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:05:54.294 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:05:54.294 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:05:54.294 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:05:54.294 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:05:54.294 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:05:54.294 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:05:54.294 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:05:54.295 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:05:54.296 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: 7f74e9ffb640 / http_manager 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: 7f74ebfff640 / http_manager 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: 7f75717e2640 / rgw_dt_lg_renew 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: 7f759cff9640 / ms_dispatch 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: 7f759e7fc640 / io_context_pool 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: 7f75a4e01640 / ms_dispatch 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: 7f75a7606640 / ms_dispatch 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: 7f75a8e09640 / io_context_pool 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: 7f76b2589640 / msgr-worker-2 2024-09-12T18:05:54.297 INFO:tasks.workunit.client.0.smithi097.stderr: 7f76ba589640 / io_context_pool 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr: 7f76bad8a640 / msgr-worker-1 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr: 7f76bb58b640 / msgr-worker-0 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr: 7f76bd2849c0 / radosgw-admin 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.120502.log 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient(hunting): handle_auth_done global_id 7070 payload 274 2024-09-12T18:05:54.298 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient: _finish_hunting 0 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:05:54.111+0000 7f76b2589640 1 monclient: found mon.noname-c 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:05:54.111+0000 7f76b2589640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: dump: 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.299 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: _finish_auth 0 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: _check_auth_tickets 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:05:54.111+0000 7f75a8e09640 10 monclient: dump: 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.300 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 monclient: authenticate success, global_id 7070 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 10 monclient: get_monmap_and_config success 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 4 set_mon_vals no callback set 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 10 monclient: shutdown 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) unregister_commands rotate-key 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 10 monclient: build_initial_monmap 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:54.301 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 10 monclient: monmap: 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding auth protocol: cephx 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding auth protocol: cephx 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding auth protocol: cephx 2024-09-12T18:05:54.302 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: crc 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb602dad0) adding con mode: secure 2024-09-12T18:05:54.303 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 1 librados: starting msgr at 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 1 librados: starting objecter 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command objecter_requests hook 0x563bb602d3f0 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 1 librados: setting wanted keys 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 1 librados: calling monclient init 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 10 monclient: init 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding auth protocol: cephx 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding auth protocol: cephx 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding auth protocol: cephx 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.304 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: crc 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 5 AuthRegistry(0x563bb6028490) adding con mode: secure 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:05:54.111+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.305 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command rotate-key hook 0x563bb60285d8 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-b con 0x563bb5ed7d60 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-c con 0x563bb5ed8140 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-a con 0x563bb5ee1710 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient(hunting): authenticate will time out at 2783.524290s 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): get_auth_request con 0x563bb5ed8140 auth_method 0 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.306 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): get_auth_request con 0x563bb5ee1710 auth_method 0 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient(hunting): handle_auth_done global_id 7073 payload 824 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient: _finish_hunting 0 2024-09-12T18:05:54.307 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:05:54.115+0000 7f76b2589640 1 monclient: found mon.noname-c 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:05:54.115+0000 7f76b2589640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: dump: 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.308 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: _finish_auth 0 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: _check_auth_tickets 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:05:54.115+0000 7f75a7606640 10 monclient: dump: 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.309 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:05:54.115+0000 7f75a8e09640 4 set_mon_vals no callback set 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 5 monclient: authenticate success, global_id 7073 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:05:54.115+0000 7f76bd2849c0 1 librados: init done 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:05:54.115+0000 7f75a7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:05:54.115+0000 7f75a7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:05:54.115+0000 7f75a7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:05:54.115+0000 7f76bad8a640 10 monclient: get_auth_request con 0x7f75a0070b10 auth_method 0 2024-09-12T18:05:54.310 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:05:54.115+0000 7f76bb58b640 10 monclient: get_auth_request con 0x563bb6053010 auth_method 0 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:05:54.119+0000 7f76bad8a640 10 monclient: get_auth_request con 0x563bb6072fa0 auth_method 0 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:05:54.119+0000 7f76b2589640 10 monclient: get_auth_request con 0x563bb6077300 auth_method 0 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: build_initial_monmap 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: monmap: 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:54.311 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding auth protocol: cephx 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding auth protocol: cephx 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding auth protocol: cephx 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.312 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: crc 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607c0f0) adding con mode: secure 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563bb607fb20 EEXIST 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: init 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding auth protocol: cephx 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding auth protocol: cephx 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding auth protocol: cephx 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.313 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: crc 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 AuthRegistry(0x563bb607a7c8) adding con mode: secure 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command rotate-key cmddesc rotate-key hook 0x563bb607a910 EEXIST 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:54.314 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-c con 0x563bb60a3cd0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-b con 0x563bb60a3600 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-a con 0x563bb60a1fe0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient(hunting): authenticate will time out at 2783.534587s 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): get_auth_request con 0x563bb60a3cd0 auth_method 0 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.315 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): get_auth_request con 0x563bb60a1fe0 auth_method 0 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:05:54.123+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:05:54.123+0000 7f76b2589640 10 monclient(hunting): get_auth_request con 0x563bb60a3600 auth_method 0 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:05:54.123+0000 7f76b2589640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:05:54.123+0000 7f76b2589640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.316 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:05:54.123+0000 7f76b2589640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient(hunting): handle_auth_done global_id 7076 payload 824 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient: _finish_hunting 0 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:05:54.123+0000 7f76bad8a640 1 monclient: found mon.noname-c 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:05:54.123+0000 7f76bad8a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: dump: 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.317 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: _finish_auth 0 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: _check_auth_tickets 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:05:54.123+0000 7f75a4e01640 10 monclient: dump: 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.318 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 5 monclient: authenticate success, global_id 7076 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:05:54.123+0000 7f76ba589640 4 set_mon_vals no callback set 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.319 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:05:54.123+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.320 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:05:54.127+0000 7f75a4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:54.320 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:05:54.127+0000 7f75a4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.320 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:05:54.127+0000 7f75a4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.320 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient: get_auth_request con 0x7f7594070a20 auth_method 0 2024-09-12T18:05:54.320 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: get_monmap_and_config 2024-09-12T18:05:54.320 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: build_initial_monmap 2024-09-12T18:05:54.320 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:54.320 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: monmap: 2024-09-12T18:05:54.320 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:54.320 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:54.320 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding auth protocol: cephx 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding auth protocol: cephx 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding auth protocol: cephx 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.321 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.322 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.322 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.322 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.322 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.322 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.322 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.322 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: crc 2024-09-12T18:05:54.322 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60c36e0) adding con mode: secure 2024-09-12T18:05:54.322 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.322 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: init 2024-09-12T18:05:54.322 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding auth protocol: cephx 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding auth protocol: cephx 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding auth protocol: cephx 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.323 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: crc 2024-09-12T18:05:54.324 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee39f80) adding con mode: secure 2024-09-12T18:05:54.324 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.324 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.324 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff0ee3a0c8 EEXIST 2024-09-12T18:05:54.324 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:54.324 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:05:54.324 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-c con 0x563bb60f79a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:54.324 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-a con 0x563bb60f7d80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:54.324 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-b con 0x563bb60f2140 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:54.324 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.324 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient(hunting): authenticate will time out at 2783.538791s 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): get_auth_request con 0x563bb60f79a0 auth_method 0 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): get_auth_request con 0x563bb60f7d80 auth_method 0 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.325 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:05:54.127+0000 7f76b2589640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient(hunting): handle_auth_done global_id 7079 payload 274 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient: _finish_hunting 0 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:05:54.127+0000 7f76bad8a640 1 monclient: found mon.noname-c 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:05:54.127+0000 7f76bad8a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: dump: 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.326 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:54.327 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:05:54.127+0000 7f759e7fc640 10 monclient: dump: 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.328 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 5 monclient: authenticate success, global_id 7079 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 10 monclient: get_monmap_and_config success 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:05:54.127+0000 7f76bd2849c0 4 set_mon_vals no callback set 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: shutdown 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: build_initial_monmap 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 build_initial for_mkfs: 0 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: monmap: 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.329 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding auth protocol: cephx 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding auth protocol: cephx 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding auth protocol: cephx 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.330 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: crc 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60f3de0) adding con mode: secure 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 librados: starting msgr at 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 librados: starting objecter 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563bb60f34a0 EEXIST 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 librados: setting wanted keys 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 librados: calling monclient init 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: init 2024-09-12T18:05:54.331 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding auth protocol: cephx 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding auth protocol: cephx 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding auth protocol: cephx 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.332 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: crc 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 AuthRegistry(0x563bb60a5af0) adding con mode: secure 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command rotate-key cmddesc rotate-key hook 0x563bb60a5c38 EEXIST 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _reopen_session rank -1 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-c con 0x563bb60f2140 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-b con 0x563bb60f79a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): picked mon.noname-a con 0x563bb6101ac0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.333 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): _renew_subs 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient(hunting): authenticate will time out at 2783.541341s 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): get_auth_request con 0x563bb60f2140 auth_method 0 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): get_auth_request con 0x563bb6101ac0 auth_method 0 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.334 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:05:54.131+0000 7f76bb58b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient(hunting): handle_auth_done global_id 7082 payload 824 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient: _finish_hunting 0 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:05:54.131+0000 7f76bad8a640 1 monclient: found mon.noname-c 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:05:54.131+0000 7f76bad8a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: dump: 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.335 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: _finish_auth 0 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: _check_auth_tickets 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:05:54.131+0000 7f759cff9640 10 monclient: dump: 2024-09-12T18:05:54.336 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:05:54.131+0000 7f759e7fc640 4 set_mon_vals no callback set 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 monclient: authenticate success, global_id 7082 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.337 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _renew_subs 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 1 librados: init done 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command cr dump hook 0x563bb60efd18 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:05:54.131+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:05:54.135+0000 7f759cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:05:54.135+0000 7f759cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:05:54.135+0000 7f759cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:05:54.135+0000 7f76b2589640 10 monclient: get_auth_request con 0x7f7584070ae0 auth_method 0 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:05:54.135+0000 7f76bb58b640 10 monclient: get_auth_request con 0x563bb61116e0 auth_method 0 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.338 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 realm 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:05:54.135+0000 7f76bad8a640 10 monclient: get_auth_request con 0x563bb6115940 auth_method 0 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:05:54.135+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:05:54.139+0000 7f76b2589640 10 monclient: get_auth_request con 0x563bb61191a0 auth_method 0 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:05:54.139+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:05:54.139+0000 7f76bd2849c0 20 searching for the correct realm 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:05:54.139+0000 7f76bb58b640 10 monclient: get_auth_request con 0x7f76a4008050 auth_method 0 2024-09-12T18:05:54.339 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:05:54.143+0000 7f76bad8a640 10 monclient: get_auth_request con 0x7f76ac008040 auth_method 0 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:05:54.143+0000 7f76b2589640 10 monclient: get_auth_request con 0x7f76a408aa80 auth_method 0 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:05:54.143+0000 7f76bb58b640 0 -- 172.21.15.97:0/1761709300 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x563bb61116e0 msgr2=0x563bb6113b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:05:54.143+0000 7f759cff9640 1 client.7082.objecter ms_handle_reset 0x563bb61116e0 session 0x563bb6111060 osd.6 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:05:54.143+0000 7f759cff9640 10 monclient: _renew_subs 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:05:54.143+0000 7f759cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:05:54.143+0000 7f76bb58b640 10 monclient: get_auth_request con 0x7f7584080600 auth_method 0 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:05:54.147+0000 7f76bb58b640 10 monclient: get_auth_request con 0x7f76ac089b30 auth_method 0 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:05:54.147+0000 7f76bad8a640 10 monclient: get_auth_request con 0x7f76b40d7040 auth_method 0 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:05:54.151+0000 7f76bad8a640 0 -- 172.21.15.97:0/1761709300 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x563bb6115940 msgr2=0x563bb6117d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:05:54.151+0000 7f759cff9640 1 client.7082.objecter ms_handle_reset 0x563bb6115940 session 0x563bb61152c0 osd.1 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:05:54.151+0000 7f76bad8a640 10 monclient: get_auth_request con 0x563bb61116e0 auth_method 0 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:54.340 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 zone default found 2024-09-12T18:05:54.341 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 4 Realm: () 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 zonegroup default 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:05:54.159+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:05:54.163+0000 7f76bd2849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:05:54.163+0000 7f76bd2849c0 20 started sync module instance, tier type = 2024-09-12T18:05:54.342 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:05:54.163+0000 7f76bd2849c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=0 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=1 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=2 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=3 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=4 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=5 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:05:54.183+0000 7f76bd2849c0 20 add_watcher() i=6 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 20 add_watcher() i=7 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding auth protocol: cephx 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding auth protocol: cephx 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding auth protocol: cephx 2024-09-12T18:05:54.343 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:05:54.187+0000 7f75717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: crc 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 AuthRegistry(0x7fff0ee3a450) adding con mode: secure 2024-09-12T18:05:54.344 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command cache list hook 0x563bb6101ec0 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command cache inspect hook 0x563bb6101ec0 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command cache erase hook 0x563bb6101ec0 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command cache zap hook 0x563bb6101ec0 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:05:54.187+0000 7f76bd2849c0 5 note: GC not initialized 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:05:54.191+0000 7f74ebfff640 20 reqs_thread_entry: start 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command sync trace show hook 0x7f76b40bb210 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command sync trace history hook 0x7f76b40bb210 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command sync trace active hook 0x7f76b40bb210 2024-09-12T18:05:54.345 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 5 asok(0x563bb5e1d2b0) register_command sync trace active_short hook 0x7f76b40bb210 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 Filter name: none 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:05:54.191+0000 7f74e9ffb640 20 reqs_thread_entry: start 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 : miss 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:05:54.346 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:05:54.191+0000 7f76bd2849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34, ofs0, ns] 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431649 cookie 94814457638944 notifier 7082 bl.length()=911 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:05:54.203+0000 7f759e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.347 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_sources= new_sources= 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential sources added=[] removed=[] 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_dests= new_dests= 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:05:54.203+0000 7f76bd2849c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential dests added=[] removed=[] 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:05:54.215+0000 7f76bd2849c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f76bd2849c0 time 2024-09-12T18:05:54.217875+0000 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f76c0b5e2eb] 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f76c0b5e49f] 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563bb43570c1] 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563bb43691fa] 2024-09-12T18:05:54.348 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f76bf9c4d90] 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:05:54.215+0000 7f76bd2849c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f76bd2849c0 thread_name:radosgw-admin 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f76bf9dd520] 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:05:54.349 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f76c0b5e345] 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f76c0b5e49f] 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563bb43570c1] 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563bb43691fa] 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f76bf9c4d90] 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:05:54.350 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:05:54.351 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:05:54.352 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:05:54.353 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:05:54.354 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:05:54.355 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:05:54.356 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: 7f74e9ffb640 / http_manager 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: 7f74ebfff640 / http_manager 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: 7f75717e2640 / rgw_dt_lg_renew 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: 7f759cff9640 / ms_dispatch 2024-09-12T18:05:54.357 INFO:tasks.workunit.client.0.smithi097.stderr: 7f759e7fc640 / io_context_pool 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr: 7f75a4e01640 / ms_dispatch 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr: 7f75a7606640 / ms_dispatch 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr: 7f75a8e09640 / io_context_pool 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr: 7f76b2589640 / msgr-worker-2 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr: 7f76ba589640 / io_context_pool 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr: 7f76bad8a640 / msgr-worker-1 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr: 7f76bb58b640 / msgr-worker-0 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr: 7f76bd2849c0 / radosgw-admin 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:05:54.219901Z_f8c1a839-2753-4bbd-afc7-fd15e600d1ef/log 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:05:54.358 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:05:54.359 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T18:05:54.363 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:54.363 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:54.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.295+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.299+0000 7fc6dd2239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.299+0000 7fc6dd2239c0 20 realm 2024-09-12T18:05:54.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.299+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.299+0000 7fc6dd2239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.299+0000 7fc6dd2239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:54.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.299+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.299+0000 7fc6dd2239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.299+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.303+0000 7fc6dd2239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.303+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.303+0000 7fc6dd2239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.303+0000 7fc6dd2239c0 20 searching for the correct realm 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.311+0000 7fc6db52a640 0 -- 172.21.15.97:0/1111354916 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55fc789f3780 msgr2=0x55fc789f5bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.315+0000 7fc6db52a640 0 -- 172.21.15.97:0/1111354916 >> [v2:172.21.15.154:6808/3304684764,v1:172.21.15.154:6809/3304684764] conn(0x7fc6cc04ba70 msgr2=0x7fc6cc05b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:54.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 zone default found 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 4 Realm: () 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:54.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 zonegroup default 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.323+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.327+0000 7fc6dd2239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.327+0000 7fc6dd2239c0 20 started sync module instance, tier type = 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.327+0000 7fc6dd2239c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.347+0000 7fc6dd2239c0 20 add_watcher() i=0 2024-09-12T18:05:54.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.347+0000 7fc6dd2239c0 20 add_watcher() i=1 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.347+0000 7fc6dd2239c0 20 add_watcher() i=2 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.347+0000 7fc6dd2239c0 20 add_watcher() i=3 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.347+0000 7fc6dd2239c0 20 add_watcher() i=4 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.347+0000 7fc6dd2239c0 20 add_watcher() i=5 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.347+0000 7fc6dd2239c0 20 add_watcher() i=6 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.347+0000 7fc6dd2239c0 20 add_watcher() i=7 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.347+0000 7fc6dd2239c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.351+0000 7fc5917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 5 note: GC not initialized 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc50bfff640 20 reqs_thread_entry: start 2024-09-12T18:05:54.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:54.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 Filter name: none 2024-09-12T18:05:54.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc509ffb640 20 reqs_thread_entry: start 2024-09-12T18:05:54.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:54.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:05:54.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:54.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:54.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:05:54.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.355+0000 7fc6dd2239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:05:54.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.359+0000 7fc5917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.363+0000 7fc6dd2239c0 20 remove_watcher() i=0 2024-09-12T18:05:54.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.363+0000 7fc6dd2239c0 2 removed watcher, disabling cache 2024-09-12T18:05:54.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.363+0000 7fc6dd2239c0 20 remove_watcher() i=1 2024-09-12T18:05:54.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.367+0000 7fc6dd2239c0 20 remove_watcher() i=2 2024-09-12T18:05:54.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.367+0000 7fc6dd2239c0 20 remove_watcher() i=3 2024-09-12T18:05:54.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.371+0000 7fc6dd2239c0 20 remove_watcher() i=4 2024-09-12T18:05:54.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.371+0000 7fc6dd2239c0 20 remove_watcher() i=5 2024-09-12T18:05:54.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.375+0000 7fc6dd2239c0 20 remove_watcher() i=6 2024-09-12T18:05:54.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.379+0000 7fc6dd2239c0 20 remove_watcher() i=7 2024-09-12T18:05:54.392 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.392 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:05:54.392 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-do-reshard id: 98539659-fdaf-41ce-847d-239ff89323af.4641.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:05:54.392 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:05:54.393 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:54.393 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:54.432 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:05:54.432 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:05:54.491 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:05:54.524 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:05:54.525 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:05:54.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.567+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.571+0000 7f260bfc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.571+0000 7f260bfc99c0 20 realm 2024-09-12T18:05:54.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.571+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.571+0000 7f260bfc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.571+0000 7f260bfc99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:05:54.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.571+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.571+0000 7f260bfc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.571+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.571+0000 7f260bfc99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.571+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.575+0000 7f260bfc99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:05:54.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.575+0000 7f260bfc99c0 20 searching for the correct realm 2024-09-12T18:05:54.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.579+0000 7f260a2d0640 0 -- 172.21.15.97:0/4257205109 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x559b1c7e2aa0 msgr2=0x559b1c7e4e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:54.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.587+0000 7f2609acf640 0 -- 172.21.15.97:0/4257205109 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x559b1c7e6da0 msgr2=0x559b1c7e9190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:05:54.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.591+0000 7f260bfc99c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:05:54.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.591+0000 7f260bfc99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:05:54.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.591+0000 7f260bfc99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:05:54.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.591+0000 7f260bfc99c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:05:54.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.591+0000 7f260bfc99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:05:54.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.591+0000 7f260bfc99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:05:54.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.591+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.591+0000 7f260bfc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.591+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.591+0000 7f260bfc99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:05:54.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.591+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:05:54.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 20 zone default found 2024-09-12T18:05:54.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 4 Realm: () 2024-09-12T18:05:54.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:05:54.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:05:54.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:05:54.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 20 zonegroup default 2024-09-12T18:05:54.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:05:54.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 20 started sync module instance, tier type = 2024-09-12T18:05:54.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.595+0000 7f260bfc99c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:05:54.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.611+0000 7f260bfc99c0 20 add_watcher() i=0 2024-09-12T18:05:54.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.611+0000 7f260bfc99c0 20 add_watcher() i=1 2024-09-12T18:05:54.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.611+0000 7f260bfc99c0 20 add_watcher() i=2 2024-09-12T18:05:54.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.611+0000 7f260bfc99c0 20 add_watcher() i=3 2024-09-12T18:05:54.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.611+0000 7f260bfc99c0 20 add_watcher() i=4 2024-09-12T18:05:54.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.611+0000 7f260bfc99c0 20 add_watcher() i=5 2024-09-12T18:05:54.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.615+0000 7f260bfc99c0 20 add_watcher() i=6 2024-09-12T18:05:54.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.615+0000 7f260bfc99c0 20 add_watcher() i=7 2024-09-12T18:05:54.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.615+0000 7f260bfc99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:05:54.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f24bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:05:54.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:05:54.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 5 note: GC not initialized 2024-09-12T18:05:54.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f24befe5640 20 reqs_thread_entry: start 2024-09-12T18:05:54.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 20 init_complete bucket index max shards: 11 2024-09-12T18:05:54.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 20 Filter name: none 2024-09-12T18:05:54.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f24bcfe1640 20 reqs_thread_entry: start 2024-09-12T18:05:54.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:05:54.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:05:54.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:05:54.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:05:54.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 : miss 2024-09-12T18:05:54.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 20 rados->read ofs=0 len=0 2024-09-12T18:05:54.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:05:54.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:05:54.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:05:54.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:05:54.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:05:54.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.619+0000 7f260bfc99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 2024-09-12T18:05:54.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.623+0000 7f260bfc99c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to be held by another RGW process; skipping for now 2024-09-12T18:05:54.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.623+0000 7f24bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:05:54.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.627+0000 7f260bfc99c0 20 remove_watcher() i=0 2024-09-12T18:05:54.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.627+0000 7f260bfc99c0 2 removed watcher, disabling cache 2024-09-12T18:05:54.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.631+0000 7f260bfc99c0 20 remove_watcher() i=1 2024-09-12T18:05:54.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.631+0000 7f260bfc99c0 20 remove_watcher() i=2 2024-09-12T18:05:54.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.635+0000 7f260bfc99c0 20 remove_watcher() i=3 2024-09-12T18:05:54.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.635+0000 7f260bfc99c0 20 remove_watcher() i=4 2024-09-12T18:05:54.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.639+0000 7f260bfc99c0 20 remove_watcher() i=5 2024-09-12T18:05:54.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.639+0000 7f260bfc99c0 20 remove_watcher() i=6 2024-09-12T18:05:54.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:05:54.643+0000 7f260bfc99c0 20 remove_watcher() i=7 2024-09-12T18:05:54.657 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:06:24.670 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:06:24.707 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:24.707 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:24.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.751+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.755+0000 7fa1599399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:24.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.755+0000 7fa1599399c0 20 realm 2024-09-12T18:06:24.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.755+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.755+0000 7fa1599399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:24.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.755+0000 7fa1599399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:24.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.755+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.755+0000 7fa1599399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:24.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.755+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.755+0000 7fa1599399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:24.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.755+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.759+0000 7fa1599399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:24.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.759+0000 7fa1599399c0 20 searching for the correct realm 2024-09-12T18:06:24.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.763+0000 7fa15743f640 0 -- 172.21.15.97:0/3783959766 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fa148036030 msgr2=0x7fa148068d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:24.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.771+0000 7fa15743f640 0 -- 172.21.15.97:0/3783959766 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fa15002e940 msgr2=0x7fa150037400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:24.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:24.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:24.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:24.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:24.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:24.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:24.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:24.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:24.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:24.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 zone default found 2024-09-12T18:06:24.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 4 Realm: () 2024-09-12T18:06:24.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:24.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:24.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:24.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 zonegroup default 2024-09-12T18:06:24.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:24.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 started sync module instance, tier type = 2024-09-12T18:06:24.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.779+0000 7fa1599399c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:24.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.799+0000 7fa1599399c0 20 add_watcher() i=0 2024-09-12T18:06:24.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.799+0000 7fa1599399c0 20 add_watcher() i=1 2024-09-12T18:06:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.799+0000 7fa1599399c0 20 add_watcher() i=2 2024-09-12T18:06:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.799+0000 7fa1599399c0 20 add_watcher() i=3 2024-09-12T18:06:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.799+0000 7fa1599399c0 20 add_watcher() i=4 2024-09-12T18:06:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.799+0000 7fa1599399c0 20 add_watcher() i=5 2024-09-12T18:06:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.799+0000 7fa1599399c0 20 add_watcher() i=6 2024-09-12T18:06:24.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.799+0000 7fa1599399c0 20 add_watcher() i=7 2024-09-12T18:06:24.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.799+0000 7fa1599399c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:24.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.803+0000 7fa00dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:24.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.803+0000 7fa1599399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:24.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.803+0000 7fa1599399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:24.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.803+0000 7fa1599399c0 5 note: GC not initialized 2024-09-12T18:06:24.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa00cfe1640 20 reqs_thread_entry: start 2024-09-12T18:06:24.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:24.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 20 Filter name: none 2024-09-12T18:06:24.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7f9f867fc640 20 reqs_thread_entry: start 2024-09-12T18:06:24.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:06:24.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:06:24.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:06:24.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:06:24.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 : miss 2024-09-12T18:06:24.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:06:24.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:06:24.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:06:24.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:24.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:24.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 2024-09-12T18:06:24.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.807+0000 7fa1599399c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:06:24.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa1599399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:06:24.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa1599399c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:06:24.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa1599399c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:24.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa1599399c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34, ofs0, ns] 2024-09-12T18:06:24.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa03a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431650 cookie 94249119603680 notifier 7590 bl.length()=911 2024-09-12T18:06:24.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa03a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:06:24.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa03a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:06:24.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa03a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:24.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_sources= new_sources= 2024-09-12T18:06:24.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential sources added=[] removed=[] 2024-09-12T18:06:24.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_dests= new_dests= 2024-09-12T18:06:24.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.823+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential dests added=[] removed=[] 2024-09-12T18:06:24.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.0 2024-09-12T18:06:24.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.0 2024-09-12T18:06:24.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.1 2024-09-12T18:06:24.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.1 2024-09-12T18:06:24.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.2 2024-09-12T18:06:24.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.2 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.3 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.3 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.4 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.4 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.5 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.5 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.6 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.6 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.7 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.7 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.8 2024-09-12T18:06:24.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.8 2024-09-12T18:06:24.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.9 2024-09-12T18:06:24.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.9 2024-09-12T18:06:24.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.10 2024-09-12T18:06:24.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.10 2024-09-12T18:06:24.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.11 2024-09-12T18:06:24.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2.11 2024-09-12T18:06:24.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.835+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.0 2024-09-12T18:06:24.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.839+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.1 2024-09-12T18:06:24.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.839+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2 2024-09-12T18:06:24.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.839+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.3 2024-09-12T18:06:24.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.839+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.4 2024-09-12T18:06:24.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.843+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.5 2024-09-12T18:06:24.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.843+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.6 2024-09-12T18:06:24.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.843+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.7 2024-09-12T18:06:24.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.843+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.8 2024-09-12T18:06:24.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.847+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.9 2024-09-12T18:06:24.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.847+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.10 2024-09-12T18:06:24.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.851+0000 7fa1599399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:24.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.851+0000 7fa1599399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 2024-09-12T18:06:24.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.855+0000 7fa1599399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:06:24.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.855+0000 7fa1599399c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:06:24.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.855+0000 7fa1599399c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:24.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.855+0000 7fa1599399c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34, ofs0, ns] 2024-09-12T18:06:24.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.855+0000 7fa03affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431651 cookie 94249119603680 notifier 7590 bl.length()=911 2024-09-12T18:06:24.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.855+0000 7fa03affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:06:24.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.855+0000 7fa03affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:06:24.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.855+0000 7fa03affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:24.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.859+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_sources= new_sources= 2024-09-12T18:06:24.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.859+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential sources added=[] removed=[] 2024-09-12T18:06:24.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.859+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_dests= new_dests= 2024-09-12T18:06:24.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.859+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential dests added=[] removed=[] 2024-09-12T18:06:24.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.863+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.0 2024-09-12T18:06:24.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.863+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.1 2024-09-12T18:06:24.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.863+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.2 2024-09-12T18:06:24.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.863+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.3 2024-09-12T18:06:24.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.867+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.4 2024-09-12T18:06:24.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.867+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.5 2024-09-12T18:06:24.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.867+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.6 2024-09-12T18:06:24.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.867+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.7 2024-09-12T18:06:24.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.867+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.8 2024-09-12T18:06:24.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.871+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.9 2024-09-12T18:06:24.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.871+0000 7fa1599399c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.34.10 2024-09-12T18:06:24.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.871+0000 7fa1599399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:24.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.871+0000 7fa1599399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 2024-09-12T18:06:24.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.875+0000 7fa1599399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:06:24.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.875+0000 7fa1599399c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:06:24.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.875+0000 7fa1599399c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:24.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.875+0000 7fa1599399c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34, ofs0, ns] 2024-09-12T18:06:24.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.875+0000 7fa03affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431652 cookie 94249119603680 notifier 7590 bl.length()=879 2024-09-12T18:06:24.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.875+0000 7fa03affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 info.flags=0x17 2024-09-12T18:06:24.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.875+0000 7fa03affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:98539659-fdaf-41ce-847d-239ff89323af.4641.34 to cache LRU end 2024-09-12T18:06:24.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.875+0000 7fa03affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:24.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.879+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_sources= new_sources= 2024-09-12T18:06:24.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.879+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential sources added=[] removed=[] 2024-09-12T18:06:24.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.879+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): orig_dests= new_dests= 2024-09-12T18:06:24.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.879+0000 7fa1599399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[98539659-fdaf-41ce-847d-239ff89323af.4641.34]): potential dests added=[] removed=[] 2024-09-12T18:06:24.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.883+0000 7fa1599399c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T18:06:24.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.887+0000 7fa00dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:24.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.891+0000 7fa1599399c0 20 remove_watcher() i=0 2024-09-12T18:06:24.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.891+0000 7fa1599399c0 2 removed watcher, disabling cache 2024-09-12T18:06:24.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.891+0000 7fa1599399c0 20 remove_watcher() i=1 2024-09-12T18:06:24.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.895+0000 7fa1599399c0 20 remove_watcher() i=2 2024-09-12T18:06:24.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.895+0000 7fa1599399c0 20 remove_watcher() i=3 2024-09-12T18:06:24.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.899+0000 7fa1599399c0 20 remove_watcher() i=4 2024-09-12T18:06:24.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.899+0000 7fa1599399c0 20 remove_watcher() i=5 2024-09-12T18:06:24.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.903+0000 7fa1599399c0 20 remove_watcher() i=6 2024-09-12T18:06:24.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.907+0000 7fa1599399c0 20 remove_watcher() i=7 2024-09-12T18:06:24.921 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T18:06:24.949 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:24.949 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:24.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.995+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.995+0000 7f90143da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.995+0000 7f90143da9c0 20 realm 2024-09-12T18:06:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.995+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.999+0000 7f90143da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.999+0000 7f90143da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.999+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.999+0000 7f90143da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:24.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.999+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:24.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.999+0000 7f90143da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:24.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.999+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:25.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.999+0000 7f90143da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:25.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:24.999+0000 7f90143da9c0 20 searching for the correct realm 2024-09-12T18:06:25.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.007+0000 7f90116df640 0 -- 172.21.15.97:0/4037017188 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f900810c0a0 msgr2=0x7f9008009d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:25.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.011+0000 7f90126e1640 0 -- 172.21.15.97:0/4037017188 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55f9b19a9d10 msgr2=0x55f9b19ac190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:25.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:25.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:25.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:25.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:25.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:25.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:25.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:25.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:25.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:25.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:25.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:25.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:25.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 zone default found 2024-09-12T18:06:25.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 4 Realm: () 2024-09-12T18:06:25.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:25.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:25.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:25.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 zonegroup default 2024-09-12T18:06:25.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:25.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:25.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:25.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:25.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.019+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:25.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.023+0000 7f90143da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:25.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.023+0000 7f90143da9c0 20 started sync module instance, tier type = 2024-09-12T18:06:25.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.023+0000 7f90143da9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:25.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.039+0000 7f90143da9c0 20 add_watcher() i=0 2024-09-12T18:06:25.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.039+0000 7f90143da9c0 20 add_watcher() i=1 2024-09-12T18:06:25.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.039+0000 7f90143da9c0 20 add_watcher() i=2 2024-09-12T18:06:25.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.039+0000 7f90143da9c0 20 add_watcher() i=3 2024-09-12T18:06:25.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.039+0000 7f90143da9c0 20 add_watcher() i=4 2024-09-12T18:06:25.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.039+0000 7f90143da9c0 20 add_watcher() i=5 2024-09-12T18:06:25.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.039+0000 7f90143da9c0 20 add_watcher() i=6 2024-09-12T18:06:25.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.043+0000 7f90143da9c0 20 add_watcher() i=7 2024-09-12T18:06:25.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.043+0000 7f90143da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:25.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.043+0000 7f8ec37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:25.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:25.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:25.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 5 note: GC not initialized 2024-09-12T18:06:25.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f8ec27fc640 20 reqs_thread_entry: start 2024-09-12T18:06:25.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:25.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 Filter name: none 2024-09-12T18:06:25.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f8e33fff640 20 reqs_thread_entry: start 2024-09-12T18:06:25.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:25.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:06:25.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:25.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:06:25.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:25.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:25.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:06:25.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:25.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:06:25.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.047+0000 7f90143da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:25.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.051+0000 7f8ec37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:25.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.055+0000 7f90143da9c0 20 remove_watcher() i=0 2024-09-12T18:06:25.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.055+0000 7f90143da9c0 2 removed watcher, disabling cache 2024-09-12T18:06:25.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.055+0000 7f90143da9c0 20 remove_watcher() i=1 2024-09-12T18:06:25.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.059+0000 7f90143da9c0 20 remove_watcher() i=2 2024-09-12T18:06:25.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.063+0000 7f90143da9c0 20 remove_watcher() i=3 2024-09-12T18:06:25.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.063+0000 7f90143da9c0 20 remove_watcher() i=4 2024-09-12T18:06:25.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.063+0000 7f90143da9c0 20 remove_watcher() i=5 2024-09-12T18:06:25.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.067+0000 7f90143da9c0 20 remove_watcher() i=6 2024-09-12T18:06:25.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:25.071+0000 7f90143da9c0 20 remove_watcher() i=7 2024-09-12T18:06:25.084 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:25.084 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:06:25.084 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-do-reshard id: 98539659-fdaf-41ce-847d-239ff89323af.4641.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:06:25.084 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:25.085 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:25.085 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:25.104 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:25.104 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:25.600 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:25.600 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:25.974 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T18:06:25.974 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:25.977 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:25.977 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:26.109 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:26.109 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:26.197 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:26.197 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:26.301 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:26.302 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:26.399 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:26.399 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:26.496 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:26.496 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:26.598 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:26.598 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:26.694 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:26.694 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:26.789 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:26.790 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:26.885 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:26.885 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:26.989 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:26.990 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:27.088 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:27.089 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:27.185 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:27.185 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:27.285 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:27.285 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:27.379 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:27.380 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:27.475 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:27.475 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:27.572 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:27.572 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:27.665 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:27.665 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:27.760 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:27.857 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:27.857 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:27.951 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:27.951 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:28.050 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:28.051 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:28.139 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T18:06:28.171 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:28.172 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:28.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.219+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.219+0000 7fab7a1a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.219+0000 7fab7a1a19c0 20 realm 2024-09-12T18:06:28.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.219+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.219+0000 7fab7a1a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.219+0000 7fab7a1a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:28.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.219+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.219+0000 7fab7a1a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.219+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.223+0000 7fab7a1a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:28.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.223+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.223+0000 7fab7a1a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:28.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.223+0000 7fab7a1a19c0 20 searching for the correct realm 2024-09-12T18:06:28.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.227+0000 7fab774a6640 0 -- 172.21.15.97:0/880772533 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fab60088c20 msgr2=0x7fab6006c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:28.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.235+0000 7fab784a8640 0 -- 172.21.15.97:0/880772533 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55713ceb0480 msgr2=0x55713ceb28e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:28.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:28.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:28.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:28.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:28.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:28.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:28.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:28.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:28.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 zone default found 2024-09-12T18:06:28.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 4 Realm: () 2024-09-12T18:06:28.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:28.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:28.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:28.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 zonegroup default 2024-09-12T18:06:28.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.243+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.247+0000 7fab7a1a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.247+0000 7fab7a1a19c0 20 started sync module instance, tier type = 2024-09-12T18:06:28.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.247+0000 7fab7a1a19c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:28.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.263+0000 7fab7a1a19c0 20 add_watcher() i=0 2024-09-12T18:06:28.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.263+0000 7fab7a1a19c0 20 add_watcher() i=1 2024-09-12T18:06:28.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.263+0000 7fab7a1a19c0 20 add_watcher() i=2 2024-09-12T18:06:28.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.263+0000 7fab7a1a19c0 20 add_watcher() i=3 2024-09-12T18:06:28.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.263+0000 7fab7a1a19c0 20 add_watcher() i=4 2024-09-12T18:06:28.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.263+0000 7fab7a1a19c0 20 add_watcher() i=5 2024-09-12T18:06:28.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.263+0000 7fab7a1a19c0 20 add_watcher() i=6 2024-09-12T18:06:28.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.267+0000 7fab7a1a19c0 20 add_watcher() i=7 2024-09-12T18:06:28.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.267+0000 7fab7a1a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:28.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7faa2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:28.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fab7a1a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:28.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fab7a1a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:28.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fab7a1a19c0 5 note: GC not initialized 2024-09-12T18:06:28.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7faa2cfe1640 20 reqs_thread_entry: start 2024-09-12T18:06:28.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fab7a1a19c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:28.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fab7a1a19c0 20 Filter name: none 2024-09-12T18:06:28.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fa9a67fc640 20 reqs_thread_entry: start 2024-09-12T18:06:28.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fab7a1a19c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:28.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fab7a1a19c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:28.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fab7a1a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:28.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.271+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.275+0000 7fab7a1a19c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:28.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.275+0000 7fab7a1a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.275+0000 7fab7a1a19c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:28.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.275+0000 7fab7a1a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:28.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.275+0000 7faa2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:28.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.279+0000 7fab7a1a19c0 20 remove_watcher() i=0 2024-09-12T18:06:28.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.279+0000 7fab7a1a19c0 2 removed watcher, disabling cache 2024-09-12T18:06:28.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.283+0000 7fab7a1a19c0 20 remove_watcher() i=1 2024-09-12T18:06:28.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.283+0000 7fab7a1a19c0 20 remove_watcher() i=2 2024-09-12T18:06:28.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.287+0000 7fab7a1a19c0 20 remove_watcher() i=3 2024-09-12T18:06:28.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.287+0000 7fab7a1a19c0 20 remove_watcher() i=4 2024-09-12T18:06:28.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.291+0000 7fab7a1a19c0 20 remove_watcher() i=5 2024-09-12T18:06:28.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.295+0000 7fab7a1a19c0 20 remove_watcher() i=6 2024-09-12T18:06:28.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.295+0000 7fab7a1a19c0 20 remove_watcher() i=7 2024-09-12T18:06:28.310 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:28.310 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:06:28.310 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-logrecord-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:06:28.310 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:28.310 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T18:06:28.344 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:28.345 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:28.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.391+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.391+0000 7f733b9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.391+0000 7f733b9119c0 20 realm 2024-09-12T18:06:28.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.391+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.391+0000 7f733b9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.391+0000 7f733b9119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:28.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.391+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.391+0000 7f733b9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.391+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.395+0000 7f733b9119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:28.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.395+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.395+0000 7f733b9119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:28.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.395+0000 7f733b9119c0 20 searching for the correct realm 2024-09-12T18:06:28.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.403+0000 7f7339c18640 0 -- 172.21.15.97:0/771480147 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55ae9b619170 msgr2=0x55ae9b61b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:28.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.407+0000 7f7339417640 0 -- 172.21.15.97:0/771480147 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55ae9b61d4e0 msgr2=0x55ae9b61f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:28.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:28.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:28.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:28.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:28.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:28.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:28.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:28.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:28.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 zone default found 2024-09-12T18:06:28.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 4 Realm: () 2024-09-12T18:06:28.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:28.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:28.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:28.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 zonegroup default 2024-09-12T18:06:28.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.415+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.419+0000 7f733b9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.419+0000 7f733b9119c0 20 started sync module instance, tier type = 2024-09-12T18:06:28.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.419+0000 7f733b9119c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:28.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.435+0000 7f733b9119c0 20 add_watcher() i=0 2024-09-12T18:06:28.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.435+0000 7f733b9119c0 20 add_watcher() i=1 2024-09-12T18:06:28.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.435+0000 7f733b9119c0 20 add_watcher() i=2 2024-09-12T18:06:28.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.435+0000 7f733b9119c0 20 add_watcher() i=3 2024-09-12T18:06:28.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.435+0000 7f733b9119c0 20 add_watcher() i=4 2024-09-12T18:06:28.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.435+0000 7f733b9119c0 20 add_watcher() i=5 2024-09-12T18:06:28.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.435+0000 7f733b9119c0 20 add_watcher() i=6 2024-09-12T18:06:28.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.439+0000 7f733b9119c0 20 add_watcher() i=7 2024-09-12T18:06:28.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.439+0000 7f733b9119c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:28.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.439+0000 7f71ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:28.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:28.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:28.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 5 note: GC not initialized 2024-09-12T18:06:28.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f71ee7e4640 20 reqs_thread_entry: start 2024-09-12T18:06:28.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:28.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 20 Filter name: none 2024-09-12T18:06:28.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f715ffff640 20 reqs_thread_entry: start 2024-09-12T18:06:28.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T18:06:28.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:28.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T18:06:28.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T18:06:28.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 : miss 2024-09-12T18:06:28.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:28.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:28.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.443+0000 7f733b9119c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 2024-09-12T18:06:28.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.455+0000 7f733b9119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.455+0000 7f733b9119c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.455+0000 7f733b9119c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.455+0000 7f733b9119c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35, ofs0, ns] 2024-09-12T18:06:28.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.455+0000 7f720bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431602 cookie 94208419559280 notifier 7187 bl.length()=923 2024-09-12T18:06:28.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.455+0000 7f720bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.455+0000 7f720bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.455+0000 7f720bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.459+0000 7f733b9119c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): orig_sources= new_sources= 2024-09-12T18:06:28.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.459+0000 7f733b9119c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): potential sources added=[] removed=[] 2024-09-12T18:06:28.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.459+0000 7f733b9119c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): orig_dests= new_dests= 2024-09-12T18:06:28.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.459+0000 7f733b9119c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): potential dests added=[] removed=[] 2024-09-12T18:06:28.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.463+0000 7f733b9119c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T18:06:28.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.463+0000 7f733b9119c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T18:06:28.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.475+0000 7f733b9119c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:28.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.475+0000 7f733b9119c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 2024-09-12T18:06:28.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f733b9119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f733b9119c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f733b9119c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f733b9119c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35, ofs0, ns] 2024-09-12T18:06:28.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f720bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94208419559280 notifier 7187 bl.length()=891 2024-09-12T18:06:28.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f720bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f720bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f720bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f733b9119c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): orig_sources= new_sources= 2024-09-12T18:06:28.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f733b9119c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): potential sources added=[] removed=[] 2024-09-12T18:06:28.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f733b9119c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): orig_dests= new_dests= 2024-09-12T18:06:28.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.479+0000 7f733b9119c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): potential dests added=[] removed=[] 2024-09-12T18:06:28.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.483+0000 7f71ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:28.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.487+0000 7f733b9119c0 20 remove_watcher() i=0 2024-09-12T18:06:28.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.487+0000 7f733b9119c0 2 removed watcher, disabling cache 2024-09-12T18:06:28.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.491+0000 7f733b9119c0 20 remove_watcher() i=1 2024-09-12T18:06:28.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.491+0000 7f733b9119c0 20 remove_watcher() i=2 2024-09-12T18:06:28.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.495+0000 7f733b9119c0 20 remove_watcher() i=3 2024-09-12T18:06:28.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.495+0000 7f733b9119c0 20 remove_watcher() i=4 2024-09-12T18:06:28.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.499+0000 7f733b9119c0 20 remove_watcher() i=5 2024-09-12T18:06:28.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.503+0000 7f733b9119c0 20 remove_watcher() i=6 2024-09-12T18:06:28.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.507+0000 7f733b9119c0 20 remove_watcher() i=7 2024-09-12T18:06:28.520 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T18:06:28.546 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:28.546 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:28.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.587+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.591+0000 7f327daac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.591+0000 7f327daac9c0 20 realm 2024-09-12T18:06:28.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.591+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.591+0000 7f327daac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.591+0000 7f327daac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:28.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.591+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.591+0000 7f327daac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.591+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.591+0000 7f327daac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:28.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.591+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.595+0000 7f327daac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:28.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.595+0000 7f327daac9c0 20 searching for the correct realm 2024-09-12T18:06:28.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.599+0000 7f327b5b2640 0 -- 172.21.15.97:0/2543714061 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f326c0c7020 msgr2=0x7f326c0f75b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:28.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.607+0000 7f327b5b2640 0 -- 172.21.15.97:0/2543714061 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f327402c060 msgr2=0x7f327409d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:28.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.611+0000 7f327daac9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:28.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.611+0000 7f327daac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:28.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.611+0000 7f327daac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:28.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.611+0000 7f327daac9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:28.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.611+0000 7f327daac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:28.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.611+0000 7f327daac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:28.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.611+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.611+0000 7f327daac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.611+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.611+0000 7f327daac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:28.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.611+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:28.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 20 zone default found 2024-09-12T18:06:28.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 4 Realm: () 2024-09-12T18:06:28.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:28.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:28.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:28.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 20 zonegroup default 2024-09-12T18:06:28.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 20 started sync module instance, tier type = 2024-09-12T18:06:28.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.615+0000 7f327daac9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:28.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.635+0000 7f327daac9c0 20 add_watcher() i=0 2024-09-12T18:06:28.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.635+0000 7f327daac9c0 20 add_watcher() i=1 2024-09-12T18:06:28.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.635+0000 7f327daac9c0 20 add_watcher() i=2 2024-09-12T18:06:28.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.635+0000 7f327daac9c0 20 add_watcher() i=3 2024-09-12T18:06:28.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.635+0000 7f327daac9c0 20 add_watcher() i=4 2024-09-12T18:06:28.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.635+0000 7f327daac9c0 20 add_watcher() i=5 2024-09-12T18:06:28.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.635+0000 7f327daac9c0 20 add_watcher() i=6 2024-09-12T18:06:28.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.635+0000 7f327daac9c0 20 add_watcher() i=7 2024-09-12T18:06:28.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.635+0000 7f327daac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:28.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.639+0000 7f3131fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:28.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.639+0000 7f327daac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:28.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.639+0000 7f327daac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:28.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.639+0000 7f327daac9c0 5 note: GC not initialized 2024-09-12T18:06:28.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.639+0000 7f3130fe1640 20 reqs_thread_entry: start 2024-09-12T18:06:28.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.639+0000 7f327daac9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:28.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.639+0000 7f327daac9c0 20 Filter name: none 2024-09-12T18:06:28.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.639+0000 7f30aa7fc640 20 reqs_thread_entry: start 2024-09-12T18:06:28.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.639+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.643+0000 7f327daac9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:28.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.643+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.643+0000 7f327daac9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:28.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.643+0000 7f327daac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:28.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.643+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.643+0000 7f327daac9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:28.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.643+0000 7f327daac9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.643+0000 7f327daac9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:28.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.643+0000 7f327daac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:28.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.647+0000 7f3131fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:28.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.651+0000 7f327daac9c0 20 remove_watcher() i=0 2024-09-12T18:06:28.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.651+0000 7f327daac9c0 2 removed watcher, disabling cache 2024-09-12T18:06:28.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.655+0000 7f327daac9c0 20 remove_watcher() i=1 2024-09-12T18:06:28.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.655+0000 7f327daac9c0 20 remove_watcher() i=2 2024-09-12T18:06:28.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.659+0000 7f327daac9c0 20 remove_watcher() i=3 2024-09-12T18:06:28.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.659+0000 7f327daac9c0 20 remove_watcher() i=4 2024-09-12T18:06:28.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.659+0000 7f327daac9c0 20 remove_watcher() i=5 2024-09-12T18:06:28.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.663+0000 7f327daac9c0 20 remove_watcher() i=6 2024-09-12T18:06:28.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.667+0000 7f327daac9c0 20 remove_watcher() i=7 2024-09-12T18:06:28.680 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:28.680 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:06:28.681 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-logrecord-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:06:28.681 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:28.681 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:28.682 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:28.718 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:28.718 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:28.779 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:06:28.814 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:28.814 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:28.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.859+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.859+0000 7f83b74429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.859+0000 7f83b74429c0 20 realm 2024-09-12T18:06:28.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.859+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.859+0000 7f83b74429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.859+0000 7f83b74429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:28.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.859+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.859+0000 7f83b74429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.859+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.863+0000 7f83b74429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:28.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.863+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.863+0000 7f83b74429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:28.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.863+0000 7f83b74429c0 20 searching for the correct realm 2024-09-12T18:06:28.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.867+0000 7f83b5749640 0 -- 172.21.15.97:0/2599227749 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f839c017070 msgr2=0x7f839c09b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:28.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.875+0000 7f83b4f48640 0 -- 172.21.15.97:0/2599227749 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f83a4018070 msgr2=0x7f83a40580b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:28.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:28.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:28.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:28.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:28.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:28.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:28.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:28.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:28.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 zone default found 2024-09-12T18:06:28.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 4 Realm: () 2024-09-12T18:06:28.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:28.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:28.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:28.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 zonegroup default 2024-09-12T18:06:28.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:28.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 started sync module instance, tier type = 2024-09-12T18:06:28.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.883+0000 7f83b74429c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:28.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.903+0000 7f83b74429c0 20 add_watcher() i=0 2024-09-12T18:06:28.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.903+0000 7f83b74429c0 20 add_watcher() i=1 2024-09-12T18:06:28.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.903+0000 7f83b74429c0 20 add_watcher() i=2 2024-09-12T18:06:28.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.903+0000 7f83b74429c0 20 add_watcher() i=3 2024-09-12T18:06:28.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.903+0000 7f83b74429c0 20 add_watcher() i=4 2024-09-12T18:06:28.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.903+0000 7f83b74429c0 20 add_watcher() i=5 2024-09-12T18:06:28.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.903+0000 7f83b74429c0 20 add_watcher() i=6 2024-09-12T18:06:28.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.907+0000 7f83b74429c0 20 add_watcher() i=7 2024-09-12T18:06:28.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.907+0000 7f83b74429c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:28.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.907+0000 7f826afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:28.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.907+0000 7f83b74429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:28.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.907+0000 7f83b74429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:28.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.907+0000 7f83b74429c0 5 note: GC not initialized 2024-09-12T18:06:28.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f8269fe3640 20 reqs_thread_entry: start 2024-09-12T18:06:28.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:28.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 20 Filter name: none 2024-09-12T18:06:28.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f81db7fe640 20 reqs_thread_entry: start 2024-09-12T18:06:28.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T18:06:28.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T18:06:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T18:06:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 : miss 2024-09-12T18:06:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.911+0000 7f83b74429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 2024-09-12T18:06:28.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f83b74429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f83b74429c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f83b74429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f83b74429c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35, ofs0, ns] 2024-09-12T18:06:28.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f828b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431604 cookie 93880228477472 notifier 7220 bl.length()=923 2024-09-12T18:06:28.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f828b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f828b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f828b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): orig_sources= new_sources= 2024-09-12T18:06:28.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): potential sources added=[] removed=[] 2024-09-12T18:06:28.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): orig_dests= new_dests= 2024-09-12T18:06:28.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.923+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): potential dests added=[] removed=[] 2024-09-12T18:06:28.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.0 2024-09-12T18:06:28.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.0 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.1 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.1 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.2 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.2 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.3 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.3 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.4 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.4 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.5 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.5 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.6 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.6 2024-09-12T18:06:28.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.7 2024-09-12T18:06:28.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.7 2024-09-12T18:06:28.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.8 2024-09-12T18:06:28.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.8 2024-09-12T18:06:28.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.9 2024-09-12T18:06:28.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.9 2024-09-12T18:06:28.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.10 2024-09-12T18:06:28.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.10 2024-09-12T18:06:28.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.11 2024-09-12T18:06:28.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1.11 2024-09-12T18:06:28.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.0 2024-09-12T18:06:28.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.939+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1 2024-09-12T18:06:28.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.943+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.2 2024-09-12T18:06:28.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.943+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.3 2024-09-12T18:06:28.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.943+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.4 2024-09-12T18:06:28.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.943+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.5 2024-09-12T18:06:28.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.943+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.6 2024-09-12T18:06:28.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.947+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.7 2024-09-12T18:06:28.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.947+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.8 2024-09-12T18:06:28.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.947+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.9 2024-09-12T18:06:28.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.947+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.10 2024-09-12T18:06:28.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.959+0000 7f83b74429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:28.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.959+0000 7f83b74429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 2024-09-12T18:06:28.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.959+0000 7f83b74429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.959+0000 7f83b74429c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.959+0000 7f83b74429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.959+0000 7f83b74429c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35, ofs0, ns] 2024-09-12T18:06:28.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.959+0000 7f828b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431605 cookie 93880228477472 notifier 7220 bl.length()=923 2024-09-12T18:06:28.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.959+0000 7f828b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.959+0000 7f828b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.959+0000 7f828b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.963+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): orig_sources= new_sources= 2024-09-12T18:06:28.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.963+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): potential sources added=[] removed=[] 2024-09-12T18:06:28.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.963+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): orig_dests= new_dests= 2024-09-12T18:06:28.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.963+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): potential dests added=[] removed=[] 2024-09-12T18:06:28.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.967+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.0 2024-09-12T18:06:28.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.971+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.1 2024-09-12T18:06:28.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.971+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.2 2024-09-12T18:06:28.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.971+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.3 2024-09-12T18:06:28.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.971+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.4 2024-09-12T18:06:28.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.971+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.5 2024-09-12T18:06:28.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.971+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.6 2024-09-12T18:06:28.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.975+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.7 2024-09-12T18:06:28.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.975+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.8 2024-09-12T18:06:28.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.975+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.9 2024-09-12T18:06:28.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.975+0000 7f83b74429c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.35.10 2024-09-12T18:06:28.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.975+0000 7f83b74429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 : hit (requested=0x17, cached=0x17) 2024-09-12T18:06:28.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.975+0000 7f83b74429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 2024-09-12T18:06:28.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.979+0000 7f83b74429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.979+0000 7f83b74429c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.979+0000 7f83b74429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.979+0000 7f83b74429c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35, ofs0, ns] 2024-09-12T18:06:28.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.979+0000 7f828b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431606 cookie 93880228477472 notifier 7220 bl.length()=891 2024-09-12T18:06:28.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.979+0000 7f828b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 info.flags=0x17 2024-09-12T18:06:28.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.979+0000 7f828b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.35 to cache LRU end 2024-09-12T18:06:28.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.979+0000 7f828b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:28.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.983+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): orig_sources= new_sources= 2024-09-12T18:06:28.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.983+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): potential sources added=[] removed=[] 2024-09-12T18:06:28.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.983+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): orig_dests= new_dests= 2024-09-12T18:06:28.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.983+0000 7f83b74429c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.35]): potential dests added=[] removed=[] 2024-09-12T18:06:28.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.987+0000 7f83b74429c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T18:06:28.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.991+0000 7f826afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:28.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.995+0000 7f83b74429c0 20 remove_watcher() i=0 2024-09-12T18:06:28.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.995+0000 7f83b74429c0 2 removed watcher, disabling cache 2024-09-12T18:06:28.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.999+0000 7f83b74429c0 20 remove_watcher() i=1 2024-09-12T18:06:29.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:28.999+0000 7f83b74429c0 20 remove_watcher() i=2 2024-09-12T18:06:29.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.003+0000 7f83b74429c0 20 remove_watcher() i=3 2024-09-12T18:06:29.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.007+0000 7f83b74429c0 20 remove_watcher() i=4 2024-09-12T18:06:29.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.007+0000 7f83b74429c0 20 remove_watcher() i=5 2024-09-12T18:06:29.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.011+0000 7f83b74429c0 20 remove_watcher() i=6 2024-09-12T18:06:29.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.011+0000 7f83b74429c0 20 remove_watcher() i=7 2024-09-12T18:06:29.029 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T18:06:29.062 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:29.062 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:29.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.107+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:29.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 20 realm 2024-09-12T18:06:29.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:29.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:29.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:29.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:29.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:29.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.111+0000 7ffb2fc089c0 20 searching for the correct realm 2024-09-12T18:06:29.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.119+0000 7ffb2cf0d640 0 -- 172.21.15.97:0/1813376588 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5559b64a0390 msgr2=0x5559b64a27e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:29.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.335+0000 7ffb2d70e640 0 -- 172.21.15.97:0/1813376588 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x5559b64a45e0 msgr2=0x5559b64a69d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:29.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.343+0000 7ffb2fc089c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:29.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.343+0000 7ffb2fc089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:29.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.343+0000 7ffb2fc089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:29.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.343+0000 7ffb2fc089c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:29.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.343+0000 7ffb2fc089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:29.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.343+0000 7ffb2fc089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:29.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.343+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.343+0000 7ffb2fc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:29.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.343+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:29.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:29.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 20 zone default found 2024-09-12T18:06:29.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 4 Realm: () 2024-09-12T18:06:29.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:29.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:29.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:29.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 20 zonegroup default 2024-09-12T18:06:29.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:29.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:29.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.347+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.351+0000 7ffb2fc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:29.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.351+0000 7ffb2fc089c0 20 started sync module instance, tier type = 2024-09-12T18:06:29.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.351+0000 7ffb2fc089c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:29.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.371+0000 7ffb2fc089c0 20 add_watcher() i=0 2024-09-12T18:06:29.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.371+0000 7ffb2fc089c0 20 add_watcher() i=1 2024-09-12T18:06:29.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.371+0000 7ffb2fc089c0 20 add_watcher() i=2 2024-09-12T18:06:29.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.371+0000 7ffb2fc089c0 20 add_watcher() i=3 2024-09-12T18:06:29.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.371+0000 7ffb2fc089c0 20 add_watcher() i=4 2024-09-12T18:06:29.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.371+0000 7ffb2fc089c0 20 add_watcher() i=5 2024-09-12T18:06:29.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.371+0000 7ffb2fc089c0 20 add_watcher() i=6 2024-09-12T18:06:29.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.371+0000 7ffb2fc089c0 20 add_watcher() i=7 2024-09-12T18:06:29.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.371+0000 7ffb2fc089c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:29.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.379+0000 7ff9e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:29.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.379+0000 7ffb2fc089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:29.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.379+0000 7ffb2fc089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:29.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.379+0000 7ffb2fc089c0 5 note: GC not initialized 2024-09-12T18:06:29.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.379+0000 7ff9e27e4640 20 reqs_thread_entry: start 2024-09-12T18:06:29.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.379+0000 7ffb2fc089c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:29.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ffb2fc089c0 20 Filter name: none 2024-09-12T18:06:29.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ff953fff640 20 reqs_thread_entry: start 2024-09-12T18:06:29.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ffb2fc089c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:29.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ffb2fc089c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:29.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ffb2fc089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:29.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ffb2fc089c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:29.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ffb2fc089c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:29.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ffb2fc089c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:29.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.383+0000 7ffb2fc089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:29.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.387+0000 7ff9e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:29.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.391+0000 7ffb2fc089c0 20 remove_watcher() i=0 2024-09-12T18:06:29.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.391+0000 7ffb2fc089c0 2 removed watcher, disabling cache 2024-09-12T18:06:29.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.395+0000 7ffb2fc089c0 20 remove_watcher() i=1 2024-09-12T18:06:29.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.399+0000 7ffb2fc089c0 20 remove_watcher() i=2 2024-09-12T18:06:29.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.399+0000 7ffb2fc089c0 20 remove_watcher() i=3 2024-09-12T18:06:29.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.403+0000 7ffb2fc089c0 20 remove_watcher() i=4 2024-09-12T18:06:29.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.403+0000 7ffb2fc089c0 20 remove_watcher() i=5 2024-09-12T18:06:29.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.407+0000 7ffb2fc089c0 20 remove_watcher() i=6 2024-09-12T18:06:29.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:29.411+0000 7ffb2fc089c0 20 remove_watcher() i=7 2024-09-12T18:06:29.426 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:29.426 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:06:29.426 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-logrecord-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:06:29.426 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:29.428 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:29.428 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:29.452 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:29.453 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:30.002 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:30.003 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:30.402 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T18:06:30.402 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:30.405 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:30.405 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:30.533 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:30.533 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:30.617 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:30.617 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:30.717 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:30.717 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:30.813 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:30.813 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:30.906 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:30.906 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:31.006 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:31.100 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:31.100 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:31.191 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:31.191 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:31.290 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:31.290 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:31.385 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:31.385 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:31.490 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:31.490 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:31.582 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:31.582 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:31.680 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:31.680 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:31.777 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:31.777 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:31.876 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:31.876 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:31.969 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:31.969 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:32.061 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:32.061 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:32.155 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:32.155 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:32.252 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:32.252 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:32.344 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:32.344 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:32.432 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:32.432 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:32.527 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T18:06:32.559 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:32.559 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:32.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.607+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.607+0000 7fe0e9d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.607+0000 7fe0e9d129c0 20 realm 2024-09-12T18:06:32.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.607+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.607+0000 7fe0e9d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.607+0000 7fe0e9d129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:32.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.607+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.611+0000 7fe0e9d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.611+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.611+0000 7fe0e9d129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:32.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.611+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.611+0000 7fe0e9d129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:32.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.611+0000 7fe0e9d129c0 20 searching for the correct realm 2024-09-12T18:06:32.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.615+0000 7fe0e7017640 0 -- 172.21.15.97:0/3855297362 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fe0dc00e070 msgr2=0x7fe0dc066890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:32.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.623+0000 7fe0e8019640 0 -- 172.21.15.97:0/3855297362 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55b58f2fc8e0 msgr2=0x55b58f2fecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:06:32.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.631+0000 7fe0e9d129c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:32.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.631+0000 7fe0e9d129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:32.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.631+0000 7fe0e9d129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:32.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.631+0000 7fe0e9d129c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:32.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.631+0000 7fe0e9d129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:32.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.631+0000 7fe0e9d129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:32.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.631+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.631+0000 7fe0e9d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.631+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.631+0000 7fe0e9d129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:32.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.631+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:32.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 20 zone default found 2024-09-12T18:06:32.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 4 Realm: () 2024-09-12T18:06:32.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:32.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:32.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:32.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 20 zonegroup default 2024-09-12T18:06:32.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 20 started sync module instance, tier type = 2024-09-12T18:06:32.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.635+0000 7fe0e9d129c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:32.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.655+0000 7fe0e9d129c0 20 add_watcher() i=0 2024-09-12T18:06:32.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.655+0000 7fe0e9d129c0 20 add_watcher() i=1 2024-09-12T18:06:32.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.655+0000 7fe0e9d129c0 20 add_watcher() i=2 2024-09-12T18:06:32.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.655+0000 7fe0e9d129c0 20 add_watcher() i=3 2024-09-12T18:06:32.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.655+0000 7fe0e9d129c0 20 add_watcher() i=4 2024-09-12T18:06:32.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.655+0000 7fe0e9d129c0 20 add_watcher() i=5 2024-09-12T18:06:32.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.655+0000 7fe0e9d129c0 20 add_watcher() i=6 2024-09-12T18:06:32.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.655+0000 7fe0e9d129c0 20 add_watcher() i=7 2024-09-12T18:06:32.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.655+0000 7fe0e9d129c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:32.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.659+0000 7fdf9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:32.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.659+0000 7fe0e9d129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:32.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.659+0000 7fe0e9d129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:32.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 5 note: GC not initialized 2024-09-12T18:06:32.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fdf9cfe1640 20 reqs_thread_entry: start 2024-09-12T18:06:32.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:32.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 Filter name: none 2024-09-12T18:06:32.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fdf167fc640 20 reqs_thread_entry: start 2024-09-12T18:06:32.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:32.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:32.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:32.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:32.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:32.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.663+0000 7fe0e9d129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:32.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.667+0000 7fdf9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:32.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.671+0000 7fe0e9d129c0 20 remove_watcher() i=0 2024-09-12T18:06:32.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.671+0000 7fe0e9d129c0 2 removed watcher, disabling cache 2024-09-12T18:06:32.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.671+0000 7fe0e9d129c0 20 remove_watcher() i=1 2024-09-12T18:06:32.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.675+0000 7fe0e9d129c0 20 remove_watcher() i=2 2024-09-12T18:06:32.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.675+0000 7fe0e9d129c0 20 remove_watcher() i=3 2024-09-12T18:06:32.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.679+0000 7fe0e9d129c0 20 remove_watcher() i=4 2024-09-12T18:06:32.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.679+0000 7fe0e9d129c0 20 remove_watcher() i=5 2024-09-12T18:06:32.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.683+0000 7fe0e9d129c0 20 remove_watcher() i=6 2024-09-12T18:06:32.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.687+0000 7fe0e9d129c0 20 remove_watcher() i=7 2024-09-12T18:06:32.698 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.698 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:06:32.698 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-logrecord-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:06:32.699 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.699 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T18:06:32.732 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:32.732 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:32.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 realm 2024-09-12T18:06:32.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.775+0000 7fa608d7c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:32.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:32.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:32.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 searching for the correct realm 2024-09-12T18:06:32.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.787+0000 7fa607083640 0 -- 172.21.15.97:0/1012465832 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fa5fc030070 msgr2=0x7fa5fc08e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:32.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.791+0000 7fa606882640 0 -- 172.21.15.97:0/1012465832 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fa600017020 msgr2=0x7fa600073ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:32.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:32.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:32.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:32.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:32.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:32.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:32.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:32.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:32.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 zone default found 2024-09-12T18:06:32.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 4 Realm: () 2024-09-12T18:06:32.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:32.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:32.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:32.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 zonegroup default 2024-09-12T18:06:32.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.803+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.803+0000 7fa608d7c9c0 20 started sync module instance, tier type = 2024-09-12T18:06:32.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.803+0000 7fa608d7c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:32.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=0 2024-09-12T18:06:32.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=1 2024-09-12T18:06:32.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=2 2024-09-12T18:06:32.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=3 2024-09-12T18:06:32.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=4 2024-09-12T18:06:32.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=5 2024-09-12T18:06:32.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=6 2024-09-12T18:06:32.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.823+0000 7fa608d7c9c0 20 add_watcher() i=7 2024-09-12T18:06:32.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.823+0000 7fa608d7c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:32.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa4bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:32.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:32.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:32.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 note: GC not initialized 2024-09-12T18:06:32.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa437fff640 20 reqs_thread_entry: start 2024-09-12T18:06:32.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:32.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 Filter name: none 2024-09-12T18:06:32.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa435ffb640 20 reqs_thread_entry: start 2024-09-12T18:06:32.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:06:32.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:32.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:06:32.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:06:32.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 : miss 2024-09-12T18:06:32.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:32.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:06:32.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:06:32.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:32.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:32.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 2024-09-12T18:06:32.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:06:32.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:06:32.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:32.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36, ofs0, ns] 2024-09-12T18:06:32.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431645 cookie 94068301183296 notifier 7749 bl.length()=923 2024-09-12T18:06:32.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:06:32.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:06:32.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_sources= new_sources= 2024-09-12T18:06:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential sources added=[] removed=[] 2024-09-12T18:06:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_dests= new_dests= 2024-09-12T18:06:32.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential dests added=[] removed=[] 2024-09-12T18:06:32.845 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa608d7c9c0 time 2024-09-12T18:06:32.848222+0000 2024-09-12T18:06:32.845 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:32.846 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:32.846 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa60c6562eb] 2024-09-12T18:06:32.846 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa60c65649f] 2024-09-12T18:06:32.846 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558df8a320c1] 2024-09-12T18:06:32.846 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x14100ec) [0x558df94880ec] 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558df8a4418d] 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa60b4bcd90] 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fa608d7c9c0 thread_name:radosgw-admin 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.847+0000 7fa608d7c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa608d7c9c0 time 2024-09-12T18:06:32.848222+0000 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:32.847 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa60c6562eb] 2024-09-12T18:06:32.848 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa60c65649f] 2024-09-12T18:06:32.848 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558df8a320c1] 2024-09-12T18:06:32.848 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x14100ec) [0x558df94880ec] 2024-09-12T18:06:32.848 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558df8a4418d] 2024-09-12T18:06:32.848 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:06:32.848 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa60b4bcd90] 2024-09-12T18:06:32.849 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:06:32.849 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:06:32.849 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.868 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:32.868 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa60b4d5520] 2024-09-12T18:06:32.868 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:06:32.868 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:06:32.868 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:06:32.868 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa60c656345] 2024-09-12T18:06:32.868 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa60c65649f] 2024-09-12T18:06:32.868 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558df8a320c1] 2024-09-12T18:06:32.868 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x14100ec) [0x558df94880ec] 2024-09-12T18:06:32.868 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558df8a4418d] 2024-09-12T18:06:32.869 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:06:32.869 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa60b4bcd90] 2024-09-12T18:06:32.869 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:06:32.869 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:06:32.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.847+0000 7fa608d7c9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:06:32.871 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fa608d7c9c0 thread_name:radosgw-admin 2024-09-12T18:06:32.871 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.872 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:32.872 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa60b4d5520] 2024-09-12T18:06:32.872 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:06:32.872 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:06:32.872 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:06:32.872 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa60c656345] 2024-09-12T18:06:32.872 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa60c65649f] 2024-09-12T18:06:32.872 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558df8a320c1] 2024-09-12T18:06:32.872 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x14100ec) [0x558df94880ec] 2024-09-12T18:06:32.872 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558df8a4418d] 2024-09-12T18:06:32.872 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:06:32.873 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa60b4bcd90] 2024-09-12T18:06:32.873 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:06:32.873 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:06:32.873 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:06:32.873 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.873 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:06:32.873 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:06:32.751+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.873 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:06:32.751+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.873 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:06:32.751+0000 7fa607083640 10 monclient(hunting): handle_auth_done global_id 7737 payload 274 2024-09-12T18:06:32.873 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:06:32.751+0000 7fa607083640 10 monclient: _finish_hunting 0 2024-09-12T18:06:32.873 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:06:32.751+0000 7fa607083640 1 monclient: found mon.noname-a 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:06:32.751+0000 7fa607083640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: dump: 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.874 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.875 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.875 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.875 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: _finish_auth 0 2024-09-12T18:06:32.875 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: _check_auth_tickets 2024-09-12T18:06:32.875 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:32.875 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.875 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:32.875 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: dump: 2024-09-12T18:06:32.875 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.875 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.875 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 monclient: authenticate success, global_id 7737 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 4 set_mon_vals no callback set 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: shutdown 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) unregister_commands rotate-key 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:32.876 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: monmap: 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding auth protocol: cephx 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding auth protocol: cephx 2024-09-12T18:06:32.877 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding auth protocol: cephx 2024-09-12T18:06:32.878 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.878 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.878 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.878 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.878 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.878 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.878 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.878 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.878 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.878 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.879 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.879 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.879 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.879 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 librados: starting msgr at 2024-09-12T18:06:32.879 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 librados: starting objecter 2024-09-12T18:06:32.879 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command objecter_requests hook 0x558dfba0a0f0 2024-09-12T18:06:32.879 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 librados: setting wanted keys 2024-09-12T18:06:32.879 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 librados: calling monclient init 2024-09-12T18:06:32.879 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: init 2024-09-12T18:06:32.880 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding auth protocol: cephx 2024-09-12T18:06:32.880 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding auth protocol: cephx 2024-09-12T18:06:32.880 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding auth protocol: cephx 2024-09-12T18:06:32.880 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.880 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.880 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.880 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.880 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.880 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.880 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.880 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command rotate-key hook 0x558dfb9d8598 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-b con 0x558dfb8656a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-c con 0x558dfb890b30 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-a con 0x558dfb91dbb0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:06:32.881 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): authenticate will time out at 2822.166258s 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): get_auth_request con 0x558dfb91dbb0 auth_method 0 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): get_auth_request con 0x558dfb890b30 auth_method 0 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.882 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): handle_auth_done global_id 7740 payload 824 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient: _finish_hunting 0 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:06:32.755+0000 7fa607083640 1 monclient: found mon.noname-a 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:06:32.755+0000 7fa606882640 10 monclient: get_auth_request con 0x558dfb8656a0 auth_method 0 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: dump: 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.883 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: _finish_auth 0 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: _check_auth_tickets 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:32.884 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: dump: 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 monclient: authenticate success, global_id 7740 2024-09-12T18:06:32.885 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.886 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 4 set_mon_vals no callback set 2024-09-12T18:06:32.886 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.886 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.886 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.886 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 librados: init done 2024-09-12T18:06:32.886 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:06:32.759+0000 7fa4f3606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:32.886 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:06:32.759+0000 7fa4f3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.886 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:06:32.759+0000 7fa4f3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.886 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:06:32.759+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa4ec070b10 auth_method 0 2024-09-12T18:06:32.886 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:06:32.759+0000 7fa606081640 10 monclient: get_auth_request con 0x558dfba02fc0 auth_method 0 2024-09-12T18:06:32.886 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:06:32.759+0000 7fa606882640 10 monclient: get_auth_request con 0x558dfba23160 auth_method 0 2024-09-12T18:06:32.887 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:06:32.763+0000 7fa606081640 10 monclient: get_auth_request con 0x558dfba27350 auth_method 0 2024-09-12T18:06:32.887 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:32.887 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:32.887 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient: monmap: 2024-09-12T18:06:32.887 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:06:32.887 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:32.887 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:06:32.887 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:06:32.887 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:32.887 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding auth protocol: cephx 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding auth protocol: cephx 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding auth protocol: cephx 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.888 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.889 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.889 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.889 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.889 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.889 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.889 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.889 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x558dfba2f6e0 EEXIST 2024-09-12T18:06:32.889 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient: init 2024-09-12T18:06:32.889 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding auth protocol: cephx 2024-09-12T18:06:32.889 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding auth protocol: cephx 2024-09-12T18:06:32.889 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding auth protocol: cephx 2024-09-12T18:06:32.890 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.890 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.890 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.890 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.890 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.890 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.890 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.890 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.890 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.890 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.891 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.891 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.891 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.891 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.891 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command rotate-key cmddesc rotate-key hook 0x558dfba2a6c0 EEXIST 2024-09-12T18:06:32.891 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:32.891 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:06:32.891 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-a con 0x558dfba53890 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:06:32.891 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-c con 0x558dfba531c0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-b con 0x558dfba51ba0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): authenticate will time out at 2822.175982s 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): get_auth_request con 0x558dfba53890 auth_method 0 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): get_auth_request con 0x558dfba531c0 auth_method 0 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.892 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:06:32.767+0000 7fa607083640 10 monclient(hunting): get_auth_request con 0x558dfba51ba0 auth_method 0 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:06:32.767+0000 7fa607083640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:06:32.767+0000 7fa607083640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:06:32.767+0000 7fa607083640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): handle_auth_done global_id 7262 payload 824 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient: _finish_hunting 0 2024-09-12T18:06:32.893 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:06:32.767+0000 7fa606081640 1 monclient: found mon.noname-c 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: dump: 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.894 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.895 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.895 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.895 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: _finish_auth 0 2024-09-12T18:06:32.895 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: _check_auth_tickets 2024-09-12T18:06:32.895 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:32.895 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.895 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:06:32.895 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: dump: 2024-09-12T18:06:32.895 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.895 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.895 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 monclient: authenticate success, global_id 7262 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:06:32.767+0000 7fa605880640 4 set_mon_vals no callback set 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.896 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:06:32.897 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:32.897 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.897 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.897 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa4e0070a20 auth_method 0 2024-09-12T18:06:32.897 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: get_monmap_and_config 2024-09-12T18:06:32.897 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:32.897 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:32.897 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: monmap: 2024-09-12T18:06:32.897 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:06:32.897 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:32.897 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:06:32.898 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:06:32.898 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:32.898 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.898 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:06:32.898 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:06:32.898 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:06:32.898 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.898 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding auth protocol: cephx 2024-09-12T18:06:32.898 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding auth protocol: cephx 2024-09-12T18:06:32.898 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding auth protocol: cephx 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.899 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: init 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding auth protocol: cephx 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding auth protocol: cephx 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding auth protocol: cephx 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.900 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe6fbb4d18 EEXIST 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-b con 0x558dfbaa76a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-a con 0x558dfbaa2a90 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-c con 0x558dfbaa3410 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.901 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): authenticate will time out at 2822.180195s 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): get_auth_request con 0x558dfbaa2a90 auth_method 0 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): get_auth_request con 0x558dfbaa3410 auth_method 0 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.902 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.903 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.903 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.903 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.903 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_done global_id 7746 payload 274 2024-09-12T18:06:32.903 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient: _finish_hunting 0 2024-09-12T18:06:32.903 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:06:32.771+0000 7fa606081640 1 monclient: found mon.noname-a 2024-09-12T18:06:32.903 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.903 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.903 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:32.903 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: dump: 2024-09-12T18:06:32.903 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.904 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.904 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.904 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.904 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.904 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.904 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.904 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.904 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.904 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.904 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: _finish_auth 0 2024-09-12T18:06:32.904 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:06:32.905 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:32.905 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.905 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:32.905 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: dump: 2024-09-12T18:06:32.905 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.905 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.905 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.905 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.905 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.905 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.906 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.906 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.906 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.906 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.906 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 monclient: authenticate success, global_id 7746 2024-09-12T18:06:32.906 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:32.906 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 4 set_mon_vals no callback set 2024-09-12T18:06:32.906 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: shutdown 2024-09-12T18:06:32.906 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:32.906 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:32.906 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: monmap: 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding auth protocol: cephx 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding auth protocol: cephx 2024-09-12T18:06:32.907 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding auth protocol: cephx 2024-09-12T18:06:32.908 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.908 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.908 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.908 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.908 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.908 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.908 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.908 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.908 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.908 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.908 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.909 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.909 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.909 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 1 librados: starting msgr at 2024-09-12T18:06:32.909 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 1 librados: starting objecter 2024-09-12T18:06:32.909 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x558dfba77620 EEXIST 2024-09-12T18:06:32.909 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 1 librados: setting wanted keys 2024-09-12T18:06:32.909 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 1 librados: calling monclient init 2024-09-12T18:06:32.909 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: init 2024-09-12T18:06:32.909 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding auth protocol: cephx 2024-09-12T18:06:32.909 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding auth protocol: cephx 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding auth protocol: cephx 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.910 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command rotate-key cmddesc rotate-key hook 0x558dfba557f8 EEXIST 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-c con 0x558dfbaa2a90 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-a con 0x558dfbaa3410 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-b con 0x558dfbaa76a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): authenticate will time out at 2822.182735s 2024-09-12T18:06:32.911 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): get_auth_request con 0x558dfbaa3410 auth_method 0 2024-09-12T18:06:32.912 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.912 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.912 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.912 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): get_auth_request con 0x558dfbaa2a90 auth_method 0 2024-09-12T18:06:32.912 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_done global_id 7749 payload 824 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient: _finish_hunting 0 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:06:32.771+0000 7fa606081640 1 monclient: found mon.noname-a 2024-09-12T18:06:32.913 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.914 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.914 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:32.914 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: dump: 2024-09-12T18:06:32.914 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.914 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.914 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.914 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.914 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.914 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.914 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.914 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: _finish_auth 0 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: dump: 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.915 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.916 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.916 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.916 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.916 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.916 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.916 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.916 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 4 set_mon_vals no callback set 2024-09-12T18:06:32.916 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 monclient: authenticate success, global_id 7749 2024-09-12T18:06:32.916 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.916 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.916 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 1 librados: init done 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command cr dump hook 0x7fa5fc01ef58 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:06:32.775+0000 7fa4e8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:06:32.775+0000 7fa4e8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:06:32.775+0000 7fa4e8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:06:32.775+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa4d0070ae0 auth_method 0 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:06:32.775+0000 7fa607083640 10 monclient: get_auth_request con 0x558dfbac0cd0 auth_method 0 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 realm 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.917 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:06:32.779+0000 7fa606882640 10 monclient: get_auth_request con 0x558dfbac5020 auth_method 0 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:06:32.779+0000 7fa606081640 10 monclient: get_auth_request con 0x558dfbac8790 auth_method 0 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 searching for the correct realm 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:06:32.779+0000 7fa607083640 10 monclient: get_auth_request con 0x7fa5fc030070 auth_method 0 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:06:32.783+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa5f80d3460 auth_method 0 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:06:32.783+0000 7fa606081640 10 monclient: get_auth_request con 0x7fa5fc008040 auth_method 0 2024-09-12T18:06:32.918 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:06:32.787+0000 7fa607083640 0 -- 172.21.15.97:0/1012465832 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fa5fc030070 msgr2=0x7fa5fc08e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:06:32.787+0000 7fa4e8ff9640 1 client.7749.objecter ms_handle_reset 0x7fa5fc030070 session 0x7fa5fc06ce90 osd.2 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:06:32.787+0000 7fa4e8ff9640 10 monclient: _renew_subs 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:06:32.787+0000 7fa4e8ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:06:32.787+0000 7fa607083640 10 monclient: get_auth_request con 0x7fa4d0080600 auth_method 0 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:06:32.787+0000 7fa607083640 10 monclient: get_auth_request con 0x7fa5f80f0ad0 auth_method 0 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:06:32.791+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa600017020 auth_method 0 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:06:32.791+0000 7fa606882640 0 -- 172.21.15.97:0/1012465832 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fa600017020 msgr2=0x7fa600073ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:06:32.791+0000 7fa4e8ff9640 1 client.7749.objecter ms_handle_reset 0x7fa600017020 session 0x7fa600091040 osd.3 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:06:32.791+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa5fc030070 auth_method 0 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:32.919 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 zone default found 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 4 Realm: () 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:32.920 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 zonegroup default 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:06:32.803+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:06:32.803+0000 7fa608d7c9c0 20 started sync module instance, tier type = 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:06:32.803+0000 7fa608d7c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=0 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=1 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=2 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=3 2024-09-12T18:06:32.921 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=4 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=5 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=6 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:06:32.823+0000 7fa608d7c9c0 20 add_watcher() i=7 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:06:32.823+0000 7fa608d7c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding auth protocol: cephx 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding auth protocol: cephx 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding auth protocol: cephx 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.922 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:06:32.827+0000 7fa4bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command cache list hook 0x558dfba9efd0 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command cache inspect hook 0x558dfba9efd0 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command cache erase hook 0x558dfba9efd0 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command cache zap hook 0x558dfba9efd0 2024-09-12T18:06:32.923 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 note: GC not initialized 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:06:32.827+0000 7fa437fff640 20 reqs_thread_entry: start 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command sync trace show hook 0x7fa5fc0043b0 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command sync trace history hook 0x7fa5fc0043b0 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command sync trace active hook 0x7fa5fc0043b0 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command sync trace active_short hook 0x7fa5fc0043b0 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 Filter name: none 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:06:32.827+0000 7fa435ffb640 20 reqs_thread_entry: start 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:06:32.924 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:06:32.925 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 : miss 2024-09-12T18:06:32.925 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.925 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:32.925 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:06:32.925 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:06:32.925 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:32.925 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:32.925 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 2024-09-12T18:06:32.925 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:06:32.925 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:06:32.925 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36, ofs0, ns] 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431645 cookie 94068301183296 notifier 7749 bl.length()=923 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_sources= new_sources= 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential sources added=[] removed=[] 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_dests= new_dests= 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential dests added=[] removed=[] 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:06:32.847+0000 7fa608d7c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa608d7c9c0 time 2024-09-12T18:06:32.848222+0000 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:32.926 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa60c6562eb] 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa60c65649f] 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558df8a320c1] 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x14100ec) [0x558df94880ec] 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558df8a4418d] 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa60b4bcd90] 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:06:32.847+0000 7fa608d7c9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fa608d7c9c0 thread_name:radosgw-admin 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:32.927 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa60b4d5520] 2024-09-12T18:06:32.928 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:06:32.928 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:06:32.928 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:06:32.928 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa60c656345] 2024-09-12T18:06:32.928 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa60c65649f] 2024-09-12T18:06:32.928 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558df8a320c1] 2024-09-12T18:06:32.928 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x14100ec) [0x558df94880ec] 2024-09-12T18:06:32.928 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558df8a4418d] 2024-09-12T18:06:32.928 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:06:32.928 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa60b4bcd90] 2024-09-12T18:06:32.928 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:06:32.929 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:06:32.930 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:06:32.931 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:06:32.932 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:06:32.933 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:06:32.934 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:06:32.934 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:06:32.934 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:06:32.934 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:06:32.934 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:06:32.934 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:06:32.934 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:06:32.934 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:06:32.934 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:06:32.934 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:06:32.934 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:06:32.935 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa435ffb640 / http_manager 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa437fff640 / http_manager 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4bd7e2640 / rgw_dt_lg_renew 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4e8ff9640 / ms_dispatch 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4ea7fc640 / io_context_pool 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4f0e01640 / ms_dispatch 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4f3606640 / ms_dispatch 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4f4e09640 / io_context_pool 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa605880640 / io_context_pool 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa606081640 / msgr-worker-2 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa606882640 / msgr-worker-1 2024-09-12T18:06:32.936 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa607083640 / msgr-worker-0 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa608d7c9c0 / radosgw-admin 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.126992.log 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:06:32.751+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:06:32.751+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:06:32.751+0000 7fa607083640 10 monclient(hunting): handle_auth_done global_id 7737 payload 274 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:06:32.751+0000 7fa607083640 10 monclient: _finish_hunting 0 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:06:32.751+0000 7fa607083640 1 monclient: found mon.noname-a 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:06:32.751+0000 7fa607083640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.937 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.938 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:32.938 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: dump: 2024-09-12T18:06:32.938 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.938 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.938 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.938 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.938 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.938 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.938 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.939 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.939 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.939 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.939 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: _finish_auth 0 2024-09-12T18:06:32.939 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: _check_auth_tickets 2024-09-12T18:06:32.939 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:32.939 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.939 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:32.939 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 10 monclient: dump: 2024-09-12T18:06:32.939 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.939 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 monclient: authenticate success, global_id 7737 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 4 set_mon_vals no callback set 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: shutdown 2024-09-12T18:06:32.940 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) unregister_commands rotate-key 2024-09-12T18:06:32.941 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:32.941 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:32.941 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: monmap: 2024-09-12T18:06:32.941 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:06:32.941 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:32.941 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:06:32.941 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:06:32.941 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:32.941 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.941 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding auth protocol: cephx 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding auth protocol: cephx 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding auth protocol: cephx 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.942 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: crc 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9ddc40) adding con mode: secure 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 librados: starting msgr at 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 librados: starting objecter 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command objecter_requests hook 0x558dfba0a0f0 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 librados: setting wanted keys 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 librados: calling monclient init 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: init 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding auth protocol: cephx 2024-09-12T18:06:32.943 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding auth protocol: cephx 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding auth protocol: cephx 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: crc 2024-09-12T18:06:32.944 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfb9d8450) adding con mode: secure 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command rotate-key hook 0x558dfb9d8598 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-b con 0x558dfb8656a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-c con 0x558dfb890b30 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-a con 0x558dfb91dbb0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:32.945 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient(hunting): authenticate will time out at 2822.166258s 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): get_auth_request con 0x558dfb91dbb0 auth_method 0 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): get_auth_request con 0x558dfb890b30 auth_method 0 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.946 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:06:32.755+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient(hunting): handle_auth_done global_id 7740 payload 824 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient: _finish_hunting 0 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:06:32.755+0000 7fa607083640 1 monclient: found mon.noname-a 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:06:32.755+0000 7fa607083640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:06:32.755+0000 7fa606882640 10 monclient: get_auth_request con 0x558dfb8656a0 auth_method 0 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: dump: 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.947 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: _finish_auth 0 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: _check_auth_tickets 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:06:32.755+0000 7fa4f3606640 10 monclient: dump: 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.948 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 5 monclient: authenticate success, global_id 7740 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:06:32.755+0000 7fa4f4e09640 4 set_mon_vals no callback set 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.949 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.950 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:06:32.755+0000 7fa608d7c9c0 1 librados: init done 2024-09-12T18:06:32.950 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:06:32.759+0000 7fa4f3606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:32.950 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:06:32.759+0000 7fa4f3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.950 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:06:32.759+0000 7fa4f3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.950 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:06:32.759+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa4ec070b10 auth_method 0 2024-09-12T18:06:32.950 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:06:32.759+0000 7fa606081640 10 monclient: get_auth_request con 0x558dfba02fc0 auth_method 0 2024-09-12T18:06:32.950 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:06:32.759+0000 7fa606882640 10 monclient: get_auth_request con 0x558dfba23160 auth_method 0 2024-09-12T18:06:32.950 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:06:32.763+0000 7fa606081640 10 monclient: get_auth_request con 0x558dfba27350 auth_method 0 2024-09-12T18:06:32.950 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:32.950 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient: monmap: 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding auth protocol: cephx 2024-09-12T18:06:32.951 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding auth protocol: cephx 2024-09-12T18:06:32.952 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding auth protocol: cephx 2024-09-12T18:06:32.952 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.952 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.952 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.952 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.952 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.952 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.952 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.952 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.952 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.952 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: crc 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2bd90) adding con mode: secure 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x558dfba2f6e0 EEXIST 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient: init 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding auth protocol: cephx 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding auth protocol: cephx 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding auth protocol: cephx 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.953 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: crc 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba2a578) adding con mode: secure 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command rotate-key cmddesc rotate-key hook 0x558dfba2a6c0 EEXIST 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-a con 0x558dfba53890 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:06:32.954 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-c con 0x558dfba531c0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-b con 0x558dfba51ba0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:06:32.763+0000 7fa608d7c9c0 10 monclient(hunting): authenticate will time out at 2822.175982s 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): get_auth_request con 0x558dfba53890 auth_method 0 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): get_auth_request con 0x558dfba531c0 auth_method 0 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.955 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:06:32.767+0000 7fa607083640 10 monclient(hunting): get_auth_request con 0x558dfba51ba0 auth_method 0 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:06:32.767+0000 7fa607083640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:06:32.767+0000 7fa607083640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:06:32.767+0000 7fa607083640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient(hunting): handle_auth_done global_id 7262 payload 824 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient: _finish_hunting 0 2024-09-12T18:06:32.956 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:06:32.767+0000 7fa606081640 1 monclient: found mon.noname-c 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:06:32.767+0000 7fa606081640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: dump: 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.957 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: _finish_auth 0 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: _check_auth_tickets 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 10 monclient: dump: 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.958 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 monclient: authenticate success, global_id 7262 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:06:32.767+0000 7fa605880640 4 set_mon_vals no callback set 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:06:32.767+0000 7fa4f0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:06:32.767+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa4e0070a20 auth_method 0 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: get_monmap_and_config 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:32.959 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: monmap: 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding auth protocol: cephx 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding auth protocol: cephx 2024-09-12T18:06:32.960 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding auth protocol: cephx 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: crc 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba73180) adding con mode: secure 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 10 monclient: init 2024-09-12T18:06:32.961 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding auth protocol: cephx 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding auth protocol: cephx 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding auth protocol: cephx 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: crc 2024-09-12T18:06:32.962 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb4bd0) adding con mode: secure 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:06:32.767+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe6fbb4d18 EEXIST 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-b con 0x558dfbaa76a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-a con 0x558dfbaa2a90 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-c con 0x558dfbaa3410 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): authenticate will time out at 2822.180195s 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): get_auth_request con 0x558dfbaa2a90 auth_method 0 2024-09-12T18:06:32.963 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): get_auth_request con 0x558dfbaa3410 auth_method 0 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:06:32.771+0000 7fa607083640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.964 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_done global_id 7746 payload 274 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient: _finish_hunting 0 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:06:32.771+0000 7fa606081640 1 monclient: found mon.noname-a 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: dump: 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.965 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: _finish_auth 0 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 10 monclient: dump: 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.966 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 monclient: authenticate success, global_id 7746 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 4 set_mon_vals no callback set 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: shutdown 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: build_initial_monmap 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 1 build_initial for_mkfs: 0 2024-09-12T18:06:32.967 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: monmap: 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding auth protocol: cephx 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding auth protocol: cephx 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding auth protocol: cephx 2024-09-12T18:06:32.968 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: crc 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba99d40) adding con mode: secure 2024-09-12T18:06:32.969 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.970 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 1 librados: starting msgr at 2024-09-12T18:06:32.970 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 1 librados: starting objecter 2024-09-12T18:06:32.970 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x558dfba77620 EEXIST 2024-09-12T18:06:32.970 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 1 librados: setting wanted keys 2024-09-12T18:06:32.970 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 1 librados: calling monclient init 2024-09-12T18:06:32.970 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: init 2024-09-12T18:06:32.970 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding auth protocol: cephx 2024-09-12T18:06:32.970 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding auth protocol: cephx 2024-09-12T18:06:32.970 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding auth protocol: cephx 2024-09-12T18:06:32.970 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.970 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.971 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.971 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.971 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.971 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.971 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.971 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.971 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.971 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.971 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: crc 2024-09-12T18:06:32.971 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 AuthRegistry(0x558dfba556b0) adding con mode: secure 2024-09-12T18:06:32.971 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command rotate-key cmddesc rotate-key hook 0x558dfba557f8 EEXIST 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-c con 0x558dfbaa2a90 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-a con 0x558dfbaa3410 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): picked mon.noname-b con 0x558dfbaa76a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:06:32.972 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient(hunting): authenticate will time out at 2822.182735s 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): get_auth_request con 0x558dfbaa3410 auth_method 0 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): get_auth_request con 0x558dfbaa2a90 auth_method 0 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:06:32.973 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:06:32.771+0000 7fa606882640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient(hunting): handle_auth_done global_id 7749 payload 824 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient: _finish_hunting 0 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:06:32.771+0000 7fa606081640 1 monclient: found mon.noname-a 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:06:32.771+0000 7fa606081640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: dump: 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.974 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: _finish_auth 0 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:06:32.771+0000 7fa4e8ff9640 10 monclient: dump: 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:06:32.975 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:06:32.771+0000 7fa4ea7fc640 4 set_mon_vals no callback set 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 5 monclient: authenticate success, global_id 7749 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:06:32.771+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.976 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 10 monclient: _renew_subs 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 1 librados: init done 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command cr dump hook 0x7fa5fc01ef58 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:06:32.775+0000 7fa4e8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:06:32.775+0000 7fa4e8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:06:32.775+0000 7fa4e8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:06:32.775+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa4d0070ae0 auth_method 0 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:06:32.775+0000 7fa607083640 10 monclient: get_auth_request con 0x558dfbac0cd0 auth_method 0 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 realm 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.977 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:06:32.775+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:06:32.779+0000 7fa606882640 10 monclient: get_auth_request con 0x558dfbac5020 auth_method 0 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:06:32.779+0000 7fa606081640 10 monclient: get_auth_request con 0x558dfbac8790 auth_method 0 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:06:32.779+0000 7fa608d7c9c0 20 searching for the correct realm 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:06:32.779+0000 7fa607083640 10 monclient: get_auth_request con 0x7fa5fc030070 auth_method 0 2024-09-12T18:06:32.978 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:06:32.783+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa5f80d3460 auth_method 0 2024-09-12T18:06:32.979 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:06:32.783+0000 7fa606081640 10 monclient: get_auth_request con 0x7fa5fc008040 auth_method 0 2024-09-12T18:06:32.979 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:06:32.787+0000 7fa607083640 0 -- 172.21.15.97:0/1012465832 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fa5fc030070 msgr2=0x7fa5fc08e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:32.979 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:06:32.787+0000 7fa4e8ff9640 1 client.7749.objecter ms_handle_reset 0x7fa5fc030070 session 0x7fa5fc06ce90 osd.2 2024-09-12T18:06:32.979 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:06:32.787+0000 7fa4e8ff9640 10 monclient: _renew_subs 2024-09-12T18:06:32.979 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:06:32.787+0000 7fa4e8ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:06:32.979 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:06:32.787+0000 7fa607083640 10 monclient: get_auth_request con 0x7fa4d0080600 auth_method 0 2024-09-12T18:06:32.979 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:06:32.787+0000 7fa607083640 10 monclient: get_auth_request con 0x7fa5f80f0ad0 auth_method 0 2024-09-12T18:06:32.979 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:06:32.791+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa600017020 auth_method 0 2024-09-12T18:06:32.979 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:06:32.791+0000 7fa606882640 0 -- 172.21.15.97:0/1012465832 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fa600017020 msgr2=0x7fa600073ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:32.979 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:06:32.791+0000 7fa4e8ff9640 1 client.7749.objecter ms_handle_reset 0x7fa600017020 session 0x7fa600091040 osd.3 2024-09-12T18:06:32.979 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:06:32.791+0000 7fa606882640 10 monclient: get_auth_request con 0x7fa5fc030070 auth_method 0 2024-09-12T18:06:32.980 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:32.980 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:32.980 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:32.980 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:32.980 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:32.980 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:32.980 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.980 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 zone default found 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 4 Realm: () 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 zonegroup default 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.981 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:06:32.799+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:06:32.803+0000 7fa608d7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:06:32.803+0000 7fa608d7c9c0 20 started sync module instance, tier type = 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:06:32.803+0000 7fa608d7c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=0 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=1 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=2 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=3 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=4 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=5 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:06:32.819+0000 7fa608d7c9c0 20 add_watcher() i=6 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:06:32.823+0000 7fa608d7c9c0 20 add_watcher() i=7 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:06:32.823+0000 7fa608d7c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:32.982 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding auth protocol: cephx 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding auth protocol: cephx 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding auth protocol: cephx 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:06:32.827+0000 7fa4bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: crc 2024-09-12T18:06:32.983 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 AuthRegistry(0x7ffe6fbb50a0) adding con mode: secure 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command cache list hook 0x558dfba9efd0 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command cache inspect hook 0x558dfba9efd0 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command cache erase hook 0x558dfba9efd0 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command cache zap hook 0x558dfba9efd0 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 note: GC not initialized 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:06:32.827+0000 7fa437fff640 20 reqs_thread_entry: start 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command sync trace show hook 0x7fa5fc0043b0 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command sync trace history hook 0x7fa5fc0043b0 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command sync trace active hook 0x7fa5fc0043b0 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 5 asok(0x558dfb7cd2b0) register_command sync trace active_short hook 0x7fa5fc0043b0 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:32.984 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 Filter name: none 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:06:32.827+0000 7fa435ffb640 20 reqs_thread_entry: start 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 : miss 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:06:32.985 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:32.986 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:32.986 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:06:32.827+0000 7fa608d7c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 2024-09-12T18:06:32.986 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:06:32.986 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:06:32.986 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:32.986 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:06:32.835+0000 7fa608d7c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36, ofs0, ns] 2024-09-12T18:06:32.986 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431645 cookie 94068301183296 notifier 7749 bl.length()=923 2024-09-12T18:06:32.986 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:06:32.986 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:06:32.986 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:06:32.839+0000 7fa4ea7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:32.987 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_sources= new_sources= 2024-09-12T18:06:32.987 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential sources added=[] removed=[] 2024-09-12T18:06:32.987 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_dests= new_dests= 2024-09-12T18:06:32.987 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:06:32.839+0000 7fa608d7c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential dests added=[] removed=[] 2024-09-12T18:06:32.987 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:06:32.847+0000 7fa608d7c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa608d7c9c0 time 2024-09-12T18:06:32.848222+0000 2024-09-12T18:06:32.987 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:06:32.987 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.987 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:32.987 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa60c6562eb] 2024-09-12T18:06:32.987 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa60c65649f] 2024-09-12T18:06:32.987 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558df8a320c1] 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x14100ec) [0x558df94880ec] 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558df8a4418d] 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa60b4bcd90] 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:06:32.847+0000 7fa608d7c9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fa608d7c9c0 thread_name:radosgw-admin 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa60b4d5520] 2024-09-12T18:06:32.988 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:06:32.989 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:06:32.989 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:06:32.989 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa60c656345] 2024-09-12T18:06:32.989 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa60c65649f] 2024-09-12T18:06:32.989 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558df8a320c1] 2024-09-12T18:06:32.989 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x14100ec) [0x558df94880ec] 2024-09-12T18:06:32.989 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558df8a4418d] 2024-09-12T18:06:32.989 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:06:32.989 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa60b4bcd90] 2024-09-12T18:06:32.989 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:06:32.990 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:06:32.991 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:06:32.991 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:06:32.991 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:06:32.991 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:06:32.991 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:06:32.991 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:06:32.991 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:06:32.991 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:06:32.991 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:06:32.991 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:06:32.992 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:06:32.993 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:06:32.994 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:06:32.995 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:06:32.996 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa435ffb640 / http_manager 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa437fff640 / http_manager 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4bd7e2640 / rgw_dt_lg_renew 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4e8ff9640 / ms_dispatch 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4ea7fc640 / io_context_pool 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4f0e01640 / ms_dispatch 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4f3606640 / ms_dispatch 2024-09-12T18:06:32.997 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa4f4e09640 / io_context_pool 2024-09-12T18:06:32.998 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa605880640 / io_context_pool 2024-09-12T18:06:32.998 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa606081640 / msgr-worker-2 2024-09-12T18:06:32.998 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa606882640 / msgr-worker-1 2024-09-12T18:06:32.998 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa607083640 / msgr-worker-0 2024-09-12T18:06:32.998 INFO:tasks.workunit.client.0.smithi097.stderr: 7fa608d7c9c0 / radosgw-admin 2024-09-12T18:06:32.998 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:06:32.998 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:06:32.998 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:06:32.850675Z_75671202-fd00-46d1-8910-84b5d29f127a/log 2024-09-12T18:06:32.998 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:06:32.998 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:06:32.999 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T18:06:33.003 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:33.003 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:33.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.927+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.931+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.931+0000 7f5ce8ffa9c0 20 realm 2024-09-12T18:06:33.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.931+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.931+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.931+0000 7f5ce8ffa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.931+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.931+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.931+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.935+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.935+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.935+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.935+0000 7f5ce8ffa9c0 20 searching for the correct realm 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.943+0000 7f5ce7301640 0 -- 172.21.15.97:0/3787207435 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55d1ffa5d540 msgr2=0x55d1ffa5f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.951+0000 7f5ce62ff640 0 -- 172.21.15.97:0/3787207435 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x55d1ffa64fc0 msgr2=0x55d1ffa673b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:33.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 zone default found 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 4 Realm: () 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 zonegroup default 2024-09-12T18:06:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.955+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.959+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.959+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.959+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.959+0000 7f5ce8ffa9c0 20 started sync module instance, tier type = 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.959+0000 7f5ce8ffa9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.975+0000 7f5ce8ffa9c0 20 add_watcher() i=0 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.975+0000 7f5ce8ffa9c0 20 add_watcher() i=1 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.975+0000 7f5ce8ffa9c0 20 add_watcher() i=2 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.975+0000 7f5ce8ffa9c0 20 add_watcher() i=3 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.975+0000 7f5ce8ffa9c0 20 add_watcher() i=4 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.975+0000 7f5ce8ffa9c0 20 add_watcher() i=5 2024-09-12T18:06:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.975+0000 7f5ce8ffa9c0 20 add_watcher() i=6 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.979+0000 7f5ce8ffa9c0 20 add_watcher() i=7 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.979+0000 7f5ce8ffa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5b9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 5 note: GC not initialized 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5b9cfe1640 20 reqs_thread_entry: start 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 Filter name: none 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5b95ffb640 20 reqs_thread_entry: start 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:06:33.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.983+0000 7f5ce8ffa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.987+0000 7f5b9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.991+0000 7f5ce8ffa9c0 20 remove_watcher() i=0 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.991+0000 7f5ce8ffa9c0 2 removed watcher, disabling cache 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.995+0000 7f5ce8ffa9c0 20 remove_watcher() i=1 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.995+0000 7f5ce8ffa9c0 20 remove_watcher() i=2 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.999+0000 7f5ce8ffa9c0 20 remove_watcher() i=3 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:32.999+0000 7f5ce8ffa9c0 20 remove_watcher() i=4 2024-09-12T18:06:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.003+0000 7f5ce8ffa9c0 20 remove_watcher() i=5 2024-09-12T18:06:33.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.003+0000 7f5ce8ffa9c0 20 remove_watcher() i=6 2024-09-12T18:06:33.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.007+0000 7f5ce8ffa9c0 20 remove_watcher() i=7 2024-09-12T18:06:33.021 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:33.021 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:06:33.021 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-logrecord-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:06:33.021 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:06:33.022 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:33.022 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:33.066 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:06:33.066 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:06:33.127 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:06:33.162 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:06:33.162 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:06:33.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.207+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.211+0000 7f8f12f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.211+0000 7f8f12f0c9c0 20 realm 2024-09-12T18:06:33.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.211+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.211+0000 7f8f12f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.211+0000 7f8f12f0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:06:33.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.211+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.211+0000 7f8f12f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.211+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.211+0000 7f8f12f0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:33.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.211+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.215+0000 7f8f12f0c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:06:33.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.215+0000 7f8f12f0c9c0 20 searching for the correct realm 2024-09-12T18:06:33.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.219+0000 7f8f0bfff640 0 -- 172.21.15.97:0/3107561799 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f8efc053b80 msgr2=0x7f8efc03f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:33.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.435+0000 7f8f11213640 0 -- 172.21.15.97:0/3107561799 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5638d5a1bce0 msgr2=0x5638d5a1e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:06:33.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:06:33.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:06:33.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:06:33.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:06:33.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:06:33.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:06:33.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:06:33.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:06:33.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 zone default found 2024-09-12T18:06:33.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 4 Realm: () 2024-09-12T18:06:33.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:06:33.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:06:33.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:06:33.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 zonegroup default 2024-09-12T18:06:33.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.447+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.451+0000 7f8f12f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.451+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.451+0000 7f8f12f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.451+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.451+0000 7f8f12f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:06:33.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.451+0000 7f8f12f0c9c0 20 started sync module instance, tier type = 2024-09-12T18:06:33.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.451+0000 7f8f12f0c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:06:33.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.471+0000 7f8f12f0c9c0 20 add_watcher() i=0 2024-09-12T18:06:33.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.471+0000 7f8f12f0c9c0 20 add_watcher() i=1 2024-09-12T18:06:33.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.471+0000 7f8f12f0c9c0 20 add_watcher() i=2 2024-09-12T18:06:33.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.471+0000 7f8f12f0c9c0 20 add_watcher() i=3 2024-09-12T18:06:33.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.471+0000 7f8f12f0c9c0 20 add_watcher() i=4 2024-09-12T18:06:33.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.471+0000 7f8f12f0c9c0 20 add_watcher() i=5 2024-09-12T18:06:33.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.471+0000 7f8f12f0c9c0 20 add_watcher() i=6 2024-09-12T18:06:33.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.475+0000 7f8f12f0c9c0 20 add_watcher() i=7 2024-09-12T18:06:33.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.475+0000 7f8f12f0c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:06:33.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.479+0000 7f8dc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:33.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.479+0000 7f8f12f0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:06:33.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.479+0000 7f8f12f0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:06:33.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.479+0000 7f8f12f0c9c0 5 note: GC not initialized 2024-09-12T18:06:33.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.479+0000 7f8dc5fe3640 20 reqs_thread_entry: start 2024-09-12T18:06:33.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:06:33.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 20 Filter name: none 2024-09-12T18:06:33.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8d377fe640 20 reqs_thread_entry: start 2024-09-12T18:06:33.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:06:33.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:06:33.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:06:33.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:06:33.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 : miss 2024-09-12T18:06:33.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:06:33.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:06:33.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:06:33.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:06:33.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:06:33.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:06:33.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.483+0000 7f8f12f0c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 2024-09-12T18:06:33.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.487+0000 7f8f12f0c9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to be held by another RGW process; skipping for now 2024-09-12T18:06:33.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.487+0000 7f8dc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:06:33.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.495+0000 7f8f12f0c9c0 20 remove_watcher() i=0 2024-09-12T18:06:33.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.495+0000 7f8f12f0c9c0 2 removed watcher, disabling cache 2024-09-12T18:06:33.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.495+0000 7f8f12f0c9c0 20 remove_watcher() i=1 2024-09-12T18:06:33.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.499+0000 7f8f12f0c9c0 20 remove_watcher() i=2 2024-09-12T18:06:33.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.499+0000 7f8f12f0c9c0 20 remove_watcher() i=3 2024-09-12T18:06:33.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.503+0000 7f8f12f0c9c0 20 remove_watcher() i=4 2024-09-12T18:06:33.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.503+0000 7f8f12f0c9c0 20 remove_watcher() i=5 2024-09-12T18:06:33.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.507+0000 7f8f12f0c9c0 20 remove_watcher() i=6 2024-09-12T18:06:33.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:06:33.511+0000 7f8f12f0c9c0 20 remove_watcher() i=7 2024-09-12T18:06:33.526 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:07:03.534 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:07:03.572 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:03.572 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:03.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.618+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.618+0000 7f354a35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:03.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.618+0000 7f354a35c9c0 20 realm 2024-09-12T18:07:03.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.618+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.618+0000 7f354a35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:03.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.618+0000 7f354a35c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:03.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.618+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.618+0000 7f354a35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:03.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.618+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.622+0000 7f354a35c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:03.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.622+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.622+0000 7f354a35c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:03.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.622+0000 7f354a35c9c0 20 searching for the correct realm 2024-09-12T18:07:03.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.626+0000 7f3547661640 0 -- 172.21.15.97:0/1610050481 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f353c068120 msgr2=0x7f353c0456a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:03.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.634+0000 7f3547e62640 0 -- 172.21.15.97:0/1610050481 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f354003a040 msgr2=0x7f354003a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:03.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:03.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:03.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:03.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:03.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:03.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:03.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:03.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:03.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:03.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 zone default found 2024-09-12T18:07:03.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 4 Realm: () 2024-09-12T18:07:03.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:03.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:03.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:03.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 zonegroup default 2024-09-12T18:07:03.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:03.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:03.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:03.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 started sync module instance, tier type = 2024-09-12T18:07:03.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.642+0000 7f354a35c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:03.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.662+0000 7f354a35c9c0 20 add_watcher() i=0 2024-09-12T18:07:03.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.662+0000 7f354a35c9c0 20 add_watcher() i=1 2024-09-12T18:07:03.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.662+0000 7f354a35c9c0 20 add_watcher() i=2 2024-09-12T18:07:03.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.662+0000 7f354a35c9c0 20 add_watcher() i=3 2024-09-12T18:07:03.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.662+0000 7f354a35c9c0 20 add_watcher() i=4 2024-09-12T18:07:03.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.662+0000 7f354a35c9c0 20 add_watcher() i=5 2024-09-12T18:07:03.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.662+0000 7f354a35c9c0 20 add_watcher() i=6 2024-09-12T18:07:03.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.662+0000 7f354a35c9c0 20 add_watcher() i=7 2024-09-12T18:07:03.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.662+0000 7f354a35c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:03.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.666+0000 7f33fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:03.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.666+0000 7f354a35c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:03.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.666+0000 7f354a35c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:03.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.666+0000 7f354a35c9c0 5 note: GC not initialized 2024-09-12T18:07:03.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.666+0000 7f33fd7e2640 20 reqs_thread_entry: start 2024-09-12T18:07:03.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:03.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 20 Filter name: none 2024-09-12T18:07:03.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f33f67fc640 20 reqs_thread_entry: start 2024-09-12T18:07:03.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:07:03.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:07:03.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:07:03.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:07:03.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 : miss 2024-09-12T18:07:03.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:07:03.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:07:03.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:07:03.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:03.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:03.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.670+0000 7f354a35c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 2024-09-12T18:07:03.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.674+0000 7f354a35c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:07:03.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.682+0000 7f354a35c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:07:03.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.682+0000 7f354a35c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:07:03.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.682+0000 7f354a35c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:03.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.682+0000 7f354a35c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36, ofs0, ns] 2024-09-12T18:07:03.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.686+0000 7f3426ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431646 cookie 93857020146544 notifier 7322 bl.length()=923 2024-09-12T18:07:03.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.686+0000 7f3426ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:07:03.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.686+0000 7f3426ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:07:03.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.686+0000 7f3426ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:03.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.686+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_sources= new_sources= 2024-09-12T18:07:03.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.686+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential sources added=[] removed=[] 2024-09-12T18:07:03.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.686+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_dests= new_dests= 2024-09-12T18:07:03.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.686+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential dests added=[] removed=[] 2024-09-12T18:07:03.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.0 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.0 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.1 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.1 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.2 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.2 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.3 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.3 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.4 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.4 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.5 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.5 2024-09-12T18:07:03.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.6 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.6 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.7 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.7 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.8 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.8 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.9 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.9 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.10 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.10 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.11 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2.11 2024-09-12T18:07:03.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.698+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.0 2024-09-12T18:07:03.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.702+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.1 2024-09-12T18:07:03.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.702+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2 2024-09-12T18:07:03.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.702+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.3 2024-09-12T18:07:03.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.702+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.4 2024-09-12T18:07:03.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.706+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.5 2024-09-12T18:07:03.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.706+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.6 2024-09-12T18:07:03.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.706+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.7 2024-09-12T18:07:03.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.710+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.8 2024-09-12T18:07:03.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.710+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.9 2024-09-12T18:07:03.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.710+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.10 2024-09-12T18:07:03.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.718+0000 7f354a35c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 : hit (requested=0x17, cached=0x17) 2024-09-12T18:07:03.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.718+0000 7f354a35c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 2024-09-12T18:07:03.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.718+0000 7f354a35c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:07:03.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.718+0000 7f354a35c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:07:03.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.718+0000 7f354a35c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:03.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.718+0000 7f354a35c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36, ofs0, ns] 2024-09-12T18:07:03.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.718+0000 7f3426ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431647 cookie 93857020146544 notifier 7322 bl.length()=923 2024-09-12T18:07:03.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.718+0000 7f3426ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:07:03.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.718+0000 7f3426ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:07:03.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.718+0000 7f3426ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:03.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.722+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_sources= new_sources= 2024-09-12T18:07:03.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.722+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential sources added=[] removed=[] 2024-09-12T18:07:03.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.722+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_dests= new_dests= 2024-09-12T18:07:03.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.722+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential dests added=[] removed=[] 2024-09-12T18:07:03.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.726+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.0 2024-09-12T18:07:03.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.730+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.1 2024-09-12T18:07:03.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.730+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.2 2024-09-12T18:07:03.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.730+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.3 2024-09-12T18:07:03.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.730+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.4 2024-09-12T18:07:03.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.730+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.5 2024-09-12T18:07:03.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.734+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.6 2024-09-12T18:07:03.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.734+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.7 2024-09-12T18:07:03.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.734+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.8 2024-09-12T18:07:03.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.738+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.9 2024-09-12T18:07:03.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.738+0000 7f354a35c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.36.10 2024-09-12T18:07:03.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.738+0000 7f354a35c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 : hit (requested=0x17, cached=0x17) 2024-09-12T18:07:03.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.738+0000 7f354a35c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 2024-09-12T18:07:03.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f354a35c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:07:03.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f354a35c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:07:03.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f354a35c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:03.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f354a35c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36, ofs0, ns] 2024-09-12T18:07:03.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f3426ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431648 cookie 93857020146544 notifier 7322 bl.length()=891 2024-09-12T18:07:03.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f3426ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 info.flags=0x17 2024-09-12T18:07:03.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f3426ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:98539659-fdaf-41ce-847d-239ff89323af.4641.36 to cache LRU end 2024-09-12T18:07:03.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f3426ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:03.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_sources= new_sources= 2024-09-12T18:07:03.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential sources added=[] removed=[] 2024-09-12T18:07:03.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): orig_dests= new_dests= 2024-09-12T18:07:03.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.742+0000 7f354a35c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[98539659-fdaf-41ce-847d-239ff89323af.4641.36]): potential dests added=[] removed=[] 2024-09-12T18:07:03.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.750+0000 7f354a35c9c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T18:07:03.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.754+0000 7f33fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:03.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.758+0000 7f354a35c9c0 20 remove_watcher() i=0 2024-09-12T18:07:03.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.758+0000 7f354a35c9c0 2 removed watcher, disabling cache 2024-09-12T18:07:03.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.762+0000 7f354a35c9c0 20 remove_watcher() i=1 2024-09-12T18:07:03.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.762+0000 7f354a35c9c0 20 remove_watcher() i=2 2024-09-12T18:07:03.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.766+0000 7f354a35c9c0 20 remove_watcher() i=3 2024-09-12T18:07:03.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.766+0000 7f354a35c9c0 20 remove_watcher() i=4 2024-09-12T18:07:03.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.770+0000 7f354a35c9c0 20 remove_watcher() i=5 2024-09-12T18:07:03.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.774+0000 7f354a35c9c0 20 remove_watcher() i=6 2024-09-12T18:07:03.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.774+0000 7f354a35c9c0 20 remove_watcher() i=7 2024-09-12T18:07:03.792 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T18:07:03.819 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:03.819 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:03.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.862+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.866+0000 7fe594ec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:03.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.866+0000 7fe594ec69c0 20 realm 2024-09-12T18:07:03.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.866+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.866+0000 7fe594ec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:03.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.866+0000 7fe594ec69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:03.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.866+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.866+0000 7fe594ec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:03.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.866+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.870+0000 7fe594ec69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:03.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.870+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:03.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.870+0000 7fe594ec69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:03.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.870+0000 7fe594ec69c0 20 searching for the correct realm 2024-09-12T18:07:03.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:03.874+0000 7fe5921cb640 0 -- 172.21.15.97:0/1297732318 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fe57c020030 msgr2=0x7fe57c0620b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:04.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.090+0000 7fe5929cc640 0 -- 172.21.15.97:0/1297732318 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fe58c034b50 msgr2=0x7fe58c020940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:04.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:04.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:04.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:04.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:04.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:04.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:04.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:04.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:04.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:04.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:04.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:04.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:04.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 zone default found 2024-09-12T18:07:04.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 4 Realm: () 2024-09-12T18:07:04.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:04.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:04.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:04.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 zonegroup default 2024-09-12T18:07:04.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:04.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:04.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.102+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:04.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.106+0000 7fe594ec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:04.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.106+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:04.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.106+0000 7fe594ec69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:04.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.106+0000 7fe594ec69c0 20 started sync module instance, tier type = 2024-09-12T18:07:04.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.106+0000 7fe594ec69c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:04.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.126+0000 7fe594ec69c0 20 add_watcher() i=0 2024-09-12T18:07:04.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.126+0000 7fe594ec69c0 20 add_watcher() i=1 2024-09-12T18:07:04.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.126+0000 7fe594ec69c0 20 add_watcher() i=2 2024-09-12T18:07:04.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.126+0000 7fe594ec69c0 20 add_watcher() i=3 2024-09-12T18:07:04.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.126+0000 7fe594ec69c0 20 add_watcher() i=4 2024-09-12T18:07:04.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.126+0000 7fe594ec69c0 20 add_watcher() i=5 2024-09-12T18:07:04.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.126+0000 7fe594ec69c0 20 add_watcher() i=6 2024-09-12T18:07:04.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.130+0000 7fe594ec69c0 20 add_watcher() i=7 2024-09-12T18:07:04.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.130+0000 7fe594ec69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:04.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.134+0000 7fe4497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:04.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.134+0000 7fe594ec69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:04.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.134+0000 7fe594ec69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:04.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.134+0000 7fe594ec69c0 5 note: GC not initialized 2024-09-12T18:07:04.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.134+0000 7fe3c3fff640 20 reqs_thread_entry: start 2024-09-12T18:07:04.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.134+0000 7fe594ec69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:04.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.134+0000 7fe594ec69c0 20 Filter name: none 2024-09-12T18:07:04.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.134+0000 7fe3c1ffb640 20 reqs_thread_entry: start 2024-09-12T18:07:04.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.134+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:04.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.138+0000 7fe594ec69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:07:04.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.138+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:04.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.138+0000 7fe594ec69c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:07:04.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.138+0000 7fe594ec69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:04.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.138+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:04.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.138+0000 7fe594ec69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:07:04.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.138+0000 7fe594ec69c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:04.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.138+0000 7fe594ec69c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:07:04.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.138+0000 7fe594ec69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:04.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.142+0000 7fe4497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:04.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.146+0000 7fe594ec69c0 20 remove_watcher() i=0 2024-09-12T18:07:04.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.146+0000 7fe594ec69c0 2 removed watcher, disabling cache 2024-09-12T18:07:04.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.146+0000 7fe594ec69c0 20 remove_watcher() i=1 2024-09-12T18:07:04.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.150+0000 7fe594ec69c0 20 remove_watcher() i=2 2024-09-12T18:07:04.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.150+0000 7fe594ec69c0 20 remove_watcher() i=3 2024-09-12T18:07:04.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.154+0000 7fe594ec69c0 20 remove_watcher() i=4 2024-09-12T18:07:04.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.154+0000 7fe594ec69c0 20 remove_watcher() i=5 2024-09-12T18:07:04.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.158+0000 7fe594ec69c0 20 remove_watcher() i=6 2024-09-12T18:07:04.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:04.162+0000 7fe594ec69c0 20 remove_watcher() i=7 2024-09-12T18:07:04.179 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:04.179 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:07:04.179 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-logrecord-writes id: 98539659-fdaf-41ce-847d-239ff89323af.4641.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:07:04.179 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:04.181 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:04.181 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:04.205 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:04.205 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:04.715 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:04.715 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:05.099 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T18:07:05.099 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:05.104 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:05.104 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:05.237 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:05.237 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:05.325 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:05.325 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:05.427 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:05.427 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:05.526 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:05.527 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:05.624 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:05.625 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:05.721 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:05.721 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:05.818 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:05.819 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:05.911 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:05.911 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:06.013 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:06.013 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:06.110 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:06.110 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:06.204 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:06.204 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:06.292 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:06.292 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:06.398 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:06.398 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:06.495 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:06.496 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:06.586 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:06.587 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:06.685 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:06.685 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:06.776 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:06.776 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:06.873 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:06.873 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:06.971 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:06.971 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:07.066 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:07.066 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:07.150 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:07.150 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:07.248 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:07:07.282 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:07.282 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:07.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.326+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.330+0000 7fc62dd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.330+0000 7fc62dd7b9c0 20 realm 2024-09-12T18:07:07.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.330+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.330+0000 7fc62dd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.330+0000 7fc62dd7b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:07.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.330+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.330+0000 7fc62dd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.330+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.330+0000 7fc62dd7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:07.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.330+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.334+0000 7fc62dd7b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:07.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.334+0000 7fc62dd7b9c0 20 searching for the correct realm 2024-09-12T18:07:07.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.338+0000 7fc62b080640 0 -- 172.21.15.97:0/1455741073 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fc620017040 msgr2=0x7fc620053050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:07.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.550+0000 7fc62c082640 0 -- 172.21.15.97:0/1455741073 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x561581730750 msgr2=0x561581732b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:07.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.562+0000 7fc62dd7b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:07.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.562+0000 7fc62dd7b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:07.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.562+0000 7fc62dd7b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:07.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.562+0000 7fc62dd7b9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:07.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.562+0000 7fc62dd7b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:07.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.562+0000 7fc62dd7b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:07.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.562+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.562+0000 7fc62dd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.562+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:07.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:07.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 20 zone default found 2024-09-12T18:07:07.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 4 Realm: () 2024-09-12T18:07:07.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:07.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:07.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:07.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 20 zonegroup default 2024-09-12T18:07:07.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.566+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.570+0000 7fc62dd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.570+0000 7fc62dd7b9c0 20 started sync module instance, tier type = 2024-09-12T18:07:07.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.570+0000 7fc62dd7b9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:07.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.590+0000 7fc62dd7b9c0 20 add_watcher() i=0 2024-09-12T18:07:07.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.590+0000 7fc62dd7b9c0 20 add_watcher() i=1 2024-09-12T18:07:07.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.590+0000 7fc62dd7b9c0 20 add_watcher() i=2 2024-09-12T18:07:07.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.590+0000 7fc62dd7b9c0 20 add_watcher() i=3 2024-09-12T18:07:07.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.590+0000 7fc62dd7b9c0 20 add_watcher() i=4 2024-09-12T18:07:07.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.590+0000 7fc62dd7b9c0 20 add_watcher() i=5 2024-09-12T18:07:07.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.590+0000 7fc62dd7b9c0 20 add_watcher() i=6 2024-09-12T18:07:07.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.594+0000 7fc62dd7b9c0 20 add_watcher() i=7 2024-09-12T18:07:07.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.594+0000 7fc62dd7b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:07.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.598+0000 7fc4e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:07.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.598+0000 7fc62dd7b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:07.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.598+0000 7fc62dd7b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:07.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.598+0000 7fc62dd7b9c0 5 note: GC not initialized 2024-09-12T18:07:07.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.598+0000 7fc4e0fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:07.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.598+0000 7fc62dd7b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:07.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.598+0000 7fc62dd7b9c0 20 Filter name: none 2024-09-12T18:07:07.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.598+0000 7fc45a7fc640 20 reqs_thread_entry: start 2024-09-12T18:07:07.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.598+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.598+0000 7fc62dd7b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:07.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.598+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.602+0000 7fc62dd7b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:07.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.602+0000 7fc62dd7b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:07.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.602+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.602+0000 7fc62dd7b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:07.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.602+0000 7fc62dd7b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.602+0000 7fc62dd7b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:07.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.602+0000 7fc62dd7b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:07.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.606+0000 7fc4e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:07.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.610+0000 7fc62dd7b9c0 20 remove_watcher() i=0 2024-09-12T18:07:07.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.610+0000 7fc62dd7b9c0 2 removed watcher, disabling cache 2024-09-12T18:07:07.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.614+0000 7fc62dd7b9c0 20 remove_watcher() i=1 2024-09-12T18:07:07.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.614+0000 7fc62dd7b9c0 20 remove_watcher() i=2 2024-09-12T18:07:07.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.618+0000 7fc62dd7b9c0 20 remove_watcher() i=3 2024-09-12T18:07:07.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.618+0000 7fc62dd7b9c0 20 remove_watcher() i=4 2024-09-12T18:07:07.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.622+0000 7fc62dd7b9c0 20 remove_watcher() i=5 2024-09-12T18:07:07.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.626+0000 7fc62dd7b9c0 20 remove_watcher() i=6 2024-09-12T18:07:07.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.630+0000 7fc62dd7b9c0 20 remove_watcher() i=7 2024-09-12T18:07:07.644 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:07.644 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:07:07.644 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-change-reshard-state id: 98539659-fdaf-41ce-847d-239ff89323af.4641.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:07:07.644 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:07.644 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T18:07:07.677 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:07.677 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:07.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.722+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.722+0000 7f0a95df59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.722+0000 7f0a95df59c0 20 realm 2024-09-12T18:07:07.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.722+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.722+0000 7f0a95df59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.722+0000 7f0a95df59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:07.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.722+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.726+0000 7f0a95df59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.726+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.726+0000 7f0a95df59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:07.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.726+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.726+0000 7f0a95df59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:07.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.726+0000 7f0a95df59c0 20 searching for the correct realm 2024-09-12T18:07:07.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.734+0000 7f0a930fa640 0 -- 172.21.15.97:0/1467106987 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f0a7c065b30 msgr2=0x7f0a7c0167a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:07.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.738+0000 7f0a940fc640 0 -- 172.21.15.97:0/1467106987 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x560efd80ce20 msgr2=0x560efd80f230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:07.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:07.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:07.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:07.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:07.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:07.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:07.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 zone default found 2024-09-12T18:07:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 4 Realm: () 2024-09-12T18:07:07.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 zonegroup default 2024-09-12T18:07:07.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.746+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.750+0000 7f0a95df59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.750+0000 7f0a95df59c0 20 started sync module instance, tier type = 2024-09-12T18:07:07.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.750+0000 7f0a95df59c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:07.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.766+0000 7f0a95df59c0 20 add_watcher() i=0 2024-09-12T18:07:07.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.766+0000 7f0a95df59c0 20 add_watcher() i=1 2024-09-12T18:07:07.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.766+0000 7f0a95df59c0 20 add_watcher() i=2 2024-09-12T18:07:07.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.766+0000 7f0a95df59c0 20 add_watcher() i=3 2024-09-12T18:07:07.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.766+0000 7f0a95df59c0 20 add_watcher() i=4 2024-09-12T18:07:07.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.766+0000 7f0a95df59c0 20 add_watcher() i=5 2024-09-12T18:07:07.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.766+0000 7f0a95df59c0 20 add_watcher() i=6 2024-09-12T18:07:07.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.770+0000 7f0a95df59c0 20 add_watcher() i=7 2024-09-12T18:07:07.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.770+0000 7f0a95df59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:07.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.770+0000 7f0949fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:07.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:07.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:07.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 5 note: GC not initialized 2024-09-12T18:07:07.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0948fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:07.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:07.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 20 Filter name: none 2024-09-12T18:07:07.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f08c27fc640 20 reqs_thread_entry: start 2024-09-12T18:07:07.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:07:07.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:07.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:07:07.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:07:07.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 : miss 2024-09-12T18:07:07.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:07.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:07.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:07.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:07.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:07.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.774+0000 7f0a95df59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 2024-09-12T18:07:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.786+0000 7f0a95df59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.786+0000 7f0a95df59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.786+0000 7f0a95df59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.786+0000 7f0a95df59c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37, ofs0, ns] 2024-09-12T18:07:07.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.786+0000 7f0972ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431609 cookie 94622382612496 notifier 7373 bl.length()=931 2024-09-12T18:07:07.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.786+0000 7f0972ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:07.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.786+0000 7f0972ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:07.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.786+0000 7f0972ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.790+0000 7f0a95df59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): orig_sources= new_sources= 2024-09-12T18:07:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.790+0000 7f0a95df59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): potential sources added=[] removed=[] 2024-09-12T18:07:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.790+0000 7f0a95df59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): orig_dests= new_dests= 2024-09-12T18:07:07.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.790+0000 7f0a95df59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): potential dests added=[] removed=[] 2024-09-12T18:07:07.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.0 2024-09-12T18:07:07.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.0 2024-09-12T18:07:07.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.1 2024-09-12T18:07:07.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.1 2024-09-12T18:07:07.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.2 2024-09-12T18:07:07.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.2 2024-09-12T18:07:07.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.3 2024-09-12T18:07:07.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.3 2024-09-12T18:07:07.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.4 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.4 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.5 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.5 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.6 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.6 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.7 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.7 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.8 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.8 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.9 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.9 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.10 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.10 2024-09-12T18:07:07.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.11 2024-09-12T18:07:07.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.11 2024-09-12T18:07:07.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.798+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.0 2024-09-12T18:07:07.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.802+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1 2024-09-12T18:07:07.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.802+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.2 2024-09-12T18:07:07.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.802+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.3 2024-09-12T18:07:07.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.802+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.4 2024-09-12T18:07:07.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.802+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.5 2024-09-12T18:07:07.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.806+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.6 2024-09-12T18:07:07.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.806+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.7 2024-09-12T18:07:07.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.806+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.8 2024-09-12T18:07:07.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.806+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.9 2024-09-12T18:07:07.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.810+0000 7f0a95df59c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.10 2024-09-12T18:07:07.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.814+0000 7f0a95df59c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T18:07:07.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.814+0000 7f0a95df59c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T18:07:07.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.834+0000 7f0a95df59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:07:07.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.834+0000 7f0a95df59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 2024-09-12T18:07:07.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f0a95df59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:07.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f0a95df59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:07.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f0a95df59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:07.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f0a95df59c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37, ofs0, ns] 2024-09-12T18:07:07.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f09727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431610 cookie 94622382612496 notifier 7373 bl.length()=899 2024-09-12T18:07:07.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f09727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f09727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f09727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f0a95df59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): orig_sources= new_sources= 2024-09-12T18:07:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f0a95df59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): potential sources added=[] removed=[] 2024-09-12T18:07:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f0a95df59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): orig_dests= new_dests= 2024-09-12T18:07:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f0a95df59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): potential dests added=[] removed=[] 2024-09-12T18:07:07.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.838+0000 7f0a95df59c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T18:07:07.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.842+0000 7f0949fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.846+0000 7f0a95df59c0 20 remove_watcher() i=0 2024-09-12T18:07:07.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.846+0000 7f0a95df59c0 2 removed watcher, disabling cache 2024-09-12T18:07:07.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.846+0000 7f0a95df59c0 20 remove_watcher() i=1 2024-09-12T18:07:07.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.850+0000 7f0a95df59c0 20 remove_watcher() i=2 2024-09-12T18:07:07.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.850+0000 7f0a95df59c0 20 remove_watcher() i=3 2024-09-12T18:07:07.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.854+0000 7f0a95df59c0 20 remove_watcher() i=4 2024-09-12T18:07:07.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.854+0000 7f0a95df59c0 20 remove_watcher() i=5 2024-09-12T18:07:07.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.858+0000 7f0a95df59c0 20 remove_watcher() i=6 2024-09-12T18:07:07.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.862+0000 7f0a95df59c0 20 remove_watcher() i=7 2024-09-12T18:07:07.876 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:07:07.902 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:07.902 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:07.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.946+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.946+0000 7fa8784b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.946+0000 7fa8784b59c0 20 realm 2024-09-12T18:07:07.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.946+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.946+0000 7fa8784b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.946+0000 7fa8784b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:07.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.946+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.950+0000 7fa8784b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:07.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.950+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.950+0000 7fa8784b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:07.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.950+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:07.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.950+0000 7fa8784b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:07.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.950+0000 7fa8784b59c0 20 searching for the correct realm 2024-09-12T18:07:07.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.954+0000 7fa8757ba640 0 -- 172.21.15.97:0/2060487069 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x55b8471baee0 msgr2=0x55b8471bd2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:07.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:07.958+0000 7fa875fbb640 0 -- 172.21.15.97:0/2060487069 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fa87001f060 msgr2=0x7fa870098040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:08.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:08.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:08.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:08.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:08.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:08.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:08.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:08.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:08.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 zone default found 2024-09-12T18:07:08.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 4 Realm: () 2024-09-12T18:07:08.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:08.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:08.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:08.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 zonegroup default 2024-09-12T18:07:08.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.178+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.182+0000 7fa8784b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.182+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.182+0000 7fa8784b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.182+0000 7fa8784b59c0 20 started sync module instance, tier type = 2024-09-12T18:07:08.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.182+0000 7fa8784b59c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:08.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.206+0000 7fa8784b59c0 20 add_watcher() i=0 2024-09-12T18:07:08.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.206+0000 7fa8784b59c0 20 add_watcher() i=1 2024-09-12T18:07:08.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.206+0000 7fa8784b59c0 20 add_watcher() i=2 2024-09-12T18:07:08.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.206+0000 7fa8784b59c0 20 add_watcher() i=3 2024-09-12T18:07:08.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.206+0000 7fa8784b59c0 20 add_watcher() i=4 2024-09-12T18:07:08.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.206+0000 7fa8784b59c0 20 add_watcher() i=5 2024-09-12T18:07:08.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.206+0000 7fa8784b59c0 20 add_watcher() i=6 2024-09-12T18:07:08.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.206+0000 7fa8784b59c0 20 add_watcher() i=7 2024-09-12T18:07:08.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.206+0000 7fa8784b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:08.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.210+0000 7fa7277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:08.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.214+0000 7fa8784b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:08.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.214+0000 7fa8784b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:08.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.214+0000 7fa8784b59c0 5 note: GC not initialized 2024-09-12T18:07:08.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.214+0000 7fa7267fc640 20 reqs_thread_entry: start 2024-09-12T18:07:08.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.214+0000 7fa8784b59c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:08.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.214+0000 7fa8784b59c0 20 Filter name: none 2024-09-12T18:07:08.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.214+0000 7fa697fff640 20 reqs_thread_entry: start 2024-09-12T18:07:08.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.214+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.214+0000 7fa8784b59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:08.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.214+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.218+0000 7fa8784b59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:08.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.218+0000 7fa8784b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:08.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.218+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.218+0000 7fa8784b59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:08.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.218+0000 7fa8784b59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.218+0000 7fa8784b59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:08.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.218+0000 7fa8784b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:08.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.222+0000 7fa7277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:08.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.226+0000 7fa8784b59c0 20 remove_watcher() i=0 2024-09-12T18:07:08.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.226+0000 7fa8784b59c0 2 removed watcher, disabling cache 2024-09-12T18:07:08.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.226+0000 7fa8784b59c0 20 remove_watcher() i=1 2024-09-12T18:07:08.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.230+0000 7fa8784b59c0 20 remove_watcher() i=2 2024-09-12T18:07:08.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.230+0000 7fa8784b59c0 20 remove_watcher() i=3 2024-09-12T18:07:08.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.234+0000 7fa8784b59c0 20 remove_watcher() i=4 2024-09-12T18:07:08.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.234+0000 7fa8784b59c0 20 remove_watcher() i=5 2024-09-12T18:07:08.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.238+0000 7fa8784b59c0 20 remove_watcher() i=6 2024-09-12T18:07:08.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.238+0000 7fa8784b59c0 20 remove_watcher() i=7 2024-09-12T18:07:08.255 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:08.256 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:07:08.256 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-change-reshard-state id: 98539659-fdaf-41ce-847d-239ff89323af.4641.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:07:08.256 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:08.257 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:08.257 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:08.308 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:08.309 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:08.394 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:07:08.432 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:08.432 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:08.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.474+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.478+0000 7f65f9a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.478+0000 7f65f9a309c0 20 realm 2024-09-12T18:07:08.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.478+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.478+0000 7f65f9a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.478+0000 7f65f9a309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:08.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.478+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.478+0000 7f65f9a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.478+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.478+0000 7f65f9a309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:08.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.478+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.482+0000 7f65f9a309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:08.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.482+0000 7f65f9a309c0 20 searching for the correct realm 2024-09-12T18:07:08.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.486+0000 7f65f7d37640 0 -- 172.21.15.97:0/1795445896 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f65ec076c20 msgr2=0x7f65ec072050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:08.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.494+0000 7f65f7536640 0 -- 172.21.15.97:0/1795445896 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f65f00faf30 msgr2=0x7f65f0111a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:08.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:08.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:08.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:08.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:08.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:08.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:08.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:08.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:08.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 zone default found 2024-09-12T18:07:08.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 4 Realm: () 2024-09-12T18:07:08.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:08.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:08.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:08.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 zonegroup default 2024-09-12T18:07:08.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.502+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.506+0000 7f65f9a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.506+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.506+0000 7f65f9a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.506+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.506+0000 7f65f9a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.506+0000 7f65f9a309c0 20 started sync module instance, tier type = 2024-09-12T18:07:08.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.506+0000 7f65f9a309c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:08.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.522+0000 7f65f9a309c0 20 add_watcher() i=0 2024-09-12T18:07:08.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.522+0000 7f65f9a309c0 20 add_watcher() i=1 2024-09-12T18:07:08.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.522+0000 7f65f9a309c0 20 add_watcher() i=2 2024-09-12T18:07:08.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.522+0000 7f65f9a309c0 20 add_watcher() i=3 2024-09-12T18:07:08.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.522+0000 7f65f9a309c0 20 add_watcher() i=4 2024-09-12T18:07:08.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.522+0000 7f65f9a309c0 20 add_watcher() i=5 2024-09-12T18:07:08.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.522+0000 7f65f9a309c0 20 add_watcher() i=6 2024-09-12T18:07:08.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.526+0000 7f65f9a309c0 20 add_watcher() i=7 2024-09-12T18:07:08.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.526+0000 7f65f9a309c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:08.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f64ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:08.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:08.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:08.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 5 note: GC not initialized 2024-09-12T18:07:08.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f64ad7e2640 20 reqs_thread_entry: start 2024-09-12T18:07:08.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:08.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 20 Filter name: none 2024-09-12T18:07:08.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f64a67fc640 20 reqs_thread_entry: start 2024-09-12T18:07:08.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:07:08.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:08.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:07:08.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:07:08.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 : miss 2024-09-12T18:07:08.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.530+0000 7f65f9a309c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.534+0000 7f65f9a309c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:08.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.534+0000 7f65f9a309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:08.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.534+0000 7f65f9a309c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:08.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.534+0000 7f65f9a309c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:08.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.534+0000 7f65f9a309c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:08.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.534+0000 7f65f9a309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 2024-09-12T18:07:08.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.542+0000 7f65f9a309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:08.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.542+0000 7f65f9a309c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:08.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.542+0000 7f65f9a309c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:08.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.542+0000 7f65f9a309c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37, ofs0, ns] 2024-09-12T18:07:08.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.546+0000 7f64daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431611 cookie 94435657015952 notifier 7406 bl.length()=931 2024-09-12T18:07:08.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.546+0000 7f64daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:08.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.546+0000 7f64daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:08.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.546+0000 7f64daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:08.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.546+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): orig_sources= new_sources= 2024-09-12T18:07:08.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.546+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): potential sources added=[] removed=[] 2024-09-12T18:07:08.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.546+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): orig_dests= new_dests= 2024-09-12T18:07:08.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.546+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): potential dests added=[] removed=[] 2024-09-12T18:07:08.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.0 2024-09-12T18:07:08.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.0 2024-09-12T18:07:08.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.1 2024-09-12T18:07:08.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.1 2024-09-12T18:07:08.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.2 2024-09-12T18:07:08.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.2 2024-09-12T18:07:08.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.3 2024-09-12T18:07:08.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.3 2024-09-12T18:07:08.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.4 2024-09-12T18:07:08.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.4 2024-09-12T18:07:08.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.5 2024-09-12T18:07:08.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.5 2024-09-12T18:07:08.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.6 2024-09-12T18:07:08.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.6 2024-09-12T18:07:08.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.7 2024-09-12T18:07:08.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.7 2024-09-12T18:07:08.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.8 2024-09-12T18:07:08.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.8 2024-09-12T18:07:08.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.9 2024-09-12T18:07:08.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.9 2024-09-12T18:07:08.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.10 2024-09-12T18:07:08.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.10 2024-09-12T18:07:08.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.11 2024-09-12T18:07:08.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1.11 2024-09-12T18:07:08.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.0 2024-09-12T18:07:08.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1 2024-09-12T18:07:08.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.558+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.2 2024-09-12T18:07:08.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.562+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.3 2024-09-12T18:07:08.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.562+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.4 2024-09-12T18:07:08.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.562+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.5 2024-09-12T18:07:08.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.566+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.6 2024-09-12T18:07:08.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.566+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.7 2024-09-12T18:07:08.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.566+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.8 2024-09-12T18:07:08.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.566+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.9 2024-09-12T18:07:08.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.570+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.10 2024-09-12T18:07:08.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.574+0000 7f65f9a309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:07:08.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.574+0000 7f65f9a309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 2024-09-12T18:07:08.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.578+0000 7f65f9a309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:08.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.578+0000 7f65f9a309c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:08.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.578+0000 7f65f9a309c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:08.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.578+0000 7f65f9a309c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37, ofs0, ns] 2024-09-12T18:07:08.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.578+0000 7f64da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94435657015952 notifier 7406 bl.length()=931 2024-09-12T18:07:08.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.578+0000 7f64da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:08.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.578+0000 7f64da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:08.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.578+0000 7f64da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:08.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.582+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): orig_sources= new_sources= 2024-09-12T18:07:08.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.582+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): potential sources added=[] removed=[] 2024-09-12T18:07:08.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.582+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): orig_dests= new_dests= 2024-09-12T18:07:08.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.582+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): potential dests added=[] removed=[] 2024-09-12T18:07:08.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.586+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.0 2024-09-12T18:07:08.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.586+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.1 2024-09-12T18:07:08.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.586+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.2 2024-09-12T18:07:08.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.586+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.3 2024-09-12T18:07:08.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.590+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.4 2024-09-12T18:07:08.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.590+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.5 2024-09-12T18:07:08.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.590+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.6 2024-09-12T18:07:08.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.590+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.7 2024-09-12T18:07:08.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.590+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.8 2024-09-12T18:07:08.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.590+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.9 2024-09-12T18:07:08.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.594+0000 7f65f9a309c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.37.10 2024-09-12T18:07:08.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.594+0000 7f65f9a309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:07:08.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.594+0000 7f65f9a309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 2024-09-12T18:07:08.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f65f9a309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:08.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f65f9a309c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:08.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f65f9a309c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:08.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f65f9a309c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37, ofs0, ns] 2024-09-12T18:07:08.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f64da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431613 cookie 94435657015952 notifier 7406 bl.length()=899 2024-09-12T18:07:08.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f64da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 info.flags=0x17 2024-09-12T18:07:08.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f64da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.37 to cache LRU end 2024-09-12T18:07:08.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f64da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:08.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): orig_sources= new_sources= 2024-09-12T18:07:08.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): potential sources added=[] removed=[] 2024-09-12T18:07:08.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): orig_dests= new_dests= 2024-09-12T18:07:08.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.598+0000 7f65f9a309c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.37]): potential dests added=[] removed=[] 2024-09-12T18:07:08.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.606+0000 7f65f9a309c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T18:07:08.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.606+0000 7f64ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:08.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.610+0000 7f65f9a309c0 20 remove_watcher() i=0 2024-09-12T18:07:08.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.610+0000 7f65f9a309c0 2 removed watcher, disabling cache 2024-09-12T18:07:08.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.614+0000 7f65f9a309c0 20 remove_watcher() i=1 2024-09-12T18:07:08.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.614+0000 7f65f9a309c0 20 remove_watcher() i=2 2024-09-12T18:07:08.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.618+0000 7f65f9a309c0 20 remove_watcher() i=3 2024-09-12T18:07:08.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.618+0000 7f65f9a309c0 20 remove_watcher() i=4 2024-09-12T18:07:08.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.622+0000 7f65f9a309c0 20 remove_watcher() i=5 2024-09-12T18:07:08.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.626+0000 7f65f9a309c0 20 remove_watcher() i=6 2024-09-12T18:07:08.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.626+0000 7f65f9a309c0 20 remove_watcher() i=7 2024-09-12T18:07:08.645 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:07:08.672 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:08.672 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:08.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.718+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.718+0000 7f955ad829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.718+0000 7f955ad829c0 20 realm 2024-09-12T18:07:08.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.718+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.718+0000 7f955ad829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.718+0000 7f955ad829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:08.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.718+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.718+0000 7f955ad829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.718+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.722+0000 7f955ad829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:08.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.722+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.722+0000 7f955ad829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:08.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.722+0000 7f955ad829c0 20 searching for the correct realm 2024-09-12T18:07:08.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.730+0000 7f9558888640 0 -- 172.21.15.97:0/3016459618 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f9548008050 msgr2=0x7f9548082960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:08.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.734+0000 7f9558888640 0 -- 172.21.15.97:0/3016459618 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f95540c6960 msgr2=0x7f95540dc400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:08.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:08.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:08.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:08.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:08.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:08.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:08.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:08.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:08.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 zone default found 2024-09-12T18:07:08.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 4 Realm: () 2024-09-12T18:07:08.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:08.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:08.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:08.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 zonegroup default 2024-09-12T18:07:08.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.742+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.746+0000 7f955ad829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.746+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.746+0000 7f955ad829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.746+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.746+0000 7f955ad829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:08.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.746+0000 7f955ad829c0 20 started sync module instance, tier type = 2024-09-12T18:07:08.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.746+0000 7f955ad829c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:08.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.766+0000 7f955ad829c0 20 add_watcher() i=0 2024-09-12T18:07:08.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.766+0000 7f955ad829c0 20 add_watcher() i=1 2024-09-12T18:07:08.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.766+0000 7f955ad829c0 20 add_watcher() i=2 2024-09-12T18:07:08.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.766+0000 7f955ad829c0 20 add_watcher() i=3 2024-09-12T18:07:08.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.766+0000 7f955ad829c0 20 add_watcher() i=4 2024-09-12T18:07:08.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.766+0000 7f955ad829c0 20 add_watcher() i=5 2024-09-12T18:07:08.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.766+0000 7f955ad829c0 20 add_watcher() i=6 2024-09-12T18:07:08.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.766+0000 7f955ad829c0 20 add_watcher() i=7 2024-09-12T18:07:08.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.766+0000 7f955ad829c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:08.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.770+0000 7f940efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.770+0000 7f955ad829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.770+0000 7f955ad829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.770+0000 7f955ad829c0 5 note: GC not initialized 2024-09-12T18:07:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.770+0000 7f940dfe3640 20 reqs_thread_entry: start 2024-09-12T18:07:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.770+0000 7f955ad829c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.770+0000 7f955ad829c0 20 Filter name: none 2024-09-12T18:07:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.770+0000 7f937f7fe640 20 reqs_thread_entry: start 2024-09-12T18:07:08.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.770+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.770+0000 7f955ad829c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:08.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.770+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.774+0000 7f955ad829c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:08.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.774+0000 7f955ad829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:08.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.774+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.774+0000 7f955ad829c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:08.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.774+0000 7f955ad829c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:08.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.774+0000 7f955ad829c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:08.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.774+0000 7f955ad829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:08.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.778+0000 7f940efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:08.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.782+0000 7f955ad829c0 20 remove_watcher() i=0 2024-09-12T18:07:08.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.782+0000 7f955ad829c0 2 removed watcher, disabling cache 2024-09-12T18:07:08.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.782+0000 7f955ad829c0 20 remove_watcher() i=1 2024-09-12T18:07:08.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.786+0000 7f955ad829c0 20 remove_watcher() i=2 2024-09-12T18:07:08.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.786+0000 7f955ad829c0 20 remove_watcher() i=3 2024-09-12T18:07:08.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.790+0000 7f955ad829c0 20 remove_watcher() i=4 2024-09-12T18:07:08.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.790+0000 7f955ad829c0 20 remove_watcher() i=5 2024-09-12T18:07:08.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.794+0000 7f955ad829c0 20 remove_watcher() i=6 2024-09-12T18:07:08.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:08.798+0000 7f955ad829c0 20 remove_watcher() i=7 2024-09-12T18:07:08.813 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:08.813 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:07:08.814 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-change-reshard-state id: 98539659-fdaf-41ce-847d-239ff89323af.4641.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:07:08.814 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:08.815 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:08.815 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:08.834 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:08.834 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:09.352 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:09.352 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:09.726 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T18:07:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:09.729 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:09.861 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:09.861 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:09.948 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:09.948 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:10.076 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:10.076 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:10.173 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:10.173 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:10.268 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:10.268 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:10.361 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:10.361 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:10.454 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:10.454 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:10.555 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:10.555 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:10.651 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:10.651 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:10.749 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:10.749 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:10.847 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:10.847 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:10.945 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:11.039 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:11.039 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:11.129 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:11.129 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:11.222 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:11.222 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:11.318 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:11.318 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:11.409 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:11.409 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:11.502 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:11.502 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:11.598 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:11.598 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:11.694 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:11.694 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:11.794 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:11.795 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:11.894 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:07:11.928 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:11.929 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:11.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.974+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:11.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.974+0000 7f7e8724c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:11.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.974+0000 7f7e8724c9c0 20 realm 2024-09-12T18:07:11.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.974+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:11.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.978+0000 7f7e8724c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:11.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.978+0000 7f7e8724c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:11.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.978+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:11.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.978+0000 7f7e8724c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:11.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.978+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:11.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.978+0000 7f7e8724c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:11.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.978+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:11.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.978+0000 7f7e8724c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:11.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.978+0000 7f7e8724c9c0 20 searching for the correct realm 2024-09-12T18:07:11.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:11.982+0000 7f7e84d52640 0 -- 172.21.15.97:0/4212673802 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f7e74079910 msgr2=0x7f7e74062440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:12.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.194+0000 7f7e84d52640 0 -- 172.21.15.97:0/4212673802 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f7e7c0bb070 msgr2=0x7f7e7c0f7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:12.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:12.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:12.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:12.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:12.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:12.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:12.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:12.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:12.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 zone default found 2024-09-12T18:07:12.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 4 Realm: () 2024-09-12T18:07:12.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:12.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:12.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:12.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 zonegroup default 2024-09-12T18:07:12.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.414+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.418+0000 7f7e8724c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.418+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.418+0000 7f7e8724c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.418+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.418+0000 7f7e8724c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.418+0000 7f7e8724c9c0 20 started sync module instance, tier type = 2024-09-12T18:07:12.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.418+0000 7f7e8724c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:12.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.442+0000 7f7e8724c9c0 20 add_watcher() i=0 2024-09-12T18:07:12.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.442+0000 7f7e8724c9c0 20 add_watcher() i=1 2024-09-12T18:07:12.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.442+0000 7f7e8724c9c0 20 add_watcher() i=2 2024-09-12T18:07:12.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.442+0000 7f7e8724c9c0 20 add_watcher() i=3 2024-09-12T18:07:12.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.442+0000 7f7e8724c9c0 20 add_watcher() i=4 2024-09-12T18:07:12.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.442+0000 7f7e8724c9c0 20 add_watcher() i=5 2024-09-12T18:07:12.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.442+0000 7f7e8724c9c0 20 add_watcher() i=6 2024-09-12T18:07:12.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.442+0000 7f7e8724c9c0 20 add_watcher() i=7 2024-09-12T18:07:12.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.442+0000 7f7e8724c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:12.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.446+0000 7f7d3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:12.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:12.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:12.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 5 note: GC not initialized 2024-09-12T18:07:12.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7d3a7e4640 20 reqs_thread_entry: start 2024-09-12T18:07:12.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:12.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 Filter name: none 2024-09-12T18:07:12.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7d337fe640 20 reqs_thread_entry: start 2024-09-12T18:07:12.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:12.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:12.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:12.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:12.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:12.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.450+0000 7f7e8724c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:12.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.454+0000 7f7d3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:12.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.458+0000 7f7e8724c9c0 20 remove_watcher() i=0 2024-09-12T18:07:12.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.458+0000 7f7e8724c9c0 2 removed watcher, disabling cache 2024-09-12T18:07:12.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.462+0000 7f7e8724c9c0 20 remove_watcher() i=1 2024-09-12T18:07:12.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.466+0000 7f7e8724c9c0 20 remove_watcher() i=2 2024-09-12T18:07:12.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.466+0000 7f7e8724c9c0 20 remove_watcher() i=3 2024-09-12T18:07:12.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.470+0000 7f7e8724c9c0 20 remove_watcher() i=4 2024-09-12T18:07:12.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.470+0000 7f7e8724c9c0 20 remove_watcher() i=5 2024-09-12T18:07:12.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.474+0000 7f7e8724c9c0 20 remove_watcher() i=6 2024-09-12T18:07:12.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.478+0000 7f7e8724c9c0 20 remove_watcher() i=7 2024-09-12T18:07:12.494 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:12.494 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:07:12.494 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-change-reshard-state id: 98539659-fdaf-41ce-847d-239ff89323af.4641.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:07:12.494 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:12.494 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T18:07:12.531 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:12.531 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:12.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.574+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.578+0000 7f368f07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.578+0000 7f368f07f9c0 20 realm 2024-09-12T18:07:12.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.578+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.578+0000 7f368f07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.578+0000 7f368f07f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:12.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.578+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.578+0000 7f368f07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.578+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.578+0000 7f368f07f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:12.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.578+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.582+0000 7f368f07f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:12.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.582+0000 7f368f07f9c0 20 searching for the correct realm 2024-09-12T18:07:12.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.586+0000 7f368c384640 0 -- 172.21.15.97:0/283363393 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f3674008030 msgr2=0x7f367403a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:12.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.590+0000 7f368c384640 0 -- 172.21.15.97:0/283363393 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x563822c1a130 msgr2=0x563822c1c560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:12.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.598+0000 7f368f07f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:12.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.598+0000 7f368f07f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:12.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.598+0000 7f368f07f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:12.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.598+0000 7f368f07f9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:12.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.598+0000 7f368f07f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:12.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.598+0000 7f368f07f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:12.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.598+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.598+0000 7f368f07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.598+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.598+0000 7f368f07f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:12.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.598+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:12.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 20 zone default found 2024-09-12T18:07:12.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 4 Realm: () 2024-09-12T18:07:12.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:12.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:12.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:12.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 20 zonegroup default 2024-09-12T18:07:12.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 20 started sync module instance, tier type = 2024-09-12T18:07:12.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.602+0000 7f368f07f9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:12.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.622+0000 7f368f07f9c0 20 add_watcher() i=0 2024-09-12T18:07:12.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.622+0000 7f368f07f9c0 20 add_watcher() i=1 2024-09-12T18:07:12.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.622+0000 7f368f07f9c0 20 add_watcher() i=2 2024-09-12T18:07:12.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.622+0000 7f368f07f9c0 20 add_watcher() i=3 2024-09-12T18:07:12.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.622+0000 7f368f07f9c0 20 add_watcher() i=4 2024-09-12T18:07:12.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.622+0000 7f368f07f9c0 20 add_watcher() i=5 2024-09-12T18:07:12.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.622+0000 7f368f07f9c0 20 add_watcher() i=6 2024-09-12T18:07:12.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.622+0000 7f368f07f9c0 20 add_watcher() i=7 2024-09-12T18:07:12.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.622+0000 7f368f07f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:12.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.626+0000 7f3542fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:12.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.626+0000 7f368f07f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:12.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.626+0000 7f368f07f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:12.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.626+0000 7f368f07f9c0 5 note: GC not initialized 2024-09-12T18:07:12.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.626+0000 7f3541fe3640 20 reqs_thread_entry: start 2024-09-12T18:07:12.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.626+0000 7f368f07f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:12.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.626+0000 7f368f07f9c0 20 Filter name: none 2024-09-12T18:07:12.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f34b37fe640 20 reqs_thread_entry: start 2024-09-12T18:07:12.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:07:12.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:07:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:07:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 : miss 2024-09-12T18:07:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 info.flags=0x17 2024-09-12T18:07:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 to cache LRU end 2024-09-12T18:07:12.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:12.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:12.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.630+0000 7f368f07f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 2024-09-12T18:07:12.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.638+0000 7f368f07f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 info.flags=0x17 2024-09-12T18:07:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.638+0000 7f368f07f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 to cache LRU end 2024-09-12T18:07:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.638+0000 7f368f07f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.638+0000 7f368f07f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38, ofs0, ns] 2024-09-12T18:07:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.642+0000 7f35637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431616 cookie 94799101275952 notifier 7953 bl.length()=931 2024-09-12T18:07:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.642+0000 7f35637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 info.flags=0x17 2024-09-12T18:07:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.642+0000 7f35637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 to cache LRU end 2024-09-12T18:07:12.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.642+0000 7f35637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:12.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.642+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): orig_sources= new_sources= 2024-09-12T18:07:12.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.642+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): potential sources added=[] removed=[] 2024-09-12T18:07:12.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.642+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): orig_dests= new_dests= 2024-09-12T18:07:12.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.642+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): potential dests added=[] removed=[] 2024-09-12T18:07:12.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.0 2024-09-12T18:07:12.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.0 2024-09-12T18:07:12.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.1 2024-09-12T18:07:12.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.1 2024-09-12T18:07:12.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.2 2024-09-12T18:07:12.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.2 2024-09-12T18:07:12.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.3 2024-09-12T18:07:12.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.3 2024-09-12T18:07:12.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.4 2024-09-12T18:07:12.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.4 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.5 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.5 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.6 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.6 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.7 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.7 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.8 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.8 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.9 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.9 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.10 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.10 2024-09-12T18:07:12.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.11 2024-09-12T18:07:12.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1.11 2024-09-12T18:07:12.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.0 2024-09-12T18:07:12.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.650+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1 2024-09-12T18:07:12.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.654+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.2 2024-09-12T18:07:12.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.654+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.3 2024-09-12T18:07:12.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.654+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.4 2024-09-12T18:07:12.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.654+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.5 2024-09-12T18:07:12.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.654+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.6 2024-09-12T18:07:12.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.654+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.7 2024-09-12T18:07:12.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.654+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.8 2024-09-12T18:07:12.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.658+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.9 2024-09-12T18:07:12.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.658+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.10 2024-09-12T18:07:12.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.666+0000 7f368f07f9c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T18:07:12.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.666+0000 7f368f07f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 : hit (requested=0x17, cached=0x17) 2024-09-12T18:07:12.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.666+0000 7f368f07f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 2024-09-12T18:07:12.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.666+0000 7f368f07f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 info.flags=0x17 2024-09-12T18:07:12.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.666+0000 7f368f07f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 to cache LRU end 2024-09-12T18:07:12.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.666+0000 7f368f07f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:12.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.666+0000 7f368f07f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38, ofs0, ns] 2024-09-12T18:07:12.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.666+0000 7f35637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94799101275952 notifier 7953 bl.length()=931 2024-09-12T18:07:12.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.666+0000 7f35637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 info.flags=0x17 2024-09-12T18:07:12.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.666+0000 7f35637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 to cache LRU end 2024-09-12T18:07:12.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.666+0000 7f35637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:12.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.670+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): orig_sources= new_sources= 2024-09-12T18:07:12.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.670+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): potential sources added=[] removed=[] 2024-09-12T18:07:12.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.670+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): orig_dests= new_dests= 2024-09-12T18:07:12.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.670+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): potential dests added=[] removed=[] 2024-09-12T18:07:12.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.674+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.0 2024-09-12T18:07:12.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.674+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.1 2024-09-12T18:07:12.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.674+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.2 2024-09-12T18:07:12.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.674+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.3 2024-09-12T18:07:12.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.674+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.4 2024-09-12T18:07:12.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.674+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.5 2024-09-12T18:07:12.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.674+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.6 2024-09-12T18:07:12.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.7 2024-09-12T18:07:12.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.8 2024-09-12T18:07:12.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.9 2024-09-12T18:07:12.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f368f07f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.38.10 2024-09-12T18:07:12.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f368f07f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 : hit (requested=0x17, cached=0x17) 2024-09-12T18:07:12.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f368f07f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 2024-09-12T18:07:12.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f368f07f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 info.flags=0x17 2024-09-12T18:07:12.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f368f07f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 to cache LRU end 2024-09-12T18:07:12.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f368f07f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:12.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f368f07f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38, ofs0, ns] 2024-09-12T18:07:12.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f35637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94799101275952 notifier 7953 bl.length()=899 2024-09-12T18:07:12.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f35637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 info.flags=0x17 2024-09-12T18:07:12.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f35637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.38 to cache LRU end 2024-09-12T18:07:12.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.678+0000 7f35637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:12.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.682+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): orig_sources= new_sources= 2024-09-12T18:07:12.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.682+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): potential sources added=[] removed=[] 2024-09-12T18:07:12.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.682+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): orig_dests= new_dests= 2024-09-12T18:07:12.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.682+0000 7f368f07f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.38]): potential dests added=[] removed=[] 2024-09-12T18:07:12.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.686+0000 7f368f07f9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T18:07:12.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.690+0000 7f3542fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:12.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.694+0000 7f368f07f9c0 20 remove_watcher() i=0 2024-09-12T18:07:12.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.694+0000 7f368f07f9c0 2 removed watcher, disabling cache 2024-09-12T18:07:12.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.694+0000 7f368f07f9c0 20 remove_watcher() i=1 2024-09-12T18:07:12.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.698+0000 7f368f07f9c0 20 remove_watcher() i=2 2024-09-12T18:07:12.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.698+0000 7f368f07f9c0 20 remove_watcher() i=3 2024-09-12T18:07:12.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.702+0000 7f368f07f9c0 20 remove_watcher() i=4 2024-09-12T18:07:12.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.702+0000 7f368f07f9c0 20 remove_watcher() i=5 2024-09-12T18:07:12.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.706+0000 7f368f07f9c0 20 remove_watcher() i=6 2024-09-12T18:07:12.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.710+0000 7f368f07f9c0 20 remove_watcher() i=7 2024-09-12T18:07:12.726 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:07:12.754 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:12.754 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:12.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.798+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.798+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.798+0000 7f4a4e1ad9c0 20 realm 2024-09-12T18:07:12.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.798+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.802+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.802+0000 7f4a4e1ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:12.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.802+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.802+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:12.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.802+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.802+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:12.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.802+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:12.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.802+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:12.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.802+0000 7f4a4e1ad9c0 20 searching for the correct realm 2024-09-12T18:07:12.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:12.810+0000 7f4a4b4b2640 0 -- 172.21.15.97:0/3773657375 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f4a4003e960 msgr2=0x7f4a4002e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:13.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.026+0000 7f4a4b4b2640 0 -- 172.21.15.97:0/3773657375 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x555ccdd25ae0 msgr2=0x555ccdd27f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:13.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:13.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:13.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:13.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:13.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:13.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:13.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:13.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:13.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:13.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:13.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:13.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:13.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 zone default found 2024-09-12T18:07:13.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 4 Realm: () 2024-09-12T18:07:13.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:13.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:13.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:13.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 zonegroup default 2024-09-12T18:07:13.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:13.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:13.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.038+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:13.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.042+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:13.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.042+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:13.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.042+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:13.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.042+0000 7f4a4e1ad9c0 20 started sync module instance, tier type = 2024-09-12T18:07:13.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.042+0000 7f4a4e1ad9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:13.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.062+0000 7f4a4e1ad9c0 20 add_watcher() i=0 2024-09-12T18:07:13.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.062+0000 7f4a4e1ad9c0 20 add_watcher() i=1 2024-09-12T18:07:13.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.062+0000 7f4a4e1ad9c0 20 add_watcher() i=2 2024-09-12T18:07:13.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.062+0000 7f4a4e1ad9c0 20 add_watcher() i=3 2024-09-12T18:07:13.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.062+0000 7f4a4e1ad9c0 20 add_watcher() i=4 2024-09-12T18:07:13.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.062+0000 7f4a4e1ad9c0 20 add_watcher() i=5 2024-09-12T18:07:13.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.062+0000 7f4a4e1ad9c0 20 add_watcher() i=6 2024-09-12T18:07:13.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.066+0000 7f4a4e1ad9c0 20 add_watcher() i=7 2024-09-12T18:07:13.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.066+0000 7f4a4e1ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:13.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.070+0000 7f49027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:13.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.070+0000 7f4a4e1ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:13.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.070+0000 7f4a4e1ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:13.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.070+0000 7f4a4e1ad9c0 5 note: GC not initialized 2024-09-12T18:07:13.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.070+0000 7f49017e2640 20 reqs_thread_entry: start 2024-09-12T18:07:13.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.070+0000 7f4a4e1ad9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:13.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.070+0000 7f4a4e1ad9c0 20 Filter name: none 2024-09-12T18:07:13.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.070+0000 7f48fa7fc640 20 reqs_thread_entry: start 2024-09-12T18:07:13.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.074+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:13.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.074+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:13.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.074+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:13.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.074+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:13.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.074+0000 7f4a4e1ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:13.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.074+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:13.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.074+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:13.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.074+0000 7f4a4e1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:13.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.074+0000 7f4a4e1ad9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:13.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.074+0000 7f4a4e1ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:13.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.078+0000 7f49027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:13.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.082+0000 7f4a4e1ad9c0 20 remove_watcher() i=0 2024-09-12T18:07:13.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.082+0000 7f4a4e1ad9c0 2 removed watcher, disabling cache 2024-09-12T18:07:13.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.082+0000 7f4a4e1ad9c0 20 remove_watcher() i=1 2024-09-12T18:07:13.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.086+0000 7f4a4e1ad9c0 20 remove_watcher() i=2 2024-09-12T18:07:13.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.090+0000 7f4a4e1ad9c0 20 remove_watcher() i=3 2024-09-12T18:07:13.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.090+0000 7f4a4e1ad9c0 20 remove_watcher() i=4 2024-09-12T18:07:13.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.094+0000 7f4a4e1ad9c0 20 remove_watcher() i=5 2024-09-12T18:07:13.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.094+0000 7f4a4e1ad9c0 20 remove_watcher() i=6 2024-09-12T18:07:13.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:13.098+0000 7f4a4e1ad9c0 20 remove_watcher() i=7 2024-09-12T18:07:13.115 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:13.115 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:07:13.116 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-change-reshard-state id: 98539659-fdaf-41ce-847d-239ff89323af.4641.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T18:07:13.116 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:13.117 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:13.117 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:13.145 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:13.145 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:13.738 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:13.738 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:14.590 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T18:07:14.590 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:14.592 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:14.592 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:14.752 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:14.752 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:14.841 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:14.842 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:14.960 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:14.960 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:15.084 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:15.084 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:15.180 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:15.180 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:15.288 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:15.288 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:15.405 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:15.405 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:15.515 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:15.515 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:15.619 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:15.619 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:15.723 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:15.723 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:15.822 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:15.822 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:15.909 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:15.909 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:16.019 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:16.019 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:16.122 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:16.122 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:16.222 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:16.222 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:16.314 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:16.314 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:16.421 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:16.421 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:16.531 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:16.531 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:16.636 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:16.636 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:16.741 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:16.741 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:16.847 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:16.847 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:16.958 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:07:16.992 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:16.992 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:17.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.046+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.046+0000 7feeee8669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.046+0000 7feeee8669c0 20 realm 2024-09-12T18:07:17.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.046+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.046+0000 7feeee8669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.046+0000 7feeee8669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:17.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.046+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.046+0000 7feeee8669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.046+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.050+0000 7feeee8669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.050+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.050+0000 7feeee8669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:17.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.050+0000 7feeee8669c0 20 searching for the correct realm 2024-09-12T18:07:17.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.058+0000 7feeec36c640 0 -- 172.21.15.97:0/2982361912 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7feedc01a040 msgr2=0x7feedc0619e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.062+0000 7feeec36c640 0 -- 172.21.15.97:0/2982361912 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7feee40db940 msgr2=0x7feee40ce400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:17.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:17.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:17.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:17.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:17.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:17.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:17.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 zone default found 2024-09-12T18:07:17.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 4 Realm: () 2024-09-12T18:07:17.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:17.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:17.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:17.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 zonegroup default 2024-09-12T18:07:17.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.070+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.074+0000 7feeee8669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.074+0000 7feeee8669c0 20 started sync module instance, tier type = 2024-09-12T18:07:17.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.074+0000 7feeee8669c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:17.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.090+0000 7feeee8669c0 20 add_watcher() i=0 2024-09-12T18:07:17.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.090+0000 7feeee8669c0 20 add_watcher() i=1 2024-09-12T18:07:17.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.090+0000 7feeee8669c0 20 add_watcher() i=2 2024-09-12T18:07:17.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.090+0000 7feeee8669c0 20 add_watcher() i=3 2024-09-12T18:07:17.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.090+0000 7feeee8669c0 20 add_watcher() i=4 2024-09-12T18:07:17.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.090+0000 7feeee8669c0 20 add_watcher() i=5 2024-09-12T18:07:17.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.090+0000 7feeee8669c0 20 add_watcher() i=6 2024-09-12T18:07:17.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.094+0000 7feeee8669c0 20 add_watcher() i=7 2024-09-12T18:07:17.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.094+0000 7feeee8669c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:17.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feda2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:17.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feeee8669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:17.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feeee8669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:17.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feeee8669c0 5 note: GC not initialized 2024-09-12T18:07:17.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feda1fdb640 20 reqs_thread_entry: start 2024-09-12T18:07:17.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feeee8669c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:17.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feeee8669c0 20 Filter name: none 2024-09-12T18:07:17.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7fed137fe640 20 reqs_thread_entry: start 2024-09-12T18:07:17.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feeee8669c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:17.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feeee8669c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:17.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feeee8669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:17.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.098+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.102+0000 7feeee8669c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:17.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.102+0000 7feeee8669c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.102+0000 7feeee8669c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:17.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.102+0000 7feeee8669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:17.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.102+0000 7feda2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:17.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.106+0000 7feeee8669c0 20 remove_watcher() i=0 2024-09-12T18:07:17.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.106+0000 7feeee8669c0 2 removed watcher, disabling cache 2024-09-12T18:07:17.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.110+0000 7feeee8669c0 20 remove_watcher() i=1 2024-09-12T18:07:17.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.110+0000 7feeee8669c0 20 remove_watcher() i=2 2024-09-12T18:07:17.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.114+0000 7feeee8669c0 20 remove_watcher() i=3 2024-09-12T18:07:17.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.114+0000 7feeee8669c0 20 remove_watcher() i=4 2024-09-12T18:07:17.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.118+0000 7feeee8669c0 20 remove_watcher() i=5 2024-09-12T18:07:17.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.122+0000 7feeee8669c0 20 remove_watcher() i=6 2024-09-12T18:07:17.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.122+0000 7feeee8669c0 20 remove_watcher() i=7 2024-09-12T18:07:17.138 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.138 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:07:17.138 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-change-reshard-state id: 98539659-fdaf-41ce-847d-239ff89323af.4641.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:07:17.138 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.138 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T18:07:17.172 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:17.172 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:17.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.214+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.218+0000 7fad760629c0 20 realm 2024-09-12T18:07:17.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.218+0000 7fad760629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:17.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.222+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:17.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.222+0000 7fad760629c0 20 searching for the correct realm 2024-09-12T18:07:17.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.230+0000 7fad74369640 0 -- 172.21.15.97:0/3058865210 >> [v2:172.21.15.154:6808/3304684764,v1:172.21.15.154:6809/3304684764] conn(0x7fad64008040 msgr2=0x7fad640683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.446+0000 7fad73367640 0 -- 172.21.15.97:0/3058865210 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x563e865dd880 msgr2=0x563e865dfc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:17.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:17.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:17.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:17.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:17.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:17.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:17.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 zone default found 2024-09-12T18:07:17.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 4 Realm: () 2024-09-12T18:07:17.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:17.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:17.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:17.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 zonegroup default 2024-09-12T18:07:17.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.454+0000 7fad760629c0 20 started sync module instance, tier type = 2024-09-12T18:07:17.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.454+0000 7fad760629c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:17.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=0 2024-09-12T18:07:17.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=1 2024-09-12T18:07:17.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=2 2024-09-12T18:07:17.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=3 2024-09-12T18:07:17.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=4 2024-09-12T18:07:17.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=5 2024-09-12T18:07:17.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=6 2024-09-12T18:07:17.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.478+0000 7fad760629c0 20 add_watcher() i=7 2024-09-12T18:07:17.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.478+0000 7fad760629c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:17.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.482+0000 7fac29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:17.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.482+0000 7fad760629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:17.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.482+0000 7fad760629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:17.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 5 note: GC not initialized 2024-09-12T18:07:17.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fac28fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:17.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:17.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 20 Filter name: none 2024-09-12T18:07:17.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7faba27fc640 20 reqs_thread_entry: start 2024-09-12T18:07:17.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:07:17.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:17.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:07:17.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:07:17.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 : miss 2024-09-12T18:07:17.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:17.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:17.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:17.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:17.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.486+0000 7fad760629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 2024-09-12T18:07:17.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.498+0000 7fad760629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:17.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.498+0000 7fad760629c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:17.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.498+0000 7fad760629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.498+0000 7fad760629c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39, ofs0, ns] 2024-09-12T18:07:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431653 cookie 94826542298720 notifier 8004 bl.length()=931 2024-09-12T18:07:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_sources= new_sources= 2024-09-12T18:07:17.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential sources added=[] removed=[] 2024-09-12T18:07:17.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_dests= new_dests= 2024-09-12T18:07:17.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential dests added=[] removed=[] 2024-09-12T18:07:17.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.0 2024-09-12T18:07:17.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.0 2024-09-12T18:07:17.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.1 2024-09-12T18:07:17.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.1 2024-09-12T18:07:17.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.2 2024-09-12T18:07:17.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.2 2024-09-12T18:07:17.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.3 2024-09-12T18:07:17.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.3 2024-09-12T18:07:17.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.4 2024-09-12T18:07:17.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.4 2024-09-12T18:07:17.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.5 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.5 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.6 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.6 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.7 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.7 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.8 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.8 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.9 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.9 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.10 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.10 2024-09-12T18:07:17.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.11 2024-09-12T18:07:17.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.11 2024-09-12T18:07:17.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.0 2024-09-12T18:07:17.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1 2024-09-12T18:07:17.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2 2024-09-12T18:07:17.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.3 2024-09-12T18:07:17.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.4 2024-09-12T18:07:17.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.5 2024-09-12T18:07:17.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.6 2024-09-12T18:07:17.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.7 2024-09-12T18:07:17.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.522+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.8 2024-09-12T18:07:17.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.522+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.9 2024-09-12T18:07:17.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.522+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.10 2024-09-12T18:07:17.530 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad760629c0 time 2024-09-12T18:07:17.533152+0000 2024-09-12T18:07:17.530 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:17.531 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:17.531 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad7993c2eb] 2024-09-12T18:07:17.531 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad7993c49f] 2024-09-12T18:07:17.532 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e840a90c1] 2024-09-12T18:07:17.532 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563e840ba4f1] 2024-09-12T18:07:17.532 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e840bbb44] 2024-09-12T18:07:17.532 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:07:17.532 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad787a2d90] 2024-09-12T18:07:17.532 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:07:17.532 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:07:17.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.530+0000 7fad760629c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad760629c0 time 2024-09-12T18:07:17.533152+0000 2024-09-12T18:07:17.532 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:17.532 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad7993c2eb] 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad7993c49f] 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e840a90c1] 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563e840ba4f1] 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e840bbb44] 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad787a2d90] 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.533 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:07:17.534 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fad760629c0 thread_name:radosgw-admin 2024-09-12T18:07:17.552 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:17.552 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad787bb520] 2024-09-12T18:07:17.552 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:07:17.552 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:07:17.552 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:07:17.552 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad7993c345] 2024-09-12T18:07:17.552 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad7993c49f] 2024-09-12T18:07:17.552 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e840a90c1] 2024-09-12T18:07:17.552 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563e840ba4f1] 2024-09-12T18:07:17.552 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e840bbb44] 2024-09-12T18:07:17.552 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad787a2d90] 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.530+0000 7fad760629c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fad760629c0 thread_name:radosgw-admin 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad787bb520] 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:07:17.553 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad7993c345] 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad7993c49f] 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e840a90c1] 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563e840ba4f1] 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e840bbb44] 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad787a2d90] 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: build_initial_monmap 2024-09-12T18:07:17.554 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:07:17.194+0000 7fad760629c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: monmap: 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding auth protocol: cephx 2024-09-12T18:07:17.555 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding auth protocol: cephx 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding auth protocol: cephx 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.556 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:07:17.194+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:07:17.194+0000 7fad760629c0 1 librados: starting msgr at 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:07:17.194+0000 7fad760629c0 1 librados: starting objecter 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command objecter_requests hook 0x563e8651e250 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:07:17.194+0000 7fad760629c0 1 librados: setting wanted keys 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:07:17.194+0000 7fad760629c0 1 librados: calling monclient init 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: init 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding auth protocol: cephx 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding auth protocol: cephx 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding auth protocol: cephx 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.557 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:07:17.194+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:07:17.194+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command rotate-key hook 0x563e864ed178 2024-09-12T18:07:17.558 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-c con 0x563e863786a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-a con 0x563e86433160 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-b con 0x563e86435de0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): authenticate will time out at 2866.607068s 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): get_auth_request con 0x563e863786a0 auth_method 0 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.559 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): get_auth_request con 0x563e86433160 auth_method 0 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): handle_auth_done global_id 7499 payload 824 2024-09-12T18:07:17.560 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient: _finish_hunting 0 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:07:17.194+0000 7fad73b68640 1 monclient: found mon.noname-c 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:07:17.194+0000 7fad74369640 10 monclient: get_auth_request con 0x563e86435de0 auth_method 0 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: dump: 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.561 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: _finish_auth 0 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: _check_auth_tickets 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: dump: 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.562 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 monclient: authenticate success, global_id 7499 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:07:17.194+0000 7fac61e0b640 4 set_mon_vals no callback set 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:07:17.198+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:07:17.198+0000 7fad760629c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:17.563 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:07:17.198+0000 7fad760629c0 1 librados: init done 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:07:17.198+0000 7fac5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:07:17.198+0000 7fac5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:07:17.198+0000 7fac5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:07:17.198+0000 7fad73367640 10 monclient: get_auth_request con 0x7fac5c070ae0 auth_method 0 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:07:17.198+0000 7fad74369640 10 monclient: get_auth_request con 0x563e86534be0 auth_method 0 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:07:17.202+0000 7fad73b68640 10 monclient: get_auth_request con 0x563e86537dc0 auth_method 0 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:07:17.202+0000 7fad73367640 10 monclient: get_auth_request con 0x563e8653bfb0 auth_method 0 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:07:17.202+0000 7fad760629c0 10 monclient: build_initial_monmap 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:07:17.202+0000 7fad760629c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:07:17.202+0000 7fad760629c0 10 monclient: monmap: 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:17.564 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding auth protocol: cephx 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding auth protocol: cephx 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding auth protocol: cephx 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.565 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:07:17.206+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command objecter_requests cmddesc objecter_requests hook 0x563e86544670 EEXIST 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: init 2024-09-12T18:07:17.566 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding auth protocol: cephx 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding auth protocol: cephx 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding auth protocol: cephx 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.567 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:07:17.206+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:07:17.206+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command rotate-key cmddesc rotate-key hook 0x563e8653f430 EEXIST 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-b con 0x563e86568820 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-a con 0x563e86568150 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-c con 0x563e86566b30 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.568 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): authenticate will time out at 2866.616904s 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): get_auth_request con 0x563e86566b30 auth_method 0 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): get_auth_request con 0x563e86568150 auth_method 0 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.569 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:07:17.206+0000 7fad73b68640 10 monclient(hunting): get_auth_request con 0x563e86568820 auth_method 0 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:07:17.206+0000 7fad73b68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:07:17.206+0000 7fad73b68640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:07:17.206+0000 7fad73b68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): handle_auth_done global_id 7998 payload 824 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient: _finish_hunting 0 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:07:17.206+0000 7fad73367640 1 monclient: found mon.noname-a 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:17.570 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: dump: 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: _finish_auth 0 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: _check_auth_tickets 2024-09-12T18:07:17.571 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: dump: 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.572 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.573 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 monclient: authenticate success, global_id 7998 2024-09-12T18:07:17.573 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:07:17.206+0000 7fad74b6a640 4 set_mon_vals no callback set 2024-09-12T18:07:17.573 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.573 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.573 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.573 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.573 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:07:17.210+0000 7fac597fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:17.573 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:07:17.210+0000 7fac597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.573 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:07:17.210+0000 7fac597fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.573 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: get_monmap_and_config 2024-09-12T18:07:17.573 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: build_initial_monmap 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:07:17.210+0000 7fad760629c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: monmap: 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:17.574 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding auth protocol: cephx 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding auth protocol: cephx 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding auth protocol: cephx 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.575 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:07:17.210+0000 7fad73b68640 10 monclient: get_auth_request con 0x7fac4c070a20 auth_method 0 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:07:17.210+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: init 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding auth protocol: cephx 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding auth protocol: cephx 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding auth protocol: cephx 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.576 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:07:17.210+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:07:17.210+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd91c48988 EEXIST 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:07:17.577 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-c con 0x563e8658bd40 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-a con 0x563e865b7580 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-b con 0x563e865add60 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): authenticate will time out at 2866.621933s 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): get_auth_request con 0x563e865b7580 auth_method 0 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.578 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): handle_auth_done global_id 8001 payload 274 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient: _finish_hunting 0 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:07:17.210+0000 7fad73367640 1 monclient: found mon.noname-a 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: dump: 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.579 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: _finish_auth 0 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: dump: 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.580 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 monclient: authenticate success, global_id 8001 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:07:17.210+0000 7fad760629c0 4 set_mon_vals no callback set 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: shutdown 2024-09-12T18:07:17.581 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: build_initial_monmap 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:07:17.210+0000 7fad760629c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: monmap: 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.582 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding auth protocol: cephx 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding auth protocol: cephx 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding auth protocol: cephx 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.583 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:07:17.210+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:07:17.210+0000 7fad760629c0 1 librados: starting msgr at 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:07:17.210+0000 7fad760629c0 1 librados: starting objecter 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command objecter_requests cmddesc objecter_requests hook 0x563e8658bb40 EEXIST 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:07:17.214+0000 7fad760629c0 1 librados: setting wanted keys 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:07:17.214+0000 7fad760629c0 1 librados: calling monclient init 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: init 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding auth protocol: cephx 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding auth protocol: cephx 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding auth protocol: cephx 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.584 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:07:17.214+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:07:17.214+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command rotate-key cmddesc rotate-key hook 0x563e8656a788 EEXIST 2024-09-12T18:07:17.585 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-a con 0x563e8658bd40 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-b con 0x563e865add60 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-c con 0x563e865b7580 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): authenticate will time out at 2866.624839s 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): get_auth_request con 0x563e8658bd40 auth_method 0 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.586 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): handle_auth_done global_id 8004 payload 824 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient: _finish_hunting 0 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:07:17.214+0000 7fad73b68640 1 monclient: found mon.noname-a 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: dump: 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.587 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: _finish_auth 0 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: _check_auth_tickets 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 monclient: authenticate success, global_id 8004 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:17.588 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: dump: 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.589 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:07:17.214+0000 7fac52ffd640 4 set_mon_vals no callback set 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:07:17.214+0000 7fad760629c0 1 librados: init done 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command cr dump hook 0x563e865b50e8 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:07:17.214+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:07:17.214+0000 7fac517fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:07:17.214+0000 7fac517fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:07:17.214+0000 7fac517fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:07:17.218+0000 7fad73367640 10 monclient: get_auth_request con 0x7fac3c070ae0 auth_method 0 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:07:17.218+0000 7fad74369640 10 monclient: get_auth_request con 0x563e865d5d90 auth_method 0 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 realm 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.590 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:07:17.218+0000 7fad760629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:07:17.218+0000 7fad73b68640 10 monclient: get_auth_request con 0x563e865da100 auth_method 0 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:07:17.222+0000 7fad73367640 10 monclient: get_auth_request con 0x563e865dd880 auth_method 0 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:07:17.222+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:07:17.222+0000 7fad760629c0 20 searching for the correct realm 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:07:17.222+0000 7fad74369640 10 monclient: get_auth_request con 0x7fad680cf040 auth_method 0 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:07:17.226+0000 7fad73b68640 10 monclient: get_auth_request con 0x7fad6401f060 auth_method 0 2024-09-12T18:07:17.591 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:07:17.226+0000 7fad73367640 10 monclient: get_auth_request con 0x7fad68133630 auth_method 0 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:07:17.230+0000 7fad74369640 0 -- 172.21.15.97:0/3058865210 >> [v2:172.21.15.154:6808/3304684764,v1:172.21.15.154:6809/3304684764] conn(0x7fad64008040 msgr2=0x7fad640683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:07:17.230+0000 7fad74369640 10 monclient: get_auth_request con 0x7fad64008040 auth_method 0 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:07:17.434+0000 7fad74369640 10 monclient: get_auth_request con 0x7fad64008040 auth_method 0 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:07:17.434+0000 7fad73b68640 10 monclient: get_auth_request con 0x7fad6c026410 auth_method 0 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:07:17.446+0000 7fad73367640 0 -- 172.21.15.97:0/3058865210 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x563e865dd880 msgr2=0x563e865dfc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:07:17.446+0000 7fac517fa640 1 client.8004.objecter ms_handle_reset 0x563e865dd880 session 0x563e865d9960 osd.4 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:07:17.446+0000 7fac517fa640 10 monclient: _renew_subs 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:07:17.446+0000 7fac517fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:07:17.446+0000 7fad73367640 10 monclient: get_auth_request con 0x7fac3c080580 auth_method 0 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:17.592 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 zone default found 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:07:17.450+0000 7fad760629c0 4 Realm: () 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:07:17.450+0000 7fad760629c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:07:17.450+0000 7fad760629c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:17.593 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:07:17.450+0000 7fad760629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 zonegroup default 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 started sync module instance, tier type = 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=0 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=1 2024-09-12T18:07:17.594 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=2 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=3 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=4 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=5 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=6 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:07:17.478+0000 7fad760629c0 20 add_watcher() i=7 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:07:17.478+0000 7fad760629c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding auth protocol: cephx 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding auth protocol: cephx 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding auth protocol: cephx 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.595 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:07:17.482+0000 7fac29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:07:17.482+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:07:17.482+0000 7fad760629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:07:17.482+0000 7fad760629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:17.596 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command cache list hook 0x563e865b4840 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command cache inspect hook 0x563e865b4840 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command cache erase hook 0x563e865b4840 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command cache zap hook 0x563e865b4840 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 note: GC not initialized 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:07:17.486+0000 7fac28fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command sync trace show hook 0x7fad6400f050 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command sync trace history hook 0x7fad6400f050 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command sync trace active hook 0x7fad6400f050 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command sync trace active_short hook 0x7fad6400f050 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 Filter name: none 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:07:17.486+0000 7faba27fc640 20 reqs_thread_entry: start 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:07:17.597 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 : miss 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 2024-09-12T18:07:17.598 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:07:17.498+0000 7fad760629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:07:17.498+0000 7fad760629c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:07:17.498+0000 7fad760629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:07:17.498+0000 7fad760629c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39, ofs0, ns] 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431653 cookie 94826542298720 notifier 8004 bl.length()=931 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_sources= new_sources= 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential sources added=[] removed=[] 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_dests= new_dests= 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential dests added=[] removed=[] 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.0 2024-09-12T18:07:17.599 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.0 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.1 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.1 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.2 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.2 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.3 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.3 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.4 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.4 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.5 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.5 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.6 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.6 2024-09-12T18:07:17.600 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.7 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.7 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.8 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.8 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.9 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.9 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.10 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.10 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.11 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.11 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.0 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2 2024-09-12T18:07:17.601 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.3 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.4 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.5 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.6 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.7 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:07:17.522+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.8 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:07:17.522+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.9 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:07:17.522+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.10 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:07:17.530+0000 7fad760629c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad760629c0 time 2024-09-12T18:07:17.533152+0000 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad7993c2eb] 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad7993c49f] 2024-09-12T18:07:17.602 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e840a90c1] 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563e840ba4f1] 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e840bbb44] 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad787a2d90] 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:07:17.530+0000 7fad760629c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fad760629c0 thread_name:radosgw-admin 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad787bb520] 2024-09-12T18:07:17.603 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad7993c345] 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad7993c49f] 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e840a90c1] 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563e840ba4f1] 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e840bbb44] 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad787a2d90] 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:17.604 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:07:17.605 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:07:17.606 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:07:17.607 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:07:17.608 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:07:17.609 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:07:17.610 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:07:17.611 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr: 7faba27fc640 / http_manager 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac28fe1640 / http_manager 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac29fe3640 / rgw_dt_lg_renew 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac517fa640 / ms_dispatch 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac527fc640 / io_context_pool 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac52ffd640 / io_context_pool 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac597fa640 / ms_dispatch 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac5bfff640 / ms_dispatch 2024-09-12T18:07:17.612 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac61e0b640 / io_context_pool 2024-09-12T18:07:17.613 INFO:tasks.workunit.client.0.smithi097.stderr: 7fad73367640 / msgr-worker-2 2024-09-12T18:07:17.613 INFO:tasks.workunit.client.0.smithi097.stderr: 7fad73b68640 / msgr-worker-1 2024-09-12T18:07:17.613 INFO:tasks.workunit.client.0.smithi097.stderr: 7fad74369640 / msgr-worker-0 2024-09-12T18:07:17.613 INFO:tasks.workunit.client.0.smithi097.stderr: 7fad74b6a640 / io_context_pool 2024-09-12T18:07:17.613 INFO:tasks.workunit.client.0.smithi097.stderr: 7fad760629c0 / radosgw-admin 2024-09-12T18:07:17.613 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:07:17.613 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:07:17.613 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.135252.log 2024-09-12T18:07:17.613 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:07:17.613 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:07:17.613 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: build_initial_monmap 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:07:17.194+0000 7fad760629c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: monmap: 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.614 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding auth protocol: cephx 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding auth protocol: cephx 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding auth protocol: cephx 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: crc 2024-09-12T18:07:17.615 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864f0200) adding con mode: secure 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:07:17.194+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:07:17.194+0000 7fad760629c0 1 librados: starting msgr at 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:07:17.194+0000 7fad760629c0 1 librados: starting objecter 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command objecter_requests hook 0x563e8651e250 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:07:17.194+0000 7fad760629c0 1 librados: setting wanted keys 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:07:17.194+0000 7fad760629c0 1 librados: calling monclient init 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: init 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding auth protocol: cephx 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding auth protocol: cephx 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding auth protocol: cephx 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.616 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: crc 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 AuthRegistry(0x563e864ed030) adding con mode: secure 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:07:17.194+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:07:17.194+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command rotate-key hook 0x563e864ed178 2024-09-12T18:07:17.617 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-c con 0x563e863786a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-a con 0x563e86433160 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-b con 0x563e86435de0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient(hunting): authenticate will time out at 2866.607068s 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): get_auth_request con 0x563e863786a0 auth_method 0 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.618 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): get_auth_request con 0x563e86433160 auth_method 0 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:07:17.194+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient(hunting): handle_auth_done global_id 7499 payload 824 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient: _finish_hunting 0 2024-09-12T18:07:17.619 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:07:17.194+0000 7fad73b68640 1 monclient: found mon.noname-c 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:07:17.194+0000 7fad73b68640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:07:17.194+0000 7fad74369640 10 monclient: get_auth_request con 0x563e86435de0 auth_method 0 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: dump: 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.620 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: _finish_auth 0 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: _check_auth_tickets 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:07:17.194+0000 7fac5bfff640 10 monclient: dump: 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.621 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:07:17.194+0000 7fad760629c0 5 monclient: authenticate success, global_id 7499 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:07:17.194+0000 7fac61e0b640 4 set_mon_vals no callback set 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:07:17.194+0000 7fad760629c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:07:17.198+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.622 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:07:17.198+0000 7fad760629c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:07:17.198+0000 7fad760629c0 1 librados: init done 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:07:17.198+0000 7fac5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:07:17.198+0000 7fac5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:07:17.198+0000 7fac5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:07:17.198+0000 7fad73367640 10 monclient: get_auth_request con 0x7fac5c070ae0 auth_method 0 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:07:17.198+0000 7fad74369640 10 monclient: get_auth_request con 0x563e86534be0 auth_method 0 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:07:17.202+0000 7fad73b68640 10 monclient: get_auth_request con 0x563e86537dc0 auth_method 0 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:07:17.202+0000 7fad73367640 10 monclient: get_auth_request con 0x563e8653bfb0 auth_method 0 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:07:17.202+0000 7fad760629c0 10 monclient: build_initial_monmap 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:07:17.202+0000 7fad760629c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:07:17.202+0000 7fad760629c0 10 monclient: monmap: 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:17.623 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding auth protocol: cephx 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding auth protocol: cephx 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding auth protocol: cephx 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.624 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: crc 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:07:17.202+0000 7fad760629c0 5 AuthRegistry(0x563e86540cc0) adding con mode: secure 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:07:17.206+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command objecter_requests cmddesc objecter_requests hook 0x563e86544670 EEXIST 2024-09-12T18:07:17.625 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: init 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding auth protocol: cephx 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding auth protocol: cephx 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding auth protocol: cephx 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.626 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: crc 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 AuthRegistry(0x563e8653f2e8) adding con mode: secure 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:07:17.206+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:07:17.206+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command rotate-key cmddesc rotate-key hook 0x563e8653f430 EEXIST 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-b con 0x563e86568820 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-a con 0x563e86568150 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-c con 0x563e86566b30 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.627 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient(hunting): authenticate will time out at 2866.616904s 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): get_auth_request con 0x563e86566b30 auth_method 0 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): get_auth_request con 0x563e86568150 auth_method 0 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.628 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:07:17.206+0000 7fad74369640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:07:17.206+0000 7fad73b68640 10 monclient(hunting): get_auth_request con 0x563e86568820 auth_method 0 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:07:17.206+0000 7fad73b68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:07:17.206+0000 7fad73b68640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:07:17.206+0000 7fad73b68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient(hunting): handle_auth_done global_id 7998 payload 824 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient: _finish_hunting 0 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:07:17.206+0000 7fad73367640 1 monclient: found mon.noname-a 2024-09-12T18:07:17.629 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:07:17.206+0000 7fad73367640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: dump: 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.630 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: _finish_auth 0 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: _check_auth_tickets 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:07:17.206+0000 7fac597fa640 10 monclient: dump: 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.631 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.632 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.632 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.632 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:07:17.206+0000 7fad760629c0 5 monclient: authenticate success, global_id 7998 2024-09-12T18:07:17.632 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:07:17.206+0000 7fad74b6a640 4 set_mon_vals no callback set 2024-09-12T18:07:17.632 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.632 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.632 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.632 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:07:17.206+0000 7fad760629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:07:17.210+0000 7fac597fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:07:17.210+0000 7fac597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:07:17.210+0000 7fac597fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: get_monmap_and_config 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: build_initial_monmap 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:07:17.210+0000 7fad760629c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: monmap: 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:17.633 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding auth protocol: cephx 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding auth protocol: cephx 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding auth protocol: cephx 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.634 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: crc 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e86587c40) adding con mode: secure 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:07:17.210+0000 7fad73b68640 10 monclient: get_auth_request con 0x7fac4c070a20 auth_method 0 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:07:17.210+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: init 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding auth protocol: cephx 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding auth protocol: cephx 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding auth protocol: cephx 2024-09-12T18:07:17.635 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: crc 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48840) adding con mode: secure 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:07:17.210+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.636 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:07:17.210+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd91c48988 EEXIST 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-c con 0x563e8658bd40 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-a con 0x563e865b7580 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-b con 0x563e865add60 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient(hunting): authenticate will time out at 2866.621933s 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): get_auth_request con 0x563e865b7580 auth_method 0 2024-09-12T18:07:17.637 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient(hunting): handle_auth_done global_id 8001 payload 274 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient: _finish_hunting 0 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:07:17.210+0000 7fad73367640 1 monclient: found mon.noname-a 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:07:17.210+0000 7fad73367640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: dump: 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.638 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: _finish_auth 0 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:17.639 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:07:17.210+0000 7fac52ffd640 10 monclient: dump: 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 monclient: authenticate success, global_id 8001 2024-09-12T18:07:17.640 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:07:17.210+0000 7fad760629c0 4 set_mon_vals no callback set 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: shutdown 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: build_initial_monmap 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:07:17.210+0000 7fad760629c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:07:17.210+0000 7fad760629c0 10 monclient: monmap: 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:17.641 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding auth protocol: cephx 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding auth protocol: cephx 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding auth protocol: cephx 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.642 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: crc 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 AuthRegistry(0x563e865ae2c0) adding con mode: secure 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:07:17.210+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:07:17.210+0000 7fad760629c0 1 librados: starting msgr at 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:07:17.210+0000 7fad760629c0 1 librados: starting objecter 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:07:17.210+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command objecter_requests cmddesc objecter_requests hook 0x563e8658bb40 EEXIST 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:07:17.214+0000 7fad760629c0 1 librados: setting wanted keys 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:07:17.214+0000 7fad760629c0 1 librados: calling monclient init 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: init 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding auth protocol: cephx 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding auth protocol: cephx 2024-09-12T18:07:17.643 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding auth protocol: cephx 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: crc 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 AuthRegistry(0x563e8656a640) adding con mode: secure 2024-09-12T18:07:17.644 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:07:17.214+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:07:17.214+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command rotate-key cmddesc rotate-key hook 0x563e8656a788 EEXIST 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-a con 0x563e8658bd40 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-b con 0x563e865add60 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): picked mon.noname-c con 0x563e865b7580 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient(hunting): authenticate will time out at 2866.624839s 2024-09-12T18:07:17.645 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): get_auth_request con 0x563e8658bd40 auth_method 0 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient(hunting): handle_auth_done global_id 8004 payload 824 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient: _finish_hunting 0 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:07:17.214+0000 7fad73b68640 1 monclient: found mon.noname-a 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:07:17.214+0000 7fad73b68640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: dump: 2024-09-12T18:07:17.646 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: _finish_auth 0 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: _check_auth_tickets 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 monclient: authenticate success, global_id 8004 2024-09-12T18:07:17.647 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:07:17.214+0000 7fac517fa640 10 monclient: dump: 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:17.648 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:07:17.214+0000 7fac52ffd640 4 set_mon_vals no callback set 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _renew_subs 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:07:17.214+0000 7fad760629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:07:17.214+0000 7fad760629c0 1 librados: init done 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:07:17.214+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command cr dump hook 0x563e865b50e8 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:07:17.214+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:07:17.214+0000 7fac517fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:07:17.214+0000 7fac517fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:07:17.214+0000 7fac517fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:07:17.218+0000 7fad73367640 10 monclient: get_auth_request con 0x7fac3c070ae0 auth_method 0 2024-09-12T18:07:17.649 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:07:17.218+0000 7fad74369640 10 monclient: get_auth_request con 0x563e865d5d90 auth_method 0 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 realm 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:07:17.218+0000 7fad760629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:07:17.218+0000 7fad73b68640 10 monclient: get_auth_request con 0x563e865da100 auth_method 0 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:07:17.218+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:07:17.222+0000 7fad73367640 10 monclient: get_auth_request con 0x563e865dd880 auth_method 0 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:07:17.222+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:07:17.222+0000 7fad760629c0 20 searching for the correct realm 2024-09-12T18:07:17.650 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:07:17.222+0000 7fad74369640 10 monclient: get_auth_request con 0x7fad680cf040 auth_method 0 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:07:17.226+0000 7fad73b68640 10 monclient: get_auth_request con 0x7fad6401f060 auth_method 0 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:07:17.226+0000 7fad73367640 10 monclient: get_auth_request con 0x7fad68133630 auth_method 0 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:07:17.230+0000 7fad74369640 0 -- 172.21.15.97:0/3058865210 >> [v2:172.21.15.154:6808/3304684764,v1:172.21.15.154:6809/3304684764] conn(0x7fad64008040 msgr2=0x7fad640683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:07:17.230+0000 7fad74369640 10 monclient: get_auth_request con 0x7fad64008040 auth_method 0 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:07:17.434+0000 7fad74369640 10 monclient: get_auth_request con 0x7fad64008040 auth_method 0 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:07:17.434+0000 7fad73b68640 10 monclient: get_auth_request con 0x7fad6c026410 auth_method 0 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:07:17.446+0000 7fad73367640 0 -- 172.21.15.97:0/3058865210 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x563e865dd880 msgr2=0x563e865dfc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:07:17.446+0000 7fac517fa640 1 client.8004.objecter ms_handle_reset 0x563e865dd880 session 0x563e865d9960 osd.4 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:07:17.446+0000 7fac517fa640 10 monclient: _renew_subs 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:07:17.446+0000 7fac517fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:07:17.446+0000 7fad73367640 10 monclient: get_auth_request con 0x7fac3c080580 auth_method 0 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:17.651 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 zone default found 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:07:17.450+0000 7fad760629c0 4 Realm: () 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:07:17.450+0000 7fad760629c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:17.652 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:07:17.450+0000 7fad760629c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:07:17.450+0000 7fad760629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 zonegroup default 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:07:17.450+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 started sync module instance, tier type = 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:07:17.454+0000 7fad760629c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=0 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=1 2024-09-12T18:07:17.653 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=2 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=3 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=4 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=5 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:07:17.474+0000 7fad760629c0 20 add_watcher() i=6 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:07:17.478+0000 7fad760629c0 20 add_watcher() i=7 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:07:17.478+0000 7fad760629c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding auth protocol: cephx 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding auth protocol: cephx 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding auth protocol: cephx 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.654 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: crc 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 AuthRegistry(0x7ffd91c48d10) adding con mode: secure 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:07:17.482+0000 7fac29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:07:17.482+0000 7fad760629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:07:17.482+0000 7fad760629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:17.655 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:07:17.482+0000 7fad760629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command cache list hook 0x563e865b4840 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:07:17.482+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command cache inspect hook 0x563e865b4840 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command cache erase hook 0x563e865b4840 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command cache zap hook 0x563e865b4840 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 note: GC not initialized 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:07:17.486+0000 7fac28fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command sync trace show hook 0x7fad6400f050 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command sync trace history hook 0x7fad6400f050 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command sync trace active hook 0x7fad6400f050 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:07:17.486+0000 7fad760629c0 5 asok(0x563e862e02b0) register_command sync trace active_short hook 0x7fad6400f050 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 Filter name: none 2024-09-12T18:07:17.656 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:07:17.486+0000 7faba27fc640 20 reqs_thread_entry: start 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 : miss 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:07:17.486+0000 7fad760629c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.657 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:07:17.486+0000 7fad760629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:07:17.498+0000 7fad760629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:07:17.498+0000 7fad760629c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:07:17.498+0000 7fad760629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:07:17.498+0000 7fad760629c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39, ofs0, ns] 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431653 cookie 94826542298720 notifier 8004 bl.length()=931 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:07:17.498+0000 7fac527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_sources= new_sources= 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential sources added=[] removed=[] 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_dests= new_dests= 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:07:17.502+0000 7fad760629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential dests added=[] removed=[] 2024-09-12T18:07:17.658 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.0 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.0 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.1 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.1 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.2 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.2 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.3 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.3 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.4 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.4 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.5 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.5 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.6 2024-09-12T18:07:17.659 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.6 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.7 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.7 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.8 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.8 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.9 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.9 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.10 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.10 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:07:17.514+0000 7fad760629c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.11 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1.11 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.0 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1 2024-09-12T18:07:17.660 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:07:17.514+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.3 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.4 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.5 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.6 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:07:17.518+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.7 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:07:17.522+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.8 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:07:17.522+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.9 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:07:17.522+0000 7fad760629c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.10 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:07:17.530+0000 7fad760629c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad760629c0 time 2024-09-12T18:07:17.533152+0000 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:17.661 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad7993c2eb] 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad7993c49f] 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e840a90c1] 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563e840ba4f1] 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e840bbb44] 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad787a2d90] 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:07:17.530+0000 7fad760629c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fad760629c0 thread_name:radosgw-admin 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.662 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad787bb520] 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad7993c345] 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad7993c49f] 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e840a90c1] 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563e840ba4f1] 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e840bbb44] 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad787a2d90] 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:07:17.663 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:07:17.664 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:07:17.665 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:07:17.666 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:07:17.667 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:07:17.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:07:17.669 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:07:17.670 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 7faba27fc640 / http_manager 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac28fe1640 / http_manager 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac29fe3640 / rgw_dt_lg_renew 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac517fa640 / ms_dispatch 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac527fc640 / io_context_pool 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac52ffd640 / io_context_pool 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac597fa640 / ms_dispatch 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac5bfff640 / ms_dispatch 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 7fac61e0b640 / io_context_pool 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 7fad73367640 / msgr-worker-2 2024-09-12T18:07:17.671 INFO:tasks.workunit.client.0.smithi097.stderr: 7fad73b68640 / msgr-worker-1 2024-09-12T18:07:17.672 INFO:tasks.workunit.client.0.smithi097.stderr: 7fad74369640 / msgr-worker-0 2024-09-12T18:07:17.672 INFO:tasks.workunit.client.0.smithi097.stderr: 7fad74b6a640 / io_context_pool 2024-09-12T18:07:17.672 INFO:tasks.workunit.client.0.smithi097.stderr: 7fad760629c0 / radosgw-admin 2024-09-12T18:07:17.672 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:07:17.672 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:07:17.672 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:07:17.535620Z_f2b6ba2f-76bb-4f17-9c29-7c2ef6ee8bce/log 2024-09-12T18:07:17.672 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:07:17.672 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:07:17.672 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:07:17.677 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:17.677 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:17.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.618+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.618+0000 7efc2cd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.618+0000 7efc2cd639c0 20 realm 2024-09-12T18:07:17.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.618+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.618+0000 7efc2cd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.618+0000 7efc2cd639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:17.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.618+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.622+0000 7efc2cd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.622+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.622+0000 7efc2cd639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.622+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.622+0000 7efc2cd639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.622+0000 7efc2cd639c0 20 searching for the correct realm 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.630+0000 7efc2a869640 0 -- 172.21.15.97:0/3734443857 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7efc24025040 msgr2=0x7efc2409d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.634+0000 7efc2a869640 0 -- 172.21.15.97:0/3734443857 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7efc1c0c5b90 msgr2=0x7efc1c0eb430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:17.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 zone default found 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 4 Realm: () 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 zonegroup default 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.642+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.646+0000 7efc2cd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.646+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.646+0000 7efc2cd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.646+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.646+0000 7efc2cd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.646+0000 7efc2cd639c0 20 started sync module instance, tier type = 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.646+0000 7efc2cd639c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.662+0000 7efc2cd639c0 20 add_watcher() i=0 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.662+0000 7efc2cd639c0 20 add_watcher() i=1 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.662+0000 7efc2cd639c0 20 add_watcher() i=2 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.662+0000 7efc2cd639c0 20 add_watcher() i=3 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.662+0000 7efc2cd639c0 20 add_watcher() i=4 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.662+0000 7efc2cd639c0 20 add_watcher() i=5 2024-09-12T18:07:17.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.662+0000 7efc2cd639c0 20 add_watcher() i=6 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.666+0000 7efc2cd639c0 20 add_watcher() i=7 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.666+0000 7efc2cd639c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.670+0000 7efae17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.670+0000 7efc2cd639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.670+0000 7efc2cd639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.670+0000 7efc2cd639c0 5 note: GC not initialized 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.670+0000 7efa5bfff640 20 reqs_thread_entry: start 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.670+0000 7efc2cd639c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.670+0000 7efc2cd639c0 20 Filter name: none 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.670+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.670+0000 7efa59ffb640 20 reqs_thread_entry: start 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.670+0000 7efc2cd639c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:17.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.670+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.674+0000 7efc2cd639c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:07:17.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.674+0000 7efc2cd639c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:17.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.674+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.674+0000 7efc2cd639c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:17.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.674+0000 7efc2cd639c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.674+0000 7efc2cd639c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:07:17.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.674+0000 7efc2cd639c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:17.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.678+0000 7efae17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:17.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.682+0000 7efc2cd639c0 20 remove_watcher() i=0 2024-09-12T18:07:17.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.682+0000 7efc2cd639c0 2 removed watcher, disabling cache 2024-09-12T18:07:17.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.682+0000 7efc2cd639c0 20 remove_watcher() i=1 2024-09-12T18:07:17.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.682+0000 7efc2cd639c0 20 remove_watcher() i=2 2024-09-12T18:07:17.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.686+0000 7efc2cd639c0 20 remove_watcher() i=3 2024-09-12T18:07:17.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.686+0000 7efc2cd639c0 20 remove_watcher() i=4 2024-09-12T18:07:17.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.690+0000 7efc2cd639c0 20 remove_watcher() i=5 2024-09-12T18:07:17.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.694+0000 7efc2cd639c0 20 remove_watcher() i=6 2024-09-12T18:07:17.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.694+0000 7efc2cd639c0 20 remove_watcher() i=7 2024-09-12T18:07:17.710 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.710 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:07:17.710 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-change-reshard-state id: 98539659-fdaf-41ce-847d-239ff89323af.4641.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:07:17.710 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:17.711 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:17.711 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:17.750 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:17.750 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:17.810 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:07:17.845 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:17.846 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:17.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.890+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.890+0000 7fb1736229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.890+0000 7fb1736229c0 20 realm 2024-09-12T18:07:17.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.890+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.890+0000 7fb1736229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.890+0000 7fb1736229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:17.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.890+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.894+0000 7fb1736229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.894+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.894+0000 7fb1736229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.894+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.894+0000 7fb1736229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:17.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.894+0000 7fb1736229c0 20 searching for the correct realm 2024-09-12T18:07:17.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.902+0000 7fb170927640 0 -- 172.21.15.97:0/3897040374 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55b8ca93ba30 msgr2=0x55b8ca93de50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.906+0000 7fb170927640 0 -- 172.21.15.97:0/3897040374 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x55b8ca943420 msgr2=0x55b8ca945810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:17.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:17.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:17.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:17.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:17.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:17.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:17.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:17.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:17.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 zone default found 2024-09-12T18:07:17.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 4 Realm: () 2024-09-12T18:07:17.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:17.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:17.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:17.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 zonegroup default 2024-09-12T18:07:17.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:17.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 started sync module instance, tier type = 2024-09-12T18:07:17.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.914+0000 7fb1736229c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:17.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.934+0000 7fb1736229c0 20 add_watcher() i=0 2024-09-12T18:07:17.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.934+0000 7fb1736229c0 20 add_watcher() i=1 2024-09-12T18:07:17.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.934+0000 7fb1736229c0 20 add_watcher() i=2 2024-09-12T18:07:17.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.934+0000 7fb1736229c0 20 add_watcher() i=3 2024-09-12T18:07:17.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.934+0000 7fb1736229c0 20 add_watcher() i=4 2024-09-12T18:07:17.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.934+0000 7fb1736229c0 20 add_watcher() i=5 2024-09-12T18:07:17.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.934+0000 7fb1736229c0 20 add_watcher() i=6 2024-09-12T18:07:17.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.934+0000 7fb1736229c0 20 add_watcher() i=7 2024-09-12T18:07:17.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.934+0000 7fb1736229c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:17.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.938+0000 7fb027fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:17.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.938+0000 7fb1736229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:17.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.938+0000 7fb1736229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:17.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.938+0000 7fb1736229c0 5 note: GC not initialized 2024-09-12T18:07:17.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.938+0000 7fb026fe5640 20 reqs_thread_entry: start 2024-09-12T18:07:17.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.938+0000 7fb1736229c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:17.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.938+0000 7fb1736229c0 20 Filter name: none 2024-09-12T18:07:17.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.938+0000 7fb024fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:17.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:07:17.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:17.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:07:17.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:07:17.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 : miss 2024-09-12T18:07:17.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:17.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:07:17.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:17.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:17.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:17.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:17.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 2024-09-12T18:07:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.942+0000 7fb1736229c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to be held by another RGW process; skipping for now 2024-09-12T18:07:17.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.946+0000 7fb027fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:17.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.950+0000 7fb1736229c0 20 remove_watcher() i=0 2024-09-12T18:07:17.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.950+0000 7fb1736229c0 2 removed watcher, disabling cache 2024-09-12T18:07:17.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.950+0000 7fb1736229c0 20 remove_watcher() i=1 2024-09-12T18:07:17.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.954+0000 7fb1736229c0 20 remove_watcher() i=2 2024-09-12T18:07:17.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.954+0000 7fb1736229c0 20 remove_watcher() i=3 2024-09-12T18:07:17.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.958+0000 7fb1736229c0 20 remove_watcher() i=4 2024-09-12T18:07:17.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.958+0000 7fb1736229c0 20 remove_watcher() i=5 2024-09-12T18:07:17.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.962+0000 7fb1736229c0 20 remove_watcher() i=6 2024-09-12T18:07:17.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:17.962+0000 7fb1736229c0 20 remove_watcher() i=7 2024-09-12T18:07:17.978 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:07:47.993 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:07:48.028 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:48.028 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:48.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.073+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.073+0000 7fe23fcbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.073+0000 7fe23fcbe9c0 20 realm 2024-09-12T18:07:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.073+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.073+0000 7fe23fcbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.073+0000 7fe23fcbe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.073+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.073+0000 7fe23fcbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.073+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.077+0000 7fe23fcbe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:48.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.077+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.077+0000 7fe23fcbe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:48.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.077+0000 7fe23fcbe9c0 20 searching for the correct realm 2024-09-12T18:07:48.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.085+0000 7fe23dfc5640 0 -- 172.21.15.97:0/952966812 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55eed856e480 msgr2=0x55eed85708f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:48.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.089+0000 7fe23d7c4640 0 -- 172.21.15.97:0/952966812 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55eed85726f0 msgr2=0x55eed8574b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:48.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:48.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:48.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:48.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:48.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:48.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:48.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:48.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 zone default found 2024-09-12T18:07:48.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 4 Realm: () 2024-09-12T18:07:48.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:48.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:48.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:48.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 zonegroup default 2024-09-12T18:07:48.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.097+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.101+0000 7fe23fcbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.101+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.101+0000 7fe23fcbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.101+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.101+0000 7fe23fcbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.101+0000 7fe23fcbe9c0 20 started sync module instance, tier type = 2024-09-12T18:07:48.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.101+0000 7fe23fcbe9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:48.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.121+0000 7fe23fcbe9c0 20 add_watcher() i=0 2024-09-12T18:07:48.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.121+0000 7fe23fcbe9c0 20 add_watcher() i=1 2024-09-12T18:07:48.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.121+0000 7fe23fcbe9c0 20 add_watcher() i=2 2024-09-12T18:07:48.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.121+0000 7fe23fcbe9c0 20 add_watcher() i=3 2024-09-12T18:07:48.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.121+0000 7fe23fcbe9c0 20 add_watcher() i=4 2024-09-12T18:07:48.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.121+0000 7fe23fcbe9c0 20 add_watcher() i=5 2024-09-12T18:07:48.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.121+0000 7fe23fcbe9c0 20 add_watcher() i=6 2024-09-12T18:07:48.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.121+0000 7fe23fcbe9c0 20 add_watcher() i=7 2024-09-12T18:07:48.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.121+0000 7fe23fcbe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:48.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.125+0000 7fe0f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:48.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.125+0000 7fe23fcbe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:48.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.125+0000 7fe23fcbe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:48.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.125+0000 7fe23fcbe9c0 5 note: GC not initialized 2024-09-12T18:07:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.125+0000 7fe0f2fe5640 20 reqs_thread_entry: start 2024-09-12T18:07:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.125+0000 7fe23fcbe9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.125+0000 7fe23fcbe9c0 20 Filter name: none 2024-09-12T18:07:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe0f0fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:48.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:07:48.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:48.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:07:48.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:07:48.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 : miss 2024-09-12T18:07:48.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:07:48.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:48.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:48.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:48.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:48.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.129+0000 7fe23fcbe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 2024-09-12T18:07:48.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.133+0000 7fe23fcbe9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:07:48.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.145+0000 7fe23fcbe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:48.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.145+0000 7fe23fcbe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:48.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.145+0000 7fe23fcbe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:48.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.145+0000 7fe23fcbe9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39, ofs0, ns] 2024-09-12T18:07:48.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.145+0000 7fe120ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431654 cookie 94484320204784 notifier 8055 bl.length()=931 2024-09-12T18:07:48.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.145+0000 7fe120ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:48.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.145+0000 7fe120ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:48.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.145+0000 7fe120ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:48.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.149+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_sources= new_sources= 2024-09-12T18:07:48.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.149+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential sources added=[] removed=[] 2024-09-12T18:07:48.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.149+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_dests= new_dests= 2024-09-12T18:07:48.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.149+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential dests added=[] removed=[] 2024-09-12T18:07:48.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.0 2024-09-12T18:07:48.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.0 2024-09-12T18:07:48.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.1 2024-09-12T18:07:48.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.1 2024-09-12T18:07:48.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.2 2024-09-12T18:07:48.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.2 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.3 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.3 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.4 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.4 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.5 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.5 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.6 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.6 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.7 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.7 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.8 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.8 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.9 2024-09-12T18:07:48.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.9 2024-09-12T18:07:48.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.10 2024-09-12T18:07:48.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.10 2024-09-12T18:07:48.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.11 2024-09-12T18:07:48.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2.11 2024-09-12T18:07:48.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.0 2024-09-12T18:07:48.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1 2024-09-12T18:07:48.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.165+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2 2024-09-12T18:07:48.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.169+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.3 2024-09-12T18:07:48.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.169+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.4 2024-09-12T18:07:48.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.169+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.5 2024-09-12T18:07:48.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.169+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.6 2024-09-12T18:07:48.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.169+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.7 2024-09-12T18:07:48.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.173+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.8 2024-09-12T18:07:48.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.173+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.9 2024-09-12T18:07:48.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.173+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.10 2024-09-12T18:07:48.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.177+0000 7fe23fcbe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 : hit (requested=0x17, cached=0x17) 2024-09-12T18:07:48.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.177+0000 7fe23fcbe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 2024-09-12T18:07:48.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.181+0000 7fe23fcbe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:48.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.181+0000 7fe23fcbe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:48.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.181+0000 7fe23fcbe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:48.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.181+0000 7fe23fcbe9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39, ofs0, ns] 2024-09-12T18:07:48.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.181+0000 7fe10ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431655 cookie 94484320204784 notifier 8055 bl.length()=931 2024-09-12T18:07:48.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.181+0000 7fe10ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:48.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.181+0000 7fe10ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:48.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.181+0000 7fe10ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:48.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.185+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_sources= new_sources= 2024-09-12T18:07:48.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.185+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential sources added=[] removed=[] 2024-09-12T18:07:48.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.185+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_dests= new_dests= 2024-09-12T18:07:48.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.185+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential dests added=[] removed=[] 2024-09-12T18:07:48.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.189+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.0 2024-09-12T18:07:48.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.189+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.1 2024-09-12T18:07:48.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.189+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.2 2024-09-12T18:07:48.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.189+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.3 2024-09-12T18:07:48.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.189+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.4 2024-09-12T18:07:48.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.193+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.5 2024-09-12T18:07:48.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.193+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.6 2024-09-12T18:07:48.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.193+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.7 2024-09-12T18:07:48.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.193+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.8 2024-09-12T18:07:48.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.193+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.9 2024-09-12T18:07:48.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.193+0000 7fe23fcbe9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.39.10 2024-09-12T18:07:48.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.193+0000 7fe23fcbe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 : hit (requested=0x17, cached=0x17) 2024-09-12T18:07:48.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.193+0000 7fe23fcbe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 2024-09-12T18:07:48.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.197+0000 7fe23fcbe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:48.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.197+0000 7fe23fcbe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:48.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.197+0000 7fe23fcbe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:48.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.197+0000 7fe23fcbe9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39, ofs0, ns] 2024-09-12T18:07:48.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.197+0000 7fe120ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431656 cookie 94484320204784 notifier 8055 bl.length()=899 2024-09-12T18:07:48.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.197+0000 7fe120ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 info.flags=0x17 2024-09-12T18:07:48.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.197+0000 7fe120ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:98539659-fdaf-41ce-847d-239ff89323af.4641.39 to cache LRU end 2024-09-12T18:07:48.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.197+0000 7fe120ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:07:48.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.201+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_sources= new_sources= 2024-09-12T18:07:48.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.201+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential sources added=[] removed=[] 2024-09-12T18:07:48.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.201+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): orig_dests= new_dests= 2024-09-12T18:07:48.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.201+0000 7fe23fcbe9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[98539659-fdaf-41ce-847d-239ff89323af.4641.39]): potential dests added=[] removed=[] 2024-09-12T18:07:48.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.205+0000 7fe23fcbe9c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T18:07:48.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.209+0000 7fe0f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:48.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.213+0000 7fe23fcbe9c0 20 remove_watcher() i=0 2024-09-12T18:07:48.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.213+0000 7fe23fcbe9c0 2 removed watcher, disabling cache 2024-09-12T18:07:48.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.213+0000 7fe23fcbe9c0 20 remove_watcher() i=1 2024-09-12T18:07:48.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.217+0000 7fe23fcbe9c0 20 remove_watcher() i=2 2024-09-12T18:07:48.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.217+0000 7fe23fcbe9c0 20 remove_watcher() i=3 2024-09-12T18:07:48.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.221+0000 7fe23fcbe9c0 20 remove_watcher() i=4 2024-09-12T18:07:48.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.225+0000 7fe23fcbe9c0 20 remove_watcher() i=5 2024-09-12T18:07:48.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.225+0000 7fe23fcbe9c0 20 remove_watcher() i=6 2024-09-12T18:07:48.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.229+0000 7fe23fcbe9c0 20 remove_watcher() i=7 2024-09-12T18:07:48.247 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:07:48.278 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:48.279 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:48.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.321+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.321+0000 7f003c4409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.321+0000 7f003c4409c0 20 realm 2024-09-12T18:07:48.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.321+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.325+0000 7f003c4409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.325+0000 7f003c4409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:48.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.325+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.325+0000 7f003c4409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.325+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.325+0000 7f003c4409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.325+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.325+0000 7f003c4409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:48.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.325+0000 7f003c4409c0 20 searching for the correct realm 2024-09-12T18:07:48.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.333+0000 7f0039745640 0 -- 172.21.15.97:0/2159682954 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f003010bae0 msgr2=0x7f003011c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:48.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.337+0000 7f0039f46640 0 -- 172.21.15.97:0/2159682954 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f0034047040 msgr2=0x7f0034047930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:48.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.557+0000 7f003c4409c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:48.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.557+0000 7f003c4409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:48.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.557+0000 7f003c4409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:48.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.557+0000 7f003c4409c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:48.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.557+0000 7f003c4409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:48.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.557+0000 7f003c4409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:48.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.557+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.557+0000 7f003c4409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.557+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.557+0000 7f003c4409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:48.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.557+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:48.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 20 zone default found 2024-09-12T18:07:48.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 4 Realm: () 2024-09-12T18:07:48.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:48.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:48.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:48.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 20 zonegroup default 2024-09-12T18:07:48.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:48.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 20 started sync module instance, tier type = 2024-09-12T18:07:48.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.561+0000 7f003c4409c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:48.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.585+0000 7f003c4409c0 20 add_watcher() i=0 2024-09-12T18:07:48.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.585+0000 7f003c4409c0 20 add_watcher() i=1 2024-09-12T18:07:48.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.585+0000 7f003c4409c0 20 add_watcher() i=2 2024-09-12T18:07:48.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.585+0000 7f003c4409c0 20 add_watcher() i=3 2024-09-12T18:07:48.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.585+0000 7f003c4409c0 20 add_watcher() i=4 2024-09-12T18:07:48.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.585+0000 7f003c4409c0 20 add_watcher() i=5 2024-09-12T18:07:48.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.585+0000 7f003c4409c0 20 add_watcher() i=6 2024-09-12T18:07:48.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.589+0000 7f003c4409c0 20 add_watcher() i=7 2024-09-12T18:07:48.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.589+0000 7f003c4409c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:48.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.593+0000 7efeeb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:48.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.593+0000 7f003c4409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:48.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.593+0000 7f003c4409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:48.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.593+0000 7f003c4409c0 5 note: GC not initialized 2024-09-12T18:07:48.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.593+0000 7efeea7fc640 20 reqs_thread_entry: start 2024-09-12T18:07:48.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.593+0000 7f003c4409c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:48.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.593+0000 7f003c4409c0 20 Filter name: none 2024-09-12T18:07:48.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.593+0000 7efe5bfff640 20 reqs_thread_entry: start 2024-09-12T18:07:48.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.593+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.597+0000 7f003c4409c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:48.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.597+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.597+0000 7f003c4409c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:48.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.597+0000 7f003c4409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:48.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.597+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.597+0000 7f003c4409c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:07:48.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.597+0000 7f003c4409c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:48.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.597+0000 7f003c4409c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:07:48.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.597+0000 7f003c4409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:48.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.601+0000 7efeeb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:48.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.605+0000 7f003c4409c0 20 remove_watcher() i=0 2024-09-12T18:07:48.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.605+0000 7f003c4409c0 2 removed watcher, disabling cache 2024-09-12T18:07:48.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.609+0000 7f003c4409c0 20 remove_watcher() i=1 2024-09-12T18:07:48.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.609+0000 7f003c4409c0 20 remove_watcher() i=2 2024-09-12T18:07:48.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.613+0000 7f003c4409c0 20 remove_watcher() i=3 2024-09-12T18:07:48.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.617+0000 7f003c4409c0 20 remove_watcher() i=4 2024-09-12T18:07:48.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.617+0000 7f003c4409c0 20 remove_watcher() i=5 2024-09-12T18:07:48.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.621+0000 7f003c4409c0 20 remove_watcher() i=6 2024-09-12T18:07:48.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:48.625+0000 7f003c4409c0 20 remove_watcher() i=7 2024-09-12T18:07:48.640 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:48.640 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:07:48.641 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-change-reshard-state id: 98539659-fdaf-41ce-847d-239ff89323af.4641.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:07:48.641 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:48.643 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:48.643 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:48.678 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:48.678 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:49.277 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:49.277 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:49.655 INFO:tasks.workunit.client.0.smithi097.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T18:07:49.655 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:07:49.687 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:49.687 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:49.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.733+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.733+0000 7ffaff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.733+0000 7ffaff1ad9c0 20 realm 2024-09-12T18:07:49.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.733+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.733+0000 7ffaff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.733+0000 7ffaff1ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:49.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.733+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.733+0000 7ffaff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.733+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.737+0000 7ffaff1ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:49.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.737+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.737+0000 7ffaff1ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:49.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.737+0000 7ffaff1ad9c0 20 searching for the correct realm 2024-09-12T18:07:49.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.741+0000 7ffafc4b2640 0 -- 172.21.15.97:0/2886665624 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7ffaf000e3c0 msgr2=0x7ffaf000e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:07:49.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.749+0000 7ffafd4b4640 0 -- 172.21.15.97:0/2886665624 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x56205c1e23a0 msgr2=0x56205c1e47f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:49.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:49.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:49.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:49.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:49.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:49.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:49.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:49.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:49.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 zone default found 2024-09-12T18:07:49.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 4 Realm: () 2024-09-12T18:07:49.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:49.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:49.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:49.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 zonegroup default 2024-09-12T18:07:49.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.757+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.761+0000 7ffaff1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.761+0000 7ffaff1ad9c0 20 started sync module instance, tier type = 2024-09-12T18:07:49.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.761+0000 7ffaff1ad9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.777+0000 7ffaff1ad9c0 20 add_watcher() i=0 2024-09-12T18:07:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.777+0000 7ffaff1ad9c0 20 add_watcher() i=1 2024-09-12T18:07:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.777+0000 7ffaff1ad9c0 20 add_watcher() i=2 2024-09-12T18:07:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.777+0000 7ffaff1ad9c0 20 add_watcher() i=3 2024-09-12T18:07:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.777+0000 7ffaff1ad9c0 20 add_watcher() i=4 2024-09-12T18:07:49.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.777+0000 7ffaff1ad9c0 20 add_watcher() i=5 2024-09-12T18:07:49.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.777+0000 7ffaff1ad9c0 20 add_watcher() i=6 2024-09-12T18:07:49.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.781+0000 7ffaff1ad9c0 20 add_watcher() i=7 2024-09-12T18:07:49.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.781+0000 7ffaff1ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:49.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ff9b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:49.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:49.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:49.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 5 note: GC not initialized 2024-09-12T18:07:49.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ff9b27e4640 20 reqs_thread_entry: start 2024-09-12T18:07:49.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:49.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 Filter name: none 2024-09-12T18:07:49.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ff9ab7fe640 20 reqs_thread_entry: start 2024-09-12T18:07:49.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:49.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:49.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:49.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:49.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.785+0000 7ffaff1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.789+0000 7ffaff1ad9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:49.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.789+0000 7ffaff1ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:49.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.789+0000 7ff9b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:49.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.793+0000 7ffaff1ad9c0 20 remove_watcher() i=0 2024-09-12T18:07:49.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.793+0000 7ffaff1ad9c0 2 removed watcher, disabling cache 2024-09-12T18:07:49.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.797+0000 7ffaff1ad9c0 20 remove_watcher() i=1 2024-09-12T18:07:49.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.797+0000 7ffaff1ad9c0 20 remove_watcher() i=2 2024-09-12T18:07:49.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.801+0000 7ffaff1ad9c0 20 remove_watcher() i=3 2024-09-12T18:07:49.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.805+0000 7ffaff1ad9c0 20 remove_watcher() i=4 2024-09-12T18:07:49.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.805+0000 7ffaff1ad9c0 20 remove_watcher() i=5 2024-09-12T18:07:49.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.809+0000 7ffaff1ad9c0 20 remove_watcher() i=6 2024-09-12T18:07:49.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.809+0000 7ffaff1ad9c0 20 remove_watcher() i=7 2024-09-12T18:07:49.826 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:49.826 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:07:49.826 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 98539659-fdaf-41ce-847d-239ff89323af.4641.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T18:07:49.826 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:49.827 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:07:49.853 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:49.853 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:49.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.897+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.901+0000 7ff81ffe59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.901+0000 7ff81ffe59c0 20 realm 2024-09-12T18:07:49.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.901+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.901+0000 7ff81ffe59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.901+0000 7ff81ffe59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:49.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.901+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.901+0000 7ff81ffe59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.901+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.905+0000 7ff81ffe59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:49.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.905+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.905+0000 7ff81ffe59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:49.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.905+0000 7ff81ffe59c0 20 searching for the correct realm 2024-09-12T18:07:49.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.913+0000 7ff81daeb640 0 -- 172.21.15.97:0/1253345126 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7ff81009bc20 msgr2=0x7ff81009a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.921+0000 7ff81daeb640 0 -- 172.21.15.97:0/1253345126 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x556499534620 msgr2=0x556499536a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:49.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.925+0000 7ff81ffe59c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:49.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.925+0000 7ff81ffe59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:49.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.925+0000 7ff81ffe59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:49.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.925+0000 7ff81ffe59c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:49.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.925+0000 7ff81ffe59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:49.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.925+0000 7ff81ffe59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:49.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.925+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.925+0000 7ff81ffe59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.925+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:49.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 zone default found 2024-09-12T18:07:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 4 Realm: () 2024-09-12T18:07:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 zonegroup default 2024-09-12T18:07:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:49.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 started sync module instance, tier type = 2024-09-12T18:07:49.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.929+0000 7ff81ffe59c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:49.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.957+0000 7ff81ffe59c0 20 add_watcher() i=0 2024-09-12T18:07:49.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.957+0000 7ff81ffe59c0 20 add_watcher() i=1 2024-09-12T18:07:49.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.957+0000 7ff81ffe59c0 20 add_watcher() i=2 2024-09-12T18:07:49.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.957+0000 7ff81ffe59c0 20 add_watcher() i=3 2024-09-12T18:07:49.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.957+0000 7ff81ffe59c0 20 add_watcher() i=4 2024-09-12T18:07:49.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.957+0000 7ff81ffe59c0 20 add_watcher() i=5 2024-09-12T18:07:49.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.961+0000 7ff81ffe59c0 20 add_watcher() i=6 2024-09-12T18:07:49.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.961+0000 7ff81ffe59c0 20 add_watcher() i=7 2024-09-12T18:07:49.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.961+0000 7ff81ffe59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:49.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff6cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:49.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:49.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:49.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 5 note: GC not initialized 2024-09-12T18:07:49.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff6ce7fc640 20 reqs_thread_entry: start 2024-09-12T18:07:49.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:49.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 Filter name: none 2024-09-12T18:07:49.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff63ffff640 20 reqs_thread_entry: start 2024-09-12T18:07:49.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:49.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:49.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:49.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:49.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:49.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:49.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.965+0000 7ff81ffe59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:49.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.969+0000 7ff6cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:49.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.973+0000 7ff81ffe59c0 20 remove_watcher() i=0 2024-09-12T18:07:49.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.973+0000 7ff81ffe59c0 2 removed watcher, disabling cache 2024-09-12T18:07:49.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.973+0000 7ff81ffe59c0 20 remove_watcher() i=1 2024-09-12T18:07:49.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.977+0000 7ff81ffe59c0 20 remove_watcher() i=2 2024-09-12T18:07:49.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.977+0000 7ff81ffe59c0 20 remove_watcher() i=3 2024-09-12T18:07:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.981+0000 7ff81ffe59c0 20 remove_watcher() i=4 2024-09-12T18:07:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.981+0000 7ff81ffe59c0 20 remove_watcher() i=5 2024-09-12T18:07:49.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.985+0000 7ff81ffe59c0 20 remove_watcher() i=6 2024-09-12T18:07:49.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:49.989+0000 7ff81ffe59c0 20 remove_watcher() i=7 2024-09-12T18:07:50.006 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T18:07:50.039 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:50.039 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:50.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 realm 2024-09-12T18:07:50.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.085+0000 7f7c1c2299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:50.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:50.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.089+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:50.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.089+0000 7f7c1c2299c0 20 searching for the correct realm 2024-09-12T18:07:50.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.093+0000 7f7c1952e640 0 -- 172.21.15.97:0/1418282135 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f7c0401a040 msgr2=0x7f7c0403d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:50.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.305+0000 7f7c1952e640 0 -- 172.21.15.97:0/1418282135 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5648a37a2270 msgr2=0x5648a37a4710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:50.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:50.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:50.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:50.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:50.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:50.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:50.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:50.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:50.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 zone default found 2024-09-12T18:07:50.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 4 Realm: () 2024-09-12T18:07:50.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:50.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:50.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:50.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 zonegroup default 2024-09-12T18:07:50.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 started sync module instance, tier type = 2024-09-12T18:07:50.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:50.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=0 2024-09-12T18:07:50.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=1 2024-09-12T18:07:50.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=2 2024-09-12T18:07:50.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=3 2024-09-12T18:07:50.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=4 2024-09-12T18:07:50.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=5 2024-09-12T18:07:50.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=6 2024-09-12T18:07:50.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=7 2024-09-12T18:07:50.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.349+0000 7f7c1c2299c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:50.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7acb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:50.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:50.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:50.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 note: GC not initialized 2024-09-12T18:07:50.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7aca7fc640 20 reqs_thread_entry: start 2024-09-12T18:07:50.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:50.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 Filter name: none 2024-09-12T18:07:50.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7a3bfff640 20 reqs_thread_entry: start 2024-09-12T18:07:50.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:50.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:50.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:50.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:50.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:07:50.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.361+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:50.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:07:50.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:07:50.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:50.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:50.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:07:50.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:07:50.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:07:50.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:50.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:07:50.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94869980326736 notifier 8130 bl.length()=827 2024-09-12T18:07:50.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:07:50.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:07:50.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:50.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:07:50.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:07:50.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:07:50.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:07:50.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.0 2024-09-12T18:07:50.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.0 2024-09-12T18:07:50.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.1 2024-09-12T18:07:50.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.1 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.2 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.2 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.3 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.3 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.4 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.4 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.5 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.5 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.6 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.6 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.7 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.7 2024-09-12T18:07:50.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.8 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.8 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.9 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.9 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.10 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.10 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.11 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.11 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.12 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.12 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.13 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.13 2024-09-12T18:07:50.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:07:50.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:07:50.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:07:50.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:07:50.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:07:50.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:07:50.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:07:50.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:07:50.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:07:50.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:07:50.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:07:50.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:07:50.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:07:50.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:07:50.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:07:50.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:07:50.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:07:50.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:07:50.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.397+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:07:50.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.397+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:07:50.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.397+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:07:50.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.397+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:07:50.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.401+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:07:50.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.401+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:07:50.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.401+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:07:50.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.401+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:07:50.406 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7c1c2299c0 time 2024-09-12T18:07:50.409325+0000 2024-09-12T18:07:50.406 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:50.407 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7c1fb032eb] 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1fb0349f] 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5648a0f9b0c1] 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5648a0fac4f1] 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5648a0fadb44] 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1e969d90] 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.405+0000 7f7c1c2299c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7c1c2299c0 time 2024-09-12T18:07:50.409325+0000 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:50.408 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7c1fb032eb] 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1fb0349f] 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5648a0f9b0c1] 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5648a0fac4f1] 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5648a0fadb44] 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1e969d90] 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:07:50.409 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7c1c2299c0 thread_name:radosgw-admin 2024-09-12T18:07:50.426 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:50.426 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7c1e982520] 2024-09-12T18:07:50.426 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:07:50.426 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:07:50.426 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7c1fb03345] 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1fb0349f] 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5648a0f9b0c1] 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5648a0fac4f1] 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5648a0fadb44] 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1e969d90] 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.405+0000 7f7c1c2299c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7c1c2299c0 thread_name:radosgw-admin 2024-09-12T18:07:50.427 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7c1e982520] 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7c1fb03345] 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1fb0349f] 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5648a0f9b0c1] 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5648a0fac4f1] 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5648a0fadb44] 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:07:50.428 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1e969d90] 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: crc 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: crc 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: secure 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: crc 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: secure 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: crc 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: secure 2024-09-12T18:07:50.429 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command rotate-key hook 0x5648a36b8eb8 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-b con 0x5648a35446a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-a con 0x5648a35ff160 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-c con 0x5648a3601fb0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): authenticate will time out at 2899.473307s 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): get_auth_request con 0x5648a35ff160 auth_method 0 2024-09-12T18:07:50.430 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): get_auth_request con 0x5648a3601fb0 auth_method 0 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.431 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): handle_auth_done global_id 7607 payload 824 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient: _finish_hunting 0 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:07:50.061+0000 7f7c1a530640 1 monclient: found mon.noname-c 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: dump: 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.432 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: _finish_auth 0 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: _check_auth_tickets 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: dump: 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.433 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:07:50.061+0000 7f7b07e07640 4 set_mon_vals no callback set 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 monclient: authenticate success, global_id 7607 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 1 librados: init done 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:07:50.065+0000 7f7b06604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:07:50.065+0000 7f7b06604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.434 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:07:50.065+0000 7f7b06604640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:07:50.065+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x7f7b00070ae0 auth_method 0 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:07:50.065+0000 7f7c1952e640 10 monclient: get_auth_request con 0x5648a3700bc0 auth_method 0 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:07:50.065+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x5648a3703da0 auth_method 0 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:07:50.065+0000 7f7c1952e640 10 monclient: get_auth_request con 0x5648a3707f90 auth_method 0 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient: build_initial_monmap 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient: monmap: 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:50.435 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding auth protocol: cephx 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding auth protocol: cephx 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding auth protocol: cephx 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.436 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5648a3710400 EEXIST 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient: init 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding auth protocol: cephx 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding auth protocol: cephx 2024-09-12T18:07:50.437 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding auth protocol: cephx 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.438 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command rotate-key cmddesc rotate-key hook 0x5648a370b300 EEXIST 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-c con 0x5648a37345b0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-b con 0x5648a3733ee0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-a con 0x5648a37328c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient(hunting): authenticate will time out at 2899.484023s 2024-09-12T18:07:50.439 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request con 0x5648a37345b0 auth_method 0 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): get_auth_request con 0x5648a37328c0 auth_method 0 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.440 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_done global_id 7610 payload 824 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient: _finish_hunting 0 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 1 monclient: found mon.noname-c 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: dump: 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.441 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: _finish_auth 0 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: dump: 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.442 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.443 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.443 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.443 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.443 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.443 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.443 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.443 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.443 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:07:50.073+0000 7f7c1ad31640 4 set_mon_vals no callback set 2024-09-12T18:07:50.443 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 monclient: authenticate success, global_id 7610 2024-09-12T18:07:50.443 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:07:50.073+0000 7f7c1952e640 10 monclient: get_auth_request con 0x7f7af4070a20 auth_method 0 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: get_monmap_and_config 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: build_initial_monmap 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: monmap: 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:50.444 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding auth protocol: cephx 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding auth protocol: cephx 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding auth protocol: cephx 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.445 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: init 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding auth protocol: cephx 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding auth protocol: cephx 2024-09-12T18:07:50.446 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding auth protocol: cephx 2024-09-12T18:07:50.447 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.447 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.447 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.447 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.447 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.447 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.447 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.447 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.447 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdd01082e8 EEXIST 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-c con 0x5648a37884b0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-b con 0x5648a3783860 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-a con 0x5648a3779fc0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.448 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): authenticate will time out at 2899.488598s 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request con 0x5648a37884b0 auth_method 0 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): get_auth_request con 0x5648a3779fc0 auth_method 0 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.449 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_done global_id 7613 payload 274 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient: _finish_hunting 0 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 1 monclient: found mon.noname-c 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: dump: 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: _finish_auth 0 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:50.451 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: dump: 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 monclient: authenticate success, global_id 7613 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 4 set_mon_vals no callback set 2024-09-12T18:07:50.452 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: shutdown 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: build_initial_monmap 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: monmap: 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:50.453 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding auth protocol: cephx 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding auth protocol: cephx 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding auth protocol: cephx 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.454 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 librados: starting msgr at 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 librados: starting objecter 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5648a375a430 EEXIST 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 librados: setting wanted keys 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 librados: calling monclient init 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: init 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding auth protocol: cephx 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding auth protocol: cephx 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding auth protocol: cephx 2024-09-12T18:07:50.455 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.456 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command rotate-key cmddesc rotate-key hook 0x5648a3736518 EEXIST 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-b con 0x5648a3779fc0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-c con 0x5648a3783860 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-a con 0x5648a37884b0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): authenticate will time out at 2899.491096s 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): get_auth_request con 0x5648a3783860 auth_method 0 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.457 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): get_auth_request con 0x5648a37884b0 auth_method 0 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request con 0x5648a3779fc0 auth_method 0 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.458 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_done global_id 8130 payload 824 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient: _finish_hunting 0 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:07:50.077+0000 7f7c1a530640 1 monclient: found mon.noname-a 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: dump: 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.459 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: _finish_auth 0 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: dump: 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.460 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 monclient: authenticate success, global_id 8130 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 4 set_mon_vals no callback set 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:50.461 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 librados: init done 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:07:50.081+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command cr dump hook 0x5648a377c078 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:07:50.081+0000 7f7aeb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:07:50.081+0000 7f7aeb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:07:50.081+0000 7f7aeb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:07:50.081+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x7f7ae4070ae0 auth_method 0 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:07:50.081+0000 7f7c1952e640 10 monclient: get_auth_request con 0x5648a37a2270 auth_method 0 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 realm 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.462 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:07:50.085+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x5648a37a64c0 auth_method 0 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:07:50.085+0000 7f7c1952e640 10 monclient: get_auth_request con 0x5648a37a9d20 auth_method 0 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:07:50.085+0000 7f7aeb7fe640 1 client.8130.objecter ms_handle_reset 0x5648a37a9d20 session 0x5648a37a5850 osd.4 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:07:50.085+0000 7f7aeb7fe640 10 monclient: _renew_subs 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:07:50.085+0000 7f7aeb7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:07:50.085+0000 7f7c1952e640 10 monclient: get_auth_request con 0x7f7ae4080600 auth_method 0 2024-09-12T18:07:50.463 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:07:50.089+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:07:50.089+0000 7f7c1c2299c0 20 searching for the correct realm 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:07:50.089+0000 7f7c1a530640 10 monclient: get_auth_request con 0x7f7c0403d040 auth_method 0 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:07:50.089+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x7f7c0c115040 auth_method 0 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:07:50.093+0000 7f7c1952e640 0 -- 172.21.15.97:0/1418282135 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f7c0401a040 msgr2=0x7f7c0403d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:07:50.297+0000 7f7c1952e640 10 monclient: get_auth_request con 0x7f7c0401a040 auth_method 0 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:07:50.301+0000 7f7c1a530640 10 monclient: get_auth_request con 0x7f7c0c0b8040 auth_method 0 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:07:50.305+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x7f7c1407bd60 auth_method 0 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:07:50.305+0000 7f7c1952e640 0 -- 172.21.15.97:0/1418282135 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5648a37a2270 msgr2=0x5648a37a4710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:07:50.305+0000 7f7aeb7fe640 1 client.8130.objecter ms_handle_reset 0x5648a37a2270 session 0x5648a37a1ba0 osd.6 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:07:50.309+0000 7f7c1952e640 10 monclient: get_auth_request con 0x5648a37a9d20 auth_method 0 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:50.464 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 zone default found 2024-09-12T18:07:50.465 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 4 Realm: () 2024-09-12T18:07:50.466 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:50.466 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:50.466 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:50.466 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 zonegroup default 2024-09-12T18:07:50.466 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.466 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.466 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.466 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.466 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.466 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.466 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 started sync module instance, tier type = 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=0 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=1 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=2 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=3 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=4 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=5 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=6 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=7 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding auth protocol: cephx 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding auth protocol: cephx 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding auth protocol: cephx 2024-09-12T18:07:50.467 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:07:50.357+0000 7f7acb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:50.468 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command cache list hook 0x5648a377e130 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command cache inspect hook 0x5648a377e130 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command cache erase hook 0x5648a377e130 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command cache zap hook 0x5648a377e130 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 note: GC not initialized 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:07:50.357+0000 7f7aca7fc640 20 reqs_thread_entry: start 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command sync trace show hook 0x7f7c04002f20 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command sync trace history hook 0x7f7c04002f20 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command sync trace active hook 0x7f7c04002f20 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command sync trace active_short hook 0x7f7c04002f20 2024-09-12T18:07:50.469 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 Filter name: none 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:07:50.357+0000 7f7a3bfff640 20 reqs_thread_entry: start 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:50.470 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94869980326736 notifier 8130 bl.length()=827 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:07:50.471 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.0 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.0 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.1 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.1 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.2 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.2 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.3 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.3 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.4 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.4 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.5 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.5 2024-09-12T18:07:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.6 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.6 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.7 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.7 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.8 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.8 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.9 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.9 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.10 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.10 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.11 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.11 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.12 2024-09-12T18:07:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.12 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.13 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.13 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:07:50.474 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:07:50.397+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:07:50.397+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:07:50.397+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:07:50.397+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:07:50.401+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:07:50.475 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:07:50.401+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:07:50.401+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:07:50.401+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:07:50.405+0000 7f7c1c2299c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7c1c2299c0 time 2024-09-12T18:07:50.409325+0000 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7c1fb032eb] 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1fb0349f] 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5648a0f9b0c1] 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5648a0fac4f1] 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5648a0fadb44] 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:07:50.476 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1e969d90] 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:07:50.405+0000 7f7c1c2299c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7c1c2299c0 thread_name:radosgw-admin 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7c1e982520] 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7c1fb03345] 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1fb0349f] 2024-09-12T18:07:50.477 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5648a0f9b0c1] 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5648a0fac4f1] 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5648a0fadb44] 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1e969d90] 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:07:50.478 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:07:50.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:07:50.480 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:07:50.481 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:07:50.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:07:50.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:07:50.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7a3bfff640 / http_manager 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7aca7fc640 / http_manager 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7acb7fe640 / rgw_dt_lg_renew 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7aeb7fe640 / ms_dispatch 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7afcff9640 / io_context_pool 2024-09-12T18:07:50.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7afd7fa640 / io_context_pool 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7aff7fe640 / ms_dispatch 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7b06604640 / ms_dispatch 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7b07e07640 / io_context_pool 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c1952e640 / msgr-worker-2 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c19d2f640 / msgr-worker-1 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c1a530640 / msgr-worker-0 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c1ad31640 / io_context_pool 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c1c2299c0 / radosgw-admin 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.139382.log 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:07:50.486 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: crc 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: crc 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: secure 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: crc 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: secure 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: crc 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a36b8d70) adding con mode: secure 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command rotate-key hook 0x5648a36b8eb8 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-b con 0x5648a35446a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-a con 0x5648a35ff160 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:50.487 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-c con 0x5648a3601fb0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient(hunting): authenticate will time out at 2899.473307s 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): get_auth_request con 0x5648a35ff160 auth_method 0 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): get_auth_request con 0x5648a3601fb0 auth_method 0 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.488 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:07:50.061+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient(hunting): handle_auth_done global_id 7607 payload 824 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient: _finish_hunting 0 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:07:50.061+0000 7f7c1a530640 1 monclient: found mon.noname-c 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:07:50.061+0000 7f7c1a530640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:50.489 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: dump: 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: _finish_auth 0 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: _check_auth_tickets 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.490 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:07:50.061+0000 7f7b06604640 10 monclient: dump: 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.491 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:07:50.061+0000 7f7b07e07640 4 set_mon_vals no callback set 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 5 monclient: authenticate success, global_id 7607 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:07:50.061+0000 7f7c1c2299c0 1 librados: init done 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:07:50.065+0000 7f7b06604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:07:50.065+0000 7f7b06604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:07:50.065+0000 7f7b06604640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:07:50.065+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x7f7b00070ae0 auth_method 0 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:07:50.065+0000 7f7c1952e640 10 monclient: get_auth_request con 0x5648a3700bc0 auth_method 0 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:07:50.065+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x5648a3703da0 auth_method 0 2024-09-12T18:07:50.492 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:07:50.065+0000 7f7c1952e640 10 monclient: get_auth_request con 0x5648a3707f90 auth_method 0 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient: build_initial_monmap 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient: monmap: 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:50.493 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding auth protocol: cephx 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding auth protocol: cephx 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding auth protocol: cephx 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: crc 2024-09-12T18:07:50.494 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370ca90) adding con mode: secure 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5648a3710400 EEXIST 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient: init 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding auth protocol: cephx 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding auth protocol: cephx 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding auth protocol: cephx 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.495 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: crc 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a370b1b8) adding con mode: secure 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command rotate-key cmddesc rotate-key hook 0x5648a370b300 EEXIST 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-c con 0x5648a37345b0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:50.496 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-b con 0x5648a3733ee0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:07:50.069+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-a con 0x5648a37328c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient(hunting): authenticate will time out at 2899.484023s 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request con 0x5648a37345b0 auth_method 0 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): get_auth_request con 0x5648a37328c0 auth_method 0 2024-09-12T18:07:50.497 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:07:50.073+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_done global_id 7610 payload 824 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient: _finish_hunting 0 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 1 monclient: found mon.noname-c 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:07:50.073+0000 7f7c19d2f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.498 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: dump: 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.499 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: _finish_auth 0 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 10 monclient: dump: 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.500 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:07:50.073+0000 7f7c1ad31640 4 set_mon_vals no callback set 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 monclient: authenticate success, global_id 7610 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.501 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:07:50.073+0000 7f7aff7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:07:50.073+0000 7f7c1952e640 10 monclient: get_auth_request con 0x7f7af4070a20 auth_method 0 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: get_monmap_and_config 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: build_initial_monmap 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 10 monclient: monmap: 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:50.502 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding auth protocol: cephx 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding auth protocol: cephx 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding auth protocol: cephx 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.503 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: crc 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a3753f60) adding con mode: secure 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:07:50.073+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: init 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding auth protocol: cephx 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding auth protocol: cephx 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding auth protocol: cephx 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.504 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: crc 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd01081a0) adding con mode: secure 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdd01082e8 EEXIST 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:50.505 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-c con 0x5648a37884b0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-b con 0x5648a3783860 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-a con 0x5648a3779fc0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): authenticate will time out at 2899.488598s 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request con 0x5648a37884b0 auth_method 0 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): get_auth_request con 0x5648a3779fc0 auth_method 0 2024-09-12T18:07:50.506 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): handle_auth_done global_id 7613 payload 274 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient: _finish_hunting 0 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 1 monclient: found mon.noname-c 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:07:50.507 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: dump: 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.508 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: _finish_auth 0 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 10 monclient: dump: 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.509 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 monclient: authenticate success, global_id 7613 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: get_monmap_and_config success 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 4 set_mon_vals no callback set 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: shutdown 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: build_initial_monmap 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 build_initial for_mkfs: 0 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: monmap: 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:07:50.510 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding auth protocol: cephx 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding auth protocol: cephx 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding auth protocol: cephx 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.511 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: crc 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a377a4d0) adding con mode: secure 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 librados: starting msgr at 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 librados: starting objecter 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5648a375a430 EEXIST 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 librados: setting wanted keys 2024-09-12T18:07:50.512 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 librados: calling monclient init 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: init 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding auth protocol: cephx 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding auth protocol: cephx 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding auth protocol: cephx 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.513 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: crc 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 AuthRegistry(0x5648a37363d0) adding con mode: secure 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command rotate-key cmddesc rotate-key hook 0x5648a3736518 EEXIST 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _reopen_session rank -1 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-b con 0x5648a3779fc0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-c con 0x5648a3783860 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): picked mon.noname-a con 0x5648a37884b0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:07:50.514 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): _renew_subs 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient(hunting): authenticate will time out at 2899.491096s 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): get_auth_request con 0x5648a3783860 auth_method 0 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): get_auth_request con 0x5648a37884b0 auth_method 0 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.515 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:07:50.077+0000 7f7c1952e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request con 0x5648a3779fc0 auth_method 0 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:07:50.077+0000 7f7c19d2f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient(hunting): handle_auth_done global_id 8130 payload 824 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient: _finish_hunting 0 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:07:50.077+0000 7f7c1a530640 1 monclient: found mon.noname-a 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:07:50.077+0000 7f7c1a530640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:07:50.516 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: dump: 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.517 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: _finish_auth 0 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:07:50.077+0000 7f7aeb7fe640 10 monclient: dump: 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:07:50.518 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 5 monclient: authenticate success, global_id 8130 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:07:50.077+0000 7f7afd7fa640 4 set_mon_vals no callback set 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _renew_subs 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:07:50.077+0000 7f7c1c2299c0 1 librados: init done 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:07:50.081+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command cr dump hook 0x5648a377c078 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:07:50.081+0000 7f7aeb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:07:50.519 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:07:50.081+0000 7f7aeb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:07:50.081+0000 7f7aeb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:07:50.081+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x7f7ae4070ae0 auth_method 0 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:07:50.081+0000 7f7c1952e640 10 monclient: get_auth_request con 0x5648a37a2270 auth_method 0 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 realm 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:07:50.081+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.520 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:07:50.085+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x5648a37a64c0 auth_method 0 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:07:50.085+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:07:50.085+0000 7f7c1952e640 10 monclient: get_auth_request con 0x5648a37a9d20 auth_method 0 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:07:50.085+0000 7f7aeb7fe640 1 client.8130.objecter ms_handle_reset 0x5648a37a9d20 session 0x5648a37a5850 osd.4 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:07:50.085+0000 7f7aeb7fe640 10 monclient: _renew_subs 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:07:50.085+0000 7f7aeb7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:07:50.085+0000 7f7c1952e640 10 monclient: get_auth_request con 0x7f7ae4080600 auth_method 0 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:07:50.089+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:07:50.089+0000 7f7c1c2299c0 20 searching for the correct realm 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:07:50.089+0000 7f7c1a530640 10 monclient: get_auth_request con 0x7f7c0403d040 auth_method 0 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:07:50.089+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x7f7c0c115040 auth_method 0 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:07:50.093+0000 7f7c1952e640 0 -- 172.21.15.97:0/1418282135 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f7c0401a040 msgr2=0x7f7c0403d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:50.521 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:07:50.297+0000 7f7c1952e640 10 monclient: get_auth_request con 0x7f7c0401a040 auth_method 0 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:07:50.301+0000 7f7c1a530640 10 monclient: get_auth_request con 0x7f7c0c0b8040 auth_method 0 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:07:50.305+0000 7f7c19d2f640 10 monclient: get_auth_request con 0x7f7c1407bd60 auth_method 0 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:07:50.305+0000 7f7c1952e640 0 -- 172.21.15.97:0/1418282135 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5648a37a2270 msgr2=0x5648a37a4710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:07:50.305+0000 7f7aeb7fe640 1 client.8130.objecter ms_handle_reset 0x5648a37a2270 session 0x5648a37a1ba0 osd.6 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:07:50.309+0000 7f7c1952e640 10 monclient: get_auth_request con 0x5648a37a9d20 auth_method 0 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.522 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 zone default found 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 4 Realm: () 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 zonegroup default 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.523 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:07:50.321+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 started sync module instance, tier type = 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:07:50.325+0000 7f7c1c2299c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=0 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=1 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=2 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=3 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=4 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=5 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=6 2024-09-12T18:07:50.524 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 20 add_watcher() i=7 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:07:50.349+0000 7f7c1c2299c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding auth protocol: cephx 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding auth protocol: cephx 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding auth protocol: cephx 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.525 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: crc 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 AuthRegistry(0x7ffdd0108670) adding con mode: secure 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:07:50.357+0000 7f7acb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command cache list hook 0x5648a377e130 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command cache inspect hook 0x5648a377e130 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command cache erase hook 0x5648a377e130 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command cache zap hook 0x5648a377e130 2024-09-12T18:07:50.526 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 note: GC not initialized 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:07:50.357+0000 7f7aca7fc640 20 reqs_thread_entry: start 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command sync trace show hook 0x7f7c04002f20 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command sync trace history hook 0x7f7c04002f20 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command sync trace active hook 0x7f7c04002f20 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 5 asok(0x5648a34ac2b0) register_command sync trace active_short hook 0x7f7c04002f20 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 Filter name: none 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:07:50.357+0000 7f7a3bfff640 20 reqs_thread_entry: start 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:50.527 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:07:50.357+0000 7f7c1c2299c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:07:50.361+0000 7f7c1c2299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:07:50.369+0000 7f7c1c2299c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:07:50.528 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94869980326736 notifier 8130 bl.length()=827 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:07:50.373+0000 7f7afcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:07:50.373+0000 7f7c1c2299c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.0 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.0 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.1 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.1 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.2 2024-09-12T18:07:50.529 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.2 2024-09-12T18:07:50.530 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.3 2024-09-12T18:07:50.530 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.3 2024-09-12T18:07:50.530 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.4 2024-09-12T18:07:50.530 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.4 2024-09-12T18:07:50.530 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.5 2024-09-12T18:07:50.530 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.5 2024-09-12T18:07:50.531 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.6 2024-09-12T18:07:50.531 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.6 2024-09-12T18:07:50.531 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.7 2024-09-12T18:07:50.531 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.7 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.8 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.8 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.9 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.9 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.10 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.10 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.11 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.11 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.12 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.12 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.13 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.13 2024-09-12T18:07:50.532 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:07:50.389+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:07:50.533 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:07:50.393+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:07:50.397+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:07:50.397+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:07:50.397+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:07:50.397+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:07:50.401+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:07:50.401+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:07:50.401+0000 7f7c1c2299c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:07:50.401+0000 7f7c1c2299c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:07:50.405+0000 7f7c1c2299c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7c1c2299c0 time 2024-09-12T18:07:50.409325+0000 2024-09-12T18:07:50.534 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7c1fb032eb] 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1fb0349f] 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5648a0f9b0c1] 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5648a0fac4f1] 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5648a0fadb44] 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1e969d90] 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.535 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:07:50.405+0000 7f7c1c2299c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7c1c2299c0 thread_name:radosgw-admin 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7c1e982520] 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7c1fb03345] 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7c1fb0349f] 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5648a0f9b0c1] 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5648a0fac4f1] 2024-09-12T18:07:50.536 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5648a0fadb44] 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7c1e969d90] 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:07:50.537 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:07:50.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:07:50.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:07:50.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:07:50.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:07:50.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:07:50.543 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7a3bfff640 / http_manager 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7aca7fc640 / http_manager 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7acb7fe640 / rgw_dt_lg_renew 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7aeb7fe640 / ms_dispatch 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7afcff9640 / io_context_pool 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7afd7fa640 / io_context_pool 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7aff7fe640 / ms_dispatch 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7b06604640 / ms_dispatch 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7b07e07640 / io_context_pool 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c1952e640 / msgr-worker-2 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c19d2f640 / msgr-worker-1 2024-09-12T18:07:50.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c1a530640 / msgr-worker-0 2024-09-12T18:07:50.545 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c1ad31640 / io_context_pool 2024-09-12T18:07:50.545 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7c1c2299c0 / radosgw-admin 2024-09-12T18:07:50.545 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:07:50.545 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:07:50.545 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:07:50.411769Z_a52e2604-b063-4a61-98b1-8ee925ad9fcd/log 2024-09-12T18:07:50.545 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:07:50.545 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:07:50.545 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.497+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.497+0000 7f96bfa1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.497+0000 7f96bfa1e9c0 20 realm 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.497+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.501+0000 7f96bfa1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.501+0000 7f96bfa1e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.501+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.501+0000 7f96bfa1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.501+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.501+0000 7f96bfa1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:50.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.501+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.505+0000 7f96bfa1e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.505+0000 7f96bfa1e9c0 20 searching for the correct realm 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.509+0000 7f96bdd25640 0 -- 172.21.15.97:0/395840807 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x561867de0830 msgr2=0x561867de2c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.517+0000 7f96bcd23640 0 -- 172.21.15.97:0/395840807 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x561867de8330 msgr2=0x561867dea720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.521+0000 7f96bfa1e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.521+0000 7f96bfa1e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.521+0000 7f96bfa1e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.521+0000 7f96bfa1e9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.521+0000 7f96bfa1e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.521+0000 7f96bfa1e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.521+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.521+0000 7f96bfa1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.521+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 zone default found 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 4 Realm: () 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 zonegroup default 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 started sync module instance, tier type = 2024-09-12T18:07:50.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.525+0000 7f96bfa1e9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:50.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.549+0000 7f96bfa1e9c0 20 add_watcher() i=0 2024-09-12T18:07:50.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.549+0000 7f96bfa1e9c0 20 add_watcher() i=1 2024-09-12T18:07:50.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.549+0000 7f96bfa1e9c0 20 add_watcher() i=2 2024-09-12T18:07:50.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.549+0000 7f96bfa1e9c0 20 add_watcher() i=3 2024-09-12T18:07:50.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.549+0000 7f96bfa1e9c0 20 add_watcher() i=4 2024-09-12T18:07:50.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.549+0000 7f96bfa1e9c0 20 add_watcher() i=5 2024-09-12T18:07:50.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.549+0000 7f96bfa1e9c0 20 add_watcher() i=6 2024-09-12T18:07:50.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.553+0000 7f96bfa1e9c0 20 add_watcher() i=7 2024-09-12T18:07:50.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.553+0000 7f96bfa1e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:50.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f95737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:50.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:50.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:50.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 5 note: GC not initialized 2024-09-12T18:07:50.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f95727e4640 20 reqs_thread_entry: start 2024-09-12T18:07:50.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:50.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 Filter name: none 2024-09-12T18:07:50.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f94e3fff640 20 reqs_thread_entry: start 2024-09-12T18:07:50.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:50.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:07:50.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:50.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:50.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.557+0000 7f96bfa1e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.561+0000 7f96bfa1e9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:07:50.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.561+0000 7f96bfa1e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:50.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.561+0000 7f95737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:50.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.565+0000 7f96bfa1e9c0 20 remove_watcher() i=0 2024-09-12T18:07:50.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.565+0000 7f96bfa1e9c0 2 removed watcher, disabling cache 2024-09-12T18:07:50.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.569+0000 7f96bfa1e9c0 20 remove_watcher() i=1 2024-09-12T18:07:50.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.569+0000 7f96bfa1e9c0 20 remove_watcher() i=2 2024-09-12T18:07:50.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.573+0000 7f96bfa1e9c0 20 remove_watcher() i=3 2024-09-12T18:07:50.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.573+0000 7f96bfa1e9c0 20 remove_watcher() i=4 2024-09-12T18:07:50.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.577+0000 7f96bfa1e9c0 20 remove_watcher() i=5 2024-09-12T18:07:50.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.577+0000 7f96bfa1e9c0 20 remove_watcher() i=6 2024-09-12T18:07:50.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.581+0000 7f96bfa1e9c0 20 remove_watcher() i=7 2024-09-12T18:07:50.600 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:07:50.600 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:07:50.645 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:07:50.675 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:50.675 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:50.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.717+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.717+0000 7fc4ab1889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.717+0000 7fc4ab1889c0 20 realm 2024-09-12T18:07:50.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.717+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.721+0000 7fc4ab1889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.721+0000 7fc4ab1889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:50.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.721+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.721+0000 7fc4ab1889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.721+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.721+0000 7fc4ab1889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:50.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.721+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.721+0000 7fc4ab1889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:50.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.721+0000 7fc4ab1889c0 20 searching for the correct realm 2024-09-12T18:07:50.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.729+0000 7fc4a848d640 0 -- 172.21.15.97:0/2277317964 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x555e0f273550 msgr2=0x555e0f275990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:50.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.733+0000 7fc4a848d640 0 -- 172.21.15.97:0/2277317964 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x555e0f27afa0 msgr2=0x555e0f27d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:50.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:07:50.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:50.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:50.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:07:50.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:50.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:50.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:50.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:50.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 zone default found 2024-09-12T18:07:50.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 4 Realm: () 2024-09-12T18:07:50.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:07:50.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:07:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 zonegroup default 2024-09-12T18:07:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:50.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 started sync module instance, tier type = 2024-09-12T18:07:50.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.741+0000 7fc4ab1889c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:07:50.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.761+0000 7fc4ab1889c0 20 add_watcher() i=0 2024-09-12T18:07:50.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.761+0000 7fc4ab1889c0 20 add_watcher() i=1 2024-09-12T18:07:50.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.761+0000 7fc4ab1889c0 20 add_watcher() i=2 2024-09-12T18:07:50.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.761+0000 7fc4ab1889c0 20 add_watcher() i=3 2024-09-12T18:07:50.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.761+0000 7fc4ab1889c0 20 add_watcher() i=4 2024-09-12T18:07:50.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.761+0000 7fc4ab1889c0 20 add_watcher() i=5 2024-09-12T18:07:50.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.761+0000 7fc4ab1889c0 20 add_watcher() i=6 2024-09-12T18:07:50.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.761+0000 7fc4ab1889c0 20 add_watcher() i=7 2024-09-12T18:07:50.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.761+0000 7fc4ab1889c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:50.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc35efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 5 note: GC not initialized 2024-09-12T18:07:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc35dfe3640 20 reqs_thread_entry: start 2024-09-12T18:07:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 20 init_complete bucket index max shards: 11 2024-09-12T18:07:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 20 Filter name: none 2024-09-12T18:07:50.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc2cf7fe640 20 reqs_thread_entry: start 2024-09-12T18:07:50.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:07:50.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:07:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:07:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:07:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:07:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.765+0000 7fc4ab1889c0 20 rados->read ofs=0 len=0 2024-09-12T18:07:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:07:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:07:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:07:50.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:07:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:07:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:07:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:07:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:07:50.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:07:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:07:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:07:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:07:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:07:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:07:50.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:07:50.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:07:50.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.769+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:07:50.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.773+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:07:50.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.773+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:07:50.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.773+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:07:50.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.773+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:07:50.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.773+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:07:50.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.773+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:07:50.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.773+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:07:50.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.773+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:07:50.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.773+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:07:50.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.773+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:07:50.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.777+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:07:50.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.777+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:07:50.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.777+0000 7fc4ab1889c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:07:50.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.777+0000 7fc4ab1889c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:07:50.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.777+0000 7fc35efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:50.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.781+0000 7fc4ab1889c0 20 remove_watcher() i=0 2024-09-12T18:07:50.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.781+0000 7fc4ab1889c0 2 removed watcher, disabling cache 2024-09-12T18:07:50.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.785+0000 7fc4ab1889c0 20 remove_watcher() i=1 2024-09-12T18:07:50.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.785+0000 7fc4ab1889c0 20 remove_watcher() i=2 2024-09-12T18:07:50.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.789+0000 7fc4ab1889c0 20 remove_watcher() i=3 2024-09-12T18:07:50.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.789+0000 7fc4ab1889c0 20 remove_watcher() i=4 2024-09-12T18:07:50.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.793+0000 7fc4ab1889c0 20 remove_watcher() i=5 2024-09-12T18:07:50.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.797+0000 7fc4ab1889c0 20 remove_watcher() i=6 2024-09-12T18:07:50.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:07:50.797+0000 7fc4ab1889c0 20 remove_watcher() i=7 2024-09-12T18:08:20.845 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:08:20.877 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:20.877 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:20.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.920+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.924+0000 7f7470b379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:20.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.924+0000 7f7470b379c0 20 realm 2024-09-12T18:08:20.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.924+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.924+0000 7f7470b379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:20.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.924+0000 7f7470b379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:20.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.924+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.924+0000 7f7470b379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:20.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.924+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.924+0000 7f7470b379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:20.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.924+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.928+0000 7f7470b379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:20.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.928+0000 7f7470b379c0 20 searching for the correct realm 2024-09-12T18:08:20.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.932+0000 7f746ee3e640 0 -- 172.21.15.97:0/1101712754 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f7464118040 msgr2=0x7f74640f7670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:20.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.940+0000 7f746e63d640 0 -- 172.21.15.97:0/1101712754 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f746802e040 msgr2=0x7f746801faa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:08:20.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.944+0000 7f7470b379c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:20.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.944+0000 7f7470b379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:20.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.944+0000 7f7470b379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:20.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.944+0000 7f7470b379c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:20.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.944+0000 7f7470b379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:20.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.944+0000 7f7470b379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:20.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.944+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:20.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:20.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:20.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 zone default found 2024-09-12T18:08:20.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 4 Realm: () 2024-09-12T18:08:20.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:20.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:20.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:20.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 zonegroup default 2024-09-12T18:08:20.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:20.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:20.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:20.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 started sync module instance, tier type = 2024-09-12T18:08:20.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.948+0000 7f7470b379c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:20.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.968+0000 7f7470b379c0 20 add_watcher() i=0 2024-09-12T18:08:20.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.968+0000 7f7470b379c0 20 add_watcher() i=1 2024-09-12T18:08:20.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.968+0000 7f7470b379c0 20 add_watcher() i=2 2024-09-12T18:08:20.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.968+0000 7f7470b379c0 20 add_watcher() i=3 2024-09-12T18:08:20.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.968+0000 7f7470b379c0 20 add_watcher() i=4 2024-09-12T18:08:20.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.968+0000 7f7470b379c0 20 add_watcher() i=5 2024-09-12T18:08:20.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.968+0000 7f7470b379c0 20 add_watcher() i=6 2024-09-12T18:08:20.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.972+0000 7f7470b379c0 20 add_watcher() i=7 2024-09-12T18:08:20.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.972+0000 7f7470b379c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:20.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7324fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:20.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:20.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:20.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 5 note: GC not initialized 2024-09-12T18:08:20.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f729f7fe640 20 reqs_thread_entry: start 2024-09-12T18:08:20.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:20.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 Filter name: none 2024-09-12T18:08:20.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f729d7fa640 20 reqs_thread_entry: start 2024-09-12T18:08:20.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:20.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:20.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:20.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:20.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.976+0000 7f7470b379c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:20.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.980+0000 7f7470b379c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:20.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.980+0000 7f7470b379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:20.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.980+0000 7f7324fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:20.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.984+0000 7f7470b379c0 20 remove_watcher() i=0 2024-09-12T18:08:20.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.984+0000 7f7470b379c0 2 removed watcher, disabling cache 2024-09-12T18:08:20.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.988+0000 7f7470b379c0 20 remove_watcher() i=1 2024-09-12T18:08:20.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.988+0000 7f7470b379c0 20 remove_watcher() i=2 2024-09-12T18:08:20.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.992+0000 7f7470b379c0 20 remove_watcher() i=3 2024-09-12T18:08:20.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.992+0000 7f7470b379c0 20 remove_watcher() i=4 2024-09-12T18:08:20.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.996+0000 7f7470b379c0 20 remove_watcher() i=5 2024-09-12T18:08:21.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:20.996+0000 7f7470b379c0 20 remove_watcher() i=6 2024-09-12T18:08:21.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.000+0000 7f7470b379c0 20 remove_watcher() i=7 2024-09-12T18:08:21.019 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:08:21.019 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:08:21.154 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:08:21.184 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:21.185 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:21.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.228+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.228+0000 7fef2628b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.228+0000 7fef2628b9c0 20 realm 2024-09-12T18:08:21.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.228+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.228+0000 7fef2628b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.228+0000 7fef2628b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:21.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.228+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.228+0000 7fef2628b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.228+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.232+0000 7fef2628b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.232+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.232+0000 7fef2628b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:21.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.232+0000 7fef2628b9c0 20 searching for the correct realm 2024-09-12T18:08:21.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.240+0000 7fef24592640 0 -- 172.21.15.97:0/3826643343 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fef180f6ce0 msgr2=0x7fef18111c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.244+0000 7fef23d91640 0 -- 172.21.15.97:0/3826643343 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fef1c018070 msgr2=0x7fef1c00f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:21.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:21.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:21.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:21.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:21.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:21.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:21.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 zone default found 2024-09-12T18:08:21.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 4 Realm: () 2024-09-12T18:08:21.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:21.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:21.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:21.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 zonegroup default 2024-09-12T18:08:21.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.252+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.256+0000 7fef2628b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.256+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.256+0000 7fef2628b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.256+0000 7fef2628b9c0 20 started sync module instance, tier type = 2024-09-12T18:08:21.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.256+0000 7fef2628b9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:21.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.272+0000 7fef2628b9c0 20 add_watcher() i=0 2024-09-12T18:08:21.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.272+0000 7fef2628b9c0 20 add_watcher() i=1 2024-09-12T18:08:21.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.272+0000 7fef2628b9c0 20 add_watcher() i=2 2024-09-12T18:08:21.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.272+0000 7fef2628b9c0 20 add_watcher() i=3 2024-09-12T18:08:21.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.272+0000 7fef2628b9c0 20 add_watcher() i=4 2024-09-12T18:08:21.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.272+0000 7fef2628b9c0 20 add_watcher() i=5 2024-09-12T18:08:21.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.272+0000 7fef2628b9c0 20 add_watcher() i=6 2024-09-12T18:08:21.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.276+0000 7fef2628b9c0 20 add_watcher() i=7 2024-09-12T18:08:21.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.276+0000 7fef2628b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:21.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.280+0000 7fedda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:21.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.280+0000 7fef2628b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:21.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.280+0000 7fef2628b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:21.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.280+0000 7fef2628b9c0 5 note: GC not initialized 2024-09-12T18:08:21.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.280+0000 7fedd97e2640 20 reqs_thread_entry: start 2024-09-12T18:08:21.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.280+0000 7fef2628b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:21.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 20 Filter name: none 2024-09-12T18:08:21.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fedd27fc640 20 reqs_thread_entry: start 2024-09-12T18:08:21.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:21.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:21.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:21.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:21.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:08:21.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:08:21.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:21.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:21.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:21.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:21.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:08:21.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:08:21.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:08:21.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:08:21.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:08:21.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:08:21.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:08:21.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:08:21.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.284+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:08:21.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:08:21.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:08:21.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:08:21.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:08:21.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:08:21.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:08:21.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:08:21.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:08:21.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:08:21.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:08:21.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:08:21.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.288+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:08:21.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.292+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:08:21.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.292+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:08:21.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.292+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:08:21.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.292+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:08:21.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.292+0000 7fef2628b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:08:21.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.292+0000 7fef2628b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:08:21.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.292+0000 7fedda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:21.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.296+0000 7fef2628b9c0 20 remove_watcher() i=0 2024-09-12T18:08:21.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.296+0000 7fef2628b9c0 2 removed watcher, disabling cache 2024-09-12T18:08:21.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.300+0000 7fef2628b9c0 20 remove_watcher() i=1 2024-09-12T18:08:21.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.300+0000 7fef2628b9c0 20 remove_watcher() i=2 2024-09-12T18:08:21.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.304+0000 7fef2628b9c0 20 remove_watcher() i=3 2024-09-12T18:08:21.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.304+0000 7fef2628b9c0 20 remove_watcher() i=4 2024-09-12T18:08:21.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.308+0000 7fef2628b9c0 20 remove_watcher() i=5 2024-09-12T18:08:21.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.312+0000 7fef2628b9c0 20 remove_watcher() i=6 2024-09-12T18:08:21.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.312+0000 7fef2628b9c0 20 remove_watcher() i=7 2024-09-12T18:08:21.331 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:08:21.357 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:21.357 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:21.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.400+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.400+0000 7f48f86109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.400+0000 7f48f86109c0 20 realm 2024-09-12T18:08:21.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.400+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.404+0000 7f48f86109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.404+0000 7f48f86109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:21.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.404+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.404+0000 7f48f86109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.404+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.404+0000 7f48f86109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.404+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.404+0000 7f48f86109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:21.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.404+0000 7f48f86109c0 20 searching for the correct realm 2024-09-12T18:08:21.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.408+0000 7f48f5915640 0 -- 172.21.15.97:0/379532745 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f48ec01b030 msgr2=0x7f48ec02a8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.416+0000 7f48f5915640 0 -- 172.21.15.97:0/379532745 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55bab87ddd70 msgr2=0x55bab87e01f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:21.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:21.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:21.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:21.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:21.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:21.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:21.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 zone default found 2024-09-12T18:08:21.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 4 Realm: () 2024-09-12T18:08:21.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:21.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:21.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:21.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 zonegroup default 2024-09-12T18:08:21.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.424+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.428+0000 7f48f86109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.428+0000 7f48f86109c0 20 started sync module instance, tier type = 2024-09-12T18:08:21.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.428+0000 7f48f86109c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:21.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.444+0000 7f48f86109c0 20 add_watcher() i=0 2024-09-12T18:08:21.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.444+0000 7f48f86109c0 20 add_watcher() i=1 2024-09-12T18:08:21.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.444+0000 7f48f86109c0 20 add_watcher() i=2 2024-09-12T18:08:21.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.444+0000 7f48f86109c0 20 add_watcher() i=3 2024-09-12T18:08:21.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.444+0000 7f48f86109c0 20 add_watcher() i=4 2024-09-12T18:08:21.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.444+0000 7f48f86109c0 20 add_watcher() i=5 2024-09-12T18:08:21.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.444+0000 7f48f86109c0 20 add_watcher() i=6 2024-09-12T18:08:21.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.448+0000 7f48f86109c0 20 add_watcher() i=7 2024-09-12T18:08:21.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.448+0000 7f48f86109c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:21.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f47acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:21.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:21.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:21.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 5 note: GC not initialized 2024-09-12T18:08:21.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f47277fe640 20 reqs_thread_entry: start 2024-09-12T18:08:21.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:21.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 Filter name: none 2024-09-12T18:08:21.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f47257fa640 20 reqs_thread_entry: start 2024-09-12T18:08:21.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:21.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:08:21.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:21.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:21.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.452+0000 7f48f86109c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.456+0000 7f48f86109c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:08:21.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.456+0000 7f48f86109c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:21.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.456+0000 7f47acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:21.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.460+0000 7f48f86109c0 20 remove_watcher() i=0 2024-09-12T18:08:21.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.460+0000 7f48f86109c0 2 removed watcher, disabling cache 2024-09-12T18:08:21.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.464+0000 7f48f86109c0 20 remove_watcher() i=1 2024-09-12T18:08:21.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.464+0000 7f48f86109c0 20 remove_watcher() i=2 2024-09-12T18:08:21.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.464+0000 7f48f86109c0 20 remove_watcher() i=3 2024-09-12T18:08:21.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.468+0000 7f48f86109c0 20 remove_watcher() i=4 2024-09-12T18:08:21.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.468+0000 7f48f86109c0 20 remove_watcher() i=5 2024-09-12T18:08:21.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.472+0000 7f48f86109c0 20 remove_watcher() i=6 2024-09-12T18:08:21.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.476+0000 7f48f86109c0 20 remove_watcher() i=7 2024-09-12T18:08:21.492 INFO:tasks.workunit.client.0.smithi097.stderr: test: duplicated entries should be purged before reshard 2024-09-12T18:08:21.492 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:08:21.518 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:21.518 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:21.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.556+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.560+0000 7f34a8d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.560+0000 7f34a8d119c0 20 realm 2024-09-12T18:08:21.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.560+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.560+0000 7f34a8d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.560+0000 7f34a8d119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:21.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.560+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.560+0000 7f34a8d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.560+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.564+0000 7f34a8d119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.564+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.564+0000 7f34a8d119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:21.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.564+0000 7f34a8d119c0 20 searching for the correct realm 2024-09-12T18:08:21.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.572+0000 7f34a6817640 0 -- 172.21.15.97:0/70859645 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f3498008040 msgr2=0x7f349804a340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.576+0000 7f34a6817640 0 -- 172.21.15.97:0/70859645 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55e24ed2b510 msgr2=0x55e24ed2d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.580+0000 7f34a8d119c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:21.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.580+0000 7f34a8d119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:21.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.580+0000 7f34a8d119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:21.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.580+0000 7f34a8d119c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:21.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.580+0000 7f34a8d119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:21.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.580+0000 7f34a8d119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:21.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.580+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:21.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 zone default found 2024-09-12T18:08:21.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 4 Realm: () 2024-09-12T18:08:21.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:21.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:21.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:21.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 zonegroup default 2024-09-12T18:08:21.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 started sync module instance, tier type = 2024-09-12T18:08:21.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.584+0000 7f34a8d119c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:21.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.600+0000 7f34a8d119c0 20 add_watcher() i=0 2024-09-12T18:08:21.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.600+0000 7f34a8d119c0 20 add_watcher() i=1 2024-09-12T18:08:21.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.600+0000 7f34a8d119c0 20 add_watcher() i=2 2024-09-12T18:08:21.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.600+0000 7f34a8d119c0 20 add_watcher() i=3 2024-09-12T18:08:21.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.600+0000 7f34a8d119c0 20 add_watcher() i=4 2024-09-12T18:08:21.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.600+0000 7f34a8d119c0 20 add_watcher() i=5 2024-09-12T18:08:21.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.600+0000 7f34a8d119c0 20 add_watcher() i=6 2024-09-12T18:08:21.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.604+0000 7f34a8d119c0 20 add_watcher() i=7 2024-09-12T18:08:21.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.604+0000 7f34a8d119c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:21.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f335d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f34a8d119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f34a8d119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f34a8d119c0 5 note: GC not initialized 2024-09-12T18:08:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f32d7fff640 20 reqs_thread_entry: start 2024-09-12T18:08:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f34a8d119c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f34a8d119c0 20 Filter name: none 2024-09-12T18:08:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f32d5ffb640 20 reqs_thread_entry: start 2024-09-12T18:08:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f34a8d119c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:21.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f34a8d119c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:08:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f34a8d119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.608+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.612+0000 7f34a8d119c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.612+0000 7f34a8d119c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.612+0000 7f34a8d119c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:08:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.612+0000 7f34a8d119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:21.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.612+0000 7f335d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:21.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.616+0000 7f34a8d119c0 20 remove_watcher() i=0 2024-09-12T18:08:21.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.616+0000 7f34a8d119c0 2 removed watcher, disabling cache 2024-09-12T18:08:21.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.620+0000 7f34a8d119c0 20 remove_watcher() i=1 2024-09-12T18:08:21.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.620+0000 7f34a8d119c0 20 remove_watcher() i=2 2024-09-12T18:08:21.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.624+0000 7f34a8d119c0 20 remove_watcher() i=3 2024-09-12T18:08:21.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.624+0000 7f34a8d119c0 20 remove_watcher() i=4 2024-09-12T18:08:21.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.628+0000 7f34a8d119c0 20 remove_watcher() i=5 2024-09-12T18:08:21.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.628+0000 7f34a8d119c0 20 remove_watcher() i=6 2024-09-12T18:08:21.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.632+0000 7f34a8d119c0 20 remove_watcher() i=7 2024-09-12T18:08:21.646 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.646 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:08:21.646 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 98539659-fdaf-41ce-847d-239ff89323af.4641.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T18:08:21.646 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.647 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:08:21.675 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:21.675 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:21.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.708+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 realm 2024-09-12T18:08:21.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.712+0000 7fde4ab629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:21.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:21.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 searching for the correct realm 2024-09-12T18:08:21.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.720+0000 7fde48668640 0 -- 172.21.15.97:0/169300370 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fde40030040 msgr2=0x7fde400641f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.728+0000 7fde48668640 0 -- 172.21.15.97:0/169300370 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fde380c0020 msgr2=0x7fde380f6f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:21.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:21.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:21.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:21.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:21.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:21.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:21.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 zone default found 2024-09-12T18:08:21.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 4 Realm: () 2024-09-12T18:08:21.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:21.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:21.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:21.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 zonegroup default 2024-09-12T18:08:21.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 started sync module instance, tier type = 2024-09-12T18:08:21.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=0 2024-09-12T18:08:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=1 2024-09-12T18:08:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=2 2024-09-12T18:08:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=3 2024-09-12T18:08:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=4 2024-09-12T18:08:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=5 2024-09-12T18:08:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=6 2024-09-12T18:08:21.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.756+0000 7fde4ab629c0 20 add_watcher() i=7 2024-09-12T18:08:21.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.756+0000 7fde4ab629c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:21.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fdcfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:21.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:21.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:21.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 note: GC not initialized 2024-09-12T18:08:21.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fdcfdfdb640 20 reqs_thread_entry: start 2024-09-12T18:08:21.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:21.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 Filter name: none 2024-09-12T18:08:21.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fdc6f7fe640 20 reqs_thread_entry: start 2024-09-12T18:08:21.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:21.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:21.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:21.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:21.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:08:21.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:08:21.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:21.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:21.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:21.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:21.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:08:21.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:21.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:21.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:21.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:08:21.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94897268983440 notifier 7733 bl.length()=827 2024-09-12T18:08:21.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:21.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:21.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:21.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:08:21.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:08:21.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:08:21.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:08:21.790 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde4ab629c0 time 2024-09-12T18:08:21.792561+0000 2024-09-12T18:08:21.790 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:21.791 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:21.791 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fde4e43c2eb] 2024-09-12T18:08:21.791 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde4e43c49f] 2024-09-12T18:08:21.791 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564efc9200c1] 2024-09-12T18:08:21.791 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564efc9321fa] 2024-09-12T18:08:21.791 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:08:21.791 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde4d2a2d90] 2024-09-12T18:08:21.791 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:08:21.791 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:08:21.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.788+0000 7fde4ab629c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde4ab629c0 time 2024-09-12T18:08:21.792561+0000 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fde4e43c2eb] 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde4e43c49f] 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564efc9200c1] 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564efc9321fa] 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde4d2a2d90] 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.792 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:08:21.793 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fde4ab629c0 thread_name:radosgw-admin 2024-09-12T18:08:21.812 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:21.812 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fde4d2bb520] 2024-09-12T18:08:21.812 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:08:21.812 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:08:21.812 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:08:21.812 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fde4e43c345] 2024-09-12T18:08:21.812 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde4e43c49f] 2024-09-12T18:08:21.812 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564efc9200c1] 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564efc9321fa] 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde4d2a2d90] 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.788+0000 7fde4ab629c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fde4ab629c0 thread_name:radosgw-admin 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fde4d2bb520] 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:08:21.813 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fde4e43c345] 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde4e43c49f] 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564efc9200c1] 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564efc9321fa] 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde4d2a2d90] 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.814 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_done global_id 8241 payload 274 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient: _finish_hunting 0 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:08:21.692+0000 7fde48668640 1 monclient: found mon.noname-a 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: dump: 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.815 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: _finish_auth 0 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: _check_auth_tickets 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 monclient: authenticate success, global_id 8241 2024-09-12T18:08:21.816 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: dump: 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.817 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 4 set_mon_vals no callback set 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: shutdown 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) unregister_commands rotate-key 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: build_initial_monmap 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: monmap: 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.818 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding auth protocol: cephx 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding auth protocol: cephx 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding auth protocol: cephx 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.819 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 librados: starting msgr at 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 librados: starting objecter 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command objecter_requests hook 0x564efdf2cc60 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 librados: setting wanted keys 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 librados: calling monclient init 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: init 2024-09-12T18:08:21.820 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding auth protocol: cephx 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding auth protocol: cephx 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding auth protocol: cephx 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.821 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command rotate-key hook 0x564efdf27d18 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-c con 0x564efddd7ec0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-b con 0x564efde6d3e0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-a con 0x564efde70600 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.822 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): authenticate will time out at 2931.106534s 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): get_auth_request con 0x564efddd7ec0 auth_method 0 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): get_auth_request con 0x564efde70600 auth_method 0 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.823 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_done global_id 8244 payload 824 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient: _finish_hunting 0 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:08:21.692+0000 7fde48e69640 1 monclient: found mon.noname-a 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: dump: 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.824 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: _finish_auth 0 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: _check_auth_tickets 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: dump: 2024-09-12T18:08:21.825 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 monclient: authenticate success, global_id 8244 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:08:21.692+0000 7fdd3660c640 4 set_mon_vals no callback set 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.826 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 librados: init done 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:08:21.696+0000 7fdd34e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:08:21.696+0000 7fdd34e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:08:21.696+0000 7fdd34e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:08:21.696+0000 7fde48668640 10 monclient: get_auth_request con 0x7fdd30070b10 auth_method 0 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:08:21.696+0000 7fde47e67640 10 monclient: get_auth_request con 0x564efdf50310 auth_method 0 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:08:21.696+0000 7fde48668640 10 monclient: get_auth_request con 0x564efdf728b0 auth_method 0 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:08:21.696+0000 7fde47e67640 10 monclient: get_auth_request con 0x564efdf76c10 auth_method 0 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient: build_initial_monmap 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient: monmap: 2024-09-12T18:08:21.827 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding auth protocol: cephx 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding auth protocol: cephx 2024-09-12T18:08:21.828 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding auth protocol: cephx 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.829 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x564efdf7f460 EEXIST 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient: init 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding auth protocol: cephx 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding auth protocol: cephx 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding auth protocol: cephx 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.830 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command rotate-key cmddesc rotate-key hook 0x564efdf7a240 EEXIST 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-a con 0x564efdfa3610 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-c con 0x564efdfa2f40 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-b con 0x564efdfa1920 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.831 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): authenticate will time out at 2931.115513s 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): get_auth_request con 0x564efdfa2f40 auth_method 0 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): get_auth_request con 0x564efdfa3610 auth_method 0 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.832 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): handle_auth_done global_id 8247 payload 824 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient: _finish_hunting 0 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:08:21.700+0000 7fde48668640 1 monclient: found mon.noname-a 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: dump: 2024-09-12T18:08:21.833 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: _finish_auth 0 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: _check_auth_tickets 2024-09-12T18:08:21.834 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: dump: 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.835 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.836 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:08:21.704+0000 7fde4966a640 4 set_mon_vals no callback set 2024-09-12T18:08:21.836 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 monclient: authenticate success, global_id 8247 2024-09-12T18:08:21.836 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.836 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.836 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.836 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.836 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:21.836 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.836 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.836 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient: get_auth_request con 0x7fdd20070a20 auth_method 0 2024-09-12T18:08:21.836 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: get_monmap_and_config 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: build_initial_monmap 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: monmap: 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:21.837 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding auth protocol: cephx 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding auth protocol: cephx 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding auth protocol: cephx 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.838 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: init 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding auth protocol: cephx 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding auth protocol: cephx 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding auth protocol: cephx 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.839 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc0621f378 EEXIST 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-b con 0x564efdff7430 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-c con 0x564efdff2870 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:21.840 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-a con 0x564efdfe8f40 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): authenticate will time out at 2931.119371s 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): get_auth_request con 0x564efdff2870 auth_method 0 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): get_auth_request con 0x564efdfe8f40 auth_method 0 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.841 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): handle_auth_done global_id 8250 payload 274 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient: _finish_hunting 0 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:08:21.704+0000 7fde48e69640 1 monclient: found mon.noname-a 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.842 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:21.844 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: dump: 2024-09-12T18:08:21.844 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.844 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.844 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.844 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.844 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.844 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: _finish_auth 0 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:08:21.708+0000 7fdd1f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:08:21.708+0000 7fdd1f7fe640 10 monclient: dump: 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.845 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.846 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.846 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.846 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.846 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.846 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.846 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.846 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.846 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.846 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 monclient: authenticate success, global_id 8250 2024-09-12T18:08:21.846 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 4 set_mon_vals no callback set 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: shutdown 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: build_initial_monmap 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: monmap: 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.847 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:21.848 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:21.848 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:21.848 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.848 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding auth protocol: cephx 2024-09-12T18:08:21.848 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding auth protocol: cephx 2024-09-12T18:08:21.848 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding auth protocol: cephx 2024-09-12T18:08:21.848 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.848 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.848 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.848 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.848 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.849 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.849 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.849 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.849 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.849 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.849 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.849 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.849 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.849 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 librados: starting msgr at 2024-09-12T18:08:21.849 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 librados: starting objecter 2024-09-12T18:08:21.849 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x564efdfc3dc0 EEXIST 2024-09-12T18:08:21.850 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 librados: setting wanted keys 2024-09-12T18:08:21.850 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 librados: calling monclient init 2024-09-12T18:08:21.850 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: init 2024-09-12T18:08:21.850 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding auth protocol: cephx 2024-09-12T18:08:21.850 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding auth protocol: cephx 2024-09-12T18:08:21.850 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding auth protocol: cephx 2024-09-12T18:08:21.850 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.850 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.850 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.850 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.850 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.851 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.851 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.851 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.851 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.851 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.851 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.851 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.852 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.852 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.852 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command rotate-key cmddesc rotate-key hook 0x564efdfa5578 EEXIST 2024-09-12T18:08:21.852 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:21.852 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:08:21.852 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-b con 0x564efdfe8f40 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:21.852 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-c con 0x564efdff2870 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:21.852 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-a con 0x564efdff7430 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:21.852 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.852 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.852 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.853 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:21.853 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): authenticate will time out at 2931.121746s 2024-09-12T18:08:21.853 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): get_auth_request con 0x564efdff2870 auth_method 0 2024-09-12T18:08:21.853 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.853 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.853 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.853 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): get_auth_request con 0x564efdff7430 auth_method 0 2024-09-12T18:08:21.853 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.853 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.853 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.853 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.854 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.854 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.854 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.854 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.854 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.854 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): handle_auth_done global_id 7733 payload 824 2024-09-12T18:08:21.854 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient: _finish_hunting 0 2024-09-12T18:08:21.854 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:08:21.708+0000 7fde47e67640 1 monclient: found mon.noname-c 2024-09-12T18:08:21.854 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:08:21.854 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.854 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:21.855 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: dump: 2024-09-12T18:08:21.855 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.855 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.855 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.855 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.855 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.855 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.855 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.855 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.855 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.855 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.856 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: _finish_auth 0 2024-09-12T18:08:21.856 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: _check_auth_tickets 2024-09-12T18:08:21.856 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:21.856 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.856 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:21.856 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: dump: 2024-09-12T18:08:21.856 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.856 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.856 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.856 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.856 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.857 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.857 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.857 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.857 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.857 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.857 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:08:21.708+0000 7fdd1f7fe640 4 set_mon_vals no callback set 2024-09-12T18:08:21.857 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 monclient: authenticate success, global_id 7733 2024-09-12T18:08:21.857 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.857 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:21.857 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.857 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 librados: init done 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command cr dump hook 0x564efdfe5d08 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:08:21.712+0000 7fdd1dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:08:21.712+0000 7fdd1dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:08:21.712+0000 7fdd1dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:08:21.712+0000 7fde48668640 10 monclient: get_auth_request con 0x7fdd10070ae0 auth_method 0 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:08:21.712+0000 7fde48e69640 10 monclient: get_auth_request con 0x564efe011640 auth_method 0 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 realm 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.858 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.859 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:21.859 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.859 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.859 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.859 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:08:21.712+0000 7fde48668640 10 monclient: get_auth_request con 0x564efe015680 auth_method 0 2024-09-12T18:08:21.859 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.859 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.859 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:08:21.716+0000 7fde47e67640 10 monclient: get_auth_request con 0x564efe018f70 auth_method 0 2024-09-12T18:08:21.859 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:21.859 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 searching for the correct realm 2024-09-12T18:08:21.859 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:08:21.716+0000 7fde48e69640 10 monclient: get_auth_request con 0x7fde3002c030 auth_method 0 2024-09-12T18:08:21.860 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:08:21.720+0000 7fde48668640 10 monclient: get_auth_request con 0x7fde40030040 auth_method 0 2024-09-12T18:08:21.860 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:08:21.720+0000 7fde47e67640 10 monclient: get_auth_request con 0x7fde3002f040 auth_method 0 2024-09-12T18:08:21.860 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:08:21.720+0000 7fde48668640 0 -- 172.21.15.97:0/169300370 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fde40030040 msgr2=0x7fde400641f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.860 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:08:21.720+0000 7fdd1dffb640 1 client.7733.objecter ms_handle_reset 0x7fde40030040 session 0x7fde40065520 osd.0 2024-09-12T18:08:21.860 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:08:21.720+0000 7fdd1dffb640 10 monclient: _renew_subs 2024-09-12T18:08:21.860 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:08:21.720+0000 7fdd1dffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:21.860 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:08:21.720+0000 7fde48668640 10 monclient: get_auth_request con 0x7fdd10080600 auth_method 0 2024-09-12T18:08:21.860 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:08:21.724+0000 7fde48e69640 10 monclient: get_auth_request con 0x7fde4006e270 auth_method 0 2024-09-12T18:08:21.860 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:08:21.724+0000 7fde48668640 10 monclient: get_auth_request con 0x7fde380c0020 auth_method 0 2024-09-12T18:08:21.860 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:08:21.728+0000 7fde48668640 0 -- 172.21.15.97:0/169300370 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fde380c0020 msgr2=0x7fde380f6f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.860 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:08:21.728+0000 7fdd1dffb640 1 client.7733.objecter ms_handle_reset 0x7fde380c0020 session 0x7fde3812a040 osd.3 2024-09-12T18:08:21.861 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:08:21.728+0000 7fde48668640 10 monclient: get_auth_request con 0x7fde40030040 auth_method 0 2024-09-12T18:08:21.861 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:21.861 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:21.861 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:21.861 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:21.861 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:21.861 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:21.861 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.861 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.861 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.861 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.862 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.862 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:21.862 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 zone default found 2024-09-12T18:08:21.862 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 4 Realm: () 2024-09-12T18:08:21.862 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:21.862 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:21.862 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:21.863 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 zonegroup default 2024-09-12T18:08:21.863 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.863 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.863 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.863 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.863 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.863 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.863 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 started sync module instance, tier type = 2024-09-12T18:08:21.863 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:21.863 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=0 2024-09-12T18:08:21.863 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=1 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=2 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=3 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=4 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=5 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=6 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:08:21.756+0000 7fde4ab629c0 20 add_watcher() i=7 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:08:21.756+0000 7fde4ab629c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding auth protocol: cephx 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding auth protocol: cephx 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding auth protocol: cephx 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.864 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.865 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.865 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.865 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.865 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.865 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.865 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.865 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.865 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.865 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.865 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.865 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:08:21.760+0000 7fdcfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command cache list hook 0x564efdfe8a20 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command cache inspect hook 0x564efdfe8a20 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command cache erase hook 0x564efdfe8a20 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command cache zap hook 0x564efdfe8a20 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 note: GC not initialized 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:08:21.760+0000 7fdcfdfdb640 20 reqs_thread_entry: start 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command sync trace show hook 0x7fde300043b0 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command sync trace history hook 0x7fde300043b0 2024-09-12T18:08:21.866 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command sync trace active hook 0x7fde300043b0 2024-09-12T18:08:21.867 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command sync trace active_short hook 0x7fde300043b0 2024-09-12T18:08:21.867 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:21.867 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 Filter name: none 2024-09-12T18:08:21.867 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:08:21.760+0000 7fdc6f7fe640 20 reqs_thread_entry: start 2024-09-12T18:08:21.867 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:21.867 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.867 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:21.867 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:21.867 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:21.867 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:08:21.867 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.868 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:08:21.868 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:21.868 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:21.868 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:21.868 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:21.868 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:08:21.868 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:21.868 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:21.868 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:21.868 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:08:21.868 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94897268983440 notifier 7733 bl.length()=827 2024-09-12T18:08:21.869 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:21.869 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:21.869 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:21.869 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:08:21.869 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:08:21.869 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:08:21.869 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:08:21.870 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:08:21.788+0000 7fde4ab629c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde4ab629c0 time 2024-09-12T18:08:21.792561+0000 2024-09-12T18:08:21.870 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:21.870 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.870 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:21.870 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fde4e43c2eb] 2024-09-12T18:08:21.870 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde4e43c49f] 2024-09-12T18:08:21.870 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564efc9200c1] 2024-09-12T18:08:21.870 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564efc9321fa] 2024-09-12T18:08:21.870 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:08:21.870 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde4d2a2d90] 2024-09-12T18:08:21.870 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:08:21.871 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:08:21.871 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.871 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:08:21.788+0000 7fde4ab629c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:21.871 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fde4ab629c0 thread_name:radosgw-admin 2024-09-12T18:08:21.871 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.871 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:21.871 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fde4d2bb520] 2024-09-12T18:08:21.871 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:08:21.871 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:08:21.871 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:08:21.871 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fde4e43c345] 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde4e43c49f] 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564efc9200c1] 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564efc9321fa] 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde4d2a2d90] 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:08:21.872 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:08:21.873 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:08:21.873 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:08:21.873 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:08:21.873 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:08:21.873 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:08:21.873 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:08:21.873 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:08:21.873 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:08:21.873 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:08:21.873 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:08:21.873 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:08:21.874 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:08:21.874 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:08:21.874 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:08:21.874 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:08:21.874 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:08:21.874 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:08:21.874 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:08:21.874 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:08:21.874 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:08:21.874 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:08:21.874 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:08:21.875 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:08:21.875 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:08:21.875 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:08:21.875 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:08:21.875 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:08:21.875 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:08:21.875 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:08:21.875 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:08:21.875 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:08:21.875 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:08:21.875 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:08:21.876 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:08:21.876 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:08:21.876 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:08:21.876 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:08:21.876 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:08:21.876 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:08:21.876 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:08:21.876 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:08:21.876 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:08:21.876 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:08:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:08:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:08:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:08:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:08:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:08:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:08:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:08:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:08:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:08:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:08:21.877 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:08:21.878 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:08:21.878 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:08:21.878 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:08:21.878 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:08:21.878 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:08:21.878 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:08:21.878 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:08:21.878 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:08:21.878 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:08:21.878 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:08:21.878 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:08:21.879 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:08:21.879 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:08:21.879 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:08:21.879 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:08:21.879 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:08:21.879 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:08:21.879 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:08:21.879 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:08:21.879 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:08:21.879 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:08:21.879 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:08:21.880 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:08:21.880 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:08:21.880 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:08:21.880 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:08:21.880 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:08:21.880 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:08:21.880 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:08:21.880 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:08:21.880 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:08:21.880 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:08:21.880 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdc6f7fe640 / http_manager 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdcfdfdb640 / http_manager 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdcfefdd640 / rgw_dt_lg_renew 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdd1dffb640 / ms_dispatch 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdd1f7fe640 / io_context_pool 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdd2dffb640 / ms_dispatch 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdd34e09640 / ms_dispatch 2024-09-12T18:08:21.881 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdd3660c640 / io_context_pool 2024-09-12T18:08:21.882 INFO:tasks.workunit.client.0.smithi097.stderr: 7fde47e67640 / msgr-worker-2 2024-09-12T18:08:21.882 INFO:tasks.workunit.client.0.smithi097.stderr: 7fde48668640 / msgr-worker-1 2024-09-12T18:08:21.882 INFO:tasks.workunit.client.0.smithi097.stderr: 7fde48e69640 / msgr-worker-0 2024-09-12T18:08:21.882 INFO:tasks.workunit.client.0.smithi097.stderr: 7fde4966a640 / io_context_pool 2024-09-12T18:08:21.882 INFO:tasks.workunit.client.0.smithi097.stderr: 7fde4ab629c0 / radosgw-admin 2024-09-12T18:08:21.882 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:08:21.882 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:08:21.882 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.143512.log 2024-09-12T18:08:21.882 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:08:21.882 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:08:21.882 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.883 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.883 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.883 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.883 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.883 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.883 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.883 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_done global_id 8241 payload 274 2024-09-12T18:08:21.883 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient: _finish_hunting 0 2024-09-12T18:08:21.883 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:08:21.692+0000 7fde48668640 1 monclient: found mon.noname-a 2024-09-12T18:08:21.883 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.884 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.884 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:21.884 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: dump: 2024-09-12T18:08:21.884 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.884 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.884 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.884 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.884 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.884 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.884 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.884 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.885 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.885 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.885 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: _finish_auth 0 2024-09-12T18:08:21.885 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: _check_auth_tickets 2024-09-12T18:08:21.885 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 monclient: authenticate success, global_id 8241 2024-09-12T18:08:21.885 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:21.885 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.885 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:21.885 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:08:21.692+0000 7fdd3660c640 10 monclient: dump: 2024-09-12T18:08:21.885 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.886 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.886 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.886 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.886 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.886 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.886 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.886 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.886 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.886 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.886 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:21.886 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 4 set_mon_vals no callback set 2024-09-12T18:08:21.887 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: shutdown 2024-09-12T18:08:21.887 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) unregister_commands rotate-key 2024-09-12T18:08:21.887 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: build_initial_monmap 2024-09-12T18:08:21.887 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:21.887 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: monmap: 2024-09-12T18:08:21.887 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:21.887 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:21.887 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:21.887 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:21.887 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:21.887 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.888 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:21.888 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:21.888 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:21.888 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.888 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding auth protocol: cephx 2024-09-12T18:08:21.888 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding auth protocol: cephx 2024-09-12T18:08:21.888 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding auth protocol: cephx 2024-09-12T18:08:21.889 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.889 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.889 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.889 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.889 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.889 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.889 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.889 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.889 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.889 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.889 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: crc 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf2e660) adding con mode: secure 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 librados: starting msgr at 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 librados: starting objecter 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command objecter_requests hook 0x564efdf2cc60 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 librados: setting wanted keys 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 librados: calling monclient init 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: init 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding auth protocol: cephx 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding auth protocol: cephx 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding auth protocol: cephx 2024-09-12T18:08:21.890 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.891 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.891 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.891 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.891 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.891 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.891 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.891 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.891 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.891 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.891 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: crc 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf27bd0) adding con mode: secure 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command rotate-key hook 0x564efdf27d18 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-c con 0x564efddd7ec0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-b con 0x564efde6d3e0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-a con 0x564efde70600 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.892 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.893 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:21.893 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient(hunting): authenticate will time out at 2931.106534s 2024-09-12T18:08:21.893 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): get_auth_request con 0x564efddd7ec0 auth_method 0 2024-09-12T18:08:21.893 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.893 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.893 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.893 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): get_auth_request con 0x564efde70600 auth_method 0 2024-09-12T18:08:21.893 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.893 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.893 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.893 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:08:21.692+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient(hunting): handle_auth_done global_id 8244 payload 824 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient: _finish_hunting 0 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:08:21.692+0000 7fde48e69640 1 monclient: found mon.noname-a 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:08:21.692+0000 7fde48e69640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:21.894 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: dump: 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: _finish_auth 0 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: _check_auth_tickets 2024-09-12T18:08:21.895 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:21.896 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.896 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:21.896 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:08:21.692+0000 7fdd34e09640 10 monclient: dump: 2024-09-12T18:08:21.896 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.896 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.896 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.896 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.896 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.896 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.896 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.896 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.897 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.897 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.897 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 5 monclient: authenticate success, global_id 8244 2024-09-12T18:08:21.897 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:08:21.692+0000 7fdd3660c640 4 set_mon_vals no callback set 2024-09-12T18:08:21.897 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.897 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.897 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.897 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.897 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:08:21.692+0000 7fde4ab629c0 1 librados: init done 2024-09-12T18:08:21.897 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:08:21.696+0000 7fdd34e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:21.897 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:08:21.696+0000 7fdd34e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.898 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:08:21.696+0000 7fdd34e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.898 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:08:21.696+0000 7fde48668640 10 monclient: get_auth_request con 0x7fdd30070b10 auth_method 0 2024-09-12T18:08:21.898 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:08:21.696+0000 7fde47e67640 10 monclient: get_auth_request con 0x564efdf50310 auth_method 0 2024-09-12T18:08:21.898 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:08:21.696+0000 7fde48668640 10 monclient: get_auth_request con 0x564efdf728b0 auth_method 0 2024-09-12T18:08:21.898 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:08:21.696+0000 7fde47e67640 10 monclient: get_auth_request con 0x564efdf76c10 auth_method 0 2024-09-12T18:08:21.898 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient: build_initial_monmap 2024-09-12T18:08:21.898 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:21.898 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient: monmap: 2024-09-12T18:08:21.898 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:21.898 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:21.898 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding auth protocol: cephx 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding auth protocol: cephx 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding auth protocol: cephx 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.899 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.900 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.900 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.900 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.900 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.900 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.900 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.900 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.900 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.900 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: crc 2024-09-12T18:08:21.900 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7ba70) adding con mode: secure 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x564efdf7f460 EEXIST 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient: init 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding auth protocol: cephx 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding auth protocol: cephx 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding auth protocol: cephx 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.901 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.902 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.902 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.902 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.902 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.902 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: crc 2024-09-12T18:08:21.902 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 AuthRegistry(0x564efdf7a0f8) adding con mode: secure 2024-09-12T18:08:21.902 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.902 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.902 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command rotate-key cmddesc rotate-key hook 0x564efdf7a240 EEXIST 2024-09-12T18:08:21.902 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:21.902 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:08:21.903 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-a con 0x564efdfa3610 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:21.903 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-c con 0x564efdfa2f40 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:21.903 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-b con 0x564efdfa1920 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:21.903 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.903 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.903 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.903 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:21.903 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:08:21.700+0000 7fde4ab629c0 10 monclient(hunting): authenticate will time out at 2931.115513s 2024-09-12T18:08:21.903 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): get_auth_request con 0x564efdfa2f40 auth_method 0 2024-09-12T18:08:21.903 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.903 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.904 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.904 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): get_auth_request con 0x564efdfa3610 auth_method 0 2024-09-12T18:08:21.904 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.904 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.904 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.904 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.904 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.904 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:08:21.700+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.904 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.904 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.904 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.905 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient(hunting): handle_auth_done global_id 8247 payload 824 2024-09-12T18:08:21.905 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient: _finish_hunting 0 2024-09-12T18:08:21.905 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:08:21.700+0000 7fde48668640 1 monclient: found mon.noname-a 2024-09-12T18:08:21.905 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:08:21.700+0000 7fde48668640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.905 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.905 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:21.905 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: dump: 2024-09-12T18:08:21.905 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.905 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.905 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: _finish_auth 0 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: _check_auth_tickets 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.906 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 10 monclient: dump: 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:08:21.704+0000 7fde4966a640 4 set_mon_vals no callback set 2024-09-12T18:08:21.907 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 monclient: authenticate success, global_id 8247 2024-09-12T18:08:21.908 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.908 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.908 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.908 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.908 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:21.908 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.908 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:08:21.704+0000 7fdd2dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.908 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient: get_auth_request con 0x7fdd20070a20 auth_method 0 2024-09-12T18:08:21.908 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: get_monmap_and_config 2024-09-12T18:08:21.908 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: build_initial_monmap 2024-09-12T18:08:21.908 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:21.909 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: monmap: 2024-09-12T18:08:21.909 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:21.909 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:21.909 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:21.909 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:21.909 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:21.909 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.909 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:21.909 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:21.909 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:21.909 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding auth protocol: cephx 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding auth protocol: cephx 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding auth protocol: cephx 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.910 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: crc 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfc2f10) adding con mode: secure 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: init 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding auth protocol: cephx 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding auth protocol: cephx 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding auth protocol: cephx 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.911 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.912 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.912 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.912 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.912 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.912 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.912 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: crc 2024-09-12T18:08:21.912 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f230) adding con mode: secure 2024-09-12T18:08:21.912 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.912 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.912 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc0621f378 EEXIST 2024-09-12T18:08:21.912 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:21.913 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:08:21.913 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-b con 0x564efdff7430 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:21.913 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-c con 0x564efdff2870 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:21.913 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-a con 0x564efdfe8f40 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:21.913 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.913 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.913 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.913 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:21.913 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:08:21.704+0000 7fde4ab629c0 10 monclient(hunting): authenticate will time out at 2931.119371s 2024-09-12T18:08:21.913 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): get_auth_request con 0x564efdff2870 auth_method 0 2024-09-12T18:08:21.913 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): get_auth_request con 0x564efdfe8f40 auth_method 0 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:08:21.704+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.914 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient(hunting): handle_auth_done global_id 8250 payload 274 2024-09-12T18:08:21.915 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient: _finish_hunting 0 2024-09-12T18:08:21.915 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:08:21.704+0000 7fde48e69640 1 monclient: found mon.noname-a 2024-09-12T18:08:21.915 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:08:21.704+0000 7fde48e69640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:21.915 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.915 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:21.915 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: dump: 2024-09-12T18:08:21.915 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.915 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.915 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.915 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.915 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.916 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.916 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.916 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.916 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.916 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.916 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: _finish_auth 0 2024-09-12T18:08:21.916 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:08:21.916 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:21.916 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:08:21.704+0000 7fdd1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.916 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:08:21.708+0000 7fdd1f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:21.916 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:08:21.708+0000 7fdd1f7fe640 10 monclient: dump: 2024-09-12T18:08:21.917 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.917 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.917 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.917 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.917 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.917 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.917 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.917 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.917 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.917 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.917 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 monclient: authenticate success, global_id 8250 2024-09-12T18:08:21.918 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:21.918 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 4 set_mon_vals no callback set 2024-09-12T18:08:21.918 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: shutdown 2024-09-12T18:08:21.918 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: build_initial_monmap 2024-09-12T18:08:21.918 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:21.918 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: monmap: 2024-09-12T18:08:21.918 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:21.918 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:21.918 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:21.918 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding auth protocol: cephx 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding auth protocol: cephx 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding auth protocol: cephx 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.919 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.920 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.920 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.920 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.920 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.920 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.920 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.920 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.920 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: crc 2024-09-12T18:08:21.920 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfe9a00) adding con mode: secure 2024-09-12T18:08:21.920 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.921 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 librados: starting msgr at 2024-09-12T18:08:21.921 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 librados: starting objecter 2024-09-12T18:08:21.921 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x564efdfc3dc0 EEXIST 2024-09-12T18:08:21.921 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 librados: setting wanted keys 2024-09-12T18:08:21.921 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 librados: calling monclient init 2024-09-12T18:08:21.921 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: init 2024-09-12T18:08:21.921 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding auth protocol: cephx 2024-09-12T18:08:21.921 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding auth protocol: cephx 2024-09-12T18:08:21.921 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding auth protocol: cephx 2024-09-12T18:08:21.921 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.921 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.922 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.922 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.922 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.922 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.922 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.922 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.922 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.922 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.922 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: crc 2024-09-12T18:08:21.922 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 AuthRegistry(0x564efdfa5430) adding con mode: secure 2024-09-12T18:08:21.922 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.923 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.923 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command rotate-key cmddesc rotate-key hook 0x564efdfa5578 EEXIST 2024-09-12T18:08:21.923 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:21.923 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:08:21.923 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-b con 0x564efdfe8f40 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:21.923 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-c con 0x564efdff2870 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:21.923 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): picked mon.noname-a con 0x564efdff7430 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:21.923 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.923 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.923 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:21.923 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:21.924 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient(hunting): authenticate will time out at 2931.121746s 2024-09-12T18:08:21.924 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): get_auth_request con 0x564efdff2870 auth_method 0 2024-09-12T18:08:21.924 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.924 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.924 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.924 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): get_auth_request con 0x564efdff7430 auth_method 0 2024-09-12T18:08:21.924 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:21.924 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:21.924 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:21.925 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.925 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.925 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.925 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:21.925 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:21.925 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:08:21.708+0000 7fde48e69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:21.925 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient(hunting): handle_auth_done global_id 7733 payload 824 2024-09-12T18:08:21.925 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient: _finish_hunting 0 2024-09-12T18:08:21.925 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:08:21.708+0000 7fde47e67640 1 monclient: found mon.noname-c 2024-09-12T18:08:21.925 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:08:21.708+0000 7fde47e67640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:08:21.925 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: dump: 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.926 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.927 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: _finish_auth 0 2024-09-12T18:08:21.927 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: _check_auth_tickets 2024-09-12T18:08:21.927 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:21.927 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:21.927 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:21.927 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:08:21.708+0000 7fdd1dffb640 10 monclient: dump: 2024-09-12T18:08:21.927 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:21.927 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:21.927 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.927 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:21.927 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:21.928 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:21.928 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:21.928 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:21.928 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:21.928 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.928 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:08:21.708+0000 7fdd1f7fe640 4 set_mon_vals no callback set 2024-09-12T18:08:21.928 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 monclient: authenticate success, global_id 7733 2024-09-12T18:08:21.928 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.928 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:21.928 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _renew_subs 2024-09-12T18:08:21.928 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 1 librados: init done 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command cr dump hook 0x564efdfe5d08 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:08:21.708+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:08:21.712+0000 7fdd1dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:08:21.712+0000 7fdd1dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:08:21.712+0000 7fdd1dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:08:21.712+0000 7fde48668640 10 monclient: get_auth_request con 0x7fdd10070ae0 auth_method 0 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:08:21.712+0000 7fde48e69640 10 monclient: get_auth_request con 0x564efe011640 auth_method 0 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 realm 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.929 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:08:21.712+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:08:21.712+0000 7fde48668640 10 monclient: get_auth_request con 0x564efe015680 auth_method 0 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:08:21.716+0000 7fde47e67640 10 monclient: get_auth_request con 0x564efe018f70 auth_method 0 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:08:21.716+0000 7fde4ab629c0 20 searching for the correct realm 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:08:21.716+0000 7fde48e69640 10 monclient: get_auth_request con 0x7fde3002c030 auth_method 0 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:08:21.720+0000 7fde48668640 10 monclient: get_auth_request con 0x7fde40030040 auth_method 0 2024-09-12T18:08:21.930 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:08:21.720+0000 7fde47e67640 10 monclient: get_auth_request con 0x7fde3002f040 auth_method 0 2024-09-12T18:08:21.931 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:08:21.720+0000 7fde48668640 0 -- 172.21.15.97:0/169300370 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fde40030040 msgr2=0x7fde400641f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.931 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:08:21.720+0000 7fdd1dffb640 1 client.7733.objecter ms_handle_reset 0x7fde40030040 session 0x7fde40065520 osd.0 2024-09-12T18:08:21.931 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:08:21.720+0000 7fdd1dffb640 10 monclient: _renew_subs 2024-09-12T18:08:21.931 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:08:21.720+0000 7fdd1dffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:21.931 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:08:21.720+0000 7fde48668640 10 monclient: get_auth_request con 0x7fdd10080600 auth_method 0 2024-09-12T18:08:21.931 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:08:21.724+0000 7fde48e69640 10 monclient: get_auth_request con 0x7fde4006e270 auth_method 0 2024-09-12T18:08:21.931 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:08:21.724+0000 7fde48668640 10 monclient: get_auth_request con 0x7fde380c0020 auth_method 0 2024-09-12T18:08:21.931 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:08:21.728+0000 7fde48668640 0 -- 172.21.15.97:0/169300370 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fde380c0020 msgr2=0x7fde380f6f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.931 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:08:21.728+0000 7fdd1dffb640 1 client.7733.objecter ms_handle_reset 0x7fde380c0020 session 0x7fde3812a040 osd.3 2024-09-12T18:08:21.931 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:08:21.728+0000 7fde48668640 10 monclient: get_auth_request con 0x7fde40030040 auth_method 0 2024-09-12T18:08:21.931 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:21.932 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:21.932 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:21.932 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:21.932 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:21.932 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:21.932 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.932 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.932 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.932 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.932 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:08:21.732+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.932 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:21.933 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 zone default found 2024-09-12T18:08:21.933 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 4 Realm: () 2024-09-12T18:08:21.933 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:21.933 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:21.933 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:21.933 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 zonegroup default 2024-09-12T18:08:21.933 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.933 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.933 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.933 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.933 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.934 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.934 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 started sync module instance, tier type = 2024-09-12T18:08:21.934 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:08:21.736+0000 7fde4ab629c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:21.934 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=0 2024-09-12T18:08:21.934 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=1 2024-09-12T18:08:21.934 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=2 2024-09-12T18:08:21.934 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=3 2024-09-12T18:08:21.934 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=4 2024-09-12T18:08:21.934 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=5 2024-09-12T18:08:21.934 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:08:21.752+0000 7fde4ab629c0 20 add_watcher() i=6 2024-09-12T18:08:21.934 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:08:21.756+0000 7fde4ab629c0 20 add_watcher() i=7 2024-09-12T18:08:21.935 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:08:21.756+0000 7fde4ab629c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:21.935 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding auth protocol: cephx 2024-09-12T18:08:21.935 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding auth protocol: cephx 2024-09-12T18:08:21.935 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding auth protocol: cephx 2024-09-12T18:08:21.935 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.935 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.935 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.935 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.935 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.935 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.935 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: crc 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 AuthRegistry(0x7ffc0621f700) adding con mode: secure 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:08:21.760+0000 7fdcfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command cache list hook 0x564efdfe8a20 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command cache inspect hook 0x564efdfe8a20 2024-09-12T18:08:21.936 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command cache erase hook 0x564efdfe8a20 2024-09-12T18:08:21.937 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command cache zap hook 0x564efdfe8a20 2024-09-12T18:08:21.937 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 note: GC not initialized 2024-09-12T18:08:21.937 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:08:21.760+0000 7fdcfdfdb640 20 reqs_thread_entry: start 2024-09-12T18:08:21.937 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command sync trace show hook 0x7fde300043b0 2024-09-12T18:08:21.937 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command sync trace history hook 0x7fde300043b0 2024-09-12T18:08:21.937 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command sync trace active hook 0x7fde300043b0 2024-09-12T18:08:21.937 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 5 asok(0x564efdd1e2b0) register_command sync trace active_short hook 0x7fde300043b0 2024-09-12T18:08:21.937 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:21.937 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 Filter name: none 2024-09-12T18:08:21.937 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:08:21.760+0000 7fdc6f7fe640 20 reqs_thread_entry: start 2024-09-12T18:08:21.937 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:21.938 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:08:21.760+0000 7fde4ab629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:08:21.939 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:21.939 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:21.939 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:21.939 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:08:21.939 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94897268983440 notifier 7733 bl.length()=827 2024-09-12T18:08:21.939 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:21.939 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:21.939 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:08:21.772+0000 7fdd1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:21.939 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:08:21.939 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:08:21.939 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:08:21.940 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:08:21.772+0000 7fde4ab629c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:08:21.940 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:08:21.788+0000 7fde4ab629c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde4ab629c0 time 2024-09-12T18:08:21.792561+0000 2024-09-12T18:08:21.940 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:21.940 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.940 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:21.940 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fde4e43c2eb] 2024-09-12T18:08:21.940 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde4e43c49f] 2024-09-12T18:08:21.940 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564efc9200c1] 2024-09-12T18:08:21.940 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564efc9321fa] 2024-09-12T18:08:21.940 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:08:21.940 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde4d2a2d90] 2024-09-12T18:08:21.941 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:08:21.941 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:08:21.941 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.941 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:08:21.788+0000 7fde4ab629c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:21.941 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fde4ab629c0 thread_name:radosgw-admin 2024-09-12T18:08:21.941 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.941 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:21.941 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fde4d2bb520] 2024-09-12T18:08:21.941 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:08:21.941 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fde4e43c345] 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde4e43c49f] 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564efc9200c1] 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564efc9321fa] 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde4d2a2d90] 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:21.942 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:08:21.943 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:08:21.943 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:08:21.943 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:08:21.943 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:08:21.943 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:08:21.943 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:08:21.943 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:08:21.943 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:08:21.943 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:08:21.943 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:08:21.943 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:08:21.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:08:21.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:08:21.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:08:21.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:08:21.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:08:21.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:08:21.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:08:21.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:08:21.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:08:21.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:08:21.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:08:21.945 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:08:21.945 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:08:21.945 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:08:21.945 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:08:21.945 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:08:21.945 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:08:21.945 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:08:21.945 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:08:21.945 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:08:21.945 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:08:21.945 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:08:21.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:08:21.946 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:08:21.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:08:21.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:08:21.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:08:21.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:08:21.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:08:21.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:08:21.946 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:08:21.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:08:21.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:08:21.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:08:21.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:08:21.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:08:21.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:08:21.947 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:08:21.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:08:21.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:08:21.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:08:21.947 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:08:21.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:08:21.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:08:21.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:08:21.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:08:21.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:08:21.948 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:08:21.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:08:21.948 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:08:21.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:08:21.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:08:21.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:08:21.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:08:21.948 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:08:21.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:08:21.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:08:21.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:08:21.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:08:21.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:08:21.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:08:21.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:08:21.950 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:08:21.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:08:21.950 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:08:21.950 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:08:21.950 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdc6f7fe640 / http_manager 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdcfdfdb640 / http_manager 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdcfefdd640 / rgw_dt_lg_renew 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdd1dffb640 / ms_dispatch 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdd1f7fe640 / io_context_pool 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdd2dffb640 / ms_dispatch 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdd34e09640 / ms_dispatch 2024-09-12T18:08:21.951 INFO:tasks.workunit.client.0.smithi097.stderr: 7fdd3660c640 / io_context_pool 2024-09-12T18:08:21.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7fde47e67640 / msgr-worker-2 2024-09-12T18:08:21.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7fde48668640 / msgr-worker-1 2024-09-12T18:08:21.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7fde48e69640 / msgr-worker-0 2024-09-12T18:08:21.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7fde4966a640 / io_context_pool 2024-09-12T18:08:21.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7fde4ab629c0 / radosgw-admin 2024-09-12T18:08:21.952 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:08:21.952 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:08:21.952 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:08:21.794543Z_bb42e6ba-a4f9-48a2-ba67-6f195946e9c2/log 2024-09-12T18:08:21.952 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:08:21.952 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:08:21.952 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:08:21.954 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:21.954 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:21.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.860+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.860+0000 7f9c4e1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.860+0000 7f9c4e1b09c0 20 realm 2024-09-12T18:08:21.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.860+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.864+0000 7f9c4e1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.864+0000 7f9c4e1b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:21.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.864+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.864+0000 7f9c4e1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:21.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.864+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.864+0000 7f9c4e1b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:21.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.864+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:21.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.864+0000 7f9c4e1b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:21.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.864+0000 7f9c4e1b09c0 20 searching for the correct realm 2024-09-12T18:08:21.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.868+0000 7f9c43fff640 0 -- 172.21.15.97:0/2883352242 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x5566645b4380 msgr2=0x5566645b6770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:21.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:21.872+0000 7f9c4bcb6640 0 -- 172.21.15.97:0/2883352242 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f9c440fa140 msgr2=0x7f9c44113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:22.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.088+0000 7f9c4e1b09c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:22.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.088+0000 7f9c4e1b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:22.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.088+0000 7f9c4e1b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:22.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.088+0000 7f9c4e1b09c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:22.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.088+0000 7f9c4e1b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:22.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.088+0000 7f9c4e1b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:22.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.088+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:22.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:22.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:22.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 zone default found 2024-09-12T18:08:22.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 4 Realm: () 2024-09-12T18:08:22.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:22.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:22.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:22.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 zonegroup default 2024-09-12T18:08:22.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:22.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:22.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.092+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.096+0000 7f9c4e1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:22.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.096+0000 7f9c4e1b09c0 20 started sync module instance, tier type = 2024-09-12T18:08:22.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.096+0000 7f9c4e1b09c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:22.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.116+0000 7f9c4e1b09c0 20 add_watcher() i=0 2024-09-12T18:08:22.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.116+0000 7f9c4e1b09c0 20 add_watcher() i=1 2024-09-12T18:08:22.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.116+0000 7f9c4e1b09c0 20 add_watcher() i=2 2024-09-12T18:08:22.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.116+0000 7f9c4e1b09c0 20 add_watcher() i=3 2024-09-12T18:08:22.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.116+0000 7f9c4e1b09c0 20 add_watcher() i=4 2024-09-12T18:08:22.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.116+0000 7f9c4e1b09c0 20 add_watcher() i=5 2024-09-12T18:08:22.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.116+0000 7f9c4e1b09c0 20 add_watcher() i=6 2024-09-12T18:08:22.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.120+0000 7f9c4e1b09c0 20 add_watcher() i=7 2024-09-12T18:08:22.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.120+0000 7f9c4e1b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:22.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.124+0000 7f9b01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:22.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.124+0000 7f9c4e1b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:22.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.124+0000 7f9c4e1b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:22.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.124+0000 7f9c4e1b09c0 5 note: GC not initialized 2024-09-12T18:08:22.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.128+0000 7f9b00fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:22.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.128+0000 7f9c4e1b09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:22.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.128+0000 7f9c4e1b09c0 20 Filter name: none 2024-09-12T18:08:22.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.128+0000 7f9a7a7fc640 20 reqs_thread_entry: start 2024-09-12T18:08:22.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.128+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.128+0000 7f9c4e1b09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:22.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.128+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.128+0000 7f9c4e1b09c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:22.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.128+0000 7f9c4e1b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:22.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.128+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.132+0000 7f9c4e1b09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:22.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.132+0000 7f9c4e1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.132+0000 7f9c4e1b09c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:22.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.132+0000 7f9c4e1b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:08:22.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.136+0000 7f9b01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:22.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.140+0000 7f9c4e1b09c0 20 remove_watcher() i=0 2024-09-12T18:08:22.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.140+0000 7f9c4e1b09c0 2 removed watcher, disabling cache 2024-09-12T18:08:22.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.140+0000 7f9c4e1b09c0 20 remove_watcher() i=1 2024-09-12T18:08:22.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.144+0000 7f9c4e1b09c0 20 remove_watcher() i=2 2024-09-12T18:08:22.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.144+0000 7f9c4e1b09c0 20 remove_watcher() i=3 2024-09-12T18:08:22.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.148+0000 7f9c4e1b09c0 20 remove_watcher() i=4 2024-09-12T18:08:22.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.148+0000 7f9c4e1b09c0 20 remove_watcher() i=5 2024-09-12T18:08:22.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.152+0000 7f9c4e1b09c0 20 remove_watcher() i=6 2024-09-12T18:08:22.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.156+0000 7f9c4e1b09c0 20 remove_watcher() i=7 2024-09-12T18:08:22.175 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:08:22.175 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:08:22.218 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:08:22.243 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:22.243 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:22.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.280+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.284+0000 7fb250baa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:22.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.284+0000 7fb250baa9c0 20 realm 2024-09-12T18:08:22.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.284+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.284+0000 7fb250baa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:22.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.284+0000 7fb250baa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:22.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.284+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.284+0000 7fb250baa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:22.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.284+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.284+0000 7fb250baa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:22.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.284+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.288+0000 7fb250baa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:22.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.288+0000 7fb250baa9c0 20 searching for the correct realm 2024-09-12T18:08:22.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.292+0000 7fb24e6b0640 0 -- 172.21.15.97:0/1260784056 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fb24001c410 msgr2=0x7fb24001c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:22.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.300+0000 7fb24e6b0640 0 -- 172.21.15.97:0/1260784056 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55feee0bb3d0 msgr2=0x55feee0bd870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:08:22.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.304+0000 7fb250baa9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:22.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:22.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:22.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:22.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:22.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:22.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:22.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:22.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 zone default found 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 4 Realm: () 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 zonegroup default 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:22.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:22.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 started sync module instance, tier type = 2024-09-12T18:08:22.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.308+0000 7fb250baa9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:22.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.328+0000 7fb250baa9c0 20 add_watcher() i=0 2024-09-12T18:08:22.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.328+0000 7fb250baa9c0 20 add_watcher() i=1 2024-09-12T18:08:22.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.328+0000 7fb250baa9c0 20 add_watcher() i=2 2024-09-12T18:08:22.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.328+0000 7fb250baa9c0 20 add_watcher() i=3 2024-09-12T18:08:22.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.328+0000 7fb250baa9c0 20 add_watcher() i=4 2024-09-12T18:08:22.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.328+0000 7fb250baa9c0 20 add_watcher() i=5 2024-09-12T18:08:22.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.328+0000 7fb250baa9c0 20 add_watcher() i=6 2024-09-12T18:08:22.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb250baa9c0 20 add_watcher() i=7 2024-09-12T18:08:22.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb250baa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:22.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb104fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:22.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb250baa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:22.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb250baa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb250baa9c0 5 note: GC not initialized 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb07f7fe640 20 reqs_thread_entry: start 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb250baa9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb250baa9c0 20 Filter name: none 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb07d7fa640 20 reqs_thread_entry: start 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb250baa9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.332+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:08:22.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:22.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:22.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:22.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:22.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:22.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:08:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:08:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:08:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:08:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:08:22.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:08:22.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:08:22.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:08:22.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:08:22.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:08:22.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:08:22.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:08:22.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.336+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:08:22.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:08:22.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:08:22.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:08:22.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:08:22.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:08:22.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:08:22.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:08:22.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:08:22.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:08:22.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:08:22.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:08:22.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.340+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:08:22.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.344+0000 7fb250baa9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:08:22.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.344+0000 7fb250baa9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:08:22.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.344+0000 7fb104fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:22.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.348+0000 7fb250baa9c0 20 remove_watcher() i=0 2024-09-12T18:08:22.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.348+0000 7fb250baa9c0 2 removed watcher, disabling cache 2024-09-12T18:08:22.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.348+0000 7fb250baa9c0 20 remove_watcher() i=1 2024-09-12T18:08:22.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.352+0000 7fb250baa9c0 20 remove_watcher() i=2 2024-09-12T18:08:22.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.352+0000 7fb250baa9c0 20 remove_watcher() i=3 2024-09-12T18:08:22.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.356+0000 7fb250baa9c0 20 remove_watcher() i=4 2024-09-12T18:08:22.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.356+0000 7fb250baa9c0 20 remove_watcher() i=5 2024-09-12T18:08:22.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.360+0000 7fb250baa9c0 20 remove_watcher() i=6 2024-09-12T18:08:22.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:22.364+0000 7fb250baa9c0 20 remove_watcher() i=7 2024-09-12T18:08:52.407 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T18:08:52.445 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:52.446 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:52.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 realm 2024-09-12T18:08:52.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.492+0000 7f11fd5069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:52.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:52.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:52.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 searching for the correct realm 2024-09-12T18:08:52.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.500+0000 7f11fa80b640 0 -- 172.21.15.97:0/1556425076 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f11f00aa9f0 msgr2=0x7f11f0110950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:52.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.708+0000 7f11fa80b640 0 -- 172.21.15.97:0/1556425076 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5575d6b9b7b0 msgr2=0x5575d6b9dba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:52.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:52.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:52.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:52.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:52.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:52.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:52.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:52.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:52.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 zone default found 2024-09-12T18:08:52.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 4 Realm: () 2024-09-12T18:08:52.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:52.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:52.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:52.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 zonegroup default 2024-09-12T18:08:52.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 started sync module instance, tier type = 2024-09-12T18:08:52.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=0 2024-09-12T18:08:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=1 2024-09-12T18:08:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=2 2024-09-12T18:08:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=3 2024-09-12T18:08:52.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=4 2024-09-12T18:08:52.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=5 2024-09-12T18:08:52.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=6 2024-09-12T18:08:52.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 add_watcher() i=7 2024-09-12T18:08:52.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f11fd5069c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:52.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f10b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:52.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:52.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:52.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 note: GC not initialized 2024-09-12T18:08:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f10b0fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 Filter name: none 2024-09-12T18:08:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f102a7fc640 20 reqs_thread_entry: start 2024-09-12T18:08:52.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f11fd5069c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:52.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:52.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:52.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:52.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:08:52.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.760+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.760+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:52.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:52.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:52.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:52.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:52.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:08:52.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:08:52.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:52.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:52.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:52.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:08:52.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 93964602037968 notifier 7784 bl.length()=827 2024-09-12T18:08:52.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:52.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:52.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:52.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:08:52.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:08:52.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:08:52.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:08:52.788 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f11fd5069c0 time 2024-09-12T18:08:52.791027+0000 2024-09-12T18:08:52.788 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:52.792 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:52.792 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1200de02eb] 2024-09-12T18:08:52.792 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1200de049f] 2024-09-12T18:08:52.792 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575d4f290c1] 2024-09-12T18:08:52.792 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x14100ec) [0x5575d597f0ec] 2024-09-12T18:08:52.792 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5575d4f3b18d] 2024-09-12T18:08:52.792 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:08:52.792 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f11ffc46d90] 2024-09-12T18:08:52.792 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:08:52.792 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:08:52.792 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f11fd5069c0 thread_name:radosgw-admin 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.788+0000 7f11fd5069c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f11fd5069c0 time 2024-09-12T18:08:52.791027+0000 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1200de02eb] 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1200de049f] 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575d4f290c1] 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x14100ec) [0x5575d597f0ec] 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5575d4f3b18d] 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:08:52.793 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f11ffc46d90] 2024-09-12T18:08:52.794 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:08:52.794 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:08:52.794 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.795 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:52.795 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f11ffc5f520] 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1200de0345] 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1200de049f] 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575d4f290c1] 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x14100ec) [0x5575d597f0ec] 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5575d4f3b18d] 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f11ffc46d90] 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:08:52.796 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:08:52.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.792+0000 7f11fd5069c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:52.797 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f11fd5069c0 thread_name:radosgw-admin 2024-09-12T18:08:52.797 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.797 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:52.797 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f11ffc5f520] 2024-09-12T18:08:52.797 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:08:52.797 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:08:52.797 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:08:52.797 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1200de0345] 2024-09-12T18:08:52.797 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1200de049f] 2024-09-12T18:08:52.798 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575d4f290c1] 2024-09-12T18:08:52.798 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x14100ec) [0x5575d597f0ec] 2024-09-12T18:08:52.798 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5575d4f3b18d] 2024-09-12T18:08:52.798 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:08:52.798 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f11ffc46d90] 2024-09-12T18:08:52.798 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:08:52.798 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:08:52.798 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:52.798 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.798 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:08:52.835 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:08:52.468+0000 7f11fb80d640 1 monclient: found mon.noname-a 2024-09-12T18:08:52.836 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:08:52.468+0000 7f11fb80d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:52.836 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.836 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:52.836 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: dump: 2024-09-12T18:08:52.836 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.836 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.836 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.836 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.836 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.836 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.836 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: _finish_auth 0 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: _check_auth_tickets 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: dump: 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.837 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 monclient: authenticate success, global_id 8301 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 4 set_mon_vals no callback set 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: shutdown 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) unregister_commands rotate-key 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: build_initial_monmap 2024-09-12T18:08:52.838 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: monmap: 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding auth protocol: cephx 2024-09-12T18:08:52.839 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding auth protocol: cephx 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding auth protocol: cephx 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.840 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 librados: starting msgr at 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 librados: starting objecter 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command objecter_requests hook 0x5575d684f100 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 librados: setting wanted keys 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 librados: calling monclient init 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: init 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding auth protocol: cephx 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding auth protocol: cephx 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding auth protocol: cephx 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.841 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command rotate-key hook 0x5575d6ab23c8 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:08:52.842 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-a con 0x5575d69622b0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-c con 0x5575d69fddb0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-b con 0x5575d6ab5850 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): authenticate will time out at 2961.881990s 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): get_auth_request con 0x5575d69fddb0 auth_method 0 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.843 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): get_auth_request con 0x5575d69622b0 auth_method 0 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:08:52.468+0000 7f11fb80d640 10 monclient(hunting): get_auth_request con 0x5575d6ab5850 auth_method 0 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:08:52.468+0000 7f11fb80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:08:52.468+0000 7f11fb80d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.844 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:08:52.468+0000 7f11fb80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): handle_auth_done global_id 7775 payload 824 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient: _finish_hunting 0 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:08:52.468+0000 7f11fa80b640 1 monclient: found mon.noname-c 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: dump: 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.845 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: _finish_auth 0 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: _check_auth_tickets 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: dump: 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.846 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 monclient: authenticate success, global_id 7775 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:08:52.468+0000 7f10e960a640 4 set_mon_vals no callback set 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 librados: init done 2024-09-12T18:08:52.847 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:08:52.472+0000 7f10e7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:08:52.472+0000 7f10e7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:08:52.472+0000 7f10e7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:08:52.472+0000 7f11fb00c640 10 monclient: get_auth_request con 0x7f10e0070b10 auth_method 0 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:08:52.472+0000 7f11fb80d640 10 monclient: get_auth_request con 0x5575d6aed840 auth_method 0 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:08:52.472+0000 7f11fb00c640 10 monclient: get_auth_request con 0x5575d6afcfe0 auth_method 0 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:08:52.476+0000 7f11fa80b640 10 monclient: get_auth_request con 0x5575d6b01340 auth_method 0 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 10 monclient: build_initial_monmap 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 10 monclient: monmap: 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:52.848 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding auth protocol: cephx 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding auth protocol: cephx 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding auth protocol: cephx 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.849 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command objecter_requests cmddesc objecter_requests hook 0x5575d6b09a50 EEXIST 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 10 monclient: init 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding auth protocol: cephx 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding auth protocol: cephx 2024-09-12T18:08:52.850 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding auth protocol: cephx 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.851 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command rotate-key cmddesc rotate-key hook 0x5575d6b048a0 EEXIST 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-a con 0x5575d6b2dc00 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-b con 0x5575d6b2d530 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-c con 0x5575d6b2bf10 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:52.852 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): authenticate will time out at 2961.892218s 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): get_auth_request con 0x5575d6b2dc00 auth_method 0 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): get_auth_request con 0x5575d6b2bf10 auth_method 0 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.853 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): handle_auth_done global_id 8307 payload 824 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient: _finish_hunting 0 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:08:52.480+0000 7f11fb00c640 1 monclient: found mon.noname-a 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:08:52.480+0000 7f11fa80b640 10 monclient: get_auth_request con 0x5575d6b2d530 auth_method 0 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: dump: 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.854 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: _finish_auth 0 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: _check_auth_tickets 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 monclient: authenticate success, global_id 8307 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: dump: 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.855 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:08:52.480+0000 7f11fc00e640 4 set_mon_vals no callback set 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:52.856 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:08:52.480+0000 7f10e5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:08:52.480+0000 7f10e5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:08:52.480+0000 7f10e5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:08:52.480+0000 7f11fa80b640 10 monclient: get_auth_request con 0x7f10d4070a20 auth_method 0 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: get_monmap_and_config 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: build_initial_monmap 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: monmap: 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.857 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding auth protocol: cephx 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding auth protocol: cephx 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding auth protocol: cephx 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.858 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: init 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding auth protocol: cephx 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding auth protocol: cephx 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding auth protocol: cephx 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.859 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd58a197d8 EEXIST 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:52.860 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-c con 0x5575d6b81ae0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-a con 0x5575d6b51500 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-b con 0x5575d6b7d2b0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): authenticate will time out at 2961.896453s 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): get_auth_request con 0x5575d6b81ae0 auth_method 0 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): get_auth_request con 0x5575d6b51500 auth_method 0 2024-09-12T18:08:52.861 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): handle_auth_done global_id 7781 payload 274 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient: _finish_hunting 0 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:08:52.484+0000 7f11fb00c640 1 monclient: found mon.noname-c 2024-09-12T18:08:52.862 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: dump: 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.863 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: _finish_auth 0 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: _check_auth_tickets 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 monclient: authenticate success, global_id 7781 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 4 set_mon_vals no callback set 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: dump: 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.864 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: shutdown 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: build_initial_monmap 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: monmap: 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:52.865 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding auth protocol: cephx 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding auth protocol: cephx 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding auth protocol: cephx 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.866 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 1 librados: starting msgr at 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 1 librados: starting objecter 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command objecter_requests cmddesc objecter_requests hook 0x5575d6b821d0 EEXIST 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 1 librados: setting wanted keys 2024-09-12T18:08:52.867 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 1 librados: calling monclient init 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: init 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding auth protocol: cephx 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding auth protocol: cephx 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding auth protocol: cephx 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.868 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command rotate-key cmddesc rotate-key hook 0x5575d6b2fb68 EEXIST 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-b con 0x5575d6b51500 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-a con 0x5575d6b7d2b0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-c con 0x5575d6b81ae0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.869 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): authenticate will time out at 2961.899047s 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): get_auth_request con 0x5575d6b81ae0 auth_method 0 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): get_auth_request con 0x5575d6b7d2b0 auth_method 0 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.870 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): get_auth_request con 0x5575d6b51500 auth_method 0 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): handle_auth_done global_id 7784 payload 824 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient: _finish_hunting 0 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:08:52.484+0000 7f11fb80d640 1 monclient: found mon.noname-c 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.871 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: dump: 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: _finish_auth 0 2024-09-12T18:08:52.872 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: dump: 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.873 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:08:52.484+0000 7f10deffd640 4 set_mon_vals no callback set 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 5 monclient: authenticate success, global_id 7784 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 1 librados: init done 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command cr dump hook 0x5575d6b784c8 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:08:52.488+0000 7f10dd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:08:52.488+0000 7f10dd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:08:52.488+0000 7f10dd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:08:52.488+0000 7f11fb00c640 10 monclient: get_auth_request con 0x7f10c4070ae0 auth_method 0 2024-09-12T18:08:52.874 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:08:52.488+0000 7f11fa80b640 10 monclient: get_auth_request con 0x5575d6b9b7b0 auth_method 0 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 realm 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:08:52.492+0000 7f11fb00c640 10 monclient: get_auth_request con 0x5575d6b9f980 auth_method 0 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:08:52.492+0000 7f11fa80b640 10 monclient: get_auth_request con 0x5575d6ba31e0 auth_method 0 2024-09-12T18:08:52.875 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 searching for the correct realm 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:08:52.496+0000 7f11fb80d640 10 monclient: get_auth_request con 0x5575d69fb1e0 auth_method 0 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:08:52.496+0000 7f11fb00c640 10 monclient: get_auth_request con 0x7f11ec039060 auth_method 0 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:08:52.496+0000 7f11fa80b640 10 monclient: get_auth_request con 0x7f11f00aa9f0 auth_method 0 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:08:52.500+0000 7f11fa80b640 0 -- 172.21.15.97:0/1556425076 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f11f00aa9f0 msgr2=0x7f11f0110950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:08:52.704+0000 7f11fa80b640 10 monclient: get_auth_request con 0x7f11f00aa9f0 auth_method 0 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:08:52.704+0000 7f11fb80d640 10 monclient: get_auth_request con 0x7f11ec008040 auth_method 0 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:08:52.708+0000 7f11fb00c640 10 monclient: get_auth_request con 0x7f11f4062a80 auth_method 0 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:08:52.708+0000 7f11fa80b640 0 -- 172.21.15.97:0/1556425076 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5575d6b9b7b0 msgr2=0x5575d6b9dba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:08:52.708+0000 7f10dd7fa640 1 client.7784.objecter ms_handle_reset 0x5575d6b9b7b0 session 0x5575d6b9b130 osd.6 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:08:52.708+0000 7f10dd7fa640 10 monclient: _renew_subs 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:08:52.708+0000 7f10dd7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.876 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:08:52.708+0000 7f11fa80b640 10 monclient: get_auth_request con 0x7f10c4080600 auth_method 0 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 zone default found 2024-09-12T18:08:52.877 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 4 Realm: () 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 zonegroup default 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 started sync module instance, tier type = 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:52.878 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=0 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=1 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=2 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=3 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=4 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=5 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=6 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 add_watcher() i=7 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding auth protocol: cephx 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding auth protocol: cephx 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding auth protocol: cephx 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.879 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:08:52.756+0000 7f10b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:52.880 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command cache list hook 0x5575d6b78d80 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command cache inspect hook 0x5575d6b78d80 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command cache erase hook 0x5575d6b78d80 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command cache zap hook 0x5575d6b78d80 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 note: GC not initialized 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:08:52.756+0000 7f10b0fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command sync trace show hook 0x7f11ec004570 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command sync trace history hook 0x7f11ec004570 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command sync trace active hook 0x7f11ec004570 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command sync trace active_short hook 0x7f11ec004570 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 Filter name: none 2024-09-12T18:08:52.881 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:08:52.756+0000 7f102a7fc640 20 reqs_thread_entry: start 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:52.882 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 93964602037968 notifier 7784 bl.length()=827 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:08:52.883 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:08:52.788+0000 7f11fd5069c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f11fd5069c0 time 2024-09-12T18:08:52.791027+0000 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1200de02eb] 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1200de049f] 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575d4f290c1] 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x14100ec) [0x5575d597f0ec] 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5575d4f3b18d] 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f11ffc46d90] 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:08:52.884 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:08:52.792+0000 7f11fd5069c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f11fd5069c0 thread_name:radosgw-admin 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f11ffc5f520] 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1200de0345] 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1200de049f] 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575d4f290c1] 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x14100ec) [0x5575d597f0ec] 2024-09-12T18:08:52.885 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5575d4f3b18d] 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f11ffc46d90] 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:08:52.886 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:08:52.887 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:08:52.888 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:08:52.889 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:08:52.890 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:08:52.891 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:08:52.892 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 7f102a7fc640 / http_manager 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10b0fe1640 / http_manager 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10b1fe3640 / rgw_dt_lg_renew 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10dd7fa640 / ms_dispatch 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10deffd640 / io_context_pool 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10e5602640 / ms_dispatch 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10e7e07640 / ms_dispatch 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10e960a640 / io_context_pool 2024-09-12T18:08:52.893 INFO:tasks.workunit.client.0.smithi097.stderr: 7f11fa80b640 / msgr-worker-2 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: 7f11fb00c640 / msgr-worker-1 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: 7f11fb80d640 / msgr-worker-0 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: 7f11fc00e640 / io_context_pool 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: 7f11fd5069c0 / radosgw-admin 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.145283.log 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:08:52.468+0000 7f11fb80d640 1 monclient: found mon.noname-a 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:08:52.468+0000 7f11fb80d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:52.894 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: dump: 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: _finish_auth 0 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: _check_auth_tickets 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:52.895 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:08:52.468+0000 7f10e960a640 10 monclient: dump: 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.896 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 monclient: authenticate success, global_id 8301 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 4 set_mon_vals no callback set 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: shutdown 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) unregister_commands rotate-key 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: build_initial_monmap 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: monmap: 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.897 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding auth protocol: cephx 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding auth protocol: cephx 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding auth protocol: cephx 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.898 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.899 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.899 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.899 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: crc 2024-09-12T18:08:52.899 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab78c0) adding con mode: secure 2024-09-12T18:08:52.899 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.899 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 librados: starting msgr at 2024-09-12T18:08:52.899 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 librados: starting objecter 2024-09-12T18:08:52.899 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command objecter_requests hook 0x5575d684f100 2024-09-12T18:08:52.899 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 librados: setting wanted keys 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 librados: calling monclient init 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: init 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding auth protocol: cephx 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding auth protocol: cephx 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding auth protocol: cephx 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.900 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: crc 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6ab2280) adding con mode: secure 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command rotate-key hook 0x5575d6ab23c8 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-a con 0x5575d69622b0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-c con 0x5575d69fddb0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-b con 0x5575d6ab5850 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:52.901 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient(hunting): authenticate will time out at 2961.881990s 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): get_auth_request con 0x5575d69fddb0 auth_method 0 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): get_auth_request con 0x5575d69622b0 auth_method 0 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.902 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:08:52.468+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:08:52.468+0000 7f11fb80d640 10 monclient(hunting): get_auth_request con 0x5575d6ab5850 auth_method 0 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:08:52.468+0000 7f11fb80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:08:52.468+0000 7f11fb80d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:08:52.468+0000 7f11fb80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient(hunting): handle_auth_done global_id 7775 payload 824 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient: _finish_hunting 0 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:08:52.468+0000 7f11fa80b640 1 monclient: found mon.noname-c 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:08:52.468+0000 7f11fa80b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.903 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: dump: 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.904 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: _finish_auth 0 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: _check_auth_tickets 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:08:52.468+0000 7f10e7e07640 10 monclient: dump: 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.905 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 5 monclient: authenticate success, global_id 7775 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:08:52.468+0000 7f10e960a640 4 set_mon_vals no callback set 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:08:52.468+0000 7f11fd5069c0 1 librados: init done 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:08:52.472+0000 7f10e7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:08:52.472+0000 7f10e7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.906 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:08:52.472+0000 7f10e7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:08:52.472+0000 7f11fb00c640 10 monclient: get_auth_request con 0x7f10e0070b10 auth_method 0 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:08:52.472+0000 7f11fb80d640 10 monclient: get_auth_request con 0x5575d6aed840 auth_method 0 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:08:52.472+0000 7f11fb00c640 10 monclient: get_auth_request con 0x5575d6afcfe0 auth_method 0 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:08:52.476+0000 7f11fa80b640 10 monclient: get_auth_request con 0x5575d6b01340 auth_method 0 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 10 monclient: build_initial_monmap 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 10 monclient: monmap: 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.907 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding auth protocol: cephx 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding auth protocol: cephx 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding auth protocol: cephx 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.908 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: crc 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b060f0) adding con mode: secure 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command objecter_requests cmddesc objecter_requests hook 0x5575d6b09a50 EEXIST 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 10 monclient: init 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding auth protocol: cephx 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding auth protocol: cephx 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding auth protocol: cephx 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.909 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: crc 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b04758) adding con mode: secure 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:08:52.476+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command rotate-key cmddesc rotate-key hook 0x5575d6b048a0 EEXIST 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:52.910 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-a con 0x5575d6b2dc00 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-b con 0x5575d6b2d530 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-c con 0x5575d6b2bf10 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient(hunting): authenticate will time out at 2961.892218s 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): get_auth_request con 0x5575d6b2dc00 auth_method 0 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): get_auth_request con 0x5575d6b2bf10 auth_method 0 2024-09-12T18:08:52.911 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.912 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.912 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.912 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.912 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.912 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.912 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.912 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.912 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:08:52.480+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.912 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient(hunting): handle_auth_done global_id 8307 payload 824 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient: _finish_hunting 0 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:08:52.480+0000 7f11fb00c640 1 monclient: found mon.noname-a 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:08:52.480+0000 7f11fb00c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:08:52.480+0000 7f11fa80b640 10 monclient: get_auth_request con 0x5575d6b2d530 auth_method 0 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: dump: 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.913 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: _finish_auth 0 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: _check_auth_tickets 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 monclient: authenticate success, global_id 8307 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:08:52.480+0000 7f10e5602640 10 monclient: dump: 2024-09-12T18:08:52.914 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:08:52.480+0000 7f11fc00e640 4 set_mon_vals no callback set 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:52.915 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:08:52.480+0000 7f10e5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:08:52.480+0000 7f10e5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:08:52.480+0000 7f10e5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:08:52.480+0000 7f11fa80b640 10 monclient: get_auth_request con 0x7f10d4070a20 auth_method 0 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: get_monmap_and_config 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: build_initial_monmap 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: monmap: 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:52.916 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding auth protocol: cephx 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding auth protocol: cephx 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding auth protocol: cephx 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.917 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.918 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.918 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.918 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.918 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.918 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.918 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: crc 2024-09-12T18:08:52.918 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b4d560) adding con mode: secure 2024-09-12T18:08:52.918 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.918 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 10 monclient: init 2024-09-12T18:08:52.918 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding auth protocol: cephx 2024-09-12T18:08:52.918 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding auth protocol: cephx 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding auth protocol: cephx 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: crc 2024-09-12T18:08:52.919 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:08:52.480+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19690) adding con mode: secure 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd58a197d8 EEXIST 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-c con 0x5575d6b81ae0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-a con 0x5575d6b51500 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-b con 0x5575d6b7d2b0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): authenticate will time out at 2961.896453s 2024-09-12T18:08:52.920 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): get_auth_request con 0x5575d6b81ae0 auth_method 0 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): get_auth_request con 0x5575d6b51500 auth_method 0 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.921 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): handle_auth_done global_id 7781 payload 274 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient: _finish_hunting 0 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:08:52.484+0000 7f11fb00c640 1 monclient: found mon.noname-c 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: dump: 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.922 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: _finish_auth 0 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: _check_auth_tickets 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 monclient: authenticate success, global_id 7781 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: get_monmap_and_config success 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 4 set_mon_vals no callback set 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:08:52.484+0000 7f10deffd640 10 monclient: dump: 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.923 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: shutdown 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: build_initial_monmap 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 1 build_initial for_mkfs: 0 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: monmap: 2024-09-12T18:08:52.924 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding auth protocol: cephx 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding auth protocol: cephx 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding auth protocol: cephx 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.925 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: crc 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b73f40) adding con mode: secure 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.926 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 1 librados: starting msgr at 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 1 librados: starting objecter 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command objecter_requests cmddesc objecter_requests hook 0x5575d6b821d0 EEXIST 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 1 librados: setting wanted keys 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 1 librados: calling monclient init 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: init 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding auth protocol: cephx 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding auth protocol: cephx 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding auth protocol: cephx 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.927 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: crc 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 AuthRegistry(0x5575d6b2fa20) adding con mode: secure 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command rotate-key cmddesc rotate-key hook 0x5575d6b2fb68 EEXIST 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: _reopen_session rank -1 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-b con 0x5575d6b51500 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:08:52.928 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-a con 0x5575d6b7d2b0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): picked mon.noname-c con 0x5575d6b81ae0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): _renew_subs 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:08:52.484+0000 7f11fd5069c0 10 monclient(hunting): authenticate will time out at 2961.899047s 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): get_auth_request con 0x5575d6b81ae0 auth_method 0 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): get_auth_request con 0x5575d6b7d2b0 auth_method 0 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.929 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:08:52.484+0000 7f11fa80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): get_auth_request con 0x5575d6b51500 auth_method 0 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:08:52.484+0000 7f11fb00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient(hunting): handle_auth_done global_id 7784 payload 824 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient: _finish_hunting 0 2024-09-12T18:08:52.930 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:08:52.484+0000 7f11fb80d640 1 monclient: found mon.noname-c 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:08:52.484+0000 7f11fb80d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: dump: 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.931 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: _finish_auth 0 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:08:52.484+0000 7f10dd7fa640 10 monclient: dump: 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:08:52.932 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:08:52.484+0000 7f10deffd640 4 set_mon_vals no callback set 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 5 monclient: authenticate success, global_id 7784 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 10 monclient: _renew_subs 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 1 librados: init done 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command cr dump hook 0x5575d6b784c8 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:08:52.488+0000 7f10dd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:08:52.933 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:08:52.488+0000 7f10dd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:08:52.488+0000 7f10dd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:08:52.488+0000 7f11fb00c640 10 monclient: get_auth_request con 0x7f10c4070ae0 auth_method 0 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:08:52.488+0000 7f11fa80b640 10 monclient: get_auth_request con 0x5575d6b9b7b0 auth_method 0 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 realm 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:08:52.488+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:08:52.492+0000 7f11fb00c640 10 monclient: get_auth_request con 0x5575d6b9f980 auth_method 0 2024-09-12T18:08:52.934 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:08:52.492+0000 7f11fa80b640 10 monclient: get_auth_request con 0x5575d6ba31e0 auth_method 0 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:08:52.492+0000 7f11fd5069c0 20 searching for the correct realm 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:08:52.496+0000 7f11fb80d640 10 monclient: get_auth_request con 0x5575d69fb1e0 auth_method 0 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:08:52.496+0000 7f11fb00c640 10 monclient: get_auth_request con 0x7f11ec039060 auth_method 0 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:08:52.496+0000 7f11fa80b640 10 monclient: get_auth_request con 0x7f11f00aa9f0 auth_method 0 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:08:52.500+0000 7f11fa80b640 0 -- 172.21.15.97:0/1556425076 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f11f00aa9f0 msgr2=0x7f11f0110950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:08:52.704+0000 7f11fa80b640 10 monclient: get_auth_request con 0x7f11f00aa9f0 auth_method 0 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:08:52.704+0000 7f11fb80d640 10 monclient: get_auth_request con 0x7f11ec008040 auth_method 0 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:08:52.708+0000 7f11fb00c640 10 monclient: get_auth_request con 0x7f11f4062a80 auth_method 0 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:08:52.708+0000 7f11fa80b640 0 -- 172.21.15.97:0/1556425076 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5575d6b9b7b0 msgr2=0x5575d6b9dba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:08:52.708+0000 7f10dd7fa640 1 client.7784.objecter ms_handle_reset 0x5575d6b9b7b0 session 0x5575d6b9b130 osd.6 2024-09-12T18:08:52.935 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:08:52.708+0000 7f10dd7fa640 10 monclient: _renew_subs 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:08:52.708+0000 7f10dd7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:08:52.708+0000 7f11fa80b640 10 monclient: get_auth_request con 0x7f10c4080600 auth_method 0 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:08:52.720+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:52.936 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 zone default found 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 4 Realm: () 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 zonegroup default 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.937 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 started sync module instance, tier type = 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:08:52.724+0000 7f11fd5069c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=0 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=1 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=2 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=3 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=4 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=5 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:08:52.748+0000 7f11fd5069c0 20 add_watcher() i=6 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 add_watcher() i=7 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding auth protocol: cephx 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding auth protocol: cephx 2024-09-12T18:08:52.938 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding auth protocol: cephx 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: crc 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 AuthRegistry(0x7ffd58a19b60) adding con mode: secure 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:08:52.756+0000 7f10b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:52.939 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command cache list hook 0x5575d6b78d80 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command cache inspect hook 0x5575d6b78d80 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command cache erase hook 0x5575d6b78d80 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command cache zap hook 0x5575d6b78d80 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 note: GC not initialized 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:08:52.756+0000 7f10b0fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command sync trace show hook 0x7f11ec004570 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command sync trace history hook 0x7f11ec004570 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command sync trace active hook 0x7f11ec004570 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 5 asok(0x5575d68a52b0) register_command sync trace active_short hook 0x7f11ec004570 2024-09-12T18:08:52.940 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 Filter name: none 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:08:52.756+0000 7f102a7fc640 20 reqs_thread_entry: start 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:08:52.756+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:52.941 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:08:52.760+0000 7f11fd5069c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 93964602037968 notifier 7784 bl.length()=827 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:08:52.776+0000 7f10deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:08:52.942 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:08:52.776+0000 7f11fd5069c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:08:52.788+0000 7f11fd5069c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f11fd5069c0 time 2024-09-12T18:08:52.791027+0000 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1200de02eb] 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1200de049f] 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575d4f290c1] 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0x14100ec) [0x5575d597f0ec] 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5575d4f3b18d] 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f11ffc46d90] 2024-09-12T18:08:52.943 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:08:52.792+0000 7f11fd5069c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f11fd5069c0 thread_name:radosgw-admin 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f11ffc5f520] 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1200de0345] 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1200de049f] 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575d4f290c1] 2024-09-12T18:08:52.944 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0x14100ec) [0x5575d597f0ec] 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5575d4f3b18d] 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f11ffc46d90] 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:08:52.945 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:08:52.946 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:08:52.947 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:08:52.948 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:08:52.949 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:08:52.950 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:08:52.951 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7f102a7fc640 / http_manager 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10b0fe1640 / http_manager 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10b1fe3640 / rgw_dt_lg_renew 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10dd7fa640 / ms_dispatch 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10deffd640 / io_context_pool 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10e5602640 / ms_dispatch 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10e7e07640 / ms_dispatch 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7f10e960a640 / io_context_pool 2024-09-12T18:08:52.952 INFO:tasks.workunit.client.0.smithi097.stderr: 7f11fa80b640 / msgr-worker-2 2024-09-12T18:08:52.953 INFO:tasks.workunit.client.0.smithi097.stderr: 7f11fb00c640 / msgr-worker-1 2024-09-12T18:08:52.953 INFO:tasks.workunit.client.0.smithi097.stderr: 7f11fb80d640 / msgr-worker-0 2024-09-12T18:08:52.953 INFO:tasks.workunit.client.0.smithi097.stderr: 7f11fc00e640 / io_context_pool 2024-09-12T18:08:52.953 INFO:tasks.workunit.client.0.smithi097.stderr: 7f11fd5069c0 / radosgw-admin 2024-09-12T18:08:52.953 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:08:52.953 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:08:52.953 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:08:52.797958Z_0b9ad370-09ce-4065-a7d3-4153b8181180/log 2024-09-12T18:08:52.953 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:08:52.953 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:08:52.953 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:08:52.958 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:52.958 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.888+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.888+0000 7f8c54f1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.888+0000 7f8c54f1b9c0 20 realm 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.888+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.888+0000 7f8c54f1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.888+0000 7f8c54f1b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.888+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.888+0000 7f8c54f1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.888+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.892+0000 7f8c54f1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.892+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.892+0000 7f8c54f1b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.892+0000 7f8c54f1b9c0 20 searching for the correct realm 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.900+0000 7f8c53222640 0 -- 172.21.15.97:0/1247445340 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f8c48015070 msgr2=0x7f8c4805c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.904+0000 7f8c52a21640 0 -- 172.21.15.97:0/1247445340 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f8c4c0d7450 msgr2=0x7f8c4c0d78d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 zone default found 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 4 Realm: () 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 zonegroup default 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.912+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.916+0000 7f8c54f1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.916+0000 7f8c54f1b9c0 20 started sync module instance, tier type = 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.916+0000 7f8c54f1b9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.932+0000 7f8c54f1b9c0 20 add_watcher() i=0 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.932+0000 7f8c54f1b9c0 20 add_watcher() i=1 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.932+0000 7f8c54f1b9c0 20 add_watcher() i=2 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.932+0000 7f8c54f1b9c0 20 add_watcher() i=3 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.932+0000 7f8c54f1b9c0 20 add_watcher() i=4 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.932+0000 7f8c54f1b9c0 20 add_watcher() i=5 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.936+0000 7f8c54f1b9c0 20 add_watcher() i=6 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.936+0000 7f8c54f1b9c0 20 add_watcher() i=7 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.936+0000 7f8c54f1b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8b09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:52.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 5 note: GC not initialized 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8b08fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 20 Filter name: none 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8b01ffb640 20 reqs_thread_entry: start 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.940+0000 7f8c54f1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:08:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:08:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.944+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:08:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:08:52.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:08:52.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:08:52.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:08:52.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.948+0000 7f8c54f1b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:08:52.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.952+0000 7f8b09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:52.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.956+0000 7f8c54f1b9c0 20 remove_watcher() i=0 2024-09-12T18:08:52.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.956+0000 7f8c54f1b9c0 2 removed watcher, disabling cache 2024-09-12T18:08:52.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.956+0000 7f8c54f1b9c0 20 remove_watcher() i=1 2024-09-12T18:08:52.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.960+0000 7f8c54f1b9c0 20 remove_watcher() i=2 2024-09-12T18:08:52.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.960+0000 7f8c54f1b9c0 20 remove_watcher() i=3 2024-09-12T18:08:52.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.964+0000 7f8c54f1b9c0 20 remove_watcher() i=4 2024-09-12T18:08:52.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.964+0000 7f8c54f1b9c0 20 remove_watcher() i=5 2024-09-12T18:08:52.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.968+0000 7f8c54f1b9c0 20 remove_watcher() i=6 2024-09-12T18:08:52.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:08:52.972+0000 7f8c54f1b9c0 20 remove_watcher() i=7 2024-09-12T18:08:52.987 INFO:tasks.workunit.client.0.smithi097.stderr: test: duplicated entries can be purged manually 2024-09-12T18:09:23.018 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:09:23.051 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:23.051 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:23.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.099+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.099+0000 7f8e633ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.099+0000 7f8e633ad9c0 20 realm 2024-09-12T18:09:23.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.099+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.103+0000 7f8e633ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.103+0000 7f8e633ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:23.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.103+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.103+0000 7f8e633ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.103+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.103+0000 7f8e633ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:23.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.103+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.103+0000 7f8e633ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:23.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.103+0000 7f8e633ad9c0 20 searching for the correct realm 2024-09-12T18:09:23.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.107+0000 7f8e60eb3640 0 -- 172.21.15.97:0/4196823532 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f8e500c1040 msgr2=0x7f8e500e9920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:23.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.115+0000 7f8e60eb3640 0 -- 172.21.15.97:0/4196823532 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f8e5807ce50 msgr2=0x7f8e5807b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:23.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:23.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 zone default found 2024-09-12T18:09:23.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 4 Realm: () 2024-09-12T18:09:23.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:23.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:23.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:23.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 zonegroup default 2024-09-12T18:09:23.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.335+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.339+0000 7f8e633ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.339+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.339+0000 7f8e633ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.339+0000 7f8e633ad9c0 20 started sync module instance, tier type = 2024-09-12T18:09:23.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.339+0000 7f8e633ad9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:23.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.363+0000 7f8e633ad9c0 20 add_watcher() i=0 2024-09-12T18:09:23.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.363+0000 7f8e633ad9c0 20 add_watcher() i=1 2024-09-12T18:09:23.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.363+0000 7f8e633ad9c0 20 add_watcher() i=2 2024-09-12T18:09:23.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.363+0000 7f8e633ad9c0 20 add_watcher() i=3 2024-09-12T18:09:23.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.363+0000 7f8e633ad9c0 20 add_watcher() i=4 2024-09-12T18:09:23.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.363+0000 7f8e633ad9c0 20 add_watcher() i=5 2024-09-12T18:09:23.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.363+0000 7f8e633ad9c0 20 add_watcher() i=6 2024-09-12T18:09:23.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.363+0000 7f8e633ad9c0 20 add_watcher() i=7 2024-09-12T18:09:23.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.363+0000 7f8e633ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:23.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8d177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:23.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8e633ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:23.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8e633ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:23.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8e633ad9c0 5 note: GC not initialized 2024-09-12T18:09:23.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8d167e4640 20 reqs_thread_entry: start 2024-09-12T18:09:23.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8e633ad9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:23.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8e633ad9c0 20 Filter name: none 2024-09-12T18:09:23.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8d0ffff640 20 reqs_thread_entry: start 2024-09-12T18:09:23.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8e633ad9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:23.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8e633ad9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:23.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8e633ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:23.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.371+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.375+0000 7f8e633ad9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:23.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.375+0000 7f8e633ad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.375+0000 7f8e633ad9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:23.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.375+0000 7f8e633ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:23.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.379+0000 7f8d177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:23.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.383+0000 7f8e633ad9c0 20 remove_watcher() i=0 2024-09-12T18:09:23.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.383+0000 7f8e633ad9c0 2 removed watcher, disabling cache 2024-09-12T18:09:23.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.383+0000 7f8e633ad9c0 20 remove_watcher() i=1 2024-09-12T18:09:23.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.387+0000 7f8e633ad9c0 20 remove_watcher() i=2 2024-09-12T18:09:23.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.391+0000 7f8e633ad9c0 20 remove_watcher() i=3 2024-09-12T18:09:23.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.391+0000 7f8e633ad9c0 20 remove_watcher() i=4 2024-09-12T18:09:23.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.395+0000 7f8e633ad9c0 20 remove_watcher() i=5 2024-09-12T18:09:23.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.395+0000 7f8e633ad9c0 20 remove_watcher() i=6 2024-09-12T18:09:23.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.399+0000 7f8e633ad9c0 20 remove_watcher() i=7 2024-09-12T18:09:23.415 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.415 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:09:23.415 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 98539659-fdaf-41ce-847d-239ff89323af.4641.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T18:09:23.415 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.416 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:09:23.447 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:23.447 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:23.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.491+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.491+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.491+0000 7f57593649c0 20 realm 2024-09-12T18:09:23.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.491+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.495+0000 7f57593649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:23.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:23.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:23.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.495+0000 7f57593649c0 20 searching for the correct realm 2024-09-12T18:09:23.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.499+0000 7f5756669640 0 -- 172.21.15.97:0/3398691383 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f574c0b8950 msgr2=0x7f574c0cb410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:23.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.507+0000 7f5756669640 0 -- 172.21.15.97:0/3398691383 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5564f9603df0 msgr2=0x5564f9606290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:23.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:23.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:23.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:23.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:23.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 zone default found 2024-09-12T18:09:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 4 Realm: () 2024-09-12T18:09:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 zonegroup default 2024-09-12T18:09:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.519+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.519+0000 7f57593649c0 20 started sync module instance, tier type = 2024-09-12T18:09:23.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.519+0000 7f57593649c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:23.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=0 2024-09-12T18:09:23.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=1 2024-09-12T18:09:23.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=2 2024-09-12T18:09:23.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=3 2024-09-12T18:09:23.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=4 2024-09-12T18:09:23.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=5 2024-09-12T18:09:23.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=6 2024-09-12T18:09:23.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.539+0000 7f57593649c0 20 add_watcher() i=7 2024-09-12T18:09:23.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.539+0000 7f57593649c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:23.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.539+0000 7f560d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:23.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:23.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:23.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 5 note: GC not initialized 2024-09-12T18:09:23.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f5587fff640 20 reqs_thread_entry: start 2024-09-12T18:09:23.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:23.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 20 Filter name: none 2024-09-12T18:09:23.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f5585ffb640 20 reqs_thread_entry: start 2024-09-12T18:09:23.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:09:23.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:23.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:09:23.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:09:23.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:09:23.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:23.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:23.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:23.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:23.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:23.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:09:23.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.543+0000 7f57593649c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:09:23.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f57593649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:23.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f57593649c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:23.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f57593649c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:23.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f57593649c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:09:23.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 93892168933552 notifier 8373 bl.length()=827 2024-09-12T18:09:23.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:23.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:23.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:23.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:09:23.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:09:23.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:09:23.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:09:23.573 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f57593649c0 time 2024-09-12T18:09:23.575066+0000 2024-09-12T18:09:23.573 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:09:23.574 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:09:23.574 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f575cc3e2eb] 2024-09-12T18:09:23.574 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f575cc3e49f] 2024-09-12T18:09:23.574 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5564f6a6d0c1] 2024-09-12T18:09:23.575 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5564f6a7f1fa] 2024-09-12T18:09:23.575 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:09:23.575 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f575baa4d90] 2024-09-12T18:09:23.575 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:09:23.575 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:09:23.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.575+0000 7f57593649c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f57593649c0 time 2024-09-12T18:09:23.575066+0000 2024-09-12T18:09:23.576 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:09:23.576 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.576 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:09:23.576 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f575cc3e2eb] 2024-09-12T18:09:23.576 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f575cc3e49f] 2024-09-12T18:09:23.577 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5564f6a6d0c1] 2024-09-12T18:09:23.577 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5564f6a7f1fa] 2024-09-12T18:09:23.577 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:09:23.577 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f575baa4d90] 2024-09-12T18:09:23.577 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:09:23.578 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:09:23.578 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.578 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:09:23.578 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f57593649c0 thread_name:radosgw-admin 2024-09-12T18:09:23.623 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:09:23.623 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f575babd520] 2024-09-12T18:09:23.623 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:09:23.623 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:09:23.623 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:09:23.623 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f575cc3e345] 2024-09-12T18:09:23.623 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f575cc3e49f] 2024-09-12T18:09:23.623 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5564f6a6d0c1] 2024-09-12T18:09:23.623 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5564f6a7f1fa] 2024-09-12T18:09:23.623 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:09:23.623 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f575baa4d90] 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.575+0000 7f57593649c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f57593649c0 thread_name:radosgw-admin 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f575babd520] 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f575cc3e345] 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f575cc3e49f] 2024-09-12T18:09:23.624 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5564f6a6d0c1] 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5564f6a7f1fa] 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f575baa4d90] 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:09:23.467+0000 7f5756e6a640 1 monclient: found mon.noname-c 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:09:23.467+0000 7f5756e6a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:09:23.625 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: dump: 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: _finish_auth 0 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: _check_auth_tickets 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:09:23.467+0000 7f57593649c0 5 monclient: authenticate success, global_id 7820 2024-09-12T18:09:23.626 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:09:23.467+0000 7f57593649c0 10 monclient: get_monmap_and_config success 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:09:23.467+0000 7f57593649c0 4 set_mon_vals no callback set 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: dump: 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.627 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: shutdown 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 asok(0x5564f93102b0) unregister_commands rotate-key 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: build_initial_monmap 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 build_initial for_mkfs: 0 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: monmap: 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.628 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding auth protocol: cephx 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding auth protocol: cephx 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding auth protocol: cephx 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.629 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:09:23.471+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 librados: starting msgr at 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 librados: starting objecter 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command objecter_requests hook 0x5564f951f610 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 librados: setting wanted keys 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 librados: calling monclient init 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: init 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding auth protocol: cephx 2024-09-12T18:09:23.630 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding auth protocol: cephx 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding auth protocol: cephx 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.631 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:09:23.471+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:09:23.471+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command rotate-key hook 0x5564f951b208 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _reopen_session rank -1 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-b con 0x5564f93cad60 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-c con 0x5564f93cb140 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-a con 0x5564f93d4710 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): _renew_subs 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): authenticate will time out at 2992.881890s 2024-09-12T18:09:23.632 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): get_auth_request con 0x5564f93cb140 auth_method 0 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): get_auth_request con 0x5564f93d4710 auth_method 0 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.633 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): handle_auth_done global_id 8364 payload 824 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient: _finish_hunting 0 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:09:23.471+0000 7f575766b640 1 monclient: found mon.noname-a 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: dump: 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.634 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: _finish_auth 0 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: _check_auth_tickets 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: dump: 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.635 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:09:23.471+0000 7f5644e09640 4 set_mon_vals no callback set 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 monclient: authenticate success, global_id 8364 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 librados: init done 2024-09-12T18:09:23.636 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:09:23.475+0000 7f5643606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:09:23.475+0000 7f5643606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:09:23.475+0000 7f5643606640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:09:23.475+0000 7f5756e6a640 10 monclient: get_auth_request con 0x7f563c070ae0 auth_method 0 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:09:23.475+0000 7f5756669640 10 monclient: get_auth_request con 0x5564f95237f0 auth_method 0 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:09:23.475+0000 7f5756e6a640 10 monclient: get_auth_request con 0x5564f9565c70 auth_method 0 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:09:23.479+0000 7f5756669640 10 monclient: get_auth_request con 0x5564f9569fd0 auth_method 0 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:09:23.479+0000 7f57593649c0 10 monclient: build_initial_monmap 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:09:23.479+0000 7f57593649c0 1 build_initial for_mkfs: 0 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:09:23.479+0000 7f57593649c0 10 monclient: monmap: 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:09:23.637 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding auth protocol: cephx 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding auth protocol: cephx 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding auth protocol: cephx 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.638 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:09:23.479+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command objecter_requests cmddesc objecter_requests hook 0x5564f95727f0 EEXIST 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:09:23.479+0000 7f57593649c0 10 monclient: init 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding auth protocol: cephx 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding auth protocol: cephx 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding auth protocol: cephx 2024-09-12T18:09:23.639 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:09:23.479+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.640 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:09:23.483+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command rotate-key cmddesc rotate-key hook 0x5564f956d6a0 EEXIST 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _reopen_session rank -1 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-c con 0x5564f95969a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-b con 0x5564f95962d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-a con 0x5564f9594cb0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): _renew_subs 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): authenticate will time out at 2992.892288s 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): get_auth_request con 0x5564f95969a0 auth_method 0 2024-09-12T18:09:23.641 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): get_auth_request con 0x5564f9594cb0 auth_method 0 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:09:23.483+0000 7f5756669640 10 monclient(hunting): get_auth_request con 0x5564f95962d0 auth_method 0 2024-09-12T18:09:23.642 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:09:23.483+0000 7f5756669640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:09:23.483+0000 7f5756669640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:09:23.483+0000 7f5756669640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient: _finish_hunting 0 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:09:23.483+0000 7f5756e6a640 1 monclient: found mon.noname-c 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: dump: 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.643 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: _finish_auth 0 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: _check_auth_tickets 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: dump: 2024-09-12T18:09:23.644 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 monclient: authenticate success, global_id 7826 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:09:23.483+0000 7f5757e6c640 4 set_mon_vals no callback set 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:09:23.645 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:09:23.483+0000 7f5640e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:09:23.483+0000 7f5640e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:09:23.483+0000 7f5640e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:09:23.483+0000 7f5756669640 10 monclient: get_auth_request con 0x7f5630070a20 auth_method 0 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: get_monmap_and_config 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: build_initial_monmap 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:09:23.483+0000 7f57593649c0 1 build_initial for_mkfs: 0 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: monmap: 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:09:23.646 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding auth protocol: cephx 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding auth protocol: cephx 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding auth protocol: cephx 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.647 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:09:23.483+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: init 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding auth protocol: cephx 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding auth protocol: cephx 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding auth protocol: cephx 2024-09-12T18:09:23.648 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:09:23.487+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:09:23.487+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.649 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdf621cd48 EEXIST 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _reopen_session rank -1 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-a con 0x5564f95ea2d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-b con 0x5564f95b9e40 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-c con 0x5564f95dad50 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): _renew_subs 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): authenticate will time out at 2992.896377s 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): get_auth_request con 0x5564f95ea2d0 auth_method 0 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.650 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): get_auth_request con 0x5564f95dad50 auth_method 0 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): handle_auth_done global_id 8370 payload 274 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient: _finish_hunting 0 2024-09-12T18:09:23.651 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:09:23.487+0000 7f5756e6a640 1 monclient: found mon.noname-a 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: dump: 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.652 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: _finish_auth 0 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 monclient: authenticate success, global_id 8370 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: get_monmap_and_config success 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:09:23.487+0000 7f57593649c0 4 set_mon_vals no callback set 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: dump: 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.653 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: shutdown 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: build_initial_monmap 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 build_initial for_mkfs: 0 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: monmap: 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:09:23.654 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding auth protocol: cephx 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding auth protocol: cephx 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding auth protocol: cephx 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.655 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:09:23.487+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 librados: starting msgr at 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 librados: starting objecter 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command objecter_requests cmddesc objecter_requests hook 0x5564f959b560 EEXIST 2024-09-12T18:09:23.656 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 librados: setting wanted keys 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 librados: calling monclient init 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: init 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding auth protocol: cephx 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding auth protocol: cephx 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding auth protocol: cephx 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.657 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:09:23.487+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:09:23.487+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command rotate-key cmddesc rotate-key hook 0x5564f9598908 EEXIST 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _reopen_session rank -1 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-b con 0x5564f95b9e40 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-c con 0x5564f95dad50 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-a con 0x5564f95ea2d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.658 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): _renew_subs 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): authenticate will time out at 2992.898885s 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): get_auth_request con 0x5564f95dad50 auth_method 0 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): get_auth_request con 0x5564f95ea2d0 auth_method 0 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.659 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): get_auth_request con 0x5564f95b9e40 auth_method 0 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_done global_id 8373 payload 824 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient: _finish_hunting 0 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:09:23.487+0000 7f575766b640 1 monclient: found mon.noname-a 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:09:23.660 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: dump: 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: _finish_auth 0 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:09:23.661 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: dump: 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.662 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 monclient: authenticate success, global_id 8373 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:09:23.487+0000 7f563a7fc640 4 set_mon_vals no callback set 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 librados: init done 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command cr dump hook 0x5564f95da278 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:09:23.491+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:09:23.491+0000 7f5638ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:09:23.491+0000 7f5638ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:09:23.491+0000 7f5638ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:09:23.491+0000 7f5756e6a640 10 monclient: get_auth_request con 0x7f5620070ae0 auth_method 0 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:09:23.491+0000 7f5756669640 10 monclient: get_auth_request con 0x5564f9603df0 auth_method 0 2024-09-12T18:09:23.663 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:09:23.491+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:09:23.491+0000 7f57593649c0 20 realm 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:09:23.491+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:09:23.495+0000 7f57593649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:09:23.495+0000 7f5756e6a640 10 monclient: get_auth_request con 0x5564f9608180 auth_method 0 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:09:23.495+0000 7f5756669640 10 monclient: get_auth_request con 0x5564f960b8c0 auth_method 0 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:23.664 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 searching for the correct realm 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:09:23.495+0000 7f575766b640 10 monclient: get_auth_request con 0x7f574c0ac030 auth_method 0 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:09:23.499+0000 7f5756e6a640 10 monclient: get_auth_request con 0x7f5748008070 auth_method 0 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:09:23.499+0000 7f5756669640 10 monclient: get_auth_request con 0x7f574c0b8950 auth_method 0 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:09:23.499+0000 7f5756669640 0 -- 172.21.15.97:0/3398691383 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f574c0b8950 msgr2=0x7f574c0cb410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:09:23.499+0000 7f5638ff9640 1 client.8373.objecter ms_handle_reset 0x7f574c0b8950 session 0x7f574c0e4310 osd.5 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:09:23.499+0000 7f5638ff9640 10 monclient: _renew_subs 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:09:23.499+0000 7f5638ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:09:23.503+0000 7f5756669640 10 monclient: get_auth_request con 0x7f5620080600 auth_method 0 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:09:23.503+0000 7f575766b640 10 monclient: get_auth_request con 0x7f57480912b0 auth_method 0 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:09:23.507+0000 7f5756e6a640 10 monclient: get_auth_request con 0x7f575007b450 auth_method 0 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:09:23.507+0000 7f5756669640 0 -- 172.21.15.97:0/3398691383 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5564f9603df0 msgr2=0x5564f9606290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:09:23.507+0000 7f5638ff9640 1 client.8373.objecter ms_handle_reset 0x5564f9603df0 session 0x5564f9603770 osd.6 2024-09-12T18:09:23.665 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:09:23.507+0000 7f5756669640 10 monclient: get_auth_request con 0x7f574c0b8950 auth_method 0 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 zone default found 2024-09-12T18:09:23.666 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:09:23.515+0000 7f57593649c0 4 Realm: () 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:09:23.515+0000 7f57593649c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:09:23.515+0000 7f57593649c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:09:23.515+0000 7f57593649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 zonegroup default 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:09:23.519+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:09:23.519+0000 7f57593649c0 20 started sync module instance, tier type = 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:09:23.519+0000 7f57593649c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:23.667 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=0 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=1 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=2 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=3 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=4 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=5 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=6 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:09:23.539+0000 7f57593649c0 20 add_watcher() i=7 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:09:23.539+0000 7f57593649c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding auth protocol: cephx 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding auth protocol: cephx 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding auth protocol: cephx 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.668 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:09:23.539+0000 7f560d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:09:23.543+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:23.669 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command cache list hook 0x5564f95daaf0 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command cache inspect hook 0x5564f95daaf0 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command cache erase hook 0x5564f95daaf0 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command cache zap hook 0x5564f95daaf0 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 note: GC not initialized 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:09:23.543+0000 7f5587fff640 20 reqs_thread_entry: start 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command sync trace show hook 0x7f575000e070 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command sync trace history hook 0x7f575000e070 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command sync trace active hook 0x7f575000e070 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command sync trace active_short hook 0x7f575000e070 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 Filter name: none 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:09:23.543+0000 7f5585ffb640 20 reqs_thread_entry: start 2024-09-12T18:09:23.670 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:09:23.671 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:09:23.559+0000 7f57593649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:09:23.559+0000 7f57593649c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:09:23.559+0000 7f57593649c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:09:23.559+0000 7f57593649c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 93892168933552 notifier 8373 bl.length()=827 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:09:23.672 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:09:23.575+0000 7f57593649c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f57593649c0 time 2024-09-12T18:09:23.575066+0000 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f575cc3e2eb] 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f575cc3e49f] 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5564f6a6d0c1] 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5564f6a7f1fa] 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f575baa4d90] 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.673 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:09:23.575+0000 7f57593649c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f57593649c0 thread_name:radosgw-admin 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f575babd520] 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f575cc3e345] 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f575cc3e49f] 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5564f6a6d0c1] 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5564f6a7f1fa] 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f575baa4d90] 2024-09-12T18:09:23.674 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:09:23.675 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:09:23.676 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:09:23.677 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:09:23.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:09:23.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:09:23.680 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:09:23.681 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5585ffb640 / http_manager 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5587fff640 / http_manager 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 7f560d7e2640 / rgw_dt_lg_renew 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5638ff9640 / ms_dispatch 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5639ffb640 / io_context_pool 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 7f563a7fc640 / io_context_pool 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5640e01640 / ms_dispatch 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5643606640 / ms_dispatch 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5644e09640 / io_context_pool 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5756669640 / msgr-worker-2 2024-09-12T18:09:23.682 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5756e6a640 / msgr-worker-1 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr: 7f575766b640 / msgr-worker-0 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5757e6c640 / io_context_pool 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr: 7f57593649c0 / radosgw-admin 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.147054.log 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-12T18:09:23.467+0000 7f5756e6a640 1 monclient: found mon.noname-c 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-12T18:09:23.467+0000 7f5756e6a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: dump: 2024-09-12T18:09:23.683 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: _finish_auth 0 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: _check_auth_tickets 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-12T18:09:23.467+0000 7f57593649c0 5 monclient: authenticate success, global_id 7820 2024-09-12T18:09:23.684 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-12T18:09:23.467+0000 7f57593649c0 10 monclient: get_monmap_and_config success 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-12T18:09:23.467+0000 7f57593649c0 4 set_mon_vals no callback set 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-12T18:09:23.467+0000 7f5644e09640 10 monclient: dump: 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: shutdown 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 asok(0x5564f93102b0) unregister_commands rotate-key 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: build_initial_monmap 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 build_initial for_mkfs: 0 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: monmap: 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:09:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding auth protocol: cephx 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding auth protocol: cephx 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding auth protocol: cephx 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.687 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: crc 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f954bea0) adding con mode: secure 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-12T18:09:23.471+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 librados: starting msgr at 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 librados: starting objecter 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command objecter_requests hook 0x5564f951f610 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 librados: setting wanted keys 2024-09-12T18:09:23.688 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 librados: calling monclient init 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: init 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding auth protocol: cephx 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding auth protocol: cephx 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding auth protocol: cephx 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.689 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: crc 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 AuthRegistry(0x5564f951b0c0) adding con mode: secure 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-12T18:09:23.471+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-12T18:09:23.471+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command rotate-key hook 0x5564f951b208 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _reopen_session rank -1 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-b con 0x5564f93cad60 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-c con 0x5564f93cb140 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-a con 0x5564f93d4710 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.690 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): _renew_subs 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient(hunting): authenticate will time out at 2992.881890s 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): get_auth_request con 0x5564f93cb140 auth_method 0 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): get_auth_request con 0x5564f93d4710 auth_method 0 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.691 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-12T18:09:23.471+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient(hunting): handle_auth_done global_id 8364 payload 824 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient: _finish_hunting 0 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-12T18:09:23.471+0000 7f575766b640 1 monclient: found mon.noname-a 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-12T18:09:23.471+0000 7f575766b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: dump: 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.692 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: _finish_auth 0 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: _check_auth_tickets 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:09:23.693 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-12T18:09:23.471+0000 7f5643606640 10 monclient: dump: 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-12T18:09:23.471+0000 7f5644e09640 4 set_mon_vals no callback set 2024-09-12T18:09:23.694 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-12T18:09:23.471+0000 7f57593649c0 5 monclient: authenticate success, global_id 8364 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-12T18:09:23.471+0000 7f57593649c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-12T18:09:23.471+0000 7f57593649c0 1 librados: init done 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-12T18:09:23.475+0000 7f5643606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-12T18:09:23.475+0000 7f5643606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-12T18:09:23.475+0000 7f5643606640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-12T18:09:23.475+0000 7f5756e6a640 10 monclient: get_auth_request con 0x7f563c070ae0 auth_method 0 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-12T18:09:23.475+0000 7f5756669640 10 monclient: get_auth_request con 0x5564f95237f0 auth_method 0 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-12T18:09:23.475+0000 7f5756e6a640 10 monclient: get_auth_request con 0x5564f9565c70 auth_method 0 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-12T18:09:23.479+0000 7f5756669640 10 monclient: get_auth_request con 0x5564f9569fd0 auth_method 0 2024-09-12T18:09:23.695 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-12T18:09:23.479+0000 7f57593649c0 10 monclient: build_initial_monmap 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-12T18:09:23.479+0000 7f57593649c0 1 build_initial for_mkfs: 0 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-12T18:09:23.479+0000 7f57593649c0 10 monclient: monmap: 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding auth protocol: cephx 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding auth protocol: cephx 2024-09-12T18:09:23.696 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding auth protocol: cephx 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: crc 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956ede0) adding con mode: secure 2024-09-12T18:09:23.697 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-12T18:09:23.479+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command objecter_requests cmddesc objecter_requests hook 0x5564f95727f0 EEXIST 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-12T18:09:23.479+0000 7f57593649c0 10 monclient: init 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding auth protocol: cephx 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding auth protocol: cephx 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding auth protocol: cephx 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.698 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: crc 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-12T18:09:23.479+0000 7f57593649c0 5 AuthRegistry(0x5564f956d558) adding con mode: secure 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-12T18:09:23.479+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-12T18:09:23.483+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command rotate-key cmddesc rotate-key hook 0x5564f956d6a0 EEXIST 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _reopen_session rank -1 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-c con 0x5564f95969a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-b con 0x5564f95962d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-a con 0x5564f9594cb0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.699 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): _renew_subs 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient(hunting): authenticate will time out at 2992.892288s 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): get_auth_request con 0x5564f95969a0 auth_method 0 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): get_auth_request con 0x5564f9594cb0 auth_method 0 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.700 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-12T18:09:23.483+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-12T18:09:23.483+0000 7f5756669640 10 monclient(hunting): get_auth_request con 0x5564f95962d0 auth_method 0 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-12T18:09:23.483+0000 7f5756669640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-12T18:09:23.483+0000 7f5756669640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-12T18:09:23.483+0000 7f5756669640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient: _finish_hunting 0 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-12T18:09:23.483+0000 7f5756e6a640 1 monclient: found mon.noname-c 2024-09-12T18:09:23.701 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-12T18:09:23.483+0000 7f5756e6a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: dump: 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: _finish_auth 0 2024-09-12T18:09:23.702 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: _check_auth_tickets 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-12T18:09:23.483+0000 7f5640e01640 10 monclient: dump: 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.703 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 monclient: authenticate success, global_id 7826 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-12T18:09:23.483+0000 7f5757e6c640 4 set_mon_vals no callback set 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-12T18:09:23.483+0000 7f5640e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-12T18:09:23.483+0000 7f5640e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-12T18:09:23.483+0000 7f5640e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-12T18:09:23.483+0000 7f5756669640 10 monclient: get_auth_request con 0x7f5630070a20 auth_method 0 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: get_monmap_and_config 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: build_initial_monmap 2024-09-12T18:09:23.704 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-12T18:09:23.483+0000 7f57593649c0 1 build_initial for_mkfs: 0 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: monmap: 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.705 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding auth protocol: cephx 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding auth protocol: cephx 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding auth protocol: cephx 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: crc 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x5564f95b5e60) adding con mode: secure 2024-09-12T18:09:23.706 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-12T18:09:23.483+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-12T18:09:23.483+0000 7f57593649c0 10 monclient: init 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding auth protocol: cephx 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding auth protocol: cephx 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding auth protocol: cephx 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.707 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: crc 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-12T18:09:23.483+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621cc00) adding con mode: secure 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-12T18:09:23.487+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-12T18:09:23.487+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdf621cd48 EEXIST 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _reopen_session rank -1 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-a con 0x5564f95ea2d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-b con 0x5564f95b9e40 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-c con 0x5564f95dad50 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.708 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): _renew_subs 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): authenticate will time out at 2992.896377s 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): get_auth_request con 0x5564f95ea2d0 auth_method 0 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): get_auth_request con 0x5564f95dad50 auth_method 0 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.709 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): handle_auth_done global_id 8370 payload 274 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient: _finish_hunting 0 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-12T18:09:23.487+0000 7f5756e6a640 1 monclient: found mon.noname-a 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: dump: 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.710 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: _finish_auth 0 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 monclient: authenticate success, global_id 8370 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: get_monmap_and_config success 2024-09-12T18:09:23.711 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-12T18:09:23.487+0000 7f57593649c0 4 set_mon_vals no callback set 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-12T18:09:23.487+0000 7f563a7fc640 10 monclient: dump: 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.712 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: shutdown 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: build_initial_monmap 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 build_initial for_mkfs: 0 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: monmap: 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-12T18:09:23.713 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding auth protocol: cephx 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding auth protocol: cephx 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding auth protocol: cephx 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.714 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: crc 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95bae80) adding con mode: secure 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-12T18:09:23.487+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 librados: starting msgr at 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 librados: starting objecter 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command objecter_requests cmddesc objecter_requests hook 0x5564f959b560 EEXIST 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 librados: setting wanted keys 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 librados: calling monclient init 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: init 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding auth protocol: cephx 2024-09-12T18:09:23.715 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding auth protocol: cephx 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding auth protocol: cephx 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: crc 2024-09-12T18:09:23.716 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 AuthRegistry(0x5564f95987c0) adding con mode: secure 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-12T18:09:23.487+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-12T18:09:23.487+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command rotate-key cmddesc rotate-key hook 0x5564f9598908 EEXIST 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _reopen_session rank -1 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-b con 0x5564f95b9e40 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-c con 0x5564f95dad50 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): picked mon.noname-a con 0x5564f95ea2d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:09:23.717 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): _renew_subs 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient(hunting): authenticate will time out at 2992.898885s 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): get_auth_request con 0x5564f95dad50 auth_method 0 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): get_auth_request con 0x5564f95ea2d0 auth_method 0 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-12T18:09:23.487+0000 7f5756669640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.718 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): get_auth_request con 0x5564f95b9e40 auth_method 0 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-12T18:09:23.487+0000 7f5756e6a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient(hunting): handle_auth_done global_id 8373 payload 824 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient: _finish_hunting 0 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-12T18:09:23.487+0000 7f575766b640 1 monclient: found mon.noname-a 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-12T18:09:23.487+0000 7f575766b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: dump: 2024-09-12T18:09:23.719 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: _finish_auth 0 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:09:23.720 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-12T18:09:23.487+0000 7f5638ff9640 10 monclient: dump: 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 140363d0-879c-4957-b68a-2ee681f3fbda 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-12T17:35:21.940121+0000 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.721 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 monclient: authenticate success, global_id 8373 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-12T18:09:23.487+0000 7f563a7fc640 4 set_mon_vals no callback set 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _renew_subs 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-12T18:09:23.487+0000 7f57593649c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-12T18:09:23.487+0000 7f57593649c0 1 librados: init done 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-12T18:09:23.487+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command cr dump hook 0x5564f95da278 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-12T18:09:23.491+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-12T18:09:23.491+0000 7f5638ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-12T18:09:23.491+0000 7f5638ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-12T18:09:23.491+0000 7f5638ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/322950205,v1:172.21.15.97:6833/322950205] 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-12T18:09:23.491+0000 7f5756e6a640 10 monclient: get_auth_request con 0x7f5620070ae0 auth_method 0 2024-09-12T18:09:23.722 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-12T18:09:23.491+0000 7f5756669640 10 monclient: get_auth_request con 0x5564f9603df0 auth_method 0 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-12T18:09:23.491+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-12T18:09:23.491+0000 7f57593649c0 20 realm 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-12T18:09:23.491+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-12T18:09:23.495+0000 7f57593649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-12T18:09:23.495+0000 7f5756e6a640 10 monclient: get_auth_request con 0x5564f9608180 auth_method 0 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-12T18:09:23.495+0000 7f5756669640 10 monclient: get_auth_request con 0x5564f960b8c0 auth_method 0 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-12T18:09:23.495+0000 7f57593649c0 20 searching for the correct realm 2024-09-12T18:09:23.723 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-12T18:09:23.495+0000 7f575766b640 10 monclient: get_auth_request con 0x7f574c0ac030 auth_method 0 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-12T18:09:23.499+0000 7f5756e6a640 10 monclient: get_auth_request con 0x7f5748008070 auth_method 0 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-12T18:09:23.499+0000 7f5756669640 10 monclient: get_auth_request con 0x7f574c0b8950 auth_method 0 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-12T18:09:23.499+0000 7f5756669640 0 -- 172.21.15.97:0/3398691383 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f574c0b8950 msgr2=0x7f574c0cb410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-12T18:09:23.499+0000 7f5638ff9640 1 client.8373.objecter ms_handle_reset 0x7f574c0b8950 session 0x7f574c0e4310 osd.5 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-12T18:09:23.499+0000 7f5638ff9640 10 monclient: _renew_subs 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-12T18:09:23.499+0000 7f5638ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-12T18:09:23.503+0000 7f5756669640 10 monclient: get_auth_request con 0x7f5620080600 auth_method 0 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-12T18:09:23.503+0000 7f575766b640 10 monclient: get_auth_request con 0x7f57480912b0 auth_method 0 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-12T18:09:23.507+0000 7f5756e6a640 10 monclient: get_auth_request con 0x7f575007b450 auth_method 0 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-12T18:09:23.507+0000 7f5756669640 0 -- 172.21.15.97:0/3398691383 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5564f9603df0 msgr2=0x5564f9606290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-12T18:09:23.507+0000 7f5638ff9640 1 client.8373.objecter ms_handle_reset 0x5564f9603df0 session 0x5564f9603770 osd.6 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-12T18:09:23.507+0000 7f5756669640 10 monclient: get_auth_request con 0x7f574c0b8950 auth_method 0 2024-09-12T18:09:23.724 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 zone default found 2024-09-12T18:09:23.725 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-12T18:09:23.515+0000 7f57593649c0 4 Realm: () 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-12T18:09:23.515+0000 7f57593649c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-12T18:09:23.515+0000 7f57593649c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-12T18:09:23.515+0000 7f57593649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 zonegroup default 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-12T18:09:23.515+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-12T18:09:23.519+0000 7f57593649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-12T18:09:23.519+0000 7f57593649c0 20 started sync module instance, tier type = 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-12T18:09:23.519+0000 7f57593649c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:23.726 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=0 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=1 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=2 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=3 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=4 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=5 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-12T18:09:23.535+0000 7f57593649c0 20 add_watcher() i=6 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-12T18:09:23.539+0000 7f57593649c0 20 add_watcher() i=7 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-12T18:09:23.539+0000 7f57593649c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding auth protocol: cephx 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding auth protocol: cephx 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding auth protocol: cephx 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.727 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: crc 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-12T18:09:23.539+0000 7f57593649c0 5 AuthRegistry(0x7ffdf621d0d0) adding con mode: secure 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-12T18:09:23.539+0000 7f560d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-12T18:09:23.543+0000 7f57593649c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:09:23.728 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command cache list hook 0x5564f95daaf0 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command cache inspect hook 0x5564f95daaf0 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command cache erase hook 0x5564f95daaf0 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command cache zap hook 0x5564f95daaf0 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 note: GC not initialized 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-12T18:09:23.543+0000 7f5587fff640 20 reqs_thread_entry: start 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command sync trace show hook 0x7f575000e070 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command sync trace history hook 0x7f575000e070 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command sync trace active hook 0x7f575000e070 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-12T18:09:23.543+0000 7f57593649c0 5 asok(0x5564f93102b0) register_command sync trace active_short hook 0x7f575000e070 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:23.729 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 Filter name: none 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-12T18:09:23.543+0000 7f5585ffb640 20 reqs_thread_entry: start 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-12T18:09:23.543+0000 7f57593649c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:23.730 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-12T18:09:23.543+0000 7f57593649c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-12T18:09:23.559+0000 7f57593649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-12T18:09:23.559+0000 7f57593649c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-12T18:09:23.559+0000 7f57593649c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-12T18:09:23.559+0000 7f57593649c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 93892168933552 notifier 8373 bl.length()=827 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-12T18:09:23.559+0000 7f5639ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:09:23.731 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-12T18:09:23.559+0000 7f57593649c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-12T18:09:23.575+0000 7f57593649c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f57593649c0 time 2024-09-12T18:09:23.575066+0000 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f575cc3e2eb] 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f575cc3e49f] 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5564f6a6d0c1] 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5564f6a7f1fa] 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f575baa4d90] 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-12T18:09:23.732 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-12T18:09:23.575+0000 7f57593649c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f57593649c0 thread_name:radosgw-admin 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f575babd520] 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 2: pthread_kill() 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f575cc3e345] 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f575cc3e49f] 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5564f6a6d0c1] 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5564f6a7f1fa] 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-12T18:09:23.733 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f575baa4d90] 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-12T18:09:23.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-12T18:09:23.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-12T18:09:23.736 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-12T18:09:23.737 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-12T18:09:23.738 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-12T18:09:23.739 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-12T18:09:23.740 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5585ffb640 / http_manager 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5587fff640 / http_manager 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: 7f560d7e2640 / rgw_dt_lg_renew 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5638ff9640 / ms_dispatch 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5639ffb640 / io_context_pool 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: 7f563a7fc640 / io_context_pool 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5640e01640 / ms_dispatch 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5643606640 / ms_dispatch 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5644e09640 / io_context_pool 2024-09-12T18:09:23.741 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5756669640 / msgr-worker-2 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5756e6a640 / msgr-worker-1 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr: 7f575766b640 / msgr-worker-0 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr: 7f5757e6c640 / io_context_pool 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr: 7f57593649c0 / radosgw-admin 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:09:23.577334Z_87c6d421-f5b4-4d91-8be7-ea433e1df8b7/log 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr:Aborted 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:23.742 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:23.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.851+0000 7f461c907640 0 --2- 172.21.15.97:0/1879105208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5607c2624160 0x5607c25f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:09:23.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.859+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.859+0000 7f461ee019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.859+0000 7f461ee019c0 20 realm 2024-09-12T18:09:23.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.859+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.863+0000 7f461ee019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.863+0000 7f461ee019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:23.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.863+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.863+0000 7f461ee019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:23.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.863+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.863+0000 7f461ee019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:23.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.863+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:23.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.867+0000 7f461ee019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:23.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.867+0000 7f461ee019c0 20 searching for the correct realm 2024-09-12T18:09:23.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:23.867+0000 7f461c907640 0 -- 172.21.15.97:0/3474616278 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f4610061350 msgr2=0x7f461001a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:24.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.079+0000 7f461c907640 0 -- 172.21.15.97:0/3474616278 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f46180b8040 msgr2=0x7f46180cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:24.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:24.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:24.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:24.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:24.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:24.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:24.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:24.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:24.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 zone default found 2024-09-12T18:09:24.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 4 Realm: () 2024-09-12T18:09:24.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:24.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:24.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:24.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 zonegroup default 2024-09-12T18:09:24.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.299+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.303+0000 7f461ee019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.303+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.303+0000 7f461ee019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.303+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.303+0000 7f461ee019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.303+0000 7f461ee019c0 20 started sync module instance, tier type = 2024-09-12T18:09:24.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.303+0000 7f461ee019c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:24.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.327+0000 7f461ee019c0 20 add_watcher() i=0 2024-09-12T18:09:24.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.327+0000 7f461ee019c0 20 add_watcher() i=1 2024-09-12T18:09:24.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.327+0000 7f461ee019c0 20 add_watcher() i=2 2024-09-12T18:09:24.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.327+0000 7f461ee019c0 20 add_watcher() i=3 2024-09-12T18:09:24.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.327+0000 7f461ee019c0 20 add_watcher() i=4 2024-09-12T18:09:24.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.327+0000 7f461ee019c0 20 add_watcher() i=5 2024-09-12T18:09:24.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.327+0000 7f461ee019c0 20 add_watcher() i=6 2024-09-12T18:09:24.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.327+0000 7f461ee019c0 20 add_watcher() i=7 2024-09-12T18:09:24.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.327+0000 7f461ee019c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:24.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.331+0000 7f44d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:24.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.335+0000 7f461ee019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:24.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.335+0000 7f461ee019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:24.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.335+0000 7f461ee019c0 5 note: GC not initialized 2024-09-12T18:09:24.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.335+0000 7f44d27e4640 20 reqs_thread_entry: start 2024-09-12T18:09:24.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.335+0000 7f461ee019c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:24.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.335+0000 7f461ee019c0 20 Filter name: none 2024-09-12T18:09:24.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.335+0000 7f44cb7fe640 20 reqs_thread_entry: start 2024-09-12T18:09:24.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.335+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.335+0000 7f461ee019c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:24.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.335+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.339+0000 7f461ee019c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:24.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.339+0000 7f461ee019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:24.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.339+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.339+0000 7f461ee019c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:24.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.339+0000 7f461ee019c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.339+0000 7f461ee019c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:24.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.339+0000 7f461ee019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:24.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.343+0000 7f44d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:24.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.347+0000 7f461ee019c0 20 remove_watcher() i=0 2024-09-12T18:09:24.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.347+0000 7f461ee019c0 2 removed watcher, disabling cache 2024-09-12T18:09:24.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.347+0000 7f461ee019c0 20 remove_watcher() i=1 2024-09-12T18:09:24.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.351+0000 7f461ee019c0 20 remove_watcher() i=2 2024-09-12T18:09:24.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.351+0000 7f461ee019c0 20 remove_watcher() i=3 2024-09-12T18:09:24.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.355+0000 7f461ee019c0 20 remove_watcher() i=4 2024-09-12T18:09:24.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.359+0000 7f461ee019c0 20 remove_watcher() i=5 2024-09-12T18:09:24.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.359+0000 7f461ee019c0 20 remove_watcher() i=6 2024-09-12T18:09:24.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.363+0000 7f461ee019c0 20 remove_watcher() i=7 2024-09-12T18:09:24.381 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:09:24.381 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:09:24.432 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:09:24.464 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:24.464 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:24.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.719+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.719+0000 7fceca60a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.719+0000 7fceca60a9c0 20 realm 2024-09-12T18:09:24.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.719+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.719+0000 7fceca60a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.719+0000 7fceca60a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:24.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.719+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.723+0000 7fceca60a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.723+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.723+0000 7fceca60a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:24.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.723+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.723+0000 7fceca60a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:24.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.723+0000 7fceca60a9c0 20 searching for the correct realm 2024-09-12T18:09:24.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.727+0000 7fcec8911640 0 -- 172.21.15.97:0/356994047 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fcebc10b980 msgr2=0x7fcebc10a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:24.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.939+0000 7fcec8911640 0 -- 172.21.15.97:0/356994047 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x556a493a8070 msgr2=0x556a493aa4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:24.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.959+0000 7fceca60a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:24.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.959+0000 7fceca60a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:24.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.959+0000 7fceca60a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:24.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.959+0000 7fceca60a9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:24.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.959+0000 7fceca60a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:24.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.959+0000 7fceca60a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:24.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.959+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.959+0000 7fceca60a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.959+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.959+0000 7fceca60a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:24.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.959+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:24.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 20 zone default found 2024-09-12T18:09:24.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 4 Realm: () 2024-09-12T18:09:24.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:24.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:24.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:24.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 20 zonegroup default 2024-09-12T18:09:24.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:24.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 20 started sync module instance, tier type = 2024-09-12T18:09:24.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.963+0000 7fceca60a9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:24.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.987+0000 7fceca60a9c0 20 add_watcher() i=0 2024-09-12T18:09:24.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.987+0000 7fceca60a9c0 20 add_watcher() i=1 2024-09-12T18:09:24.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.987+0000 7fceca60a9c0 20 add_watcher() i=2 2024-09-12T18:09:24.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.987+0000 7fceca60a9c0 20 add_watcher() i=3 2024-09-12T18:09:24.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.987+0000 7fceca60a9c0 20 add_watcher() i=4 2024-09-12T18:09:24.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.987+0000 7fceca60a9c0 20 add_watcher() i=5 2024-09-12T18:09:24.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.987+0000 7fceca60a9c0 20 add_watcher() i=6 2024-09-12T18:09:24.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.987+0000 7fceca60a9c0 20 add_watcher() i=7 2024-09-12T18:09:24.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.987+0000 7fceca60a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:24.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.991+0000 7fcd7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:24.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.991+0000 7fceca60a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:24.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.991+0000 7fceca60a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:24.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 5 note: GC not initialized 2024-09-12T18:09:24.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fcd7dfdb640 20 reqs_thread_entry: start 2024-09-12T18:09:24.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:24.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 20 Filter name: none 2024-09-12T18:09:24.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fccef7fe640 20 reqs_thread_entry: start 2024-09-12T18:09:24.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:09:24.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:09:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:09:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:09:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:09:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:09:24.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:09:24.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:09:24.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.995+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:09:24.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:09:24.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:09:24.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:09:24.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:09:24.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:09:24.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:09:24.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:09:24.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:09:25.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:09:25.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:09:25.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:09:25.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:24.999+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:09:25.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.003+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:09:25.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.003+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:09:25.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.003+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:09:25.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.003+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:09:25.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.003+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:09:25.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.003+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:09:25.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.003+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:09:25.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.003+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:09:25.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.003+0000 7fceca60a9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:09:25.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.003+0000 7fceca60a9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:09:25.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.007+0000 7fcd7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:25.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.011+0000 7fceca60a9c0 20 remove_watcher() i=0 2024-09-12T18:09:25.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.011+0000 7fceca60a9c0 2 removed watcher, disabling cache 2024-09-12T18:09:25.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.015+0000 7fceca60a9c0 20 remove_watcher() i=1 2024-09-12T18:09:25.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.015+0000 7fceca60a9c0 20 remove_watcher() i=2 2024-09-12T18:09:25.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.019+0000 7fceca60a9c0 20 remove_watcher() i=3 2024-09-12T18:09:25.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.023+0000 7fceca60a9c0 20 remove_watcher() i=4 2024-09-12T18:09:25.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.023+0000 7fceca60a9c0 20 remove_watcher() i=5 2024-09-12T18:09:25.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.027+0000 7fceca60a9c0 20 remove_watcher() i=6 2024-09-12T18:09:25.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:25.027+0000 7fceca60a9c0 20 remove_watcher() i=7 2024-09-12T18:09:55.075 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T18:09:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:55.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.154+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.158+0000 7f6379ffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.158+0000 7f6379ffe9c0 20 realm 2024-09-12T18:09:55.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.158+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.158+0000 7f6379ffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.158+0000 7f6379ffe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:55.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.158+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.158+0000 7f6379ffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.158+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.158+0000 7f6379ffe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:55.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.158+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.162+0000 7f6379ffe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:55.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.162+0000 7f6379ffe9c0 20 searching for the correct realm 2024-09-12T18:09:55.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.162+0000 7f6377b04640 0 -- 172.21.15.97:0/922498580 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f636805b550 msgr2=0x7f6368063290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:55.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.374+0000 7f6377b04640 0 -- 172.21.15.97:0/922498580 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x560a096bc3d0 msgr2=0x7f6370095a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:55.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.590+0000 7f6379ffe9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:55.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.590+0000 7f6379ffe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:55.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.590+0000 7f6379ffe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:55.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.590+0000 7f6379ffe9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:55.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.590+0000 7f6379ffe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:55.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.590+0000 7f6379ffe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:55.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.590+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:55.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:55.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 20 zone default found 2024-09-12T18:09:55.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 4 Realm: () 2024-09-12T18:09:55.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:55.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:55.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:55.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 20 zonegroup default 2024-09-12T18:09:55.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.594+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.598+0000 7f6379ffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.598+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.598+0000 7f6379ffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.598+0000 7f6379ffe9c0 20 started sync module instance, tier type = 2024-09-12T18:09:55.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.598+0000 7f6379ffe9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:55.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.618+0000 7f6379ffe9c0 20 add_watcher() i=0 2024-09-12T18:09:55.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.618+0000 7f6379ffe9c0 20 add_watcher() i=1 2024-09-12T18:09:55.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.618+0000 7f6379ffe9c0 20 add_watcher() i=2 2024-09-12T18:09:55.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.618+0000 7f6379ffe9c0 20 add_watcher() i=3 2024-09-12T18:09:55.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.618+0000 7f6379ffe9c0 20 add_watcher() i=4 2024-09-12T18:09:55.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.618+0000 7f6379ffe9c0 20 add_watcher() i=5 2024-09-12T18:09:55.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.618+0000 7f6379ffe9c0 20 add_watcher() i=6 2024-09-12T18:09:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.622+0000 7f6379ffe9c0 20 add_watcher() i=7 2024-09-12T18:09:55.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.622+0000 7f6379ffe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:55.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.626+0000 7f622e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:55.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.626+0000 7f6379ffe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:55.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.626+0000 7f6379ffe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:55.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.626+0000 7f6379ffe9c0 5 note: GC not initialized 2024-09-12T18:09:55.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.626+0000 7f622d7e2640 20 reqs_thread_entry: start 2024-09-12T18:09:55.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.626+0000 7f6379ffe9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:55.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.626+0000 7f6379ffe9c0 20 Filter name: none 2024-09-12T18:09:55.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f62267fc640 20 reqs_thread_entry: start 2024-09-12T18:09:55.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:09:55.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:09:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:09:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:09:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:55.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:55.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:55.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:55.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:55.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.630+0000 7f6379ffe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:09:55.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.638+0000 7f622e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:55.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.642+0000 7f6379ffe9c0 20 remove_watcher() i=0 2024-09-12T18:09:55.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.642+0000 7f6379ffe9c0 2 removed watcher, disabling cache 2024-09-12T18:09:55.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.646+0000 7f6379ffe9c0 20 remove_watcher() i=1 2024-09-12T18:09:55.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.646+0000 7f6379ffe9c0 20 remove_watcher() i=2 2024-09-12T18:09:55.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.650+0000 7f6379ffe9c0 20 remove_watcher() i=3 2024-09-12T18:09:55.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.654+0000 7f6379ffe9c0 20 remove_watcher() i=4 2024-09-12T18:09:55.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.654+0000 7f6379ffe9c0 20 remove_watcher() i=5 2024-09-12T18:09:55.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.658+0000 7f6379ffe9c0 20 remove_watcher() i=6 2024-09-12T18:09:55.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.662+0000 7f6379ffe9c0 20 remove_watcher() i=7 2024-09-12T18:09:55.684 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:09:55.711 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:55.711 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:55.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.754+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.754+0000 7f106ed939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.754+0000 7f106ed939c0 20 realm 2024-09-12T18:09:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.754+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.758+0000 7f106ed939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.758+0000 7f106ed939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.758+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.758+0000 7f106ed939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.758+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.758+0000 7f106ed939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:55.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.758+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.758+0000 7f106ed939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:55.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.758+0000 7f106ed939c0 20 searching for the correct realm 2024-09-12T18:09:55.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.766+0000 7f1067fff640 0 -- 172.21.15.97:0/1198640140 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f10580699c0 msgr2=0x7f105809a0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:55.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.770+0000 7f106d09a640 0 -- 172.21.15.97:0/1198640140 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55eec0c11d80 msgr2=0x55eec0c141f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:55.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:55.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:55.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:55.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:55.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:55.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:55.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:55.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:55.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 zone default found 2024-09-12T18:09:55.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 4 Realm: () 2024-09-12T18:09:55.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:55.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:55.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:55.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 zonegroup default 2024-09-12T18:09:55.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.778+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.782+0000 7f106ed939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.782+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.782+0000 7f106ed939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.782+0000 7f106ed939c0 20 started sync module instance, tier type = 2024-09-12T18:09:55.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.782+0000 7f106ed939c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:55.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.798+0000 7f106ed939c0 20 add_watcher() i=0 2024-09-12T18:09:55.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.798+0000 7f106ed939c0 20 add_watcher() i=1 2024-09-12T18:09:55.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.798+0000 7f106ed939c0 20 add_watcher() i=2 2024-09-12T18:09:55.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.798+0000 7f106ed939c0 20 add_watcher() i=3 2024-09-12T18:09:55.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.798+0000 7f106ed939c0 20 add_watcher() i=4 2024-09-12T18:09:55.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.798+0000 7f106ed939c0 20 add_watcher() i=5 2024-09-12T18:09:55.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.798+0000 7f106ed939c0 20 add_watcher() i=6 2024-09-12T18:09:55.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.802+0000 7f106ed939c0 20 add_watcher() i=7 2024-09-12T18:09:55.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.802+0000 7f106ed939c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:55.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f0f22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:55.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:55.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:55.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 5 note: GC not initialized 2024-09-12T18:09:55.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f0f21fe3640 20 reqs_thread_entry: start 2024-09-12T18:09:55.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:55.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 20 Filter name: none 2024-09-12T18:09:55.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f0e937fe640 20 reqs_thread_entry: start 2024-09-12T18:09:55.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:09:55.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:55.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:09:55.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:09:55.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:09:55.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:09:55.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:55.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:55.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:55.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:55.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:09:55.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:09:55.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.806+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:09:55.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:09:55.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:09:55.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:09:55.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:09:55.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:09:55.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:09:55.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:09:55.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:09:55.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:09:55.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:09:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:09:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:09:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:09:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.810+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:09:55.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.814+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:09:55.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.814+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:09:55.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.814+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:09:55.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.814+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:09:55.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.814+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:09:55.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.814+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:09:55.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.814+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:09:55.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.814+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:09:55.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.814+0000 7f106ed939c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:09:55.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.814+0000 7f106ed939c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:09:55.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.818+0000 7f0f22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:55.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.822+0000 7f106ed939c0 20 remove_watcher() i=0 2024-09-12T18:09:55.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.822+0000 7f106ed939c0 2 removed watcher, disabling cache 2024-09-12T18:09:55.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.822+0000 7f106ed939c0 20 remove_watcher() i=1 2024-09-12T18:09:55.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.826+0000 7f106ed939c0 20 remove_watcher() i=2 2024-09-12T18:09:55.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.826+0000 7f106ed939c0 20 remove_watcher() i=3 2024-09-12T18:09:55.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.830+0000 7f106ed939c0 20 remove_watcher() i=4 2024-09-12T18:09:55.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.830+0000 7f106ed939c0 20 remove_watcher() i=5 2024-09-12T18:09:55.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.834+0000 7f106ed939c0 20 remove_watcher() i=6 2024-09-12T18:09:55.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.838+0000 7f106ed939c0 20 remove_watcher() i=7 2024-09-12T18:09:55.853 INFO:tasks.workunit.client.0.smithi097.stderr:check reshard logrecord successfully 2024-09-12T18:09:55.853 INFO:tasks.workunit.client.0.smithi097.stderr: test: reshard versioned bucket 2024-09-12T18:09:55.853 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:09:55.879 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:55.879 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:55.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.922+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.922+0000 7fc1d39d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.922+0000 7fc1d39d69c0 20 realm 2024-09-12T18:09:55.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.922+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.922+0000 7fc1d39d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.922+0000 7fc1d39d69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:55.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.926+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.926+0000 7fc1d39d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:55.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.926+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.926+0000 7fc1d39d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:55.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.926+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:55.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.926+0000 7fc1d39d69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:55.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:55.926+0000 7fc1d39d69c0 20 searching for the correct realm 2024-09-12T18:09:56.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.134+0000 7fc1d1cdd640 0 -- 172.21.15.97:0/2850084841 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fc1c80f6500 msgr2=0x7fc1c80fe240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:56.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.146+0000 7fc1d14dc640 0 -- 172.21.15.97:0/2850084841 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fc1cc00e040 msgr2=0x7fc1cc046940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:56.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:56.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:56.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:56.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:56.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:56.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:56.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:56.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:56.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 zone default found 2024-09-12T18:09:56.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 4 Realm: () 2024-09-12T18:09:56.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:56.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:56.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:56.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 zonegroup default 2024-09-12T18:09:56.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.158+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.162+0000 7fc1d39d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.162+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.162+0000 7fc1d39d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.162+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.162+0000 7fc1d39d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.162+0000 7fc1d39d69c0 20 started sync module instance, tier type = 2024-09-12T18:09:56.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.162+0000 7fc1d39d69c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:56.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.186+0000 7fc1d39d69c0 20 add_watcher() i=0 2024-09-12T18:09:56.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.186+0000 7fc1d39d69c0 20 add_watcher() i=1 2024-09-12T18:09:56.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.186+0000 7fc1d39d69c0 20 add_watcher() i=2 2024-09-12T18:09:56.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.186+0000 7fc1d39d69c0 20 add_watcher() i=3 2024-09-12T18:09:56.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.186+0000 7fc1d39d69c0 20 add_watcher() i=4 2024-09-12T18:09:56.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.186+0000 7fc1d39d69c0 20 add_watcher() i=5 2024-09-12T18:09:56.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.186+0000 7fc1d39d69c0 20 add_watcher() i=6 2024-09-12T18:09:56.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.186+0000 7fc1d39d69c0 20 add_watcher() i=7 2024-09-12T18:09:56.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.186+0000 7fc1d39d69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:56.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.190+0000 7fc087fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:56.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.194+0000 7fc1d39d69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:56.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.194+0000 7fc1d39d69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:56.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.194+0000 7fc1d39d69c0 5 note: GC not initialized 2024-09-12T18:09:56.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.194+0000 7fc086fe5640 20 reqs_thread_entry: start 2024-09-12T18:09:56.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.194+0000 7fc1d39d69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:56.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.194+0000 7fc1d39d69c0 20 Filter name: none 2024-09-12T18:09:56.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.194+0000 7fc084fe1640 20 reqs_thread_entry: start 2024-09-12T18:09:56.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.194+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.194+0000 7fc1d39d69c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:56.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.194+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.198+0000 7fc1d39d69c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:56.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.198+0000 7fc1d39d69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:56.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.198+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.198+0000 7fc1d39d69c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:56.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.198+0000 7fc1d39d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.198+0000 7fc1d39d69c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:56.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.198+0000 7fc1d39d69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:56.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.202+0000 7fc087fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:56.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.206+0000 7fc1d39d69c0 20 remove_watcher() i=0 2024-09-12T18:09:56.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.206+0000 7fc1d39d69c0 2 removed watcher, disabling cache 2024-09-12T18:09:56.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.206+0000 7fc1d39d69c0 20 remove_watcher() i=1 2024-09-12T18:09:56.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.210+0000 7fc1d39d69c0 20 remove_watcher() i=2 2024-09-12T18:09:56.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.210+0000 7fc1d39d69c0 20 remove_watcher() i=3 2024-09-12T18:09:56.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.214+0000 7fc1d39d69c0 20 remove_watcher() i=4 2024-09-12T18:09:56.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.214+0000 7fc1d39d69c0 20 remove_watcher() i=5 2024-09-12T18:09:56.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.218+0000 7fc1d39d69c0 20 remove_watcher() i=6 2024-09-12T18:09:56.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.222+0000 7fc1d39d69c0 20 remove_watcher() i=7 2024-09-12T18:09:56.240 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:56.240 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:09:56.240 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: myver id: 98539659-fdaf-41ce-847d-239ff89323af.4641.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T18:09:56.240 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:56.240 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T18:09:56.272 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:56.273 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:56.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.314+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 20 realm 2024-09-12T18:09:56.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:56.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:56.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:56.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.318+0000 7f45f85b09c0 20 searching for the correct realm 2024-09-12T18:09:56.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.326+0000 7f45f68b7640 0 -- 172.21.15.97:0/3227282010 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f45ec031020 msgr2=0x7f45ec061f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:56.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.330+0000 7f45f60b6640 0 -- 172.21.15.97:0/3227282010 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f45f002b070 msgr2=0x7f45f005fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:56.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:56.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:56.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:56.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:56.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:56.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:56.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:56.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:56.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 zone default found 2024-09-12T18:09:56.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 4 Realm: () 2024-09-12T18:09:56.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:56.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:56.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:56.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 zonegroup default 2024-09-12T18:09:56.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.338+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.342+0000 7f45f85b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.342+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.342+0000 7f45f85b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.342+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.342+0000 7f45f85b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.342+0000 7f45f85b09c0 20 started sync module instance, tier type = 2024-09-12T18:09:56.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.342+0000 7f45f85b09c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:56.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.358+0000 7f45f85b09c0 20 add_watcher() i=0 2024-09-12T18:09:56.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.358+0000 7f45f85b09c0 20 add_watcher() i=1 2024-09-12T18:09:56.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.358+0000 7f45f85b09c0 20 add_watcher() i=2 2024-09-12T18:09:56.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.358+0000 7f45f85b09c0 20 add_watcher() i=3 2024-09-12T18:09:56.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.358+0000 7f45f85b09c0 20 add_watcher() i=4 2024-09-12T18:09:56.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.358+0000 7f45f85b09c0 20 add_watcher() i=5 2024-09-12T18:09:56.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.358+0000 7f45f85b09c0 20 add_watcher() i=6 2024-09-12T18:09:56.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.362+0000 7f45f85b09c0 20 add_watcher() i=7 2024-09-12T18:09:56.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.362+0000 7f45f85b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:56.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f44ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:56.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:56.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:56.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 5 note: GC not initialized 2024-09-12T18:09:56.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f44a77fe640 20 reqs_thread_entry: start 2024-09-12T18:09:56.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:56.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 20 Filter name: none 2024-09-12T18:09:56.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f44a57fa640 20 reqs_thread_entry: start 2024-09-12T18:09:56.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:09:56.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:56.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:09:56.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:09:56.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 : miss 2024-09-12T18:09:56.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.366+0000 7f45f85b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.370+0000 7f45f85b09c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:56.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.370+0000 7f45f85b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:09:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.370+0000 7f45f85b09c0 10 adding default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:09:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.370+0000 7f45f85b09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.370+0000 7f45f85b09c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.370+0000 7f45f85b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 2024-09-12T18:09:56.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.378+0000 7f45f85b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:09:56.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.378+0000 7f45f85b09c0 10 moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:09:56.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.378+0000 7f45f85b09c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:56.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.378+0000 7f45f85b09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18, ofs0, ns] 2024-09-12T18:09:56.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.378+0000 7f44d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431660 cookie 94058228925760 notifier 7934 bl.length()=821 2024-09-12T18:09:56.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.378+0000 7f44d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:09:56.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.378+0000 7f44d9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:09:56.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.378+0000 7f44d9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:56.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.382+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_sources= new_sources= 2024-09-12T18:09:56.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.382+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential sources added=[] removed=[] 2024-09-12T18:09:56.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.382+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_dests= new_dests= 2024-09-12T18:09:56.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.382+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential dests added=[] removed=[] 2024-09-12T18:09:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.0 2024-09-12T18:09:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.0 2024-09-12T18:09:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.1 2024-09-12T18:09:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.1 2024-09-12T18:09:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.2 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.2 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.3 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.3 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.4 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.4 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.5 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.5 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.6 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.6 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.7 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.7 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.8 2024-09-12T18:09:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.8 2024-09-12T18:09:56.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.9 2024-09-12T18:09:56.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.9 2024-09-12T18:09:56.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.10 2024-09-12T18:09:56.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.10 2024-09-12T18:09:56.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.11 2024-09-12T18:09:56.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.11 2024-09-12T18:09:56.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.0 2024-09-12T18:09:56.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.390+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1 2024-09-12T18:09:56.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.394+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2 2024-09-12T18:09:56.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.394+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3 2024-09-12T18:09:56.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.394+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.4 2024-09-12T18:09:56.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.394+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.5 2024-09-12T18:09:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.394+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.6 2024-09-12T18:09:56.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.398+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.7 2024-09-12T18:09:56.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.398+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.8 2024-09-12T18:09:56.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.398+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.9 2024-09-12T18:09:56.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.398+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.10 2024-09-12T18:09:56.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.402+0000 7f45f85b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:56.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.402+0000 7f45f85b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 2024-09-12T18:09:56.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.402+0000 7f45f85b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:09:56.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.402+0000 7f45f85b09c0 10 moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:09:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.402+0000 7f45f85b09c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.402+0000 7f45f85b09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18, ofs0, ns] 2024-09-12T18:09:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.402+0000 7f44d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431661 cookie 94058228925760 notifier 7934 bl.length()=821 2024-09-12T18:09:56.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.402+0000 7f44d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:09:56.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.402+0000 7f44d9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:09:56.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.402+0000 7f44d9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:56.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.406+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_sources= new_sources= 2024-09-12T18:09:56.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.406+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential sources added=[] removed=[] 2024-09-12T18:09:56.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.406+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_dests= new_dests= 2024-09-12T18:09:56.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.406+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential dests added=[] removed=[] 2024-09-12T18:09:56.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.410+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.0 2024-09-12T18:09:56.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.410+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1 2024-09-12T18:09:56.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.410+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2 2024-09-12T18:09:56.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.410+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3 2024-09-12T18:09:56.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.410+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.4 2024-09-12T18:09:56.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.410+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.5 2024-09-12T18:09:56.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.410+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.6 2024-09-12T18:09:56.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.414+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.7 2024-09-12T18:09:56.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.414+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.8 2024-09-12T18:09:56.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.414+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.9 2024-09-12T18:09:56.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.414+0000 7f45f85b09c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.10 2024-09-12T18:09:56.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.414+0000 7f45f85b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:56.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.414+0000 7f45f85b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 2024-09-12T18:09:56.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f45f85b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:09:56.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f45f85b09c0 10 moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:09:56.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f45f85b09c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:56.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f45f85b09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18, ofs0, ns] 2024-09-12T18:09:56.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f44d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431662 cookie 94058228925760 notifier 7934 bl.length()=789 2024-09-12T18:09:56.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f44d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:09:56.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f44d9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:09:56.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f44d9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:56.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_sources= new_sources= 2024-09-12T18:09:56.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential sources added=[] removed=[] 2024-09-12T18:09:56.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_dests= new_dests= 2024-09-12T18:09:56.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.418+0000 7f45f85b09c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential dests added=[] removed=[] 2024-09-12T18:09:56.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.422+0000 7f45f85b09c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T18:09:56.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.426+0000 7f44ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:56.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.430+0000 7f45f85b09c0 20 remove_watcher() i=0 2024-09-12T18:09:56.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.430+0000 7f45f85b09c0 2 removed watcher, disabling cache 2024-09-12T18:09:56.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.434+0000 7f45f85b09c0 20 remove_watcher() i=1 2024-09-12T18:09:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.434+0000 7f45f85b09c0 20 remove_watcher() i=2 2024-09-12T18:09:56.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.438+0000 7f45f85b09c0 20 remove_watcher() i=3 2024-09-12T18:09:56.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.438+0000 7f45f85b09c0 20 remove_watcher() i=4 2024-09-12T18:09:56.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.442+0000 7f45f85b09c0 20 remove_watcher() i=5 2024-09-12T18:09:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.442+0000 7f45f85b09c0 20 remove_watcher() i=6 2024-09-12T18:09:56.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.446+0000 7f45f85b09c0 20 remove_watcher() i=7 2024-09-12T18:09:56.461 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:09:56.487 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:56.488 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:56.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.530+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.530+0000 7fa31be299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.530+0000 7fa31be299c0 20 realm 2024-09-12T18:09:56.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.530+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.534+0000 7fa31be299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.534+0000 7fa31be299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:56.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.534+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.534+0000 7fa31be299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.534+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.534+0000 7fa31be299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:56.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.534+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.534+0000 7fa31be299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:56.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.534+0000 7fa31be299c0 20 searching for the correct realm 2024-09-12T18:09:56.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.542+0000 7fa31a130640 0 -- 172.21.15.97:0/528498368 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x558cc3971300 msgr2=0x558cc39736f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:56.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.550+0000 7fa31912e640 0 -- 172.21.15.97:0/528498368 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x558cc3978c40 msgr2=0x558cc397b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:56.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.554+0000 7fa31be299c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:56.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.554+0000 7fa31be299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:56.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.554+0000 7fa31be299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:56.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.554+0000 7fa31be299c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:56.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.554+0000 7fa31be299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:56.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.554+0000 7fa31be299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:56.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.554+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:56.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:56.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 zone default found 2024-09-12T18:09:56.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 4 Realm: () 2024-09-12T18:09:56.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:56.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:56.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:56.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 zonegroup default 2024-09-12T18:09:56.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 started sync module instance, tier type = 2024-09-12T18:09:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.558+0000 7fa31be299c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:56.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.578+0000 7fa31be299c0 20 add_watcher() i=0 2024-09-12T18:09:56.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.578+0000 7fa31be299c0 20 add_watcher() i=1 2024-09-12T18:09:56.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.578+0000 7fa31be299c0 20 add_watcher() i=2 2024-09-12T18:09:56.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.578+0000 7fa31be299c0 20 add_watcher() i=3 2024-09-12T18:09:56.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.578+0000 7fa31be299c0 20 add_watcher() i=4 2024-09-12T18:09:56.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.578+0000 7fa31be299c0 20 add_watcher() i=5 2024-09-12T18:09:56.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.578+0000 7fa31be299c0 20 add_watcher() i=6 2024-09-12T18:09:56.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.582+0000 7fa31be299c0 20 add_watcher() i=7 2024-09-12T18:09:56.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.582+0000 7fa31be299c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:56.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.582+0000 7fa1cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:56.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:56.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:56.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 5 note: GC not initialized 2024-09-12T18:09:56.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa1ca7fc640 20 reqs_thread_entry: start 2024-09-12T18:09:56.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:56.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 Filter name: none 2024-09-12T18:09:56.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa13bfff640 20 reqs_thread_entry: start 2024-09-12T18:09:56.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:56.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:56.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:56.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:56.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:56.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:56.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.586+0000 7fa31be299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:56.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.590+0000 7fa1cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:56.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.594+0000 7fa31be299c0 20 remove_watcher() i=0 2024-09-12T18:09:56.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.594+0000 7fa31be299c0 2 removed watcher, disabling cache 2024-09-12T18:09:56.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.598+0000 7fa31be299c0 20 remove_watcher() i=1 2024-09-12T18:09:56.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.598+0000 7fa31be299c0 20 remove_watcher() i=2 2024-09-12T18:09:56.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.602+0000 7fa31be299c0 20 remove_watcher() i=3 2024-09-12T18:09:56.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.602+0000 7fa31be299c0 20 remove_watcher() i=4 2024-09-12T18:09:56.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.606+0000 7fa31be299c0 20 remove_watcher() i=5 2024-09-12T18:09:56.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.606+0000 7fa31be299c0 20 remove_watcher() i=6 2024-09-12T18:09:56.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:56.610+0000 7fa31be299c0 20 remove_watcher() i=7 2024-09-12T18:09:56.625 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:56.625 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:09:56.625 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: myver id: 98539659-fdaf-41ce-847d-239ff89323af.4641.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T18:09:56.625 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:56.627 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:09:56.627 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:09:56.648 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:09:56.648 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:09:56.707 INFO:tasks.workunit.client.0.smithi097.stderr: test: reshard removes olh entries with empty name 2024-09-12T18:09:56.711 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:09:56.712 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:09:56.853 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:09:56.853 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:09:57.500 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:09:57.533 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:57.533 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:57.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.578+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.578+0000 7f41200f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.578+0000 7f41200f89c0 20 realm 2024-09-12T18:09:57.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.578+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.578+0000 7f41200f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.578+0000 7f41200f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:57.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.578+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.578+0000 7f41200f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.578+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.582+0000 7f41200f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:57.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.582+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.582+0000 7f41200f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:57.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.582+0000 7f41200f89c0 20 searching for the correct realm 2024-09-12T18:09:57.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.590+0000 7f411e3ff640 0 -- 172.21.15.97:0/2244788198 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x56180d200da0 msgr2=0x56180d203190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:57.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.594+0000 7f411d3fd640 0 -- 172.21.15.97:0/2244788198 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x56180d2087e0 msgr2=0x56180d20abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:57.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:57.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:57.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:57.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:57.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:57.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:57.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:57.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 zone default found 2024-09-12T18:09:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 4 Realm: () 2024-09-12T18:09:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 zonegroup default 2024-09-12T18:09:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.602+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.606+0000 7f41200f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.606+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.606+0000 7f41200f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.606+0000 7f41200f89c0 20 started sync module instance, tier type = 2024-09-12T18:09:57.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.606+0000 7f41200f89c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:57.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.622+0000 7f41200f89c0 20 add_watcher() i=0 2024-09-12T18:09:57.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.622+0000 7f41200f89c0 20 add_watcher() i=1 2024-09-12T18:09:57.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.622+0000 7f41200f89c0 20 add_watcher() i=2 2024-09-12T18:09:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.622+0000 7f41200f89c0 20 add_watcher() i=3 2024-09-12T18:09:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.622+0000 7f41200f89c0 20 add_watcher() i=4 2024-09-12T18:09:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.622+0000 7f41200f89c0 20 add_watcher() i=5 2024-09-12T18:09:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.622+0000 7f41200f89c0 20 add_watcher() i=6 2024-09-12T18:09:57.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.626+0000 7f41200f89c0 20 add_watcher() i=7 2024-09-12T18:09:57.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.626+0000 7f41200f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:57.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f3fcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:57.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:57.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:57.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 5 note: GC not initialized 2024-09-12T18:09:57.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f3fce7fc640 20 reqs_thread_entry: start 2024-09-12T18:09:57.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:57.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 Filter name: none 2024-09-12T18:09:57.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f3f3ffff640 20 reqs_thread_entry: start 2024-09-12T18:09:57.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:57.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.630+0000 7f41200f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.634+0000 7f41200f89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:57.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.634+0000 7f41200f89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:57.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.638+0000 7f3fcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:57.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.642+0000 7f41200f89c0 20 remove_watcher() i=0 2024-09-12T18:09:57.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.642+0000 7f41200f89c0 2 removed watcher, disabling cache 2024-09-12T18:09:57.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.642+0000 7f41200f89c0 20 remove_watcher() i=1 2024-09-12T18:09:57.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.642+0000 7f41200f89c0 20 remove_watcher() i=2 2024-09-12T18:09:57.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.646+0000 7f41200f89c0 20 remove_watcher() i=3 2024-09-12T18:09:57.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.646+0000 7f41200f89c0 20 remove_watcher() i=4 2024-09-12T18:09:57.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.650+0000 7f41200f89c0 20 remove_watcher() i=5 2024-09-12T18:09:57.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.654+0000 7f41200f89c0 20 remove_watcher() i=6 2024-09-12T18:09:57.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.658+0000 7f41200f89c0 20 remove_watcher() i=7 2024-09-12T18:09:57.672 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:57.672 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:09:57.672 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 98539659-fdaf-41ce-847d-239ff89323af.4641.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T18:09:57.672 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:57.673 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T18:09:57.700 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:57.700 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:57.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.742+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.746+0000 7fb4ace0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.746+0000 7fb4ace0e9c0 20 realm 2024-09-12T18:09:57.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.746+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.746+0000 7fb4ace0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.746+0000 7fb4ace0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:57.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.746+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.746+0000 7fb4ace0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.746+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.746+0000 7fb4ace0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:57.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.746+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.750+0000 7fb4ace0e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:57.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.750+0000 7fb4ace0e9c0 20 searching for the correct realm 2024-09-12T18:09:57.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.754+0000 7fb4ab115640 0 -- 172.21.15.97:0/787571383 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fb494008040 msgr2=0x7fb49408f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:57.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.762+0000 7fb4aa914640 0 -- 172.21.15.97:0/787571383 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fb4a4004040 msgr2=0x7fb4a40de400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:57.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.766+0000 7fb4ace0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:57.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.766+0000 7fb4ace0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:57.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.766+0000 7fb4ace0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:57.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.766+0000 7fb4ace0e9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:57.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.766+0000 7fb4ace0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:57.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.766+0000 7fb4ace0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:57.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.766+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.766+0000 7fb4ace0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.766+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.766+0000 7fb4ace0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:57.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.766+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:57.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 20 zone default found 2024-09-12T18:09:57.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 4 Realm: () 2024-09-12T18:09:57.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:57.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:57.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:57.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 20 zonegroup default 2024-09-12T18:09:57.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 20 started sync module instance, tier type = 2024-09-12T18:09:57.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.770+0000 7fb4ace0e9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:57.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.790+0000 7fb4ace0e9c0 20 add_watcher() i=0 2024-09-12T18:09:57.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.790+0000 7fb4ace0e9c0 20 add_watcher() i=1 2024-09-12T18:09:57.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.790+0000 7fb4ace0e9c0 20 add_watcher() i=2 2024-09-12T18:09:57.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.790+0000 7fb4ace0e9c0 20 add_watcher() i=3 2024-09-12T18:09:57.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.790+0000 7fb4ace0e9c0 20 add_watcher() i=4 2024-09-12T18:09:57.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.790+0000 7fb4ace0e9c0 20 add_watcher() i=5 2024-09-12T18:09:57.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.790+0000 7fb4ace0e9c0 20 add_watcher() i=6 2024-09-12T18:09:57.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.790+0000 7fb4ace0e9c0 20 add_watcher() i=7 2024-09-12T18:09:57.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.790+0000 7fb4ace0e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:57.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.794+0000 7fb3617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:57.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.794+0000 7fb4ace0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:57.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.794+0000 7fb4ace0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:57.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.794+0000 7fb4ace0e9c0 5 note: GC not initialized 2024-09-12T18:09:57.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.794+0000 7fb2dbfff640 20 reqs_thread_entry: start 2024-09-12T18:09:57.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.794+0000 7fb4ace0e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:57.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.794+0000 7fb4ace0e9c0 20 Filter name: none 2024-09-12T18:09:57.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.794+0000 7fb2d9ffb640 20 reqs_thread_entry: start 2024-09-12T18:09:57.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.794+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.794+0000 7fb4ace0e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:57.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.794+0000 7fb4ace0e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.798+0000 7fb4ace0e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:57.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.798+0000 7fb4ace0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:57.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.798+0000 7fb3617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:57.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.802+0000 7fb4ace0e9c0 20 remove_watcher() i=0 2024-09-12T18:09:57.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.802+0000 7fb4ace0e9c0 2 removed watcher, disabling cache 2024-09-12T18:09:57.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.802+0000 7fb4ace0e9c0 20 remove_watcher() i=1 2024-09-12T18:09:57.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.806+0000 7fb4ace0e9c0 20 remove_watcher() i=2 2024-09-12T18:09:57.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.806+0000 7fb4ace0e9c0 20 remove_watcher() i=3 2024-09-12T18:09:57.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.810+0000 7fb4ace0e9c0 20 remove_watcher() i=4 2024-09-12T18:09:57.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.814+0000 7fb4ace0e9c0 20 remove_watcher() i=5 2024-09-12T18:09:57.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.814+0000 7fb4ace0e9c0 20 remove_watcher() i=6 2024-09-12T18:09:57.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.818+0000 7fb4ace0e9c0 20 remove_watcher() i=7 2024-09-12T18:09:57.836 INFO:tasks.workunit.client.0.smithi097.stderr:rados -p default.rgw.buckets.index setomapval .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T18:09:57.863 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:57.863 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:57.886 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T18:09:57.912 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:57.912 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:57.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.954+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.954+0000 7fded3b3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.954+0000 7fded3b3c9c0 20 realm 2024-09-12T18:09:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.954+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.958+0000 7fded3b3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.958+0000 7fded3b3c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.958+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.958+0000 7fded3b3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:57.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.958+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.958+0000 7fded3b3c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:57.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.958+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:57.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.962+0000 7fded3b3c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:57.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.962+0000 7fded3b3c9c0 20 searching for the correct realm 2024-09-12T18:09:57.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:57.966+0000 7fded0e41640 0 -- 172.21.15.97:0/69114522 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fdebc0e4070 msgr2=0x7fdebc0db7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:09:58.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.182+0000 7fded1e43640 0 -- 172.21.15.97:0/69114522 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x56489768de90 msgr2=0x564897690310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:58.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.190+0000 7fded3b3c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:58.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.190+0000 7fded3b3c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:58.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.190+0000 7fded3b3c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:58.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.190+0000 7fded3b3c9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:58.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.190+0000 7fded3b3c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:58.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.190+0000 7fded3b3c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:58.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.190+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:58.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:58.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:58.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 20 zone default found 2024-09-12T18:09:58.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 4 Realm: () 2024-09-12T18:09:58.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:58.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:58.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:58.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 20 zonegroup default 2024-09-12T18:09:58.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:58.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.194+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.198+0000 7fded3b3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:58.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.198+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.198+0000 7fded3b3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:58.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.198+0000 7fded3b3c9c0 20 started sync module instance, tier type = 2024-09-12T18:09:58.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.198+0000 7fded3b3c9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:58.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.218+0000 7fded3b3c9c0 20 add_watcher() i=0 2024-09-12T18:09:58.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.218+0000 7fded3b3c9c0 20 add_watcher() i=1 2024-09-12T18:09:58.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.218+0000 7fded3b3c9c0 20 add_watcher() i=2 2024-09-12T18:09:58.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.218+0000 7fded3b3c9c0 20 add_watcher() i=3 2024-09-12T18:09:58.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.218+0000 7fded3b3c9c0 20 add_watcher() i=4 2024-09-12T18:09:58.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.218+0000 7fded3b3c9c0 20 add_watcher() i=5 2024-09-12T18:09:58.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.218+0000 7fded3b3c9c0 20 add_watcher() i=6 2024-09-12T18:09:58.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.222+0000 7fded3b3c9c0 20 add_watcher() i=7 2024-09-12T18:09:58.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.222+0000 7fded3b3c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:58.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.226+0000 7fdd87fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:58.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.226+0000 7fded3b3c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:58.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.226+0000 7fded3b3c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:58.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.226+0000 7fded3b3c9c0 5 note: GC not initialized 2024-09-12T18:09:58.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.226+0000 7fdd86fe5640 20 reqs_thread_entry: start 2024-09-12T18:09:58.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.226+0000 7fded3b3c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:58.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.226+0000 7fded3b3c9c0 20 Filter name: none 2024-09-12T18:09:58.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.226+0000 7fdd84fe1640 20 reqs_thread_entry: start 2024-09-12T18:09:58.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:58.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:58.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:58.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:09:58.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 INFO: main: starting shard=0 2024-09-12T18:09:58.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:09:58.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:09:58.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:09:58.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 INFO: main: starting shard=1 2024-09-12T18:09:58.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:09:58.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:09:58.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 INFO: main: starting shard=2 2024-09-12T18:09:58.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:09:58.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.230+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:09:58.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 INFO: main: starting shard=3 2024-09-12T18:09:58.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:09:58.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:09:58.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 INFO: main: starting shard=4 2024-09-12T18:09:58.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:09:58.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:09:58.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 INFO: main: starting shard=5 2024-09-12T18:09:58.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:09:58.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:09:58.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 INFO: main: starting shard=6 2024-09-12T18:09:58.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:09:58.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.234+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:09:58.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 INFO: main: starting shard=7 2024-09-12T18:09:58.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:09:58.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:09:58.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 INFO: main: starting shard=8 2024-09-12T18:09:58.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:09:58.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:09:58.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 INFO: main: starting shard=9 2024-09-12T18:09:58.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:09:58.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:09:58.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 INFO: main: starting shard=10 2024-09-12T18:09:58.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:09:58.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:09:58.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 INFO: main: starting shard=11 2024-09-12T18:09:58.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:09:58.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.238+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:09:58.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.242+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.242+0000 7fded3b3c9c0 20 INFO: main: starting shard=12 2024-09-12T18:09:58.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.242+0000 7fded3b3c9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:09:58.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.242+0000 7fded3b3c9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:09:58.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.242+0000 7fded3b3c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:58.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.242+0000 7fded3b3c9c0 20 INFO: main: done 2024-09-12T18:09:58.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.242+0000 7fdd87fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:58.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.246+0000 7fded3b3c9c0 20 remove_watcher() i=0 2024-09-12T18:09:58.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.246+0000 7fded3b3c9c0 2 removed watcher, disabling cache 2024-09-12T18:09:58.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.246+0000 7fded3b3c9c0 20 remove_watcher() i=1 2024-09-12T18:09:58.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.250+0000 7fded3b3c9c0 20 remove_watcher() i=2 2024-09-12T18:09:58.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.250+0000 7fded3b3c9c0 20 remove_watcher() i=3 2024-09-12T18:09:58.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.254+0000 7fded3b3c9c0 20 remove_watcher() i=4 2024-09-12T18:09:58.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.258+0000 7fded3b3c9c0 20 remove_watcher() i=5 2024-09-12T18:09:58.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.258+0000 7fded3b3c9c0 20 remove_watcher() i=6 2024-09-12T18:09:58.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.262+0000 7fded3b3c9c0 20 remove_watcher() i=7 2024-09-12T18:09:58.278 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T18:09:58.307 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:58.307 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:58.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.758+0000 7fe9ceecc640 0 --2- 172.21.15.97:0/1431735409 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x55ba09235fe0 0x55ba09228d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:09:58.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.762+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.766+0000 7fe9d1bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.766+0000 7fe9d1bc79c0 20 realm 2024-09-12T18:09:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.766+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.766+0000 7fe9d1bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:58.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.766+0000 7fe9d1bc79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:58.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.766+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.766+0000 7fe9d1bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:58.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.766+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.770+0000 7fe9d1bc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:58.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.770+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:58.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.770+0000 7fe9d1bc79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:58.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.770+0000 7fe9d1bc79c0 20 searching for the correct realm 2024-09-12T18:09:58.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.774+0000 7fe9cf6cd640 0 -- 172.21.15.97:0/1431735409 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fe9c00adbb0 msgr2=0x7fe9c0107460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:58.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:58.782+0000 7fe9cf6cd640 0 -- 172.21.15.97:0/1431735409 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fe9c8046040 msgr2=0x7fe9c8029440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:59.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:59.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:59.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:59.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:59.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:59.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:59.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:59.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:59.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 zone default found 2024-09-12T18:09:59.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 4 Realm: () 2024-09-12T18:09:59.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:59.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:59.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:59.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 zonegroup default 2024-09-12T18:09:59.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.002+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.006+0000 7fe9d1bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.006+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.006+0000 7fe9d1bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.006+0000 7fe9d1bc79c0 20 started sync module instance, tier type = 2024-09-12T18:09:59.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.006+0000 7fe9d1bc79c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:59.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.026+0000 7fe9d1bc79c0 20 add_watcher() i=0 2024-09-12T18:09:59.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.026+0000 7fe9d1bc79c0 20 add_watcher() i=1 2024-09-12T18:09:59.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.026+0000 7fe9d1bc79c0 20 add_watcher() i=2 2024-09-12T18:09:59.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.026+0000 7fe9d1bc79c0 20 add_watcher() i=3 2024-09-12T18:09:59.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.026+0000 7fe9d1bc79c0 20 add_watcher() i=4 2024-09-12T18:09:59.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.026+0000 7fe9d1bc79c0 20 add_watcher() i=5 2024-09-12T18:09:59.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.030+0000 7fe9d1bc79c0 20 add_watcher() i=6 2024-09-12T18:09:59.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.030+0000 7fe9d1bc79c0 20 add_watcher() i=7 2024-09-12T18:09:59.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.030+0000 7fe9d1bc79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:59.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.034+0000 7fe885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:59.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.034+0000 7fe9d1bc79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:59.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.034+0000 7fe9d1bc79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:59.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.034+0000 7fe9d1bc79c0 5 note: GC not initialized 2024-09-12T18:09:59.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.034+0000 7fe884fe1640 20 reqs_thread_entry: start 2024-09-12T18:09:59.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:59.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 20 Filter name: none 2024-09-12T18:09:59.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe7fe7fc640 20 reqs_thread_entry: start 2024-09-12T18:09:59.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:09:59.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:59.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:09:59.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:09:59.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : miss 2024-09-12T18:09:59.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:59.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:59.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:59.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:59.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:59.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.038+0000 7fe9d1bc79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:09:59.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.046+0000 7fe9d1bc79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:59.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.046+0000 7fe9d1bc79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:59.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.046+0000 7fe9d1bc79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:59.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.046+0000 7fe9d1bc79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:09:59.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.046+0000 7fe8b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431626 cookie 94257505742992 notifier 8024 bl.length()=827 2024-09-12T18:09:59.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.046+0000 7fe8b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:59.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.046+0000 7fe8b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:59.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.046+0000 7fe8b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:59.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.050+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:09:59.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.050+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:09:59.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.050+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:09:59.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.050+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:09:59.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.062+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.0 2024-09-12T18:09:59.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.062+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.0 2024-09-12T18:09:59.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.062+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:09:59.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.062+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:09:59.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.062+0000 7fe9d1bc79c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T18:09:59.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.062+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:09:59.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.062+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:09:59.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.062+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:09:59.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.062+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:09:59.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.062+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:09:59.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.062+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:09:59.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.066+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:09:59.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.066+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:09:59.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.066+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:09:59.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.066+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:09:59.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.066+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:09:59.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.066+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:09:59.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.070+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:09:59.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.070+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:09:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.070+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:09:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.070+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:09:59.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.070+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:09:59.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.070+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:09:59.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.074+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:09:59.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.074+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:09:59.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.074+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:09:59.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.074+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:09:59.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.074+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:09:59.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.074+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:09:59.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.074+0000 7fe9d1bc79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:59.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.074+0000 7fe9d1bc79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:09:59.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.078+0000 7fe9d1bc79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:59.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.078+0000 7fe9d1bc79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:59.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.078+0000 7fe9d1bc79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:59.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.078+0000 7fe9d1bc79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:09:59.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.078+0000 7fe8b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 94257505742992 notifier 8024 bl.length()=827 2024-09-12T18:09:59.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.078+0000 7fe8b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:59.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.078+0000 7fe8b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:59.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.078+0000 7fe8b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:59.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.082+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:09:59.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.082+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:09:59.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.082+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:09:59.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.082+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:09:59.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:09:59.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.0 2024-09-12T18:09:59.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:09:59.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.1 2024-09-12T18:09:59.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:09:59.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.2 2024-09-12T18:09:59.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:09:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.3 2024-09-12T18:09:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:09:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.4 2024-09-12T18:09:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:09:59.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.5 2024-09-12T18:09:59.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:09:59.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.090+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.6 2024-09-12T18:09:59.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.094+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:09:59.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.094+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.7 2024-09-12T18:09:59.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.094+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:09:59.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.094+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.8 2024-09-12T18:09:59.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.094+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:09:59.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.094+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.9 2024-09-12T18:09:59.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.094+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:09:59.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.094+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.10 2024-09-12T18:09:59.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.098+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:09:59.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.098+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.11 2024-09-12T18:09:59.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.098+0000 7fe9d1bc79c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:09:59.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.098+0000 7fe9d1bc79c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.2.12 2024-09-12T18:09:59.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.098+0000 7fe9d1bc79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:09:59.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.098+0000 7fe9d1bc79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 2024-09-12T18:09:59.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe9d1bc79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:59.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe9d1bc79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:59.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe9d1bc79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:59.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe9d1bc79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17, ofs0, ns] 2024-09-12T18:09:59.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe8b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 94257505742992 notifier 8024 bl.length()=795 2024-09-12T18:09:59.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe8b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 info.flags=0x17 2024-09-12T18:09:59.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe8b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.17 to cache LRU end 2024-09-12T18:09:59.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe8b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:59.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_sources= new_sources= 2024-09-12T18:09:59.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential sources added=[] removed=[] 2024-09-12T18:09:59.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): orig_dests= new_dests= 2024-09-12T18:09:59.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.102+0000 7fe9d1bc79c0 20 handle_bi_update(): bucket=:a-bucket[98539659-fdaf-41ce-847d-239ff89323af.4641.17]): potential dests added=[] removed=[] 2024-09-12T18:09:59.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.110+0000 7fe9d1bc79c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T18:09:59.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.114+0000 7fe885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:59.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.118+0000 7fe9d1bc79c0 20 remove_watcher() i=0 2024-09-12T18:09:59.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.118+0000 7fe9d1bc79c0 2 removed watcher, disabling cache 2024-09-12T18:09:59.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.118+0000 7fe9d1bc79c0 20 remove_watcher() i=1 2024-09-12T18:09:59.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.122+0000 7fe9d1bc79c0 20 remove_watcher() i=2 2024-09-12T18:09:59.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.122+0000 7fe9d1bc79c0 20 remove_watcher() i=3 2024-09-12T18:09:59.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.126+0000 7fe9d1bc79c0 20 remove_watcher() i=4 2024-09-12T18:09:59.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.130+0000 7fe9d1bc79c0 20 remove_watcher() i=5 2024-09-12T18:09:59.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.130+0000 7fe9d1bc79c0 20 remove_watcher() i=6 2024-09-12T18:09:59.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.134+0000 7fe9d1bc79c0 20 remove_watcher() i=7 2024-09-12T18:09:59.153 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T18:09:59.183 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:59.183 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.226+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 20 realm 2024-09-12T18:09:59.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:59.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:59.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:59.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.230+0000 7ff1697999c0 20 searching for the correct realm 2024-09-12T18:09:59.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.238+0000 7ff166a9e640 0 -- 172.21.15.97:0/4256311147 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x558fe2939000 msgr2=0x558fe293b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:59.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.450+0000 7ff166a9e640 0 -- 172.21.15.97:0/4256311147 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x7ff0300805b0 msgr2=0x7ff0300829e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:59.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.462+0000 7ff1697999c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:59.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.462+0000 7ff1697999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:59.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.462+0000 7ff1697999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:59.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.462+0000 7ff1697999c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:59.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.462+0000 7ff1697999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:59.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.462+0000 7ff1697999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:59.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.462+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.462+0000 7ff1697999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.462+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.462+0000 7ff1697999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:59.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.462+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:59.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 20 zone default found 2024-09-12T18:09:59.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 4 Realm: () 2024-09-12T18:09:59.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:59.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:59.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:59.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 20 zonegroup default 2024-09-12T18:09:59.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 20 started sync module instance, tier type = 2024-09-12T18:09:59.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.466+0000 7ff1697999c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:59.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.490+0000 7ff1697999c0 20 add_watcher() i=0 2024-09-12T18:09:59.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.490+0000 7ff1697999c0 20 add_watcher() i=1 2024-09-12T18:09:59.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.490+0000 7ff1697999c0 20 add_watcher() i=2 2024-09-12T18:09:59.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.490+0000 7ff1697999c0 20 add_watcher() i=3 2024-09-12T18:09:59.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.490+0000 7ff1697999c0 20 add_watcher() i=4 2024-09-12T18:09:59.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.490+0000 7ff1697999c0 20 add_watcher() i=5 2024-09-12T18:09:59.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.490+0000 7ff1697999c0 20 add_watcher() i=6 2024-09-12T18:09:59.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.490+0000 7ff1697999c0 20 add_watcher() i=7 2024-09-12T18:09:59.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.490+0000 7ff1697999c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:59.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.498+0000 7ff01dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:59.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.498+0000 7ff1697999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:59.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.498+0000 7ff1697999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:59.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.498+0000 7ff1697999c0 5 note: GC not initialized 2024-09-12T18:09:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.498+0000 7ff01cfe1640 20 reqs_thread_entry: start 2024-09-12T18:09:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.498+0000 7ff1697999c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.498+0000 7ff1697999c0 20 Filter name: none 2024-09-12T18:09:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.498+0000 7fef967fc640 20 reqs_thread_entry: start 2024-09-12T18:09:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.498+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.498+0000 7ff1697999c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:09:59.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.498+0000 7ff1697999c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.502+0000 7ff1697999c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:09:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.502+0000 7ff1697999c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.502+0000 7ff1697999c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T18:09:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.502+0000 7ff1697999c0 20 INFO: main: starting shard=0 2024-09-12T18:09:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.502+0000 7ff1697999c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.0 2024-09-12T18:09:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.502+0000 7ff1697999c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.17.3.0 2024-09-12T18:09:59.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.502+0000 7ff1697999c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:09:59.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.502+0000 7ff1697999c0 20 INFO: main: done 2024-09-12T18:09:59.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.502+0000 7ff01dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:59.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.506+0000 7ff1697999c0 20 remove_watcher() i=0 2024-09-12T18:09:59.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.506+0000 7ff1697999c0 2 removed watcher, disabling cache 2024-09-12T18:09:59.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.510+0000 7ff1697999c0 20 remove_watcher() i=1 2024-09-12T18:09:59.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.510+0000 7ff1697999c0 20 remove_watcher() i=2 2024-09-12T18:09:59.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.514+0000 7ff1697999c0 20 remove_watcher() i=3 2024-09-12T18:09:59.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.514+0000 7ff1697999c0 20 remove_watcher() i=4 2024-09-12T18:09:59.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.518+0000 7ff1697999c0 20 remove_watcher() i=5 2024-09-12T18:09:59.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.522+0000 7ff1697999c0 20 remove_watcher() i=6 2024-09-12T18:09:59.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.522+0000 7ff1697999c0 20 remove_watcher() i=7 2024-09-12T18:09:59.541 INFO:tasks.workunit.client.0.smithi097.stderr: test: PUT succeeds during reshard 2024-09-12T18:09:59.541 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:09:59.572 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:59.572 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:59.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.614+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.618+0000 7feef25be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.618+0000 7feef25be9c0 20 realm 2024-09-12T18:09:59.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.618+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.618+0000 7feef25be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.618+0000 7feef25be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:59.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.618+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.618+0000 7feef25be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.618+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.622+0000 7feef25be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:59.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.622+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.622+0000 7feef25be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:59.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.622+0000 7feef25be9c0 20 searching for the correct realm 2024-09-12T18:09:59.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.626+0000 7feef00c4640 0 -- 172.21.15.97:0/1736692430 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7feee001a040 msgr2=0x7feee0085680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:59.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.634+0000 7feef00c4640 0 -- 172.21.15.97:0/1736692430 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7feee800e040 msgr2=0x7feee803b920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:59.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.638+0000 7feef25be9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:59.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.638+0000 7feef25be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:59.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.638+0000 7feef25be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:59.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.638+0000 7feef25be9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:59.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.638+0000 7feef25be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:59.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.638+0000 7feef25be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:59.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.638+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:59.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:59.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 zone default found 2024-09-12T18:09:59.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 4 Realm: () 2024-09-12T18:09:59.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:59.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:59.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:59.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 zonegroup default 2024-09-12T18:09:59.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 started sync module instance, tier type = 2024-09-12T18:09:59.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.642+0000 7feef25be9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:59.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.662+0000 7feef25be9c0 20 add_watcher() i=0 2024-09-12T18:09:59.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.662+0000 7feef25be9c0 20 add_watcher() i=1 2024-09-12T18:09:59.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.662+0000 7feef25be9c0 20 add_watcher() i=2 2024-09-12T18:09:59.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.662+0000 7feef25be9c0 20 add_watcher() i=3 2024-09-12T18:09:59.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.662+0000 7feef25be9c0 20 add_watcher() i=4 2024-09-12T18:09:59.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.662+0000 7feef25be9c0 20 add_watcher() i=5 2024-09-12T18:09:59.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.662+0000 7feef25be9c0 20 add_watcher() i=6 2024-09-12T18:09:59.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.662+0000 7feef25be9c0 20 add_watcher() i=7 2024-09-12T18:09:59.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.662+0000 7feef25be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:59.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.666+0000 7feda6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:59.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.666+0000 7feef25be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:59.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.666+0000 7feef25be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:59.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.666+0000 7feef25be9c0 5 note: GC not initialized 2024-09-12T18:09:59.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.666+0000 7feda5fdb640 20 reqs_thread_entry: start 2024-09-12T18:09:59.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.666+0000 7feef25be9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:59.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.666+0000 7feef25be9c0 20 Filter name: none 2024-09-12T18:09:59.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.666+0000 7fed177fe640 20 reqs_thread_entry: start 2024-09-12T18:09:59.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.666+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.670+0000 7feef25be9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:59.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.670+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.670+0000 7feef25be9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:59.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.670+0000 7feef25be9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:59.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.670+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.670+0000 7feef25be9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:59.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.670+0000 7feef25be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.670+0000 7feef25be9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:59.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.670+0000 7feef25be9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:09:59.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.674+0000 7feda6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:59.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.678+0000 7feef25be9c0 20 remove_watcher() i=0 2024-09-12T18:09:59.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.678+0000 7feef25be9c0 2 removed watcher, disabling cache 2024-09-12T18:09:59.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.678+0000 7feef25be9c0 20 remove_watcher() i=1 2024-09-12T18:09:59.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.682+0000 7feef25be9c0 20 remove_watcher() i=2 2024-09-12T18:09:59.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.682+0000 7feef25be9c0 20 remove_watcher() i=3 2024-09-12T18:09:59.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.686+0000 7feef25be9c0 20 remove_watcher() i=4 2024-09-12T18:09:59.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.686+0000 7feef25be9c0 20 remove_watcher() i=5 2024-09-12T18:09:59.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.690+0000 7feef25be9c0 20 remove_watcher() i=6 2024-09-12T18:09:59.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.690+0000 7feef25be9c0 20 remove_watcher() i=7 2024-09-12T18:09:59.707 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:59.707 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-12T18:09:59.707 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: myver id: 98539659-fdaf-41ce-847d-239ff89323af.4641.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T18:09:59.707 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:09:59.707 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T18:09:59.738 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:09:59.738 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:09:59.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.778+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.782+0000 7f7cc254b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.782+0000 7f7cc254b9c0 20 realm 2024-09-12T18:09:59.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.782+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.782+0000 7f7cc254b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.782+0000 7f7cc254b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:09:59.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.782+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.782+0000 7f7cc254b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.782+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.786+0000 7f7cc254b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:59.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.786+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.786+0000 7f7cc254b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:09:59.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.786+0000 7f7cc254b9c0 20 searching for the correct realm 2024-09-12T18:09:59.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.794+0000 7f7cc0852640 0 -- 172.21.15.97:0/3592450999 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x56199950cea0 msgr2=0x56199950f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:59.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.798+0000 7f7cbf850640 0 -- 172.21.15.97:0/3592450999 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x5619995148d0 msgr2=0x561999516cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:09:59.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.802+0000 7f7cc254b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:09:59.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.802+0000 7f7cc254b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:09:59.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.802+0000 7f7cc254b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:09:59.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.802+0000 7f7cc254b9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:09:59.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.802+0000 7f7cc254b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:09:59.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.802+0000 7f7cc254b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:09:59.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.802+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:09:59.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:09:59.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 zone default found 2024-09-12T18:09:59.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 4 Realm: () 2024-09-12T18:09:59.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:09:59.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:09:59.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:09:59.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 zonegroup default 2024-09-12T18:09:59.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:09:59.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 started sync module instance, tier type = 2024-09-12T18:09:59.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.806+0000 7f7cc254b9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:09:59.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.826+0000 7f7cc254b9c0 20 add_watcher() i=0 2024-09-12T18:09:59.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.826+0000 7f7cc254b9c0 20 add_watcher() i=1 2024-09-12T18:09:59.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.826+0000 7f7cc254b9c0 20 add_watcher() i=2 2024-09-12T18:09:59.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.826+0000 7f7cc254b9c0 20 add_watcher() i=3 2024-09-12T18:09:59.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.826+0000 7f7cc254b9c0 20 add_watcher() i=4 2024-09-12T18:09:59.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.826+0000 7f7cc254b9c0 20 add_watcher() i=5 2024-09-12T18:09:59.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.826+0000 7f7cc254b9c0 20 add_watcher() i=6 2024-09-12T18:09:59.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.826+0000 7f7cc254b9c0 20 add_watcher() i=7 2024-09-12T18:09:59.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.826+0000 7f7cc254b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:09:59.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.830+0000 7f7b777de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:09:59.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.830+0000 7f7cc254b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:09:59.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.830+0000 7f7cc254b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:09:59.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.830+0000 7f7cc254b9c0 5 note: GC not initialized 2024-09-12T18:09:59.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.830+0000 7f7b767dc640 20 reqs_thread_entry: start 2024-09-12T18:09:59.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.830+0000 7f7cc254b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:09:59.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.830+0000 7f7cc254b9c0 20 Filter name: none 2024-09-12T18:09:59.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.830+0000 7f7b6f7fe640 20 reqs_thread_entry: start 2024-09-12T18:09:59.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.830+0000 7f7cc254b9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:09:59.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.830+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.834+0000 7f7cc254b9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:09:59.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.834+0000 7f7cc254b9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:09:59.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.834+0000 7f7cc254b9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:09:59.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.834+0000 7f7cc254b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 : miss 2024-09-12T18:09:59.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.834+0000 7f7cc254b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:09:59.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.834+0000 7f7cc254b9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:09:59.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.834+0000 7f7cc254b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:09:59.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.834+0000 7f7cc254b9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:09:59.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.834+0000 7f7cc254b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:09:59.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.834+0000 7f7cc254b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:59.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.834+0000 7f7cc254b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 2024-09-12T18:09:59.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.842+0000 7f7cc254b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:09:59.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.842+0000 7f7cc254b9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:09:59.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.842+0000 7f7cc254b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:59.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.842+0000 7f7cc254b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18, ofs0, ns] 2024-09-12T18:09:59.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.842+0000 7f7b96ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431663 cookie 94667946383136 notifier 8078 bl.length()=821 2024-09-12T18:09:59.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.842+0000 7f7b96ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:09:59.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.842+0000 7f7b96ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:09:59.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.842+0000 7f7b96ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:09:59.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.846+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_sources= new_sources= 2024-09-12T18:09:59.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.846+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential sources added=[] removed=[] 2024-09-12T18:09:59.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.846+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_dests= new_dests= 2024-09-12T18:09:59.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.846+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential dests added=[] removed=[] 2024-09-12T18:09:59.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:09:59.858+0000 7f7cc254b9c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T18:10:00.712 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:00.712 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:00.861 INFO:tasks.workunit.client.0.smithi097.stderr:put object successful 2024-09-12T18:10:04.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:04.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:04.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.0 2024-09-12T18:10:04.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.0 2024-09-12T18:10:04.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.1 2024-09-12T18:10:04.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.1 2024-09-12T18:10:04.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.2 2024-09-12T18:10:04.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.2 2024-09-12T18:10:04.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.3 2024-09-12T18:10:04.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.862+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.3 2024-09-12T18:10:04.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.866+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.4 2024-09-12T18:10:04.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.866+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.4 2024-09-12T18:10:04.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.866+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.5 2024-09-12T18:10:04.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.866+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.5 2024-09-12T18:10:04.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.866+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.6 2024-09-12T18:10:04.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.866+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.6 2024-09-12T18:10:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.870+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.7 2024-09-12T18:10:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.870+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.7 2024-09-12T18:10:04.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.870+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.8 2024-09-12T18:10:04.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.870+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.8 2024-09-12T18:10:04.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.870+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.9 2024-09-12T18:10:04.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.870+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.9 2024-09-12T18:10:04.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.874+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.10 2024-09-12T18:10:04.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.874+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.10 2024-09-12T18:10:04.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.874+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.11 2024-09-12T18:10:04.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.874+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.11 2024-09-12T18:10:04.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.878+0000 7f7cc254b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:10:04.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.878+0000 7f7cc254b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 2024-09-12T18:10:04.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.882+0000 7f7cc254b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:04.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.882+0000 7f7cc254b9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:04.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.882+0000 7f7cc254b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:04.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.882+0000 7f7cc254b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18, ofs0, ns] 2024-09-12T18:10:04.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.882+0000 7f7b977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431664 cookie 94667946383136 notifier 8078 bl.length()=821 2024-09-12T18:10:04.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.882+0000 7f7b977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:04.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.882+0000 7f7b977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:04.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.882+0000 7f7b977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.886+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_sources= new_sources= 2024-09-12T18:10:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.886+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential sources added=[] removed=[] 2024-09-12T18:10:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.886+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_dests= new_dests= 2024-09-12T18:10:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.886+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential dests added=[] removed=[] 2024-09-12T18:10:04.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.894+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.0 2024-09-12T18:10:04.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.894+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.0 2024-09-12T18:10:04.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.894+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.1 2024-09-12T18:10:04.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.894+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.1 2024-09-12T18:10:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.898+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.2 2024-09-12T18:10:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.898+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.2 2024-09-12T18:10:04.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.898+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.3 2024-09-12T18:10:04.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.898+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.3 2024-09-12T18:10:04.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.898+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.4 2024-09-12T18:10:04.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.898+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.4 2024-09-12T18:10:04.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.898+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.5 2024-09-12T18:10:04.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.898+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.5 2024-09-12T18:10:04.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.902+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.6 2024-09-12T18:10:04.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.902+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.6 2024-09-12T18:10:04.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.902+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.7 2024-09-12T18:10:04.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.902+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.7 2024-09-12T18:10:04.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.902+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.8 2024-09-12T18:10:04.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.902+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.8 2024-09-12T18:10:04.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.902+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.9 2024-09-12T18:10:04.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.902+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.9 2024-09-12T18:10:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.906+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.10 2024-09-12T18:10:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.906+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.10 2024-09-12T18:10:04.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.906+0000 7f7cc254b9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.11 2024-09-12T18:10:04.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.906+0000 7f7cc254b9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.1.11 2024-09-12T18:10:04.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.910+0000 7f7cc254b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:10:04.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.910+0000 7f7cc254b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 2024-09-12T18:10:04.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.914+0000 7f7cc254b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:04.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.914+0000 7f7cc254b9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:04.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.914+0000 7f7cc254b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:04.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.914+0000 7f7cc254b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18, ofs0, ns] 2024-09-12T18:10:04.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.914+0000 7f7b977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431665 cookie 94667946383136 notifier 8078 bl.length()=789 2024-09-12T18:10:04.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.914+0000 7f7b977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:04.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.914+0000 7f7b977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:04.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.914+0000 7f7b977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:04.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.918+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_sources= new_sources= 2024-09-12T18:10:04.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.918+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential sources added=[] removed=[] 2024-09-12T18:10:04.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.918+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_dests= new_dests= 2024-09-12T18:10:04.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.918+0000 7f7cc254b9c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential dests added=[] removed=[] 2024-09-12T18:10:04.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.926+0000 7f7cc254b9c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T18:10:04.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.930+0000 7f7b777de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:04.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.934+0000 7f7cc254b9c0 20 remove_watcher() i=0 2024-09-12T18:10:04.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.934+0000 7f7cc254b9c0 2 removed watcher, disabling cache 2024-09-12T18:10:04.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.938+0000 7f7cc254b9c0 20 remove_watcher() i=1 2024-09-12T18:10:04.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.938+0000 7f7cc254b9c0 20 remove_watcher() i=2 2024-09-12T18:10:04.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.942+0000 7f7cc254b9c0 20 remove_watcher() i=3 2024-09-12T18:10:04.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.946+0000 7f7cc254b9c0 20 remove_watcher() i=4 2024-09-12T18:10:04.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.946+0000 7f7cc254b9c0 20 remove_watcher() i=5 2024-09-12T18:10:04.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.950+0000 7f7cc254b9c0 20 remove_watcher() i=6 2024-09-12T18:10:04.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:04.954+0000 7f7cc254b9c0 20 remove_watcher() i=7 2024-09-12T18:10:05.866 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T18:10:05.866 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T18:10:05.871 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:05.871 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:05.968 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:05.969 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:06.127 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:06.127 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:06.267 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:06.268 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:06.343 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:06.343 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:06.473 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:06.473 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:06.542 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:06.542 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:06.683 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:06.683 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:06.749 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:10:07.195 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T18:10:08.634 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:08.635 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:08.795 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:10:08.796 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T18:10:08.831 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:08.831 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:08.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.874+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:08.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.878+0000 7fe31754d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:08.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.878+0000 7fe31754d9c0 20 realm 2024-09-12T18:10:08.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.878+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:08.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.878+0000 7fe31754d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:08.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.878+0000 7fe31754d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:08.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.878+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:08.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.878+0000 7fe31754d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:08.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.878+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:08.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.878+0000 7fe31754d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:08.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.878+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:08.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.882+0000 7fe31754d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:08.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.882+0000 7fe31754d9c0 20 searching for the correct realm 2024-09-12T18:10:08.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:08.886+0000 7fe314852640 0 -- 172.21.15.97:0/277043009 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fe3080efb70 msgr2=0x7fe3080db400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:09.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.098+0000 7fe315854640 0 -- 172.21.15.97:0/277043009 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x555906f96880 msgr2=0x555906f98cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:09.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.110+0000 7fe31754d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:10:09.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.110+0000 7fe31754d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:09.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.110+0000 7fe31754d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:09.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.110+0000 7fe31754d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:10:09.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.110+0000 7fe31754d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:09.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.110+0000 7fe31754d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:09.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.110+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:09.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:09.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 20 zone default found 2024-09-12T18:10:09.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 4 Realm: () 2024-09-12T18:10:09.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:10:09.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:10:09.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:09.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 20 zonegroup default 2024-09-12T18:10:09.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.114+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.118+0000 7fe31754d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.118+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.118+0000 7fe31754d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.118+0000 7fe31754d9c0 20 started sync module instance, tier type = 2024-09-12T18:10:09.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.118+0000 7fe31754d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:10:09.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.138+0000 7fe31754d9c0 20 add_watcher() i=0 2024-09-12T18:10:09.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.138+0000 7fe31754d9c0 20 add_watcher() i=1 2024-09-12T18:10:09.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.138+0000 7fe31754d9c0 20 add_watcher() i=2 2024-09-12T18:10:09.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.138+0000 7fe31754d9c0 20 add_watcher() i=3 2024-09-12T18:10:09.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.138+0000 7fe31754d9c0 20 add_watcher() i=4 2024-09-12T18:10:09.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.138+0000 7fe31754d9c0 20 add_watcher() i=5 2024-09-12T18:10:09.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.138+0000 7fe31754d9c0 20 add_watcher() i=6 2024-09-12T18:10:09.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.142+0000 7fe31754d9c0 20 add_watcher() i=7 2024-09-12T18:10:09.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.142+0000 7fe31754d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:09.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.146+0000 7fe1cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:09.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.146+0000 7fe31754d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:09.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.146+0000 7fe31754d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:09.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.146+0000 7fe31754d9c0 5 note: GC not initialized 2024-09-12T18:10:09.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe1ca7e4640 20 reqs_thread_entry: start 2024-09-12T18:10:09.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:10:09.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 Filter name: none 2024-09-12T18:10:09.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe13bfff640 20 reqs_thread_entry: start 2024-09-12T18:10:09.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:10:09.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:10:09.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:10:09.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:10:09.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 INFO: main: starting shard=0 2024-09-12T18:10:09.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:09.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:09.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 INFO: main: starting shard=1 2024-09-12T18:10:09.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:09.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.150+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:09.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 INFO: main: starting shard=2 2024-09-12T18:10:09.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:09.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:09.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 INFO: main: starting shard=3 2024-09-12T18:10:09.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:09.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:09.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 INFO: main: starting shard=4 2024-09-12T18:10:09.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:09.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:09.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 INFO: main: starting shard=5 2024-09-12T18:10:09.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:09.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:09.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:10:09.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 INFO: main: starting shard=6 2024-09-12T18:10:09.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:09.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.154+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:09.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 20 INFO: main: starting shard=7 2024-09-12T18:10:09.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:09.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:09.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 20 INFO: main: starting shard=8 2024-09-12T18:10:09.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:09.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:09.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 20 INFO: main: starting shard=9 2024-09-12T18:10:09.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:09.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.158+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:09.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 20 INFO: main: starting shard=10 2024-09-12T18:10:09.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:09.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:09.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 20 INFO: main: starting shard=11 2024-09-12T18:10:09.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:09.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:09.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 20 INFO: main: starting shard=12 2024-09-12T18:10:09.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:09.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:09.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.162+0000 7fe31754d9c0 20 INFO: main: done 2024-09-12T18:10:09.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.166+0000 7fe1cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:09.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.170+0000 7fe31754d9c0 20 remove_watcher() i=0 2024-09-12T18:10:09.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.170+0000 7fe31754d9c0 2 removed watcher, disabling cache 2024-09-12T18:10:09.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.170+0000 7fe31754d9c0 20 remove_watcher() i=1 2024-09-12T18:10:09.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.174+0000 7fe31754d9c0 20 remove_watcher() i=2 2024-09-12T18:10:09.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.174+0000 7fe31754d9c0 20 remove_watcher() i=3 2024-09-12T18:10:09.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.178+0000 7fe31754d9c0 20 remove_watcher() i=4 2024-09-12T18:10:09.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.182+0000 7fe31754d9c0 20 remove_watcher() i=5 2024-09-12T18:10:09.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.182+0000 7fe31754d9c0 20 remove_watcher() i=6 2024-09-12T18:10:09.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.186+0000 7fe31754d9c0 20 remove_watcher() i=7 2024-09-12T18:10:09.204 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:09.205 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:09.232 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:09.233 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:09.355 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:10:09.355 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T18:10:09.391 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:09.391 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:09.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.434+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.438+0000 7f15c10b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.438+0000 7f15c10b89c0 20 realm 2024-09-12T18:10:09.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.438+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.438+0000 7f15c10b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.438+0000 7f15c10b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:09.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.438+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.438+0000 7f15c10b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.438+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.438+0000 7f15c10b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:09.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.438+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.442+0000 7f15c10b89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:09.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.442+0000 7f15c10b89c0 20 searching for the correct realm 2024-09-12T18:10:09.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.446+0000 7f15bebbe640 0 -- 172.21.15.97:0/1520729686 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f15b00489a0 msgr2=0x7f15b007d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:09.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.454+0000 7f15bebbe640 0 -- 172.21.15.97:0/1520729686 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f15b80da070 msgr2=0x7f15b812fa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:09.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.458+0000 7f15c10b89c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:10:09.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.458+0000 7f15c10b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:09.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.458+0000 7f15c10b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:09.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.458+0000 7f15c10b89c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:10:09.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.458+0000 7f15c10b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:09.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.458+0000 7f15c10b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:09.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.458+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:09.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:09.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 zone default found 2024-09-12T18:10:09.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 4 Realm: () 2024-09-12T18:10:09.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:10:09.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:10:09.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:09.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 zonegroup default 2024-09-12T18:10:09.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 started sync module instance, tier type = 2024-09-12T18:10:09.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.462+0000 7f15c10b89c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:10:09.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.482+0000 7f15c10b89c0 20 add_watcher() i=0 2024-09-12T18:10:09.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.482+0000 7f15c10b89c0 20 add_watcher() i=1 2024-09-12T18:10:09.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.482+0000 7f15c10b89c0 20 add_watcher() i=2 2024-09-12T18:10:09.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.482+0000 7f15c10b89c0 20 add_watcher() i=3 2024-09-12T18:10:09.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.482+0000 7f15c10b89c0 20 add_watcher() i=4 2024-09-12T18:10:09.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.482+0000 7f15c10b89c0 20 add_watcher() i=5 2024-09-12T18:10:09.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.482+0000 7f15c10b89c0 20 add_watcher() i=6 2024-09-12T18:10:09.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.482+0000 7f15c10b89c0 20 add_watcher() i=7 2024-09-12T18:10:09.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.482+0000 7f15c10b89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:09.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.486+0000 7f1475fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:09.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.486+0000 7f15c10b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:09.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.486+0000 7f15c10b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:09.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.486+0000 7f15c10b89c0 5 note: GC not initialized 2024-09-12T18:10:09.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.486+0000 7f1474fe1640 20 reqs_thread_entry: start 2024-09-12T18:10:09.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.486+0000 7f15c10b89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:10:09.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.486+0000 7f15c10b89c0 20 Filter name: none 2024-09-12T18:10:09.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.486+0000 7f146dffb640 20 reqs_thread_entry: start 2024-09-12T18:10:09.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:10:09.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:10:09.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:10:09.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:10:09.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 INFO: main: starting shard=0 2024-09-12T18:10:09.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:09.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:09.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 INFO: main: starting shard=1 2024-09-12T18:10:09.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:09.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:09.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 INFO: main: starting shard=2 2024-09-12T18:10:09.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:09.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:09.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 INFO: main: starting shard=3 2024-09-12T18:10:09.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:09.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.490+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:09.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 INFO: main: starting shard=4 2024-09-12T18:10:09.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:09.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:09.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 INFO: main: starting shard=5 2024-09-12T18:10:09.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:09.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:09.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 INFO: main: starting shard=6 2024-09-12T18:10:09.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:09.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:09.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 INFO: main: starting shard=7 2024-09-12T18:10:09.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:09.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:09.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 INFO: main: starting shard=8 2024-09-12T18:10:09.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:09.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.494+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:09.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 20 INFO: main: starting shard=9 2024-09-12T18:10:09.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:09.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:09.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:10:09.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 20 INFO: main: starting shard=10 2024-09-12T18:10:09.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:09.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:09.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 20 INFO: main: starting shard=11 2024-09-12T18:10:09.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:09.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.498+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:09.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.502+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.502+0000 7f15c10b89c0 20 INFO: main: starting shard=12 2024-09-12T18:10:09.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.502+0000 7f15c10b89c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:09.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.502+0000 7f15c10b89c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:09.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.502+0000 7f15c10b89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.502+0000 7f15c10b89c0 20 INFO: main: done 2024-09-12T18:10:09.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.502+0000 7f1475fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:09.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.506+0000 7f15c10b89c0 20 remove_watcher() i=0 2024-09-12T18:10:09.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.506+0000 7f15c10b89c0 2 removed watcher, disabling cache 2024-09-12T18:10:09.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.510+0000 7f15c10b89c0 20 remove_watcher() i=1 2024-09-12T18:10:09.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.510+0000 7f15c10b89c0 20 remove_watcher() i=2 2024-09-12T18:10:09.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.514+0000 7f15c10b89c0 20 remove_watcher() i=3 2024-09-12T18:10:09.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.514+0000 7f15c10b89c0 20 remove_watcher() i=4 2024-09-12T18:10:09.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.518+0000 7f15c10b89c0 20 remove_watcher() i=5 2024-09-12T18:10:09.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.522+0000 7f15c10b89c0 20 remove_watcher() i=6 2024-09-12T18:10:09.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.522+0000 7f15c10b89c0 20 remove_watcher() i=7 2024-09-12T18:10:09.541 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:09.541 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:09.568 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:09.568 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:09.667 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:10:09.667 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T18:10:09.702 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:09.702 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:09.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.742+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.746+0000 7f16888709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.746+0000 7f16888709c0 20 realm 2024-09-12T18:10:09.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.746+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.746+0000 7f16888709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.746+0000 7f16888709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:09.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.746+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.746+0000 7f16888709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.746+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.746+0000 7f16888709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:09.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.746+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.750+0000 7f16888709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:09.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.750+0000 7f16888709c0 20 searching for the correct realm 2024-09-12T18:10:09.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.754+0000 7f1686376640 0 -- 172.21.15.97:0/790875833 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f167807d040 msgr2=0x7f1678022470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:09.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.762+0000 7f1686376640 0 -- 172.21.15.97:0/790875833 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f16800ceb80 msgr2=0x7f16800d7910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.766+0000 7f16888709c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:10:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.766+0000 7f16888709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.766+0000 7f16888709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:10:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 zone default found 2024-09-12T18:10:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 4 Realm: () 2024-09-12T18:10:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:10:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:10:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 zonegroup default 2024-09-12T18:10:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:09.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 started sync module instance, tier type = 2024-09-12T18:10:09.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.770+0000 7f16888709c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:10:09.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.790+0000 7f16888709c0 20 add_watcher() i=0 2024-09-12T18:10:09.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.790+0000 7f16888709c0 20 add_watcher() i=1 2024-09-12T18:10:09.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.790+0000 7f16888709c0 20 add_watcher() i=2 2024-09-12T18:10:09.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.790+0000 7f16888709c0 20 add_watcher() i=3 2024-09-12T18:10:09.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.790+0000 7f16888709c0 20 add_watcher() i=4 2024-09-12T18:10:09.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.790+0000 7f16888709c0 20 add_watcher() i=5 2024-09-12T18:10:09.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.790+0000 7f16888709c0 20 add_watcher() i=6 2024-09-12T18:10:09.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.794+0000 7f16888709c0 20 add_watcher() i=7 2024-09-12T18:10:09.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.794+0000 7f16888709c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:09.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f153cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:09.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:09.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:09.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 5 note: GC not initialized 2024-09-12T18:10:09.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f14b77fe640 20 reqs_thread_entry: start 2024-09-12T18:10:09.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 init_complete bucket index max shards: 11 2024-09-12T18:10:09.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 Filter name: none 2024-09-12T18:10:09.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f14b57fa640 20 reqs_thread_entry: start 2024-09-12T18:10:09.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:10:09.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:09.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:10:09.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:10:09.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:10:09.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 INFO: main: starting shard=0 2024-09-12T18:10:09.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:09.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:09.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:10:09.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 INFO: main: starting shard=1 2024-09-12T18:10:09.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:09.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:09.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 INFO: main: starting shard=2 2024-09-12T18:10:09.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:09.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.798+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:09.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 20 INFO: main: starting shard=3 2024-09-12T18:10:09.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:09.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:09.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 20 INFO: main: starting shard=4 2024-09-12T18:10:09.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:09.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:09.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 20 INFO: main: starting shard=5 2024-09-12T18:10:09.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:09.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.802+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:09.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 INFO: main: starting shard=6 2024-09-12T18:10:09.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:09.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:09.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 INFO: main: starting shard=7 2024-09-12T18:10:09.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:09.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:09.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 INFO: main: starting shard=8 2024-09-12T18:10:09.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:09.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:09.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 INFO: main: starting shard=9 2024-09-12T18:10:09.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:09.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.806+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:09.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 20 INFO: main: starting shard=10 2024-09-12T18:10:09.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:09.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:09.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 20 INFO: main: starting shard=11 2024-09-12T18:10:09.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:09.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:09.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 20 INFO: main: starting shard=12 2024-09-12T18:10:09.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:09.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:09.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:09.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.810+0000 7f16888709c0 20 INFO: main: done 2024-09-12T18:10:09.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.814+0000 7f153cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:09.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.818+0000 7f16888709c0 20 remove_watcher() i=0 2024-09-12T18:10:09.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.818+0000 7f16888709c0 2 removed watcher, disabling cache 2024-09-12T18:10:09.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.818+0000 7f16888709c0 20 remove_watcher() i=1 2024-09-12T18:10:09.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.822+0000 7f16888709c0 20 remove_watcher() i=2 2024-09-12T18:10:09.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.822+0000 7f16888709c0 20 remove_watcher() i=3 2024-09-12T18:10:09.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.826+0000 7f16888709c0 20 remove_watcher() i=4 2024-09-12T18:10:09.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.826+0000 7f16888709c0 20 remove_watcher() i=5 2024-09-12T18:10:09.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.830+0000 7f16888709c0 20 remove_watcher() i=6 2024-09-12T18:10:09.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:09.834+0000 7f16888709c0 20 remove_watcher() i=7 2024-09-12T18:10:09.851 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:09.851 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:09.877 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:10:10.305 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T18:10:10.740 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T18:10:10.774 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:10.774 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:10.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.814+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.814+0000 7ffb828b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:10.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.814+0000 7ffb828b29c0 20 realm 2024-09-12T18:10:10.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.814+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.814+0000 7ffb828b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:10.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.814+0000 7ffb828b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:10.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.814+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.818+0000 7ffb828b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:10.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.818+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.818+0000 7ffb828b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:10.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.818+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.818+0000 7ffb828b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:10.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.818+0000 7ffb828b29c0 20 searching for the correct realm 2024-09-12T18:10:10.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.826+0000 7ffb80bb9640 0 -- 172.21.15.97:0/2673367794 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7ffb74023070 msgr2=0x7ffb74047ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:10.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.830+0000 7ffb803b8640 0 -- 172.21.15.97:0/2673367794 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7ffb78088f30 msgr2=0x7ffb780879a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:10.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:10:10.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:10.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:10.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:10:10.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:10.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:10.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:10.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:10.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:10.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 zone default found 2024-09-12T18:10:10.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 4 Realm: () 2024-09-12T18:10:10.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:10:10.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:10:10.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:10.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 zonegroup default 2024-09-12T18:10:10.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:10.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:10.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.838+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.842+0000 7ffb828b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:10.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.842+0000 7ffb828b29c0 20 started sync module instance, tier type = 2024-09-12T18:10:10.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.842+0000 7ffb828b29c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:10:10.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.858+0000 7ffb828b29c0 20 add_watcher() i=0 2024-09-12T18:10:10.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.858+0000 7ffb828b29c0 20 add_watcher() i=1 2024-09-12T18:10:10.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.858+0000 7ffb828b29c0 20 add_watcher() i=2 2024-09-12T18:10:10.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.858+0000 7ffb828b29c0 20 add_watcher() i=3 2024-09-12T18:10:10.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.858+0000 7ffb828b29c0 20 add_watcher() i=4 2024-09-12T18:10:10.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.858+0000 7ffb828b29c0 20 add_watcher() i=5 2024-09-12T18:10:10.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.858+0000 7ffb828b29c0 20 add_watcher() i=6 2024-09-12T18:10:10.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ffb828b29c0 20 add_watcher() i=7 2024-09-12T18:10:10.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ffb828b29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:10.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ffa36fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:10.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ffb828b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:10.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ffb828b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:10.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ffb828b29c0 5 note: GC not initialized 2024-09-12T18:10:10.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ffa35fdb640 20 reqs_thread_entry: start 2024-09-12T18:10:10.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ffb828b29c0 20 init_complete bucket index max shards: 11 2024-09-12T18:10:10.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ffb828b29c0 20 Filter name: none 2024-09-12T18:10:10.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ff9a77fe640 20 reqs_thread_entry: start 2024-09-12T18:10:10.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ffb828b29c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:10:10.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.862+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.866+0000 7ffb828b29c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:10:10.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.866+0000 7ffb828b29c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:10:10.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.866+0000 7ffb828b29c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:10:10.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.866+0000 7ffb828b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 : miss 2024-09-12T18:10:10.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.866+0000 7ffb828b29c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:10.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.866+0000 7ffb828b29c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:10:10.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.866+0000 7ffb828b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:10.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.866+0000 7ffb828b29c0 10 adding default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:10.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.866+0000 7ffb828b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:10:10.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.866+0000 7ffb828b29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:10.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.866+0000 7ffb828b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 2024-09-12T18:10:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.878+0000 7ffb828b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.878+0000 7ffb828b29c0 10 moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.878+0000 7ffb828b29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.878+0000 7ffb828b29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18, ofs0, ns] 2024-09-12T18:10:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.878+0000 7ffa56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431666 cookie 94250921658288 notifier 8174 bl.length()=821 2024-09-12T18:10:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.878+0000 7ffa56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:10.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.878+0000 7ffa56ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:10.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.878+0000 7ffa56ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:10.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.882+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_sources= new_sources= 2024-09-12T18:10:10.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.882+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential sources added=[] removed=[] 2024-09-12T18:10:10.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.882+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_dests= new_dests= 2024-09-12T18:10:10.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.882+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential dests added=[] removed=[] 2024-09-12T18:10:10.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.0 2024-09-12T18:10:10.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.0 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.1 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.1 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.2 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.2 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.3 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.3 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.4 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.4 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.5 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.5 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.6 2024-09-12T18:10:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.6 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.7 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.7 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.8 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.8 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.10 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.10 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.11 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.11 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.12 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.12 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.13 2024-09-12T18:10:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.13 2024-09-12T18:10:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.14 2024-09-12T18:10:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.14 2024-09-12T18:10:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.15 2024-09-12T18:10:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.15 2024-09-12T18:10:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.16 2024-09-12T18:10:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.16 2024-09-12T18:10:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.890+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.894+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.894+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.894+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.894+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.894+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.894+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.894+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.894+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:10.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.898+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:10.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.898+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:10.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.898+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:10.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.898+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.898+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.898+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:10.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.902+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:10.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.902+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:10.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.902+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:10.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.902+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:10.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.902+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:10.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.902+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:10.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.906+0000 7ffb828b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:10:10.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.906+0000 7ffb828b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 2024-09-12T18:10:10.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.906+0000 7ffb828b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:10.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.906+0000 7ffb828b29c0 10 moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:10.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.906+0000 7ffb828b29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:10.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.906+0000 7ffb828b29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18, ofs0, ns] 2024-09-12T18:10:10.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.910+0000 7ffa577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431667 cookie 94250921658288 notifier 8174 bl.length()=821 2024-09-12T18:10:10.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.910+0000 7ffa577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:10.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.910+0000 7ffa577fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:10.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.910+0000 7ffa577fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:10.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.910+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_sources= new_sources= 2024-09-12T18:10:10.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.910+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential sources added=[] removed=[] 2024-09-12T18:10:10.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.910+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_dests= new_dests= 2024-09-12T18:10:10.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.910+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential dests added=[] removed=[] 2024-09-12T18:10:10.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.914+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:10.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.914+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.0 2024-09-12T18:10:10.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.914+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:10.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.914+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.1 2024-09-12T18:10:10.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.914+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:10.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.914+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.2 2024-09-12T18:10:10.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:10.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.3 2024-09-12T18:10:10.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:10.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.4 2024-09-12T18:10:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.5 2024-09-12T18:10:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.6 2024-09-12T18:10:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:10.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.7 2024-09-12T18:10:10.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:10.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.8 2024-09-12T18:10:10.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:10.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.9 2024-09-12T18:10:10.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:10.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.918+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.10 2024-09-12T18:10:10.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:10.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.11 2024-09-12T18:10:10.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffb828b29c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:10.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffb828b29c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.2.12 2024-09-12T18:10:10.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffb828b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:10:10.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffb828b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 2024-09-12T18:10:10.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffb828b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:10.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffb828b29c0 10 moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:10.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffb828b29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:10.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffb828b29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18, ofs0, ns] 2024-09-12T18:10:10.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffa56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431668 cookie 94250921658288 notifier 8174 bl.length()=789 2024-09-12T18:10:10.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffa56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:10.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffa56ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:10.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.922+0000 7ffa56ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:10.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.926+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_sources= new_sources= 2024-09-12T18:10:10.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.926+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential sources added=[] removed=[] 2024-09-12T18:10:10.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.926+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): orig_dests= new_dests= 2024-09-12T18:10:10.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.926+0000 7ffb828b29c0 20 handle_bi_update(): bucket=:myver[98539659-fdaf-41ce-847d-239ff89323af.4641.18]): potential dests added=[] removed=[] 2024-09-12T18:10:10.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.930+0000 7ffb828b29c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T18:10:10.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.934+0000 7ffa36fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:10.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.934+0000 7ffb828b29c0 20 remove_watcher() i=0 2024-09-12T18:10:10.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.934+0000 7ffb828b29c0 2 removed watcher, disabling cache 2024-09-12T18:10:10.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.938+0000 7ffb828b29c0 20 remove_watcher() i=1 2024-09-12T18:10:10.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.938+0000 7ffb828b29c0 20 remove_watcher() i=2 2024-09-12T18:10:10.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.942+0000 7ffb828b29c0 20 remove_watcher() i=3 2024-09-12T18:10:10.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.942+0000 7ffb828b29c0 20 remove_watcher() i=4 2024-09-12T18:10:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.946+0000 7ffb828b29c0 20 remove_watcher() i=5 2024-09-12T18:10:10.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.946+0000 7ffb828b29c0 20 remove_watcher() i=6 2024-09-12T18:10:10.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:10.950+0000 7ffb828b29c0 20 remove_watcher() i=7 2024-09-12T18:10:10.962 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T18:10:10.991 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:10.991 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:11.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.030+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.030+0000 7f5e400499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.030+0000 7f5e400499c0 20 realm 2024-09-12T18:10:11.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.030+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.030+0000 7f5e400499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.030+0000 7f5e400499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:11.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.030+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.030+0000 7f5e400499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.030+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.030+0000 7f5e400499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:11.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.030+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.034+0000 7f5e400499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:11.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.034+0000 7f5e400499c0 20 searching for the correct realm 2024-09-12T18:10:11.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.042+0000 7f5e3db4f640 0 -- 172.21.15.97:0/40050485 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x5622df1b7210 msgr2=0x5622df1b9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:11.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.046+0000 7f5e3db4f640 0 -- 172.21.15.97:0/40050485 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f5e38064070 msgr2=0x7f5e38067a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:10:11.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.050+0000 7f5e400499c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:10:11.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.050+0000 7f5e400499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:11.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.050+0000 7f5e400499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:11.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.050+0000 7f5e400499c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:10:11.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.050+0000 7f5e400499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:11.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.050+0000 7f5e400499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:11.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.050+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:11.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:11.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 zone default found 2024-09-12T18:10:11.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 4 Realm: () 2024-09-12T18:10:11.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:10:11.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:10:11.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:11.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 zonegroup default 2024-09-12T18:10:11.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 started sync module instance, tier type = 2024-09-12T18:10:11.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.054+0000 7f5e400499c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:10:11.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.078+0000 7f5e400499c0 20 add_watcher() i=0 2024-09-12T18:10:11.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.078+0000 7f5e400499c0 20 add_watcher() i=1 2024-09-12T18:10:11.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.078+0000 7f5e400499c0 20 add_watcher() i=2 2024-09-12T18:10:11.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.078+0000 7f5e400499c0 20 add_watcher() i=3 2024-09-12T18:10:11.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.078+0000 7f5e400499c0 20 add_watcher() i=4 2024-09-12T18:10:11.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.078+0000 7f5e400499c0 20 add_watcher() i=5 2024-09-12T18:10:11.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.082+0000 7f5e400499c0 20 add_watcher() i=6 2024-09-12T18:10:11.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.082+0000 7f5e400499c0 20 add_watcher() i=7 2024-09-12T18:10:11.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.082+0000 7f5e400499c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:11.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.082+0000 7f5cf3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:11.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:11.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:11.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 5 note: GC not initialized 2024-09-12T18:10:11.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5cf2fe5640 20 reqs_thread_entry: start 2024-09-12T18:10:11.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 init_complete bucket index max shards: 11 2024-09-12T18:10:11.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 Filter name: none 2024-09-12T18:10:11.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5cf0fe1640 20 reqs_thread_entry: start 2024-09-12T18:10:11.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:10:11.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:10:11.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:10:11.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:10:11.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 : miss 2024-09-12T18:10:11.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:10:11.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 info.flags=0x17 2024-09-12T18:10:11.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 adding default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 to cache LRU end 2024-09-12T18:10:11.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:10:11.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:10:11.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:98539659-fdaf-41ce-847d-239ff89323af.4641.18 2024-09-12T18:10:11.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.0 2024-09-12T18:10:11.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.0 2024-09-12T18:10:11.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T18:10:11.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.1 2024-09-12T18:10:11.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.1 2024-09-12T18:10:11.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T18:10:11.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.2 2024-09-12T18:10:11.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.2 2024-09-12T18:10:11.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T18:10:11.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.3 2024-09-12T18:10:11.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.086+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.3 2024-09-12T18:10:11.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T18:10:11.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.4 2024-09-12T18:10:11.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.4 2024-09-12T18:10:11.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T18:10:11.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.5 2024-09-12T18:10:11.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.5 2024-09-12T18:10:11.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T18:10:11.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.6 2024-09-12T18:10:11.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.6 2024-09-12T18:10:11.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T18:10:11.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.7 2024-09-12T18:10:11.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.090+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.7 2024-09-12T18:10:11.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.094+0000 7f5e400499c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T18:10:11.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.094+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.8 2024-09-12T18:10:11.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.094+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.8 2024-09-12T18:10:11.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.094+0000 7f5e400499c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T18:10:11.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.094+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.094+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.094+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.10 2024-09-12T18:10:11.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.094+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.10 2024-09-12T18:10:11.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.094+0000 7f5e400499c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T18:10:11.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.094+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.11 2024-09-12T18:10:11.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.094+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.11 2024-09-12T18:10:11.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T18:10:11.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.12 2024-09-12T18:10:11.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.12 2024-09-12T18:10:11.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T18:10:11.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.13 2024-09-12T18:10:11.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.13 2024-09-12T18:10:11.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T18:10:11.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.14 2024-09-12T18:10:11.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.14 2024-09-12T18:10:11.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T18:10:11.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.15 2024-09-12T18:10:11.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.15 2024-09-12T18:10:11.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T18:10:11.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 10 bucket_obj is .dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.16 2024-09-12T18:10:11.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.16 2024-09-12T18:10:11.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T18:10:11.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.098+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.102+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:x state=0x5622df1f28b8 s->prefetch_data=0 2024-09-12T18:10:11.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.102+0000 7f5e400499c0 20 get_obj_state: setting s->obj_tag to rbqoswpj47iuao3rsjs0hgqkrpedxr9a 2024-09-12T18:10:11.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.102+0000 7f5e400499c0 20 get_obj_state_impl: setting s->olh_tag to u9of53cvb2maj25zoyj25mse8n3572mm 2024-09-12T18:10:11.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.102+0000 7f5e400499c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=u9of53cvb2maj25zoyj25mse8n3572mm 2024-09-12T18:10:11.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.102+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.106+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.106+0000 7f5e400499c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T18:10:11.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.106+0000 7f5e400499c0 20 olh_log_entry: epoch=2 op=3 key=x[SNpxW5kE8u7uD0fA6CZhl6bV.EQlXMF] 2024-09-12T18:10:11.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.106+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:_:SNpxW5kE8u7uD0fA6CZhl6bV.EQlXMF_x state=0x5622df21b688 s->prefetch_data=0 2024-09-12T18:10:11.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.106+0000 7f5e400499c0 10 manifest: total_size = 22 2024-09-12T18:10:11.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.106+0000 7f5e400499c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.2766776339926330854 2024-09-12T18:10:11.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.106+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:_:SNpxW5kE8u7uD0fA6CZhl6bV.EQlXMF_x state=0x5622df21b688 s->prefetch_data=0 2024-09-12T18:10:11.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.106+0000 7f5e400499c0 20 prepare_atomic_modification: state is not atomic. state=0x5622df21b688 2024-09-12T18:10:11.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.106+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.110+0000 7f5e400499c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:10:11.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.110+0000 7f5e400499c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T18:10:11.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.110+0000 7f5e400499c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:10:11.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.110+0000 7f5e400499c0 5 delete_objs_inline: removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.18__shadow:SNpxW5kE8u7uD0fA6CZhl6bV.EQlXMF_.XOtNXrttu6uS4XPq58ETOxo501YZKVL_0 2024-09-12T18:10:11.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.110+0000 7f5d217fa640 20 handle_completion(): completion ok for obj=x[SNpxW5kE8u7uD0fA6CZhl6bV.EQlXMF] 2024-09-12T18:10:11.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.110+0000 7f5e400499c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:10:11.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.110+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:x state=0x5622df1f28b8 s->prefetch_data=0 2024-09-12T18:10:11.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.110+0000 7f5e400499c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=u9of53cvb2maj25zoyj25mse8n3572mm 2024-09-12T18:10:11.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.114+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.118+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.118+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.118+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:y state=0x5622df21e328 s->prefetch_data=0 2024-09-12T18:10:11.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.118+0000 7f5e400499c0 20 get_obj_state: setting s->obj_tag to r99165p22hrjw9qwwzpsqf0puqcmkl43 2024-09-12T18:10:11.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.118+0000 7f5e400499c0 20 get_obj_state_impl: setting s->olh_tag to hxayhqbckho4co28oo2d927brhw8wjv9 2024-09-12T18:10:11.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.118+0000 7f5e400499c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hxayhqbckho4co28oo2d927brhw8wjv9 2024-09-12T18:10:11.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.122+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.122+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.122+0000 7f5e400499c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T18:10:11.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.122+0000 7f5e400499c0 20 olh_log_entry: epoch=2 op=3 key=y[tN9EpFrgXUKPYZaX5.WZrs0y.Z.oN1f] 2024-09-12T18:10:11.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.122+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:_:tN9EpFrgXUKPYZaX5.WZrs0y.Z.oN1f_y state=0x5622df1eddd8 s->prefetch_data=0 2024-09-12T18:10:11.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.122+0000 7f5e400499c0 10 manifest: total_size = 12 2024-09-12T18:10:11.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.122+0000 7f5e400499c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.8517624484494224291 2024-09-12T18:10:11.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.122+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:_:tN9EpFrgXUKPYZaX5.WZrs0y.Z.oN1f_y state=0x5622df1eddd8 s->prefetch_data=0 2024-09-12T18:10:11.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.122+0000 7f5e400499c0 20 prepare_atomic_modification: state is not atomic. state=0x5622df1eddd8 2024-09-12T18:10:11.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.122+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.126+0000 7f5e400499c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:10:11.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.126+0000 7f5e400499c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T18:10:11.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.126+0000 7f5e400499c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:10:11.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.126+0000 7f5e400499c0 5 delete_objs_inline: removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.18__shadow:tN9EpFrgXUKPYZaX5.WZrs0y.Z.oN1f_.JIhDH3b9yFbLYdwdBsb0yAHteN0_D0m_0 2024-09-12T18:10:11.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.126+0000 7f5d217fa640 20 handle_completion(): completion ok for obj=y[tN9EpFrgXUKPYZaX5.WZrs0y.Z.oN1f] 2024-09-12T18:10:11.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.130+0000 7f5e400499c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:10:11.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.130+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:y state=0x5622df21e328 s->prefetch_data=0 2024-09-12T18:10:11.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.130+0000 7f5e400499c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hxayhqbckho4co28oo2d927brhw8wjv9 2024-09-12T18:10:11.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.138+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.138+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.138+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.138+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:z state=0x5622df21e328 s->prefetch_data=0 2024-09-12T18:10:11.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.138+0000 7f5e400499c0 20 get_obj_state: setting s->obj_tag to cr5sw23g2ueamsk9s5cr7zwexvl827ab 2024-09-12T18:10:11.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.138+0000 7f5e400499c0 20 get_obj_state_impl: setting s->olh_tag to mol7h733o5ixw4pxk525rhiketw96z5d 2024-09-12T18:10:11.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.138+0000 7f5e400499c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mol7h733o5ixw4pxk525rhiketw96z5d 2024-09-12T18:10:11.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.138+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.142+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.142+0000 7f5e400499c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T18:10:11.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.142+0000 7f5e400499c0 20 olh_log_entry: epoch=2 op=3 key=z[POM3AlOkcaJbZUOQUUk2ssK-k0kLeJy] 2024-09-12T18:10:11.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.142+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:_:POM3AlOkcaJbZUOQUUk2ssK-k0kLeJy_z state=0x5622df1f01c8 s->prefetch_data=0 2024-09-12T18:10:11.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.142+0000 7f5e400499c0 10 manifest: total_size = 11 2024-09-12T18:10:11.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.142+0000 7f5e400499c0 20 get_obj_state: setting s->obj_tag to 98539659-fdaf-41ce-847d-239ff89323af.4641.17792339756757785685 2024-09-12T18:10:11.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.142+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:_:POM3AlOkcaJbZUOQUUk2ssK-k0kLeJy_z state=0x5622df1f01c8 s->prefetch_data=0 2024-09-12T18:10:11.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.142+0000 7f5e400499c0 20 prepare_atomic_modification: state is not atomic. state=0x5622df1f01c8 2024-09-12T18:10:11.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.142+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.146+0000 7f5e400499c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:10:11.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.146+0000 7f5e400499c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T18:10:11.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.146+0000 7f5e400499c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:10:11.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.146+0000 7f5e400499c0 5 delete_objs_inline: removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.18__shadow:POM3AlOkcaJbZUOQUUk2ssK-k0kLeJy_.iTmuul2fJTVed-5tv6Aj8r2rCtAJJ_O_0 2024-09-12T18:10:11.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.146+0000 7f5d217fa640 20 handle_completion(): completion ok for obj=z[POM3AlOkcaJbZUOQUUk2ssK-k0kLeJy] 2024-09-12T18:10:11.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.146+0000 7f5e400499c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:10:11.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.146+0000 7f5e400499c0 20 get_obj_state: octx=0x5622deeb13b0 obj=myver:z state=0x5622df21e328 s->prefetch_data=0 2024-09-12T18:10:11.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.146+0000 7f5e400499c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mol7h733o5ixw4pxk525rhiketw96z5d 2024-09-12T18:10:11.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.150+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.150+0000 7f5e400499c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.18.3.9 2024-09-12T18:10:11.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.150+0000 7f5e400499c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T18:10:11.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.150+0000 7f5e400499c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T18:10:11.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.150+0000 7f5cf3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:11.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.154+0000 7f5e400499c0 20 remove_watcher() i=0 2024-09-12T18:10:11.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.154+0000 7f5e400499c0 2 removed watcher, disabling cache 2024-09-12T18:10:11.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.158+0000 7f5e400499c0 20 remove_watcher() i=1 2024-09-12T18:10:11.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.158+0000 7f5e400499c0 20 remove_watcher() i=2 2024-09-12T18:10:11.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.158+0000 7f5e400499c0 20 remove_watcher() i=3 2024-09-12T18:10:11.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.162+0000 7f5e400499c0 20 remove_watcher() i=4 2024-09-12T18:10:11.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.162+0000 7f5e400499c0 20 remove_watcher() i=5 2024-09-12T18:10:11.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.166+0000 7f5e400499c0 20 remove_watcher() i=6 2024-09-12T18:10:11.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.174+0000 7f5e400499c0 20 remove_watcher() i=7 2024-09-12T18:10:11.195 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:11.195 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:11.272 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:11.273 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:11.538 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:10:11.571 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:11.571 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:11.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.614+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.618+0000 7f53ae06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.618+0000 7f53ae06d9c0 20 realm 2024-09-12T18:10:11.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.618+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.618+0000 7f53ae06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.618+0000 7f53ae06d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:11.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.618+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.618+0000 7f53ae06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.618+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.618+0000 7f53ae06d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:11.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.618+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.622+0000 7f53ae06d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:11.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.622+0000 7f53ae06d9c0 20 searching for the correct realm 2024-09-12T18:10:11.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.630+0000 7f53ac374640 0 -- 172.21.15.97:0/529254666 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55ed8c5c9170 msgr2=0x55ed8c5cb580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:11.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.634+0000 7f53abb73640 0 -- 172.21.15.97:0/529254666 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55ed8c5cd380 msgr2=0x55ed8c5cf770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:11.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:10:11.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:11.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:11.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:10:11.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:11.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:11.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:11.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:11.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 zone default found 2024-09-12T18:10:11.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 4 Realm: () 2024-09-12T18:10:11.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:10:11.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:10:11.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:11.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 zonegroup default 2024-09-12T18:10:11.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.642+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.646+0000 7f53ae06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.646+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.646+0000 7f53ae06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:11.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.646+0000 7f53ae06d9c0 20 started sync module instance, tier type = 2024-09-12T18:10:11.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.646+0000 7f53ae06d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:10:11.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.662+0000 7f53ae06d9c0 20 add_watcher() i=0 2024-09-12T18:10:11.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.662+0000 7f53ae06d9c0 20 add_watcher() i=1 2024-09-12T18:10:11.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.662+0000 7f53ae06d9c0 20 add_watcher() i=2 2024-09-12T18:10:11.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.662+0000 7f53ae06d9c0 20 add_watcher() i=3 2024-09-12T18:10:11.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.662+0000 7f53ae06d9c0 20 add_watcher() i=4 2024-09-12T18:10:11.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.662+0000 7f53ae06d9c0 20 add_watcher() i=5 2024-09-12T18:10:11.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.662+0000 7f53ae06d9c0 20 add_watcher() i=6 2024-09-12T18:10:11.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.666+0000 7f53ae06d9c0 20 add_watcher() i=7 2024-09-12T18:10:11.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.666+0000 7f53ae06d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:11.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f5261fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:11.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:11.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:11.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 5 note: GC not initialized 2024-09-12T18:10:11.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f5260fe1640 20 reqs_thread_entry: start 2024-09-12T18:10:11.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:10:11.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 Filter name: none 2024-09-12T18:10:11.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f51da7fc640 20 reqs_thread_entry: start 2024-09-12T18:10:11.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:10:11.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:10:11.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:10:11.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:10:11.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.670+0000 7f53ae06d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:11.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.674+0000 7f53ae06d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:10:11.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.674+0000 7f53ae06d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:10:11.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.674+0000 7f5261fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:11.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.678+0000 7f53ae06d9c0 20 remove_watcher() i=0 2024-09-12T18:10:11.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.678+0000 7f53ae06d9c0 2 removed watcher, disabling cache 2024-09-12T18:10:11.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.682+0000 7f53ae06d9c0 20 remove_watcher() i=1 2024-09-12T18:10:11.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.682+0000 7f53ae06d9c0 20 remove_watcher() i=2 2024-09-12T18:10:11.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.690+0000 7f53ae06d9c0 20 remove_watcher() i=3 2024-09-12T18:10:11.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.690+0000 7f53ae06d9c0 20 remove_watcher() i=4 2024-09-12T18:10:11.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.694+0000 7f53ae06d9c0 20 remove_watcher() i=5 2024-09-12T18:10:11.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.694+0000 7f53ae06d9c0 20 remove_watcher() i=6 2024-09-12T18:10:11.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T18:10:11.698+0000 7f53ae06d9c0 20 remove_watcher() i=7 2024-09-12T18:10:11.713 INFO:tasks.workunit.client.0.smithi097.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T18:10:11.713 INFO:tasks.workunit.client.0.smithi097.stderr:Deleting bucket a-bucket 2024-09-12T18:10:11.714 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:11.715 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:11.741 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:11.742 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:11.842 INFO:tasks.workunit.client.0.smithi097.stderr:Deleting bucket myver 2024-09-12T18:10:11.844 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:11.844 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:11.982 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:10:11.982 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T18:10:12.437 INFO:tasks.workunit.client.0.smithi097.stderr:Completed resharding tests 2024-09-12T18:10:12.437 INFO:tasks.workunit.client.0.smithi097.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T18:10:12.438 INFO:tasks.workunit.client.0.smithi097.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T18:10:12.438 INFO:tasks.workunit.client.0.smithi097.stdout:connected to https://localhost:443 2024-09-12T18:10:12.558 INFO:tasks.workunit.client.0.smithi097.stderr:+ deactivate 2024-09-12T18:10:12.558 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T18:10:12.558 INFO:tasks.workunit.client.0.smithi097.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:10:12.558 INFO:tasks.workunit.client.0.smithi097.stderr:+ export PATH 2024-09-12T18:10:12.558 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:10:12.558 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-12T18:10:12.558 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:10:12.558 INFO:tasks.workunit.client.0.smithi097.stderr:+ hash -r 2024-09-12T18:10:12.559 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-12T18:10:12.559 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:10:12.559 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:10:12.559 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:10:12.559 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset -f deactivate 2024-09-12T18:10:12.559 INFO:tasks.workunit.client.0.smithi097.stderr:+ echo OK. 2024-09-12T18:10:12.560 INFO:tasks.workunit.client.0.smithi097.stdout:OK. 2024-09-12T18:10:12.560 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:10:12.560 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:10:12.618 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T18:10:12.619 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:10:13.054 DEBUG:teuthology.parallel:result is None 2024-09-12T18:10:13.054 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:10:13.066 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:10:13.067 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:10:13.114 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:10:13.114 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T18:10:13.131 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T18:10:13.132 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T18:10:13.132 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T18:10:13.132 DEBUG:teuthology.orchestra.run.smithi097:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:10:13.162 INFO:teuthology.orchestra.run.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T18:10:19.720 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T18:10:19.720 DEBUG:teuthology.orchestra.run.smithi097:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T18:10:19.811 INFO:teuthology.orchestra.run.smithi097.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T18:10:19.868 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T18:10:20.083 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-12T18:10:20.084 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-12T18:10:20.287 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:10:20.287 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:10:20.287 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:10:20.288 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:10:20.288 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:10:20.288 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:10:20.288 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:10:20.289 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-09-12T18:10:20.290 INFO:teuthology.orchestra.run.smithi097.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T18:10:20.290 INFO:teuthology.orchestra.run.smithi097.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T18:10:20.291 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-09-12T18:10:20.291 INFO:teuthology.orchestra.run.smithi097.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T18:10:20.291 INFO:teuthology.orchestra.run.smithi097.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T18:10:20.291 INFO:teuthology.orchestra.run.smithi097.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T18:10:20.326 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-09-12T18:10:20.326 INFO:teuthology.orchestra.run.smithi097.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T18:10:20.327 INFO:teuthology.orchestra.run.smithi097.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T18:10:20.509 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:10:20.510 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 46.0 MB of archives. 2024-09-12T18:10:20.510 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T18:10:20.510 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T18:10:20.874 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T18:10:21.230 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T18:10:21.231 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T18:10:21.237 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T18:10:21.237 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T18:10:22.338 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T18:10:22.340 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T18:10:22.588 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T18:10:22.991 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T18:10:22.991 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T18:10:22.992 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: falling back to frontend: Readline 2024-09-12T18:10:23.001 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T18:10:23.002 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T18:10:23.002 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: falling back to frontend: Teletype 2024-09-12T18:10:23.005 INFO:teuthology.orchestra.run.smithi097.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T18:10:23.040 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 46.0 MB in 2s (19.6 MB/s) 2024-09-12T18:10:23.151 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T18:10:23.229 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T18:10:23.235 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T18:10:23.274 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:23.686 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T18:10:23.715 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:10:23.795 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:24.199 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T18:10:24.229 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:10:24.266 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:24.519 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T18:10:24.535 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:10:24.610 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:24.879 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T18:10:24.895 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:10:24.937 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:25.417 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T18:10:25.445 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:10:25.486 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:10:27.188 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T18:10:27.217 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:10:27.258 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:10:27.726 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T18:10:27.755 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:10:27.796 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:10:28.580 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T18:10:28.608 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:10:28.658 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:10:29.025 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:10:30.104 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T18:10:30.129 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T18:10:30.157 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T18:10:30.554 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:30.722 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:31.116 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:10:31.208 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T18:10:31.276 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:10:31.368 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T18:10:31.396 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T18:10:31.423 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T18:10:31.447 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T18:10:31.574 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T18:10:31.728 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T18:10:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T18:10:31.955 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T18:10:31.997 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T18:10:32.048 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T18:10:32.075 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T18:10:32.099 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T18:10:32.164 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:32.290 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:32.407 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:10:32.483 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T18:10:32.576 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:10:32.686 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:10:33.745 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:10:33.837 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T18:10:34.139 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:10:34.603 INFO:teuthology.orchestra.run.smithi097.stdout: Gradle will be installed under /opt/gradle 2024-09-12T18:10:34.635 INFO:teuthology.orchestra.run.smithi097.stderr:--2024-09-12 18:10:34-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T18:10:34.639 INFO:teuthology.orchestra.run.smithi097.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4865, ... 2024-09-12T18:10:34.648 INFO:teuthology.orchestra.run.smithi097.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-12T18:10:34.694 INFO:teuthology.orchestra.run.smithi097.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T18:10:34.694 INFO:teuthology.orchestra.run.smithi097.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T18:10:34.694 INFO:teuthology.orchestra.run.smithi097.stderr:--2024-09-12 18:10:34-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T18:10:34.695 INFO:teuthology.orchestra.run.smithi097.stderr:Resolving github.com (github.com)... 140.82.112.4 2024-09-12T18:10:34.705 INFO:teuthology.orchestra.run.smithi097.stderr:Connecting to github.com (github.com)|140.82.112.4|:443... connected. 2024-09-12T18:10:34.792 INFO:teuthology.orchestra.run.smithi097.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T18:10:34.792 INFO:teuthology.orchestra.run.smithi097.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T181034Z&X-Amz-Expires=300&X-Amz-Signature=a7e803e27a9fac13c3fa82487a4e1802251b0c66114d12ee9accddaed25c8467&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T18:10:34.792 INFO:teuthology.orchestra.run.smithi097.stderr:--2024-09-12 18:10:34-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T181034Z&X-Amz-Expires=300&X-Amz-Signature=a7e803e27a9fac13c3fa82487a4e1802251b0c66114d12ee9accddaed25c8467&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T18:10:34.802 INFO:teuthology.orchestra.run.smithi097.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.110.133, 185.199.109.133, ... 2024-09-12T18:10:34.814 INFO:teuthology.orchestra.run.smithi097.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-12T18:10:34.898 INFO:teuthology.orchestra.run.smithi097.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T18:10:34.898 INFO:teuthology.orchestra.run.smithi097.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T18:10:34.898 INFO:teuthology.orchestra.run.smithi097.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T18:10:34.898 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T18:10:34.909 INFO:teuthology.orchestra.run.smithi097.stderr: 0K .......... .......... .......... .......... .......... 0% 4.08M 22s 2024-09-12T18:10:34.921 INFO:teuthology.orchestra.run.smithi097.stderr: 50K .......... .......... .......... .......... .......... 0% 4.29M 22s 2024-09-12T18:10:34.923 INFO:teuthology.orchestra.run.smithi097.stderr: 100K .......... .......... .......... .......... .......... 0% 19.7M 16s 2024-09-12T18:10:34.926 INFO:teuthology.orchestra.run.smithi097.stderr: 150K .......... .......... .......... .......... .......... 0% 15.0M 13s 2024-09-12T18:10:34.933 INFO:teuthology.orchestra.run.smithi097.stderr: 200K .......... .......... .......... .......... .......... 0% 7.70M 13s 2024-09-12T18:10:34.934 INFO:teuthology.orchestra.run.smithi097.stderr: 250K .......... .......... .......... .......... .......... 0% 48.5M 11s 2024-09-12T18:10:34.936 INFO:teuthology.orchestra.run.smithi097.stderr: 300K .......... .......... .......... .......... .......... 0% 19.1M 10s 2024-09-12T18:10:34.938 INFO:teuthology.orchestra.run.smithi097.stderr: 350K .......... .......... .......... .......... .......... 0% 41.1M 9s 2024-09-12T18:10:34.951 INFO:teuthology.orchestra.run.smithi097.stderr: 400K .......... .......... .......... .......... .......... 0% 8.09M 9s 2024-09-12T18:10:34.951 INFO:teuthology.orchestra.run.smithi097.stderr: 450K .......... .......... .......... .......... .......... 0% 93.8M 9s 2024-09-12T18:10:34.951 INFO:teuthology.orchestra.run.smithi097.stderr: 500K .......... .......... .......... .......... .......... 0% 77.6M 8s 2024-09-12T18:10:34.951 INFO:teuthology.orchestra.run.smithi097.stderr: 550K .......... .......... .......... .......... .......... 0% 41.0M 7s 2024-09-12T18:10:34.952 INFO:teuthology.orchestra.run.smithi097.stderr: 600K .......... .......... .......... .......... .......... 0% 29.7M 7s 2024-09-12T18:10:34.952 INFO:teuthology.orchestra.run.smithi097.stderr: 650K .......... .......... .......... .......... .......... 0% 73.8M 7s 2024-09-12T18:10:34.952 INFO:teuthology.orchestra.run.smithi097.stderr: 700K .......... .......... .......... .......... .......... 0% 102M 6s 2024-09-12T18:10:34.952 INFO:teuthology.orchestra.run.smithi097.stderr: 750K .......... .......... .......... .......... .......... 0% 76.2M 6s 2024-09-12T18:10:34.952 INFO:teuthology.orchestra.run.smithi097.stderr: 800K .......... .......... .......... .......... .......... 0% 101M 6s 2024-09-12T18:10:36.153 INFO:teuthology.orchestra.run.smithi097.stderr: 850K .......... .......... .......... .......... .......... 0% 9.03M 6s 2024-09-12T18:10:36.154 INFO:teuthology.orchestra.run.smithi097.stderr: 900K .......... .......... .......... .......... .......... 1% 120M 6s 2024-09-12T18:10:36.154 INFO:teuthology.orchestra.run.smithi097.stderr: 950K .......... .......... .......... .......... .......... 1% 143M 5s 2024-09-12T18:10:36.154 INFO:teuthology.orchestra.run.smithi097.stderr: 1000K .......... .......... .......... .......... .......... 1% 118M 5s 2024-09-12T18:10:36.154 INFO:teuthology.orchestra.run.smithi097.stderr: 1050K .......... .......... .......... .......... .......... 1% 66.0M 5s 2024-09-12T18:10:36.154 INFO:teuthology.orchestra.run.smithi097.stderr: 1100K .......... .......... .......... .......... .......... 1% 76.9M 5s 2024-09-12T18:10:36.154 INFO:teuthology.orchestra.run.smithi097.stderr: 1150K .......... .......... .......... .......... .......... 1% 84.0M 5s 2024-09-12T18:10:36.154 INFO:teuthology.orchestra.run.smithi097.stderr: 1200K .......... .......... .......... .......... .......... 1% 89.1M 5s 2024-09-12T18:10:36.154 INFO:teuthology.orchestra.run.smithi097.stderr: 1250K .......... .......... .......... .......... .......... 1% 81.3M 4s 2024-09-12T18:10:36.154 INFO:teuthology.orchestra.run.smithi097.stderr: 1300K .......... .......... .......... .......... .......... 1% 87.3M 4s 2024-09-12T18:10:36.154 INFO:teuthology.orchestra.run.smithi097.stderr: 1350K .......... .......... .......... .......... .......... 1% 90.6M 4s 2024-09-12T18:10:36.155 INFO:teuthology.orchestra.run.smithi097.stderr: 1400K .......... .......... .......... .......... .......... 1% 91.4M 4s 2024-09-12T18:10:36.155 INFO:teuthology.orchestra.run.smithi097.stderr: 1450K .......... .......... .......... .......... .......... 1% 68.0M 4s 2024-09-12T18:10:36.155 INFO:teuthology.orchestra.run.smithi097.stderr: 1500K .......... .......... .......... .......... .......... 1% 91.5M 4s 2024-09-12T18:10:36.155 INFO:teuthology.orchestra.run.smithi097.stderr: 1550K .......... .......... .......... .......... .......... 1% 109M 4s 2024-09-12T18:10:36.155 INFO:teuthology.orchestra.run.smithi097.stderr: 1600K .......... .......... .......... .......... .......... 1% 95.6M 4s 2024-09-12T18:10:36.155 INFO:teuthology.orchestra.run.smithi097.stderr: 1650K .......... .......... .......... .......... .......... 1% 94.9M 4s 2024-09-12T18:10:36.155 INFO:teuthology.orchestra.run.smithi097.stderr: 1700K .......... .......... .......... .......... .......... 1% 89.3M 3s 2024-09-12T18:10:36.155 INFO:teuthology.orchestra.run.smithi097.stderr: 1750K .......... .......... .......... .......... .......... 1% 19.3M 4s 2024-09-12T18:10:36.155 INFO:teuthology.orchestra.run.smithi097.stderr: 1800K .......... .......... .......... .......... .......... 1% 117M 3s 2024-09-12T18:10:36.155 INFO:teuthology.orchestra.run.smithi097.stderr: 1850K .......... .......... .......... .......... .......... 2% 151M 3s 2024-09-12T18:10:36.155 INFO:teuthology.orchestra.run.smithi097.stderr: 1900K .......... .......... .......... .......... .......... 2% 127M 3s 2024-09-12T18:10:36.156 INFO:teuthology.orchestra.run.smithi097.stderr: 1950K .......... .......... .......... .......... .......... 2% 139M 3s 2024-09-12T18:10:36.156 INFO:teuthology.orchestra.run.smithi097.stderr: 2000K .......... .......... .......... .......... .......... 2% 110M 3s 2024-09-12T18:10:36.156 INFO:teuthology.orchestra.run.smithi097.stderr: 2050K .......... .......... .......... .......... .......... 2% 112M 3s 2024-09-12T18:10:36.156 INFO:teuthology.orchestra.run.smithi097.stderr: 2100K .......... .......... .......... .......... .......... 2% 91.9M 3s 2024-09-12T18:10:36.156 INFO:teuthology.orchestra.run.smithi097.stderr: 2150K .......... .......... .......... .......... .......... 2% 107M 3s 2024-09-12T18:10:36.156 INFO:teuthology.orchestra.run.smithi097.stderr: 2200K .......... .......... .......... .......... .......... 2% 123M 3s 2024-09-12T18:10:36.156 INFO:teuthology.orchestra.run.smithi097.stderr: 2250K .......... .......... .......... .......... .......... 2% 96.8M 3s 2024-09-12T18:10:36.156 INFO:teuthology.orchestra.run.smithi097.stderr: 2300K .......... .......... .......... .......... .......... 2% 103M 3s 2024-09-12T18:10:36.156 INFO:teuthology.orchestra.run.smithi097.stderr: 2350K .......... .......... .......... .......... .......... 2% 103M 3s 2024-09-12T18:10:36.156 INFO:teuthology.orchestra.run.smithi097.stderr: 2400K .......... .......... .......... .......... .......... 2% 100M 3s 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2450K .......... .......... .......... .......... .......... 2% 108M 3s 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2500K .......... .......... .......... .......... .......... 2% 102M 3s 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2550K .......... .......... .......... .......... .......... 2% 99.3M 3s 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2600K .......... .......... .......... .......... .......... 2% 94.6M 3s 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2650K .......... .......... .......... .......... .......... 2% 153M 3s 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2700K .......... .......... .......... .......... .......... 2% 124M 3s 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2750K .......... .......... .......... .......... .......... 3% 147M 3s 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2800K .......... .......... .......... .......... .......... 3% 136M 2s 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2850K .......... .......... .......... .......... .......... 3% 165M 2s 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2900K .......... .......... .......... .......... .......... 3% 127M 2s 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2950K .......... .......... .......... .......... .......... 3% 157M 2s 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi097.stderr: 3000K .......... .......... .......... .......... .......... 3% 149M 2s 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi097.stderr: 3050K .......... .......... .......... .......... .......... 3% 153M 2s 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi097.stderr: 3100K .......... .......... .......... .......... .......... 3% 138M 2s 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi097.stderr: 3150K .......... .......... .......... .......... .......... 3% 130M 2s 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi097.stderr: 3200K .......... .......... .......... .......... .......... 3% 106M 2s 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi097.stderr: 3250K .......... .......... .......... .......... .......... 3% 111M 2s 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi097.stderr: 3300K .......... .......... .......... .......... .......... 3% 88.0M 2s 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi097.stderr: 3350K .......... .......... .......... .......... .......... 3% 98.1M 2s 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi097.stderr: 3400K .......... .......... .......... .......... .......... 3% 86.0M 2s 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi097.stderr: 3450K .......... .......... .......... .......... .......... 3% 85.7M 2s 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi097.stderr: 3500K .......... .......... .......... .......... .......... 3% 87.8M 2s 2024-09-12T18:10:36.159 INFO:teuthology.orchestra.run.smithi097.stderr: 3550K .......... .......... .......... .......... .......... 3% 72.0M 2s 2024-09-12T18:10:36.159 INFO:teuthology.orchestra.run.smithi097.stderr: 3600K .......... .......... .......... .......... .......... 3% 102M 2s 2024-09-12T18:10:36.159 INFO:teuthology.orchestra.run.smithi097.stderr: 3650K .......... .......... .......... .......... .......... 3% 128M 2s 2024-09-12T18:10:36.159 INFO:teuthology.orchestra.run.smithi097.stderr: 3700K .......... .......... .......... .......... .......... 4% 132M 2s 2024-09-12T18:10:36.159 INFO:teuthology.orchestra.run.smithi097.stderr: 3750K .......... .......... .......... .......... .......... 4% 131M 2s 2024-09-12T18:10:36.159 INFO:teuthology.orchestra.run.smithi097.stderr: 3800K .......... .......... .......... .......... .......... 4% 137M 2s 2024-09-12T18:10:36.159 INFO:teuthology.orchestra.run.smithi097.stderr: 3850K .......... .......... .......... .......... .......... 4% 148M 2s 2024-09-12T18:10:36.159 INFO:teuthology.orchestra.run.smithi097.stderr: 3900K .......... .......... .......... .......... .......... 4% 141M 2s 2024-09-12T18:10:36.159 INFO:teuthology.orchestra.run.smithi097.stderr: 3950K .......... .......... .......... .......... .......... 4% 109M 2s 2024-09-12T18:10:36.159 INFO:teuthology.orchestra.run.smithi097.stderr: 4000K .......... .......... .......... .......... .......... 4% 143M 2s 2024-09-12T18:10:36.160 INFO:teuthology.orchestra.run.smithi097.stderr: 4050K .......... .......... .......... .......... .......... 4% 134M 2s 2024-09-12T18:10:36.160 INFO:teuthology.orchestra.run.smithi097.stderr: 4100K .......... .......... .......... .......... .......... 4% 154M 2s 2024-09-12T18:10:36.160 INFO:teuthology.orchestra.run.smithi097.stderr: 4150K .......... .......... .......... .......... .......... 4% 156M 2s 2024-09-12T18:10:36.160 INFO:teuthology.orchestra.run.smithi097.stderr: 4200K .......... .......... .......... .......... .......... 4% 110M 2s 2024-09-12T18:10:36.160 INFO:teuthology.orchestra.run.smithi097.stderr: 4250K .......... .......... .......... .......... .......... 4% 151M 2s 2024-09-12T18:10:36.160 INFO:teuthology.orchestra.run.smithi097.stderr: 4300K .......... .......... .......... .......... .......... 4% 150M 2s 2024-09-12T18:10:36.160 INFO:teuthology.orchestra.run.smithi097.stderr: 4350K .......... .......... .......... .......... .......... 4% 127M 2s 2024-09-12T18:10:36.160 INFO:teuthology.orchestra.run.smithi097.stderr: 4400K .......... .......... .......... .......... .......... 4% 153M 2s 2024-09-12T18:10:36.160 INFO:teuthology.orchestra.run.smithi097.stderr: 4450K .......... .......... .......... .......... .......... 4% 154M 2s 2024-09-12T18:10:36.160 INFO:teuthology.orchestra.run.smithi097.stderr: 4500K .......... .......... .......... .......... .......... 4% 154M 2s 2024-09-12T18:10:36.160 INFO:teuthology.orchestra.run.smithi097.stderr: 4550K .......... .......... .......... .......... .......... 4% 140M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 4600K .......... .......... .......... .......... .......... 5% 130M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 4650K .......... .......... .......... .......... .......... 5% 130M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 4700K .......... .......... .......... .......... .......... 5% 106M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 4750K .......... .......... .......... .......... .......... 5% 91.8M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 4800K .......... .......... .......... .......... .......... 5% 143M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 4850K .......... .......... .......... .......... .......... 5% 107M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 4900K .......... .......... .......... .......... .......... 5% 117M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 4950K .......... .......... .......... .......... .......... 5% 119M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 5000K .......... .......... .......... .......... .......... 5% 128M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 5050K .......... .......... .......... .......... .......... 5% 95.3M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 5100K .......... .......... .......... .......... .......... 5% 119M 2s 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi097.stderr: 5150K .......... .......... .......... .......... .......... 5% 136M 2s 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi097.stderr: 5200K .......... .......... .......... .......... .......... 5% 104M 2s 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi097.stderr: 5250K .......... .......... .......... .......... .......... 5% 163M 2s 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi097.stderr: 5300K .......... .......... .......... .......... .......... 5% 134M 2s 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi097.stderr: 5350K .......... .......... .......... .......... .......... 5% 124M 2s 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi097.stderr: 5400K .......... .......... .......... .......... .......... 5% 152M 2s 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi097.stderr: 5450K .......... .......... .......... .......... .......... 5% 141M 2s 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi097.stderr: 5500K .......... .......... .......... .......... .......... 5% 128M 2s 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi097.stderr: 5550K .......... .......... .......... .......... .......... 6% 161M 2s 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi097.stderr: 5600K .......... .......... .......... .......... .......... 6% 117M 2s 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi097.stderr: 5650K .......... .......... .......... .......... .......... 6% 151M 2s 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi097.stderr: 5700K .......... .......... .......... .......... .......... 6% 112M 2s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 5750K .......... .......... .......... .......... .......... 6% 171M 2s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 5800K .......... .......... .......... .......... .......... 6% 175M 2s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 5850K .......... .......... .......... .......... .......... 6% 172M 2s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 5900K .......... .......... .......... .......... .......... 6% 158M 2s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 5950K .......... .......... .......... .......... .......... 6% 156M 1s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 6000K .......... .......... .......... .......... .......... 6% 171M 1s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 6050K .......... .......... .......... .......... .......... 6% 174M 1s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 6100K .......... .......... .......... .......... .......... 6% 177M 1s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 6150K .......... .......... .......... .......... .......... 6% 156M 1s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 6200K .......... .......... .......... .......... .......... 6% 165M 1s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 6250K .......... .......... .......... .......... .......... 6% 101M 1s 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi097.stderr: 6300K .......... .......... .......... .......... .......... 6% 184M 1s 2024-09-12T18:10:36.164 INFO:teuthology.orchestra.run.smithi097.stderr: 6350K .......... .......... .......... .......... .......... 6% 122M 1s 2024-09-12T18:10:36.164 INFO:teuthology.orchestra.run.smithi097.stderr: 6400K .......... .......... .......... .......... .......... 6% 102M 1s 2024-09-12T18:10:36.164 INFO:teuthology.orchestra.run.smithi097.stderr: 6450K .......... .......... .......... .......... .......... 6% 112M 1s 2024-09-12T18:10:36.164 INFO:teuthology.orchestra.run.smithi097.stderr: 6500K .......... .......... .......... .......... .......... 7% 114M 1s 2024-09-12T18:10:36.164 INFO:teuthology.orchestra.run.smithi097.stderr: 6550K .......... .......... .......... .......... .......... 7% 184M 1s 2024-09-12T18:10:36.164 INFO:teuthology.orchestra.run.smithi097.stderr: 6600K .......... .......... .......... .......... .......... 7% 184M 1s 2024-09-12T18:10:36.164 INFO:teuthology.orchestra.run.smithi097.stderr: 6650K .......... .......... .......... .......... .......... 7% 182M 1s 2024-09-12T18:10:36.164 INFO:teuthology.orchestra.run.smithi097.stderr: 6700K .......... .......... .......... .......... .......... 7% 143M 1s 2024-09-12T18:10:36.164 INFO:teuthology.orchestra.run.smithi097.stderr: 6750K .......... .......... .......... .......... .......... 7% 118M 1s 2024-09-12T18:10:36.164 INFO:teuthology.orchestra.run.smithi097.stderr: 6800K .......... .......... .......... .......... .......... 7% 160M 1s 2024-09-12T18:10:36.164 INFO:teuthology.orchestra.run.smithi097.stderr: 6850K .......... .......... .......... .......... .......... 7% 130M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 6900K .......... .......... .......... .......... .......... 7% 188M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 6950K .......... .......... .......... .......... .......... 7% 180M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 7000K .......... .......... .......... .......... .......... 7% 173M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 7050K .......... .......... .......... .......... .......... 7% 132M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 7100K .......... .......... .......... .......... .......... 7% 167M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 7150K .......... .......... .......... .......... .......... 7% 197M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 7200K .......... .......... .......... .......... .......... 7% 154M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 7250K .......... .......... .......... .......... .......... 7% 155M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 7300K .......... .......... .......... .......... .......... 7% 151M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 7350K .......... .......... .......... .......... .......... 7% 148M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 7400K .......... .......... .......... .......... .......... 8% 194M 1s 2024-09-12T18:10:36.165 INFO:teuthology.orchestra.run.smithi097.stderr: 7450K .......... .......... .......... .......... .......... 8% 138M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 7500K .......... .......... .......... .......... .......... 8% 160M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 7550K .......... .......... .......... .......... .......... 8% 189M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 7600K .......... .......... .......... .......... .......... 8% 208M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 7650K .......... .......... .......... .......... .......... 8% 164M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 7700K .......... .......... .......... .......... .......... 8% 206M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 7750K .......... .......... .......... .......... .......... 8% 211M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 7800K .......... .......... .......... .......... .......... 8% 169M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 7850K .......... .......... .......... .......... .......... 8% 120M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 7900K .......... .......... .......... .......... .......... 8% 98.5M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 7950K .......... .......... .......... .......... .......... 8% 207M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 8000K .......... .......... .......... .......... .......... 8% 203M 1s 2024-09-12T18:10:36.166 INFO:teuthology.orchestra.run.smithi097.stderr: 8050K .......... .......... .......... .......... .......... 8% 204M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8100K .......... .......... .......... .......... .......... 8% 211M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8150K .......... .......... .......... .......... .......... 8% 157M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8200K .......... .......... .......... .......... .......... 8% 166M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8250K .......... .......... .......... .......... .......... 8% 152M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8300K .......... .......... .......... .......... .......... 8% 98.2M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8350K .......... .......... .......... .......... .......... 9% 113M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8400K .......... .......... .......... .......... .......... 9% 147M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8450K .......... .......... .......... .......... .......... 9% 200M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8500K .......... .......... .......... .......... .......... 9% 185M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8550K .......... .......... .......... .......... .......... 9% 219M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8600K .......... .......... .......... .......... .......... 9% 198M 1s 2024-09-12T18:10:36.167 INFO:teuthology.orchestra.run.smithi097.stderr: 8650K .......... .......... .......... .......... .......... 9% 140M 1s 2024-09-12T18:10:36.168 INFO:teuthology.orchestra.run.smithi097.stderr: 8700K .......... .......... .......... .......... .......... 9% 196M 1s 2024-09-12T18:10:36.168 INFO:teuthology.orchestra.run.smithi097.stderr: 8750K .......... .......... .......... .......... .......... 9% 199M 1s 2024-09-12T18:10:36.168 INFO:teuthology.orchestra.run.smithi097.stderr: 8800K .......... .......... .......... .......... .......... 9% 187M 1s 2024-09-12T18:10:36.168 INFO:teuthology.orchestra.run.smithi097.stderr: 8850K .......... .......... .......... .......... .......... 9% 142M 1s 2024-09-12T18:10:36.168 INFO:teuthology.orchestra.run.smithi097.stderr: 8900K .......... .......... .......... .......... .......... 9% 226M 1s 2024-09-12T18:10:36.168 INFO:teuthology.orchestra.run.smithi097.stderr: 8950K .......... .......... .......... .......... .......... 9% 229M 1s 2024-09-12T18:10:36.168 INFO:teuthology.orchestra.run.smithi097.stderr: 9000K .......... .......... .......... .......... .......... 9% 153M 1s 2024-09-12T18:10:36.168 INFO:teuthology.orchestra.run.smithi097.stderr: 9050K .......... .......... .......... .......... .......... 9% 171M 1s 2024-09-12T18:10:36.168 INFO:teuthology.orchestra.run.smithi097.stderr: 9100K .......... .......... .......... .......... .......... 9% 197M 1s 2024-09-12T18:10:36.168 INFO:teuthology.orchestra.run.smithi097.stderr: 9150K .......... .......... .......... .......... .......... 9% 225M 1s 2024-09-12T18:10:36.168 INFO:teuthology.orchestra.run.smithi097.stderr: 9200K .......... .......... .......... .......... .......... 9% 146M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9250K .......... .......... .......... .......... .......... 10% 206M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9300K .......... .......... .......... .......... .......... 10% 134M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9350K .......... .......... .......... .......... .......... 10% 162M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9400K .......... .......... .......... .......... .......... 10% 219M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9450K .......... .......... .......... .......... .......... 10% 226M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9500K .......... .......... .......... .......... .......... 10% 143M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9550K .......... .......... .......... .......... .......... 10% 172M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9600K .......... .......... .......... .......... .......... 10% 214M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9650K .......... .......... .......... .......... .......... 10% 246M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9700K .......... .......... .......... .......... .......... 10% 248M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9750K .......... .......... .......... .......... .......... 10% 214M 1s 2024-09-12T18:10:36.169 INFO:teuthology.orchestra.run.smithi097.stderr: 9800K .......... .......... .......... .......... .......... 10% 226M 1s 2024-09-12T18:10:36.170 INFO:teuthology.orchestra.run.smithi097.stderr: 9850K .......... .......... .......... .......... .......... 10% 251M 1s 2024-09-12T18:10:36.170 INFO:teuthology.orchestra.run.smithi097.stderr: 9900K .......... .......... .......... .......... .......... 10% 244M 1s 2024-09-12T18:10:36.170 INFO:teuthology.orchestra.run.smithi097.stderr: 9950K .......... .......... .......... .......... .......... 10% 248M 1s 2024-09-12T18:10:36.170 INFO:teuthology.orchestra.run.smithi097.stderr: 10000K .......... .......... .......... .......... .......... 10% 226M 1s 2024-09-12T18:10:36.170 INFO:teuthology.orchestra.run.smithi097.stderr: 10050K .......... .......... .......... .......... .......... 10% 226M 1s 2024-09-12T18:10:36.170 INFO:teuthology.orchestra.run.smithi097.stderr: 10100K .......... .......... .......... .......... .......... 10% 242M 1s 2024-09-12T18:10:36.170 INFO:teuthology.orchestra.run.smithi097.stderr: 10150K .......... .......... .......... .......... .......... 10% 257M 1s 2024-09-12T18:10:36.170 INFO:teuthology.orchestra.run.smithi097.stderr: 10200K .......... .......... .......... .......... .......... 11% 237M 1s 2024-09-12T18:10:36.170 INFO:teuthology.orchestra.run.smithi097.stderr: 10250K .......... .......... .......... .......... .......... 11% 279M 1s 2024-09-12T18:10:36.170 INFO:teuthology.orchestra.run.smithi097.stderr: 10300K .......... .......... .......... .......... .......... 11% 263M 1s 2024-09-12T18:10:36.170 INFO:teuthology.orchestra.run.smithi097.stderr: 10350K .......... .......... .......... .......... .......... 11% 203M 1s 2024-09-12T18:10:36.171 INFO:teuthology.orchestra.run.smithi097.stderr: 10400K .......... .......... .......... .......... .......... 11% 257M 1s 2024-09-12T18:10:36.171 INFO:teuthology.orchestra.run.smithi097.stderr: 10450K .......... .......... .......... .......... .......... 11% 202M 1s 2024-09-12T18:10:36.171 INFO:teuthology.orchestra.run.smithi097.stderr: 10500K .......... .......... .......... .......... .......... 11% 173M 1s 2024-09-12T18:10:36.171 INFO:teuthology.orchestra.run.smithi097.stderr: 10550K .......... .......... .......... .......... .......... 11% 141M 1s 2024-09-12T18:10:36.171 INFO:teuthology.orchestra.run.smithi097.stderr: 10600K .......... .......... .......... .......... .......... 11% 143M 1s 2024-09-12T18:10:36.171 INFO:teuthology.orchestra.run.smithi097.stderr: 10650K .......... .......... .......... .......... .......... 11% 161M 1s 2024-09-12T18:10:36.171 INFO:teuthology.orchestra.run.smithi097.stderr: 10700K .......... .......... .......... .......... .......... 11% 239M 1s 2024-09-12T18:10:36.171 INFO:teuthology.orchestra.run.smithi097.stderr: 10750K .......... .......... .......... .......... .......... 11% 146M 1s 2024-09-12T18:10:36.171 INFO:teuthology.orchestra.run.smithi097.stderr: 10800K .......... .......... .......... .......... .......... 11% 191M 1s 2024-09-12T18:10:36.171 INFO:teuthology.orchestra.run.smithi097.stderr: 10850K .......... .......... .......... .......... .......... 11% 246M 1s 2024-09-12T18:10:36.171 INFO:teuthology.orchestra.run.smithi097.stderr: 10900K .......... .......... .......... .......... .......... 11% 266M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 10950K .......... .......... .......... .......... .......... 11% 190M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 11000K .......... .......... .......... .......... .......... 11% 185M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 11050K .......... .......... .......... .......... .......... 11% 187M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 11100K .......... .......... .......... .......... .......... 12% 246M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 11150K .......... .......... .......... .......... .......... 12% 235M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 11200K .......... .......... .......... .......... .......... 12% 262M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 11250K .......... .......... .......... .......... .......... 12% 195M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 11300K .......... .......... .......... .......... .......... 12% 240M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 11350K .......... .......... .......... .......... .......... 12% 175M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 11400K .......... .......... .......... .......... .......... 12% 237M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 11450K .......... .......... .......... .......... .......... 12% 210M 1s 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi097.stderr: 11500K .......... .......... .......... .......... .......... 12% 256M 1s 2024-09-12T18:10:36.173 INFO:teuthology.orchestra.run.smithi097.stderr: 11550K .......... .......... .......... .......... .......... 12% 182M 1s 2024-09-12T18:10:36.173 INFO:teuthology.orchestra.run.smithi097.stderr: 11600K .......... .......... .......... .......... .......... 12% 267M 1s 2024-09-12T18:10:36.173 INFO:teuthology.orchestra.run.smithi097.stderr: 11650K .......... .......... .......... .......... .......... 12% 209M 1s 2024-09-12T18:10:36.173 INFO:teuthology.orchestra.run.smithi097.stderr: 11700K .......... .......... .......... .......... .......... 12% 172M 1s 2024-09-12T18:10:36.173 INFO:teuthology.orchestra.run.smithi097.stderr: 11750K .......... .......... .......... .......... .......... 12% 238M 1s 2024-09-12T18:10:36.173 INFO:teuthology.orchestra.run.smithi097.stderr: 11800K .......... .......... .......... .......... .......... 12% 172M 1s 2024-09-12T18:10:36.173 INFO:teuthology.orchestra.run.smithi097.stderr: 11850K .......... .......... .......... .......... .......... 12% 199M 1s 2024-09-12T18:10:36.173 INFO:teuthology.orchestra.run.smithi097.stderr: 11900K .......... .......... .......... .......... .......... 12% 272M 1s 2024-09-12T18:10:36.173 INFO:teuthology.orchestra.run.smithi097.stderr: 11950K .......... .......... .......... .......... .......... 12% 271M 1s 2024-09-12T18:10:36.173 INFO:teuthology.orchestra.run.smithi097.stderr: 12000K .......... .......... .......... .......... .......... 12% 247M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12050K .......... .......... .......... .......... .......... 13% 173M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12100K .......... .......... .......... .......... .......... 13% 182M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12150K .......... .......... .......... .......... .......... 13% 227M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12200K .......... .......... .......... .......... .......... 13% 282M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12250K .......... .......... .......... .......... .......... 13% 240M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12300K .......... .......... .......... .......... .......... 13% 281M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12350K .......... .......... .......... .......... .......... 13% 270M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12400K .......... .......... .......... .......... .......... 13% 199M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12450K .......... .......... .......... .......... .......... 13% 242M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12500K .......... .......... .......... .......... .......... 13% 275M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12550K .......... .......... .......... .......... .......... 13% 257M 1s 2024-09-12T18:10:36.174 INFO:teuthology.orchestra.run.smithi097.stderr: 12600K .......... .......... .......... .......... .......... 13% 290M 1s 2024-09-12T18:10:36.175 INFO:teuthology.orchestra.run.smithi097.stderr: 12650K .......... .......... .......... .......... .......... 13% 263M 1s 2024-09-12T18:10:36.175 INFO:teuthology.orchestra.run.smithi097.stderr: 12700K .......... .......... .......... .......... .......... 13% 261M 1s 2024-09-12T18:10:36.175 INFO:teuthology.orchestra.run.smithi097.stderr: 12750K .......... .......... .......... .......... .......... 13% 279M 1s 2024-09-12T18:10:36.175 INFO:teuthology.orchestra.run.smithi097.stderr: 12800K .......... .......... .......... .......... .......... 13% 282M 1s 2024-09-12T18:10:36.175 INFO:teuthology.orchestra.run.smithi097.stderr: 12850K .......... .......... .......... .......... .......... 13% 292M 1s 2024-09-12T18:10:36.175 INFO:teuthology.orchestra.run.smithi097.stderr: 12900K .......... .......... .......... .......... .......... 13% 247M 1s 2024-09-12T18:10:36.175 INFO:teuthology.orchestra.run.smithi097.stderr: 12950K .......... .......... .......... .......... .......... 13% 60.4M 1s 2024-09-12T18:10:36.175 INFO:teuthology.orchestra.run.smithi097.stderr: 13000K .......... .......... .......... .......... .......... 14% 178M 1s 2024-09-12T18:10:36.175 INFO:teuthology.orchestra.run.smithi097.stderr: 13050K .......... .......... .......... .......... .......... 14% 213M 1s 2024-09-12T18:10:36.175 INFO:teuthology.orchestra.run.smithi097.stderr: 13100K .......... .......... .......... .......... .......... 14% 203M 1s 2024-09-12T18:10:36.176 INFO:teuthology.orchestra.run.smithi097.stderr: 13150K .......... .......... .......... .......... .......... 14% 194M 1s 2024-09-12T18:10:36.176 INFO:teuthology.orchestra.run.smithi097.stderr: 13200K .......... .......... .......... .......... .......... 14% 205M 1s 2024-09-12T18:10:36.176 INFO:teuthology.orchestra.run.smithi097.stderr: 13250K .......... .......... .......... .......... .......... 14% 201M 1s 2024-09-12T18:10:36.176 INFO:teuthology.orchestra.run.smithi097.stderr: 13300K .......... .......... .......... .......... .......... 14% 195M 1s 2024-09-12T18:10:36.176 INFO:teuthology.orchestra.run.smithi097.stderr: 13350K .......... .......... .......... .......... .......... 14% 212M 1s 2024-09-12T18:10:36.176 INFO:teuthology.orchestra.run.smithi097.stderr: 13400K .......... .......... .......... .......... .......... 14% 217M 1s 2024-09-12T18:10:36.176 INFO:teuthology.orchestra.run.smithi097.stderr: 13450K .......... .......... .......... .......... .......... 14% 241M 1s 2024-09-12T18:10:36.176 INFO:teuthology.orchestra.run.smithi097.stderr: 13500K .......... .......... .......... .......... .......... 14% 261M 1s 2024-09-12T18:10:36.176 INFO:teuthology.orchestra.run.smithi097.stderr: 13550K .......... .......... .......... .......... .......... 14% 298M 1s 2024-09-12T18:10:36.176 INFO:teuthology.orchestra.run.smithi097.stderr: 13600K .......... .......... .......... .......... .......... 14% 216M 1s 2024-09-12T18:10:36.176 INFO:teuthology.orchestra.run.smithi097.stderr: 13650K .......... .......... .......... .......... .......... 14% 213M 1s 2024-09-12T18:10:36.177 INFO:teuthology.orchestra.run.smithi097.stderr: 13700K .......... .......... .......... .......... .......... 14% 221M 1s 2024-09-12T18:10:36.177 INFO:teuthology.orchestra.run.smithi097.stderr: 13750K .......... .......... .......... .......... .......... 14% 225M 1s 2024-09-12T18:10:36.177 INFO:teuthology.orchestra.run.smithi097.stderr: 13800K .......... .......... .......... .......... .......... 14% 284M 1s 2024-09-12T18:10:36.177 INFO:teuthology.orchestra.run.smithi097.stderr: 13850K .......... .......... .......... .......... .......... 14% 268M 1s 2024-09-12T18:10:36.177 INFO:teuthology.orchestra.run.smithi097.stderr: 13900K .......... .......... .......... .......... .......... 15% 213M 1s 2024-09-12T18:10:36.177 INFO:teuthology.orchestra.run.smithi097.stderr: 13950K .......... .......... .......... .......... .......... 15% 210M 1s 2024-09-12T18:10:36.177 INFO:teuthology.orchestra.run.smithi097.stderr: 14000K .......... .......... .......... .......... .......... 15% 280M 1s 2024-09-12T18:10:36.177 INFO:teuthology.orchestra.run.smithi097.stderr: 14050K .......... .......... .......... .......... .......... 15% 295M 1s 2024-09-12T18:10:36.177 INFO:teuthology.orchestra.run.smithi097.stderr: 14100K .......... .......... .......... .......... .......... 15% 189M 1s 2024-09-12T18:10:36.177 INFO:teuthology.orchestra.run.smithi097.stderr: 14150K .......... .......... .......... .......... .......... 15% 220M 1s 2024-09-12T18:10:36.177 INFO:teuthology.orchestra.run.smithi097.stderr: 14200K .......... .......... .......... .......... .......... 15% 211M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14250K .......... .......... .......... .......... .......... 15% 229M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14300K .......... .......... .......... .......... .......... 15% 265M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14350K .......... .......... .......... .......... .......... 15% 206M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14400K .......... .......... .......... .......... .......... 15% 242M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14450K .......... .......... .......... .......... .......... 15% 288M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14500K .......... .......... .......... .......... .......... 15% 248M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14550K .......... .......... .......... .......... .......... 15% 178M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14600K .......... .......... .......... .......... .......... 15% 280M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14650K .......... .......... .......... .......... .......... 15% 293M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14700K .......... .......... .......... .......... .......... 15% 216M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14750K .......... .......... .......... .......... .......... 15% 215M 1s 2024-09-12T18:10:36.178 INFO:teuthology.orchestra.run.smithi097.stderr: 14800K .......... .......... .......... .......... .......... 15% 216M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 14850K .......... .......... .......... .......... .......... 16% 226M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 14900K .......... .......... .......... .......... .......... 16% 301M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 14950K .......... .......... .......... .......... .......... 16% 271M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 15000K .......... .......... .......... .......... .......... 16% 225M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 15050K .......... .......... .......... .......... .......... 16% 219M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 15100K .......... .......... .......... .......... .......... 16% 273M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 15150K .......... .......... .......... .......... .......... 16% 304M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 15200K .......... .......... .......... .......... .......... 16% 271M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 15250K .......... .......... .......... .......... .......... 16% 285M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 15300K .......... .......... .......... .......... .......... 16% 22.3M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 15350K .......... .......... .......... .......... .......... 16% 195M 1s 2024-09-12T18:10:36.179 INFO:teuthology.orchestra.run.smithi097.stderr: 15400K .......... .......... .......... .......... .......... 16% 174M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 15450K .......... .......... .......... .......... .......... 16% 194M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 15500K .......... .......... .......... .......... .......... 16% 206M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 15550K .......... .......... .......... .......... .......... 16% 184M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 15600K .......... .......... .......... .......... .......... 16% 229M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 15650K .......... .......... .......... .......... .......... 16% 246M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 15700K .......... .......... .......... .......... .......... 16% 274M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 15750K .......... .......... .......... .......... .......... 17% 229M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 15800K .......... .......... .......... .......... .......... 17% 287M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 15850K .......... .......... .......... .......... .......... 17% 304M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 15900K .......... .......... .......... .......... .......... 17% 219M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 15950K .......... .......... .......... .......... .......... 17% 191M 1s 2024-09-12T18:10:36.180 INFO:teuthology.orchestra.run.smithi097.stderr: 16000K .......... .......... .......... .......... .......... 17% 296M 1s 2024-09-12T18:10:36.181 INFO:teuthology.orchestra.run.smithi097.stderr: 16050K .......... .......... .......... .......... .......... 17% 203M 1s 2024-09-12T18:10:36.181 INFO:teuthology.orchestra.run.smithi097.stderr: 16100K .......... .......... .......... .......... .......... 17% 270M 1s 2024-09-12T18:10:36.181 INFO:teuthology.orchestra.run.smithi097.stderr: 16150K .......... .......... .......... .......... .......... 17% 176M 1s 2024-09-12T18:10:36.181 INFO:teuthology.orchestra.run.smithi097.stderr: 16200K .......... .......... .......... .......... .......... 17% 242M 1s 2024-09-12T18:10:36.181 INFO:teuthology.orchestra.run.smithi097.stderr: 16250K .......... .......... .......... .......... .......... 17% 250M 1s 2024-09-12T18:10:36.181 INFO:teuthology.orchestra.run.smithi097.stderr: 16300K .......... .......... .......... .......... .......... 17% 214M 1s 2024-09-12T18:10:36.181 INFO:teuthology.orchestra.run.smithi097.stderr: 16350K .......... .......... .......... .......... .......... 17% 208M 1s 2024-09-12T18:10:36.181 INFO:teuthology.orchestra.run.smithi097.stderr: 16400K .......... .......... .......... .......... .......... 17% 250M 1s 2024-09-12T18:10:36.181 INFO:teuthology.orchestra.run.smithi097.stderr: 16450K .......... .......... .......... .......... .......... 17% 268M 1s 2024-09-12T18:10:36.181 INFO:teuthology.orchestra.run.smithi097.stderr: 16500K .......... .......... .......... .......... .......... 17% 242M 1s 2024-09-12T18:10:36.181 INFO:teuthology.orchestra.run.smithi097.stderr: 16550K .......... .......... .......... .......... .......... 17% 247M 1s 2024-09-12T18:10:36.182 INFO:teuthology.orchestra.run.smithi097.stderr: 16600K .......... .......... .......... .......... .......... 17% 195M 1s 2024-09-12T18:10:36.182 INFO:teuthology.orchestra.run.smithi097.stderr: 16650K .......... .......... .......... .......... .......... 17% 245M 1s 2024-09-12T18:10:36.182 INFO:teuthology.orchestra.run.smithi097.stderr: 16700K .......... .......... .......... .......... .......... 18% 198M 1s 2024-09-12T18:10:36.182 INFO:teuthology.orchestra.run.smithi097.stderr: 16750K .......... .......... .......... .......... .......... 18% 228M 1s 2024-09-12T18:10:36.182 INFO:teuthology.orchestra.run.smithi097.stderr: 16800K .......... .......... .......... .......... .......... 18% 225M 1s 2024-09-12T18:10:36.182 INFO:teuthology.orchestra.run.smithi097.stderr: 16850K .......... .......... .......... .......... .......... 18% 269M 1s 2024-09-12T18:10:36.182 INFO:teuthology.orchestra.run.smithi097.stderr: 16900K .......... .......... .......... .......... .......... 18% 191M 1s 2024-09-12T18:10:36.182 INFO:teuthology.orchestra.run.smithi097.stderr: 16950K .......... .......... .......... .......... .......... 18% 245M 1s 2024-09-12T18:10:36.182 INFO:teuthology.orchestra.run.smithi097.stderr: 17000K .......... .......... .......... .......... .......... 18% 224M 1s 2024-09-12T18:10:36.182 INFO:teuthology.orchestra.run.smithi097.stderr: 17050K .......... .......... .......... .......... .......... 18% 245M 1s 2024-09-12T18:10:36.182 INFO:teuthology.orchestra.run.smithi097.stderr: 17100K .......... .......... .......... .......... .......... 18% 203M 1s 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi097.stderr: 17150K .......... .......... .......... .......... .......... 18% 211M 1s 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi097.stderr: 17200K .......... .......... .......... .......... .......... 18% 173M 1s 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi097.stderr: 17250K .......... .......... .......... .......... .......... 18% 289M 1s 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi097.stderr: 17300K .......... .......... .......... .......... .......... 18% 291M 1s 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi097.stderr: 17350K .......... .......... .......... .......... .......... 18% 307M 1s 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi097.stderr: 17400K .......... .......... .......... .......... .......... 18% 236M 1s 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi097.stderr: 17450K .......... .......... .......... .......... .......... 18% 296M 1s 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi097.stderr: 17500K .......... .......... .......... .......... .......... 18% 304M 1s 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi097.stderr: 17550K .......... .......... .......... .......... .......... 18% 240M 1s 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi097.stderr: 17600K .......... .......... .......... .......... .......... 18% 267M 1s 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi097.stderr: 17650K .......... .......... .......... .......... .......... 19% 298M 1s 2024-09-12T18:10:36.184 INFO:teuthology.orchestra.run.smithi097.stderr: 17700K .......... .......... .......... .......... .......... 19% 299M 1s 2024-09-12T18:10:36.184 INFO:teuthology.orchestra.run.smithi097.stderr: 17750K .......... .......... .......... .......... .......... 19% 291M 1s 2024-09-12T18:10:36.184 INFO:teuthology.orchestra.run.smithi097.stderr: 17800K .......... .......... .......... .......... .......... 19% 238M 1s 2024-09-12T18:10:36.184 INFO:teuthology.orchestra.run.smithi097.stderr: 17850K .......... .......... .......... .......... .......... 19% 272M 1s 2024-09-12T18:10:36.184 INFO:teuthology.orchestra.run.smithi097.stderr: 17900K .......... .......... .......... .......... .......... 19% 304M 1s 2024-09-12T18:10:36.184 INFO:teuthology.orchestra.run.smithi097.stderr: 17950K .......... .......... .......... .......... .......... 19% 303M 1s 2024-09-12T18:10:36.184 INFO:teuthology.orchestra.run.smithi097.stderr: 18000K .......... .......... .......... .......... .......... 19% 46.1M 1s 2024-09-12T18:10:36.184 INFO:teuthology.orchestra.run.smithi097.stderr: 18050K .......... .......... .......... .......... .......... 19% 126M 1s 2024-09-12T18:10:36.184 INFO:teuthology.orchestra.run.smithi097.stderr: 18100K .......... .......... .......... .......... .......... 19% 163M 1s 2024-09-12T18:10:36.184 INFO:teuthology.orchestra.run.smithi097.stderr: 18150K .......... .......... .......... .......... .......... 19% 189M 1s 2024-09-12T18:10:36.184 INFO:teuthology.orchestra.run.smithi097.stderr: 18200K .......... .......... .......... .......... .......... 19% 252M 1s 2024-09-12T18:10:36.185 INFO:teuthology.orchestra.run.smithi097.stderr: 18250K .......... .......... .......... .......... .......... 19% 182M 1s 2024-09-12T18:10:36.185 INFO:teuthology.orchestra.run.smithi097.stderr: 18300K .......... .......... .......... .......... .......... 19% 164M 1s 2024-09-12T18:10:36.185 INFO:teuthology.orchestra.run.smithi097.stderr: 18350K .......... .......... .......... .......... .......... 19% 166M 1s 2024-09-12T18:10:36.185 INFO:teuthology.orchestra.run.smithi097.stderr: 18400K .......... .......... .......... .......... .......... 19% 185M 1s 2024-09-12T18:10:36.185 INFO:teuthology.orchestra.run.smithi097.stderr: 18450K .......... .......... .......... .......... .......... 19% 214M 1s 2024-09-12T18:10:36.185 INFO:teuthology.orchestra.run.smithi097.stderr: 18500K .......... .......... .......... .......... .......... 19% 170M 1s 2024-09-12T18:10:36.185 INFO:teuthology.orchestra.run.smithi097.stderr: 18550K .......... .......... .......... .......... .......... 20% 196M 1s 2024-09-12T18:10:36.185 INFO:teuthology.orchestra.run.smithi097.stderr: 18600K .......... .......... .......... .......... .......... 20% 137M 1s 2024-09-12T18:10:36.185 INFO:teuthology.orchestra.run.smithi097.stderr: 18650K .......... .......... .......... .......... .......... 20% 161M 1s 2024-09-12T18:10:36.185 INFO:teuthology.orchestra.run.smithi097.stderr: 18700K .......... .......... .......... .......... .......... 20% 198M 1s 2024-09-12T18:10:36.186 INFO:teuthology.orchestra.run.smithi097.stderr: 18750K .......... .......... .......... .......... .......... 20% 162M 1s 2024-09-12T18:10:36.186 INFO:teuthology.orchestra.run.smithi097.stderr: 18800K .......... .......... .......... .......... .......... 20% 158M 1s 2024-09-12T18:10:36.186 INFO:teuthology.orchestra.run.smithi097.stderr: 18850K .......... .......... .......... .......... .......... 20% 237M 1s 2024-09-12T18:10:36.186 INFO:teuthology.orchestra.run.smithi097.stderr: 18900K .......... .......... .......... .......... .......... 20% 156M 1s 2024-09-12T18:10:36.186 INFO:teuthology.orchestra.run.smithi097.stderr: 18950K .......... .......... .......... .......... .......... 20% 204M 1s 2024-09-12T18:10:36.186 INFO:teuthology.orchestra.run.smithi097.stderr: 19000K .......... .......... .......... .......... .......... 20% 234M 1s 2024-09-12T18:10:36.186 INFO:teuthology.orchestra.run.smithi097.stderr: 19050K .......... .......... .......... .......... .......... 20% 200M 1s 2024-09-12T18:10:36.186 INFO:teuthology.orchestra.run.smithi097.stderr: 19100K .......... .......... .......... .......... .......... 20% 209M 1s 2024-09-12T18:10:36.186 INFO:teuthology.orchestra.run.smithi097.stderr: 19150K .......... .......... .......... .......... .......... 20% 209M 1s 2024-09-12T18:10:36.186 INFO:teuthology.orchestra.run.smithi097.stderr: 19200K .......... .......... .......... .......... .......... 20% 235M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19250K .......... .......... .......... .......... .......... 20% 248M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19300K .......... .......... .......... .......... .......... 20% 227M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19350K .......... .......... .......... .......... .......... 20% 253M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19400K .......... .......... .......... .......... .......... 20% 223M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19450K .......... .......... .......... .......... .......... 20% 234M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19500K .......... .......... .......... .......... .......... 21% 252M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19550K .......... .......... .......... .......... .......... 21% 200M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19600K .......... .......... .......... .......... .......... 21% 217M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19650K .......... .......... .......... .......... .......... 21% 217M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19700K .......... .......... .......... .......... .......... 21% 225M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19750K .......... .......... .......... .......... .......... 21% 188M 1s 2024-09-12T18:10:36.187 INFO:teuthology.orchestra.run.smithi097.stderr: 19800K .......... .......... .......... .......... .......... 21% 201M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 19850K .......... .......... .......... .......... .......... 21% 194M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 19900K .......... .......... .......... .......... .......... 21% 225M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 19950K .......... .......... .......... .......... .......... 21% 244M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 20000K .......... .......... .......... .......... .......... 21% 252M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 20050K .......... .......... .......... .......... .......... 21% 227M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 20100K .......... .......... .......... .......... .......... 21% 252M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 20150K .......... .......... .......... .......... .......... 21% 255M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 20200K .......... .......... .......... .......... .......... 21% 210M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 20250K .......... .......... .......... .......... .......... 21% 211M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 20300K .......... .......... .......... .......... .......... 21% 255M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 20350K .......... .......... .......... .......... .......... 21% 257M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 20400K .......... .......... .......... .......... .......... 22% 261M 1s 2024-09-12T18:10:36.188 INFO:teuthology.orchestra.run.smithi097.stderr: 20450K .......... .......... .......... .......... .......... 22% 163M 1s 2024-09-12T18:10:36.189 INFO:teuthology.orchestra.run.smithi097.stderr: 20500K .......... .......... .......... .......... .......... 22% 209M 1s 2024-09-12T18:10:36.189 INFO:teuthology.orchestra.run.smithi097.stderr: 20550K .......... .......... .......... .......... .......... 22% 135M 1s 2024-09-12T18:10:36.189 INFO:teuthology.orchestra.run.smithi097.stderr: 20600K .......... .......... .......... .......... .......... 22% 160M 1s 2024-09-12T18:10:36.189 INFO:teuthology.orchestra.run.smithi097.stderr: 20650K .......... .......... .......... .......... .......... 22% 190M 1s 2024-09-12T18:10:36.189 INFO:teuthology.orchestra.run.smithi097.stderr: 20700K .......... .......... .......... .......... .......... 22% 162M 1s 2024-09-12T18:10:36.189 INFO:teuthology.orchestra.run.smithi097.stderr: 20750K .......... .......... .......... .......... .......... 22% 179M 1s 2024-09-12T18:10:36.189 INFO:teuthology.orchestra.run.smithi097.stderr: 20800K .......... .......... .......... .......... .......... 22% 200M 1s 2024-09-12T18:10:36.189 INFO:teuthology.orchestra.run.smithi097.stderr: 20850K .......... .......... .......... .......... .......... 22% 242M 1s 2024-09-12T18:10:36.189 INFO:teuthology.orchestra.run.smithi097.stderr: 20900K .......... .......... .......... .......... .......... 22% 191M 1s 2024-09-12T18:10:36.189 INFO:teuthology.orchestra.run.smithi097.stderr: 20950K .......... .......... .......... .......... .......... 22% 203M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21000K .......... .......... .......... .......... .......... 22% 209M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21050K .......... .......... .......... .......... .......... 22% 216M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21100K .......... .......... .......... .......... .......... 22% 190M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21150K .......... .......... .......... .......... .......... 22% 208M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21200K .......... .......... .......... .......... .......... 22% 203M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21250K .......... .......... .......... .......... .......... 22% 254M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21300K .......... .......... .......... .......... .......... 22% 153M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21350K .......... .......... .......... .......... .......... 23% 244M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21400K .......... .......... .......... .......... .......... 23% 176M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21450K .......... .......... .......... .......... .......... 23% 228M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21500K .......... .......... .......... .......... .......... 23% 186M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21550K .......... .......... .......... .......... .......... 23% 195M 1s 2024-09-12T18:10:36.190 INFO:teuthology.orchestra.run.smithi097.stderr: 21600K .......... .......... .......... .......... .......... 23% 204M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 21650K .......... .......... .......... .......... .......... 23% 226M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 21700K .......... .......... .......... .......... .......... 23% 199M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 21750K .......... .......... .......... .......... .......... 23% 275M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 21800K .......... .......... .......... .......... .......... 23% 241M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 21850K .......... .......... .......... .......... .......... 23% 222M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 21900K .......... .......... .......... .......... .......... 23% 185M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 21950K .......... .......... .......... .......... .......... 23% 221M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 22000K .......... .......... .......... .......... .......... 23% 235M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 22050K .......... .......... .......... .......... .......... 23% 277M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 22100K .......... .......... .......... .......... .......... 23% 228M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 22150K .......... .......... .......... .......... .......... 23% 253M 1s 2024-09-12T18:10:36.191 INFO:teuthology.orchestra.run.smithi097.stderr: 22200K .......... .......... .......... .......... .......... 23% 270M 1s 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi097.stderr: 22250K .......... .......... .......... .......... .......... 24% 220M 1s 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi097.stderr: 22300K .......... .......... .......... .......... .......... 24% 216M 1s 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi097.stderr: 22350K .......... .......... .......... .......... .......... 24% 272M 1s 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi097.stderr: 22400K .......... .......... .......... .......... .......... 24% 281M 1s 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi097.stderr: 22450K .......... .......... .......... .......... .......... 24% 292M 1s 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi097.stderr: 22500K .......... .......... .......... .......... .......... 24% 254M 1s 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi097.stderr: 22550K .......... .......... .......... .......... .......... 24% 270M 1s 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi097.stderr: 22600K .......... .......... .......... .......... .......... 24% 293M 1s 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi097.stderr: 22650K .......... .......... .......... .......... .......... 24% 275M 1s 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi097.stderr: 22700K .......... .......... .......... .......... .......... 24% 212M 1s 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi097.stderr: 22750K .......... .......... .......... .......... .......... 24% 296M 1s 2024-09-12T18:10:36.193 INFO:teuthology.orchestra.run.smithi097.stderr: 22800K .......... .......... .......... .......... .......... 24% 292M 1s 2024-09-12T18:10:36.193 INFO:teuthology.orchestra.run.smithi097.stderr: 22850K .......... .......... .......... .......... .......... 24% 291M 1s 2024-09-12T18:10:36.193 INFO:teuthology.orchestra.run.smithi097.stderr: 22900K .......... .......... .......... .......... .......... 24% 255M 1s 2024-09-12T18:10:36.193 INFO:teuthology.orchestra.run.smithi097.stderr: 22950K .......... .......... .......... .......... .......... 24% 256M 1s 2024-09-12T18:10:36.193 INFO:teuthology.orchestra.run.smithi097.stderr: 23000K .......... .......... .......... .......... .......... 24% 50.6M 1s 2024-09-12T18:10:36.193 INFO:teuthology.orchestra.run.smithi097.stderr: 23050K .......... .......... .......... .......... .......... 24% 296M 1s 2024-09-12T18:10:36.193 INFO:teuthology.orchestra.run.smithi097.stderr: 23100K .......... .......... .......... .......... .......... 24% 223M 1s 2024-09-12T18:10:36.193 INFO:teuthology.orchestra.run.smithi097.stderr: 23150K .......... .......... .......... .......... .......... 24% 217M 1s 2024-09-12T18:10:36.193 INFO:teuthology.orchestra.run.smithi097.stderr: 23200K .......... .......... .......... .......... .......... 25% 243M 1s 2024-09-12T18:10:36.193 INFO:teuthology.orchestra.run.smithi097.stderr: 23250K .......... .......... .......... .......... .......... 25% 246M 1s 2024-09-12T18:10:36.194 INFO:teuthology.orchestra.run.smithi097.stderr: 23300K .......... .......... .......... .......... .......... 25% 265M 1s 2024-09-12T18:10:36.194 INFO:teuthology.orchestra.run.smithi097.stderr: 23350K .......... .......... .......... .......... .......... 25% 203M 1s 2024-09-12T18:10:36.194 INFO:teuthology.orchestra.run.smithi097.stderr: 23400K .......... .......... .......... .......... .......... 25% 252M 1s 2024-09-12T18:10:36.194 INFO:teuthology.orchestra.run.smithi097.stderr: 23450K .......... .......... .......... .......... .......... 25% 242M 1s 2024-09-12T18:10:36.194 INFO:teuthology.orchestra.run.smithi097.stderr: 23500K .......... .......... .......... .......... .......... 25% 264M 1s 2024-09-12T18:10:36.194 INFO:teuthology.orchestra.run.smithi097.stderr: 23550K .......... .......... .......... .......... .......... 25% 220M 1s 2024-09-12T18:10:36.194 INFO:teuthology.orchestra.run.smithi097.stderr: 23600K .......... .......... .......... .......... .......... 25% 203M 1s 2024-09-12T18:10:36.194 INFO:teuthology.orchestra.run.smithi097.stderr: 23650K .......... .......... .......... .......... .......... 25% 217M 1s 2024-09-12T18:10:36.194 INFO:teuthology.orchestra.run.smithi097.stderr: 23700K .......... .......... .......... .......... .......... 25% 218M 1s 2024-09-12T18:10:36.194 INFO:teuthology.orchestra.run.smithi097.stderr: 23750K .......... .......... .......... .......... .......... 25% 215M 1s 2024-09-12T18:10:36.194 INFO:teuthology.orchestra.run.smithi097.stderr: 23800K .......... .......... .......... .......... .......... 25% 231M 1s 2024-09-12T18:10:36.195 INFO:teuthology.orchestra.run.smithi097.stderr: 23850K .......... .......... .......... .......... .......... 25% 250M 1s 2024-09-12T18:10:36.195 INFO:teuthology.orchestra.run.smithi097.stderr: 23900K .......... .......... .......... .......... .......... 25% 241M 1s 2024-09-12T18:10:36.195 INFO:teuthology.orchestra.run.smithi097.stderr: 23950K .......... .......... .......... .......... .......... 25% 224M 1s 2024-09-12T18:10:36.195 INFO:teuthology.orchestra.run.smithi097.stderr: 24000K .......... .......... .......... .......... .......... 25% 192M 1s 2024-09-12T18:10:36.195 INFO:teuthology.orchestra.run.smithi097.stderr: 24050K .......... .......... .......... .......... .......... 25% 270M 1s 2024-09-12T18:10:36.195 INFO:teuthology.orchestra.run.smithi097.stderr: 24100K .......... .......... .......... .......... .......... 25% 200M 1s 2024-09-12T18:10:36.195 INFO:teuthology.orchestra.run.smithi097.stderr: 24150K .......... .......... .......... .......... .......... 26% 231M 1s 2024-09-12T18:10:36.195 INFO:teuthology.orchestra.run.smithi097.stderr: 24200K .......... .......... .......... .......... .......... 26% 199M 1s 2024-09-12T18:10:36.195 INFO:teuthology.orchestra.run.smithi097.stderr: 24250K .......... .......... .......... .......... .......... 26% 229M 1s 2024-09-12T18:10:36.195 INFO:teuthology.orchestra.run.smithi097.stderr: 24300K .......... .......... .......... .......... .......... 26% 188M 1s 2024-09-12T18:10:36.195 INFO:teuthology.orchestra.run.smithi097.stderr: 24350K .......... .......... .......... .......... .......... 26% 248M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24400K .......... .......... .......... .......... .......... 26% 212M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24450K .......... .......... .......... .......... .......... 26% 254M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24500K .......... .......... .......... .......... .......... 26% 267M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24550K .......... .......... .......... .......... .......... 26% 228M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24600K .......... .......... .......... .......... .......... 26% 227M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24650K .......... .......... .......... .......... .......... 26% 264M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24700K .......... .......... .......... .......... .......... 26% 191M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24750K .......... .......... .......... .......... .......... 26% 276M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24800K .......... .......... .......... .......... .......... 26% 265M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24850K .......... .......... .......... .......... .......... 26% 245M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24900K .......... .......... .......... .......... .......... 26% 242M 1s 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi097.stderr: 24950K .......... .......... .......... .......... .......... 26% 259M 1s 2024-09-12T18:10:36.197 INFO:teuthology.orchestra.run.smithi097.stderr: 25000K .......... .......... .......... .......... .......... 26% 230M 1s 2024-09-12T18:10:36.197 INFO:teuthology.orchestra.run.smithi097.stderr: 25050K .......... .......... .......... .......... .......... 27% 209M 1s 2024-09-12T18:10:36.197 INFO:teuthology.orchestra.run.smithi097.stderr: 25100K .......... .......... .......... .......... .......... 27% 243M 1s 2024-09-12T18:10:36.197 INFO:teuthology.orchestra.run.smithi097.stderr: 25150K .......... .......... .......... .......... .......... 27% 267M 1s 2024-09-12T18:10:36.197 INFO:teuthology.orchestra.run.smithi097.stderr: 25200K .......... .......... .......... .......... .......... 27% 268M 1s 2024-09-12T18:10:36.197 INFO:teuthology.orchestra.run.smithi097.stderr: 25250K .......... .......... .......... .......... .......... 27% 185M 1s 2024-09-12T18:10:36.197 INFO:teuthology.orchestra.run.smithi097.stderr: 25300K .......... .......... .......... .......... .......... 27% 252M 1s 2024-09-12T18:10:36.197 INFO:teuthology.orchestra.run.smithi097.stderr: 25350K .......... .......... .......... .......... .......... 27% 303M 1s 2024-09-12T18:10:36.197 INFO:teuthology.orchestra.run.smithi097.stderr: 25400K .......... .......... .......... .......... .......... 27% 248M 1s 2024-09-12T18:10:36.197 INFO:teuthology.orchestra.run.smithi097.stderr: 25450K .......... .......... .......... .......... .......... 27% 258M 1s 2024-09-12T18:10:36.197 INFO:teuthology.orchestra.run.smithi097.stderr: 25500K .......... .......... .......... .......... .......... 27% 305M 1s 2024-09-12T18:10:36.198 INFO:teuthology.orchestra.run.smithi097.stderr: 25550K .......... .......... .......... .......... .......... 27% 307M 1s 2024-09-12T18:10:36.198 INFO:teuthology.orchestra.run.smithi097.stderr: 25600K .......... .......... .......... .......... .......... 27% 275M 1s 2024-09-12T18:10:36.198 INFO:teuthology.orchestra.run.smithi097.stderr: 25650K .......... .......... .......... .......... .......... 27% 305M 1s 2024-09-12T18:10:36.198 INFO:teuthology.orchestra.run.smithi097.stderr: 25700K .......... .......... .......... .......... .......... 27% 309M 1s 2024-09-12T18:10:36.198 INFO:teuthology.orchestra.run.smithi097.stderr: 25750K .......... .......... .......... .......... .......... 27% 84.0M 1s 2024-09-12T18:10:36.198 INFO:teuthology.orchestra.run.smithi097.stderr: 25800K .......... .......... .......... .......... .......... 27% 214M 1s 2024-09-12T18:10:36.198 INFO:teuthology.orchestra.run.smithi097.stderr: 25850K .......... .......... .......... .......... .......... 27% 225M 1s 2024-09-12T18:10:36.198 INFO:teuthology.orchestra.run.smithi097.stderr: 25900K .......... .......... .......... .......... .......... 27% 273M 1s 2024-09-12T18:10:36.198 INFO:teuthology.orchestra.run.smithi097.stderr: 25950K .......... .......... .......... .......... .......... 27% 178M 1s 2024-09-12T18:10:36.198 INFO:teuthology.orchestra.run.smithi097.stderr: 26000K .......... .......... .......... .......... .......... 28% 268M 1s 2024-09-12T18:10:36.198 INFO:teuthology.orchestra.run.smithi097.stderr: 26050K .......... .......... .......... .......... .......... 28% 245M 1s 2024-09-12T18:10:36.199 INFO:teuthology.orchestra.run.smithi097.stderr: 26100K .......... .......... .......... .......... .......... 28% 227M 1s 2024-09-12T18:10:36.199 INFO:teuthology.orchestra.run.smithi097.stderr: 26150K .......... .......... .......... .......... .......... 28% 208M 1s 2024-09-12T18:10:36.199 INFO:teuthology.orchestra.run.smithi097.stderr: 26200K .......... .......... .......... .......... .......... 28% 213M 1s 2024-09-12T18:10:36.199 INFO:teuthology.orchestra.run.smithi097.stderr: 26250K .......... .......... .......... .......... .......... 28% 202M 1s 2024-09-12T18:10:36.199 INFO:teuthology.orchestra.run.smithi097.stderr: 26300K .......... .......... .......... .......... .......... 28% 300M 1s 2024-09-12T18:10:36.199 INFO:teuthology.orchestra.run.smithi097.stderr: 26350K .......... .......... .......... .......... .......... 28% 262M 1s 2024-09-12T18:10:36.199 INFO:teuthology.orchestra.run.smithi097.stderr: 26400K .......... .......... .......... .......... .......... 28% 254M 1s 2024-09-12T18:10:36.199 INFO:teuthology.orchestra.run.smithi097.stderr: 26450K .......... .......... .......... .......... .......... 28% 298M 1s 2024-09-12T18:10:36.199 INFO:teuthology.orchestra.run.smithi097.stderr: 26500K .......... .......... .......... .......... .......... 28% 279M 1s 2024-09-12T18:10:36.199 INFO:teuthology.orchestra.run.smithi097.stderr: 26550K .......... .......... .......... .......... .......... 28% 304M 1s 2024-09-12T18:10:36.199 INFO:teuthology.orchestra.run.smithi097.stderr: 26600K .......... .......... .......... .......... .......... 28% 245M 1s 2024-09-12T18:10:36.200 INFO:teuthology.orchestra.run.smithi097.stderr: 26650K .......... .......... .......... .......... .......... 28% 306M 1s 2024-09-12T18:10:36.200 INFO:teuthology.orchestra.run.smithi097.stderr: 26700K .......... .......... .......... .......... .......... 28% 258M 1s 2024-09-12T18:10:36.200 INFO:teuthology.orchestra.run.smithi097.stderr: 26750K .......... .......... .......... .......... .......... 28% 280M 1s 2024-09-12T18:10:36.200 INFO:teuthology.orchestra.run.smithi097.stderr: 26800K .......... .......... .......... .......... .......... 28% 202M 1s 2024-09-12T18:10:36.200 INFO:teuthology.orchestra.run.smithi097.stderr: 26850K .......... .......... .......... .......... .......... 28% 220M 1s 2024-09-12T18:10:36.200 INFO:teuthology.orchestra.run.smithi097.stderr: 26900K .......... .......... .......... .......... .......... 29% 291M 1s 2024-09-12T18:10:36.200 INFO:teuthology.orchestra.run.smithi097.stderr: 26950K .......... .......... .......... .......... .......... 29% 204M 0s 2024-09-12T18:10:36.200 INFO:teuthology.orchestra.run.smithi097.stderr: 27000K .......... .......... .......... .......... .......... 29% 173M 0s 2024-09-12T18:10:36.200 INFO:teuthology.orchestra.run.smithi097.stderr: 27050K .......... .......... .......... .......... .......... 29% 207M 0s 2024-09-12T18:10:36.200 INFO:teuthology.orchestra.run.smithi097.stderr: 27100K .......... .......... .......... .......... .......... 29% 239M 0s 2024-09-12T18:10:36.200 INFO:teuthology.orchestra.run.smithi097.stderr: 27150K .......... .......... .......... .......... .......... 29% 306M 0s 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi097.stderr: 27200K .......... .......... .......... .......... .......... 29% 217M 0s 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi097.stderr: 27250K .......... .......... .......... .......... .......... 29% 215M 0s 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi097.stderr: 27300K .......... .......... .......... .......... .......... 29% 232M 0s 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi097.stderr: 27350K .......... .......... .......... .......... .......... 29% 183M 0s 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi097.stderr: 27400K .......... .......... .......... .......... .......... 29% 227M 0s 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi097.stderr: 27450K .......... .......... .......... .......... .......... 29% 262M 0s 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi097.stderr: 27500K .......... .......... .......... .......... .......... 29% 229M 0s 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi097.stderr: 27550K .......... .......... .......... .......... .......... 29% 222M 0s 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi097.stderr: 27600K .......... .......... .......... .......... .......... 29% 279M 0s 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi097.stderr: 27650K .......... .......... .......... .......... .......... 29% 228M 0s 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi097.stderr: 27700K .......... .......... .......... .......... .......... 29% 238M 0s 2024-09-12T18:10:36.202 INFO:teuthology.orchestra.run.smithi097.stderr: 27750K .......... .......... .......... .......... .......... 29% 229M 0s 2024-09-12T18:10:36.202 INFO:teuthology.orchestra.run.smithi097.stderr: 27800K .......... .......... .......... .......... .......... 29% 239M 0s 2024-09-12T18:10:36.202 INFO:teuthology.orchestra.run.smithi097.stderr: 27850K .......... .......... .......... .......... .......... 30% 242M 0s 2024-09-12T18:10:36.202 INFO:teuthology.orchestra.run.smithi097.stderr: 27900K .......... .......... .......... .......... .......... 30% 258M 0s 2024-09-12T18:10:36.202 INFO:teuthology.orchestra.run.smithi097.stderr: 27950K .......... .......... .......... .......... .......... 30% 216M 0s 2024-09-12T18:10:36.202 INFO:teuthology.orchestra.run.smithi097.stderr: 28000K .......... .......... .......... .......... .......... 30% 241M 0s 2024-09-12T18:10:36.202 INFO:teuthology.orchestra.run.smithi097.stderr: 28050K .......... .......... .......... .......... .......... 30% 242M 0s 2024-09-12T18:10:36.202 INFO:teuthology.orchestra.run.smithi097.stderr: 28100K .......... .......... .......... .......... .......... 30% 250M 0s 2024-09-12T18:10:36.202 INFO:teuthology.orchestra.run.smithi097.stderr: 28150K .......... .......... .......... .......... .......... 30% 302M 0s 2024-09-12T18:10:36.202 INFO:teuthology.orchestra.run.smithi097.stderr: 28200K .......... .......... .......... .......... .......... 30% 267M 0s 2024-09-12T18:10:36.202 INFO:teuthology.orchestra.run.smithi097.stderr: 28250K .......... .......... .......... .......... .......... 30% 205M 0s 2024-09-12T18:10:36.203 INFO:teuthology.orchestra.run.smithi097.stderr: 28300K .......... .......... .......... .......... .......... 30% 245M 0s 2024-09-12T18:10:36.203 INFO:teuthology.orchestra.run.smithi097.stderr: 28350K .......... .......... .......... .......... .......... 30% 205M 0s 2024-09-12T18:10:36.203 INFO:teuthology.orchestra.run.smithi097.stderr: 28400K .......... .......... .......... .......... .......... 30% 303M 0s 2024-09-12T18:10:36.203 INFO:teuthology.orchestra.run.smithi097.stderr: 28450K .......... .......... .......... .......... .......... 30% 272M 0s 2024-09-12T18:10:36.203 INFO:teuthology.orchestra.run.smithi097.stderr: 28500K .......... .......... .......... .......... .......... 30% 61.4M 0s 2024-09-12T18:10:36.203 INFO:teuthology.orchestra.run.smithi097.stderr: 28550K .......... .......... .......... .......... .......... 30% 197M 0s 2024-09-12T18:10:36.203 INFO:teuthology.orchestra.run.smithi097.stderr: 28600K .......... .......... .......... .......... .......... 30% 232M 0s 2024-09-12T18:10:36.203 INFO:teuthology.orchestra.run.smithi097.stderr: 28650K .......... .......... .......... .......... .......... 30% 210M 0s 2024-09-12T18:10:36.203 INFO:teuthology.orchestra.run.smithi097.stderr: 28700K .......... .......... .......... .......... .......... 30% 227M 0s 2024-09-12T18:10:36.203 INFO:teuthology.orchestra.run.smithi097.stderr: 28750K .......... .......... .......... .......... .......... 31% 297M 0s 2024-09-12T18:10:36.203 INFO:teuthology.orchestra.run.smithi097.stderr: 28800K .......... .......... .......... .......... .......... 31% 236M 0s 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi097.stderr: 28850K .......... .......... .......... .......... .......... 31% 204M 0s 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi097.stderr: 28900K .......... .......... .......... .......... .......... 31% 245M 0s 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi097.stderr: 28950K .......... .......... .......... .......... .......... 31% 196M 0s 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi097.stderr: 29000K .......... .......... .......... .......... .......... 31% 220M 0s 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi097.stderr: 29050K .......... .......... .......... .......... .......... 31% 107M 0s 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi097.stderr: 29100K .......... .......... .......... .......... .......... 31% 243M 0s 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi097.stderr: 29150K .......... .......... .......... .......... .......... 31% 243M 0s 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi097.stderr: 29200K .......... .......... .......... .......... .......... 31% 281M 0s 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi097.stderr: 29250K .......... .......... .......... .......... .......... 31% 250M 0s 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi097.stderr: 29300K .......... .......... .......... .......... .......... 31% 152M 0s 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi097.stderr: 29350K .......... .......... .......... .......... .......... 31% 83.6M 0s 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi097.stderr: 29400K .......... .......... .......... .......... .......... 31% 281M 0s 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi097.stderr: 29450K .......... .......... .......... .......... .......... 31% 129M 0s 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi097.stderr: 29500K .......... .......... .......... .......... .......... 31% 275M 0s 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi097.stderr: 29550K .......... .......... .......... .......... .......... 31% 51.9M 0s 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi097.stderr: 29600K .......... .......... .......... .......... .......... 31% 205M 0s 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi097.stderr: 29650K .......... .......... .......... .......... .......... 31% 283M 0s 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi097.stderr: 29700K .......... .......... .......... .......... .......... 32% 231M 0s 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi097.stderr: 29750K .......... .......... .......... .......... .......... 32% 303M 0s 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi097.stderr: 29800K .......... .......... .......... .......... .......... 32% 162M 0s 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi097.stderr: 29850K .......... .......... .......... .......... .......... 32% 225M 0s 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi097.stderr: 29900K .......... .......... .......... .......... .......... 32% 265M 0s 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi097.stderr: 29950K .......... .......... .......... .......... .......... 32% 243M 0s 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi097.stderr: 30000K .......... .......... .......... .......... .......... 32% 240M 0s 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi097.stderr: 30050K .......... .......... .......... .......... .......... 32% 307M 0s 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi097.stderr: 30100K .......... .......... .......... .......... .......... 32% 286M 0s 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi097.stderr: 30150K .......... .......... .......... .......... .......... 32% 203M 0s 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi097.stderr: 30200K .......... .......... .......... .......... .......... 32% 251M 0s 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi097.stderr: 30250K .......... .......... .......... .......... .......... 32% 225M 0s 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi097.stderr: 30300K .......... .......... .......... .......... .......... 32% 215M 0s 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi097.stderr: 30350K .......... .......... .......... .......... .......... 32% 255M 0s 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi097.stderr: 30400K .......... .......... .......... .......... .......... 32% 260M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 30450K .......... .......... .......... .......... .......... 32% 233M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 30500K .......... .......... .......... .......... .......... 32% 238M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 30550K .......... .......... .......... .......... .......... 32% 235M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 30600K .......... .......... .......... .......... .......... 32% 316M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 30650K .......... .......... .......... .......... .......... 33% 222M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 30700K .......... .......... .......... .......... .......... 33% 247M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 30750K .......... .......... .......... .......... .......... 33% 298M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 30800K .......... .......... .......... .......... .......... 33% 250M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 30850K .......... .......... .......... .......... .......... 33% 181M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 30900K .......... .......... .......... .......... .......... 33% 248M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 30950K .......... .......... .......... .......... .......... 33% 112M 0s 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi097.stderr: 31000K .......... .......... .......... .......... .......... 33% 258M 0s 2024-09-12T18:10:36.208 INFO:teuthology.orchestra.run.smithi097.stderr: 31050K .......... .......... .......... .......... .......... 33% 288M 0s 2024-09-12T18:10:36.208 INFO:teuthology.orchestra.run.smithi097.stderr: 31100K .......... .......... .......... .......... .......... 33% 313M 0s 2024-09-12T18:10:36.208 INFO:teuthology.orchestra.run.smithi097.stderr: 31150K .......... .......... .......... .......... .......... 33% 120M 0s 2024-09-12T18:10:36.208 INFO:teuthology.orchestra.run.smithi097.stderr: 31200K .......... .......... .......... .......... .......... 33% 182M 0s 2024-09-12T18:10:36.208 INFO:teuthology.orchestra.run.smithi097.stderr: 31250K .......... .......... .......... .......... .......... 33% 277M 0s 2024-09-12T18:10:36.208 INFO:teuthology.orchestra.run.smithi097.stderr: 31300K .......... .......... .......... .......... .......... 33% 322M 0s 2024-09-12T18:10:36.208 INFO:teuthology.orchestra.run.smithi097.stderr: 31350K .......... .......... .......... .......... .......... 33% 337M 0s 2024-09-12T18:10:36.208 INFO:teuthology.orchestra.run.smithi097.stderr: 31400K .......... .......... .......... .......... .......... 33% 83.4M 0s 2024-09-12T18:10:36.208 INFO:teuthology.orchestra.run.smithi097.stderr: 31450K .......... .......... .......... .......... .......... 33% 293M 0s 2024-09-12T18:10:36.208 INFO:teuthology.orchestra.run.smithi097.stderr: 31500K .......... .......... .......... .......... .......... 33% 329M 0s 2024-09-12T18:10:36.209 INFO:teuthology.orchestra.run.smithi097.stderr: 31550K .......... .......... .......... .......... .......... 34% 305M 0s 2024-09-12T18:10:36.209 INFO:teuthology.orchestra.run.smithi097.stderr: 31600K .......... .......... .......... .......... .......... 34% 115M 0s 2024-09-12T18:10:36.209 INFO:teuthology.orchestra.run.smithi097.stderr: 31650K .......... .......... .......... .......... .......... 34% 153M 0s 2024-09-12T18:10:36.209 INFO:teuthology.orchestra.run.smithi097.stderr: 31700K .......... .......... .......... .......... .......... 34% 100M 0s 2024-09-12T18:10:36.209 INFO:teuthology.orchestra.run.smithi097.stderr: 31750K .......... .......... .......... .......... .......... 34% 295M 0s 2024-09-12T18:10:36.209 INFO:teuthology.orchestra.run.smithi097.stderr: 31800K .......... .......... .......... .......... .......... 34% 190M 0s 2024-09-12T18:10:36.209 INFO:teuthology.orchestra.run.smithi097.stderr: 31850K .......... .......... .......... .......... .......... 34% 204M 0s 2024-09-12T18:10:36.209 INFO:teuthology.orchestra.run.smithi097.stderr: 31900K .......... .......... .......... .......... .......... 34% 274M 0s 2024-09-12T18:10:36.209 INFO:teuthology.orchestra.run.smithi097.stderr: 31950K .......... .......... .......... .......... .......... 34% 246M 0s 2024-09-12T18:10:36.209 INFO:teuthology.orchestra.run.smithi097.stderr: 32000K .......... .......... .......... .......... .......... 34% 235M 0s 2024-09-12T18:10:36.210 INFO:teuthology.orchestra.run.smithi097.stderr: 32050K .......... .......... .......... .......... .......... 34% 113M 0s 2024-09-12T18:10:36.210 INFO:teuthology.orchestra.run.smithi097.stderr: 32100K .......... .......... .......... .......... .......... 34% 170M 0s 2024-09-12T18:10:36.210 INFO:teuthology.orchestra.run.smithi097.stderr: 32150K .......... .......... .......... .......... .......... 34% 117M 0s 2024-09-12T18:10:36.210 INFO:teuthology.orchestra.run.smithi097.stderr: 32200K .......... .......... .......... .......... .......... 34% 199M 0s 2024-09-12T18:10:36.210 INFO:teuthology.orchestra.run.smithi097.stderr: 32250K .......... .......... .......... .......... .......... 34% 231M 0s 2024-09-12T18:10:36.210 INFO:teuthology.orchestra.run.smithi097.stderr: 32300K .......... .......... .......... .......... .......... 34% 218M 0s 2024-09-12T18:10:36.210 INFO:teuthology.orchestra.run.smithi097.stderr: 32350K .......... .......... .......... .......... .......... 34% 183M 0s 2024-09-12T18:10:36.210 INFO:teuthology.orchestra.run.smithi097.stderr: 32400K .......... .......... .......... .......... .......... 34% 115M 0s 2024-09-12T18:10:36.210 INFO:teuthology.orchestra.run.smithi097.stderr: 32450K .......... .......... .......... .......... .......... 34% 164M 0s 2024-09-12T18:10:36.210 INFO:teuthology.orchestra.run.smithi097.stderr: 32500K .......... .......... .......... .......... .......... 35% 91.9M 0s 2024-09-12T18:10:36.210 INFO:teuthology.orchestra.run.smithi097.stderr: 32550K .......... .......... .......... .......... .......... 35% 223M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 32600K .......... .......... .......... .......... .......... 35% 225M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 32650K .......... .......... .......... .......... .......... 35% 265M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 32700K .......... .......... .......... .......... .......... 35% 257M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 32750K .......... .......... .......... .......... .......... 35% 256M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 32800K .......... .......... .......... .......... .......... 35% 154M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 32850K .......... .......... .......... .......... .......... 35% 184M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 32900K .......... .......... .......... .......... .......... 35% 249M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 32950K .......... .......... .......... .......... .......... 35% 243M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 33000K .......... .......... .......... .......... .......... 35% 300M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 33050K .......... .......... .......... .......... .......... 35% 208M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 33100K .......... .......... .......... .......... .......... 35% 204M 0s 2024-09-12T18:10:36.211 INFO:teuthology.orchestra.run.smithi097.stderr: 33150K .......... .......... .......... .......... .......... 35% 294M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33200K .......... .......... .......... .......... .......... 35% 226M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33250K .......... .......... .......... .......... .......... 35% 251M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33300K .......... .......... .......... .......... .......... 35% 170M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33350K .......... .......... .......... .......... .......... 35% 277M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33400K .......... .......... .......... .......... .......... 36% 226M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33450K .......... .......... .......... .......... .......... 36% 249M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33500K .......... .......... .......... .......... .......... 36% 125M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33550K .......... .......... .......... .......... .......... 36% 139M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33600K .......... .......... .......... .......... .......... 36% 240M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33650K .......... .......... .......... .......... .......... 36% 270M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33700K .......... .......... .......... .......... .......... 36% 92.6M 0s 2024-09-12T18:10:36.212 INFO:teuthology.orchestra.run.smithi097.stderr: 33750K .......... .......... .......... .......... .......... 36% 239M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 33800K .......... .......... .......... .......... .......... 36% 214M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 33850K .......... .......... .......... .......... .......... 36% 295M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 33900K .......... .......... .......... .......... .......... 36% 274M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 33950K .......... .......... .......... .......... .......... 36% 283M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 34000K .......... .......... .......... .......... .......... 36% 213M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 34050K .......... .......... .......... .......... .......... 36% 271M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 34100K .......... .......... .......... .......... .......... 36% 246M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 34150K .......... .......... .......... .......... .......... 36% 264M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 34200K .......... .......... .......... .......... .......... 36% 253M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 34250K .......... .......... .......... .......... .......... 36% 106M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 34300K .......... .......... .......... .......... .......... 36% 237M 0s 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi097.stderr: 34350K .......... .......... .......... .......... .......... 37% 206M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34400K .......... .......... .......... .......... .......... 37% 258M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34450K .......... .......... .......... .......... .......... 37% 246M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34500K .......... .......... .......... .......... .......... 37% 285M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34550K .......... .......... .......... .......... .......... 37% 276M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34600K .......... .......... .......... .......... .......... 37% 299M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34650K .......... .......... .......... .......... .......... 37% 266M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34700K .......... .......... .......... .......... .......... 37% 132M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34750K .......... .......... .......... .......... .......... 37% 185M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34800K .......... .......... .......... .......... .......... 37% 260M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34850K .......... .......... .......... .......... .......... 37% 270M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34900K .......... .......... .......... .......... .......... 37% 236M 0s 2024-09-12T18:10:36.214 INFO:teuthology.orchestra.run.smithi097.stderr: 34950K .......... .......... .......... .......... .......... 37% 242M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35000K .......... .......... .......... .......... .......... 37% 197M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35050K .......... .......... .......... .......... .......... 37% 251M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35100K .......... .......... .......... .......... .......... 37% 287M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35150K .......... .......... .......... .......... .......... 37% 224M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35200K .......... .......... .......... .......... .......... 37% 232M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35250K .......... .......... .......... .......... .......... 37% 297M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35300K .......... .......... .......... .......... .......... 38% 238M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35350K .......... .......... .......... .......... .......... 38% 248M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35400K .......... .......... .......... .......... .......... 38% 272M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35450K .......... .......... .......... .......... .......... 38% 291M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35500K .......... .......... .......... .......... .......... 38% 301M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35550K .......... .......... .......... .......... .......... 38% 246M 0s 2024-09-12T18:10:36.215 INFO:teuthology.orchestra.run.smithi097.stderr: 35600K .......... .......... .......... .......... .......... 38% 120M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 35650K .......... .......... .......... .......... .......... 38% 232M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 35700K .......... .......... .......... .......... .......... 38% 283M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 35750K .......... .......... .......... .......... .......... 38% 137M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 35800K .......... .......... .......... .......... .......... 38% 228M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 35850K .......... .......... .......... .......... .......... 38% 298M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 35900K .......... .......... .......... .......... .......... 38% 282M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 35950K .......... .......... .......... .......... .......... 38% 319M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 36000K .......... .......... .......... .......... .......... 38% 249M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 36050K .......... .......... .......... .......... .......... 38% 295M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 36100K .......... .......... .......... .......... .......... 38% 289M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 36150K .......... .......... .......... .......... .......... 38% 300M 0s 2024-09-12T18:10:36.216 INFO:teuthology.orchestra.run.smithi097.stderr: 36200K .......... .......... .......... .......... .......... 39% 157M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36250K .......... .......... .......... .......... .......... 39% 111M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36300K .......... .......... .......... .......... .......... 39% 174M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36350K .......... .......... .......... .......... .......... 39% 214M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36400K .......... .......... .......... .......... .......... 39% 313M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36450K .......... .......... .......... .......... .......... 39% 279M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36500K .......... .......... .......... .......... .......... 39% 255M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36550K .......... .......... .......... .......... .......... 39% 110M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36600K .......... .......... .......... .......... .......... 39% 284M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36650K .......... .......... .......... .......... .......... 39% 137M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36700K .......... .......... .......... .......... .......... 39% 167M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36750K .......... .......... .......... .......... .......... 39% 186M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36800K .......... .......... .......... .......... .......... 39% 145M 0s 2024-09-12T18:10:36.217 INFO:teuthology.orchestra.run.smithi097.stderr: 36850K .......... .......... .......... .......... .......... 39% 259M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 36900K .......... .......... .......... .......... .......... 39% 170M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 36950K .......... .......... .......... .......... .......... 39% 202M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 37000K .......... .......... .......... .......... .......... 39% 223M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 37050K .......... .......... .......... .......... .......... 39% 258M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 37100K .......... .......... .......... .......... .......... 39% 273M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 37150K .......... .......... .......... .......... .......... 40% 310M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 37200K .......... .......... .......... .......... .......... 40% 218M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 37250K .......... .......... .......... .......... .......... 40% 107M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 37300K .......... .......... .......... .......... .......... 40% 297M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 37350K .......... .......... .......... .......... .......... 40% 248M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 37400K .......... .......... .......... .......... .......... 40% 236M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 37450K .......... .......... .......... .......... .......... 40% 259M 0s 2024-09-12T18:10:36.218 INFO:teuthology.orchestra.run.smithi097.stderr: 37500K .......... .......... .......... .......... .......... 40% 240M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 37550K .......... .......... .......... .......... .......... 40% 284M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 37600K .......... .......... .......... .......... .......... 40% 213M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 37650K .......... .......... .......... .......... .......... 40% 248M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 37700K .......... .......... .......... .......... .......... 40% 254M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 37750K .......... .......... .......... .......... .......... 40% 234M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 37800K .......... .......... .......... .......... .......... 40% 262M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 37850K .......... .......... .......... .......... .......... 40% 228M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 37900K .......... .......... .......... .......... .......... 40% 200M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 37950K .......... .......... .......... .......... .......... 40% 210M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 38000K .......... .......... .......... .......... .......... 40% 280M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 38050K .......... .......... .......... .......... .......... 41% 246M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 38100K .......... .......... .......... .......... .......... 41% 266M 0s 2024-09-12T18:10:36.219 INFO:teuthology.orchestra.run.smithi097.stderr: 38150K .......... .......... .......... .......... .......... 41% 239M 0s 2024-09-12T18:10:36.220 INFO:teuthology.orchestra.run.smithi097.stderr: 38200K .......... .......... .......... .......... .......... 41% 283M 0s 2024-09-12T18:10:36.220 INFO:teuthology.orchestra.run.smithi097.stderr: 38250K .......... .......... .......... .......... .......... 41% 265M 0s 2024-09-12T18:10:36.220 INFO:teuthology.orchestra.run.smithi097.stderr: 38300K .......... .......... .......... .......... .......... 41% 309M 0s 2024-09-12T18:10:36.220 INFO:teuthology.orchestra.run.smithi097.stderr: 38350K .......... .......... .......... .......... .......... 41% 225M 0s 2024-09-12T18:10:36.220 INFO:teuthology.orchestra.run.smithi097.stderr: 38400K .......... .......... .......... .......... .......... 41% 359M 0s 2024-09-12T18:10:36.220 INFO:teuthology.orchestra.run.smithi097.stderr: 38450K .......... .......... .......... .......... .......... 41% 245M 0s 2024-09-12T18:10:36.220 INFO:teuthology.orchestra.run.smithi097.stderr: 38500K .......... .......... .......... .......... .......... 41% 262M 0s 2024-09-12T18:10:36.220 INFO:teuthology.orchestra.run.smithi097.stderr: 38550K .......... .......... .......... .......... .......... 41% 318M 0s 2024-09-12T18:10:36.220 INFO:teuthology.orchestra.run.smithi097.stderr: 38600K .......... .......... .......... .......... .......... 41% 329M 0s 2024-09-12T18:10:36.220 INFO:teuthology.orchestra.run.smithi097.stderr: 38650K .......... .......... .......... .......... .......... 41% 280M 0s 2024-09-12T18:10:36.220 INFO:teuthology.orchestra.run.smithi097.stderr: 38700K .......... .......... .......... .......... .......... 41% 207M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 38750K .......... .......... .......... .......... .......... 41% 250M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 38800K .......... .......... .......... .......... .......... 41% 290M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 38850K .......... .......... .......... .......... .......... 41% 331M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 38900K .......... .......... .......... .......... .......... 41% 257M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 38950K .......... .......... .......... .......... .......... 41% 340M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 39000K .......... .......... .......... .......... .......... 42% 310M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 39050K .......... .......... .......... .......... .......... 42% 258M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 39100K .......... .......... .......... .......... .......... 42% 191M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 39150K .......... .......... .......... .......... .......... 42% 228M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 39200K .......... .......... .......... .......... .......... 42% 221M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 39250K .......... .......... .......... .......... .......... 42% 207M 0s 2024-09-12T18:10:36.221 INFO:teuthology.orchestra.run.smithi097.stderr: 39300K .......... .......... .......... .......... .......... 42% 239M 0s 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi097.stderr: 39350K .......... .......... .......... .......... .......... 42% 331M 0s 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi097.stderr: 39400K .......... .......... .......... .......... .......... 42% 187M 0s 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi097.stderr: 39450K .......... .......... .......... .......... .......... 42% 334M 0s 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi097.stderr: 39500K .......... .......... .......... .......... .......... 42% 347M 0s 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi097.stderr: 39550K .......... .......... .......... .......... .......... 42% 313M 0s 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi097.stderr: 39600K .......... .......... .......... .......... .......... 42% 262M 0s 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi097.stderr: 39650K .......... .......... .......... .......... .......... 42% 347M 0s 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi097.stderr: 39700K .......... .......... .......... .......... .......... 42% 136M 0s 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi097.stderr: 39750K .......... .......... .......... .......... .......... 42% 213M 0s 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi097.stderr: 39800K .......... .......... .......... .......... .......... 42% 134M 0s 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi097.stderr: 39850K .......... .......... .......... .......... .......... 42% 89.2M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 39900K .......... .......... .......... .......... .......... 43% 252M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 39950K .......... .......... .......... .......... .......... 43% 195M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 40000K .......... .......... .......... .......... .......... 43% 76.4M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 40050K .......... .......... .......... .......... .......... 43% 188M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 40100K .......... .......... .......... .......... .......... 43% 283M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 40150K .......... .......... .......... .......... .......... 43% 327M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 40200K .......... .......... .......... .......... .......... 43% 272M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 40250K .......... .......... .......... .......... .......... 43% 239M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 40300K .......... .......... .......... .......... .......... 43% 277M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 40350K .......... .......... .......... .......... .......... 43% 244M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 40400K .......... .......... .......... .......... .......... 43% 327M 0s 2024-09-12T18:10:36.223 INFO:teuthology.orchestra.run.smithi097.stderr: 40450K .......... .......... .......... .......... .......... 43% 241M 0s 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi097.stderr: 40500K .......... .......... .......... .......... .......... 43% 293M 0s 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi097.stderr: 40550K .......... .......... .......... .......... .......... 43% 336M 0s 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi097.stderr: 40600K .......... .......... .......... .......... .......... 43% 296M 0s 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi097.stderr: 40650K .......... .......... .......... .......... .......... 43% 262M 0s 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi097.stderr: 40700K .......... .......... .......... .......... .......... 43% 244M 0s 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi097.stderr: 40750K .......... .......... .......... .......... .......... 43% 283M 0s 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi097.stderr: 40800K .......... .......... .......... .......... .......... 43% 286M 0s 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi097.stderr: 40850K .......... .......... .......... .......... .......... 44% 265M 0s 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi097.stderr: 40900K .......... .......... .......... .......... .......... 44% 259M 0s 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi097.stderr: 40950K .......... .......... .......... .......... .......... 44% 331M 0s 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi097.stderr: 41000K .......... .......... .......... .......... .......... 44% 320M 0s 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi097.stderr: 41050K .......... .......... .......... .......... .......... 44% 241M 0s 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi097.stderr: 41100K .......... .......... .......... .......... .......... 44% 310M 0s 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi097.stderr: 41150K .......... .......... .......... .......... .......... 44% 276M 0s 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi097.stderr: 41200K .......... .......... .......... .......... .......... 44% 259M 0s 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi097.stderr: 41250K .......... .......... .......... .......... .......... 44% 322M 0s 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi097.stderr: 41300K .......... .......... .......... .......... .......... 44% 339M 0s 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi097.stderr: 41350K .......... .......... .......... .......... .......... 44% 349M 0s 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi097.stderr: 41400K .......... .......... .......... .......... .......... 44% 297M 0s 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi097.stderr: 41450K .......... .......... .......... .......... .......... 44% 386M 0s 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi097.stderr: 41500K .......... .......... .......... .......... .......... 44% 336M 0s 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi097.stderr: 41550K .......... .......... .......... .......... .......... 44% 284M 0s 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi097.stderr: 41600K .......... .......... .......... .......... .......... 44% 257M 0s 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi097.stderr: 41650K .......... .......... .......... .......... .......... 44% 280M 0s 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi097.stderr: 41700K .......... .......... .......... .......... .......... 44% 200M 0s 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi097.stderr: 41750K .......... .......... .......... .......... .......... 44% 258M 0s 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi097.stderr: 41800K .......... .......... .......... .......... .......... 45% 294M 0s 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi097.stderr: 41850K .......... .......... .......... .......... .......... 45% 322M 0s 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi097.stderr: 41900K .......... .......... .......... .......... .......... 45% 302M 0s 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi097.stderr: 41950K .......... .......... .......... .......... .......... 45% 229M 0s 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi097.stderr: 42000K .......... .......... .......... .......... .......... 45% 271M 0s 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi097.stderr: 42050K .......... .......... .......... .......... .......... 45% 303M 0s 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi097.stderr: 42100K .......... .......... .......... .......... .......... 45% 325M 0s 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi097.stderr: 42150K .......... .......... .......... .......... .......... 45% 275M 0s 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi097.stderr: 42200K .......... .......... .......... .......... .......... 45% 211M 0s 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi097.stderr: 42250K .......... .......... .......... .......... .......... 45% 319M 0s 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi097.stderr: 42300K .......... .......... .......... .......... .......... 45% 289M 0s 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi097.stderr: 42350K .......... .......... .......... .......... .......... 45% 212M 0s 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi097.stderr: 42400K .......... .......... .......... .......... .......... 45% 261M 0s 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi097.stderr: 42450K .......... .......... .......... .......... .......... 45% 329M 0s 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi097.stderr: 42500K .......... .......... .......... .......... .......... 45% 301M 0s 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi097.stderr: 42550K .......... .......... .......... .......... .......... 45% 306M 0s 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi097.stderr: 42600K .......... .......... .......... .......... .......... 45% 301M 0s 2024-09-12T18:10:36.228 INFO:teuthology.orchestra.run.smithi097.stderr: 42650K .......... .......... .......... .......... .......... 45% 344M 0s 2024-09-12T18:10:36.228 INFO:teuthology.orchestra.run.smithi097.stderr: 42700K .......... .......... .......... .......... .......... 46% 328M 0s 2024-09-12T18:10:36.228 INFO:teuthology.orchestra.run.smithi097.stderr: 42750K .......... .......... .......... .......... .......... 46% 198M 0s 2024-09-12T18:10:36.228 INFO:teuthology.orchestra.run.smithi097.stderr: 42800K .......... .......... .......... .......... .......... 46% 114M 0s 2024-09-12T18:10:36.228 INFO:teuthology.orchestra.run.smithi097.stderr: 42850K .......... .......... .......... .......... .......... 46% 85.7M 0s 2024-09-12T18:10:36.228 INFO:teuthology.orchestra.run.smithi097.stderr: 42900K .......... .......... .......... .......... .......... 46% 328M 0s 2024-09-12T18:10:36.228 INFO:teuthology.orchestra.run.smithi097.stderr: 42950K .......... .......... .......... .......... .......... 46% 208M 0s 2024-09-12T18:10:36.228 INFO:teuthology.orchestra.run.smithi097.stderr: 43000K .......... .......... .......... .......... .......... 46% 72.9M 0s 2024-09-12T18:10:36.228 INFO:teuthology.orchestra.run.smithi097.stderr: 43050K .......... .......... .......... .......... .......... 46% 132M 0s 2024-09-12T18:10:36.228 INFO:teuthology.orchestra.run.smithi097.stderr: 43100K .......... .......... .......... .......... .......... 46% 229M 0s 2024-09-12T18:10:36.229 INFO:teuthology.orchestra.run.smithi097.stderr: 43150K .......... .......... .......... .......... .......... 46% 278M 0s 2024-09-12T18:10:36.229 INFO:teuthology.orchestra.run.smithi097.stderr: 43200K .......... .......... .......... .......... .......... 46% 307M 0s 2024-09-12T18:10:36.229 INFO:teuthology.orchestra.run.smithi097.stderr: 43250K .......... .......... .......... .......... .......... 46% 214M 0s 2024-09-12T18:10:36.229 INFO:teuthology.orchestra.run.smithi097.stderr: 43300K .......... .......... .......... .......... .......... 46% 190M 0s 2024-09-12T18:10:36.229 INFO:teuthology.orchestra.run.smithi097.stderr: 43350K .......... .......... .......... .......... .......... 46% 219M 0s 2024-09-12T18:10:36.229 INFO:teuthology.orchestra.run.smithi097.stderr: 43400K .......... .......... .......... .......... .......... 46% 244M 0s 2024-09-12T18:10:36.229 INFO:teuthology.orchestra.run.smithi097.stderr: 43450K .......... .......... .......... .......... .......... 46% 304M 0s 2024-09-12T18:10:36.229 INFO:teuthology.orchestra.run.smithi097.stderr: 43500K .......... .......... .......... .......... .......... 46% 262M 0s 2024-09-12T18:10:36.229 INFO:teuthology.orchestra.run.smithi097.stderr: 43550K .......... .......... .......... .......... .......... 46% 59.9M 0s 2024-09-12T18:10:36.229 INFO:teuthology.orchestra.run.smithi097.stderr: 43600K .......... .......... .......... .......... .......... 46% 290M 0s 2024-09-12T18:10:36.229 INFO:teuthology.orchestra.run.smithi097.stderr: 43650K .......... .......... .......... .......... .......... 47% 275M 0s 2024-09-12T18:10:36.230 INFO:teuthology.orchestra.run.smithi097.stderr: 43700K .......... .......... .......... .......... .......... 47% 202M 0s 2024-09-12T18:10:36.230 INFO:teuthology.orchestra.run.smithi097.stderr: 43750K .......... .......... .......... .......... .......... 47% 300M 0s 2024-09-12T18:10:36.230 INFO:teuthology.orchestra.run.smithi097.stderr: 43800K .......... .......... .......... .......... .......... 47% 207M 0s 2024-09-12T18:10:36.230 INFO:teuthology.orchestra.run.smithi097.stderr: 43850K .......... .......... .......... .......... .......... 47% 302M 0s 2024-09-12T18:10:36.230 INFO:teuthology.orchestra.run.smithi097.stderr: 43900K .......... .......... .......... .......... .......... 47% 283M 0s 2024-09-12T18:10:36.232 INFO:teuthology.orchestra.run.smithi097.stderr: 43950K .......... .......... .......... .......... .......... 47% 327M 0s 2024-09-12T18:10:36.232 INFO:teuthology.orchestra.run.smithi097.stderr: 44000K .......... .......... .......... .......... .......... 47% 290M 0s 2024-09-12T18:10:36.232 INFO:teuthology.orchestra.run.smithi097.stderr: 44050K .......... .......... .......... .......... .......... 47% 331M 0s 2024-09-12T18:10:36.232 INFO:teuthology.orchestra.run.smithi097.stderr: 44100K .......... .......... .......... .......... .......... 47% 361M 0s 2024-09-12T18:10:36.232 INFO:teuthology.orchestra.run.smithi097.stderr: 44150K .......... .......... .......... .......... .......... 47% 300M 0s 2024-09-12T18:10:36.232 INFO:teuthology.orchestra.run.smithi097.stderr: 44200K .......... .......... .......... .......... .......... 47% 273M 0s 2024-09-12T18:10:36.232 INFO:teuthology.orchestra.run.smithi097.stderr: 44250K .......... .......... .......... .......... .......... 47% 385M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44300K .......... .......... .......... .......... .......... 47% 318M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44350K .......... .......... .......... .......... .......... 47% 329M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44400K .......... .......... .......... .......... .......... 47% 330M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44450K .......... .......... .......... .......... .......... 47% 356M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44500K .......... .......... .......... .......... .......... 47% 107M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44550K .......... .......... .......... .......... .......... 48% 243M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44600K .......... .......... .......... .......... .......... 48% 170M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44650K .......... .......... .......... .......... .......... 48% 211M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44700K .......... .......... .......... .......... .......... 48% 114M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44750K .......... .......... .......... .......... .......... 48% 311M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44800K .......... .......... .......... .......... .......... 48% 301M 0s 2024-09-12T18:10:36.233 INFO:teuthology.orchestra.run.smithi097.stderr: 44850K .......... .......... .......... .......... .......... 48% 285M 0s 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi097.stderr: 44900K .......... .......... .......... .......... .......... 48% 329M 0s 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi097.stderr: 44950K .......... .......... .......... .......... .......... 48% 260M 0s 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi097.stderr: 45000K .......... .......... .......... .......... .......... 48% 315M 0s 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi097.stderr: 45050K .......... .......... .......... .......... .......... 48% 313M 0s 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi097.stderr: 45100K .......... .......... .......... .......... .......... 48% 236M 0s 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi097.stderr: 45150K .......... .......... .......... .......... .......... 48% 204M 0s 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi097.stderr: 45200K .......... .......... .......... .......... .......... 48% 344M 0s 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi097.stderr: 45250K .......... .......... .......... .......... .......... 48% 282M 0s 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi097.stderr: 45300K .......... .......... .......... .......... .......... 48% 306M 0s 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi097.stderr: 45350K .......... .......... .......... .......... .......... 48% 292M 0s 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi097.stderr: 45400K .......... .......... .......... .......... .......... 48% 287M 0s 2024-09-12T18:10:36.235 INFO:teuthology.orchestra.run.smithi097.stderr: 45450K .......... .......... .......... .......... .......... 48% 287M 0s 2024-09-12T18:10:36.235 INFO:teuthology.orchestra.run.smithi097.stderr: 45500K .......... .......... .......... .......... .......... 49% 299M 0s 2024-09-12T18:10:36.235 INFO:teuthology.orchestra.run.smithi097.stderr: 45550K .......... .......... .......... .......... .......... 49% 309M 0s 2024-09-12T18:10:36.235 INFO:teuthology.orchestra.run.smithi097.stderr: 45600K .......... .......... .......... .......... .......... 49% 311M 0s 2024-09-12T18:10:36.235 INFO:teuthology.orchestra.run.smithi097.stderr: 45650K .......... .......... .......... .......... .......... 49% 269M 0s 2024-09-12T18:10:36.235 INFO:teuthology.orchestra.run.smithi097.stderr: 45700K .......... .......... .......... .......... .......... 49% 307M 0s 2024-09-12T18:10:36.235 INFO:teuthology.orchestra.run.smithi097.stderr: 45750K .......... .......... .......... .......... .......... 49% 283M 0s 2024-09-12T18:10:36.235 INFO:teuthology.orchestra.run.smithi097.stderr: 45800K .......... .......... .......... .......... .......... 49% 295M 0s 2024-09-12T18:10:36.235 INFO:teuthology.orchestra.run.smithi097.stderr: 45850K .......... .......... .......... .......... .......... 49% 352M 0s 2024-09-12T18:10:36.235 INFO:teuthology.orchestra.run.smithi097.stderr: 45900K .......... .......... .......... .......... .......... 49% 329M 0s 2024-09-12T18:10:36.236 INFO:teuthology.orchestra.run.smithi097.stderr: 45950K .......... .......... .......... .......... .......... 49% 262M 0s 2024-09-12T18:10:36.236 INFO:teuthology.orchestra.run.smithi097.stderr: 46000K .......... .......... .......... .......... .......... 49% 373M 0s 2024-09-12T18:10:36.236 INFO:teuthology.orchestra.run.smithi097.stderr: 46050K .......... .......... .......... .......... .......... 49% 125M 0s 2024-09-12T18:10:36.236 INFO:teuthology.orchestra.run.smithi097.stderr: 46100K .......... .......... .......... .......... .......... 49% 288M 0s 2024-09-12T18:10:36.236 INFO:teuthology.orchestra.run.smithi097.stderr: 46150K .......... .......... .......... .......... .......... 49% 172M 0s 2024-09-12T18:10:36.236 INFO:teuthology.orchestra.run.smithi097.stderr: 46200K .......... .......... .......... .......... .......... 49% 293M 0s 2024-09-12T18:10:36.236 INFO:teuthology.orchestra.run.smithi097.stderr: 46250K .......... .......... .......... .......... .......... 49% 268M 0s 2024-09-12T18:10:36.236 INFO:teuthology.orchestra.run.smithi097.stderr: 46300K .......... .......... .......... .......... .......... 49% 148M 0s 2024-09-12T18:10:36.236 INFO:teuthology.orchestra.run.smithi097.stderr: 46350K .......... .......... .......... .......... .......... 49% 126M 0s 2024-09-12T18:10:36.236 INFO:teuthology.orchestra.run.smithi097.stderr: 46400K .......... .......... .......... .......... .......... 49% 88.3M 0s 2024-09-12T18:10:36.236 INFO:teuthology.orchestra.run.smithi097.stderr: 46450K .......... .......... .......... .......... .......... 50% 308M 0s 2024-09-12T18:10:36.237 INFO:teuthology.orchestra.run.smithi097.stderr: 46500K .......... .......... .......... .......... .......... 50% 183M 0s 2024-09-12T18:10:36.237 INFO:teuthology.orchestra.run.smithi097.stderr: 46550K .......... .......... .......... .......... .......... 50% 59.2M 0s 2024-09-12T18:10:36.237 INFO:teuthology.orchestra.run.smithi097.stderr: 46600K .......... .......... .......... .......... .......... 50% 257M 0s 2024-09-12T18:10:36.237 INFO:teuthology.orchestra.run.smithi097.stderr: 46650K .......... .......... .......... .......... .......... 50% 273M 0s 2024-09-12T18:10:36.237 INFO:teuthology.orchestra.run.smithi097.stderr: 46700K .......... .......... .......... .......... .......... 50% 260M 0s 2024-09-12T18:10:36.237 INFO:teuthology.orchestra.run.smithi097.stderr: 46750K .......... .......... .......... .......... .......... 50% 279M 0s 2024-09-12T18:10:36.237 INFO:teuthology.orchestra.run.smithi097.stderr: 46800K .......... .......... .......... .......... .......... 50% 263M 0s 2024-09-12T18:10:36.237 INFO:teuthology.orchestra.run.smithi097.stderr: 46850K .......... .......... .......... .......... .......... 50% 314M 0s 2024-09-12T18:10:36.237 INFO:teuthology.orchestra.run.smithi097.stderr: 46900K .......... .......... .......... .......... .......... 50% 236M 0s 2024-09-12T18:10:36.237 INFO:teuthology.orchestra.run.smithi097.stderr: 46950K .......... .......... .......... .......... .......... 50% 275M 0s 2024-09-12T18:10:36.237 INFO:teuthology.orchestra.run.smithi097.stderr: 47000K .......... .......... .......... .......... .......... 50% 319M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47050K .......... .......... .......... .......... .......... 50% 325M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47100K .......... .......... .......... .......... .......... 50% 272M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47150K .......... .......... .......... .......... .......... 50% 299M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47200K .......... .......... .......... .......... .......... 50% 371M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47250K .......... .......... .......... .......... .......... 50% 66.4M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47300K .......... .......... .......... .......... .......... 50% 219M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47350K .......... .......... .......... .......... .......... 51% 151M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47400K .......... .......... .......... .......... .......... 51% 271M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47450K .......... .......... .......... .......... .......... 51% 113M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47500K .......... .......... .......... .......... .......... 51% 254M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47550K .......... .......... .......... .......... .......... 51% 76.4M 0s 2024-09-12T18:10:36.238 INFO:teuthology.orchestra.run.smithi097.stderr: 47600K .......... .......... .......... .......... .......... 51% 88.4M 0s 2024-09-12T18:10:36.239 INFO:teuthology.orchestra.run.smithi097.stderr: 47650K .......... .......... .......... .......... .......... 51% 259M 0s 2024-09-12T18:10:36.239 INFO:teuthology.orchestra.run.smithi097.stderr: 47700K .......... .......... .......... .......... .......... 51% 169M 0s 2024-09-12T18:10:36.239 INFO:teuthology.orchestra.run.smithi097.stderr: 47750K .......... .......... .......... .......... .......... 51% 120M 0s 2024-09-12T18:10:36.239 INFO:teuthology.orchestra.run.smithi097.stderr: 47800K .......... .......... .......... .......... .......... 51% 193M 0s 2024-09-12T18:10:36.239 INFO:teuthology.orchestra.run.smithi097.stderr: 47850K .......... .......... .......... .......... .......... 51% 307M 0s 2024-09-12T18:10:36.239 INFO:teuthology.orchestra.run.smithi097.stderr: 47900K .......... .......... .......... .......... .......... 51% 353M 0s 2024-09-12T18:10:36.239 INFO:teuthology.orchestra.run.smithi097.stderr: 47950K .......... .......... .......... .......... .......... 51% 164M 0s 2024-09-12T18:10:36.239 INFO:teuthology.orchestra.run.smithi097.stderr: 48000K .......... .......... .......... .......... .......... 51% 303M 0s 2024-09-12T18:10:36.239 INFO:teuthology.orchestra.run.smithi097.stderr: 48050K .......... .......... .......... .......... .......... 51% 286M 0s 2024-09-12T18:10:36.239 INFO:teuthology.orchestra.run.smithi097.stderr: 48100K .......... .......... .......... .......... .......... 51% 225M 0s 2024-09-12T18:10:36.240 INFO:teuthology.orchestra.run.smithi097.stderr: 48150K .......... .......... .......... .......... .......... 51% 324M 0s 2024-09-12T18:10:36.240 INFO:teuthology.orchestra.run.smithi097.stderr: 48200K .......... .......... .......... .......... .......... 51% 376M 0s 2024-09-12T18:10:36.240 INFO:teuthology.orchestra.run.smithi097.stderr: 48250K .......... .......... .......... .......... .......... 51% 229M 0s 2024-09-12T18:10:36.240 INFO:teuthology.orchestra.run.smithi097.stderr: 48300K .......... .......... .......... .......... .......... 52% 244M 0s 2024-09-12T18:10:36.240 INFO:teuthology.orchestra.run.smithi097.stderr: 48350K .......... .......... .......... .......... .......... 52% 324M 0s 2024-09-12T18:10:36.240 INFO:teuthology.orchestra.run.smithi097.stderr: 48400K .......... .......... .......... .......... .......... 52% 358M 0s 2024-09-12T18:10:36.240 INFO:teuthology.orchestra.run.smithi097.stderr: 48450K .......... .......... .......... .......... .......... 52% 241M 0s 2024-09-12T18:10:36.240 INFO:teuthology.orchestra.run.smithi097.stderr: 48500K .......... .......... .......... .......... .......... 52% 274M 0s 2024-09-12T18:10:36.240 INFO:teuthology.orchestra.run.smithi097.stderr: 48550K .......... .......... .......... .......... .......... 52% 294M 0s 2024-09-12T18:10:36.240 INFO:teuthology.orchestra.run.smithi097.stderr: 48600K .......... .......... .......... .......... .......... 52% 282M 0s 2024-09-12T18:10:36.240 INFO:teuthology.orchestra.run.smithi097.stderr: 48650K .......... .......... .......... .......... .......... 52% 249M 0s 2024-09-12T18:10:36.241 INFO:teuthology.orchestra.run.smithi097.stderr: 48700K .......... .......... .......... .......... .......... 52% 312M 0s 2024-09-12T18:10:36.241 INFO:teuthology.orchestra.run.smithi097.stderr: 48750K .......... .......... .......... .......... .......... 52% 288M 0s 2024-09-12T18:10:36.241 INFO:teuthology.orchestra.run.smithi097.stderr: 48800K .......... .......... .......... .......... .......... 52% 366M 0s 2024-09-12T18:10:36.241 INFO:teuthology.orchestra.run.smithi097.stderr: 48850K .......... .......... .......... .......... .......... 52% 380M 0s 2024-09-12T18:10:36.241 INFO:teuthology.orchestra.run.smithi097.stderr: 48900K .......... .......... .......... .......... .......... 52% 292M 0s 2024-09-12T18:10:36.241 INFO:teuthology.orchestra.run.smithi097.stderr: 48950K .......... .......... .......... .......... .......... 52% 295M 0s 2024-09-12T18:10:36.241 INFO:teuthology.orchestra.run.smithi097.stderr: 49000K .......... .......... .......... .......... .......... 52% 312M 0s 2024-09-12T18:10:36.241 INFO:teuthology.orchestra.run.smithi097.stderr: 49050K .......... .......... .......... .......... .......... 52% 294M 0s 2024-09-12T18:10:36.241 INFO:teuthology.orchestra.run.smithi097.stderr: 49100K .......... .......... .......... .......... .......... 52% 239M 0s 2024-09-12T18:10:36.241 INFO:teuthology.orchestra.run.smithi097.stderr: 49150K .......... .......... .......... .......... .......... 52% 305M 0s 2024-09-12T18:10:36.241 INFO:teuthology.orchestra.run.smithi097.stderr: 49200K .......... .......... .......... .......... .......... 53% 314M 0s 2024-09-12T18:10:36.242 INFO:teuthology.orchestra.run.smithi097.stderr: 49250K .......... .......... .......... .......... .......... 53% 232M 0s 2024-09-12T18:10:36.242 INFO:teuthology.orchestra.run.smithi097.stderr: 49300K .......... .......... .......... .......... .......... 53% 270M 0s 2024-09-12T18:10:36.242 INFO:teuthology.orchestra.run.smithi097.stderr: 49350K .......... .......... .......... .......... .......... 53% 285M 0s 2024-09-12T18:10:36.242 INFO:teuthology.orchestra.run.smithi097.stderr: 49400K .......... .......... .......... .......... .......... 53% 185M 0s 2024-09-12T18:10:36.242 INFO:teuthology.orchestra.run.smithi097.stderr: 49450K .......... .......... .......... .......... .......... 53% 290M 0s 2024-09-12T18:10:36.242 INFO:teuthology.orchestra.run.smithi097.stderr: 49500K .......... .......... .......... .......... .......... 53% 315M 0s 2024-09-12T18:10:36.242 INFO:teuthology.orchestra.run.smithi097.stderr: 49550K .......... .......... .......... .......... .......... 53% 237M 0s 2024-09-12T18:10:36.242 INFO:teuthology.orchestra.run.smithi097.stderr: 49600K .......... .......... .......... .......... .......... 53% 109M 0s 2024-09-12T18:10:36.242 INFO:teuthology.orchestra.run.smithi097.stderr: 49650K .......... .......... .......... .......... .......... 53% 240M 0s 2024-09-12T18:10:36.242 INFO:teuthology.orchestra.run.smithi097.stderr: 49700K .......... .......... .......... .......... .......... 53% 280M 0s 2024-09-12T18:10:36.243 INFO:teuthology.orchestra.run.smithi097.stderr: 49750K .......... .......... .......... .......... .......... 53% 272M 0s 2024-09-12T18:10:36.243 INFO:teuthology.orchestra.run.smithi097.stderr: 49800K .......... .......... .......... .......... .......... 53% 278M 0s 2024-09-12T18:10:36.243 INFO:teuthology.orchestra.run.smithi097.stderr: 49850K .......... .......... .......... .......... .......... 53% 278M 0s 2024-09-12T18:10:36.243 INFO:teuthology.orchestra.run.smithi097.stderr: 49900K .......... .......... .......... .......... .......... 53% 305M 0s 2024-09-12T18:10:36.243 INFO:teuthology.orchestra.run.smithi097.stderr: 49950K .......... .......... .......... .......... .......... 53% 377M 0s 2024-09-12T18:10:36.243 INFO:teuthology.orchestra.run.smithi097.stderr: 50000K .......... .......... .......... .......... .......... 53% 284M 0s 2024-09-12T18:10:36.243 INFO:teuthology.orchestra.run.smithi097.stderr: 50050K .......... .......... .......... .......... .......... 53% 260M 0s 2024-09-12T18:10:36.243 INFO:teuthology.orchestra.run.smithi097.stderr: 50100K .......... .......... .......... .......... .......... 53% 248M 0s 2024-09-12T18:10:36.243 INFO:teuthology.orchestra.run.smithi097.stderr: 50150K .......... .......... .......... .......... .......... 54% 320M 0s 2024-09-12T18:10:36.243 INFO:teuthology.orchestra.run.smithi097.stderr: 50200K .......... .......... .......... .......... .......... 54% 365M 0s 2024-09-12T18:10:36.243 INFO:teuthology.orchestra.run.smithi097.stderr: 50250K .......... .......... .......... .......... .......... 54% 318M 0s 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi097.stderr: 50300K .......... .......... .......... .......... .......... 54% 293M 0s 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi097.stderr: 50350K .......... .......... .......... .......... .......... 54% 310M 0s 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi097.stderr: 50400K .......... .......... .......... .......... .......... 54% 358M 0s 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi097.stderr: 50450K .......... .......... .......... .......... .......... 54% 108M 0s 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi097.stderr: 50500K .......... .......... .......... .......... .......... 54% 212M 0s 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi097.stderr: 50550K .......... .......... .......... .......... .......... 54% 50.6M 0s 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi097.stderr: 50600K .......... .......... .......... .......... .......... 54% 62.5M 0s 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi097.stderr: 50650K .......... .......... .......... .......... .......... 54% 323M 0s 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi097.stderr: 50700K .......... .......... .......... .......... .......... 54% 97.9M 0s 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi097.stderr: 50750K .......... .......... .......... .......... .......... 54% 97.8M 0s 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi097.stderr: 50800K .......... .......... .......... .......... .......... 54% 87.8M 0s 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi097.stderr: 50850K .......... .......... .......... .......... .......... 54% 294M 0s 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi097.stderr: 50900K .......... .......... .......... .......... .......... 54% 82.4M 0s 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi097.stderr: 50950K .......... .......... .......... .......... .......... 54% 265M 0s 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi097.stderr: 51000K .......... .......... .......... .......... .......... 54% 184M 0s 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi097.stderr: 51050K .......... .......... .......... .......... .......... 55% 134M 0s 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi097.stderr: 51100K .......... .......... .......... .......... .......... 55% 249M 0s 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi097.stderr: 51150K .......... .......... .......... .......... .......... 55% 273M 0s 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi097.stderr: 51200K .......... .......... .......... .......... .......... 55% 254M 0s 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi097.stderr: 51250K .......... .......... .......... .......... .......... 55% 293M 0s 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi097.stderr: 51300K .......... .......... .......... .......... .......... 55% 229M 0s 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi097.stderr: 51350K .......... .......... .......... .......... .......... 55% 286M 0s 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi097.stderr: 51400K .......... .......... .......... .......... .......... 55% 112M 0s 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi097.stderr: 51450K .......... .......... .......... .......... .......... 55% 329M 0s 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi097.stderr: 51500K .......... .......... .......... .......... .......... 55% 258M 0s 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi097.stderr: 51550K .......... .......... .......... .......... .......... 55% 335M 0s 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi097.stderr: 51600K .......... .......... .......... .......... .......... 55% 232M 0s 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi097.stderr: 51650K .......... .......... .......... .......... .......... 55% 238M 0s 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi097.stderr: 51700K .......... .......... .......... .......... .......... 55% 245M 0s 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi097.stderr: 51750K .......... .......... .......... .......... .......... 55% 303M 0s 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi097.stderr: 51800K .......... .......... .......... .......... .......... 55% 270M 0s 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi097.stderr: 51850K .......... .......... .......... .......... .......... 55% 271M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 51900K .......... .......... .......... .......... .......... 55% 236M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 51950K .......... .......... .......... .......... .......... 55% 283M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 52000K .......... .......... .......... .......... .......... 56% 288M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 52050K .......... .......... .......... .......... .......... 56% 299M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 52100K .......... .......... .......... .......... .......... 56% 270M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 52150K .......... .......... .......... .......... .......... 56% 274M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 52200K .......... .......... .......... .......... .......... 56% 226M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 52250K .......... .......... .......... .......... .......... 56% 236M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 52300K .......... .......... .......... .......... .......... 56% 268M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 52350K .......... .......... .......... .......... .......... 56% 281M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 52400K .......... .......... .......... .......... .......... 56% 265M 0s 2024-09-12T18:10:36.247 INFO:teuthology.orchestra.run.smithi097.stderr: 52450K .......... .......... .......... .......... .......... 56% 238M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 52500K .......... .......... .......... .......... .......... 56% 292M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 52550K .......... .......... .......... .......... .......... 56% 296M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 52600K .......... .......... .......... .......... .......... 56% 274M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 52650K .......... .......... .......... .......... .......... 56% 273M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 52700K .......... .......... .......... .......... .......... 56% 264M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 52750K .......... .......... .......... .......... .......... 56% 334M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 52800K .......... .......... .......... .......... .......... 56% 375M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 52850K .......... .......... .......... .......... .......... 56% 324M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 52900K .......... .......... .......... .......... .......... 56% 319M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 52950K .......... .......... .......... .......... .......... 57% 257M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 53000K .......... .......... .......... .......... .......... 57% 288M 0s 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi097.stderr: 53050K .......... .......... .......... .......... .......... 57% 297M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53100K .......... .......... .......... .......... .......... 57% 252M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53150K .......... .......... .......... .......... .......... 57% 265M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53200K .......... .......... .......... .......... .......... 57% 283M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53250K .......... .......... .......... .......... .......... 57% 319M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53300K .......... .......... .......... .......... .......... 57% 318M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53350K .......... .......... .......... .......... .......... 57% 288M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53400K .......... .......... .......... .......... .......... 57% 381M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53450K .......... .......... .......... .......... .......... 57% 328M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53500K .......... .......... .......... .......... .......... 57% 347M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53550K .......... .......... .......... .......... .......... 57% 232M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53600K .......... .......... .......... .......... .......... 57% 72.8M 0s 2024-09-12T18:10:36.249 INFO:teuthology.orchestra.run.smithi097.stderr: 53650K .......... .......... .......... .......... .......... 57% 285M 0s 2024-09-12T18:10:36.250 INFO:teuthology.orchestra.run.smithi097.stderr: 53700K .......... .......... .......... .......... .......... 57% 293M 0s 2024-09-12T18:10:36.250 INFO:teuthology.orchestra.run.smithi097.stderr: 53750K .......... .......... .......... .......... .......... 57% 73.6M 0s 2024-09-12T18:10:36.250 INFO:teuthology.orchestra.run.smithi097.stderr: 53800K .......... .......... .......... .......... .......... 57% 98.7M 0s 2024-09-12T18:10:36.250 INFO:teuthology.orchestra.run.smithi097.stderr: 53850K .......... .......... .......... .......... .......... 58% 125M 0s 2024-09-12T18:10:36.250 INFO:teuthology.orchestra.run.smithi097.stderr: 53900K .......... .......... .......... .......... .......... 58% 250M 0s 2024-09-12T18:10:36.250 INFO:teuthology.orchestra.run.smithi097.stderr: 53950K .......... .......... .......... .......... .......... 58% 275M 0s 2024-09-12T18:10:36.250 INFO:teuthology.orchestra.run.smithi097.stderr: 54000K .......... .......... .......... .......... .......... 58% 337M 0s 2024-09-12T18:10:36.250 INFO:teuthology.orchestra.run.smithi097.stderr: 54050K .......... .......... .......... .......... .......... 58% 270M 0s 2024-09-12T18:10:36.250 INFO:teuthology.orchestra.run.smithi097.stderr: 54100K .......... .......... .......... .......... .......... 58% 314M 0s 2024-09-12T18:10:36.250 INFO:teuthology.orchestra.run.smithi097.stderr: 54150K .......... .......... .......... .......... .......... 58% 311M 0s 2024-09-12T18:10:36.250 INFO:teuthology.orchestra.run.smithi097.stderr: 54200K .......... .......... .......... .......... .......... 58% 303M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54250K .......... .......... .......... .......... .......... 58% 298M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54300K .......... .......... .......... .......... .......... 58% 249M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54350K .......... .......... .......... .......... .......... 58% 57.3M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54400K .......... .......... .......... .......... .......... 58% 243M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54450K .......... .......... .......... .......... .......... 58% 249M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54500K .......... .......... .......... .......... .......... 58% 229M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54550K .......... .......... .......... .......... .......... 58% 253M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54600K .......... .......... .......... .......... .......... 58% 316M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54650K .......... .......... .......... .......... .......... 58% 364M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54700K .......... .......... .......... .......... .......... 58% 95.9M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54750K .......... .......... .......... .......... .......... 58% 138M 0s 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi097.stderr: 54800K .......... .......... .......... .......... .......... 59% 306M 0s 2024-09-12T18:10:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 54850K .......... .......... .......... .......... .......... 59% 302M 0s 2024-09-12T18:10:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 54900K .......... .......... .......... .......... .......... 59% 351M 0s 2024-09-12T18:10:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 54950K .......... .......... .......... .......... .......... 59% 271M 0s 2024-09-12T18:10:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 55000K .......... .......... .......... .......... .......... 59% 207M 0s 2024-09-12T18:10:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 55050K .......... .......... .......... .......... .......... 59% 373M 0s 2024-09-12T18:10:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 55100K .......... .......... .......... .......... .......... 59% 161M 0s 2024-09-12T18:10:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 55150K .......... .......... .......... .......... .......... 59% 310M 0s 2024-09-12T18:10:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 55200K .......... .......... .......... .......... .......... 59% 254M 0s 2024-09-12T18:10:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 55250K .......... .......... .......... .......... .......... 59% 207M 0s 2024-09-12T18:10:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 55300K .......... .......... .......... .......... .......... 59% 151M 0s 2024-09-12T18:10:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 55350K .......... .......... .......... .......... .......... 59% 284M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55400K .......... .......... .......... .......... .......... 59% 325M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55450K .......... .......... .......... .......... .......... 59% 364M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55500K .......... .......... .......... .......... .......... 59% 326M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55550K .......... .......... .......... .......... .......... 59% 293M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55600K .......... .......... .......... .......... .......... 59% 278M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55650K .......... .......... .......... .......... .......... 59% 70.4M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55700K .......... .......... .......... .......... .......... 60% 300M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55750K .......... .......... .......... .......... .......... 60% 327M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55800K .......... .......... .......... .......... .......... 60% 340M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55850K .......... .......... .......... .......... .......... 60% 340M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55900K .......... .......... .......... .......... .......... 60% 292M 0s 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi097.stderr: 55950K .......... .......... .......... .......... .......... 60% 302M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56000K .......... .......... .......... .......... .......... 60% 303M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56050K .......... .......... .......... .......... .......... 60% 337M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56100K .......... .......... .......... .......... .......... 60% 214M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56150K .......... .......... .......... .......... .......... 60% 349M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56200K .......... .......... .......... .......... .......... 60% 378M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56250K .......... .......... .......... .......... .......... 60% 311M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56300K .......... .......... .......... .......... .......... 60% 280M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56350K .......... .......... .......... .......... .......... 60% 244M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56400K .......... .......... .......... .......... .......... 60% 373M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56450K .......... .......... .......... .......... .......... 60% 326M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56500K .......... .......... .......... .......... .......... 60% 317M 0s 2024-09-12T18:10:36.254 INFO:teuthology.orchestra.run.smithi097.stderr: 56550K .......... .......... .......... .......... .......... 60% 316M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 56600K .......... .......... .......... .......... .......... 60% 323M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 56650K .......... .......... .......... .......... .......... 61% 330M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 56700K .......... .......... .......... .......... .......... 61% 311M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 56750K .......... .......... .......... .......... .......... 61% 332M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 56800K .......... .......... .......... .......... .......... 61% 155M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 56850K .......... .......... .......... .......... .......... 61% 258M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 56900K .......... .......... .......... .......... .......... 61% 160M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 56950K .......... .......... .......... .......... .......... 61% 279M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 57000K .......... .......... .......... .......... .......... 61% 288M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 57050K .......... .......... .......... .......... .......... 61% 262M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 57100K .......... .......... .......... .......... .......... 61% 288M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 57150K .......... .......... .......... .......... .......... 61% 275M 0s 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi097.stderr: 57200K .......... .......... .......... .......... .......... 61% 296M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57250K .......... .......... .......... .......... .......... 61% 322M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57300K .......... .......... .......... .......... .......... 61% 372M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57350K .......... .......... .......... .......... .......... 61% 85.4M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57400K .......... .......... .......... .......... .......... 61% 309M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57450K .......... .......... .......... .......... .......... 61% 117M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57500K .......... .......... .......... .......... .......... 61% 341M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57550K .......... .......... .......... .......... .......... 62% 237M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57600K .......... .......... .......... .......... .......... 62% 239M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57650K .......... .......... .......... .......... .......... 62% 371M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57700K .......... .......... .......... .......... .......... 62% 79.7M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57750K .......... .......... .......... .......... .......... 62% 313M 0s 2024-09-12T18:10:36.256 INFO:teuthology.orchestra.run.smithi097.stderr: 57800K .......... .......... .......... .......... .......... 62% 212M 0s 2024-09-12T18:10:36.257 INFO:teuthology.orchestra.run.smithi097.stderr: 57850K .......... .......... .......... .......... .......... 62% 294M 0s 2024-09-12T18:10:36.257 INFO:teuthology.orchestra.run.smithi097.stderr: 57900K .......... .......... .......... .......... .......... 62% 276M 0s 2024-09-12T18:10:36.257 INFO:teuthology.orchestra.run.smithi097.stderr: 57950K .......... .......... .......... .......... .......... 62% 220M 0s 2024-09-12T18:10:36.257 INFO:teuthology.orchestra.run.smithi097.stderr: 58000K .......... .......... .......... .......... .......... 62% 256M 0s 2024-09-12T18:10:36.257 INFO:teuthology.orchestra.run.smithi097.stderr: 58050K .......... .......... .......... .......... .......... 62% 323M 0s 2024-09-12T18:10:36.257 INFO:teuthology.orchestra.run.smithi097.stderr: 58100K .......... .......... .......... .......... .......... 62% 342M 0s 2024-09-12T18:10:36.257 INFO:teuthology.orchestra.run.smithi097.stderr: 58150K .......... .......... .......... .......... .......... 62% 198M 0s 2024-09-12T18:10:36.257 INFO:teuthology.orchestra.run.smithi097.stderr: 58200K .......... .......... .......... .......... .......... 62% 235M 0s 2024-09-12T18:10:36.257 INFO:teuthology.orchestra.run.smithi097.stderr: 58250K .......... .......... .......... .......... .......... 62% 176M 0s 2024-09-12T18:10:36.257 INFO:teuthology.orchestra.run.smithi097.stderr: 58300K .......... .......... .......... .......... .......... 62% 251M 0s 2024-09-12T18:10:36.257 INFO:teuthology.orchestra.run.smithi097.stderr: 58350K .......... .......... .......... .......... .......... 62% 318M 0s 2024-09-12T18:10:36.258 INFO:teuthology.orchestra.run.smithi097.stderr: 58400K .......... .......... .......... .......... .......... 62% 142M 0s 2024-09-12T18:10:36.258 INFO:teuthology.orchestra.run.smithi097.stderr: 58450K .......... .......... .......... .......... .......... 62% 202M 0s 2024-09-12T18:10:36.258 INFO:teuthology.orchestra.run.smithi097.stderr: 58500K .......... .......... .......... .......... .......... 63% 239M 0s 2024-09-12T18:10:36.258 INFO:teuthology.orchestra.run.smithi097.stderr: 58550K .......... .......... .......... .......... .......... 63% 290M 0s 2024-09-12T18:10:36.258 INFO:teuthology.orchestra.run.smithi097.stderr: 58600K .......... .......... .......... .......... .......... 63% 318M 0s 2024-09-12T18:10:36.258 INFO:teuthology.orchestra.run.smithi097.stderr: 58650K .......... .......... .......... .......... .......... 63% 354M 0s 2024-09-12T18:10:36.258 INFO:teuthology.orchestra.run.smithi097.stderr: 58700K .......... .......... .......... .......... .......... 63% 145M 0s 2024-09-12T18:10:36.258 INFO:teuthology.orchestra.run.smithi097.stderr: 58750K .......... .......... .......... .......... .......... 63% 283M 0s 2024-09-12T18:10:36.258 INFO:teuthology.orchestra.run.smithi097.stderr: 58800K .......... .......... .......... .......... .......... 63% 337M 0s 2024-09-12T18:10:36.258 INFO:teuthology.orchestra.run.smithi097.stderr: 58850K .......... .......... .......... .......... .......... 63% 210M 0s 2024-09-12T18:10:36.258 INFO:teuthology.orchestra.run.smithi097.stderr: 58900K .......... .......... .......... .......... .......... 63% 302M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 58950K .......... .......... .......... .......... .......... 63% 320M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 59000K .......... .......... .......... .......... .......... 63% 283M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 59050K .......... .......... .......... .......... .......... 63% 312M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 59100K .......... .......... .......... .......... .......... 63% 382M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 59150K .......... .......... .......... .......... .......... 63% 302M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 59200K .......... .......... .......... .......... .......... 63% 295M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 59250K .......... .......... .......... .......... .......... 63% 245M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 59300K .......... .......... .......... .......... .......... 63% 334M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 59350K .......... .......... .......... .......... .......... 63% 299M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 59400K .......... .......... .......... .......... .......... 63% 294M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 59450K .......... .......... .......... .......... .......... 64% 314M 0s 2024-09-12T18:10:36.259 INFO:teuthology.orchestra.run.smithi097.stderr: 59500K .......... .......... .......... .......... .......... 64% 344M 0s 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi097.stderr: 59550K .......... .......... .......... .......... .......... 64% 252M 0s 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi097.stderr: 59600K .......... .......... .......... .......... .......... 64% 281M 0s 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi097.stderr: 59650K .......... .......... .......... .......... .......... 64% 329M 0s 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi097.stderr: 59700K .......... .......... .......... .......... .......... 64% 311M 0s 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi097.stderr: 59750K .......... .......... .......... .......... .......... 64% 248M 0s 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi097.stderr: 59800K .......... .......... .......... .......... .......... 64% 350M 0s 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi097.stderr: 59850K .......... .......... .......... .......... .......... 64% 165M 0s 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi097.stderr: 59900K .......... .......... .......... .......... .......... 64% 205M 0s 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi097.stderr: 59950K .......... .......... .......... .......... .......... 64% 143M 0s 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi097.stderr: 60000K .......... .......... .......... .......... .......... 64% 206M 0s 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi097.stderr: 60050K .......... .......... .......... .......... .......... 64% 351M 0s 2024-09-12T18:10:36.261 INFO:teuthology.orchestra.run.smithi097.stderr: 60100K .......... .......... .......... .......... .......... 64% 326M 0s 2024-09-12T18:10:36.261 INFO:teuthology.orchestra.run.smithi097.stderr: 60150K .......... .......... .......... .......... .......... 64% 337M 0s 2024-09-12T18:10:36.261 INFO:teuthology.orchestra.run.smithi097.stderr: 60200K .......... .......... .......... .......... .......... 64% 85.6M 0s 2024-09-12T18:10:36.261 INFO:teuthology.orchestra.run.smithi097.stderr: 60250K .......... .......... .......... .......... .......... 64% 237M 0s 2024-09-12T18:10:36.261 INFO:teuthology.orchestra.run.smithi097.stderr: 60300K .......... .......... .......... .......... .......... 64% 322M 0s 2024-09-12T18:10:36.261 INFO:teuthology.orchestra.run.smithi097.stderr: 60350K .......... .......... .......... .......... .......... 65% 356M 0s 2024-09-12T18:10:36.261 INFO:teuthology.orchestra.run.smithi097.stderr: 60400K .......... .......... .......... .......... .......... 65% 297M 0s 2024-09-12T18:10:36.261 INFO:teuthology.orchestra.run.smithi097.stderr: 60450K .......... .......... .......... .......... .......... 65% 319M 0s 2024-09-12T18:10:36.261 INFO:teuthology.orchestra.run.smithi097.stderr: 60500K .......... .......... .......... .......... .......... 65% 141M 0s 2024-09-12T18:10:36.261 INFO:teuthology.orchestra.run.smithi097.stderr: 60550K .......... .......... .......... .......... .......... 65% 210M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 60600K .......... .......... .......... .......... .......... 65% 197M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 60650K .......... .......... .......... .......... .......... 65% 367M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 60700K .......... .......... .......... .......... .......... 65% 310M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 60750K .......... .......... .......... .......... .......... 65% 357M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 60800K .......... .......... .......... .......... .......... 65% 285M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 60850K .......... .......... .......... .......... .......... 65% 244M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 60900K .......... .......... .......... .......... .......... 65% 67.5M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 60950K .......... .......... .......... .......... .......... 65% 322M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 61000K .......... .......... .......... .......... .......... 65% 244M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 61050K .......... .......... .......... .......... .......... 65% 307M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 61100K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-12T18:10:36.262 INFO:teuthology.orchestra.run.smithi097.stderr: 61150K .......... .......... .......... .......... .......... 65% 307M 0s 2024-09-12T18:10:36.263 INFO:teuthology.orchestra.run.smithi097.stderr: 61200K .......... .......... .......... .......... .......... 65% 116M 0s 2024-09-12T18:10:36.263 INFO:teuthology.orchestra.run.smithi097.stderr: 61250K .......... .......... .......... .......... .......... 65% 310M 0s 2024-09-12T18:10:36.263 INFO:teuthology.orchestra.run.smithi097.stderr: 61300K .......... .......... .......... .......... .......... 66% 162M 0s 2024-09-12T18:10:36.263 INFO:teuthology.orchestra.run.smithi097.stderr: 61350K .......... .......... .......... .......... .......... 66% 308M 0s 2024-09-12T18:10:36.263 INFO:teuthology.orchestra.run.smithi097.stderr: 61400K .......... .......... .......... .......... .......... 66% 327M 0s 2024-09-12T18:10:36.263 INFO:teuthology.orchestra.run.smithi097.stderr: 61450K .......... .......... .......... .......... .......... 66% 359M 0s 2024-09-12T18:10:36.263 INFO:teuthology.orchestra.run.smithi097.stderr: 61500K .......... .......... .......... .......... .......... 66% 375M 0s 2024-09-12T18:10:36.263 INFO:teuthology.orchestra.run.smithi097.stderr: 61550K .......... .......... .......... .......... .......... 66% 299M 0s 2024-09-12T18:10:36.263 INFO:teuthology.orchestra.run.smithi097.stderr: 61600K .......... .......... .......... .......... .......... 66% 337M 0s 2024-09-12T18:10:36.263 INFO:teuthology.orchestra.run.smithi097.stderr: 61650K .......... .......... .......... .......... .......... 66% 377M 0s 2024-09-12T18:10:36.263 INFO:teuthology.orchestra.run.smithi097.stderr: 61700K .......... .......... .......... .......... .......... 66% 425M 0s 2024-09-12T18:10:36.264 INFO:teuthology.orchestra.run.smithi097.stderr: 61750K .......... .......... .......... .......... .......... 66% 220M 0s 2024-09-12T18:10:36.264 INFO:teuthology.orchestra.run.smithi097.stderr: 61800K .......... .......... .......... .......... .......... 66% 322M 0s 2024-09-12T18:10:36.264 INFO:teuthology.orchestra.run.smithi097.stderr: 61850K .......... .......... .......... .......... .......... 66% 325M 0s 2024-09-12T18:10:36.264 INFO:teuthology.orchestra.run.smithi097.stderr: 61900K .......... .......... .......... .......... .......... 66% 279M 0s 2024-09-12T18:10:36.264 INFO:teuthology.orchestra.run.smithi097.stderr: 61950K .......... .......... .......... .......... .......... 66% 305M 0s 2024-09-12T18:10:36.264 INFO:teuthology.orchestra.run.smithi097.stderr: 62000K .......... .......... .......... .......... .......... 66% 282M 0s 2024-09-12T18:10:36.264 INFO:teuthology.orchestra.run.smithi097.stderr: 62050K .......... .......... .......... .......... .......... 66% 297M 0s 2024-09-12T18:10:36.264 INFO:teuthology.orchestra.run.smithi097.stderr: 62100K .......... .......... .......... .......... .......... 66% 286M 0s 2024-09-12T18:10:36.264 INFO:teuthology.orchestra.run.smithi097.stderr: 62150K .......... .......... .......... .......... .......... 66% 333M 0s 2024-09-12T18:10:36.264 INFO:teuthology.orchestra.run.smithi097.stderr: 62200K .......... .......... .......... .......... .......... 67% 330M 0s 2024-09-12T18:10:36.264 INFO:teuthology.orchestra.run.smithi097.stderr: 62250K .......... .......... .......... .......... .......... 67% 197M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62300K .......... .......... .......... .......... .......... 67% 197M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62350K .......... .......... .......... .......... .......... 67% 316M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62400K .......... .......... .......... .......... .......... 67% 322M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62450K .......... .......... .......... .......... .......... 67% 100M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62500K .......... .......... .......... .......... .......... 67% 286M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62550K .......... .......... .......... .......... .......... 67% 309M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62600K .......... .......... .......... .......... .......... 67% 298M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62650K .......... .......... .......... .......... .......... 67% 315M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62700K .......... .......... .......... .......... .......... 67% 186M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62750K .......... .......... .......... .......... .......... 67% 273M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62800K .......... .......... .......... .......... .......... 67% 248M 0s 2024-09-12T18:10:36.265 INFO:teuthology.orchestra.run.smithi097.stderr: 62850K .......... .......... .......... .......... .......... 67% 175M 0s 2024-09-12T18:10:36.266 INFO:teuthology.orchestra.run.smithi097.stderr: 62900K .......... .......... .......... .......... .......... 67% 156M 0s 2024-09-12T18:10:36.266 INFO:teuthology.orchestra.run.smithi097.stderr: 62950K .......... .......... .......... .......... .......... 67% 218M 0s 2024-09-12T18:10:36.266 INFO:teuthology.orchestra.run.smithi097.stderr: 63000K .......... .......... .......... .......... .......... 67% 335M 0s 2024-09-12T18:10:36.266 INFO:teuthology.orchestra.run.smithi097.stderr: 63050K .......... .......... .......... .......... .......... 67% 118M 0s 2024-09-12T18:10:36.266 INFO:teuthology.orchestra.run.smithi097.stderr: 63100K .......... .......... .......... .......... .......... 67% 349M 0s 2024-09-12T18:10:36.266 INFO:teuthology.orchestra.run.smithi097.stderr: 63150K .......... .......... .......... .......... .......... 68% 395M 0s 2024-09-12T18:10:36.266 INFO:teuthology.orchestra.run.smithi097.stderr: 63200K .......... .......... .......... .......... .......... 68% 264M 0s 2024-09-12T18:10:36.266 INFO:teuthology.orchestra.run.smithi097.stderr: 63250K .......... .......... .......... .......... .......... 68% 275M 0s 2024-09-12T18:10:36.266 INFO:teuthology.orchestra.run.smithi097.stderr: 63300K .......... .......... .......... .......... .......... 68% 144M 0s 2024-09-12T18:10:36.266 INFO:teuthology.orchestra.run.smithi097.stderr: 63350K .......... .......... .......... .......... .......... 68% 288M 0s 2024-09-12T18:10:36.266 INFO:teuthology.orchestra.run.smithi097.stderr: 63400K .......... .......... .......... .......... .......... 68% 300M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 63450K .......... .......... .......... .......... .......... 68% 276M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 63500K .......... .......... .......... .......... .......... 68% 315M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 63550K .......... .......... .......... .......... .......... 68% 358M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 63600K .......... .......... .......... .......... .......... 68% 284M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 63650K .......... .......... .......... .......... .......... 68% 332M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 63700K .......... .......... .......... .......... .......... 68% 318M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 63750K .......... .......... .......... .......... .......... 68% 301M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 63800K .......... .......... .......... .......... .......... 68% 346M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 63850K .......... .......... .......... .......... .......... 68% 83.5M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 63900K .......... .......... .......... .......... .......... 68% 331M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 63950K .......... .......... .......... .......... .......... 68% 249M 0s 2024-09-12T18:10:36.267 INFO:teuthology.orchestra.run.smithi097.stderr: 64000K .......... .......... .......... .......... .......... 68% 135M 0s 2024-09-12T18:10:36.268 INFO:teuthology.orchestra.run.smithi097.stderr: 64050K .......... .......... .......... .......... .......... 68% 308M 0s 2024-09-12T18:10:36.268 INFO:teuthology.orchestra.run.smithi097.stderr: 64100K .......... .......... .......... .......... .......... 69% 268M 0s 2024-09-12T18:10:36.268 INFO:teuthology.orchestra.run.smithi097.stderr: 64150K .......... .......... .......... .......... .......... 69% 270M 0s 2024-09-12T18:10:36.268 INFO:teuthology.orchestra.run.smithi097.stderr: 64200K .......... .......... .......... .......... .......... 69% 379M 0s 2024-09-12T18:10:36.268 INFO:teuthology.orchestra.run.smithi097.stderr: 64250K .......... .......... .......... .......... .......... 69% 123M 0s 2024-09-12T18:10:36.268 INFO:teuthology.orchestra.run.smithi097.stderr: 64300K .......... .......... .......... .......... .......... 69% 323M 0s 2024-09-12T18:10:36.268 INFO:teuthology.orchestra.run.smithi097.stderr: 64350K .......... .......... .......... .......... .......... 69% 52.0M 0s 2024-09-12T18:10:36.268 INFO:teuthology.orchestra.run.smithi097.stderr: 64400K .......... .......... .......... .......... .......... 69% 311M 0s 2024-09-12T18:10:36.268 INFO:teuthology.orchestra.run.smithi097.stderr: 64450K .......... .......... .......... .......... .......... 69% 270M 0s 2024-09-12T18:10:36.268 INFO:teuthology.orchestra.run.smithi097.stderr: 64500K .......... .......... .......... .......... .......... 69% 215M 0s 2024-09-12T18:10:36.268 INFO:teuthology.orchestra.run.smithi097.stderr: 64550K .......... .......... .......... .......... .......... 69% 280M 0s 2024-09-12T18:10:36.269 INFO:teuthology.orchestra.run.smithi097.stderr: 64600K .......... .......... .......... .......... .......... 69% 361M 0s 2024-09-12T18:10:36.269 INFO:teuthology.orchestra.run.smithi097.stderr: 64650K .......... .......... .......... .......... .......... 69% 276M 0s 2024-09-12T18:10:36.269 INFO:teuthology.orchestra.run.smithi097.stderr: 64700K .......... .......... .......... .......... .......... 69% 305M 0s 2024-09-12T18:10:36.269 INFO:teuthology.orchestra.run.smithi097.stderr: 64750K .......... .......... .......... .......... .......... 69% 303M 0s 2024-09-12T18:10:36.269 INFO:teuthology.orchestra.run.smithi097.stderr: 64800K .......... .......... .......... .......... .......... 69% 302M 0s 2024-09-12T18:10:36.269 INFO:teuthology.orchestra.run.smithi097.stderr: 64850K .......... .......... .......... .......... .......... 69% 272M 0s 2024-09-12T18:10:36.269 INFO:teuthology.orchestra.run.smithi097.stderr: 64900K .......... .......... .......... .......... .......... 69% 299M 0s 2024-09-12T18:10:36.269 INFO:teuthology.orchestra.run.smithi097.stderr: 64950K .......... .......... .......... .......... .......... 69% 276M 0s 2024-09-12T18:10:36.269 INFO:teuthology.orchestra.run.smithi097.stderr: 65000K .......... .......... .......... .......... .......... 70% 344M 0s 2024-09-12T18:10:36.269 INFO:teuthology.orchestra.run.smithi097.stderr: 65050K .......... .......... .......... .......... .......... 70% 313M 0s 2024-09-12T18:10:36.269 INFO:teuthology.orchestra.run.smithi097.stderr: 65100K .......... .......... .......... .......... .......... 70% 281M 0s 2024-09-12T18:10:36.270 INFO:teuthology.orchestra.run.smithi097.stderr: 65150K .......... .......... .......... .......... .......... 70% 392M 0s 2024-09-12T18:10:36.270 INFO:teuthology.orchestra.run.smithi097.stderr: 65200K .......... .......... .......... .......... .......... 70% 344M 0s 2024-09-12T18:10:36.270 INFO:teuthology.orchestra.run.smithi097.stderr: 65250K .......... .......... .......... .......... .......... 70% 379M 0s 2024-09-12T18:10:36.270 INFO:teuthology.orchestra.run.smithi097.stderr: 65300K .......... .......... .......... .......... .......... 70% 306M 0s 2024-09-12T18:10:36.270 INFO:teuthology.orchestra.run.smithi097.stderr: 65350K .......... .......... .......... .......... .......... 70% 341M 0s 2024-09-12T18:10:36.270 INFO:teuthology.orchestra.run.smithi097.stderr: 65400K .......... .......... .......... .......... .......... 70% 289M 0s 2024-09-12T18:10:36.270 INFO:teuthology.orchestra.run.smithi097.stderr: 65450K .......... .......... .......... .......... .......... 70% 355M 0s 2024-09-12T18:10:36.270 INFO:teuthology.orchestra.run.smithi097.stderr: 65500K .......... .......... .......... .......... .......... 70% 373M 0s 2024-09-12T18:10:36.270 INFO:teuthology.orchestra.run.smithi097.stderr: 65550K .......... .......... .......... .......... .......... 70% 311M 0s 2024-09-12T18:10:36.270 INFO:teuthology.orchestra.run.smithi097.stderr: 65600K .......... .......... .......... .......... .......... 70% 243M 0s 2024-09-12T18:10:36.270 INFO:teuthology.orchestra.run.smithi097.stderr: 65650K .......... .......... .......... .......... .......... 70% 170M 0s 2024-09-12T18:10:36.271 INFO:teuthology.orchestra.run.smithi097.stderr: 65700K .......... .......... .......... .......... .......... 70% 210M 0s 2024-09-12T18:10:36.271 INFO:teuthology.orchestra.run.smithi097.stderr: 65750K .......... .......... .......... .......... .......... 70% 163M 0s 2024-09-12T18:10:36.271 INFO:teuthology.orchestra.run.smithi097.stderr: 65800K .......... .......... .......... .......... .......... 70% 264M 0s 2024-09-12T18:10:36.271 INFO:teuthology.orchestra.run.smithi097.stderr: 65850K .......... .......... .......... .......... .......... 70% 361M 0s 2024-09-12T18:10:36.271 INFO:teuthology.orchestra.run.smithi097.stderr: 65900K .......... .......... .......... .......... .......... 70% 255M 0s 2024-09-12T18:10:36.271 INFO:teuthology.orchestra.run.smithi097.stderr: 65950K .......... .......... .......... .......... .......... 71% 295M 0s 2024-09-12T18:10:36.271 INFO:teuthology.orchestra.run.smithi097.stderr: 66000K .......... .......... .......... .......... .......... 71% 388M 0s 2024-09-12T18:10:36.271 INFO:teuthology.orchestra.run.smithi097.stderr: 66050K .......... .......... .......... .......... .......... 71% 384M 0s 2024-09-12T18:10:36.271 INFO:teuthology.orchestra.run.smithi097.stderr: 66100K .......... .......... .......... .......... .......... 71% 124M 0s 2024-09-12T18:10:36.271 INFO:teuthology.orchestra.run.smithi097.stderr: 66150K .......... .......... .......... .......... .......... 71% 268M 0s 2024-09-12T18:10:36.271 INFO:teuthology.orchestra.run.smithi097.stderr: 66200K .......... .......... .......... .......... .......... 71% 311M 0s 2024-09-12T18:10:36.272 INFO:teuthology.orchestra.run.smithi097.stderr: 66250K .......... .......... .......... .......... .......... 71% 416M 0s 2024-09-12T18:10:36.272 INFO:teuthology.orchestra.run.smithi097.stderr: 66300K .......... .......... .......... .......... .......... 71% 321M 0s 2024-09-12T18:10:36.272 INFO:teuthology.orchestra.run.smithi097.stderr: 66350K .......... .......... .......... .......... .......... 71% 197M 0s 2024-09-12T18:10:36.272 INFO:teuthology.orchestra.run.smithi097.stderr: 66400K .......... .......... .......... .......... .......... 71% 305M 0s 2024-09-12T18:10:36.272 INFO:teuthology.orchestra.run.smithi097.stderr: 66450K .......... .......... .......... .......... .......... 71% 282M 0s 2024-09-12T18:10:36.272 INFO:teuthology.orchestra.run.smithi097.stderr: 66500K .......... .......... .......... .......... .......... 71% 367M 0s 2024-09-12T18:10:36.272 INFO:teuthology.orchestra.run.smithi097.stderr: 66550K .......... .......... .......... .......... .......... 71% 294M 0s 2024-09-12T18:10:36.272 INFO:teuthology.orchestra.run.smithi097.stderr: 66600K .......... .......... .......... .......... .......... 71% 401M 0s 2024-09-12T18:10:36.272 INFO:teuthology.orchestra.run.smithi097.stderr: 66650K .......... .......... .......... .......... .......... 71% 348M 0s 2024-09-12T18:10:36.272 INFO:teuthology.orchestra.run.smithi097.stderr: 66700K .......... .......... .......... .......... .......... 71% 139M 0s 2024-09-12T18:10:36.272 INFO:teuthology.orchestra.run.smithi097.stderr: 66750K .......... .......... .......... .......... .......... 71% 270M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 66800K .......... .......... .......... .......... .......... 71% 403M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 66850K .......... .......... .......... .......... .......... 72% 128M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 66900K .......... .......... .......... .......... .......... 72% 233M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 66950K .......... .......... .......... .......... .......... 72% 242M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 67000K .......... .......... .......... .......... .......... 72% 438M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 67050K .......... .......... .......... .......... .......... 72% 150M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 67100K .......... .......... .......... .......... .......... 72% 252M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 67150K .......... .......... .......... .......... .......... 72% 110M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 67200K .......... .......... .......... .......... .......... 72% 326M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 67250K .......... .......... .......... .......... .......... 72% 334M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 67300K .......... .......... .......... .......... .......... 72% 351M 0s 2024-09-12T18:10:36.273 INFO:teuthology.orchestra.run.smithi097.stderr: 67350K .......... .......... .......... .......... .......... 72% 60.5M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67400K .......... .......... .......... .......... .......... 72% 81.4M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67450K .......... .......... .......... .......... .......... 72% 174M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67500K .......... .......... .......... .......... .......... 72% 354M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67550K .......... .......... .......... .......... .......... 72% 318M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67600K .......... .......... .......... .......... .......... 72% 177M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67650K .......... .......... .......... .......... .......... 72% 300M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67700K .......... .......... .......... .......... .......... 72% 400M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67750K .......... .......... .......... .......... .......... 72% 274M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67800K .......... .......... .......... .......... .......... 73% 314M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67850K .......... .......... .......... .......... .......... 73% 395M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67900K .......... .......... .......... .......... .......... 73% 374M 0s 2024-09-12T18:10:36.274 INFO:teuthology.orchestra.run.smithi097.stderr: 67950K .......... .......... .......... .......... .......... 73% 358M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68000K .......... .......... .......... .......... .......... 73% 324M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68050K .......... .......... .......... .......... .......... 73% 368M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68100K .......... .......... .......... .......... .......... 73% 392M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68150K .......... .......... .......... .......... .......... 73% 219M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68200K .......... .......... .......... .......... .......... 73% 284M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68250K .......... .......... .......... .......... .......... 73% 357M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68300K .......... .......... .......... .......... .......... 73% 292M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68350K .......... .......... .......... .......... .......... 73% 297M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68400K .......... .......... .......... .......... .......... 73% 332M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68450K .......... .......... .......... .......... .......... 73% 257M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68500K .......... .......... .......... .......... .......... 73% 331M 0s 2024-09-12T18:10:36.275 INFO:teuthology.orchestra.run.smithi097.stderr: 68550K .......... .......... .......... .......... .......... 73% 290M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 68600K .......... .......... .......... .......... .......... 73% 239M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 68650K .......... .......... .......... .......... .......... 73% 333M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 68700K .......... .......... .......... .......... .......... 74% 257M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 68750K .......... .......... .......... .......... .......... 74% 379M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 68800K .......... .......... .......... .......... .......... 74% 250M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 68850K .......... .......... .......... .......... .......... 74% 281M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 68900K .......... .......... .......... .......... .......... 74% 267M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 68950K .......... .......... .......... .......... .......... 74% 384M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 69000K .......... .......... .......... .......... .......... 74% 172M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 69050K .......... .......... .......... .......... .......... 74% 296M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 69100K .......... .......... .......... .......... .......... 74% 263M 0s 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi097.stderr: 69150K .......... .......... .......... .......... .......... 74% 393M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69200K .......... .......... .......... .......... .......... 74% 304M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69250K .......... .......... .......... .......... .......... 74% 249M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69300K .......... .......... .......... .......... .......... 74% 232M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69350K .......... .......... .......... .......... .......... 74% 253M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69400K .......... .......... .......... .......... .......... 74% 304M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69450K .......... .......... .......... .......... .......... 74% 300M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69500K .......... .......... .......... .......... .......... 74% 367M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69550K .......... .......... .......... .......... .......... 74% 368M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69600K .......... .......... .......... .......... .......... 74% 147M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69650K .......... .......... .......... .......... .......... 75% 299M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69700K .......... .......... .......... .......... .......... 75% 304M 0s 2024-09-12T18:10:36.277 INFO:teuthology.orchestra.run.smithi097.stderr: 69750K .......... .......... .......... .......... .......... 75% 288M 0s 2024-09-12T18:10:36.278 INFO:teuthology.orchestra.run.smithi097.stderr: 69800K .......... .......... .......... .......... .......... 75% 305M 0s 2024-09-12T18:10:36.278 INFO:teuthology.orchestra.run.smithi097.stderr: 69850K .......... .......... .......... .......... .......... 75% 318M 0s 2024-09-12T18:10:36.278 INFO:teuthology.orchestra.run.smithi097.stderr: 69900K .......... .......... .......... .......... .......... 75% 246M 0s 2024-09-12T18:10:36.278 INFO:teuthology.orchestra.run.smithi097.stderr: 69950K .......... .......... .......... .......... .......... 75% 219M 0s 2024-09-12T18:10:36.278 INFO:teuthology.orchestra.run.smithi097.stderr: 70000K .......... .......... .......... .......... .......... 75% 336M 0s 2024-09-12T18:10:36.278 INFO:teuthology.orchestra.run.smithi097.stderr: 70050K .......... .......... .......... .......... .......... 75% 315M 0s 2024-09-12T18:10:36.278 INFO:teuthology.orchestra.run.smithi097.stderr: 70100K .......... .......... .......... .......... .......... 75% 281M 0s 2024-09-12T18:10:36.278 INFO:teuthology.orchestra.run.smithi097.stderr: 70150K .......... .......... .......... .......... .......... 75% 77.9M 0s 2024-09-12T18:10:36.278 INFO:teuthology.orchestra.run.smithi097.stderr: 70200K .......... .......... .......... .......... .......... 75% 136M 0s 2024-09-12T18:10:36.278 INFO:teuthology.orchestra.run.smithi097.stderr: 70250K .......... .......... .......... .......... .......... 75% 247M 0s 2024-09-12T18:10:36.278 INFO:teuthology.orchestra.run.smithi097.stderr: 70300K .......... .......... .......... .......... .......... 75% 315M 0s 2024-09-12T18:10:36.279 INFO:teuthology.orchestra.run.smithi097.stderr: 70350K .......... .......... .......... .......... .......... 75% 92.0M 0s 2024-09-12T18:10:36.279 INFO:teuthology.orchestra.run.smithi097.stderr: 70400K .......... .......... .......... .......... .......... 75% 78.3M 0s 2024-09-12T18:10:36.279 INFO:teuthology.orchestra.run.smithi097.stderr: 70450K .......... .......... .......... .......... .......... 75% 143M 0s 2024-09-12T18:10:36.279 INFO:teuthology.orchestra.run.smithi097.stderr: 70500K .......... .......... .......... .......... .......... 75% 245M 0s 2024-09-12T18:10:36.279 INFO:teuthology.orchestra.run.smithi097.stderr: 70550K .......... .......... .......... .......... .......... 75% 316M 0s 2024-09-12T18:10:36.279 INFO:teuthology.orchestra.run.smithi097.stderr: 70600K .......... .......... .......... .......... .......... 76% 135M 0s 2024-09-12T18:10:36.279 INFO:teuthology.orchestra.run.smithi097.stderr: 70650K .......... .......... .......... .......... .......... 76% 274M 0s 2024-09-12T18:10:36.279 INFO:teuthology.orchestra.run.smithi097.stderr: 70700K .......... .......... .......... .......... .......... 76% 323M 0s 2024-09-12T18:10:36.279 INFO:teuthology.orchestra.run.smithi097.stderr: 70750K .......... .......... .......... .......... .......... 76% 345M 0s 2024-09-12T18:10:36.279 INFO:teuthology.orchestra.run.smithi097.stderr: 70800K .......... .......... .......... .......... .......... 76% 309M 0s 2024-09-12T18:10:36.279 INFO:teuthology.orchestra.run.smithi097.stderr: 70850K .......... .......... .......... .......... .......... 76% 253M 0s 2024-09-12T18:10:36.280 INFO:teuthology.orchestra.run.smithi097.stderr: 70900K .......... .......... .......... .......... .......... 76% 307M 0s 2024-09-12T18:10:36.280 INFO:teuthology.orchestra.run.smithi097.stderr: 70950K .......... .......... .......... .......... .......... 76% 330M 0s 2024-09-12T18:10:36.280 INFO:teuthology.orchestra.run.smithi097.stderr: 71000K .......... .......... .......... .......... .......... 76% 258M 0s 2024-09-12T18:10:36.280 INFO:teuthology.orchestra.run.smithi097.stderr: 71050K .......... .......... .......... .......... .......... 76% 349M 0s 2024-09-12T18:10:36.280 INFO:teuthology.orchestra.run.smithi097.stderr: 71100K .......... .......... .......... .......... .......... 76% 406M 0s 2024-09-12T18:10:36.280 INFO:teuthology.orchestra.run.smithi097.stderr: 71150K .......... .......... .......... .......... .......... 76% 139M 0s 2024-09-12T18:10:36.280 INFO:teuthology.orchestra.run.smithi097.stderr: 71200K .......... .......... .......... .......... .......... 76% 231M 0s 2024-09-12T18:10:36.280 INFO:teuthology.orchestra.run.smithi097.stderr: 71250K .......... .......... .......... .......... .......... 76% 293M 0s 2024-09-12T18:10:36.280 INFO:teuthology.orchestra.run.smithi097.stderr: 71300K .......... .......... .......... .......... .......... 76% 307M 0s 2024-09-12T18:10:36.280 INFO:teuthology.orchestra.run.smithi097.stderr: 71350K .......... .......... .......... .......... .......... 76% 288M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71400K .......... .......... .......... .......... .......... 76% 324M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71450K .......... .......... .......... .......... .......... 76% 323M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71500K .......... .......... .......... .......... .......... 77% 297M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71550K .......... .......... .......... .......... .......... 77% 390M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71600K .......... .......... .......... .......... .......... 77% 265M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71650K .......... .......... .......... .......... .......... 77% 321M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71700K .......... .......... .......... .......... .......... 77% 327M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71750K .......... .......... .......... .......... .......... 77% 328M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71800K .......... .......... .......... .......... .......... 77% 318M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71850K .......... .......... .......... .......... .......... 77% 340M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71900K .......... .......... .......... .......... .......... 77% 239M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 71950K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-12T18:10:36.281 INFO:teuthology.orchestra.run.smithi097.stderr: 72000K .......... .......... .......... .......... .......... 77% 306M 0s 2024-09-12T18:10:36.282 INFO:teuthology.orchestra.run.smithi097.stderr: 72050K .......... .......... .......... .......... .......... 77% 306M 0s 2024-09-12T18:10:36.282 INFO:teuthology.orchestra.run.smithi097.stderr: 72100K .......... .......... .......... .......... .......... 77% 271M 0s 2024-09-12T18:10:36.282 INFO:teuthology.orchestra.run.smithi097.stderr: 72150K .......... .......... .......... .......... .......... 77% 287M 0s 2024-09-12T18:10:36.282 INFO:teuthology.orchestra.run.smithi097.stderr: 72200K .......... .......... .......... .......... .......... 77% 361M 0s 2024-09-12T18:10:36.282 INFO:teuthology.orchestra.run.smithi097.stderr: 72250K .......... .......... .......... .......... .......... 77% 325M 0s 2024-09-12T18:10:36.282 INFO:teuthology.orchestra.run.smithi097.stderr: 72300K .......... .......... .......... .......... .......... 77% 310M 0s 2024-09-12T18:10:36.282 INFO:teuthology.orchestra.run.smithi097.stderr: 72350K .......... .......... .......... .......... .......... 77% 342M 0s 2024-09-12T18:10:36.282 INFO:teuthology.orchestra.run.smithi097.stderr: 72400K .......... .......... .......... .......... .......... 77% 395M 0s 2024-09-12T18:10:36.282 INFO:teuthology.orchestra.run.smithi097.stderr: 72450K .......... .......... .......... .......... .......... 78% 389M 0s 2024-09-12T18:10:36.282 INFO:teuthology.orchestra.run.smithi097.stderr: 72500K .......... .......... .......... .......... .......... 78% 203M 0s 2024-09-12T18:10:36.282 INFO:teuthology.orchestra.run.smithi097.stderr: 72550K .......... .......... .......... .......... .......... 78% 322M 0s 2024-09-12T18:10:36.283 INFO:teuthology.orchestra.run.smithi097.stderr: 72600K .......... .......... .......... .......... .......... 78% 384M 0s 2024-09-12T18:10:36.283 INFO:teuthology.orchestra.run.smithi097.stderr: 72650K .......... .......... .......... .......... .......... 78% 296M 0s 2024-09-12T18:10:36.283 INFO:teuthology.orchestra.run.smithi097.stderr: 72700K .......... .......... .......... .......... .......... 78% 301M 0s 2024-09-12T18:10:36.283 INFO:teuthology.orchestra.run.smithi097.stderr: 72750K .......... .......... .......... .......... .......... 78% 94.5M 0s 2024-09-12T18:10:36.283 INFO:teuthology.orchestra.run.smithi097.stderr: 72800K .......... .......... .......... .......... .......... 78% 317M 0s 2024-09-12T18:10:36.283 INFO:teuthology.orchestra.run.smithi097.stderr: 72850K .......... .......... .......... .......... .......... 78% 297M 0s 2024-09-12T18:10:36.283 INFO:teuthology.orchestra.run.smithi097.stderr: 72900K .......... .......... .......... .......... .......... 78% 306M 0s 2024-09-12T18:10:36.283 INFO:teuthology.orchestra.run.smithi097.stderr: 72950K .......... .......... .......... .......... .......... 78% 328M 0s 2024-09-12T18:10:36.283 INFO:teuthology.orchestra.run.smithi097.stderr: 73000K .......... .......... .......... .......... .......... 78% 279M 0s 2024-09-12T18:10:36.283 INFO:teuthology.orchestra.run.smithi097.stderr: 73050K .......... .......... .......... .......... .......... 78% 407M 0s 2024-09-12T18:10:36.283 INFO:teuthology.orchestra.run.smithi097.stderr: 73100K .......... .......... .......... .......... .......... 78% 304M 0s 2024-09-12T18:10:36.284 INFO:teuthology.orchestra.run.smithi097.stderr: 73150K .......... .......... .......... .......... .......... 78% 224M 0s 2024-09-12T18:10:36.284 INFO:teuthology.orchestra.run.smithi097.stderr: 73200K .......... .......... .......... .......... .......... 78% 150M 0s 2024-09-12T18:10:36.284 INFO:teuthology.orchestra.run.smithi097.stderr: 73250K .......... .......... .......... .......... .......... 78% 203M 0s 2024-09-12T18:10:36.284 INFO:teuthology.orchestra.run.smithi097.stderr: 73300K .......... .......... .......... .......... .......... 78% 275M 0s 2024-09-12T18:10:36.284 INFO:teuthology.orchestra.run.smithi097.stderr: 73350K .......... .......... .......... .......... .......... 79% 100M 0s 2024-09-12T18:10:36.284 INFO:teuthology.orchestra.run.smithi097.stderr: 73400K .......... .......... .......... .......... .......... 79% 265M 0s 2024-09-12T18:10:36.284 INFO:teuthology.orchestra.run.smithi097.stderr: 73450K .......... .......... .......... .......... .......... 79% 87.3M 0s 2024-09-12T18:10:36.284 INFO:teuthology.orchestra.run.smithi097.stderr: 73500K .......... .......... .......... .......... .......... 79% 95.8M 0s 2024-09-12T18:10:36.284 INFO:teuthology.orchestra.run.smithi097.stderr: 73550K .......... .......... .......... .......... .......... 79% 305M 0s 2024-09-12T18:10:36.284 INFO:teuthology.orchestra.run.smithi097.stderr: 73600K .......... .......... .......... .......... .......... 79% 141M 0s 2024-09-12T18:10:36.284 INFO:teuthology.orchestra.run.smithi097.stderr: 73650K .......... .......... .......... .......... .......... 79% 215M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 73700K .......... .......... .......... .......... .......... 79% 155M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 73750K .......... .......... .......... .......... .......... 79% 347M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 73800K .......... .......... .......... .......... .......... 79% 368M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 73850K .......... .......... .......... .......... .......... 79% 286M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 73900K .......... .......... .......... .......... .......... 79% 252M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 73950K .......... .......... .......... .......... .......... 79% 363M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 74000K .......... .......... .......... .......... .......... 79% 340M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 74050K .......... .......... .......... .......... .......... 79% 73.0M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 74100K .......... .......... .......... .......... .......... 79% 74.9M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 74150K .......... .......... .......... .......... .......... 79% 391M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 74200K .......... .......... .......... .......... .......... 79% 115M 0s 2024-09-12T18:10:36.285 INFO:teuthology.orchestra.run.smithi097.stderr: 74250K .......... .......... .......... .......... .......... 79% 257M 0s 2024-09-12T18:10:36.286 INFO:teuthology.orchestra.run.smithi097.stderr: 74300K .......... .......... .......... .......... .......... 80% 361M 0s 2024-09-12T18:10:36.286 INFO:teuthology.orchestra.run.smithi097.stderr: 74350K .......... .......... .......... .......... .......... 80% 309M 0s 2024-09-12T18:10:36.286 INFO:teuthology.orchestra.run.smithi097.stderr: 74400K .......... .......... .......... .......... .......... 80% 289M 0s 2024-09-12T18:10:36.286 INFO:teuthology.orchestra.run.smithi097.stderr: 74450K .......... .......... .......... .......... .......... 80% 302M 0s 2024-09-12T18:10:36.286 INFO:teuthology.orchestra.run.smithi097.stderr: 74500K .......... .......... .......... .......... .......... 80% 315M 0s 2024-09-12T18:10:36.286 INFO:teuthology.orchestra.run.smithi097.stderr: 74550K .......... .......... .......... .......... .......... 80% 317M 0s 2024-09-12T18:10:36.286 INFO:teuthology.orchestra.run.smithi097.stderr: 74600K .......... .......... .......... .......... .......... 80% 288M 0s 2024-09-12T18:10:36.286 INFO:teuthology.orchestra.run.smithi097.stderr: 74650K .......... .......... .......... .......... .......... 80% 321M 0s 2024-09-12T18:10:36.286 INFO:teuthology.orchestra.run.smithi097.stderr: 74700K .......... .......... .......... .......... .......... 80% 315M 0s 2024-09-12T18:10:36.286 INFO:teuthology.orchestra.run.smithi097.stderr: 74750K .......... .......... .......... .......... .......... 80% 269M 0s 2024-09-12T18:10:36.287 INFO:teuthology.orchestra.run.smithi097.stderr: 74800K .......... .......... .......... .......... .......... 80% 334M 0s 2024-09-12T18:10:36.287 INFO:teuthology.orchestra.run.smithi097.stderr: 74850K .......... .......... .......... .......... .......... 80% 305M 0s 2024-09-12T18:10:36.287 INFO:teuthology.orchestra.run.smithi097.stderr: 74900K .......... .......... .......... .......... .......... 80% 354M 0s 2024-09-12T18:10:36.287 INFO:teuthology.orchestra.run.smithi097.stderr: 74950K .......... .......... .......... .......... .......... 80% 311M 0s 2024-09-12T18:10:36.287 INFO:teuthology.orchestra.run.smithi097.stderr: 75000K .......... .......... .......... .......... .......... 80% 321M 0s 2024-09-12T18:10:36.287 INFO:teuthology.orchestra.run.smithi097.stderr: 75050K .......... .......... .......... .......... .......... 80% 261M 0s 2024-09-12T18:10:36.287 INFO:teuthology.orchestra.run.smithi097.stderr: 75100K .......... .......... .......... .......... .......... 80% 331M 0s 2024-09-12T18:10:36.287 INFO:teuthology.orchestra.run.smithi097.stderr: 75150K .......... .......... .......... .......... .......... 80% 313M 0s 2024-09-12T18:10:36.287 INFO:teuthology.orchestra.run.smithi097.stderr: 75200K .......... .......... .......... .......... .......... 81% 281M 0s 2024-09-12T18:10:36.287 INFO:teuthology.orchestra.run.smithi097.stderr: 75250K .......... .......... .......... .......... .......... 81% 324M 0s 2024-09-12T18:10:36.287 INFO:teuthology.orchestra.run.smithi097.stderr: 75300K .......... .......... .......... .......... .......... 81% 262M 0s 2024-09-12T18:10:36.288 INFO:teuthology.orchestra.run.smithi097.stderr: 75350K .......... .......... .......... .......... .......... 81% 318M 0s 2024-09-12T18:10:36.288 INFO:teuthology.orchestra.run.smithi097.stderr: 75400K .......... .......... .......... .......... .......... 81% 295M 0s 2024-09-12T18:10:36.288 INFO:teuthology.orchestra.run.smithi097.stderr: 75450K .......... .......... .......... .......... .......... 81% 312M 0s 2024-09-12T18:10:36.288 INFO:teuthology.orchestra.run.smithi097.stderr: 75500K .......... .......... .......... .......... .......... 81% 323M 0s 2024-09-12T18:10:36.288 INFO:teuthology.orchestra.run.smithi097.stderr: 75550K .......... .......... .......... .......... .......... 81% 371M 0s 2024-09-12T18:10:36.288 INFO:teuthology.orchestra.run.smithi097.stderr: 75600K .......... .......... .......... .......... .......... 81% 241M 0s 2024-09-12T18:10:36.288 INFO:teuthology.orchestra.run.smithi097.stderr: 75650K .......... .......... .......... .......... .......... 81% 330M 0s 2024-09-12T18:10:36.288 INFO:teuthology.orchestra.run.smithi097.stderr: 75700K .......... .......... .......... .......... .......... 81% 286M 0s 2024-09-12T18:10:36.288 INFO:teuthology.orchestra.run.smithi097.stderr: 75750K .......... .......... .......... .......... .......... 81% 291M 0s 2024-09-12T18:10:36.288 INFO:teuthology.orchestra.run.smithi097.stderr: 75800K .......... .......... .......... .......... .......... 81% 379M 0s 2024-09-12T18:10:36.288 INFO:teuthology.orchestra.run.smithi097.stderr: 75850K .......... .......... .......... .......... .......... 81% 302M 0s 2024-09-12T18:10:36.289 INFO:teuthology.orchestra.run.smithi097.stderr: 75900K .......... .......... .......... .......... .......... 81% 296M 0s 2024-09-12T18:10:36.289 INFO:teuthology.orchestra.run.smithi097.stderr: 75950K .......... .......... .......... .......... .......... 81% 387M 0s 2024-09-12T18:10:36.289 INFO:teuthology.orchestra.run.smithi097.stderr: 76000K .......... .......... .......... .......... .......... 81% 340M 0s 2024-09-12T18:10:36.289 INFO:teuthology.orchestra.run.smithi097.stderr: 76050K .......... .......... .......... .......... .......... 81% 346M 0s 2024-09-12T18:10:36.289 INFO:teuthology.orchestra.run.smithi097.stderr: 76100K .......... .......... .......... .......... .......... 81% 268M 0s 2024-09-12T18:10:36.289 INFO:teuthology.orchestra.run.smithi097.stderr: 76150K .......... .......... .......... .......... .......... 82% 353M 0s 2024-09-12T18:10:36.289 INFO:teuthology.orchestra.run.smithi097.stderr: 76200K .......... .......... .......... .......... .......... 82% 402M 0s 2024-09-12T18:10:36.289 INFO:teuthology.orchestra.run.smithi097.stderr: 76250K .......... .......... .......... .......... .......... 82% 414M 0s 2024-09-12T18:10:36.289 INFO:teuthology.orchestra.run.smithi097.stderr: 76300K .......... .......... .......... .......... .......... 82% 114M 0s 2024-09-12T18:10:36.289 INFO:teuthology.orchestra.run.smithi097.stderr: 76350K .......... .......... .......... .......... .......... 82% 273M 0s 2024-09-12T18:10:36.289 INFO:teuthology.orchestra.run.smithi097.stderr: 76400K .......... .......... .......... .......... .......... 82% 414M 0s 2024-09-12T18:10:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 76450K .......... .......... .......... .......... .......... 82% 194M 0s 2024-09-12T18:10:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 76500K .......... .......... .......... .......... .......... 82% 128M 0s 2024-09-12T18:10:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 76550K .......... .......... .......... .......... .......... 82% 171M 0s 2024-09-12T18:10:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 76600K .......... .......... .......... .......... .......... 82% 274M 0s 2024-09-12T18:10:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 76650K .......... .......... .......... .......... .......... 82% 126M 0s 2024-09-12T18:10:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 76700K .......... .......... .......... .......... .......... 82% 61.6M 0s 2024-09-12T18:10:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 76750K .......... .......... .......... .......... .......... 82% 252M 0s 2024-09-12T18:10:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 76800K .......... .......... .......... .......... .......... 82% 403M 0s 2024-09-12T18:10:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 76850K .......... .......... .......... .......... .......... 82% 48.9M 0s 2024-09-12T18:10:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 76900K .......... .......... .......... .......... .......... 82% 338M 0s 2024-09-12T18:10:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 76950K .......... .......... .......... .......... .......... 82% 267M 0s 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi097.stderr: 77000K .......... .......... .......... .......... .......... 82% 89.4M 0s 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi097.stderr: 77050K .......... .......... .......... .......... .......... 82% 281M 0s 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi097.stderr: 77100K .......... .......... .......... .......... .......... 83% 85.3M 0s 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi097.stderr: 77150K .......... .......... .......... .......... .......... 83% 237M 0s 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi097.stderr: 77200K .......... .......... .......... .......... .......... 83% 198M 0s 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi097.stderr: 77250K .......... .......... .......... .......... .......... 83% 106M 0s 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi097.stderr: 77300K .......... .......... .......... .......... .......... 83% 292M 0s 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi097.stderr: 77350K .......... .......... .......... .......... .......... 83% 291M 0s 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi097.stderr: 77400K .......... .......... .......... .......... .......... 83% 321M 0s 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi097.stderr: 77450K .......... .......... .......... .......... .......... 83% 303M 0s 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi097.stderr: 77500K .......... .......... .......... .......... .......... 83% 272M 0s 2024-09-12T18:10:36.292 INFO:teuthology.orchestra.run.smithi097.stderr: 77550K .......... .......... .......... .......... .......... 83% 332M 0s 2024-09-12T18:10:36.292 INFO:teuthology.orchestra.run.smithi097.stderr: 77600K .......... .......... .......... .......... .......... 83% 373M 0s 2024-09-12T18:10:36.292 INFO:teuthology.orchestra.run.smithi097.stderr: 77650K .......... .......... .......... .......... .......... 83% 358M 0s 2024-09-12T18:10:36.292 INFO:teuthology.orchestra.run.smithi097.stderr: 77700K .......... .......... .......... .......... .......... 83% 297M 0s 2024-09-12T18:10:36.292 INFO:teuthology.orchestra.run.smithi097.stderr: 77750K .......... .......... .......... .......... .......... 83% 337M 0s 2024-09-12T18:10:36.292 INFO:teuthology.orchestra.run.smithi097.stderr: 77800K .......... .......... .......... .......... .......... 83% 353M 0s 2024-09-12T18:10:36.292 INFO:teuthology.orchestra.run.smithi097.stderr: 77850K .......... .......... .......... .......... .......... 83% 314M 0s 2024-09-12T18:10:36.292 INFO:teuthology.orchestra.run.smithi097.stderr: 77900K .......... .......... .......... .......... .......... 83% 387M 0s 2024-09-12T18:10:36.292 INFO:teuthology.orchestra.run.smithi097.stderr: 77950K .......... .......... .......... .......... .......... 83% 291M 0s 2024-09-12T18:10:36.292 INFO:teuthology.orchestra.run.smithi097.stderr: 78000K .......... .......... .......... .......... .......... 84% 20.4M 0s 2024-09-12T18:10:36.293 INFO:teuthology.orchestra.run.smithi097.stderr: 78050K .......... .......... .......... .......... .......... 84% 222M 0s 2024-09-12T18:10:36.293 INFO:teuthology.orchestra.run.smithi097.stderr: 78100K .......... .......... .......... .......... .......... 84% 299M 0s 2024-09-12T18:10:36.293 INFO:teuthology.orchestra.run.smithi097.stderr: 78150K .......... .......... .......... .......... .......... 84% 320M 0s 2024-09-12T18:10:36.293 INFO:teuthology.orchestra.run.smithi097.stderr: 78200K .......... .......... .......... .......... .......... 84% 350M 0s 2024-09-12T18:10:36.293 INFO:teuthology.orchestra.run.smithi097.stderr: 78250K .......... .......... .......... .......... .......... 84% 244M 0s 2024-09-12T18:10:36.293 INFO:teuthology.orchestra.run.smithi097.stderr: 78300K .......... .......... .......... .......... .......... 84% 302M 0s 2024-09-12T18:10:36.293 INFO:teuthology.orchestra.run.smithi097.stderr: 78350K .......... .......... .......... .......... .......... 84% 296M 0s 2024-09-12T18:10:36.293 INFO:teuthology.orchestra.run.smithi097.stderr: 78400K .......... .......... .......... .......... .......... 84% 274M 0s 2024-09-12T18:10:36.293 INFO:teuthology.orchestra.run.smithi097.stderr: 78450K .......... .......... .......... .......... .......... 84% 308M 0s 2024-09-12T18:10:36.293 INFO:teuthology.orchestra.run.smithi097.stderr: 78500K .......... .......... .......... .......... .......... 84% 342M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 78550K .......... .......... .......... .......... .......... 84% 262M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 78600K .......... .......... .......... .......... .......... 84% 334M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 78650K .......... .......... .......... .......... .......... 84% 327M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 78700K .......... .......... .......... .......... .......... 84% 351M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 78750K .......... .......... .......... .......... .......... 84% 265M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 78800K .......... .......... .......... .......... .......... 84% 348M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 78850K .......... .......... .......... .......... .......... 84% 326M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 78900K .......... .......... .......... .......... .......... 84% 367M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 78950K .......... .......... .......... .......... .......... 85% 273M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 79000K .......... .......... .......... .......... .......... 85% 333M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 79050K .......... .......... .......... .......... .......... 85% 386M 0s 2024-09-12T18:10:36.294 INFO:teuthology.orchestra.run.smithi097.stderr: 79100K .......... .......... .......... .......... .......... 85% 278M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79150K .......... .......... .......... .......... .......... 85% 326M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79200K .......... .......... .......... .......... .......... 85% 320M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79250K .......... .......... .......... .......... .......... 85% 321M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79300K .......... .......... .......... .......... .......... 85% 407M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79350K .......... .......... .......... .......... .......... 85% 409M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79400K .......... .......... .......... .......... .......... 85% 348M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79450K .......... .......... .......... .......... .......... 85% 406M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79500K .......... .......... .......... .......... .......... 85% 358M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79550K .......... .......... .......... .......... .......... 85% 339M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79600K .......... .......... .......... .......... .......... 85% 255M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79650K .......... .......... .......... .......... .......... 85% 71.9M 0s 2024-09-12T18:10:36.295 INFO:teuthology.orchestra.run.smithi097.stderr: 79700K .......... .......... .......... .......... .......... 85% 72.1M 0s 2024-09-12T18:10:36.296 INFO:teuthology.orchestra.run.smithi097.stderr: 79750K .......... .......... .......... .......... .......... 85% 40.9M 0s 2024-09-12T18:10:36.296 INFO:teuthology.orchestra.run.smithi097.stderr: 79800K .......... .......... .......... .......... .......... 85% 290M 0s 2024-09-12T18:10:36.296 INFO:teuthology.orchestra.run.smithi097.stderr: 79850K .......... .......... .......... .......... .......... 86% 296M 0s 2024-09-12T18:10:36.296 INFO:teuthology.orchestra.run.smithi097.stderr: 79900K .......... .......... .......... .......... .......... 86% 299M 0s 2024-09-12T18:10:36.296 INFO:teuthology.orchestra.run.smithi097.stderr: 79950K .......... .......... .......... .......... .......... 86% 276M 0s 2024-09-12T18:10:36.296 INFO:teuthology.orchestra.run.smithi097.stderr: 80000K .......... .......... .......... .......... .......... 86% 320M 0s 2024-09-12T18:10:36.296 INFO:teuthology.orchestra.run.smithi097.stderr: 80050K .......... .......... .......... .......... .......... 86% 388M 0s 2024-09-12T18:10:36.296 INFO:teuthology.orchestra.run.smithi097.stderr: 80100K .......... .......... .......... .......... .......... 86% 138M 0s 2024-09-12T18:10:36.296 INFO:teuthology.orchestra.run.smithi097.stderr: 80150K .......... .......... .......... .......... .......... 86% 173M 0s 2024-09-12T18:10:36.296 INFO:teuthology.orchestra.run.smithi097.stderr: 80200K .......... .......... .......... .......... .......... 86% 214M 0s 2024-09-12T18:10:36.296 INFO:teuthology.orchestra.run.smithi097.stderr: 80250K .......... .......... .......... .......... .......... 86% 104M 0s 2024-09-12T18:10:36.297 INFO:teuthology.orchestra.run.smithi097.stderr: 80300K .......... .......... .......... .......... .......... 86% 292M 0s 2024-09-12T18:10:36.297 INFO:teuthology.orchestra.run.smithi097.stderr: 80350K .......... .......... .......... .......... .......... 86% 154M 0s 2024-09-12T18:10:36.297 INFO:teuthology.orchestra.run.smithi097.stderr: 80400K .......... .......... .......... .......... .......... 86% 224M 0s 2024-09-12T18:10:36.297 INFO:teuthology.orchestra.run.smithi097.stderr: 80450K .......... .......... .......... .......... .......... 86% 242M 0s 2024-09-12T18:10:36.297 INFO:teuthology.orchestra.run.smithi097.stderr: 80500K .......... .......... .......... .......... .......... 86% 292M 0s 2024-09-12T18:10:36.297 INFO:teuthology.orchestra.run.smithi097.stderr: 80550K .......... .......... .......... .......... .......... 86% 278M 0s 2024-09-12T18:10:36.297 INFO:teuthology.orchestra.run.smithi097.stderr: 80600K .......... .......... .......... .......... .......... 86% 273M 0s 2024-09-12T18:10:36.297 INFO:teuthology.orchestra.run.smithi097.stderr: 80650K .......... .......... .......... .......... .......... 86% 276M 0s 2024-09-12T18:10:36.297 INFO:teuthology.orchestra.run.smithi097.stderr: 80700K .......... .......... .......... .......... .......... 86% 376M 0s 2024-09-12T18:10:36.297 INFO:teuthology.orchestra.run.smithi097.stderr: 80750K .......... .......... .......... .......... .......... 86% 262M 0s 2024-09-12T18:10:36.297 INFO:teuthology.orchestra.run.smithi097.stderr: 80800K .......... .......... .......... .......... .......... 87% 307M 0s 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi097.stderr: 80850K .......... .......... .......... .......... .......... 87% 401M 0s 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi097.stderr: 80900K .......... .......... .......... .......... .......... 87% 26.4M 0s 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi097.stderr: 80950K .......... .......... .......... .......... .......... 87% 270M 0s 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi097.stderr: 81000K .......... .......... .......... .......... .......... 87% 378M 0s 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi097.stderr: 81050K .......... .......... .......... .......... .......... 87% 102M 0s 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi097.stderr: 81100K .......... .......... .......... .......... .......... 87% 95.5M 0s 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi097.stderr: 81150K .......... .......... .......... .......... .......... 87% 151M 0s 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi097.stderr: 81200K .......... .......... .......... .......... .......... 87% 278M 0s 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi097.stderr: 81250K .......... .......... .......... .......... .......... 87% 350M 0s 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi097.stderr: 81300K .......... .......... .......... .......... .......... 87% 314M 0s 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi097.stderr: 81350K .......... .......... .......... .......... .......... 87% 256M 0s 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi097.stderr: 81400K .......... .......... .......... .......... .......... 87% 356M 0s 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi097.stderr: 81450K .......... .......... .......... .......... .......... 87% 202M 0s 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi097.stderr: 81500K .......... .......... .......... .......... .......... 87% 206M 0s 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi097.stderr: 81550K .......... .......... .......... .......... .......... 87% 240M 0s 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi097.stderr: 81600K .......... .......... .......... .......... .......... 87% 230M 0s 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi097.stderr: 81650K .......... .......... .......... .......... .......... 87% 232M 0s 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi097.stderr: 81700K .......... .......... .......... .......... .......... 87% 219M 0s 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi097.stderr: 81750K .......... .......... .......... .......... .......... 88% 219M 0s 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi097.stderr: 81800K .......... .......... .......... .......... .......... 88% 226M 0s 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi097.stderr: 81850K .......... .......... .......... .......... .......... 88% 254M 0s 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi097.stderr: 81900K .......... .......... .......... .......... .......... 88% 218M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 81950K .......... .......... .......... .......... .......... 88% 197M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 82000K .......... .......... .......... .......... .......... 88% 189M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 82050K .......... .......... .......... .......... .......... 88% 246M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 82100K .......... .......... .......... .......... .......... 88% 229M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 82150K .......... .......... .......... .......... .......... 88% 213M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 82200K .......... .......... .......... .......... .......... 88% 240M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 82250K .......... .......... .......... .......... .......... 88% 248M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 82300K .......... .......... .......... .......... .......... 88% 225M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 82350K .......... .......... .......... .......... .......... 88% 182M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 82400K .......... .......... .......... .......... .......... 88% 244M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 82450K .......... .......... .......... .......... .......... 88% 232M 0s 2024-09-12T18:10:36.300 INFO:teuthology.orchestra.run.smithi097.stderr: 82500K .......... .......... .......... .......... .......... 88% 230M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 82550K .......... .......... .......... .......... .......... 88% 216M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 82600K .......... .......... .......... .......... .......... 88% 257M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 82650K .......... .......... .......... .......... .......... 89% 237M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 82700K .......... .......... .......... .......... .......... 89% 247M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 82750K .......... .......... .......... .......... .......... 89% 196M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 82800K .......... .......... .......... .......... .......... 89% 227M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 82850K .......... .......... .......... .......... .......... 89% 223M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 82900K .......... .......... .......... .......... .......... 89% 235M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 82950K .......... .......... .......... .......... .......... 89% 220M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 83000K .......... .......... .......... .......... .......... 89% 238M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 83050K .......... .......... .......... .......... .......... 89% 236M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 83100K .......... .......... .......... .......... .......... 89% 256M 0s 2024-09-12T18:10:36.301 INFO:teuthology.orchestra.run.smithi097.stderr: 83150K .......... .......... .......... .......... .......... 89% 204M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83200K .......... .......... .......... .......... .......... 89% 364M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83250K .......... .......... .......... .......... .......... 89% 285M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83300K .......... .......... .......... .......... .......... 89% 382M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83350K .......... .......... .......... .......... .......... 89% 370M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83400K .......... .......... .......... .......... .......... 89% 404M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83450K .......... .......... .......... .......... .......... 89% 415M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83500K .......... .......... .......... .......... .......... 89% 313M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83550K .......... .......... .......... .......... .......... 89% 233M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83600K .......... .......... .......... .......... .......... 90% 292M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83650K .......... .......... .......... .......... .......... 90% 291M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83700K .......... .......... .......... .......... .......... 90% 305M 0s 2024-09-12T18:10:36.302 INFO:teuthology.orchestra.run.smithi097.stderr: 83750K .......... .......... .......... .......... .......... 90% 367M 0s 2024-09-12T18:10:36.303 INFO:teuthology.orchestra.run.smithi097.stderr: 83800K .......... .......... .......... .......... .......... 90% 354M 0s 2024-09-12T18:10:36.303 INFO:teuthology.orchestra.run.smithi097.stderr: 83850K .......... .......... .......... .......... .......... 90% 51.3M 0s 2024-09-12T18:10:36.303 INFO:teuthology.orchestra.run.smithi097.stderr: 83900K .......... .......... .......... .......... .......... 90% 283M 0s 2024-09-12T18:10:36.303 INFO:teuthology.orchestra.run.smithi097.stderr: 83950K .......... .......... .......... .......... .......... 90% 278M 0s 2024-09-12T18:10:36.303 INFO:teuthology.orchestra.run.smithi097.stderr: 84000K .......... .......... .......... .......... .......... 90% 286M 0s 2024-09-12T18:10:36.303 INFO:teuthology.orchestra.run.smithi097.stderr: 84050K .......... .......... .......... .......... .......... 90% 353M 0s 2024-09-12T18:10:36.303 INFO:teuthology.orchestra.run.smithi097.stderr: 84100K .......... .......... .......... .......... .......... 90% 91.0M 0s 2024-09-12T18:10:36.303 INFO:teuthology.orchestra.run.smithi097.stderr: 84150K .......... .......... .......... .......... .......... 90% 152M 0s 2024-09-12T18:10:36.303 INFO:teuthology.orchestra.run.smithi097.stderr: 84200K .......... .......... .......... .......... .......... 90% 325M 0s 2024-09-12T18:10:36.303 INFO:teuthology.orchestra.run.smithi097.stderr: 84250K .......... .......... .......... .......... .......... 90% 313M 0s 2024-09-12T18:10:36.303 INFO:teuthology.orchestra.run.smithi097.stderr: 84300K .......... .......... .......... .......... .......... 90% 302M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84350K .......... .......... .......... .......... .......... 90% 313M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84400K .......... .......... .......... .......... .......... 90% 63.1M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84450K .......... .......... .......... .......... .......... 90% 68.7M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84500K .......... .......... .......... .......... .......... 91% 265M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84550K .......... .......... .......... .......... .......... 91% 322M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84600K .......... .......... .......... .......... .......... 91% 258M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84650K .......... .......... .......... .......... .......... 91% 328M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84700K .......... .......... .......... .......... .......... 91% 375M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84750K .......... .......... .......... .......... .......... 91% 280M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84800K .......... .......... .......... .......... .......... 91% 248M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84850K .......... .......... .......... .......... .......... 91% 316M 0s 2024-09-12T18:10:36.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84900K .......... .......... .......... .......... .......... 91% 269M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 84950K .......... .......... .......... .......... .......... 91% 289M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 85000K .......... .......... .......... .......... .......... 91% 324M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 85050K .......... .......... .......... .......... .......... 91% 210M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 85100K .......... .......... .......... .......... .......... 91% 314M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 85150K .......... .......... .......... .......... .......... 91% 300M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 85200K .......... .......... .......... .......... .......... 91% 296M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 85250K .......... .......... .......... .......... .......... 91% 262M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 85300K .......... .......... .......... .......... .......... 91% 256M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 85350K .......... .......... .......... .......... .......... 91% 291M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 85400K .......... .......... .......... .......... .......... 91% 337M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 85450K .......... .......... .......... .......... .......... 92% 312M 0s 2024-09-12T18:10:36.305 INFO:teuthology.orchestra.run.smithi097.stderr: 85500K .......... .......... .......... .......... .......... 92% 362M 0s 2024-09-12T18:10:36.306 INFO:teuthology.orchestra.run.smithi097.stderr: 85550K .......... .......... .......... .......... .......... 92% 253M 0s 2024-09-12T18:10:36.306 INFO:teuthology.orchestra.run.smithi097.stderr: 85600K .......... .......... .......... .......... .......... 92% 343M 0s 2024-09-12T18:10:36.306 INFO:teuthology.orchestra.run.smithi097.stderr: 85650K .......... .......... .......... .......... .......... 92% 286M 0s 2024-09-12T18:10:36.306 INFO:teuthology.orchestra.run.smithi097.stderr: 85700K .......... .......... .......... .......... .......... 92% 377M 0s 2024-09-12T18:10:36.306 INFO:teuthology.orchestra.run.smithi097.stderr: 85750K .......... .......... .......... .......... .......... 92% 379M 0s 2024-09-12T18:10:36.306 INFO:teuthology.orchestra.run.smithi097.stderr: 85800K .......... .......... .......... .......... .......... 92% 252M 0s 2024-09-12T18:10:36.306 INFO:teuthology.orchestra.run.smithi097.stderr: 85850K .......... .......... .......... .......... .......... 92% 276M 0s 2024-09-12T18:10:36.306 INFO:teuthology.orchestra.run.smithi097.stderr: 85900K .......... .......... .......... .......... .......... 92% 304M 0s 2024-09-12T18:10:36.306 INFO:teuthology.orchestra.run.smithi097.stderr: 85950K .......... .......... .......... .......... .......... 92% 328M 0s 2024-09-12T18:10:36.306 INFO:teuthology.orchestra.run.smithi097.stderr: 86000K .......... .......... .......... .......... .......... 92% 319M 0s 2024-09-12T18:10:36.306 INFO:teuthology.orchestra.run.smithi097.stderr: 86050K .......... .......... .......... .......... .......... 92% 298M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86100K .......... .......... .......... .......... .......... 92% 287M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86150K .......... .......... .......... .......... .......... 92% 302M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86200K .......... .......... .......... .......... .......... 92% 353M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86250K .......... .......... .......... .......... .......... 92% 396M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86300K .......... .......... .......... .......... .......... 92% 393M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86350K .......... .......... .......... .......... .......... 93% 405M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86400K .......... .......... .......... .......... .......... 93% 293M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86450K .......... .......... .......... .......... .......... 93% 348M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86500K .......... .......... .......... .......... .......... 93% 336M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86550K .......... .......... .......... .......... .......... 93% 294M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86600K .......... .......... .......... .......... .......... 93% 404M 0s 2024-09-12T18:10:36.307 INFO:teuthology.orchestra.run.smithi097.stderr: 86650K .......... .......... .......... .......... .......... 93% 338M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 86700K .......... .......... .......... .......... .......... 93% 46.7M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 86750K .......... .......... .......... .......... .......... 93% 317M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 86800K .......... .......... .......... .......... .......... 93% 311M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 86850K .......... .......... .......... .......... .......... 93% 336M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 86900K .......... .......... .......... .......... .......... 93% 307M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 86950K .......... .......... .......... .......... .......... 93% 309M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 87000K .......... .......... .......... .......... .......... 93% 287M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 87050K .......... .......... .......... .......... .......... 93% 347M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 87100K .......... .......... .......... .......... .......... 93% 185M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 87150K .......... .......... .......... .......... .......... 93% 170M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 87200K .......... .......... .......... .......... .......... 93% 100M 0s 2024-09-12T18:10:36.308 INFO:teuthology.orchestra.run.smithi097.stderr: 87250K .......... .......... .......... .......... .......... 93% 116M 0s 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi097.stderr: 87300K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi097.stderr: 87350K .......... .......... .......... .......... .......... 94% 80.5M 0s 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi097.stderr: 87400K .......... .......... .......... .......... .......... 94% 133M 0s 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi097.stderr: 87450K .......... .......... .......... .......... .......... 94% 92.7M 0s 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi097.stderr: 87500K .......... .......... .......... .......... .......... 94% 129M 0s 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi097.stderr: 87550K .......... .......... .......... .......... .......... 94% 275M 0s 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi097.stderr: 87600K .......... .......... .......... .......... .......... 94% 337M 0s 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi097.stderr: 87650K .......... .......... .......... .......... .......... 94% 226M 0s 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi097.stderr: 87700K .......... .......... .......... .......... .......... 94% 287M 0s 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi097.stderr: 87750K .......... .......... .......... .......... .......... 94% 287M 0s 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi097.stderr: 87800K .......... .......... .......... .......... .......... 94% 239M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 87850K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 87900K .......... .......... .......... .......... .......... 94% 338M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 87950K .......... .......... .......... .......... .......... 94% 294M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 88000K .......... .......... .......... .......... .......... 94% 301M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 88050K .......... .......... .......... .......... .......... 94% 253M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 88100K .......... .......... .......... .......... .......... 94% 389M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 88150K .......... .......... .......... .......... .......... 94% 387M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 88200K .......... .......... .......... .......... .......... 94% 304M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 88250K .......... .......... .......... .......... .......... 95% 348M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 88300K .......... .......... .......... .......... .......... 95% 133M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 88350K .......... .......... .......... .......... .......... 95% 298M 0s 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi097.stderr: 88400K .......... .......... .......... .......... .......... 95% 297M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88450K .......... .......... .......... .......... .......... 95% 237M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88500K .......... .......... .......... .......... .......... 95% 245M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88550K .......... .......... .......... .......... .......... 95% 318M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88600K .......... .......... .......... .......... .......... 95% 266M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88650K .......... .......... .......... .......... .......... 95% 328M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88700K .......... .......... .......... .......... .......... 95% 269M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88750K .......... .......... .......... .......... .......... 95% 340M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88800K .......... .......... .......... .......... .......... 95% 260M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88850K .......... .......... .......... .......... .......... 95% 309M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88900K .......... .......... .......... .......... .......... 95% 296M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88950K .......... .......... .......... .......... .......... 95% 372M 0s 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi097.stderr: 89000K .......... .......... .......... .......... .......... 95% 308M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89050K .......... .......... .......... .......... .......... 95% 411M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89100K .......... .......... .......... .......... .......... 95% 365M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89150K .......... .......... .......... .......... .......... 96% 326M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89200K .......... .......... .......... .......... .......... 96% 313M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89250K .......... .......... .......... .......... .......... 96% 293M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89300K .......... .......... .......... .......... .......... 96% 285M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89350K .......... .......... .......... .......... .......... 96% 294M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89400K .......... .......... .......... .......... .......... 96% 296M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89450K .......... .......... .......... .......... .......... 96% 390M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89500K .......... .......... .......... .......... .......... 96% 401M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89550K .......... .......... .......... .......... .......... 96% 415M 0s 2024-09-12T18:10:36.312 INFO:teuthology.orchestra.run.smithi097.stderr: 89600K .......... .......... .......... .......... .......... 96% 365M 0s 2024-09-12T18:10:36.313 INFO:teuthology.orchestra.run.smithi097.stderr: 89650K .......... .......... .......... .......... .......... 96% 232M 0s 2024-09-12T18:10:36.313 INFO:teuthology.orchestra.run.smithi097.stderr: 89700K .......... .......... .......... .......... .......... 96% 339M 0s 2024-09-12T18:10:36.313 INFO:teuthology.orchestra.run.smithi097.stderr: 89750K .......... .......... .......... .......... .......... 96% 130M 0s 2024-09-12T18:10:36.313 INFO:teuthology.orchestra.run.smithi097.stderr: 89800K .......... .......... .......... .......... .......... 96% 328M 0s 2024-09-12T18:10:36.313 INFO:teuthology.orchestra.run.smithi097.stderr: 89850K .......... .......... .......... .......... .......... 96% 279M 0s 2024-09-12T18:10:36.313 INFO:teuthology.orchestra.run.smithi097.stderr: 89900K .......... .......... .......... .......... .......... 96% 408M 0s 2024-09-12T18:10:36.313 INFO:teuthology.orchestra.run.smithi097.stderr: 89950K .......... .......... .......... .......... .......... 96% 199M 0s 2024-09-12T18:10:36.313 INFO:teuthology.orchestra.run.smithi097.stderr: 90000K .......... .......... .......... .......... .......... 96% 223M 0s 2024-09-12T18:10:36.313 INFO:teuthology.orchestra.run.smithi097.stderr: 90050K .......... .......... .......... .......... .......... 96% 279M 0s 2024-09-12T18:10:36.313 INFO:teuthology.orchestra.run.smithi097.stderr: 90100K .......... .......... .......... .......... .......... 97% 298M 0s 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi097.stderr: 90150K .......... .......... .......... .......... .......... 97% 281M 0s 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi097.stderr: 90200K .......... .......... .......... .......... .......... 97% 313M 0s 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi097.stderr: 90250K .......... .......... .......... .......... .......... 97% 139M 0s 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi097.stderr: 90300K .......... .......... .......... .......... .......... 97% 77.4M 0s 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi097.stderr: 90350K .......... .......... .......... .......... .......... 97% 360M 0s 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi097.stderr: 90400K .......... .......... .......... .......... .......... 97% 143M 0s 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi097.stderr: 90450K .......... .......... .......... .......... .......... 97% 64.5M 0s 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi097.stderr: 90500K .......... .......... .......... .......... .......... 97% 175M 0s 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi097.stderr: 90550K .......... .......... .......... .......... .......... 97% 346M 0s 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi097.stderr: 90600K .......... .......... .......... .......... .......... 97% 260M 0s 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi097.stderr: 90650K .......... .......... .......... .......... .......... 97% 238M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 90700K .......... .......... .......... .......... .......... 97% 88.3M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 90750K .......... .......... .......... .......... .......... 97% 277M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 90800K .......... .......... .......... .......... .......... 97% 313M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 90850K .......... .......... .......... .......... .......... 97% 288M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 90900K .......... .......... .......... .......... .......... 97% 279M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 90950K .......... .......... .......... .......... .......... 97% 264M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 91000K .......... .......... .......... .......... .......... 98% 393M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 91050K .......... .......... .......... .......... .......... 98% 266M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 91100K .......... .......... .......... .......... .......... 98% 283M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 91150K .......... .......... .......... .......... .......... 98% 303M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 91200K .......... .......... .......... .......... .......... 98% 136M 0s 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi097.stderr: 91250K .......... .......... .......... .......... .......... 98% 269M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91300K .......... .......... .......... .......... .......... 98% 303M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91350K .......... .......... .......... .......... .......... 98% 264M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91400K .......... .......... .......... .......... .......... 98% 302M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91450K .......... .......... .......... .......... .......... 98% 372M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91500K .......... .......... .......... .......... .......... 98% 399M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91550K .......... .......... .......... .......... .......... 98% 100M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91600K .......... .......... .......... .......... .......... 98% 335M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91650K .......... .......... .......... .......... .......... 98% 333M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91700K .......... .......... .......... .......... .......... 98% 331M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91750K .......... .......... .......... .......... .......... 98% 379M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91800K .......... .......... .......... .......... .......... 98% 396M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91850K .......... .......... .......... .......... .......... 98% 309M 0s 2024-09-12T18:10:36.316 INFO:teuthology.orchestra.run.smithi097.stderr: 91900K .......... .......... .......... .......... .......... 98% 315M 0s 2024-09-12T18:10:36.317 INFO:teuthology.orchestra.run.smithi097.stderr: 91950K .......... .......... .......... .......... .......... 99% 322M 0s 2024-09-12T18:10:36.317 INFO:teuthology.orchestra.run.smithi097.stderr: 92000K .......... .......... .......... .......... .......... 99% 313M 0s 2024-09-12T18:10:36.317 INFO:teuthology.orchestra.run.smithi097.stderr: 92050K .......... .......... .......... .......... .......... 99% 304M 0s 2024-09-12T18:10:36.317 INFO:teuthology.orchestra.run.smithi097.stderr: 92100K .......... .......... .......... .......... .......... 99% 296M 0s 2024-09-12T18:10:36.317 INFO:teuthology.orchestra.run.smithi097.stderr: 92150K .......... .......... .......... .......... .......... 99% 271M 0s 2024-09-12T18:10:36.317 INFO:teuthology.orchestra.run.smithi097.stderr: 92200K .......... .......... .......... .......... .......... 99% 296M 0s 2024-09-12T18:10:36.317 INFO:teuthology.orchestra.run.smithi097.stderr: 92250K .......... .......... .......... .......... .......... 99% 282M 0s 2024-09-12T18:10:36.317 INFO:teuthology.orchestra.run.smithi097.stderr: 92300K .......... .......... .......... .......... .......... 99% 250M 0s 2024-09-12T18:10:36.317 INFO:teuthology.orchestra.run.smithi097.stderr: 92350K .......... .......... .......... .......... .......... 99% 308M 0s 2024-09-12T18:10:36.317 INFO:teuthology.orchestra.run.smithi097.stderr: 92400K .......... .......... .......... .......... .......... 99% 332M 0s 2024-09-12T18:10:36.317 INFO:teuthology.orchestra.run.smithi097.stderr: 92450K .......... .......... .......... .......... .......... 99% 283M 0s 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr: 92500K .......... .......... .......... .......... .......... 99% 287M 0s 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr: 92550K .......... .......... .......... .......... .......... 99% 327M 0s 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr: 92600K .......... .......... .......... .......... .......... 99% 340M 0s 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr: 92650K .......... .......... .......... .......... .......... 99% 377M 0s 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr: 92700K .......... .......... .......... .......... .......... 99% 285M 0s 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr: 92750K .......... .......... .......... .......... .......... 99% 276M 0s 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr: 92800K .......... .......... .......... .......... .......... 99% 242M 0s 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr: 92850K .......... .......... .......... .......... .......... 99% 148M 0s 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr: 92900K 100% 2.74M=0.5s 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12 18:10:35 (185 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T18:10:36.318 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T18:10:36.348 INFO:teuthology.orchestra.run.smithi097.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T18:10:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T18:10:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T18:10:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T18:10:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T18:10:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T18:10:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T18:10:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T18:10:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T18:10:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T18:10:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T18:10:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T18:10:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T18:10:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T18:10:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T18:10:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T18:10:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T18:10:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T18:10:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T18:10:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T18:10:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T18:10:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T18:10:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T18:10:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T18:10:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T18:10:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T18:10:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T18:10:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T18:10:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T18:10:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T18:10:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T18:10:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T18:10:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T18:10:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T18:10:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T18:10:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T18:10:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T18:10:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T18:10:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T18:10:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T18:10:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T18:10:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T18:10:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T18:10:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T18:10:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T18:10:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T18:10:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T18:10:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T18:10:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T18:10:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T18:10:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T18:10:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T18:10:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T18:10:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T18:10:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T18:10:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T18:10:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T18:10:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T18:10:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T18:10:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T18:10:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T18:10:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T18:10:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T18:10:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T18:10:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T18:10:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T18:10:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T18:10:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T18:10:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T18:10:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T18:10:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T18:10:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T18:10:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T18:10:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T18:10:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T18:10:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T18:10:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T18:10:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T18:10:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T18:10:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T18:10:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T18:10:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T18:10:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T18:10:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T18:10:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T18:10:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T18:10:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T18:10:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T18:10:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T18:10:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T18:10:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T18:10:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T18:10:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T18:10:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T18:10:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T18:10:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T18:10:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T18:10:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T18:10:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T18:10:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T18:10:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T18:10:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T18:10:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T18:10:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T18:10:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T18:10:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T18:10:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T18:10:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T18:10:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T18:10:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T18:10:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T18:10:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T18:10:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T18:10:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T18:10:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T18:10:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T18:10:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T18:10:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T18:10:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T18:10:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T18:10:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T18:10:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T18:10:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T18:10:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T18:10:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T18:10:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T18:10:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T18:10:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T18:10:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T18:10:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T18:10:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T18:10:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T18:10:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T18:10:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T18:10:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T18:10:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T18:10:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T18:10:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T18:10:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T18:10:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T18:10:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T18:10:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T18:10:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T18:10:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T18:10:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T18:10:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T18:10:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T18:10:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T18:10:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T18:10:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T18:10:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T18:10:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T18:10:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T18:10:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T18:10:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T18:10:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T18:10:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T18:10:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T18:10:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T18:10:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T18:10:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T18:10:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T18:10:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T18:10:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T18:10:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T18:10:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T18:10:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T18:10:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T18:10:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T18:10:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T18:10:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T18:10:36.369 INFO:teuthology.orchestra.run.smithi097.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T18:10:36.559 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:10:36.559 INFO:teuthology.orchestra.run.smithi097.stdout:Welcome to Gradle 6.0.1! 2024-09-12T18:10:36.559 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:10:36.559 INFO:teuthology.orchestra.run.smithi097.stdout:Here are the highlights of this release: 2024-09-12T18:10:36.559 INFO:teuthology.orchestra.run.smithi097.stdout: - Substantial improvements in dependency management, including 2024-09-12T18:10:36.559 INFO:teuthology.orchestra.run.smithi097.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T18:10:36.559 INFO:teuthology.orchestra.run.smithi097.stdout: - Advanced control of transitive versions 2024-09-12T18:10:36.559 INFO:teuthology.orchestra.run.smithi097.stdout: - Support for optional features and dependencies 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout: - Rules to tweak published metadata 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout: - Support for Java 13 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout: - New Zinc compiler for Scala 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout: - VS2019 support 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout:------------------------------------------------------------ 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout:Gradle 6.0.1 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi097.stdout:------------------------------------------------------------ 2024-09-12T18:10:36.561 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:10:36.561 INFO:teuthology.orchestra.run.smithi097.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T18:10:36.561 INFO:teuthology.orchestra.run.smithi097.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T18:10:36.561 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:10:36.561 INFO:teuthology.orchestra.run.smithi097.stdout:Kotlin: 1.3.50 2024-09-12T18:10:36.561 INFO:teuthology.orchestra.run.smithi097.stdout:Groovy: 2.5.8 2024-09-12T18:10:36.561 INFO:teuthology.orchestra.run.smithi097.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T18:10:36.561 INFO:teuthology.orchestra.run.smithi097.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T18:10:36.561 INFO:teuthology.orchestra.run.smithi097.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T18:10:36.561 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:10:36.576 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T18:10:36.576 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T18:10:36.576 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T18:10:36.577 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T18:10:36.577 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T18:10:36.577 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T18:10:36.753 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T18:10:36.753 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T18:10:36.754 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'KQORFSLZHORDRXRBNCNJ', 'access_secret': 'y12mXv+gfzabmANKEhMX3hdFPEHMnHU2CTqxwcERrk82rt52t/Y6LQ==', 'region': 'mexico', 'endpoint': 'smithi097.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi097.front.sepia.ceph.com'} 2024-09-12T18:10:36.754 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T18:10:36.754 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'KQORFSLZHORDRXRBNCNJ', '--secret', 'y12mXv+gfzabmANKEhMX3hdFPEHMnHU2CTqxwcERrk82rt52t/Y6LQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T18:10:36.754 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key KQORFSLZHORDRXRBNCNJ --secret y12mXv+gfzabmANKEhMX3hdFPEHMnHU2CTqxwcERrk82rt52t/Y6LQ== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T18:10:36.797 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:36.798 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:37.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.029+0000 7f25eb0f0640 0 --2- 172.21.15.97:0/3487302508 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563c58f81d30 0x563c58f82150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:10:37.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.041+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.045+0000 7f25ed5ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.045+0000 7f25ed5ea9c0 20 realm 2024-09-12T18:10:37.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.045+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.045+0000 7f25ed5ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.045+0000 7f25ed5ea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:37.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.045+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.045+0000 7f25ed5ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.045+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.049+0000 7f25ed5ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:37.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.049+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.049+0000 7f25ed5ea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:37.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.049+0000 7f25ed5ea9c0 20 searching for the correct realm 2024-09-12T18:10:37.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.053+0000 7f25ea8ef640 0 -- 172.21.15.97:0/2893092101 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x563c58facf00 msgr2=0x563c58faf2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.061+0000 7f25eb0f0640 0 -- 172.21.15.97:0/2893092101 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f25dc02b400 msgr2=0x7f25dc02b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:10:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:10:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 zone default found 2024-09-12T18:10:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 4 Realm: () 2024-09-12T18:10:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:10:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:10:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 zonegroup default 2024-09-12T18:10:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.281+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.285+0000 7f25ed5ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.285+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.285+0000 7f25ed5ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.285+0000 7f25ed5ea9c0 20 started sync module instance, tier type = 2024-09-12T18:10:37.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.285+0000 7f25ed5ea9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:10:37.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.313+0000 7f25ed5ea9c0 20 add_watcher() i=0 2024-09-12T18:10:37.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.313+0000 7f25ed5ea9c0 20 add_watcher() i=1 2024-09-12T18:10:37.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.313+0000 7f25ed5ea9c0 20 add_watcher() i=2 2024-09-12T18:10:37.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.313+0000 7f25ed5ea9c0 20 add_watcher() i=3 2024-09-12T18:10:37.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.313+0000 7f25ed5ea9c0 20 add_watcher() i=4 2024-09-12T18:10:37.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.313+0000 7f25ed5ea9c0 20 add_watcher() i=5 2024-09-12T18:10:37.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.313+0000 7f25ed5ea9c0 20 add_watcher() i=6 2024-09-12T18:10:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.317+0000 7f25ed5ea9c0 20 add_watcher() i=7 2024-09-12T18:10:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.317+0000 7f25ed5ea9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:37.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.321+0000 7f24a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:37.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.321+0000 7f25ed5ea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:37.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.321+0000 7f25ed5ea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:37.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.321+0000 7f25ed5ea9c0 5 note: GC not initialized 2024-09-12T18:10:37.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.321+0000 7f24a0fe1640 20 reqs_thread_entry: start 2024-09-12T18:10:37.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.321+0000 7f25ed5ea9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:10:37.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.321+0000 7f25ed5ea9c0 20 Filter name: none 2024-09-12T18:10:37.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.321+0000 7f241a7fc640 20 reqs_thread_entry: start 2024-09-12T18:10:37.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.321+0000 7f25ed5ea9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:10:37.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.321+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T18:10:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:10:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T18:10:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T18:10:37.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:10:37.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 10 cache get: name=default.rgw.meta+users.keys+KQORFSLZHORDRXRBNCNJ : miss 2024-09-12T18:10:37.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 10 cache put: name=default.rgw.meta+users.keys+KQORFSLZHORDRXRBNCNJ info.flags=0x0 2024-09-12T18:10:37.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 10 adding default.rgw.meta+users.keys+KQORFSLZHORDRXRBNCNJ to cache LRU end 2024-09-12T18:10:37.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 10 cache get: name=default.rgw.meta+users.keys+KQORFSLZHORDRXRBNCNJ : hit (negative entry) 2024-09-12T18:10:37.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.325+0000 7f25ed5ea9c0 10 cache get: name=default.rgw.meta+users.keys+KQORFSLZHORDRXRBNCNJ : hit (negative entry) 2024-09-12T18:10:37.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.329+0000 7f25ed5ea9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T18:10:37.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.329+0000 7f25ed5ea9c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:10:37.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.329+0000 7f25ed5ea9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:10:37.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.329+0000 7f24ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431659 cookie 94817190893680 notifier 8225 bl.length()=670 2024-09-12T18:10:37.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.329+0000 7f24ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T18:10:37.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.329+0000 7f24ceffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:10:37.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.333+0000 7f25ed5ea9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T18:10:37.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.333+0000 7f25ed5ea9c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:10:37.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.333+0000 7f25ed5ea9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:10:37.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.333+0000 7f24ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 94817190885520 notifier 8225 bl.length()=200 2024-09-12T18:10:37.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.333+0000 7f24ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T18:10:37.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.333+0000 7f24ce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:10:37.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.341+0000 7f25ed5ea9c0 10 cache put: name=default.rgw.meta+users.keys+KQORFSLZHORDRXRBNCNJ info.flags=0x7 2024-09-12T18:10:37.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.341+0000 7f25ed5ea9c0 10 moving default.rgw.meta+users.keys+KQORFSLZHORDRXRBNCNJ to cache LRU end 2024-09-12T18:10:37.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.341+0000 7f25ed5ea9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:KQORFSLZHORDRXRBNCNJ, ofs0, ns] 2024-09-12T18:10:37.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.341+0000 7f24ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431660 cookie 94817190883024 notifier 8225 bl.length()=189 2024-09-12T18:10:37.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.341+0000 7f24ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KQORFSLZHORDRXRBNCNJ info.flags=0x7 2024-09-12T18:10:37.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.341+0000 7f24ce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KQORFSLZHORDRXRBNCNJ to cache LRU end 2024-09-12T18:10:37.345 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:10:37.346 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "tester.client.0", 2024-09-12T18:10:37.346 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T18:10:37.346 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T18:10:37.346 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-12T18:10:37.346 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:10:37.346 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-12T18:10:37.346 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-12T18:10:37.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T18:10:37.346 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "tester.client.0", 2024-09-12T18:10:37.346 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "KQORFSLZHORDRXRBNCNJ", 2024-09-12T18:10:37.346 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "y12mXv+gfzabmANKEhMX3hdFPEHMnHU2CTqxwcERrk82rt52t/Y6LQ==", 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:10:37.329495Z" 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:10:37.347 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-12T18:10:37.349 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-12T18:10:37.349 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-12T18:10:37.349 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-12T18:10:37.349 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-12T18:10:37.349 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:10:37.329438Z", 2024-09-12T18:10:37.349 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-12T18:10:37.349 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-12T18:10:37.349 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:10:37.349 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:10:37.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.345+0000 7f24a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:37.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.349+0000 7f25ed5ea9c0 20 remove_watcher() i=0 2024-09-12T18:10:37.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.349+0000 7f25ed5ea9c0 2 removed watcher, disabling cache 2024-09-12T18:10:37.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.349+0000 7f25ed5ea9c0 20 remove_watcher() i=1 2024-09-12T18:10:37.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.353+0000 7f25ed5ea9c0 20 remove_watcher() i=2 2024-09-12T18:10:37.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.353+0000 7f25ed5ea9c0 20 remove_watcher() i=3 2024-09-12T18:10:37.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.357+0000 7f25ed5ea9c0 20 remove_watcher() i=4 2024-09-12T18:10:37.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.361+0000 7f25ed5ea9c0 20 remove_watcher() i=5 2024-09-12T18:10:37.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.361+0000 7f25ed5ea9c0 20 remove_watcher() i=6 2024-09-12T18:10:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.365+0000 7f25ed5ea9c0 20 remove_watcher() i=7 2024-09-12T18:10:37.384 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T18:10:37.384 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T18:10:37.434 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T18:10:37.434 DEBUG:teuthology.orchestra.run.smithi097:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T18:10:37.479 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:10:37.553 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:37.553 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:37.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.597+0000 7ffbe51759c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.597+0000 7ffbe51759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.597+0000 7ffbe51759c0 20 realm 2024-09-12T18:10:37.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.597+0000 7ffbe51759c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.597+0000 7ffbe51759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.597+0000 7ffbe51759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:37.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.597+0000 7ffbe51759c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.601+0000 7ffbe51759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.601+0000 7ffbe51759c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.601+0000 7ffbe51759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:37.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.601+0000 7ffbe51759c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.601+0000 7ffbe51759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:37.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.601+0000 7ffbe51759c0 20 searching for the correct realm 2024-09-12T18:10:37.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.609+0000 7ffbe347c640 0 -- 172.21.15.97:0/330315323 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7ffbcc0f6940 msgr2=0x7ffbcc111130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:37.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.613+0000 7ffbe2c7b640 0 -- 172.21.15.97:0/330315323 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7ffbdc026040 msgr2=0x7ffbdc026420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:37.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:10:37.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:37.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:37.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:10:37.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:37.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:37.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:37.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:37.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 zone default found 2024-09-12T18:10:37.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 4 Realm: () 2024-09-12T18:10:37.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:10:37.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:10:37.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:37.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 zonegroup default 2024-09-12T18:10:37.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.621+0000 7ffbe51759c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.625+0000 7ffbe51759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.625+0000 7ffbe51759c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.625+0000 7ffbe51759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.625+0000 7ffbe51759c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:37.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.625+0000 7ffbe51759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:37.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.625+0000 7ffbe51759c0 20 started sync module instance, tier type = 2024-09-12T18:10:37.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.625+0000 7ffbe51759c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:10:37.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.641+0000 7ffbe51759c0 20 add_watcher() i=0 2024-09-12T18:10:37.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.641+0000 7ffbe51759c0 20 add_watcher() i=1 2024-09-12T18:10:37.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.641+0000 7ffbe51759c0 20 add_watcher() i=2 2024-09-12T18:10:37.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.641+0000 7ffbe51759c0 20 add_watcher() i=3 2024-09-12T18:10:37.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.641+0000 7ffbe51759c0 20 add_watcher() i=4 2024-09-12T18:10:37.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.641+0000 7ffbe51759c0 20 add_watcher() i=5 2024-09-12T18:10:37.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.641+0000 7ffbe51759c0 20 add_watcher() i=6 2024-09-12T18:10:37.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.645+0000 7ffbe51759c0 20 add_watcher() i=7 2024-09-12T18:10:37.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.645+0000 7ffbe51759c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.649+0000 7ffa997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.649+0000 7ffbe51759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.649+0000 7ffbe51759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:37.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.725+0000 7ffa13fff640 20 reqs_thread_entry: start 2024-09-12T18:10:37.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.725+0000 7ffbe51759c0 20 init_complete bucket index max shards: 11 2024-09-12T18:10:37.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.725+0000 7ffbe51759c0 20 Filter name: none 2024-09-12T18:10:37.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.725+0000 7ffa11ffb640 20 reqs_thread_entry: start 2024-09-12T18:10:37.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.725+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:10:37.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.729+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:10:37.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1517708971735421491', time=2024-09-12T20:02:17.348970+0000, chain.objs.size()=1 2024-09-12T18:10:37.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.Do4lRnJ5Qr8H4pZifDUyaZBuFo1SzKX_0 2024-09-12T18:10:37.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6326748291072740202', time=2024-09-12T20:03:39.455739+0000, chain.objs.size()=1 2024-09-12T18:10:37.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.udyIuL8p1uwuF-zH_2xZyScrRO2I5w4_0 2024-09-12T18:10:37.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1141171484331932626', time=2024-09-12T20:03:48.102052+0000, chain.objs.size()=1 2024-09-12T18:10:37.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.HB7cf8cqo1-6S2xzmBOFW-repYY2UCz_0 2024-09-12T18:10:37.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12707549739785904878', time=2024-09-12T20:05:07.534725+0000, chain.objs.size()=1 2024-09-12T18:10:37.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.s6_Llr25hc3JMCOBYK9Qs-sjmvuCh3J_0 2024-09-12T18:10:37.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14859681075779599867', time=2024-09-12T20:05:46.137881+0000, chain.objs.size()=1 2024-09-12T18:10:37.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.oZXO3o-TOu7zZFGJbRXFdsIzNUTQEXa_0 2024-09-12T18:10:37.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.249053259766279810', time=2024-09-12T20:07:13.441258+0000, chain.objs.size()=1 2024-09-12T18:10:37.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.iioF7z-dxZBPOYrW9ZGhK-gQ55bkRT5_0 2024-09-12T18:10:37.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12658882539051929154', time=2024-09-12T20:07:13.674578+0000, chain.objs.size()=1 2024-09-12T18:10:37.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.bkaUzKbHSjj72oJr4EcfTikgTBu0rtU_0 2024-09-12T18:10:37.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16040756384878898376', time=2024-09-12T20:07:49.160763+0000, chain.objs.size()=1 2024-09-12T18:10:37.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.733+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.SAKUGmMn5DXw11iKHDACb_sdF8UWuQC_0 2024-09-12T18:10:37.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.737+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.741+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:10:37.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.741+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:10:37.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12759214183279829391', time=2024-09-12T20:00:32.431619+0000, chain.objs.size()=1 2024-09-12T18:10:37.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.EIkuYrz-LQdeGFrO7THNnW53ZQITD5h_0 2024-09-12T18:10:37.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5847837060457983957', time=2024-09-12T20:00:32.826458+0000, chain.objs.size()=2 2024-09-12T18:10:37.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.eoeNus6Pd1HnLn4x978F68A_9rTD3S-_0 2024-09-12T18:10:37.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.eoeNus6Pd1HnLn4x978F68A_9rTD3S-_1 2024-09-12T18:10:37.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_D7npmfD37pMKGxxoHgp35H1MTTIH530', time=2024-09-12T20:00:32.908881+0000, chain.objs.size()=1 2024-09-12T18:10:37.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.Czeiu0jqtgsF9-sc3Nr8ysv00LKb4Bp_0 2024-09-12T18:10:37.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16755739750420868269', time=2024-09-12T20:02:24.326286+0000, chain.objs.size()=1 2024-09-12T18:10:37.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.ZTXzJtIVCHM7houBJ-8_CDnXgAtrjtf_0 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12814200807827229317', time=2024-09-12T20:02:59.485182+0000, chain.objs.size()=1 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.jgAr78zC5WEN-SB8wEJLk0PuKdSk8T6_0 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4135051879180652809', time=2024-09-12T20:03:00.350677+0000, chain.objs.size()=1 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.cFh7hYSHDxhCvIU_SrjoieGpvJ4Wm8a_0 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1103415890167855211', time=2024-09-12T20:03:04.342244+0000, chain.objs.size()=1 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.GRnSM9TkgzKboW-vTH7IjHd39u6dMVw_0 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4365272575740677274', time=2024-09-12T20:03:07.903148+0000, chain.objs.size()=1 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.QI0mrH4zSgkyb8Kog5oLrtjuiDyTihW_0 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9788370143904376827', time=2024-09-12T20:03:39.410480+0000, chain.objs.size()=1 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.4-P7Hgmu3rHysTbTx_3g1R-GGZtH2oK_0 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1446077713278428846', time=2024-09-12T20:03:43.208749+0000, chain.objs.size()=1 2024-09-12T18:10:37.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.p-HnW7J8NSRB3nTXEZkzy4WGWeHwY0-_0 2024-09-12T18:10:37.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14397138280451140587', time=2024-09-12T20:03:47.893144+0000, chain.objs.size()=1 2024-09-12T18:10:37.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.745+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.LG6MlhMOx7EXmS2_G6wduWZ2CICw9Jo_0 2024-09-12T18:10:37.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10352311148150771024', time=2024-09-12T20:04:23.236950+0000, chain.objs.size()=1 2024-09-12T18:10:37.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.Jxz8BaUsf0jTiDr94nLoEktTzW0V2O3_0 2024-09-12T18:10:37.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1885135999854052137', time=2024-09-12T20:05:50.756649+0000, chain.objs.size()=1 2024-09-12T18:10:37.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.VK5OrONxcG_8M5kTYG2yW7pVjhsBjTC_0 2024-09-12T18:10:37.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12666649395350763010', time=2024-09-12T20:05:50.849631+0000, chain.objs.size()=1 2024-09-12T18:10:37.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.BMmdzE0p_VAnNSEluJxYMKVB7lwYDS0_0 2024-09-12T18:10:37.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3320378615561204899', time=2024-09-12T20:06:25.430259+0000, chain.objs.size()=1 2024-09-12T18:10:37.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.n01LGxo_h8tn1ejNVUjAHN9ttdCTGYN_0 2024-09-12T18:10:37.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9504858972342327191', time=2024-09-12T20:06:29.795878+0000, chain.objs.size()=1 2024-09-12T18:10:37.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.H-hyvJl9l5K5LH-SgnYGCGTjPwr-OZP_0 2024-09-12T18:10:37.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3413405983677866098', time=2024-09-12T20:06:29.919231+0000, chain.objs.size()=1 2024-09-12T18:10:37.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.749+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.8k996UZIJDYwtbpM619I55lm9AGayDk_0 2024-09-12T18:10:37.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.753+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.757+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:10:37.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.761+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.761+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:10:37.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6035023091340012167', time=2024-09-12T20:00:32.846850+0000, chain.objs.size()=2 2024-09-12T18:10:37.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.eoeNus6Pd1HnLn4x978F68A_9rTD3S-_0 2024-09-12T18:10:37.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.eoeNus6Pd1HnLn4x978F68A_9rTD3S-_1 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.437005142997409563', time=2024-09-12T20:02:20.981968+0000, chain.objs.size()=1 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.6Tp8VZfHKwwPD_M2a3ra1zXLp3baKZ__0 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14007642096703316692', time=2024-09-12T20:02:21.264260+0000, chain.objs.size()=1 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.QbLJj-VqSWHbXJR3R-aQz0XqUr95aMP_0 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4333482690590393625', time=2024-09-12T20:03:00.326726+0000, chain.objs.size()=1 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.aQaHV9gc42h5MyI8ivUmpCZ6aWSlK3p_0 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12693464269281317601', time=2024-09-12T20:03:00.328634+0000, chain.objs.size()=1 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.IZgqg7a9tT5ttz1seSRc0_p1ztMlVvD_0 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7241395695929642015', time=2024-09-12T20:03:39.449701+0000, chain.objs.size()=1 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.44cpyBeqAcCg6VX0sEFwT3hwRrpV5Nq_0 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13529127777859802977', time=2024-09-12T20:03:39.451416+0000, chain.objs.size()=1 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.-tObdkBVEEgjCmz7BHxzeZQLFUQ1IWv_0 2024-09-12T18:10:37.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2425442256215918465', time=2024-09-12T20:03:47.979260+0000, chain.objs.size()=1 2024-09-12T18:10:37.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.gfpAAUqP82rHoMwge837L9-cSpAt4nB_0 2024-09-12T18:10:37.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5709480145401586312', time=2024-09-12T20:04:23.462951+0000, chain.objs.size()=1 2024-09-12T18:10:37.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.G3WlgVn60geJR5dWHFrgt2CPR7Ya-oF_0 2024-09-12T18:10:37.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7117543552988830768', time=2024-09-12T20:05:07.475604+0000, chain.objs.size()=1 2024-09-12T18:10:37.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.Dnl5beNKUmLjGUl4OpRL39_vikHyw70_0 2024-09-12T18:10:37.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10130168291725197057', time=2024-09-12T20:05:11.269617+0000, chain.objs.size()=1 2024-09-12T18:10:37.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.765+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.jdfOdfQ3YQqIVuReCECfXz7_xRKI9F3_0 2024-09-12T18:10:37.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1880760510630804801', time=2024-09-12T20:05:50.727941+0000, chain.objs.size()=1 2024-09-12T18:10:37.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.89nAc3en6H1kTKf9ESEvMM-syuI3D1s_0 2024-09-12T18:10:37.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5187129758808492644', time=2024-09-12T20:05:50.778054+0000, chain.objs.size()=1 2024-09-12T18:10:37.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.8MxcOUOJrnDXKaZGR-8xGGqk58cb1Te_0 2024-09-12T18:10:37.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14158356300602153105', time=2024-09-12T20:05:50.850249+0000, chain.objs.size()=1 2024-09-12T18:10:37.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.lg-6mvqmK4cRABMuYapKBoHZrCE56e8_0 2024-09-12T18:10:37.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9865008900967968320', time=2024-09-12T20:06:29.797373+0000, chain.objs.size()=1 2024-09-12T18:10:37.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.85nlEPNGXi9f7xmbuj_myMd3pbdJF7U_0 2024-09-12T18:10:37.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13770220835418930370', time=2024-09-12T20:06:29.904799+0000, chain.objs.size()=1 2024-09-12T18:10:37.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.LSBDSLJKir-nZTd7xbVFYEOyoj_9tEV_0 2024-09-12T18:10:37.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11004310120712764245', time=2024-09-12T20:06:29.990978+0000, chain.objs.size()=1 2024-09-12T18:10:37.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.JuUIhAoxetIyzmLYMzamRdDnC6GDvZr_0 2024-09-12T18:10:37.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6126969478596080891', time=2024-09-12T20:07:09.216390+0000, chain.objs.size()=1 2024-09-12T18:10:37.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.9h2RD7ym3mllQ4dUjqvJ_H5JsHe4HYw_0 2024-09-12T18:10:37.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3796962103862305953', time=2024-09-12T20:07:13.541611+0000, chain.objs.size()=1 2024-09-12T18:10:37.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.z0H2xkR3_zHT4w2lNJ8NYFcrYRX8laU_0 2024-09-12T18:10:37.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17377680414692925737', time=2024-09-12T20:07:49.014624+0000, chain.objs.size()=1 2024-09-12T18:10:37.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.oe3n8lvVeI-cGQqHjuxsbzuAgyAY9Ns_0 2024-09-12T18:10:37.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10622241550469713343', time=2024-09-12T20:07:49.163394+0000, chain.objs.size()=1 2024-09-12T18:10:37.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.769+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.yD1UHzy5IK-gf57GbQ1y2MfhTHoWBBO_0 2024-09-12T18:10:37.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.773+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.781+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:10:37.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:10:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6970860529565595395', time=2024-09-12T20:03:00.463344+0000, chain.objs.size()=1 2024-09-12T18:10:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.T-3rr-QMS4Bc-IBhU-NEk3CnWVkvePp_0 2024-09-12T18:10:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13340326925422021963', time=2024-09-12T20:03:04.514704+0000, chain.objs.size()=1 2024-09-12T18:10:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.RQIbTjUHdSxy8aQf8Eq2qqhT1zwPTGG_0 2024-09-12T18:10:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3193212097731048088', time=2024-09-12T20:03:04.516506+0000, chain.objs.size()=1 2024-09-12T18:10:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.5jrrXdZOerewPRUjnDd6FRFo82pQ_nb_0 2024-09-12T18:10:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.914820471918442695', time=2024-09-12T20:05:02.868419+0000, chain.objs.size()=1 2024-09-12T18:10:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.MC1I6uHDGOTmk1IOpnxOyv7gpwVmv8T_0 2024-09-12T18:10:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.952994815785886004', time=2024-09-12T20:05:11.341528+0000, chain.objs.size()=1 2024-09-12T18:10:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.XPNrBdBRZBk0J_83ePc0tXuapzC5e_m_0 2024-09-12T18:10:37.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14681280422006322483', time=2024-09-12T20:05:46.057904+0000, chain.objs.size()=1 2024-09-12T18:10:37.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.D8gHPK_WTrcf_gzAtTh3Sf0BzecaISR_0 2024-09-12T18:10:37.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1098184317068972631', time=2024-09-12T20:07:13.498105+0000, chain.objs.size()=1 2024-09-12T18:10:37.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.ISKse2zkuEDOtjrP2iBSHhqWXMlkrGl_0 2024-09-12T18:10:37.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5393890713738405569', time=2024-09-12T20:09:57.426764+0000, chain.objs.size()=1 2024-09-12T18:10:37.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.785+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.ZnBQRJsdo-jmLIvy--xHxlwLuc3SU5o_0 2024-09-12T18:10:37.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.793+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.797+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:10:37.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:10:37.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3864431225118573165', time=2024-09-12T20:02:17.198613+0000, chain.objs.size()=1 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.YuhP_sO7GvihQE-xdBm6dV30GZBzrgy_0 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18367273929641283131', time=2024-09-12T20:03:04.440063+0000, chain.objs.size()=1 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.-0XADz0TOAAmJ0NsB4SXzzaSpjXKIRN_0 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1444044077594313364', time=2024-09-12T20:03:04.592464+0000, chain.objs.size()=1 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.qrpEFDHd7ippxWUDzHW0Zh4uDj0xTwN_0 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8380856975325718195', time=2024-09-12T20:03:04.601734+0000, chain.objs.size()=1 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.HwbBiIfhcFiA8g77fRUlNV5qluvi9ys_0 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2628305222943343122', time=2024-09-12T20:04:23.309843+0000, chain.objs.size()=1 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.x-cuPfmRzEF0CbOdu9CebyqaEvxcU7Y_0 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.967969864730673966', time=2024-09-12T20:05:07.487864+0000, chain.objs.size()=1 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.TAx_FwIugp8aj3L2nhqdoVR_6QucmW1_0 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10388900409048751479', time=2024-09-12T20:05:07.657918+0000, chain.objs.size()=1 2024-09-12T18:10:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.7qoqjfWUtmlB9H36xcQ4rhmeNoC0Ad5_0 2024-09-12T18:10:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3959415556710659581', time=2024-09-12T20:05:11.491569+0000, chain.objs.size()=1 2024-09-12T18:10:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.jyioaZUrBMD_qmPOFyGF4iQ-jvfZj6t_0 2024-09-12T18:10:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7470239730881685441', time=2024-09-12T20:05:46.115488+0000, chain.objs.size()=1 2024-09-12T18:10:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.pvYIHpm0byFSmgR2om03PMDivhxj0e4_0 2024-09-12T18:10:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14864428327396284651', time=2024-09-12T20:05:46.161411+0000, chain.objs.size()=1 2024-09-12T18:10:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.S9HHaNMBSnOZQ-HQZE-tNwUfqy6tSPI_0 2024-09-12T18:10:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12682772023440208689', time=2024-09-12T20:06:25.581462+0000, chain.objs.size()=1 2024-09-12T18:10:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.qCgKB1p8TwS-cgQ0VQgbF-gNz0IRfjM_0 2024-09-12T18:10:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8216804171514891981', time=2024-09-12T20:06:29.812937+0000, chain.objs.size()=1 2024-09-12T18:10:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.801+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.ND7RrwJgXc2LPz4kEKPVPz1DcsrmEFP_0 2024-09-12T18:10:37.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.805+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16035698785086731038', time=2024-09-12T20:07:09.101313+0000, chain.objs.size()=1 2024-09-12T18:10:37.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.805+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.HrmjeE3WLMVL0n0UJMrYjb6ZAM-MbLz_0 2024-09-12T18:10:37.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.805+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4721175555930219448', time=2024-09-12T20:07:13.445818+0000, chain.objs.size()=1 2024-09-12T18:10:37.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.805+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.m16aJ9HBHNktF9tYyDA5pnd299Z1paK_0 2024-09-12T18:10:37.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.805+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13236325583027306429', time=2024-09-12T20:07:13.702786+0000, chain.objs.size()=1 2024-09-12T18:10:37.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.805+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.OtR7vkdjyZouRXJhanQAseDaOOQBHcW_0 2024-09-12T18:10:37.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.805+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1799517832573263103', time=2024-09-12T20:07:49.079216+0000, chain.objs.size()=1 2024-09-12T18:10:37.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.805+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.TxGKe5O-_4RU8ntlPfG6rWnvD1hXLBB_0 2024-09-12T18:10:37.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.809+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.813+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:10:37.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.817+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.817+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:10:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_nwptZiKTkNufOaV78HoJF6fzY87vWwI', time=2024-09-12T20:00:32.770094+0000, chain.objs.size()=1 2024-09-12T18:10:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.v239cspShSFjEHzzIJqVjX4yJ17AGUu_0 2024-09-12T18:10:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6778653752146673780', time=2024-09-12T20:00:32.956612+0000, chain.objs.size()=3 2024-09-12T18:10:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.1 2024-09-12T18:10:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.2 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.3 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8616589311256220041', time=2024-09-12T20:00:33.063504+0000, chain.objs.size()=3 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-STANDARD.2~nUS9yQ6U01BoZ4ypgnGftAvL1ftZ_z3.1 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-STANDARD.2~nUS9yQ6U01BoZ4ypgnGftAvL1ftZ_z3.2 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-STANDARD.2~nUS9yQ6U01BoZ4ypgnGftAvL1ftZ_z3.3 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16354983324142086974', time=2024-09-12T20:02:21.186519+0000, chain.objs.size()=1 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.hzTtQP7jfDjSJZf3S5JXKqmHtl0LjTX_0 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1002597375374719467', time=2024-09-12T20:03:00.415287+0000, chain.objs.size()=1 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.WHs3e9LLBttN2BVoMAj116xKtjVMazD_0 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8244181600369147158', time=2024-09-12T20:03:44.200496+0000, chain.objs.size()=1 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.PL0HaTr9o3ytq-F6xOxBSONfZ-HqB93_0 2024-09-12T18:10:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3115567481520210513', time=2024-09-12T20:03:44.202681+0000, chain.objs.size()=1 2024-09-12T18:10:37.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.Mnvkv1njUqzyFtMkVLhMp0damZmimUa_0 2024-09-12T18:10:37.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15971018008483813428', time=2024-09-12T20:03:44.279563+0000, chain.objs.size()=1 2024-09-12T18:10:37.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.821+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.7C0WTWp_6CCc-lshC-HEectQB5gp9fa_0 2024-09-12T18:10:37.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12657135717085848605', time=2024-09-12T20:03:44.359746+0000, chain.objs.size()=1 2024-09-12T18:10:37.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.w1eNbrqUhCEtFqF9WpMjILNns5h0ifj_0 2024-09-12T18:10:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7859723596566910928', time=2024-09-12T20:03:47.950548+0000, chain.objs.size()=1 2024-09-12T18:10:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.rKo9LfYNRj3_VrYzscI7yrQiT1_635w_0 2024-09-12T18:10:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8994951609252240603', time=2024-09-12T20:04:28.019209+0000, chain.objs.size()=1 2024-09-12T18:10:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.KXdvrwjLHZdJgqL7VU7s8Cf83uq6Ii9_0 2024-09-12T18:10:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13621840180674990866', time=2024-09-12T20:04:28.166905+0000, chain.objs.size()=1 2024-09-12T18:10:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.zjKHAVj2GfPlBwKlFWcPsbqBFxFArfO_0 2024-09-12T18:10:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4557874334327950979', time=2024-09-12T20:05:50.914896+0000, chain.objs.size()=1 2024-09-12T18:10:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.FVBzOs_g1uyW996t6oMZ-1FHajPiL24_0 2024-09-12T18:10:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10458312678910029759', time=2024-09-12T20:06:25.426616+0000, chain.objs.size()=1 2024-09-12T18:10:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.LVyfi8oBz7EadlzzcCsKjBGJmuJMZu4_0 2024-09-12T18:10:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9424880025286444621', time=2024-09-12T20:07:04.563741+0000, chain.objs.size()=1 2024-09-12T18:10:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.sdwEWmdllFvj9xPFseKgt7Z--jPqOae_0 2024-09-12T18:10:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12670900653820304749', time=2024-09-12T20:07:09.311377+0000, chain.objs.size()=1 2024-09-12T18:10:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.57XeIQ3aRyFMHOGVLZWJMq6cD_yka_y_0 2024-09-12T18:10:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4139239217299211003', time=2024-09-12T20:07:13.559569+0000, chain.objs.size()=1 2024-09-12T18:10:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.zMkZ-xJ39yT-LL8FMds892n626YPLMF_0 2024-09-12T18:10:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9626350784650108972', time=2024-09-12T20:07:49.016759+0000, chain.objs.size()=1 2024-09-12T18:10:37.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.wg_Q8i0LYCQZgxEBMLxa1L5sUpML-zc_0 2024-09-12T18:10:37.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8171194014985962931', time=2024-09-12T20:09:57.419771+0000, chain.objs.size()=1 2024-09-12T18:10:37.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.825+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.EWWwzpp6N13T2DkKBwGp6DvIZci_VoE_0 2024-09-12T18:10:37.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.829+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17206555516077371098', time=2024-09-12T20:09:57.490960+0000, chain.objs.size()=1 2024-09-12T18:10:37.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.829+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.pTs9oB8MwmnWFHIO4qhnmmmrxSFlXai_0 2024-09-12T18:10:37.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.833+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.837+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:10:37.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13326389104163597054', time=2024-09-12T20:00:32.464029+0000, chain.objs.size()=1 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.nY9Bm5dwkJdSivJAAdUJwtTvcnkcf-X_0 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1864570296407102306', time=2024-09-12T20:00:32.928402+0000, chain.objs.size()=5 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.1 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.1_1 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.2 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.2_1 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.3 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10921312934785020711', time=2024-09-12T20:03:04.512127+0000, chain.objs.size()=1 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.YCta0RBFdOw3YiPEkFFKx3da9LL48LG_0 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7496350703556206633', time=2024-09-12T20:03:04.578507+0000, chain.objs.size()=1 2024-09-12T18:10:37.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.wajVLcKevqhSDFI3WHj-QQysW7ZCag5_0 2024-09-12T18:10:37.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7065934923031696531', time=2024-09-12T20:03:39.395860+0000, chain.objs.size()=1 2024-09-12T18:10:37.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.Gsv7XMWPVZwkCrDZOHjqiXtBShWm6T6_0 2024-09-12T18:10:37.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14529051880245463201', time=2024-09-12T20:03:48.058860+0000, chain.objs.size()=1 2024-09-12T18:10:37.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.8DooibyF4tdd2xpbRnoNi2vQThBYVDW_0 2024-09-12T18:10:37.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1606055557669419162', time=2024-09-12T20:04:28.230947+0000, chain.objs.size()=1 2024-09-12T18:10:37.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.AGYCdZ8uMNOzJ0aDWEbsaKz7cU_2LC9_0 2024-09-12T18:10:37.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2338838177919591266', time=2024-09-12T20:05:11.384625+0000, chain.objs.size()=1 2024-09-12T18:10:37.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.841+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.Ari8imwvDFp52l2WfgpADPlkSPL7DiO_0 2024-09-12T18:10:37.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.845+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4066671768904668502', time=2024-09-12T20:05:46.120001+0000, chain.objs.size()=1 2024-09-12T18:10:37.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.845+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.PUGl-zaI5600ND89OrTZGM_-yAUKEkD_0 2024-09-12T18:10:37.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.845+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3208160010860111942', time=2024-09-12T20:05:46.226244+0000, chain.objs.size()=1 2024-09-12T18:10:37.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.845+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.UNVgtbbBJYEaegmATnUR1Zg6Plj-NS__0 2024-09-12T18:10:37.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1801440161161382336', time=2024-09-12T20:05:49.715372+0000, chain.objs.size()=1 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.EI_kv3FtJFr6NXJ-7yKjjVmLPFQPn44_0 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7449897135551815492', time=2024-09-12T20:06:25.336493+0000, chain.objs.size()=1 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.xO576WlynGAj-vOIYm61uLsvRZW4TjT_0 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6862024568793265678', time=2024-09-12T20:07:09.103005+0000, chain.objs.size()=1 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.0Py8wYMuUKzztnekQjevPOlNRkF7oWk_0 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10287524566348034557', time=2024-09-12T20:07:09.279823+0000, chain.objs.size()=1 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.xE_rf0TQCyo-82LfhRvpP4ykqjAZtUV_0 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1661216911443693786', time=2024-09-12T20:07:13.460810+0000, chain.objs.size()=1 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.ESdBZMEb_hm2LwUYl1a-5hHJipQQZwF_0 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11410385405246340305', time=2024-09-12T20:07:13.559421+0000, chain.objs.size()=1 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.hkWda-bLHMVlXKHLwVlsJOVaVOlfCb2_0 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16401987313692636057', time=2024-09-12T20:09:57.420006+0000, chain.objs.size()=1 2024-09-12T18:10:37.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.ceUwNJ_ro8PiqMaAfzv_l23YG8I8Gft_0 2024-09-12T18:10:37.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10419846657236042278', time=2024-09-12T20:10:11.484087+0000, chain.objs.size()=1 2024-09-12T18:10:37.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.18__shadow:TxjzNL0W5QNtRo2tDVgR6S88xV1G.o7_.9LBtbt_coL8ulpsmtrFzqlO9w-Rs_ub_0 2024-09-12T18:10:37.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15637829896507240221', time=2024-09-12T20:10:11.486254+0000, chain.objs.size()=1 2024-09-12T18:10:37.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.849+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.18__shadow:gbEunzXWN6klcfUhGlSPSwdulB2yYMR_.Q9vyPk9RBOrgX4yNo-NUu5HFdx7RAW9_0 2024-09-12T18:10:37.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.853+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.857+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:10:37.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:10:37.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11405656199075962080', time=2024-09-12T20:00:32.480444+0000, chain.objs.size()=1 2024-09-12T18:10:37.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.-D8EL2_isGP0wFTg8MC2QQRbbFRVdkG_0 2024-09-12T18:10:37.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2756127112814296438', time=2024-09-12T20:00:33.341573+0000, chain.objs.size()=1 2024-09-12T18:10:37.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.8__shadow_.hjm96WQBNUYXKFIelJY5wmThhHBt__N_0 2024-09-12T18:10:37.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2082772311258631584', time=2024-09-12T20:02:17.338850+0000, chain.objs.size()=1 2024-09-12T18:10:37.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.ABIvL4Zvo7VB29H-gE9BiegmCpagzjA_0 2024-09-12T18:10:37.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10453585880087659347', time=2024-09-12T20:02:21.072569+0000, chain.objs.size()=1 2024-09-12T18:10:37.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.T3AkpOvQ15Q4EBgSYKj7kiMwn-goXKm_0 2024-09-12T18:10:37.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.741557489639223207', time=2024-09-12T20:02:55.460086+0000, chain.objs.size()=1 2024-09-12T18:10:37.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.Fz8Xxd0YMxAjH-5xeFLa8jLj764DfS1_0 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.826920458703663180', time=2024-09-12T20:03:04.452100+0000, chain.objs.size()=1 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.Ww0U8KchVeCmBbA9zp0szUhXO-lOLZU_0 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18034184585505544300', time=2024-09-12T20:03:44.363989+0000, chain.objs.size()=1 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.2S7CJDKAk9sqoC9CFSZlQtGTSAKhzux_0 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10309750586147817191', time=2024-09-12T20:03:47.876670+0000, chain.objs.size()=1 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.45I1Yqami0BpMoSjPeh3iC3VJjUJgob_0 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18414620597986617877', time=2024-09-12T20:03:51.823970+0000, chain.objs.size()=1 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.kyCYnESyWgRFfJ-4LbDoRNg1y6caO1g_0 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6215745145858107033', time=2024-09-12T20:05:03.028850+0000, chain.objs.size()=1 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.9fMeW0awFFruPp7CNajYtbJg_moZwDi_0 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11628648029003154602', time=2024-09-12T20:07:04.548627+0000, chain.objs.size()=1 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.SOOYYDUiCbX_fy3UT0xruVLV6H5EHtL_0 2024-09-12T18:10:37.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17810669830627994048', time=2024-09-12T20:07:13.541569+0000, chain.objs.size()=1 2024-09-12T18:10:37.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.861+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.0otPaV2iXSeJU4JAptQ7fFyI5r2dhoP_0 2024-09-12T18:10:37.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.865+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8214685627957865785', time=2024-09-12T20:09:57.423905+0000, chain.objs.size()=1 2024-09-12T18:10:37.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.865+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.0eBrh2YSeIFZEtxBEFggR9B2saWgE7B_0 2024-09-12T18:10:37.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.869+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.873+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:10:37.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.873+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:10:37.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_eWBXB6VijkNRtcxGATAEFGVUqm9ayeb', time=2024-09-12T20:00:32.819390+0000, chain.objs.size()=2 2024-09-12T18:10:37.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.C-RH1PHUzYHUQ9NHwRc64Sahr52MWFX_0 2024-09-12T18:10:37.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.C-RH1PHUzYHUQ9NHwRc64Sahr52MWFX_1 2024-09-12T18:10:37.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_p6x4v9xsIPDHKaTMMWT_w_PtLCAt-4M', time=2024-09-12T20:00:32.935222+0000, chain.objs.size()=3 2024-09-12T18:10:37.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.s5KUHfk5lbCrBqz-oi3tqLvPkTZHk46_0 2024-09-12T18:10:37.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.s5KUHfk5lbCrBqz-oi3tqLvPkTZHk46_1 2024-09-12T18:10:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.s5KUHfk5lbCrBqz-oi3tqLvPkTZHk46_2 2024-09-12T18:10:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1269344763259542585', time=2024-09-12T20:00:32.987767+0000, chain.objs.size()=5 2024-09-12T18:10:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.1 2024-09-12T18:10:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.1_1 2024-09-12T18:10:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.2 2024-09-12T18:10:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.2_1 2024-09-12T18:10:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.3 2024-09-12T18:10:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5034571182735498157', time=2024-09-12T20:00:33.356655+0000, chain.objs.size()=1 2024-09-12T18:10:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.8__shadow_.0ZvELxd58_Mdng5F2_6-3NjqaRJDGEt_0 2024-09-12T18:10:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14129077126951620700', time=2024-09-12T20:02:17.336606+0000, chain.objs.size()=1 2024-09-12T18:10:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.877+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.f02suHdKjTuInODFaGZSJdGVNuA0JNC_0 2024-09-12T18:10:37.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3105352326527274146', time=2024-09-12T20:02:17.396038+0000, chain.objs.size()=1 2024-09-12T18:10:37.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.k5icrv9mykGlnTq7xy34k_9zIyfo2XN_0 2024-09-12T18:10:37.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9614542461348504206', time=2024-09-12T20:03:00.301267+0000, chain.objs.size()=1 2024-09-12T18:10:37.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.2XMus2wRxbvXhVNU7YhFQSzjyYVCyfz_0 2024-09-12T18:10:37.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4021922017022286132', time=2024-09-12T20:03:44.243220+0000, chain.objs.size()=1 2024-09-12T18:10:37.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.8fsw33mnYQy2k7ETQhi_TZ_EdGU-x0y_0 2024-09-12T18:10:37.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6430172685995719144', time=2024-09-12T20:04:28.098094+0000, chain.objs.size()=1 2024-09-12T18:10:37.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.QAhX_GlPLSFJ0Q1Z0a-nAUrc4cA1RQR_0 2024-09-12T18:10:37.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5619527802511281562', time=2024-09-12T20:05:11.264626+0000, chain.objs.size()=1 2024-09-12T18:10:37.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.7jLCYo7cxUOdNjL_gfgLl3kucHYt02c_0 2024-09-12T18:10:37.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12960660804738402022', time=2024-09-12T20:05:11.370956+0000, chain.objs.size()=1 2024-09-12T18:10:37.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.oel9ccigKb_nBIE1DhqQCEK07OYkXlU_0 2024-09-12T18:10:37.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7790617772872792101', time=2024-09-12T20:05:11.372945+0000, chain.objs.size()=1 2024-09-12T18:10:37.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.DnAACGgRzU_y4yOS7bEpCl3WOX-Ywll_0 2024-09-12T18:10:37.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4876176117045967820', time=2024-09-12T20:05:46.115341+0000, chain.objs.size()=1 2024-09-12T18:10:37.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.IpuypGb6q5OCv804a2OqXBanz4CL_W0_0 2024-09-12T18:10:37.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12025229800301069927', time=2024-09-12T20:05:50.747184+0000, chain.objs.size()=1 2024-09-12T18:10:37.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.-aeUReT7joqkU7zXTkL0fpHWTwhV8_e_0 2024-09-12T18:10:37.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8678764820273017956', time=2024-09-12T20:06:29.968246+0000, chain.objs.size()=1 2024-09-12T18:10:37.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.885+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.ZOYDCbt_vVLf6GZimygqbEsC4TguHeO_0 2024-09-12T18:10:37.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.889+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.893+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:10:37.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.893+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:10:37.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7306207433552701730', time=2024-09-12T20:00:32.455941+0000, chain.objs.size()=1 2024-09-12T18:10:37.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.XcFdQXnVfeqylxmGOoJFoNtqiJjM2tD_0 2024-09-12T18:10:37.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8199650380280379327', time=2024-09-12T20:00:32.983387+0000, chain.objs.size()=3 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.1 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.2 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-STANDARD.2~thKBTd4V4xNxGViahMunwx9YFWnIbVd.3 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15900655147546947474', time=2024-09-12T20:00:33.120533+0000, chain.objs.size()=3 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.8pgca3IbnkRUbHgks3N2_MP8AsBVSWp_0 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.8pgca3IbnkRUbHgks3N2_MP8AsBVSWp_1 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.8pgca3IbnkRUbHgks3N2_MP8AsBVSWp_2 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7745867758995354465', time=2024-09-12T20:02:55.351644+0000, chain.objs.size()=1 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.7sPYv0NBstz2zBGJiSkPz91rKcYqGje_0 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18161373999985530997', time=2024-09-12T20:02:55.371186+0000, chain.objs.size()=1 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.z6GUf6GPAs9k40nNsIxqIY6t680JVdf_0 2024-09-12T18:10:37.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13868720242997732437', time=2024-09-12T20:02:55.509806+0000, chain.objs.size()=1 2024-09-12T18:10:37.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.84IhQyoeRDj9YXmwS62DSnJa7XldF-C_0 2024-09-12T18:10:37.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17284446523605199981', time=2024-09-12T20:03:44.367855+0000, chain.objs.size()=1 2024-09-12T18:10:37.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.VBNwv_azX46Ixsr7WWNqZhCLvaXbxel_0 2024-09-12T18:10:37.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.912561365866749031', time=2024-09-12T20:04:23.230399+0000, chain.objs.size()=1 2024-09-12T18:10:37.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.897+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.Y4K-TpTJAinXjtqLCljP9M9OtHkYWH4_0 2024-09-12T18:10:37.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.901+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.969020774142423082', time=2024-09-12T20:04:28.013765+0000, chain.objs.size()=1 2024-09-12T18:10:37.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.901+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.njMdflNP0JHWtuGKyx-lj4ER_O9RwWq_0 2024-09-12T18:10:37.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.901+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9564643102164529360', time=2024-09-12T20:05:50.787089+0000, chain.objs.size()=1 2024-09-12T18:10:37.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.901+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.Z9P_PVkt8MoVO7YpsJjMoDO10FbsmMg_0 2024-09-12T18:10:37.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.901+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11936864045778028778', time=2024-09-12T20:06:29.813222+0000, chain.objs.size()=1 2024-09-12T18:10:37.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.901+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.fNVl1Moq-sHdqryJw81bRxEdsqeK6XW_0 2024-09-12T18:10:37.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.901+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8450883876996682311', time=2024-09-12T20:07:04.505204+0000, chain.objs.size()=1 2024-09-12T18:10:37.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.901+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.ce0CUs0sOxOulBPmzxPGmUKVt9ASGUn_0 2024-09-12T18:10:37.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.901+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10862948272697329230', time=2024-09-12T20:07:48.970648+0000, chain.objs.size()=1 2024-09-12T18:10:37.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.901+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.vO1ifoUZQJJKLPZNnuZThOqOFjoNdN9_0 2024-09-12T18:10:37.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.905+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10207099952818108191', time=2024-09-12T20:07:49.012195+0000, chain.objs.size()=1 2024-09-12T18:10:37.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.905+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.SVfyDBWnAweTmDr5MpHE0yO9rCWwaBP_0 2024-09-12T18:10:37.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.905+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17171465676503266974', time=2024-09-12T20:07:49.016988+0000, chain.objs.size()=1 2024-09-12T18:10:37.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.905+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.kuYM9PQszVpJNeaJF3SFIVj7rLmfebj_0 2024-09-12T18:10:37.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.905+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11170643563562309548', time=2024-09-12T20:07:49.229539+0000, chain.objs.size()=1 2024-09-12T18:10:37.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.905+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.rNcj9IVywtlvZwM9oxTWsaCWi9K6w8K_0 2024-09-12T18:10:37.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.905+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5725590766815999268', time=2024-09-12T20:09:57.460462+0000, chain.objs.size()=1 2024-09-12T18:10:37.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.905+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.dZNHp0Nz6JNmPwjMVssokkw3dPhvBdi_0 2024-09-12T18:10:37.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.909+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.913+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:10:37.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.913+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_fNWDalV07Zn-Ocjul6yySXCTs5oRwJi', time=2024-09-12T20:00:32.777008+0000, chain.objs.size()=2 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.Z33NMGbqZUBjp4wuKgFaBxlHpjmOfyO_0 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.Z33NMGbqZUBjp4wuKgFaBxlHpjmOfyO_1 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3593117845392817534', time=2024-09-12T20:00:33.260592+0000, chain.objs.size()=1 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.7__shadow_.laqFljaFTlXZjC7M3jVlB5wMH94ts3g_0 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17558242600687297471', time=2024-09-12T20:02:17.413646+0000, chain.objs.size()=1 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.l8IhNoXjxE6ypIPsEGLrVpGSMK1w6td_0 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3424281752760204743', time=2024-09-12T20:02:21.040123+0000, chain.objs.size()=1 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.MMkIGpQ0NRxOD4D-fRuolhxEB8JhZue_0 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17753540230410914145', time=2024-09-12T20:02:21.041834+0000, chain.objs.size()=1 2024-09-12T18:10:37.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.I6-eGt7b16wOLiNui7QQdWK8ovH-21-_0 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4625847596348113531', time=2024-09-12T20:02:21.170098+0000, chain.objs.size()=1 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.zsaSgLu4zwYkjfa-vT7GfIasMyhFrIZ_0 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17811998012413248612', time=2024-09-12T20:02:21.172199+0000, chain.objs.size()=1 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.u4sFhmCCSMfwJnLaCX0oUACHe6ubsGI_0 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13741790195032457267', time=2024-09-12T20:02:55.278876+0000, chain.objs.size()=1 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.9DbX9Qp6ep7IQgKQi8IzdHAxGD7963q_0 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18129810957455598191', time=2024-09-12T20:03:00.369839+0000, chain.objs.size()=1 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.Xhpin2Kj0DRj4XZghkyr6KSNXj5P_o8_0 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1736206834839374667', time=2024-09-12T20:03:00.371584+0000, chain.objs.size()=1 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.Dqwpr5q_96h9lO4HT9MUoduNbZA7eUg_0 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14527994350089817486', time=2024-09-12T20:03:04.443732+0000, chain.objs.size()=1 2024-09-12T18:10:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.917+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.B8XCPMyOBbo94DTj4-sZn4ZvF3bITT-_0 2024-09-12T18:10:37.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3566238378943637609', time=2024-09-12T20:03:04.570647+0000, chain.objs.size()=1 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.alvOioowBV7RhWlzELyGiJiNuTrR8Td_0 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12043365027160176694', time=2024-09-12T20:03:47.993045+0000, chain.objs.size()=1 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.Skcz4JGXj6HFpWa0ucriWoClnJY3fov_0 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.228396944685216097', time=2024-09-12T20:05:06.628003+0000, chain.objs.size()=1 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.0AcNyUm8aaLRnvU7mFkTK7VRi0fY_Xo_0 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14817478532167184282', time=2024-09-12T20:05:50.686629+0000, chain.objs.size()=1 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.A7kfZTJBWMqpqDWKRsGiy_YiVo3ZoXM_0 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15999770084590624730', time=2024-09-12T20:06:29.823614+0000, chain.objs.size()=1 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.t8NluyOQHpMrhsXJNL9Z99aBNNstoWW_0 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15974800566389452493', time=2024-09-12T20:06:29.978215+0000, chain.objs.size()=1 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.C6XiSjZKXXpLG-DPV9oCQIxCdJ_zlpo_0 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1716188613010445815', time=2024-09-12T20:07:04.453967+0000, chain.objs.size()=1 2024-09-12T18:10:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.4Vh7fIb16VnLrwjTrbMLMut0oidmUd2_0 2024-09-12T18:10:37.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13221423997925515144', time=2024-09-12T20:07:04.568360+0000, chain.objs.size()=1 2024-09-12T18:10:37.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.inL0p1AHlhwaG08YRnYy92PEI_qhm-F_0 2024-09-12T18:10:37.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4166497771265873559', time=2024-09-12T20:07:09.212980+0000, chain.objs.size()=1 2024-09-12T18:10:37.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.dA7coPxLGQXJeTbhsekfePM9Xg8tsgs_0 2024-09-12T18:10:37.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9729463298082281918', time=2024-09-12T20:07:09.214457+0000, chain.objs.size()=1 2024-09-12T18:10:37.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.TGzdT5ej3UbUGUtaW-Wzh4sOKzonHNY_0 2024-09-12T18:10:37.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10665915477640090891', time=2024-09-12T20:09:57.440390+0000, chain.objs.size()=1 2024-09-12T18:10:37.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.921+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.QEe2lcCGU2LcLRTjDhSAq-fQ930l1_D_0 2024-09-12T18:10:37.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.929+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.933+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:10:37.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.933+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.933+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:10:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_pAmqDUNVUFIE0Wv4ZGpaIPsNPSQ9BNl', time=2024-09-12T20:00:32.920550+0000, chain.objs.size()=3 2024-09-12T18:10:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.SNVOU63oo6icjuqGDrnlPPAf09C5uOn_0 2024-09-12T18:10:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.SNVOU63oo6icjuqGDrnlPPAf09C5uOn_1 2024-09-12T18:10:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.SNVOU63oo6icjuqGDrnlPPAf09C5uOn_2 2024-09-12T18:10:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13858628253598276979', time=2024-09-12T20:00:32.974642+0000, chain.objs.size()=5 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.1 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.1_1 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.2 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.2_1 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-LUKEWARM.2~2Ynjfil4a6FRBv0dV1GTGj-MUCyNARO.3 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17238811690148548702', time=2024-09-12T20:03:39.570477+0000, chain.objs.size()=1 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.mYdJF7fG7xYJKP7u-IZyte3xH727p-G_0 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13947210665147037198', time=2024-09-12T20:03:44.231779+0000, chain.objs.size()=1 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.uupA5VnHkTmmjwPYriZ32Sy5sMo-Ox2_0 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8757312778254459493', time=2024-09-12T20:04:28.055418+0000, chain.objs.size()=1 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.CG0WjZaLU9DRpnYaYfe05-e5V-CmgB__0 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10046747025997963283', time=2024-09-12T20:04:28.136290+0000, chain.objs.size()=1 2024-09-12T18:10:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.937+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.SYF07OD2tX8dJoY293fmcqKW6A9SY6D_0 2024-09-12T18:10:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.691809082557107443', time=2024-09-12T20:04:28.226104+0000, chain.objs.size()=1 2024-09-12T18:10:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.HbMUD-7QoGoz5oSaFLwbrh7meTSdmqa_0 2024-09-12T18:10:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11998491184111601366', time=2024-09-12T20:05:07.436177+0000, chain.objs.size()=1 2024-09-12T18:10:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.3zzBLzYaIZN_-ucd0hx7gtum2W6_uLy_0 2024-09-12T18:10:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15357880457526731307', time=2024-09-12T20:05:07.477307+0000, chain.objs.size()=1 2024-09-12T18:10:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.Su-ZP4YIUuY9E-dxUycGymV-WFx8--w_0 2024-09-12T18:10:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15720925899668328550', time=2024-09-12T20:05:07.658789+0000, chain.objs.size()=1 2024-09-12T18:10:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.0Np-jjYB3yM0tGuuQk1tng9rO1BO6SA_0 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11209774906646692283', time=2024-09-12T20:05:11.390127+0000, chain.objs.size()=1 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.AhepBHlVpaBJMpP9YboEbUkXDSb5gaL_0 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2799605391955886615', time=2024-09-12T20:05:11.482671+0000, chain.objs.size()=1 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.QT9qF1o1fnuupkNpMafFNBJY4ESwqmQ_0 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3644529341250867730', time=2024-09-12T20:05:46.141283+0000, chain.objs.size()=1 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.wMcDnopqc0XL0W3aJwNMstuhaq51OkJ_0 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9297968989142679861', time=2024-09-12T20:06:25.423337+0000, chain.objs.size()=1 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.pjqPigwQApgSruR9EutvkhzNhc86DOQ_0 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12481075776528962532', time=2024-09-12T20:06:25.425386+0000, chain.objs.size()=1 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.jEyMxcsnL543hZa4BpRgwLMpgyHHdV8_0 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17170154094896514100', time=2024-09-12T20:07:13.499473+0000, chain.objs.size()=1 2024-09-12T18:10:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.945+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.yykc0eEVvYWGi-ZbG3AvjoRNFmDB5iz_0 2024-09-12T18:10:37.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.949+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.953+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:10:37.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:10:37.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12377350128094919491', time=2024-09-12T20:00:32.860750+0000, chain.objs.size()=2 2024-09-12T18:10:37.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.MGZQWS5rK6s8EXtCxaliG5P_zKipBMf_0 2024-09-12T18:10:37.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.MGZQWS5rK6s8EXtCxaliG5P_zKipBMf_1 2024-09-12T18:10:37.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_d1GhluD-8uQ-GIJrLVL7faJmYAD63aw', time=2024-09-12T20:00:32.995053+0000, chain.objs.size()=1 2024-09-12T18:10:37.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.6EjOYK6nfLmt7WYuWbrEg2nPYNsrTN2_0 2024-09-12T18:10:37.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8285549305327909028', time=2024-09-12T20:02:17.233959+0000, chain.objs.size()=1 2024-09-12T18:10:37.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.lLuRtn-FSxdhTCyX11SDc8r_zpybXqB_0 2024-09-12T18:10:37.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7936350510165504126', time=2024-09-12T20:02:55.409785+0000, chain.objs.size()=1 2024-09-12T18:10:37.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.JsRCuN2f0zmHJVge97vVEzYv1Nq8ggU_0 2024-09-12T18:10:37.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13370267063204530485', time=2024-09-12T20:02:55.448435+0000, chain.objs.size()=1 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.Z4ej4-Nh0pasQuW2YDPSun95Lm8QvO7_0 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4600091004198346398', time=2024-09-12T20:03:00.309587+0000, chain.objs.size()=1 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.UAcVf3x9mKc2M9XaV_-ghD4H179HVpb_0 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7522430934761759936', time=2024-09-12T20:03:04.338328+0000, chain.objs.size()=1 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.TalqKO37GiToeIoOy1WBSwQ_rSt6Y8j_0 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4379649610234301520', time=2024-09-12T20:03:04.407156+0000, chain.objs.size()=1 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.WftkTxlu-Msczbdp0UhWGl_7aw2yKw0_0 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9217738232626146257', time=2024-09-12T20:03:39.383239+0000, chain.objs.size()=1 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.pBvbzZsqwLV3BMjG0f5RDc1GyRKDx03_0 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10474040967933758795', time=2024-09-12T20:04:23.309717+0000, chain.objs.size()=1 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.uQd1gWC54R3V9xq-y39kTaJ6IWb3KQY_0 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9569387291445584972', time=2024-09-12T20:04:28.098182+0000, chain.objs.size()=1 2024-09-12T18:10:37.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.957+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.eqms8yiezI9BsREUpm-4TRtQOwEd2VD_0 2024-09-12T18:10:37.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4376236901299196280', time=2024-09-12T20:04:28.249393+0000, chain.objs.size()=1 2024-09-12T18:10:37.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.VXgz3pGZGhHnuIlMrVWwSyoRJj7nJ9c_0 2024-09-12T18:10:37.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6081466591862279644', time=2024-09-12T20:04:31.355867+0000, chain.objs.size()=1 2024-09-12T18:10:37.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.NTCMDL540w4p-437HVEGiMNq0NSbOHI_0 2024-09-12T18:10:37.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11948950219130760849', time=2024-09-12T20:06:25.510884+0000, chain.objs.size()=1 2024-09-12T18:10:37.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.tDewnR86umPlS-TZLPOEKgGYkuctmYI_0 2024-09-12T18:10:37.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8845789985903510889', time=2024-09-12T20:06:29.812794+0000, chain.objs.size()=1 2024-09-12T18:10:37.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.3WragVO-uvRlHv-GKjGIZXxX1W8NK4O_0 2024-09-12T18:10:37.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3556760774391332698', time=2024-09-12T20:07:09.338892+0000, chain.objs.size()=1 2024-09-12T18:10:37.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.YiOaDEYaEQvj75wyF3LUZcFevtjL8fL_0 2024-09-12T18:10:37.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6892990939059801087', time=2024-09-12T20:07:13.582772+0000, chain.objs.size()=1 2024-09-12T18:10:37.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.zYIYszKb2O7uXryfWgkICoF8sf2LM9j_0 2024-09-12T18:10:37.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.110217505796357684', time=2024-09-12T20:10:06.091531+0000, chain.objs.size()=1 2024-09-12T18:10:37.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.961+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.18__shadow:J2s7omou11y.B6YhytyV-VmkQRIIyel_.YH6GfayA--gToXmeL5QkghR5Zewer9N_0 2024-09-12T18:10:37.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.965+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.969+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:10:37.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.969+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:10:37.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_k6P9pw-bFl3CxMP5afO57HwOmJ4A7kf', time=2024-09-12T20:00:32.794864+0000, chain.objs.size()=2 2024-09-12T18:10:37.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.LmthZ8BiXcW2i7vAvzLMNO5AHdcR38q_0 2024-09-12T18:10:37.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.LmthZ8BiXcW2i7vAvzLMNO5AHdcR38q_1 2024-09-12T18:10:37.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_fB_oG7mK-mlKT5WDh1CHEBu5TE8VyWw', time=2024-09-12T20:00:32.854217+0000, chain.objs.size()=1 2024-09-12T18:10:37.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.UsoBfmg8zVcnMHe_Do0CBWPpz6stZSS_0 2024-09-12T18:10:37.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_ol3gqyGQ-E2jzi5z4dQkWEgwGbzmEnL', time=2024-09-12T20:00:32.964110+0000, chain.objs.size()=3 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.v-89HJnHhoN_-NrBEHOqgCw1TWRGg-8_0 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.v-89HJnHhoN_-NrBEHOqgCw1TWRGg-8_1 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.v-89HJnHhoN_-NrBEHOqgCw1TWRGg-8_2 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17553079801290439022', time=2024-09-12T20:02:17.197879+0000, chain.objs.size()=1 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.E_wFmiLjwe3FLrAe1fsqE7MoVJ5TIqJ_0 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4979410490391363057', time=2024-09-12T20:02:17.256477+0000, chain.objs.size()=1 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.Y-EaiInvW1CbpXCvy8sZ4dGvW3vgv0U_0 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17820081124661328031', time=2024-09-12T20:02:17.258547+0000, chain.objs.size()=1 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.7KQezp0PWUw7d-1A0a57mjSuG_5Gft2_0 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8355865602012435777', time=2024-09-12T20:02:55.503256+0000, chain.objs.size()=1 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.MYmMdC7hTMaKlDinaleG_XNrefX8E2-_0 2024-09-12T18:10:37.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7489812694261673373', time=2024-09-12T20:03:04.406180+0000, chain.objs.size()=1 2024-09-12T18:10:37.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.pb87Rpsg9amNdAwMrqrR0omVo9jC7qA_0 2024-09-12T18:10:37.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17062102944607268204', time=2024-09-12T20:03:04.408026+0000, chain.objs.size()=1 2024-09-12T18:10:37.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.973+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.xqH3TKLXIpUP6OAPsoXVOipG0WBSgXJ_0 2024-09-12T18:10:37.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10771304983655213732', time=2024-09-12T20:03:39.410317+0000, chain.objs.size()=1 2024-09-12T18:10:37.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.Rsco8T3VEqoI-PZosb1mwKxHZ9j_WPc_0 2024-09-12T18:10:37.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15539211375668312057', time=2024-09-12T20:03:39.552486+0000, chain.objs.size()=1 2024-09-12T18:10:37.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.Yvr-rbL6YUor_bQSa2Zs_t2nnKwzzqC_0 2024-09-12T18:10:37.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16409555504724546077', time=2024-09-12T20:03:47.994439+0000, chain.objs.size()=1 2024-09-12T18:10:37.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.w0qkXqfmVp6-JSt6ER4-3xmnzPoLrJg_0 2024-09-12T18:10:37.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14091558101437445765', time=2024-09-12T20:04:23.313876+0000, chain.objs.size()=1 2024-09-12T18:10:37.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.trLZJNVSYv3_fKGdxEttP22T_Hd4L-q_0 2024-09-12T18:10:37.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.983557565489746904', time=2024-09-12T20:06:25.430393+0000, chain.objs.size()=1 2024-09-12T18:10:37.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.jQp92XVZAKapguc7rUkM5Ia4TQVUExT_0 2024-09-12T18:10:37.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11621660526388770300', time=2024-09-12T20:06:28.715816+0000, chain.objs.size()=1 2024-09-12T18:10:37.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.F1WlUmBT_UuClQDBLrn4CJc8PkvQYrS_0 2024-09-12T18:10:37.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12033726534021416670', time=2024-09-12T20:07:04.499910+0000, chain.objs.size()=1 2024-09-12T18:10:37.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.cxdVl5ZNKqnp7OvKwU78Cree5RBZIoB_0 2024-09-12T18:10:37.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17643111097034915123', time=2024-09-12T20:07:09.195452+0000, chain.objs.size()=1 2024-09-12T18:10:37.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.Gs352asJBAVTfl0CXrfSkqQYo-kDfPR_0 2024-09-12T18:10:37.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15163832582871825637', time=2024-09-12T20:07:13.581023+0000, chain.objs.size()=1 2024-09-12T18:10:37.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.-1hiCy7a3daNJIxzTQuYD5yPnnwjKME_0 2024-09-12T18:10:37.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16427954545571819341', time=2024-09-12T20:07:13.582949+0000, chain.objs.size()=1 2024-09-12T18:10:37.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.mEJU3HE3OQS-3g7sG1K77twer-XWtV6_0 2024-09-12T18:10:37.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10868174266590034916', time=2024-09-12T20:07:49.238366+0000, chain.objs.size()=1 2024-09-12T18:10:37.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.977+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.tYy9mvLhJRP6Lf4cNdDSOSUYc5xYcPH_0 2024-09-12T18:10:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.981+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1028087832088313603', time=2024-09-12T20:09:57.436307+0000, chain.objs.size()=1 2024-09-12T18:10:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.981+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.DsKl4UsNr_DsbVJuLajbLDAy-54bdgs_0 2024-09-12T18:10:37.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.985+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:37.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:10:37.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:37.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:37.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T18:10:37.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12050935855322642998', time=2024-09-12T20:00:32.446495+0000, chain.objs.size()=1 2024-09-12T18:10:37.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.c_i8kWKHzmmwr6LFHTQ0JeztN2K2kE-_0 2024-09-12T18:10:37.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18078668305031792224', time=2024-09-12T20:00:32.786764+0000, chain.objs.size()=2 2024-09-12T18:10:37.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.MGZQWS5rK6s8EXtCxaliG5P_zKipBMf_0 2024-09-12T18:10:37.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.MGZQWS5rK6s8EXtCxaliG5P_zKipBMf_1 2024-09-12T18:10:37.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12932525628201754924', time=2024-09-12T20:02:16.240346+0000, chain.objs.size()=1 2024-09-12T18:10:37.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.adPOmoObWpX_zywBSA01WymdYuD-3HL_0 2024-09-12T18:10:37.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6786045586146382534', time=2024-09-12T20:02:21.171735+0000, chain.objs.size()=1 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.cRMYug4voW35M-HI86UYEm7ErffsvGW_0 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5500636664792244907', time=2024-09-12T20:02:55.409712+0000, chain.objs.size()=1 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.2wgvbKWhrK8JF7YqpGBzRYchzuHRSjd_0 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17604561215468221186', time=2024-09-12T20:03:00.298234+0000, chain.objs.size()=1 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.1oqFV2HakXWmB0qx8nqLSmxy1DzxaGE_0 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14595372479604373829', time=2024-09-12T20:03:00.373032+0000, chain.objs.size()=1 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.hrreRw8iFGyrr4u3_j0CGx2hJQu0ZQY_0 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5266344736873170952', time=2024-09-12T20:03:00.475010+0000, chain.objs.size()=1 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.nRFGV4AhXx4f26OwBpHLfvcG_2tZQLK_0 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12855526728869677166', time=2024-09-12T20:03:04.338087+0000, chain.objs.size()=1 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.ANKebo5bcTSKD0JLkh4YieKemCVulIk_0 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.857851732370295210', time=2024-09-12T20:03:39.472628+0000, chain.objs.size()=1 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.K1VfKP_-AZRJgdLl9C_OZYJikKlYd17_0 2024-09-12T18:10:37.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3913653279839641823', time=2024-09-12T20:03:44.245046+0000, chain.objs.size()=1 2024-09-12T18:10:37.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.989+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.yfCMCDLFBrrZC6PG953KRSW94nXlWWZ_0 2024-09-12T18:10:37.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.993+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7617314445502562102', time=2024-09-12T20:04:23.231377+0000, chain.objs.size()=1 2024-09-12T18:10:37.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.993+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.rmUwMt6zD2uWnAbP0Ga-Owh6EGYZ7bz_0 2024-09-12T18:10:37.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6225265580159463382', time=2024-09-12T20:05:02.788819+0000, chain.objs.size()=1 2024-09-12T18:10:37.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.x8twDDDFpUWDaZNIdOLuhsaLMpQhJDR_0 2024-09-12T18:10:37.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8996978327837380166', time=2024-09-12T20:05:02.935628+0000, chain.objs.size()=1 2024-09-12T18:10:37.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.CzZK6-80vFuxFtH70Dozw95rX_sXPb3_0 2024-09-12T18:10:37.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6612704707583231377', time=2024-09-12T20:05:02.937944+0000, chain.objs.size()=1 2024-09-12T18:10:37.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.8uitQpqhC_EtYMETC0IKpASsA8HzWPT_0 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2702081462835438846', time=2024-09-12T20:05:02.997200+0000, chain.objs.size()=1 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.I8BN1xEJ1GpbuEcAuibaUarQVr8Uob6_0 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16048966633448796301', time=2024-09-12T20:05:07.487982+0000, chain.objs.size()=1 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.65rBbmtgT7pb8tZAeK_ezQC9cIayrv5_0 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1321924462856567498', time=2024-09-12T20:05:45.193265+0000, chain.objs.size()=1 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.iwimhQvT6VmUr_48upmQK4pYs2wp6CJ_0 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4683313991208771489', time=2024-09-12T20:05:46.276580+0000, chain.objs.size()=1 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.QamM2CpG0A3FIdxgp-nD1Mc3KhIQd9f_0 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2184127039734894610', time=2024-09-12T20:06:25.581292+0000, chain.objs.size()=1 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.TKzC0ZDg4-H_k4w5vCIqJjjA8SiNWiT_0 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14130387362075589543', time=2024-09-12T20:06:29.812565+0000, chain.objs.size()=1 2024-09-12T18:10:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.tKUNiVpxZzMR2V9sHa2C8a44PmIGIGK_0 2024-09-12T18:10:38.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5894250764411466059', time=2024-09-12T20:07:09.101427+0000, chain.objs.size()=1 2024-09-12T18:10:38.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.7pWWtVskSXRsKpP4N63GnYkrauEdMou_0 2024-09-12T18:10:38.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2275791393608953585', time=2024-09-12T20:07:09.195013+0000, chain.objs.size()=1 2024-09-12T18:10:38.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.zSVCgHVZnxQfg4WI06C0uviZ0AkfIne_0 2024-09-12T18:10:38.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16489332822962896477', time=2024-09-12T20:07:13.455786+0000, chain.objs.size()=1 2024-09-12T18:10:38.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:37.997+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.hKPXyT6PvCeSX4OzsllYmDXG_mHOVzL_0 2024-09-12T18:10:38.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.001+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.005+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:10:38.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T18:10:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4575549635310022836', time=2024-09-12T20:02:21.163152+0000, chain.objs.size()=1 2024-09-12T18:10:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.wp4ACW28Vdi-Rn9nGOGz0iArysNF4g0_0 2024-09-12T18:10:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5121016573633334568', time=2024-09-12T20:02:21.257674+0000, chain.objs.size()=1 2024-09-12T18:10:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.BHy63NHbwtA911rjL3y5HWO3pbPPU8x_0 2024-09-12T18:10:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12661113109117586548', time=2024-09-12T20:02:55.481361+0000, chain.objs.size()=1 2024-09-12T18:10:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.wTVT5P573fCAPRG8kuPOXmur5gMvlmP_0 2024-09-12T18:10:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15656215996516783707', time=2024-09-12T20:03:44.297367+0000, chain.objs.size()=1 2024-09-12T18:10:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.xubtXKlXcMMlud3Rq0RXSGLDza2nQ7G_0 2024-09-12T18:10:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2009708831061937884', time=2024-09-12T20:05:11.269711+0000, chain.objs.size()=1 2024-09-12T18:10:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.3GrHsidMLWrwhZFpNXIZ97L80OstYql_0 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1369564527008825622', time=2024-09-12T20:05:11.345249+0000, chain.objs.size()=1 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.qQkx91NuGkd0R3529ckGG2hGnvoeroT_0 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13322161322169007511', time=2024-09-12T20:05:11.370484+0000, chain.objs.size()=1 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.6g02FZgq2o-TY1ZQIZkQ915K2muujWr_0 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9764924064672147273', time=2024-09-12T20:05:50.760987+0000, chain.objs.size()=1 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.x1c2Y_sPg9ypR8farUGYpujJTH98rzJ_0 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.109402271674339406', time=2024-09-12T20:07:04.453110+0000, chain.objs.size()=1 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.UbRra6AwUXFc2ohAxVuSbPsZPXg7oEv_0 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7476342989447011116', time=2024-09-12T20:07:04.708251+0000, chain.objs.size()=1 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.yupwDV8NHfRvvtPSuKm7UUVf2uaknCe_0 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18356508986614839263', time=2024-09-12T20:07:13.726585+0000, chain.objs.size()=1 2024-09-12T18:10:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.009+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.yRwxI33-OLulMkBxQCB6oLibE9QtpWL_0 2024-09-12T18:10:38.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.013+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.017+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:10:38.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:10:38.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6833565349470747245', time=2024-09-12T20:00:32.468750+0000, chain.objs.size()=1 2024-09-12T18:10:38.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.7zSaikDlHLPHs1XOffUSd1WimmR_grS_0 2024-09-12T18:10:38.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12650565731509553369', time=2024-09-12T20:00:32.811836+0000, chain.objs.size()=1 2024-09-12T18:10:38.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.L91j6dMx7IqIlPg-nkXAWH8KCzRmS5I_0 2024-09-12T18:10:38.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13493030975323219929', time=2024-09-12T20:02:17.415115+0000, chain.objs.size()=1 2024-09-12T18:10:38.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.418ywwUOuUlWDHfdC4UZOJhtioc8o9c_0 2024-09-12T18:10:38.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16439773801798230330', time=2024-09-12T20:02:21.240309+0000, chain.objs.size()=1 2024-09-12T18:10:38.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.PbcCRAMaQXTs6CSB-8z1OS8fR44L7wX_0 2024-09-12T18:10:38.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10905692138896466590', time=2024-09-12T20:03:44.430166+0000, chain.objs.size()=1 2024-09-12T18:10:38.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.8lpbsJF34H0qj7Wj1PzvB2lXWwor0G5_0 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13727329766653741672', time=2024-09-12T20:04:23.256759+0000, chain.objs.size()=1 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_._gdG0plJE-TVYrwNdIjqBkEQV-2h27z_0 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15153028130132047475', time=2024-09-12T20:05:07.473046+0000, chain.objs.size()=1 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.XXm1yR2Uq2fIcFJ4ThWAz7wH9JDxGc0_0 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4383467762959949060', time=2024-09-12T20:05:46.266169+0000, chain.objs.size()=1 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.9gIIEdiI2lAEtPomYhPpIw3xO-Wl75N_0 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12061222221430617651', time=2024-09-12T20:07:04.532303+0000, chain.objs.size()=1 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.xF1q-5vpC1DXtUnyt_6m6GnVmiFs2xD_0 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10636479678191502578', time=2024-09-12T20:07:04.584627+0000, chain.objs.size()=1 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.VFOPcR7d9S9GDcxDFAsk09BQKR54KV__0 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2850491078770487508', time=2024-09-12T20:07:09.202598+0000, chain.objs.size()=1 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.ADfxcM8DeNY64vt0OLtcIcGRPbUAgSx_0 2024-09-12T18:10:38.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2704410828659453311', time=2024-09-12T20:07:13.504637+0000, chain.objs.size()=1 2024-09-12T18:10:38.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.021+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.BY528uwBCUQjRIroriT_uvfCNLGRujp_0 2024-09-12T18:10:38.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.025+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8242073459304315294', time=2024-09-12T20:07:49.222294+0000, chain.objs.size()=1 2024-09-12T18:10:38.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.025+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.sf2EIg-uWcWHGNOaBw1KZtFz-l7cX0p_0 2024-09-12T18:10:38.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.029+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.033+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:10:38.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:10:38.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.295229007784549988', time=2024-09-12T20:02:55.460184+0000, chain.objs.size()=1 2024-09-12T18:10:38.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.Q45wvRSKSEci20NnOd_YAqNCayNaeTq_0 2024-09-12T18:10:38.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13862862138789153948', time=2024-09-12T20:03:39.307782+0000, chain.objs.size()=1 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.oP68CEx-nGdxixKpAsmc6C79QFAdQur_0 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17390972914212707793', time=2024-09-12T20:03:39.384648+0000, chain.objs.size()=1 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.6Yqs2GI88GkJE8YgAki1oZfqy7DQuBa_0 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.139603375859396941', time=2024-09-12T20:03:44.196108+0000, chain.objs.size()=1 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.GVlOajPyevGGyE1xsBPfOxDrAioj8l1_0 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15936933809011909180', time=2024-09-12T20:03:44.238818+0000, chain.objs.size()=1 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.iftyxyWDat1WPlVCcTjkGET7OvOCFqm_0 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7752407585075287769', time=2024-09-12T20:03:48.103201+0000, chain.objs.size()=1 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.oLETAEeMNvZU1BD_d5t3k96l5NO4r3B_0 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1337247752622348005', time=2024-09-12T20:04:28.103435+0000, chain.objs.size()=1 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.35dhLZgQ_RSgxXJu_kiajKYXWQhx5XP_0 2024-09-12T18:10:38.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11381472829250672689', time=2024-09-12T20:05:02.800292+0000, chain.objs.size()=1 2024-09-12T18:10:38.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.oQV1C6FUa7f7g8WBduqYtgxHvqACV4u_0 2024-09-12T18:10:38.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8269894883877261833', time=2024-09-12T20:05:07.580878+0000, chain.objs.size()=1 2024-09-12T18:10:38.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.t6pQzJQeBISydoQk508hyMwYvBxpqt2_0 2024-09-12T18:10:38.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2115685646238483042', time=2024-09-12T20:06:25.429231+0000, chain.objs.size()=1 2024-09-12T18:10:38.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.3Jm_SdO_Lzo7wC50W-ThZFty-TOniCC_0 2024-09-12T18:10:38.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10706332814863312199', time=2024-09-12T20:06:25.558720+0000, chain.objs.size()=1 2024-09-12T18:10:38.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.uMmKmfaDxunXA9ucOp35OlaVEIF5mF4_0 2024-09-12T18:10:38.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16822358558135217448', time=2024-09-12T20:07:04.619324+0000, chain.objs.size()=1 2024-09-12T18:10:38.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.037+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.SYekw1EG1-F69sbNRivTtHdGCDXz5Qf_0 2024-09-12T18:10:38.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.041+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4683150882106847974', time=2024-09-12T20:07:04.693162+0000, chain.objs.size()=1 2024-09-12T18:10:38.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.041+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.4T_GDGiSIjG4Yv6lVBv5DzybF_aBzqz_0 2024-09-12T18:10:38.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.041+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5084288476831050857', time=2024-09-12T20:07:49.239062+0000, chain.objs.size()=1 2024-09-12T18:10:38.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.041+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.LZHPpXoZRXKgjEleKQq4kkVuN_BiZn2_0 2024-09-12T18:10:38.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.041+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.049+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:10:38.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.049+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:10:38.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13484198696804575583', time=2024-09-12T20:00:32.441612+0000, chain.objs.size()=1 2024-09-12T18:10:38.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.duVZvT2aUjaKE4cv1sqRbAoTa4Rlp9a_0 2024-09-12T18:10:38.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11910116807374241422', time=2024-09-12T20:00:32.660142+0000, chain.objs.size()=4 2024-09-12T18:10:38.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.10__multipart_foo.2~NiSfyOFPeqixwv9vpimJTzBRJo24RT0.1 2024-09-12T18:10:38.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.10__multipart_foo.2~NiSfyOFPeqixwv9vpimJTzBRJo24RT0.2 2024-09-12T18:10:38.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.10__multipart_foo.2~NiSfyOFPeqixwv9vpimJTzBRJo24RT0.3 2024-09-12T18:10:38.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.10__multipart_foo.2~NiSfyOFPeqixwv9vpimJTzBRJo24RT0.4 2024-09-12T18:10:38.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8118834451365374142', time=2024-09-12T20:00:33.007546+0000, chain.objs.size()=5 2024-09-12T18:10:38.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.1 2024-09-12T18:10:38.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.1_1 2024-09-12T18:10:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.2 2024-09-12T18:10:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.2_1 2024-09-12T18:10:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__multipart_foo-FROZEN.2~2ItDa422rKLl7_QNEbuX0r2LVm57YwB.3 2024-09-12T18:10:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5967462385631925864', time=2024-09-12T20:02:55.339785+0000, chain.objs.size()=1 2024-09-12T18:10:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.v1HHO1oWPpheCOusLl34ZsxtIkqlblj_0 2024-09-12T18:10:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10427671094464522423', time=2024-09-12T20:03:44.241401+0000, chain.objs.size()=1 2024-09-12T18:10:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.053+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.Ie6NStTV2-lLhyqQf7sEK4XLbU3bZrM_0 2024-09-12T18:10:38.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12365494297788293459', time=2024-09-12T20:03:47.874014+0000, chain.objs.size()=1 2024-09-12T18:10:38.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.hrmOdIJEan7TS54IbnwCtXxTgvy3Tgy_0 2024-09-12T18:10:38.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15656047658251257137', time=2024-09-12T20:03:47.979222+0000, chain.objs.size()=1 2024-09-12T18:10:38.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.58PS2eVBYTWIZm_kJGoxtOk2dfT_EuD_0 2024-09-12T18:10:38.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2985786931648474110', time=2024-09-12T20:04:23.411939+0000, chain.objs.size()=1 2024-09-12T18:10:38.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.JSkCB7y0NWIdfpG3K-gPoUmHQPpaFLe_0 2024-09-12T18:10:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.197326839409298523', time=2024-09-12T20:04:23.414465+0000, chain.objs.size()=1 2024-09-12T18:10:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.G-uIAIh2A_I9q-z99HYbGxXGDL1htsR_0 2024-09-12T18:10:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2836649626594874168', time=2024-09-12T20:04:23.416212+0000, chain.objs.size()=1 2024-09-12T18:10:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.itbUQMlHWdWEBionR6aMpHBD_Kv7ets_0 2024-09-12T18:10:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6004664601141738362', time=2024-09-12T20:05:02.869205+0000, chain.objs.size()=1 2024-09-12T18:10:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.S6Q4JyZf63P0PuRxunJetVuaA8xqwXH_0 2024-09-12T18:10:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.539519090070785566', time=2024-09-12T20:05:07.474968+0000, chain.objs.size()=1 2024-09-12T18:10:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.68xa4WVNJXjlECOTSlAk-gLxojqRv5T_0 2024-09-12T18:10:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8115500160556827456', time=2024-09-12T20:05:11.345218+0000, chain.objs.size()=1 2024-09-12T18:10:38.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.-cvEC0jihQzoHzOATcwQCEGphiSnDW0_0 2024-09-12T18:10:38.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7428856031339549627', time=2024-09-12T20:05:11.541029+0000, chain.objs.size()=1 2024-09-12T18:10:38.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.fqvutLBdUzKfRZWIxhTEJbeoptIlgGr_0 2024-09-12T18:10:38.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1039202405368543107', time=2024-09-12T20:07:17.749773+0000, chain.objs.size()=1 2024-09-12T18:10:38.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.057+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.nxpox_45V64JlyZlhL-zd0sJvNJndwi_0 2024-09-12T18:10:38.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.061+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.065+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:10:38.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:10:38.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_dJR4I-omLtfpa9L0mCFqwevKIL6Bq0U', time=2024-09-12T20:00:32.802862+0000, chain.objs.size()=2 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.tbFt8UXttGU8xpN3KJkqxVydKXNWYTm_0 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.tbFt8UXttGU8xpN3KJkqxVydKXNWYTm_1 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3553682366851779580', time=2024-09-12T20:00:33.126261+0000, chain.objs.size()=1 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.ZnOFlPjAaSNHjMP_dU5OYM4UMzl-S5h_0 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.312227648553834751', time=2024-09-12T20:00:33.251857+0000, chain.objs.size()=1 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.7__shadow_.2K7FYwDoZtVdvC0jkboYx1dG-xNKmy0_0 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15036045950663309675', time=2024-09-12T20:02:17.256466+0000, chain.objs.size()=1 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.9vCslbnklJmonlpuTsczy6HgO8kWgl9_0 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15374263626813653111', time=2024-09-12T20:02:20.999604+0000, chain.objs.size()=1 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.K77tGozGmsxLgsc8qtq_MPDj_stDROh_0 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11288414425457447928', time=2024-09-12T20:02:21.146030+0000, chain.objs.size()=1 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_._M3hjFk_rHTAEpZEEXwYIXK3z9W4kdu_0 2024-09-12T18:10:38.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14915355413724618478', time=2024-09-12T20:02:55.294604+0000, chain.objs.size()=1 2024-09-12T18:10:38.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.4MSack3EyZg7yo42JK6w2baLMlDVEjd_0 2024-09-12T18:10:38.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16290217263853679375', time=2024-09-12T20:03:00.348594+0000, chain.objs.size()=1 2024-09-12T18:10:38.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.45huV6gmjpOI7LlXH_wZ8oDFZPkru-r_0 2024-09-12T18:10:38.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11380376912524429599', time=2024-09-12T20:03:00.353036+0000, chain.objs.size()=1 2024-09-12T18:10:38.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.M_qzQZXchjVjmnkF1sFRYl-iKoj9_w3_0 2024-09-12T18:10:38.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8799295718470534492', time=2024-09-12T20:05:11.287098+0000, chain.objs.size()=1 2024-09-12T18:10:38.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.irzvRJsqjxfBv7koECETYHqAojlSePe_0 2024-09-12T18:10:38.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13393288222964575870', time=2024-09-12T20:05:11.518057+0000, chain.objs.size()=1 2024-09-12T18:10:38.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.069+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.922og3PJzHpIYDIeljj5_PSNbXiMIDx_0 2024-09-12T18:10:38.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15786048702732022121', time=2024-09-12T20:05:46.040433+0000, chain.objs.size()=1 2024-09-12T18:10:38.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.Uocypuy3Yrxw8_17vPioufV-SWtnNh2_0 2024-09-12T18:10:38.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11900678886482807498', time=2024-09-12T20:06:25.432176+0000, chain.objs.size()=1 2024-09-12T18:10:38.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.hRNJsjl_VJkksXsPem6Dka2MBvgVMM__0 2024-09-12T18:10:38.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15390344501051791111', time=2024-09-12T20:06:25.455364+0000, chain.objs.size()=1 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.TG5uA7Mglz41snXmpuVkZ9HxlFchOAr_0 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10266580383126213488', time=2024-09-12T20:06:29.920742+0000, chain.objs.size()=1 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.ZO_8IaN_Ei9RT07vVCyA5Zqq1hm9DHG_0 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6578567041792548788', time=2024-09-12T20:07:09.316508+0000, chain.objs.size()=1 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.83bkKt5F_Erepfw9zeuwV8Ee0usSAj0_0 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15278391250096689452', time=2024-09-12T20:07:49.180050+0000, chain.objs.size()=1 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.qadCuJEjEiRF3XUhoREsk7R95hnDntP_0 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11774455082696559951', time=2024-09-12T20:07:49.265706+0000, chain.objs.size()=1 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.F98i4b5p3o-dIsniXMIEMVeI2h8UF3-_0 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1724603679436065421', time=2024-09-12T20:09:57.436407+0000, chain.objs.size()=1 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.GJ84Ed1EVj8BMKhdUHpoyGxUYxieLLp_0 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7009230646016852349', time=2024-09-12T20:09:57.438809+0000, chain.objs.size()=1 2024-09-12T18:10:38.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.073+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.ltUp6bjcvGxelbMVWYeXSIZrGWwghsJ_0 2024-09-12T18:10:38.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.077+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.081+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:10:38.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4770996995207740836', time=2024-09-12T20:00:33.270180+0000, chain.objs.size()=1 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.7__shadow_.SKaZNU49-nShuwK4Q8Ilov4U4xUZQ_L_0 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13224339680765742640', time=2024-09-12T20:04:23.309798+0000, chain.objs.size()=1 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.Z0TYxC8gOZ-1je9-s_P-uaQs59Jbz3b_0 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10540918596697721246', time=2024-09-12T20:04:23.368590+0000, chain.objs.size()=1 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.hY__BWfWsnpjTX6Hb4Fs6g_1DEXxiLY_0 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8624263990393109778', time=2024-09-12T20:05:07.657945+0000, chain.objs.size()=1 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.MxEj9YAsYZ5_q1wVh-9JiMvLcHNVgGY_0 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9061827655308369193', time=2024-09-12T20:05:50.749006+0000, chain.objs.size()=1 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.g5fu0ixqb3C5fGp7MTD8TbEJlafMMK1_0 2024-09-12T18:10:38.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9788464054099186517', time=2024-09-12T20:05:50.798111+0000, chain.objs.size()=1 2024-09-12T18:10:38.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.zyhgZqWDyWeh5TrTF3378elYod4-Y4B_0 2024-09-12T18:10:38.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15114759330604662608', time=2024-09-12T20:06:25.511203+0000, chain.objs.size()=1 2024-09-12T18:10:38.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.YSvnCHo2TtQwg159LfTCOeDjAQSQavp_0 2024-09-12T18:10:38.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1754075181079668053', time=2024-09-12T20:06:29.747911+0000, chain.objs.size()=1 2024-09-12T18:10:38.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.a4FJEi8H2W3sHcfbxCtAozoONpOTfXi_0 2024-09-12T18:10:38.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4748454854751257984', time=2024-09-12T20:06:29.814386+0000, chain.objs.size()=1 2024-09-12T18:10:38.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.gKUPeAwA59CmxxspGtd_0ZjGS3oRmtE_0 2024-09-12T18:10:38.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12107603734352309283', time=2024-09-12T20:06:29.816223+0000, chain.objs.size()=1 2024-09-12T18:10:38.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.Z1fvL4a6XDEgAio9mW8e4IPyFZOmiHV_0 2024-09-12T18:10:38.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.59677141349633709', time=2024-09-12T20:06:29.817739+0000, chain.objs.size()=1 2024-09-12T18:10:38.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.k9xD7TqnrLzxSir4znNsd9xiDNDb5xW_0 2024-09-12T18:10:38.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2323890196070512916', time=2024-09-12T20:07:04.518359+0000, chain.objs.size()=1 2024-09-12T18:10:38.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.085+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.pozzXh-IRNoijIowtvJJZVV4QMnnBL4_0 2024-09-12T18:10:38.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.089+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4876782760153985302', time=2024-09-12T20:07:09.197179+0000, chain.objs.size()=1 2024-09-12T18:10:38.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.089+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.wq4Z-vHVq-uVfxzzxBsYHdnmi_XtRrG_0 2024-09-12T18:10:38.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.089+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13483257163885898663', time=2024-09-12T20:09:57.436883+0000, chain.objs.size()=1 2024-09-12T18:10:38.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.089+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.eagBZVrXZQhczNVhHzmaHgNMbwTZ18n_0 2024-09-12T18:10:38.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.089+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.093+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:10:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:10:38.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12323148661925676772', time=2024-09-12T20:02:21.007119+0000, chain.objs.size()=1 2024-09-12T18:10:38.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.eE1fjn21Dp7aZiF2l4H5oNQXFhhuRk6_0 2024-09-12T18:10:38.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15364291888849580647', time=2024-09-12T20:02:21.186586+0000, chain.objs.size()=1 2024-09-12T18:10:38.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.6XM0iYLY0DeNxnn4g18xzUrfiVW-RKR_0 2024-09-12T18:10:38.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12861763340770615976', time=2024-09-12T20:03:00.326184+0000, chain.objs.size()=1 2024-09-12T18:10:38.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.hdolXOTSb0GCi0u3EDCBB3u3t-VlHrg_0 2024-09-12T18:10:38.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14561207808995494765', time=2024-09-12T20:03:44.363211+0000, chain.objs.size()=1 2024-09-12T18:10:38.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.ZFnmWHY-egWOlf-QlAfxBhxqNFCVNo8_0 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2285692152388070299', time=2024-09-12T20:03:47.867689+0000, chain.objs.size()=1 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.e84UNrft4AlVntIsQ79Z8HlQvSZFrXJ_0 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5552270770547253083', time=2024-09-12T20:03:47.869903+0000, chain.objs.size()=1 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.H5VQADNvz5SnaevJLkTsvI75KzWPROg_0 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7262904403333079071', time=2024-09-12T20:03:47.928204+0000, chain.objs.size()=1 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.tGps0aim9hAnU3cW5IBz-DGSzdwoiyw_0 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13951735199491741352', time=2024-09-12T20:04:28.230860+0000, chain.objs.size()=1 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.Rr71UB36KT6kG9iUMIF3Wb5QnOi5tRJ_0 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17472003337620459071', time=2024-09-12T20:05:02.776055+0000, chain.objs.size()=1 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.oU1JO4XgY_V84N4QneVcwPPPFS_qIG4_0 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11691675303272176778', time=2024-09-12T20:05:46.038933+0000, chain.objs.size()=1 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.GFFkeokUNcsfcno56OJDfxozrLZ6D5Z_0 2024-09-12T18:10:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16837604471312159106', time=2024-09-12T20:05:46.136076+0000, chain.objs.size()=1 2024-09-12T18:10:38.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.MLvTQEyvFOkQ-MXXy0p5hX0hZQSKtP__0 2024-09-12T18:10:38.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3718235920523252234', time=2024-09-12T20:05:50.923368+0000, chain.objs.size()=1 2024-09-12T18:10:38.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.097+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.TtJ8jUyHikpvvs9tLC_1jXNSr-qUyiw_0 2024-09-12T18:10:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.101+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2165426708869049546', time=2024-09-12T20:05:54.432895+0000, chain.objs.size()=1 2024-09-12T18:10:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.101+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.HzssKsMeBjINWkeo-tf83zeTda9L7FJ_0 2024-09-12T18:10:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.101+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11442461966674629895', time=2024-09-12T20:07:09.103064+0000, chain.objs.size()=1 2024-09-12T18:10:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.101+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.RUZkgfS58HNvJCYNJ74FGY_DnfDzbD0_0 2024-09-12T18:10:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.101+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9836822240255461000', time=2024-09-12T20:07:49.016819+0000, chain.objs.size()=1 2024-09-12T18:10:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.101+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.ZynSdddyw053MM6BhfJA3dnsyiXHzj7_0 2024-09-12T18:10:38.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.105+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.109+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:10:38.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T18:10:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8502334837470557288', time=2024-09-12T20:02:17.272467+0000, chain.objs.size()=1 2024-09-12T18:10:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.rfdhei7gLn-XvIsnb4QKbS5oPG3KrrF_0 2024-09-12T18:10:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13038219778631157151', time=2024-09-12T20:03:47.993036+0000, chain.objs.size()=1 2024-09-12T18:10:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.UqOjJZ-TXkos3bYNMndfBpk7MdVPNei_0 2024-09-12T18:10:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4838828328922931005', time=2024-09-12T20:04:23.314853+0000, chain.objs.size()=1 2024-09-12T18:10:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.-lj77Z4I9ipE2olVW0lod9_NKwhZNve_0 2024-09-12T18:10:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.69443017772781140', time=2024-09-12T20:04:23.478363+0000, chain.objs.size()=1 2024-09-12T18:10:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.F-2dAK7QObqowqc2cd-jotnY5td_GL6_0 2024-09-12T18:10:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2425808783003251499', time=2024-09-12T20:04:27.277867+0000, chain.objs.size()=1 2024-09-12T18:10:38.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.zQ8kZtREQBftYRB6xb3yMObMcKQvSGa_0 2024-09-12T18:10:38.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5968111650181417231', time=2024-09-12T20:04:28.267248+0000, chain.objs.size()=1 2024-09-12T18:10:38.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.Rg5iLttECXTe33R8Wyw62sQ09aTTIiP_0 2024-09-12T18:10:38.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11085440194584052888', time=2024-09-12T20:05:02.937052+0000, chain.objs.size()=1 2024-09-12T18:10:38.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.WWSZRpNyGjplK1TVNyiJQ2EIGTQcrLU_0 2024-09-12T18:10:38.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12600699293507523013', time=2024-09-12T20:05:50.796225+0000, chain.objs.size()=1 2024-09-12T18:10:38.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.vSCjikrH4SBkgWJz_lpFSZk01a58iio_0 2024-09-12T18:10:38.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7370305236797594824', time=2024-09-12T20:07:13.686038+0000, chain.objs.size()=1 2024-09-12T18:10:38.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.113+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.nF5AHFGLHfa6EIgWUq2NuRcDGL9aquv_0 2024-09-12T18:10:38.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.117+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.121+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:10:38.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.125+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.125+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:10:38.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1111630227578615648', time=2024-09-12T20:00:32.490956+0000, chain.objs.size()=1 2024-09-12T18:10:38.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.leCSbcdo_FL49MJzMzeFNam_dyO9xM0_0 2024-09-12T18:10:38.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4611836723566762115', time=2024-09-12T20:00:32.605781+0000, chain.objs.size()=4 2024-09-12T18:10:38.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.12__multipart_foo.2~5LsEKCESeAsvAnwaaEcbLGCHrcj2G_1.1 2024-09-12T18:10:38.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.12__multipart_foo.2~5LsEKCESeAsvAnwaaEcbLGCHrcj2G_1.2 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.12__multipart_foo.2~5LsEKCESeAsvAnwaaEcbLGCHrcj2G_1.3 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.12__multipart_foo.2~5LsEKCESeAsvAnwaaEcbLGCHrcj2G_1.4 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17657419800211608556', time=2024-09-12T20:00:33.350034+0000, chain.objs.size()=1 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.8__shadow_.B9rGU7eZFoaRdtTSLuaIO1r6rKNoXyw_0 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3339758312490407837', time=2024-09-12T20:02:55.323102+0000, chain.objs.size()=1 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.GcvcGsk3c5rXwULjU_qgg-mJFpWus8E_0 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12768703755852158871', time=2024-09-12T20:02:55.341966+0000, chain.objs.size()=1 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.rKKWY16ZaE63fRImOzrxdpCF4KxzQvm_0 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4469850541334577803', time=2024-09-12T20:03:44.318418+0000, chain.objs.size()=1 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.wBdv_DIAmEsFRs-FWiHy-TjpZCCPJIC_0 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.997008189762884256', time=2024-09-12T20:03:44.453388+0000, chain.objs.size()=1 2024-09-12T18:10:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.R-lI7IhXypHGQiD1vwHliu488IXGVOn_0 2024-09-12T18:10:38.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17399222017508301847', time=2024-09-12T20:03:48.100740+0000, chain.objs.size()=1 2024-09-12T18:10:38.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.ARDMmZH2iKsMgp72zcNGvHAIkJTufFC_0 2024-09-12T18:10:38.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11518570117178760083', time=2024-09-12T20:05:02.800292+0000, chain.objs.size()=1 2024-09-12T18:10:38.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.129+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.XHMH0EY1MG5KwWB4LaASuXGktoc67cr_0 2024-09-12T18:10:38.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.133+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8942082783079192876', time=2024-09-12T20:05:02.918558+0000, chain.objs.size()=1 2024-09-12T18:10:38.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.133+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.y-EQb-Ie3YSGs4ShOym8VFYe5Ipa2it_0 2024-09-12T18:10:38.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.133+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1068861675861771053', time=2024-09-12T20:05:50.679881+0000, chain.objs.size()=1 2024-09-12T18:10:38.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.133+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.A8Uqn2hr3DZGoaUCE1mzQANqcJnkKw__0 2024-09-12T18:10:38.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.133+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9051821870872098061', time=2024-09-12T20:07:04.489046+0000, chain.objs.size()=1 2024-09-12T18:10:38.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.133+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.mhJ36n_dDTdW88XRy2taHR6b5WNDW35_0 2024-09-12T18:10:38.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.137+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.141+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:10:38.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.141+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:10:38.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9813621727700065608', time=2024-09-12T20:02:17.346815+0000, chain.objs.size()=1 2024-09-12T18:10:38.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.WKLmGYoQT_8B8aVv9YQN2zKG4SDZyg2_0 2024-09-12T18:10:38.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7127925001826862449', time=2024-09-12T20:03:39.413123+0000, chain.objs.size()=1 2024-09-12T18:10:38.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.RekkHWLG2GHMzRSXWn1ie9IKgkZuRSg_0 2024-09-12T18:10:38.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7462779432420034594', time=2024-09-12T20:04:23.313802+0000, chain.objs.size()=1 2024-09-12T18:10:38.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.01Fx_Kr2ULreo4F_FE74OYozdTcmKmV_0 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8284906405969743547', time=2024-09-12T20:04:23.468462+0000, chain.objs.size()=1 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.wBsIa9c0xJBVRRIeg8jy9oe4ndDSdfk_0 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18380024430111683911', time=2024-09-12T20:05:02.882711+0000, chain.objs.size()=1 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.kGIO7oaNicDv9pIx66vmfdvgWia_wHY_0 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10799709785316236339', time=2024-09-12T20:05:07.614753+0000, chain.objs.size()=1 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.-EGk98MEvNlnm7ycUcmTke8d4gkPjzZ_0 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16059493070779912277', time=2024-09-12T20:05:46.128550+0000, chain.objs.size()=1 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.XXFzJ-zBPgkco2V6SD4mq16LXAbIcj3_0 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.33084016168372251', time=2024-09-12T20:05:46.130777+0000, chain.objs.size()=1 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.0Jj0OrD1940KmgrwLTCIRmmy8zfizOL_0 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1762773142034979061', time=2024-09-12T20:05:50.758736+0000, chain.objs.size()=1 2024-09-12T18:10:38.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.3pRqKP-fB04cEDju3klZ8IL_XlRe_SY_0 2024-09-12T18:10:38.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6386129274929867975', time=2024-09-12T20:05:50.931181+0000, chain.objs.size()=1 2024-09-12T18:10:38.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.IQX1Y4yxkPZHmYYohdzDSFCJqwiODP6_0 2024-09-12T18:10:38.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6956918842806355086', time=2024-09-12T20:06:29.794193+0000, chain.objs.size()=1 2024-09-12T18:10:38.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.o7m2kX7wvLocxdtG51Y0m2qOVmmw-___0 2024-09-12T18:10:38.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5078437186641409737', time=2024-09-12T20:07:49.177770+0000, chain.objs.size()=1 2024-09-12T18:10:38.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.145+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.am8dt307pFB8eCiIYeEbwIAE5abY6XE_0 2024-09-12T18:10:38.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.149+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.153+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:10:38.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:10:38.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5695388958250793149', time=2024-09-12T20:00:32.550280+0000, chain.objs.size()=4 2024-09-12T18:10:38.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.11__multipart_foo.2~PcoUWEQ8Wd8GW4z5OLqGXC8_xL7GXVf.1 2024-09-12T18:10:38.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.11__multipart_foo.2~PcoUWEQ8Wd8GW4z5OLqGXC8_xL7GXVf.2 2024-09-12T18:10:38.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.11__multipart_foo.2~PcoUWEQ8Wd8GW4z5OLqGXC8_xL7GXVf.3 2024-09-12T18:10:38.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.11__multipart_foo.2~PcoUWEQ8Wd8GW4z5OLqGXC8_xL7GXVf.4 2024-09-12T18:10:38.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14454745463293996772', time=2024-09-12T20:00:33.134625+0000, chain.objs.size()=3 2024-09-12T18:10:38.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.r7SoinjzzrPl0OVzlwgZ3rZMzZ4rvq__0 2024-09-12T18:10:38.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.r7SoinjzzrPl0OVzlwgZ3rZMzZ4rvq__1 2024-09-12T18:10:38.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.13__shadow_.r7SoinjzzrPl0OVzlwgZ3rZMzZ4rvq__2 2024-09-12T18:10:38.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2129146436778764896', time=2024-09-12T20:02:17.336606+0000, chain.objs.size()=1 2024-09-12T18:10:38.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.PhwURTdW5Xmrngyf5ca62JvPZ3rhFhV_0 2024-09-12T18:10:38.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12518483196444578251', time=2024-09-12T20:03:00.490824+0000, chain.objs.size()=1 2024-09-12T18:10:38.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.gKHPEfG_tRKEaGVybMdRqPGFwicm8TM_0 2024-09-12T18:10:38.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6911810926503386858', time=2024-09-12T20:03:39.515392+0000, chain.objs.size()=1 2024-09-12T18:10:38.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_._tpgvNR4KoR7Kj2aEcFBb9jaVOW-JUy_0 2024-09-12T18:10:38.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5869116872230603490', time=2024-09-12T20:03:39.570319+0000, chain.objs.size()=1 2024-09-12T18:10:38.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.l_r9FsqArUGpPS6xZ-_1iaAzbsYUthu_0 2024-09-12T18:10:38.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2790975100887366896', time=2024-09-12T20:04:28.098288+0000, chain.objs.size()=1 2024-09-12T18:10:38.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.157+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.OakjkbYTt1IO8ugfHgMph1WL3SVb5mb_0 2024-09-12T18:10:38.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15404345916241147515', time=2024-09-12T20:05:02.935503+0000, chain.objs.size()=1 2024-09-12T18:10:38.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.thJ9xJnDYIVNnq3hYvKBFQuz__IMD7L_0 2024-09-12T18:10:38.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12268416013666868150', time=2024-09-12T20:05:07.487893+0000, chain.objs.size()=1 2024-09-12T18:10:38.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.C-hC-uPaBwz_2NY9hano-WsgOSQA5KA_0 2024-09-12T18:10:38.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5406592584061048164', time=2024-09-12T20:05:50.747252+0000, chain.objs.size()=1 2024-09-12T18:10:38.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.JjRM4gfdcsIwkYpQ2J0njw2DMsf0Gro_0 2024-09-12T18:10:38.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7921809672927326852', time=2024-09-12T20:06:25.510901+0000, chain.objs.size()=1 2024-09-12T18:10:38.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.-5e-f5GB3aP6Rzv4il6AmK62-_2V2Lv_0 2024-09-12T18:10:38.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1289001154884612308', time=2024-09-12T20:07:49.079270+0000, chain.objs.size()=1 2024-09-12T18:10:38.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.o-C9M4JiZxvGtMJEIRQgx5YX_E1acnG_0 2024-09-12T18:10:38.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17258348182528326529', time=2024-09-12T20:07:49.251341+0000, chain.objs.size()=1 2024-09-12T18:10:38.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.yKqTb6yqV_It5vDq71yTjiLK19Ad78K_0 2024-09-12T18:10:38.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2103060418059507564', time=2024-09-12T20:09:57.366207+0000, chain.objs.size()=1 2024-09-12T18:10:38.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.161+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.17__shadow_.zc_hS84Gx5MZgt-WnVcrZb4lAAzmDq4_0 2024-09-12T18:10:38.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.165+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.169+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:10:38.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:10:38.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2913524299468264041', time=2024-09-12T20:00:33.332946+0000, chain.objs.size()=1 2024-09-12T18:10:38.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.8__shadow_.973UGN8BYFR0e280L1IOGefJqziWid5_0 2024-09-12T18:10:38.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.998451569914939099', time=2024-09-12T20:02:17.252743+0000, chain.objs.size()=1 2024-09-12T18:10:38.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.HoYSPM_v025GbghRLoMYGyFoAI_IU_r_0 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15797552735956922246', time=2024-09-12T20:02:17.335453+0000, chain.objs.size()=1 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.OjP-1L4h_B1AKDsVddMuFKMJnQ_Qyew_0 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15029102781048277105', time=2024-09-12T20:03:04.449919+0000, chain.objs.size()=1 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.VIGvMyHHg1x9zWttRLmlyaf_kogmFUr_0 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4943485636068568072', time=2024-09-12T20:03:39.369891+0000, chain.objs.size()=1 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.k8_LK9flfMvjTBMbbPjwba12tP65ral_0 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5892896082470621475', time=2024-09-12T20:03:44.358709+0000, chain.objs.size()=1 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.60ehdbIFmt6A_Nigeo6SdIL9tnxTgEB_0 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1794780044991057884', time=2024-09-12T20:03:48.007643+0000, chain.objs.size()=1 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.UTP5Dj-ECu5CA97VwDsjoRf4AmiFVvp_0 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6623354409292865906', time=2024-09-12T20:03:48.102270+0000, chain.objs.size()=1 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.Rbo07FiQpSIrJBhjOikdL5ZGJOi49fS_0 2024-09-12T18:10:38.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1858716021191814710', time=2024-09-12T20:04:28.242067+0000, chain.objs.size()=1 2024-09-12T18:10:38.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.SVa-83-P4N2Fot2-LVG3kG0Gp2eyRVJ_0 2024-09-12T18:10:38.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14666991656223817896', time=2024-09-12T20:05:02.939380+0000, chain.objs.size()=1 2024-09-12T18:10:38.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.1lOdktEn4RittLQu5aaQhr-P_ZYt7Is_0 2024-09-12T18:10:38.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15303235236158864768', time=2024-09-12T20:05:07.444823+0000, chain.objs.size()=1 2024-09-12T18:10:38.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.IIpd6z8ql7EURkZkDKRZpn_b8T8TYZa_0 2024-09-12T18:10:38.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18395557779781791872', time=2024-09-12T20:05:07.479409+0000, chain.objs.size()=1 2024-09-12T18:10:38.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.173+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.6GA4cFX6N6UAQAECNl49eYoULmc4cIe_0 2024-09-12T18:10:38.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.177+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7450843307071470892', time=2024-09-12T20:05:11.390408+0000, chain.objs.size()=1 2024-09-12T18:10:38.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.177+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.ymFFCWgIzSch1CQSxcqySle3obJLmVA_0 2024-09-12T18:10:38.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.177+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4603995716224753009', time=2024-09-12T20:05:46.141452+0000, chain.objs.size()=1 2024-09-12T18:10:38.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.177+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.VsctoVA4r-fe7Oi2J2pcPT0iEB4Y8TG_0 2024-09-12T18:10:38.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.177+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4139109677924368784', time=2024-09-12T20:05:50.860987+0000, chain.objs.size()=1 2024-09-12T18:10:38.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.177+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.33__shadow_.tiZUZDoms5ObCuKO2_JV3gMAyq-LHQB_0 2024-09-12T18:10:38.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.177+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7140409349681103415', time=2024-09-12T20:07:04.543779+0000, chain.objs.size()=1 2024-09-12T18:10:38.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.177+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.Xh9TjjCC7FBGPl9P3RS0NGdMb8bs5GF_0 2024-09-12T18:10:38.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.177+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14856713142105850428', time=2024-09-12T20:10:11.469061+0000, chain.objs.size()=1 2024-09-12T18:10:38.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.177+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.18__shadow:4LY5p4UM1LM8QBO1xqFPIMM20uZ4ZLE_.YNTw-7d4b0srTWy4_GP90C9qcYkODnX_0 2024-09-12T18:10:38.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.181+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.185+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:10:38.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.185+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:10:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17414687546966586809', time=2024-09-12T20:00:32.834962+0000, chain.objs.size()=1 2024-09-12T18:10:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.15__shadow_.L91j6dMx7IqIlPg-nkXAWH8KCzRmS5I_0 2024-09-12T18:10:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17785486640426749217', time=2024-09-12T20:02:17.346825+0000, chain.objs.size()=1 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.wSFdAG-Q1plHTbvsdYeCvp75wRQtsNo_0 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8062212363487883982', time=2024-09-12T20:02:21.145905+0000, chain.objs.size()=1 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.WUVP6M01gxry9fPUMCg5AnnuHiXhpJZ_0 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5020885888202841971', time=2024-09-12T20:02:55.372748+0000, chain.objs.size()=1 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.x18ThFDDV_eA85duOhD3lc9fXDR_SzR_0 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13302887913627242161', time=2024-09-12T20:02:55.374516+0000, chain.objs.size()=1 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.p03yrkZ49i_PS6DpBaMZPn-rr_8XQ9Q_0 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7516921885276812067', time=2024-09-12T20:03:00.348826+0000, chain.objs.size()=1 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.RE7CDiLbS2TScXogorJuFD9km4Et8YX_0 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2923403012007713451', time=2024-09-12T20:03:00.350840+0000, chain.objs.size()=1 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.peEgdDwnY_Q_6jl4Y3dvhkQiRIWiOqh_0 2024-09-12T18:10:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17282587279990388076', time=2024-09-12T20:03:39.409961+0000, chain.objs.size()=1 2024-09-12T18:10:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.PwN5-QqSGX2BTeOq8_1poXma1DSU_lY_0 2024-09-12T18:10:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5705364411390649303', time=2024-09-12T20:05:07.474985+0000, chain.objs.size()=1 2024-09-12T18:10:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.YpzBNEI2jALddo4rAwv0IxdDfQSP55l_0 2024-09-12T18:10:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9627776722803484549', time=2024-09-12T20:05:46.040394+0000, chain.objs.size()=1 2024-09-12T18:10:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.vZMagnZYw7hLDaEtTZ7673kRPkG0pXu_0 2024-09-12T18:10:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1691444951726933300', time=2024-09-12T20:06:25.345480+0000, chain.objs.size()=1 2024-09-12T18:10:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.B4zfICOaDxBqlfCo4WwX6Oyyl6vOA9g_0 2024-09-12T18:10:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3550494174794051390', time=2024-09-12T20:06:29.919386+0000, chain.objs.size()=1 2024-09-12T18:10:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.189+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.35__shadow_.wQrX4wgYNYowfO8NEDxwCshW7l8XZ6U_0 2024-09-12T18:10:38.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.193+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4690499012324837725', time=2024-09-12T20:07:04.677214+0000, chain.objs.size()=1 2024-09-12T18:10:38.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.193+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.Xq1k0LYGdIGpp10XvgEgS08L-hfp5DI_0 2024-09-12T18:10:38.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.193+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3818024135466486303', time=2024-09-12T20:07:09.088018+0000, chain.objs.size()=1 2024-09-12T18:10:38.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.193+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.NSgFDHY3CLT3zOrbP16S3Ni7spAZ6cn_0 2024-09-12T18:10:38.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.193+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.197+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:10:38.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.201+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:10:38.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10172815200426381920', time=2024-09-12T20:00:33.072284+0000, chain.objs.size()=5 2024-09-12T18:10:38.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-LUKEWARM.2~WS3ZJtNM8mXYjaDON8AukbLXHZQTwFk.1 2024-09-12T18:10:38.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.14__shadow_foo-LUKEWARM.2~WS3ZJtNM8mXYjaDON8AukbLXHZQTwFk.1_1 2024-09-12T18:10:38.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-LUKEWARM.2~WS3ZJtNM8mXYjaDON8AukbLXHZQTwFk.2 2024-09-12T18:10:38.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.14__shadow_foo-LUKEWARM.2~WS3ZJtNM8mXYjaDON8AukbLXHZQTwFk.2_1 2024-09-12T18:10:38.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-LUKEWARM.2~WS3ZJtNM8mXYjaDON8AukbLXHZQTwFk.3 2024-09-12T18:10:38.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14091609435288274277', time=2024-09-12T20:04:23.251489+0000, chain.objs.size()=1 2024-09-12T18:10:38.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.uOYefnd5fWxMOJVpmGuJIulZwqjMtMQ_0 2024-09-12T18:10:38.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1913189891351035926', time=2024-09-12T20:04:28.151317+0000, chain.objs.size()=1 2024-09-12T18:10:38.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.ijeKainPnSpuMBfJwFVcEpBzGARHRXA_0 2024-09-12T18:10:38.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3366004416630950860', time=2024-09-12T20:05:02.870818+0000, chain.objs.size()=1 2024-09-12T18:10:38.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.WVQ5wDuT51xEpbu1I4Mwx-zgW9_QRKB_0 2024-09-12T18:10:38.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15920214465709057044', time=2024-09-12T20:07:04.537903+0000, chain.objs.size()=1 2024-09-12T18:10:38.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.RcqwOuliV7D9M-5aszp6phBsTDAB9ts_0 2024-09-12T18:10:38.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8391887259213150643', time=2024-09-12T20:07:09.139295+0000, chain.objs.size()=1 2024-09-12T18:10:38.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.ZN84GYYnBdiV_8lHd4jjFrgjsX__35U_0 2024-09-12T18:10:38.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10264356689357006600', time=2024-09-12T20:07:09.227676+0000, chain.objs.size()=1 2024-09-12T18:10:38.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.205+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.DNavePtFXtQfSM3ed2E-DjONBBjMzQk_0 2024-09-12T18:10:38.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.209+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.217+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:10:38.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:10:38.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2508801334625034265', time=2024-09-12T20:00:32.500751+0000, chain.objs.size()=1 2024-09-12T18:10:38.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.4__shadow_.uq8c7yPbUx4twj4u03xdxIyIvxXTphz_0 2024-09-12T18:10:38.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2257975663277275958', time=2024-09-12T20:02:21.186709+0000, chain.objs.size()=1 2024-09-12T18:10:38.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.kvr7NEqnHPJ_m8rEhVjvzB_QzTXOYxr_0 2024-09-12T18:10:38.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11425928691401044297', time=2024-09-12T20:02:55.284499+0000, chain.objs.size()=1 2024-09-12T18:10:38.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.8NrWLWT-3ZERQmILSE3GTNXltgTT3_k_0 2024-09-12T18:10:38.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10048125165086255986', time=2024-09-12T20:02:55.372922+0000, chain.objs.size()=1 2024-09-12T18:10:38.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.21__shadow_.P8mKWCUBst4rSMXG9OyzBL-SvYKh3JU_0 2024-09-12T18:10:38.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1433145940147273077', time=2024-09-12T20:03:04.465063+0000, chain.objs.size()=1 2024-09-12T18:10:38.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.AdJf97eXMu4zVxY7yAgN8imVKlL6Uir_0 2024-09-12T18:10:38.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14594207823536130662', time=2024-09-12T20:04:23.419578+0000, chain.objs.size()=1 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.27__shadow_.dvkY8wfcqsIyL3iEzG2i4yBWyXzIqqt_0 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8695366922936122204', time=2024-09-12T20:04:28.160090+0000, chain.objs.size()=1 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.j-pusuudbKPziXH30BFe_3Jr051uW44_0 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15117917090433471335', time=2024-09-12T20:05:11.289487+0000, chain.objs.size()=1 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.aUY3qSlrm2Sr-RAwetg0oD28Qyf3Yde_0 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1386335255702517142', time=2024-09-12T20:05:46.124560+0000, chain.objs.size()=1 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.INzUVYweMAkDDw6DOtNIZNRlY3vkv92_0 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10131126948812486199', time=2024-09-12T20:05:46.250578+0000, chain.objs.size()=1 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.32__shadow_.8a2LBT4vGqIhulq8PSsk0IyxuHQlO1L_0 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8581122284702534191', time=2024-09-12T20:06:25.336334+0000, chain.objs.size()=1 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.VJu9lFimpiuMaR8Y_Rjs7mkxVCJd_Lw_0 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12489754362735186574', time=2024-09-12T20:07:04.520231+0000, chain.objs.size()=1 2024-09-12T18:10:38.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.221+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.BD-BE10rneOUpp0EY4OuvHPFnvrJM43_0 2024-09-12T18:10:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.225+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1397879146535824947', time=2024-09-12T20:07:08.306539+0000, chain.objs.size()=1 2024-09-12T18:10:38.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.225+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_._WyrECySuIZMB8bNakMN3r3nsWS6OCA_0 2024-09-12T18:10:38.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.229+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.233+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:10:38.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.237+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.237+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:10:38.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='_f3fECEKfLin08BlkGEHpOBL0xxWItD_', time=2024-09-12T20:00:32.947554+0000, chain.objs.size()=3 2024-09-12T18:10:38.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.dTOFPhnZYnPcK0vQ58bxc7unZ52AGWV_0 2024-09-12T18:10:38.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.dTOFPhnZYnPcK0vQ58bxc7unZ52AGWV_1 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.16__shadow_.dTOFPhnZYnPcK0vQ58bxc7unZ52AGWV_2 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.578609018608915390', time=2024-09-12T20:02:21.078696+0000, chain.objs.size()=1 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.Yg5gkj4u5wg38_SVsHddGEnccynk_YO_0 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12596196268527372913', time=2024-09-12T20:03:04.449961+0000, chain.objs.size()=1 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.GiW_JrdEBmPS6K0gVerHmPSdbhU_y2i_0 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17033301005687438695', time=2024-09-12T20:03:39.455809+0000, chain.objs.size()=1 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.KIG8RPU8gzw6pvGLTgFWjN_SUDjTnjo_0 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12071259681498553727', time=2024-09-12T20:03:44.425006+0000, chain.objs.size()=1 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.25__shadow_.hQ3MPK3sDb7_166EUik8KBjLr_6edAm_0 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5948917671238906992', time=2024-09-12T20:04:28.030798+0000, chain.objs.size()=1 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.wLx9gTt48ml0moRgZufhxIAwUFwKabG_0 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6600343486667463166', time=2024-09-12T20:04:28.151249+0000, chain.objs.size()=1 2024-09-12T18:10:38.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.28__shadow_.wZYxNcYpW9ZanHN-4hGYTHo4r30tM5W_0 2024-09-12T18:10:38.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4298459576002864664', time=2024-09-12T20:05:02.939382+0000, chain.objs.size()=1 2024-09-12T18:10:38.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.462qufw1SvbMX8oajK5UFIc007DYOw2_0 2024-09-12T18:10:38.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8290831078397380936', time=2024-09-12T20:05:03.016848+0000, chain.objs.size()=1 2024-09-12T18:10:38.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.Vgi0gqt0B__fIDtSCMoOmsUgl73edG6_0 2024-09-12T18:10:38.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5252336295062332332', time=2024-09-12T20:05:07.534654+0000, chain.objs.size()=1 2024-09-12T18:10:38.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.241+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.SkpJvDVz5ubjgRNtaW_-67b3GSdKWtx_0 2024-09-12T18:10:38.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.245+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12666498919994021300', time=2024-09-12T20:06:33.064864+0000, chain.objs.size()=1 2024-09-12T18:10:38.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.245+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.m7OrCr_H7Bff03IE-TMnMS-i2Dmu9if_0 2024-09-12T18:10:38.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.245+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8342244470498314325', time=2024-09-12T20:07:04.611872+0000, chain.objs.size()=1 2024-09-12T18:10:38.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.245+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.36__shadow_.h1xhPI26MORnk0hTFl_30Tyvs4Z17D__0 2024-09-12T18:10:38.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.245+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13226438847426164611', time=2024-09-12T20:07:09.099513+0000, chain.objs.size()=1 2024-09-12T18:10:38.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.245+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.37__shadow_.41rNF508EjY6Zm8A3Z4Yhs0y8DerWlm_0 2024-09-12T18:10:38.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.245+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7355717534657031731', time=2024-09-12T20:07:13.552076+0000, chain.objs.size()=1 2024-09-12T18:10:38.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.245+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.zklj2eI4NrrWAZznjgJwePGu2T0L9L9_0 2024-09-12T18:10:38.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.249+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.253+0000 7ffbe51759c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:10:38.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:10:38.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8201583057673181567', time=2024-09-12T20:00:32.717493+0000, chain.objs.size()=7 2024-09-12T18:10:38.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.9__multipart_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.1 2024-09-12T18:10:38.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.9__shadow_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.1_1 2024-09-12T18:10:38.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.9__multipart_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.2 2024-09-12T18:10:38.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.9__shadow_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.2_1 2024-09-12T18:10:38.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.9__multipart_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.3 2024-09-12T18:10:38.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.9__shadow_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.3_1 2024-09-12T18:10:38.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.9__multipart_foo.2~d_zcxQz_NAvAwvQOrwg6j703QfirsXx.4 2024-09-12T18:10:38.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8375536079092993533', time=2024-09-12T20:00:33.054320+0000, chain.objs.size()=5 2024-09-12T18:10:38.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-FROZEN.2~LcLHGGm-AZzRLkGGfd2MRBetIDLPUp2.1 2024-09-12T18:10:38.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.14__shadow_foo-FROZEN.2~LcLHGGm-AZzRLkGGfd2MRBetIDLPUp2.1_1 2024-09-12T18:10:38.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-FROZEN.2~LcLHGGm-AZzRLkGGfd2MRBetIDLPUp2.2 2024-09-12T18:10:38.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.14__shadow_foo-FROZEN.2~LcLHGGm-AZzRLkGGfd2MRBetIDLPUp2.2_1 2024-09-12T18:10:38.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.257+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.14__multipart_foo-FROZEN.2~LcLHGGm-AZzRLkGGfd2MRBetIDLPUp2.3 2024-09-12T18:10:38.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14341129183692990171', time=2024-09-12T20:00:33.279877+0000, chain.objs.size()=1 2024-09-12T18:10:38.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.7__shadow_.7aQIgdM6ObjG4zeArliW1xbargqnEC6_0 2024-09-12T18:10:38.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12692299619655575793', time=2024-09-12T20:02:17.256475+0000, chain.objs.size()=1 2024-09-12T18:10:38.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.19__shadow_.hj90EksnJYJulI3XKxvzRkQBxrZAL2n_0 2024-09-12T18:10:38.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2562888096352564089', time=2024-09-12T20:02:21.279389+0000, chain.objs.size()=1 2024-09-12T18:10:38.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.20__shadow_.cKdPFY6tvznsSI5Lu4DSpGEEenBD2ci_0 2024-09-12T18:10:38.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12619795945582002839', time=2024-09-12T20:03:00.348744+0000, chain.objs.size()=1 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.22__shadow_.hCyh8iCbBE3N2AOfMvnt_8YDc2AZI4t_0 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2629152162762049492', time=2024-09-12T20:03:04.406317+0000, chain.objs.size()=1 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.23__shadow_.JC0QqUTtDNhuj9qsQbohCCstG1nfrz3_0 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7090245442063807146', time=2024-09-12T20:03:39.410062+0000, chain.objs.size()=1 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.24__shadow_.B4yYadYY1QP4CxICwbVBWwibE5wSQQL_0 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11391751337654473009', time=2024-09-12T20:03:47.893199+0000, chain.objs.size()=1 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.alsgnupnIALsh6aNHh1t3UYRAmYt_90_0 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4760021206291803716', time=2024-09-12T20:03:47.895615+0000, chain.objs.size()=1 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.26__shadow_.LNAb5IdIntrsPf2jeXvtjM0kCPRMJzS_0 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15242978750727005725', time=2024-09-12T20:05:02.791223+0000, chain.objs.size()=1 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.29__shadow_.eDloZiXkhOcMzyvizOxanwg8gdtPzkI_0 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18290133763434389321', time=2024-09-12T20:05:07.474810+0000, chain.objs.size()=1 2024-09-12T18:10:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.30__shadow_.8bwDSm9txwn36vn3pX66bTbrOmyAl1__0 2024-09-12T18:10:38.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17435629866158014674', time=2024-09-12T20:05:11.343585+0000, chain.objs.size()=1 2024-09-12T18:10:38.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.265+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.1WVA8Z-Bwd6pjVktJGviZmsu-bGYlJa_0 2024-09-12T18:10:38.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.269+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.402114254307789524', time=2024-09-12T20:05:11.345630+0000, chain.objs.size()=1 2024-09-12T18:10:38.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.269+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.31__shadow_.ksIzypSGyjQA7hWLR1AUySrMrxmhfRa_0 2024-09-12T18:10:38.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.269+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11518295537770822697', time=2024-09-12T20:06:25.381746+0000, chain.objs.size()=1 2024-09-12T18:10:38.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.269+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.B4woM-Vkf1QyqDVJ7fnSWB2D28T0iGD_0 2024-09-12T18:10:38.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.269+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16517994935980713897', time=2024-09-12T20:06:25.384252+0000, chain.objs.size()=1 2024-09-12T18:10:38.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.269+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.34__shadow_.Y5LAqDv_kDOKSusSbcWq7VcTm7L3qyo_0 2024-09-12T18:10:38.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.269+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5870531776526651553', time=2024-09-12T20:07:13.417358+0000, chain.objs.size()=1 2024-09-12T18:10:38.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.269+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.38__shadow_.26terVAVLRFC66X4Lmga1EFNP2CZjbq_0 2024-09-12T18:10:38.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.269+0000 7ffbe51759c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5878503938163809921', time=2024-09-12T20:07:49.088495+0000, chain.objs.size()=1 2024-09-12T18:10:38.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.269+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.39__shadow_.yzxmv-__YiBCy4OvTEgoO4hfZiEgcdW_0 2024-09-12T18:10:38.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.273+0000 7ffbe51759c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:10:38.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.281+0000 7ffa997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:38.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.285+0000 7ffbe51759c0 20 remove_watcher() i=0 2024-09-12T18:10:38.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.285+0000 7ffbe51759c0 2 removed watcher, disabling cache 2024-09-12T18:10:38.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.285+0000 7ffbe51759c0 20 remove_watcher() i=1 2024-09-12T18:10:38.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.289+0000 7ffbe51759c0 20 remove_watcher() i=2 2024-09-12T18:10:38.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.289+0000 7ffbe51759c0 20 remove_watcher() i=3 2024-09-12T18:10:38.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.293+0000 7ffbe51759c0 20 remove_watcher() i=4 2024-09-12T18:10:38.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.293+0000 7ffbe51759c0 20 remove_watcher() i=5 2024-09-12T18:10:38.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.297+0000 7ffbe51759c0 20 remove_watcher() i=6 2024-09-12T18:10:38.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.297+0000 7ffbe51759c0 20 remove_watcher() i=7 2024-09-12T18:10:38.319 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:10:38.393 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:38.393 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:38.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.437+0000 7f3b7c9909c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.437+0000 7f3b7c9909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.437+0000 7f3b7c9909c0 20 realm 2024-09-12T18:10:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.437+0000 7f3b7c9909c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.441+0000 7f3b7c9909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.441+0000 7f3b7c9909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:38.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.441+0000 7f3b7c9909c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:38.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.441+0000 7f3b7c9909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:38.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.441+0000 7f3b7c9909c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.441+0000 7f3b7c9909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.441+0000 7f3b7c9909c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:38.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.441+0000 7f3b7c9909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:38.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.441+0000 7f3b7c9909c0 20 searching for the correct realm 2024-09-12T18:10:38.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.449+0000 7f3b79c95640 0 -- 172.21.15.97:0/308332472 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f3b70107bd0 msgr2=0x7f3b700b89a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:10:38.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.661+0000 7f3b7ac97640 0 -- 172.21.15.97:0/308332472 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55bfcc5667d0 msgr2=0x55bfcc568c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:38.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.673+0000 7f3b7c9909c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:10:38.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.673+0000 7f3b7c9909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:38.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.673+0000 7f3b7c9909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:38.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.673+0000 7f3b7c9909c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:10:38.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.673+0000 7f3b7c9909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:38.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.673+0000 7f3b7c9909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:38.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.673+0000 7f3b7c9909c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:38.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:38.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:38.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:38.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:38.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:38.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 20 zone default found 2024-09-12T18:10:38.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 4 Realm: () 2024-09-12T18:10:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:10:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:10:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 20 zonegroup default 2024-09-12T18:10:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:38.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.677+0000 7f3b7c9909c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:38.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.681+0000 7f3b7c9909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:38.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.681+0000 7f3b7c9909c0 20 rados->read ofs=0 len=0 2024-09-12T18:10:38.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.681+0000 7f3b7c9909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:38.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.681+0000 7f3b7c9909c0 20 started sync module instance, tier type = 2024-09-12T18:10:38.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.681+0000 7f3b7c9909c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:10:38.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.701+0000 7f3b7c9909c0 20 add_watcher() i=0 2024-09-12T18:10:38.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.701+0000 7f3b7c9909c0 20 add_watcher() i=1 2024-09-12T18:10:38.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.701+0000 7f3b7c9909c0 20 add_watcher() i=2 2024-09-12T18:10:38.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.701+0000 7f3b7c9909c0 20 add_watcher() i=3 2024-09-12T18:10:38.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.701+0000 7f3b7c9909c0 20 add_watcher() i=4 2024-09-12T18:10:38.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.701+0000 7f3b7c9909c0 20 add_watcher() i=5 2024-09-12T18:10:38.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.701+0000 7f3b7c9909c0 20 add_watcher() i=6 2024-09-12T18:10:38.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.705+0000 7f3b7c9909c0 20 add_watcher() i=7 2024-09-12T18:10:38.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.705+0000 7f3b7c9909c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:38.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.709+0000 7f3a317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:38.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.709+0000 7f3b7c9909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:38.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.709+0000 7f3b7c9909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:38.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.801+0000 7f3a2b7fe640 20 reqs_thread_entry: start 2024-09-12T18:10:38.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.801+0000 7f3b7c9909c0 20 init_complete bucket index max shards: 11 2024-09-12T18:10:38.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.801+0000 7f3b7c9909c0 20 Filter name: none 2024-09-12T18:10:38.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.805+0000 7f3a297fa640 20 reqs_thread_entry: start 2024-09-12T18:10:38.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.805+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:10:38.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.805+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.809+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.809+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.813+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:10:38.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.817+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.817+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.817+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.821+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:10:38.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.821+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.825+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.825+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.825+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:10:38.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.829+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.829+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.829+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.833+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:10:38.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.837+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.837+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.837+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.837+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:10:38.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.845+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.845+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.845+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.849+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:10:38.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.853+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.853+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.853+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.857+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:10:38.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.861+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.861+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.861+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.865+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:10:38.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.865+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.869+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.869+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.869+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:10:38.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.873+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.877+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.877+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.877+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:10:38.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.881+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.881+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.881+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.885+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:10:38.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.889+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.889+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.889+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.893+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:10:38.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.897+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.897+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.897+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.901+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:10:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.905+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.905+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.905+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.909+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:10:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.913+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.913+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.913+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.917+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:10:38.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.921+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.921+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.921+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.925+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:10:38.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.929+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.929+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.929+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.929+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:10:38.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.933+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.937+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.937+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.941+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:10:38.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.941+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.945+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.945+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.945+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:10:38.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.949+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.949+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.949+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.953+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:10:38.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.957+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.957+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.957+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.961+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:10:38.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.965+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.965+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.969+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.969+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:10:38.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.973+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.977+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.977+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.981+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:10:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.985+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.985+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.985+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.989+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:10:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.993+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.993+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:38.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.993+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:38.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:38.997+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:10:39.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.001+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.001+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:39.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.001+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.005+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:10:39.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.009+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.009+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:39.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.009+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.013+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:10:39.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.017+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.017+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:39.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.021+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.021+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:10:39.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.025+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.029+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:39.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.029+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.033+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:10:39.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.037+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.037+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:39.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.037+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.041+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:10:39.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.045+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.049+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:39.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.049+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.053+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:10:39.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.053+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.057+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:10:39.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.057+0000 7f3b7c9909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:10:39.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.061+0000 7f3a317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:39.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.069+0000 7f3b7c9909c0 20 remove_watcher() i=0 2024-09-12T18:10:39.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.069+0000 7f3b7c9909c0 2 removed watcher, disabling cache 2024-09-12T18:10:39.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.069+0000 7f3b7c9909c0 20 remove_watcher() i=1 2024-09-12T18:10:39.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.073+0000 7f3b7c9909c0 20 remove_watcher() i=2 2024-09-12T18:10:39.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.077+0000 7f3b7c9909c0 20 remove_watcher() i=3 2024-09-12T18:10:39.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.077+0000 7f3b7c9909c0 20 remove_watcher() i=4 2024-09-12T18:10:39.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.081+0000 7f3b7c9909c0 20 remove_watcher() i=5 2024-09-12T18:10:39.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.081+0000 7f3b7c9909c0 20 remove_watcher() i=6 2024-09-12T18:10:39.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:10:39.085+0000 7f3b7c9909c0 20 remove_watcher() i=7 2024-09-12T18:10:39.109 DEBUG:teuthology.orchestra.run.smithi097:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T18:10:39.714 INFO:teuthology.orchestra.run.smithi097.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T18:10:44.611 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :clean UP-TO-DATE 2024-09-12T18:11:03.010 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileJava 2024-09-12T18:11:03.010 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processResources 2024-09-12T18:11:03.010 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :classes 2024-09-12T18:11:03.710 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:03.710 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileTestJava 2024-09-12T18:11:03.716 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:03.716 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:11:03.717 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :testClasses 2024-09-12T18:11:03.717 INFO:teuthology.orchestra.run.smithi097.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:11:03.717 INFO:teuthology.orchestra.run.smithi097.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:11:10.210 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:10.210 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :test 2024-09-12T18:11:10.210 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:10.210 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T18:11:21.110 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:21.110 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T18:11:21.909 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:21.910 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T18:11:22.210 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:22.210 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T18:11:23.009 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:23.010 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T18:11:44.111 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:44.111 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T18:11:45.010 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:45.010 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T18:11:45.010 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:45.010 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T18:11:45.209 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:45.210 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T18:11:45.409 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:45.410 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T18:11:46.210 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:46.210 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T18:11:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:11:59.810 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T18:12:01.410 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:12:01.410 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T18:12:01.910 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:12:01.910 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T18:12:01.910 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12 18:12:01,823 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:13:00.811 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:00.812 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T18:13:02.410 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:02.410 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T18:13:02.610 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:02.610 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T18:13:03.410 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:03.410 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T18:13:03.610 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:03.610 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T18:13:05.010 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:05.010 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T18:13:17.610 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:17.610 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T18:13:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:18.510 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T18:13:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:18.610 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T18:13:18.810 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:18.810 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T18:13:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:37.311 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T18:13:42.112 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:42.113 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests STANDARD_OUT 2024-09-12T18:13:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12 18:13:42,038 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12 18:13:42,115 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T18:13:43.110 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:13:43.110 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T18:14:08.211 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:14:08.211 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T18:14:09.410 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:14:09.410 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T18:14:15.610 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:14:15.610 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T18:14:16.510 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:14:16.510 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T18:17:12.512 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:17:12.512 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T18:17:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:17:13.411 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T18:17:31.112 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:17:31.112 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T18:17:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:17:31.911 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T18:17:44.211 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:17:44.211 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T18:17:45.011 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:17:45.011 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T18:17:49.211 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:17:49.310 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T18:18:08.211 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:08.212 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T18:18:08.411 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:08.411 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T18:18:09.411 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:09.411 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T18:18:09.611 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:09.611 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T18:18:10.411 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:10.411 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T18:18:10.611 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:10.611 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T18:18:11.511 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:11.511 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T18:18:11.811 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:11.811 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T18:18:12.711 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:12.711 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T18:18:12.911 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:12.911 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T18:18:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:13.811 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T18:18:14.011 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:14.011 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T18:18:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:14.911 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T18:18:15.211 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:15.211 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T18:18:16.011 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:16.011 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T18:18:44.211 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:44.212 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T18:18:45.111 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:45.111 INFO:teuthology.orchestra.run.smithi097.stdout:---------------------------------------------------------------------- 2024-09-12T18:18:45.111 INFO:teuthology.orchestra.run.smithi097.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T18:18:45.111 INFO:teuthology.orchestra.run.smithi097.stdout:---------------------------------------------------------------------- 2024-09-12T18:18:45.149 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:45.149 INFO:teuthology.orchestra.run.smithi097.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:18:45.149 INFO:teuthology.orchestra.run.smithi097.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:18:45.149 INFO:teuthology.orchestra.run.smithi097.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:18:45.149 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:45.149 INFO:teuthology.orchestra.run.smithi097.stdout:BUILD SUCCESSFUL in 8m 5s 2024-09-12T18:18:45.149 INFO:teuthology.orchestra.run.smithi097.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T18:18:45.471 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:18:45.502 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:18:45.502 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:18:45.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.540+0000 7feffe4ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:45.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.544+0000 7feffe4ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:45.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.544+0000 7feffe4ce9c0 20 realm 2024-09-12T18:18:45.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.544+0000 7feffe4ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:45.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.544+0000 7feffe4ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:45.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.544+0000 7feffe4ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:18:45.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.544+0000 7feffe4ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:45.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.544+0000 7feffe4ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:45.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.544+0000 7feffe4ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:45.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.544+0000 7feffe4ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:18:45.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.544+0000 7feffe4ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:45.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.548+0000 7feffe4ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:18:45.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.548+0000 7feffe4ce9c0 20 searching for the correct realm 2024-09-12T18:18:45.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.552+0000 7feffb7d3640 0 -- 172.21.15.97:0/1372591364 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7feff00d8910 msgr2=0x7feff00b73d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:18:45.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.560+0000 7feffb7d3640 0 -- 172.21.15.97:0/1372591364 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x564c16b23f20 msgr2=0x564c16b26390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:18:45.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.564+0000 7feffe4ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:18:45.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.564+0000 7feffe4ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:18:45.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.564+0000 7feffe4ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:18:45.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.564+0000 7feffe4ce9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:18:45.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.564+0000 7feffe4ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:18:45.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.564+0000 7feffe4ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:18:45.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.564+0000 7feffe4ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:45.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:45.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:45.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:18:45.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:45.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:18:45.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 zone default found 2024-09-12T18:18:45.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 4 Realm: () 2024-09-12T18:18:45.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:18:45.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:18:45.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:18:45.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 zonegroup default 2024-09-12T18:18:45.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:45.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:45.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:45.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:45.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:45.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:45.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 started sync module instance, tier type = 2024-09-12T18:18:45.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.568+0000 7feffe4ce9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:18:45.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.588+0000 7feffe4ce9c0 20 add_watcher() i=0 2024-09-12T18:18:45.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.588+0000 7feffe4ce9c0 20 add_watcher() i=1 2024-09-12T18:18:45.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.588+0000 7feffe4ce9c0 20 add_watcher() i=2 2024-09-12T18:18:45.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.588+0000 7feffe4ce9c0 20 add_watcher() i=3 2024-09-12T18:18:45.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.588+0000 7feffe4ce9c0 20 add_watcher() i=4 2024-09-12T18:18:45.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.588+0000 7feffe4ce9c0 20 add_watcher() i=5 2024-09-12T18:18:45.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.588+0000 7feffe4ce9c0 20 add_watcher() i=6 2024-09-12T18:18:45.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.592+0000 7feffe4ce9c0 20 add_watcher() i=7 2024-09-12T18:18:45.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.592+0000 7feffe4ce9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:18:45.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.592+0000 7feeb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:18:45.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.596+0000 7feffe4ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:18:45.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.596+0000 7feffe4ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:18:45.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.668+0000 7feeb0fe1640 20 reqs_thread_entry: start 2024-09-12T18:18:45.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.668+0000 7feffe4ce9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:18:45.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.668+0000 7feffe4ce9c0 20 Filter name: none 2024-09-12T18:18:45.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.668+0000 7fee2a7fc640 20 reqs_thread_entry: start 2024-09-12T18:18:45.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.668+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:18:45.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.672+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.672+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.672+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:18:45.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.672+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1219733933646447813', time=2024-09-12T20:14:08.608238+0000, chain.objs.size()=5 2024-09-12T18:18:45.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.672+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__multipart_file2.mpg.2~kGwf3z6OBnTdNGGz1VqzufOqebCPwI2.1 2024-09-12T18:18:45.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.676+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__multipart_file2.mpg.2~kGwf3z6OBnTdNGGz1VqzufOqebCPwI2.2 2024-09-12T18:18:45.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.676+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__multipart_file2.mpg.2~kGwf3z6OBnTdNGGz1VqzufOqebCPwI2.3 2024-09-12T18:18:45.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.676+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__multipart_file2.mpg.2~kGwf3z6OBnTdNGGz1VqzufOqebCPwI2.4 2024-09-12T18:18:45.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.676+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__multipart_file2.mpg.2~kGwf3z6OBnTdNGGz1VqzufOqebCPwI2.5 2024-09-12T18:18:45.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.676+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9669937950654684867', time=2024-09-12T20:18:08.718422+0000, chain.objs.size()=1 2024-09-12T18:18:45.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.676+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.59__shadow_.YsVLjr5Yk7BwG_bCcxLHNoYDNb_nh8Q_0 2024-09-12T18:18:45.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.680+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.684+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:18:45.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.688+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.688+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:18:45.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10570610601540354271', time=2024-09-12T20:13:17.845288+0000, chain.objs.size()=9 2024-09-12T18:18:45.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.51__multipart_key1.2~SbVmqCaXcom9AeXU54nIYb39FxmD8L7.1 2024-09-12T18:18:45.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.51__shadow_key1.2~SbVmqCaXcom9AeXU54nIYb39FxmD8L7.1_1 2024-09-12T18:18:45.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.51__multipart_key1.2~SbVmqCaXcom9AeXU54nIYb39FxmD8L7.2 2024-09-12T18:18:45.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.51__shadow_key1.2~SbVmqCaXcom9AeXU54nIYb39FxmD8L7.2_1 2024-09-12T18:18:45.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.51__multipart_key1.2~SbVmqCaXcom9AeXU54nIYb39FxmD8L7.3 2024-09-12T18:18:45.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.51__shadow_key1.2~SbVmqCaXcom9AeXU54nIYb39FxmD8L7.3_1 2024-09-12T18:18:45.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.51__multipart_key1.2~SbVmqCaXcom9AeXU54nIYb39FxmD8L7.4 2024-09-12T18:18:45.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.51__shadow_key1.2~SbVmqCaXcom9AeXU54nIYb39FxmD8L7.4_1 2024-09-12T18:18:45.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.51__multipart_key1.2~SbVmqCaXcom9AeXU54nIYb39FxmD8L7.5 2024-09-12T18:18:45.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9369952701816553837', time=2024-09-12T20:17:27.081409+0000, chain.objs.size()=1 2024-09-12T18:18:45.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.692+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.56__shadow_.7xOHJbULvsB5-HLA1bqrgt9O12B5asP_0 2024-09-12T18:18:45.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.700+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.704+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:18:45.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.708+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.708+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.708+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.708+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:18:45.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.712+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.712+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.716+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.716+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:18:45.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.720+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.720+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.720+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:18:45.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:45.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10877294383184413470', time=2024-09-12T20:12:00.753381+0000, chain.objs.size()=9 2024-09-12T18:18:45.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__multipart_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.1 2024-09-12T18:18:45.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__shadow_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.1_1 2024-09-12T18:18:45.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__multipart_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.2 2024-09-12T18:18:45.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__shadow_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.2_1 2024-09-12T18:18:45.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__multipart_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.3 2024-09-12T18:18:45.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__shadow_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.3_1 2024-09-12T18:18:45.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__multipart_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.4 2024-09-12T18:18:45.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__shadow_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.4_1 2024-09-12T18:18:45.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.724+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__multipart_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.5 2024-09-12T18:18:45.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.728+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.732+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:18:45.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:18:45.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9109376783553928226', time=2024-09-12T20:17:31.286762+0000, chain.objs.size()=9 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.56__multipart_key1.2~LIRzICKx51whqgTxx93MlJz5kye52hS.1 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.56__shadow_key1.2~LIRzICKx51whqgTxx93MlJz5kye52hS.1_1 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.56__multipart_key1.2~LIRzICKx51whqgTxx93MlJz5kye52hS.2 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.56__shadow_key1.2~LIRzICKx51whqgTxx93MlJz5kye52hS.2_1 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.56__multipart_key1.2~LIRzICKx51whqgTxx93MlJz5kye52hS.3 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.56__shadow_key1.2~LIRzICKx51whqgTxx93MlJz5kye52hS.3_1 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.56__multipart_key1.2~LIRzICKx51whqgTxx93MlJz5kye52hS.4 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.56__shadow_key1.2~LIRzICKx51whqgTxx93MlJz5kye52hS.4_1 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.56__multipart_key1.2~LIRzICKx51whqgTxx93MlJz5kye52hS.5 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1612645622374949948', time=2024-09-12T20:18:12.061703+0000, chain.objs.size()=1 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.62__shadow_.leDpHeCjWuiWP1NG0qIS2D7AaHW1I9e_0 2024-09-12T18:18:45.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15368973817797486077', time=2024-09-12T20:18:13.201419+0000, chain.objs.size()=1 2024-09-12T18:18:45.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.736+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.63__shadow_.0yUWQ2NX-6LdpK-b_bOQZ8uas-mJoC1_0 2024-09-12T18:18:45.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.744+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.748+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:18:45.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.752+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.752+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.752+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.752+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15018080208834971380', time=2024-09-12T20:13:01.799820+0000, chain.objs.size()=7 2024-09-12T18:18:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.752+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~TANjqO2aGf4tpfXMOSDXnsZrVRV5TRR.1 2024-09-12T18:18:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.752+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~TANjqO2aGf4tpfXMOSDXnsZrVRV5TRR.1_1 2024-09-12T18:18:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.752+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~TANjqO2aGf4tpfXMOSDXnsZrVRV5TRR.1_2 2024-09-12T18:18:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.752+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~TANjqO2aGf4tpfXMOSDXnsZrVRV5TRR.2 2024-09-12T18:18:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.752+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~TANjqO2aGf4tpfXMOSDXnsZrVRV5TRR.2_1 2024-09-12T18:18:45.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.752+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~TANjqO2aGf4tpfXMOSDXnsZrVRV5TRR.2_2 2024-09-12T18:18:45.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.752+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~TANjqO2aGf4tpfXMOSDXnsZrVRV5TRR.3 2024-09-12T18:18:45.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.760+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.764+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:18:45.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:45.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12123469175639986423', time=2024-09-12T20:15:10.108180+0000, chain.objs.size()=21 2024-09-12T18:18:45.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.1 2024-09-12T18:18:45.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.1_1 2024-09-12T18:18:45.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.2 2024-09-12T18:18:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.2_1 2024-09-12T18:18:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.3 2024-09-12T18:18:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.3_1 2024-09-12T18:18:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.4 2024-09-12T18:18:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.4_1 2024-09-12T18:18:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.5 2024-09-12T18:18:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.5_1 2024-09-12T18:18:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.6 2024-09-12T18:18:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.768+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.6_1 2024-09-12T18:18:45.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.772+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.7 2024-09-12T18:18:45.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.776+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.7_1 2024-09-12T18:18:45.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.776+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.8 2024-09-12T18:18:45.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.776+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.8_1 2024-09-12T18:18:45.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.776+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.9 2024-09-12T18:18:45.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.776+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.9_1 2024-09-12T18:18:45.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.776+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.10 2024-09-12T18:18:45.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.776+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.10_1 2024-09-12T18:18:45.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.776+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XRINoirSk6tPPY7Z-egdFlMvekSIyWF.11 2024-09-12T18:18:45.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.784+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.788+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:18:45.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.792+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.792+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.792+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:45.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.792+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6219202825600198546', time=2024-09-12T20:18:10.931474+0000, chain.objs.size()=1 2024-09-12T18:18:45.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.792+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.61__shadow_.EzEGxFHo0PM71IYHPdd8QXQWJb73oKL_0 2024-09-12T18:18:45.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.796+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.800+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:18:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.804+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.804+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.804+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.808+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:18:45.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:18:45.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~MIH0AmhDHtQK6hA4QXrf_chUnRDni3U', time=2024-09-12T20:11:21.049729+0000, chain.objs.size()=9 2024-09-12T18:18:45.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.40__multipart_key1.2~MIH0AmhDHtQK6hA4QXrf_chUnRDni3U.1 2024-09-12T18:18:45.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.40__shadow_key1.2~MIH0AmhDHtQK6hA4QXrf_chUnRDni3U.1_1 2024-09-12T18:18:45.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.40__multipart_key1.2~MIH0AmhDHtQK6hA4QXrf_chUnRDni3U.2 2024-09-12T18:18:45.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.40__shadow_key1.2~MIH0AmhDHtQK6hA4QXrf_chUnRDni3U.2_1 2024-09-12T18:18:45.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.40__multipart_key1.2~MIH0AmhDHtQK6hA4QXrf_chUnRDni3U.3 2024-09-12T18:18:45.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.40__shadow_key1.2~MIH0AmhDHtQK6hA4QXrf_chUnRDni3U.3_1 2024-09-12T18:18:45.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.40__multipart_key1.2~MIH0AmhDHtQK6hA4QXrf_chUnRDni3U.4 2024-09-12T18:18:45.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.40__shadow_key1.2~MIH0AmhDHtQK6hA4QXrf_chUnRDni3U.4_1 2024-09-12T18:18:45.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.40__multipart_key1.2~MIH0AmhDHtQK6hA4QXrf_chUnRDni3U.5 2024-09-12T18:18:45.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.95963460801194007', time=2024-09-12T20:12:52.359574+0000, chain.objs.size()=9 2024-09-12T18:18:45.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~WGMmfFsPilFQoEk2g2EpA_a2qP0lRxY.1 2024-09-12T18:18:45.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~WGMmfFsPilFQoEk2g2EpA_a2qP0lRxY.1_1 2024-09-12T18:18:45.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.812+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~WGMmfFsPilFQoEk2g2EpA_a2qP0lRxY.2 2024-09-12T18:18:45.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~WGMmfFsPilFQoEk2g2EpA_a2qP0lRxY.2_1 2024-09-12T18:18:45.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~WGMmfFsPilFQoEk2g2EpA_a2qP0lRxY.3 2024-09-12T18:18:45.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~WGMmfFsPilFQoEk2g2EpA_a2qP0lRxY.3_1 2024-09-12T18:18:45.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~WGMmfFsPilFQoEk2g2EpA_a2qP0lRxY.4 2024-09-12T18:18:45.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~WGMmfFsPilFQoEk2g2EpA_a2qP0lRxY.4_1 2024-09-12T18:18:45.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~WGMmfFsPilFQoEk2g2EpA_a2qP0lRxY.5 2024-09-12T18:18:45.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7161557343580916902', time=2024-09-12T20:13:01.088786+0000, chain.objs.size()=6 2024-09-12T18:18:45.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.46__shadow_.KgZbs0FMscHvTjDsdAMuXIWHldxqEe__0 2024-09-12T18:18:45.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.46__shadow_.KgZbs0FMscHvTjDsdAMuXIWHldxqEe__1 2024-09-12T18:18:45.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.46__shadow_.KgZbs0FMscHvTjDsdAMuXIWHldxqEe__2 2024-09-12T18:18:45.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.46__shadow_.KgZbs0FMscHvTjDsdAMuXIWHldxqEe__3 2024-09-12T18:18:45.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.820+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.46__shadow_.KgZbs0FMscHvTjDsdAMuXIWHldxqEe__4 2024-09-12T18:18:45.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.824+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.46__shadow_.KgZbs0FMscHvTjDsdAMuXIWHldxqEe__5 2024-09-12T18:18:45.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.832+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.836+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:18:45.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:45.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6930157497472091973', time=2024-09-12T20:12:32.423963+0000, chain.objs.size()=9 2024-09-12T18:18:45.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~Gl9ySHEjY8AOex1QkvH-LLZnZqj0aEG.1 2024-09-12T18:18:45.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~Gl9ySHEjY8AOex1QkvH-LLZnZqj0aEG.1_1 2024-09-12T18:18:45.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~Gl9ySHEjY8AOex1QkvH-LLZnZqj0aEG.2 2024-09-12T18:18:45.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~Gl9ySHEjY8AOex1QkvH-LLZnZqj0aEG.2_1 2024-09-12T18:18:45.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~Gl9ySHEjY8AOex1QkvH-LLZnZqj0aEG.3 2024-09-12T18:18:45.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~Gl9ySHEjY8AOex1QkvH-LLZnZqj0aEG.3_1 2024-09-12T18:18:45.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~Gl9ySHEjY8AOex1QkvH-LLZnZqj0aEG.4 2024-09-12T18:18:45.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~Gl9ySHEjY8AOex1QkvH-LLZnZqj0aEG.4_1 2024-09-12T18:18:45.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.840+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~Gl9ySHEjY8AOex1QkvH-LLZnZqj0aEG.5 2024-09-12T18:18:45.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.848+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.852+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:18:45.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.856+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.856+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.856+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:45.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.856+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.642897829134133728', time=2024-09-12T20:18:44.415129+0000, chain.objs.size()=21 2024-09-12T18:18:45.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.856+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__multipart_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.1 2024-09-12T18:18:45.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.856+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__shadow_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.1_1 2024-09-12T18:18:45.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.860+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__multipart_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.2 2024-09-12T18:18:45.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.860+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__shadow_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.2_1 2024-09-12T18:18:45.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.860+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__multipart_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.3 2024-09-12T18:18:45.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.860+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__shadow_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.3_1 2024-09-12T18:18:45.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.860+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__multipart_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.4 2024-09-12T18:18:45.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.860+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__shadow_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.4_1 2024-09-12T18:18:45.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.860+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__multipart_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.5 2024-09-12T18:18:45.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.860+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__shadow_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.5_1 2024-09-12T18:18:45.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.860+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__multipart_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.6 2024-09-12T18:18:45.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.860+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__shadow_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.6_1 2024-09-12T18:18:45.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.864+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__multipart_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.7 2024-09-12T18:18:45.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.864+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__shadow_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.7_1 2024-09-12T18:18:45.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.868+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__multipart_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.8 2024-09-12T18:18:45.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.868+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__shadow_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.8_1 2024-09-12T18:18:45.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.868+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__multipart_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.9 2024-09-12T18:18:45.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.868+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__shadow_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.9_1 2024-09-12T18:18:45.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.868+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__multipart_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.10 2024-09-12T18:18:45.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.868+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__shadow_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.10_1 2024-09-12T18:18:45.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.868+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.66__multipart_key1.2~l02lmMH0zfx4-hDR5aGfYLxd1sJiQFj.11 2024-09-12T18:18:45.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.872+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.880+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:18:45.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.880+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.880+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.880+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:45.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.880+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.769209452803906257', time=2024-09-12T20:14:08.699580+0000, chain.objs.size()=1 2024-09-12T18:18:45.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.880+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__shadow_.BFJ8_m0fPRmiB7gTyjv_wKq7sV7CnQs_0 2024-09-12T18:18:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.884+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.888+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:18:45.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.892+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.892+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.892+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.896+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:18:45.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.900+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.900+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.900+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.900+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:18:45.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11184589094347377533', time=2024-09-12T20:16:22.251152+0000, chain.objs.size()=19 2024-09-12T18:18:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.1 2024-09-12T18:18:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.1_1 2024-09-12T18:18:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.2 2024-09-12T18:18:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.2_1 2024-09-12T18:18:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.3 2024-09-12T18:18:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.3_1 2024-09-12T18:18:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.4 2024-09-12T18:18:45.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.4_1 2024-09-12T18:18:45.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.5 2024-09-12T18:18:45.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.5_1 2024-09-12T18:18:45.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.6 2024-09-12T18:18:45.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.904+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.6_1 2024-09-12T18:18:45.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.912+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.7 2024-09-12T18:18:45.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.912+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.7_1 2024-09-12T18:18:45.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.912+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.8 2024-09-12T18:18:45.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.916+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.8_1 2024-09-12T18:18:45.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.916+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.9 2024-09-12T18:18:45.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.916+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.9_1 2024-09-12T18:18:45.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.916+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~XUpZRQkbGrvUgD7U7ieuxmjd0Ad6dPn.10 2024-09-12T18:18:45.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.920+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.924+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:18:45.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.928+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.928+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:45.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2097922729385429238', time=2024-09-12T20:17:12.394402+0000, chain.objs.size()=16 2024-09-12T18:18:45.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.1 2024-09-12T18:18:45.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.1_1 2024-09-12T18:18:45.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.1_2 2024-09-12T18:18:45.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.2 2024-09-12T18:18:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.2_1 2024-09-12T18:18:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.2_2 2024-09-12T18:18:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.3 2024-09-12T18:18:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.3_1 2024-09-12T18:18:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.3_2 2024-09-12T18:18:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.4 2024-09-12T18:18:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.4_1 2024-09-12T18:18:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.932+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.4_2 2024-09-12T18:18:45.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.936+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.5 2024-09-12T18:18:45.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.940+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.5_1 2024-09-12T18:18:45.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.940+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.5_2 2024-09-12T18:18:45.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.940+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~u8xddLmKflegwgVl5M3F9ZidBVInyCE.6 2024-09-12T18:18:45.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.944+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.952+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:18:45.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.956+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.956+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.956+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.956+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:18:45.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.960+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.960+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13146371900096719007', time=2024-09-12T20:15:36.018343+0000, chain.objs.size()=21 2024-09-12T18:18:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.1 2024-09-12T18:18:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.1_1 2024-09-12T18:18:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.2 2024-09-12T18:18:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.2_1 2024-09-12T18:18:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.3 2024-09-12T18:18:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.3_1 2024-09-12T18:18:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.4 2024-09-12T18:18:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.4_1 2024-09-12T18:18:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.5 2024-09-12T18:18:45.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.5_1 2024-09-12T18:18:45.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.6 2024-09-12T18:18:45.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.964+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.6_1 2024-09-12T18:18:45.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.972+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.7 2024-09-12T18:18:45.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.972+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.7_1 2024-09-12T18:18:45.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.972+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.8 2024-09-12T18:18:45.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.972+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.8_1 2024-09-12T18:18:45.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.972+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.9 2024-09-12T18:18:45.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.972+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.9_1 2024-09-12T18:18:45.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.972+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.10 2024-09-12T18:18:45.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.972+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.10_1 2024-09-12T18:18:45.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.972+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~RzzRunl9V5KKjvNCyz1nXv9YjQRalCl.11 2024-09-12T18:18:45.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.980+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:45.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.984+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:18:45.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.984+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:45.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:45.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:18:45.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12992439024666241781', time=2024-09-12T20:12:00.031937+0000, chain.objs.size()=9 2024-09-12T18:18:45.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__multipart_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.1 2024-09-12T18:18:45.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__shadow_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.1_1 2024-09-12T18:18:45.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__multipart_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.2 2024-09-12T18:18:45.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__shadow_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.2_1 2024-09-12T18:18:45.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__multipart_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.3 2024-09-12T18:18:45.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__shadow_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.3_1 2024-09-12T18:18:45.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__multipart_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.4 2024-09-12T18:18:45.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__shadow_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.4_1 2024-09-12T18:18:45.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.44__multipart_key1.2~rppe-iO7nksvFGJNavpUXMKfQauwOW2.5 2024-09-12T18:18:45.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14524129656734352530', time=2024-09-12T20:14:08.799325+0000, chain.objs.size()=1 2024-09-12T18:18:45.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__shadow_.Nag6way5jmSjAc9vsTN-uJXyt5bNMyZ_0 2024-09-12T18:18:45.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10664505927062672157', time=2024-09-12T20:17:44.407043+0000, chain.objs.size()=9 2024-09-12T18:18:45.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.57__multipart_key1.2~QQ4wM538l3KI-zKfaWmiBbvjzY6_Xh8.1 2024-09-12T18:18:45.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.988+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.57__shadow_key1.2~QQ4wM538l3KI-zKfaWmiBbvjzY6_Xh8.1_1 2024-09-12T18:18:45.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.992+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.57__multipart_key1.2~QQ4wM538l3KI-zKfaWmiBbvjzY6_Xh8.2 2024-09-12T18:18:45.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.992+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.57__shadow_key1.2~QQ4wM538l3KI-zKfaWmiBbvjzY6_Xh8.2_1 2024-09-12T18:18:46.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.992+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.57__multipart_key1.2~QQ4wM538l3KI-zKfaWmiBbvjzY6_Xh8.3 2024-09-12T18:18:46.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.992+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.57__shadow_key1.2~QQ4wM538l3KI-zKfaWmiBbvjzY6_Xh8.3_1 2024-09-12T18:18:46.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.992+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.57__multipart_key1.2~QQ4wM538l3KI-zKfaWmiBbvjzY6_Xh8.4 2024-09-12T18:18:46.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.992+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.57__shadow_key1.2~QQ4wM538l3KI-zKfaWmiBbvjzY6_Xh8.4_1 2024-09-12T18:18:46.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:45.996+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.57__multipart_key1.2~QQ4wM538l3KI-zKfaWmiBbvjzY6_Xh8.5 2024-09-12T18:18:46.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.000+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:46.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.004+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:18:46.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.008+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.008+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:18:46.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1915526462039070206', time=2024-09-12T20:14:08.441379+0000, chain.objs.size()=9 2024-09-12T18:18:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__multipart_file.mpg.2~zqLQIIWcpJHWB1-quhVyFpsAA_rCEba.1 2024-09-12T18:18:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__shadow_file.mpg.2~zqLQIIWcpJHWB1-quhVyFpsAA_rCEba.1_1 2024-09-12T18:18:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__multipart_file.mpg.2~zqLQIIWcpJHWB1-quhVyFpsAA_rCEba.2 2024-09-12T18:18:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__shadow_file.mpg.2~zqLQIIWcpJHWB1-quhVyFpsAA_rCEba.2_1 2024-09-12T18:18:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__multipart_file.mpg.2~zqLQIIWcpJHWB1-quhVyFpsAA_rCEba.3 2024-09-12T18:18:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__shadow_file.mpg.2~zqLQIIWcpJHWB1-quhVyFpsAA_rCEba.3_1 2024-09-12T18:18:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__multipart_file.mpg.2~zqLQIIWcpJHWB1-quhVyFpsAA_rCEba.4 2024-09-12T18:18:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__shadow_file.mpg.2~zqLQIIWcpJHWB1-quhVyFpsAA_rCEba.4_1 2024-09-12T18:18:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__multipart_file.mpg.2~zqLQIIWcpJHWB1-quhVyFpsAA_rCEba.5 2024-09-12T18:18:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.601464739229079367', time=2024-09-12T20:17:12.747602+0000, chain.objs.size()=16 2024-09-12T18:18:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.1 2024-09-12T18:18:46.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.1_1 2024-09-12T18:18:46.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.012+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.1_2 2024-09-12T18:18:46.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.016+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.2 2024-09-12T18:18:46.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.016+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.2_1 2024-09-12T18:18:46.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.016+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.2_2 2024-09-12T18:18:46.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.016+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.3 2024-09-12T18:18:46.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.020+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.3_1 2024-09-12T18:18:46.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.020+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.3_2 2024-09-12T18:18:46.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.020+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.4 2024-09-12T18:18:46.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.020+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.4_1 2024-09-12T18:18:46.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.020+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.4_2 2024-09-12T18:18:46.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.020+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.5 2024-09-12T18:18:46.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.020+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.5_1 2024-09-12T18:18:46.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.024+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.5_2 2024-09-12T18:18:46.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.024+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~s4RMuFVIRY0AWKOSuW0x5msXUpwUIhU.6 2024-09-12T18:18:46.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.028+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:46.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.036+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:18:46.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.040+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.040+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.040+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.044+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:18:46.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~AnwouTFZVF_Y3kvn4PCP1oS-5fuv5nx', time=2024-09-12T20:14:16.126677+0000, chain.objs.size()=5 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.54__multipart_key1.2~AnwouTFZVF_Y3kvn4PCP1oS-5fuv5nx.7 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.54__shadow_key1.2~AnwouTFZVF_Y3kvn4PCP1oS-5fuv5nx.7_1 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.54__multipart_key1.2~AnwouTFZVF_Y3kvn4PCP1oS-5fuv5nx.10 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.54__shadow_key1.2~AnwouTFZVF_Y3kvn4PCP1oS-5fuv5nx.10_1 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.54__multipart_key1.2~AnwouTFZVF_Y3kvn4PCP1oS-5fuv5nx.13 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0', time=2024-09-12T20:18:01.298150+0000, chain.objs.size()=1 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.16 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0', time=2024-09-12T20:18:01.495926+0000, chain.objs.size()=1 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.19 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0', time=2024-09-12T20:18:01.557471+0000, chain.objs.size()=49 2024-09-12T18:18:46.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.1 2024-09-12T18:18:46.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.2 2024-09-12T18:18:46.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.3 2024-09-12T18:18:46.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.4 2024-09-12T18:18:46.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.048+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.5 2024-09-12T18:18:46.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.056+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.6 2024-09-12T18:18:46.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.056+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.7 2024-09-12T18:18:46.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.056+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.8 2024-09-12T18:18:46.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.056+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.9 2024-09-12T18:18:46.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.056+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.10 2024-09-12T18:18:46.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.056+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.11 2024-09-12T18:18:46.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.056+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.12 2024-09-12T18:18:46.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.056+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.13 2024-09-12T18:18:46.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.056+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.14 2024-09-12T18:18:46.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.056+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.15 2024-09-12T18:18:46.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.056+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.gDJj0Yxy2Xbj6oP-dZgTWjI8f5A49JrH.16 2024-09-12T18:18:46.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.060+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.17 2024-09-12T18:18:46.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.060+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.18 2024-09-12T18:18:46.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.060+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.miHYa5qbtQlmDkwfHrj8ZArzrGgEiKe3.19 2024-09-12T18:18:46.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.060+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.20 2024-09-12T18:18:46.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.060+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.21 2024-09-12T18:18:46.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.060+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.22 2024-09-12T18:18:46.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.060+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.23 2024-09-12T18:18:46.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.060+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.24 2024-09-12T18:18:46.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.060+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.25 2024-09-12T18:18:46.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.060+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.26 2024-09-12T18:18:46.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.064+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.27 2024-09-12T18:18:46.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.064+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.28 2024-09-12T18:18:46.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.064+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.29 2024-09-12T18:18:46.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.064+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.30 2024-09-12T18:18:46.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.064+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.31 2024-09-12T18:18:46.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.064+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.32 2024-09-12T18:18:46.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.064+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.33 2024-09-12T18:18:46.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.064+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.34 2024-09-12T18:18:46.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.064+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.35 2024-09-12T18:18:46.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.064+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.36 2024-09-12T18:18:46.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.064+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.37 2024-09-12T18:18:46.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.068+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.38 2024-09-12T18:18:46.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.068+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.39 2024-09-12T18:18:46.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.068+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.40 2024-09-12T18:18:46.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.068+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.41 2024-09-12T18:18:46.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.068+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.42 2024-09-12T18:18:46.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.068+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.43 2024-09-12T18:18:46.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.068+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.44 2024-09-12T18:18:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.068+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.45 2024-09-12T18:18:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.068+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.46 2024-09-12T18:18:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.068+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.47 2024-09-12T18:18:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.068+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.48 2024-09-12T18:18:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.072+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.58__multipart_key1.2~CdcAHUr3SQAgw1j-xZqqA45unD4acP0.49 2024-09-12T18:18:46.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.072+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5382818564329641886', time=2024-09-12T20:18:09.782925+0000, chain.objs.size()=1 2024-09-12T18:18:46.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.072+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.60__shadow_.O4bP_0G3Yvaa9ByZSUESU2i7ywSepQf_0 2024-09-12T18:18:46.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.076+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:46.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.080+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:18:46.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.084+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.084+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.084+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.088+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:18:46.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.088+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.092+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.092+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.092+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15164537300178031176', time=2024-09-12T20:12:56.896263+0000, chain.objs.size()=7 2024-09-12T18:18:46.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.092+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~A1U-b6ctE7ANLRigk0iokT090qeRYY6.1 2024-09-12T18:18:46.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.092+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~A1U-b6ctE7ANLRigk0iokT090qeRYY6.1_1 2024-09-12T18:18:46.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.092+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~A1U-b6ctE7ANLRigk0iokT090qeRYY6.1_2 2024-09-12T18:18:46.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.092+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~A1U-b6ctE7ANLRigk0iokT090qeRYY6.2 2024-09-12T18:18:46.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.092+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~A1U-b6ctE7ANLRigk0iokT090qeRYY6.2_1 2024-09-12T18:18:46.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.092+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~A1U-b6ctE7ANLRigk0iokT090qeRYY6.2_2 2024-09-12T18:18:46.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.092+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~A1U-b6ctE7ANLRigk0iokT090qeRYY6.3 2024-09-12T18:18:46.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.100+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:46.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.104+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:18:46.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:18:46.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5459440091997098960', time=2024-09-12T20:11:44.367033+0000, chain.objs.size()=9 2024-09-12T18:18:46.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.42__multipart_key1.2~0zJlbkMYWQiSO2CAYStC8SceibxFFWF.1 2024-09-12T18:18:46.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.42__shadow_key1.2~0zJlbkMYWQiSO2CAYStC8SceibxFFWF.1_1 2024-09-12T18:18:46.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.42__multipart_key1.2~0zJlbkMYWQiSO2CAYStC8SceibxFFWF.2 2024-09-12T18:18:46.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.42__shadow_key1.2~0zJlbkMYWQiSO2CAYStC8SceibxFFWF.2_1 2024-09-12T18:18:46.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.42__multipart_key1.2~0zJlbkMYWQiSO2CAYStC8SceibxFFWF.3 2024-09-12T18:18:46.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.42__shadow_key1.2~0zJlbkMYWQiSO2CAYStC8SceibxFFWF.3_1 2024-09-12T18:18:46.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.42__multipart_key1.2~0zJlbkMYWQiSO2CAYStC8SceibxFFWF.4 2024-09-12T18:18:46.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.42__shadow_key1.2~0zJlbkMYWQiSO2CAYStC8SceibxFFWF.4_1 2024-09-12T18:18:46.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.42__multipart_key1.2~0zJlbkMYWQiSO2CAYStC8SceibxFFWF.5 2024-09-12T18:18:46.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8753851664659143633', time=2024-09-12T20:13:00.726316+0000, chain.objs.size()=7 2024-09-12T18:18:46.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~I7E_qwmrbZejnh5wpffoZjFTgBLI7KT.1 2024-09-12T18:18:46.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~I7E_qwmrbZejnh5wpffoZjFTgBLI7KT.1_1 2024-09-12T18:18:46.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.108+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~I7E_qwmrbZejnh5wpffoZjFTgBLI7KT.1_2 2024-09-12T18:18:46.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.116+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~I7E_qwmrbZejnh5wpffoZjFTgBLI7KT.2 2024-09-12T18:18:46.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.116+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~I7E_qwmrbZejnh5wpffoZjFTgBLI7KT.2_1 2024-09-12T18:18:46.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.120+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~I7E_qwmrbZejnh5wpffoZjFTgBLI7KT.2_2 2024-09-12T18:18:46.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.120+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~I7E_qwmrbZejnh5wpffoZjFTgBLI7KT.3 2024-09-12T18:18:46.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.124+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:46.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.128+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:18:46.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:18:46.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12264632246718474046', time=2024-09-12T20:16:47.177310+0000, chain.objs.size()=16 2024-09-12T18:18:46.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.1 2024-09-12T18:18:46.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.1_1 2024-09-12T18:18:46.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.1_2 2024-09-12T18:18:46.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.2 2024-09-12T18:18:46.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.2_1 2024-09-12T18:18:46.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.2_2 2024-09-12T18:18:46.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.3 2024-09-12T18:18:46.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.3_1 2024-09-12T18:18:46.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.3_2 2024-09-12T18:18:46.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.4 2024-09-12T18:18:46.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.4_1 2024-09-12T18:18:46.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.132+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.4_2 2024-09-12T18:18:46.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.140+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.5 2024-09-12T18:18:46.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.140+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.5_1 2024-09-12T18:18:46.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.140+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__shadow_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.5_2 2024-09-12T18:18:46.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.144+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.55__multipart_key1.2~9-JkzYgtLC6R0XPP0up5dANCTKWl8j1.6 2024-09-12T18:18:46.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.144+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17455733949350055372', time=2024-09-12T20:18:14.285857+0000, chain.objs.size()=1 2024-09-12T18:18:46.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.144+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.64__shadow_.AbbY3TEHy6BhAe3vkRTHwLDgYy49iRo_0 2024-09-12T18:18:46.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.148+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:46.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.152+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:18:46.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.156+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:18:46.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9812036533060579198', time=2024-09-12T20:12:47.348402+0000, chain.objs.size()=9 2024-09-12T18:18:46.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~cfl96qlD0w-MXvwWcW69nGuk6VTGiti.1 2024-09-12T18:18:46.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~cfl96qlD0w-MXvwWcW69nGuk6VTGiti.1_1 2024-09-12T18:18:46.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~cfl96qlD0w-MXvwWcW69nGuk6VTGiti.2 2024-09-12T18:18:46.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~cfl96qlD0w-MXvwWcW69nGuk6VTGiti.2_1 2024-09-12T18:18:46.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~cfl96qlD0w-MXvwWcW69nGuk6VTGiti.3 2024-09-12T18:18:46.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~cfl96qlD0w-MXvwWcW69nGuk6VTGiti.3_1 2024-09-12T18:18:46.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~cfl96qlD0w-MXvwWcW69nGuk6VTGiti.4 2024-09-12T18:18:46.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__shadow_key1.2~cfl96qlD0w-MXvwWcW69nGuk6VTGiti.4_1 2024-09-12T18:18:46.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.47__multipart_key1.2~cfl96qlD0w-MXvwWcW69nGuk6VTGiti.5 2024-09-12T18:18:46.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1260033617909851063', time=2024-09-12T20:13:41.685158+0000, chain.objs.size()=9 2024-09-12T18:18:46.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.52__multipart_key1.2~mod-YBGbVsr1quPhkd4pxCIv6L1c-8s.1 2024-09-12T18:18:46.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.52__shadow_key1.2~mod-YBGbVsr1quPhkd4pxCIv6L1c-8s.1_1 2024-09-12T18:18:46.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.160+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.52__multipart_key1.2~mod-YBGbVsr1quPhkd4pxCIv6L1c-8s.2 2024-09-12T18:18:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.164+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.52__shadow_key1.2~mod-YBGbVsr1quPhkd4pxCIv6L1c-8s.2_1 2024-09-12T18:18:46.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.168+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.52__multipart_key1.2~mod-YBGbVsr1quPhkd4pxCIv6L1c-8s.3 2024-09-12T18:18:46.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.168+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.52__shadow_key1.2~mod-YBGbVsr1quPhkd4pxCIv6L1c-8s.3_1 2024-09-12T18:18:46.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.168+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.52__multipart_key1.2~mod-YBGbVsr1quPhkd4pxCIv6L1c-8s.4 2024-09-12T18:18:46.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.168+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.52__shadow_key1.2~mod-YBGbVsr1quPhkd4pxCIv6L1c-8s.4_1 2024-09-12T18:18:46.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.168+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.52__multipart_key1.2~mod-YBGbVsr1quPhkd4pxCIv6L1c-8s.5 2024-09-12T18:18:46.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.176+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:46.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.180+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:18:46.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.180+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.184+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.184+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.188+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:18:46.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.192+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.192+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.192+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:18:46.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.192+0000 7feffe4ce9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14920438777079720457', time=2024-09-12T20:14:08.536593+0000, chain.objs.size()=1 2024-09-12T18:18:46.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.192+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.53__shadow_.3KFaagjri98JgvAkFxdirVv2siBo1La_0 2024-09-12T18:18:46.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.196+0000 7feffe4ce9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:18:46.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.200+0000 7feeb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:18:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.204+0000 7feffe4ce9c0 20 remove_watcher() i=0 2024-09-12T18:18:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.204+0000 7feffe4ce9c0 2 removed watcher, disabling cache 2024-09-12T18:18:46.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.208+0000 7feffe4ce9c0 20 remove_watcher() i=1 2024-09-12T18:18:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.208+0000 7feffe4ce9c0 20 remove_watcher() i=2 2024-09-12T18:18:46.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.212+0000 7feffe4ce9c0 20 remove_watcher() i=3 2024-09-12T18:18:46.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.216+0000 7feffe4ce9c0 20 remove_watcher() i=4 2024-09-12T18:18:46.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.216+0000 7feffe4ce9c0 20 remove_watcher() i=5 2024-09-12T18:18:46.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.220+0000 7feffe4ce9c0 20 remove_watcher() i=6 2024-09-12T18:18:46.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.220+0000 7feffe4ce9c0 20 remove_watcher() i=7 2024-09-12T18:18:46.247 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:18:46.322 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:18:46.323 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:18:46.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.364+0000 7f25111409c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:46.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 20 realm 2024-09-12T18:18:46.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:46.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:18:46.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:46.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:18:46.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:18:46.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.368+0000 7f25111409c0 20 searching for the correct realm 2024-09-12T18:18:46.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.376+0000 7f250ec46640 0 -- 172.21.15.97:0/1725749969 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f250012db90 msgr2=0x7f2500127120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:18:46.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.384+0000 7f250ec46640 0 -- 172.21.15.97:0/1725749969 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f2508017c20 msgr2=0x7f2508030410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:18:46.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.388+0000 7f25111409c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:18:46.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.388+0000 7f25111409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:18:46.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.388+0000 7f25111409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:18:46.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.388+0000 7f25111409c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:18:46.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.388+0000 7f25111409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:18:46.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.388+0000 7f25111409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:18:46.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.388+0000 7f25111409c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:46.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:18:46.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:18:46.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 zone default found 2024-09-12T18:18:46.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 4 Realm: () 2024-09-12T18:18:46.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:18:46.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:18:46.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:18:46.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 zonegroup default 2024-09-12T18:18:46.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:46.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:46.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:46.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 started sync module instance, tier type = 2024-09-12T18:18:46.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.392+0000 7f25111409c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:18:46.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.412+0000 7f25111409c0 20 add_watcher() i=0 2024-09-12T18:18:46.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.412+0000 7f25111409c0 20 add_watcher() i=1 2024-09-12T18:18:46.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.412+0000 7f25111409c0 20 add_watcher() i=2 2024-09-12T18:18:46.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.412+0000 7f25111409c0 20 add_watcher() i=3 2024-09-12T18:18:46.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.412+0000 7f25111409c0 20 add_watcher() i=4 2024-09-12T18:18:46.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.412+0000 7f25111409c0 20 add_watcher() i=5 2024-09-12T18:18:46.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.412+0000 7f25111409c0 20 add_watcher() i=6 2024-09-12T18:18:46.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.412+0000 7f25111409c0 20 add_watcher() i=7 2024-09-12T18:18:46.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.412+0000 7f25111409c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:18:46.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.416+0000 7f23c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:18:46.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.416+0000 7f25111409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:18:46.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.416+0000 7f25111409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:18:46.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.488+0000 7f233ffff640 20 reqs_thread_entry: start 2024-09-12T18:18:46.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.488+0000 7f25111409c0 20 init_complete bucket index max shards: 11 2024-09-12T18:18:46.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.488+0000 7f25111409c0 20 Filter name: none 2024-09-12T18:18:46.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.488+0000 7f233dffb640 20 reqs_thread_entry: start 2024-09-12T18:18:46.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.488+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:18:46.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.492+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.492+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.492+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.496+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:18:46.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.500+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.500+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.500+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.500+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:18:46.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.504+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.504+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.508+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.508+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:18:46.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.512+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.512+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.512+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.516+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:18:46.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.520+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.520+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.520+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.524+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:18:46.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.524+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.524+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.524+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.528+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:18:46.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.532+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.532+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.532+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.536+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:18:46.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.536+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.540+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.540+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.540+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:18:46.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.544+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.544+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.548+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.548+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:18:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.552+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.556+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.556+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.556+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:18:46.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.560+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.560+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.560+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.564+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:18:46.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.568+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.568+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.572+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.572+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:18:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.576+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.580+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.580+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.584+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:18:46.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.584+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.588+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.588+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.592+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:18:46.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.596+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.596+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.596+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.596+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:18:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.600+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.604+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.604+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.604+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:18:46.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.608+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.608+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.612+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.612+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:18:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.616+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.616+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.620+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.620+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:18:46.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.624+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.624+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.624+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.628+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:18:46.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.632+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.632+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.632+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.636+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:18:46.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.640+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.640+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.640+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.644+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:18:46.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.648+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.648+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.652+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.652+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:18:46.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.656+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.660+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.660+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.664+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:18:46.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.668+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.668+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.672+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.672+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:18:46.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.676+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.676+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.680+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.680+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:18:46.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.684+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.684+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.688+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.688+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:18:46.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.692+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.692+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.696+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.696+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:18:46.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.700+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.704+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.704+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.708+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:18:46.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.712+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.712+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.712+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.716+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:18:46.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.720+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.720+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.720+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.724+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:18:46.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.728+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.728+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.728+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.732+0000 7f25111409c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:18:46.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.736+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.736+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:46.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.736+0000 7f25111409c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:46.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.740+0000 7f23c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:18:46.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.748+0000 7f25111409c0 20 remove_watcher() i=0 2024-09-12T18:18:46.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.748+0000 7f25111409c0 2 removed watcher, disabling cache 2024-09-12T18:18:46.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.748+0000 7f25111409c0 20 remove_watcher() i=1 2024-09-12T18:18:46.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.752+0000 7f25111409c0 20 remove_watcher() i=2 2024-09-12T18:18:46.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.752+0000 7f25111409c0 20 remove_watcher() i=3 2024-09-12T18:18:46.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.756+0000 7f25111409c0 20 remove_watcher() i=4 2024-09-12T18:18:46.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.760+0000 7f25111409c0 20 remove_watcher() i=5 2024-09-12T18:18:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.760+0000 7f25111409c0 20 remove_watcher() i=6 2024-09-12T18:18:46.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.764+0000 7f25111409c0 20 remove_watcher() i=7 2024-09-12T18:18:46.790 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:18:46.862 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:18:46.862 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:18:46.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.904+0000 7f82df6ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.904+0000 7f82df6ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.904+0000 7f82df6ca9c0 20 realm 2024-09-12T18:18:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.904+0000 7f82df6ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.904+0000 7f82df6ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.904+0000 7f82df6ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:18:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.904+0000 7f82df6ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.904+0000 7f82df6ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.904+0000 7f82df6ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.908+0000 7f82df6ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:18:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.908+0000 7f82df6ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.908+0000 7f82df6ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:18:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.908+0000 7f82df6ca9c0 20 searching for the correct realm 2024-09-12T18:18:46.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:46.912+0000 7f82dc9cf640 0 -- 172.21.15.97:0/276277722 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f82c80717c0 msgr2=0x7f82c8069350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:18:47.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.124+0000 7f82dd9d1640 0 -- 172.21.15.97:0/276277722 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55d0cba5c150 msgr2=0x55d0cba5e610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:18:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.136+0000 7f82df6ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:18:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.136+0000 7f82df6ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:18:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.136+0000 7f82df6ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:18:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.136+0000 7f82df6ca9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:18:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.136+0000 7f82df6ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:18:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.136+0000 7f82df6ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:18:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.136+0000 7f82df6ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:47.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:18:47.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:18:47.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 zone default found 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 4 Realm: () 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 zonegroup default 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 started sync module instance, tier type = 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.140+0000 7f82df6ca9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:18:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.164+0000 7f82df6ca9c0 20 add_watcher() i=0 2024-09-12T18:18:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.164+0000 7f82df6ca9c0 20 add_watcher() i=1 2024-09-12T18:18:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.164+0000 7f82df6ca9c0 20 add_watcher() i=2 2024-09-12T18:18:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.164+0000 7f82df6ca9c0 20 add_watcher() i=3 2024-09-12T18:18:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.164+0000 7f82df6ca9c0 20 add_watcher() i=4 2024-09-12T18:18:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.164+0000 7f82df6ca9c0 20 add_watcher() i=5 2024-09-12T18:18:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.164+0000 7f82df6ca9c0 20 add_watcher() i=6 2024-09-12T18:18:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.164+0000 7f82df6ca9c0 20 add_watcher() i=7 2024-09-12T18:18:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.164+0000 7f82df6ca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:18:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.168+0000 7f81937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:18:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.168+0000 7f82df6ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:18:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.168+0000 7f82df6ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:18:47.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.280+0000 7f81927e4640 20 reqs_thread_entry: start 2024-09-12T18:18:47.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.280+0000 7f82df6ca9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:18:47.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.280+0000 7f82df6ca9c0 20 Filter name: none 2024-09-12T18:18:47.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.280+0000 7f8103fff640 20 reqs_thread_entry: start 2024-09-12T18:18:47.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.280+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:18:47.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.280+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.284+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.284+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.288+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:18:47.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.288+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.288+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.292+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.292+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:18:47.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.296+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.296+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.300+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.300+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:18:47.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.308+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.308+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.308+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.312+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:18:47.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.316+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.316+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.316+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.316+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:18:47.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.320+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.324+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.324+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.324+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:18:47.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.328+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.332+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.332+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.332+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:18:47.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.336+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.340+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.340+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.344+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:18:47.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.344+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.344+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.348+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.348+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:18:47.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.352+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.352+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.352+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.356+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:18:47.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.360+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.360+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.360+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.364+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:18:47.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.368+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.372+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.372+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.376+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:18:47.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.380+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.380+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.380+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.384+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:18:47.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.388+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.388+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.388+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.392+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:18:47.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.396+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.396+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.396+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.400+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:18:47.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.404+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.404+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.404+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.408+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:18:47.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.412+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.412+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.412+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.416+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:18:47.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.424+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.424+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.424+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.428+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:18:47.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.432+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.432+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.436+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.436+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:18:47.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.440+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.440+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.444+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.444+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:18:47.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.448+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.448+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.452+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.452+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:18:47.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.456+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.460+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.460+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.464+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:18:47.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.468+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.468+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.468+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.472+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:18:47.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.476+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.476+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.476+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.480+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:18:47.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.484+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.484+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.484+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.488+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:18:47.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.492+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.492+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.492+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.496+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:18:47.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.496+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.500+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.500+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.504+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:18:47.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.508+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.512+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.512+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.512+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:18:47.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.516+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.516+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.520+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.520+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:18:47.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.524+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.528+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.528+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.528+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:18:47.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.532+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.536+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.536+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.540+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:18:47.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.544+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.544+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:47.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.544+0000 7f82df6ca9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:47.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.552+0000 7f81937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:18:47.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.556+0000 7f82df6ca9c0 20 remove_watcher() i=0 2024-09-12T18:18:47.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.556+0000 7f82df6ca9c0 2 removed watcher, disabling cache 2024-09-12T18:18:47.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.560+0000 7f82df6ca9c0 20 remove_watcher() i=1 2024-09-12T18:18:47.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.560+0000 7f82df6ca9c0 20 remove_watcher() i=2 2024-09-12T18:18:47.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.564+0000 7f82df6ca9c0 20 remove_watcher() i=3 2024-09-12T18:18:47.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.564+0000 7f82df6ca9c0 20 remove_watcher() i=4 2024-09-12T18:18:47.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.568+0000 7f82df6ca9c0 20 remove_watcher() i=5 2024-09-12T18:18:47.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.572+0000 7f82df6ca9c0 20 remove_watcher() i=6 2024-09-12T18:18:47.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.576+0000 7f82df6ca9c0 20 remove_watcher() i=7 2024-09-12T18:18:47.600 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:18:47.675 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:18:47.675 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:18:47.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.716+0000 7f6577b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.720+0000 7f6577b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:47.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.720+0000 7f6577b4f9c0 20 realm 2024-09-12T18:18:47.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.720+0000 7f6577b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.720+0000 7f6577b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:47.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.720+0000 7f6577b4f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:18:47.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.720+0000 7f6577b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.720+0000 7f6577b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:47.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.720+0000 7f6577b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.720+0000 7f6577b4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:18:47.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.720+0000 7f6577b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.724+0000 7f6577b4f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:18:47.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.724+0000 7f6577b4f9c0 20 searching for the correct realm 2024-09-12T18:18:47.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.728+0000 7f6574e54640 0 -- 172.21.15.97:0/2397664895 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x5608fc5cff70 msgr2=0x5608fc5d2360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:18:47.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.732+0000 7f6575655640 0 -- 172.21.15.97:0/2397664895 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f65700f6450 msgr2=0x7f65700f4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:18:47.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:18:47.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:18:47.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:18:47.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:18:47.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:18:47.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:18:47.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:47.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:18:47.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:18:47.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 zone default found 2024-09-12T18:18:47.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 4 Realm: () 2024-09-12T18:18:47.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:18:47.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:18:47.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:18:47.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 zonegroup default 2024-09-12T18:18:47.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:47.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.952+0000 7f6577b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.956+0000 7f6577b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:47.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.956+0000 7f6577b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:47.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.956+0000 7f6577b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:47.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.956+0000 7f6577b4f9c0 20 started sync module instance, tier type = 2024-09-12T18:18:47.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.956+0000 7f6577b4f9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:18:47.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.976+0000 7f6577b4f9c0 20 add_watcher() i=0 2024-09-12T18:18:47.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.980+0000 7f6577b4f9c0 20 add_watcher() i=1 2024-09-12T18:18:47.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.980+0000 7f6577b4f9c0 20 add_watcher() i=2 2024-09-12T18:18:47.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.980+0000 7f6577b4f9c0 20 add_watcher() i=3 2024-09-12T18:18:47.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.980+0000 7f6577b4f9c0 20 add_watcher() i=4 2024-09-12T18:18:47.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.980+0000 7f6577b4f9c0 20 add_watcher() i=5 2024-09-12T18:18:47.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.980+0000 7f6577b4f9c0 20 add_watcher() i=6 2024-09-12T18:18:47.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.980+0000 7f6577b4f9c0 20 add_watcher() i=7 2024-09-12T18:18:47.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.980+0000 7f6577b4f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:18:47.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.984+0000 7f64277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:18:47.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.984+0000 7f6577b4f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:18:47.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:47.984+0000 7f6577b4f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:18:48.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.076+0000 7f64267e4640 20 reqs_thread_entry: start 2024-09-12T18:18:48.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.076+0000 7f6577b4f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:18:48.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.076+0000 7f6577b4f9c0 20 Filter name: none 2024-09-12T18:18:48.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.076+0000 7f6397fff640 20 reqs_thread_entry: start 2024-09-12T18:18:48.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.076+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:18:48.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.080+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.080+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.080+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.084+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:18:48.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.088+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.088+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.088+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.088+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:18:48.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.092+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.096+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.096+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.096+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:18:48.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.100+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.104+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.104+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.108+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:18:48.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.112+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.112+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.112+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.116+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:18:48.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.116+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.120+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.120+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.120+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:18:48.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.124+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.124+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.128+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.128+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:18:48.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.132+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.132+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.132+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.136+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:18:48.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.140+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.140+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.140+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.144+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:18:48.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.148+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.148+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.148+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.148+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:18:48.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.152+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.152+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.152+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.156+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:18:48.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.156+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.160+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.160+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.160+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:18:48.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.164+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.168+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.168+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.168+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:18:48.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.172+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.172+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.172+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.176+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:18:48.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.180+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.180+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.184+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.184+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:18:48.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.188+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.192+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.192+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.196+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:18:48.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.196+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.200+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.200+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.204+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:18:48.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.204+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.208+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.208+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.208+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:18:48.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.212+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.212+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.212+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.216+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:18:48.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.220+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.220+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.220+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.224+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:18:48.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.228+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.228+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.228+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.232+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:18:48.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.236+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.236+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.236+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.240+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:18:48.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.244+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.244+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.244+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.244+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:18:48.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.248+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.248+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.252+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.252+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:18:48.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.256+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.260+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.260+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.264+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:18:48.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.268+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.268+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.268+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.272+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:18:48.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.276+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.280+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.280+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.284+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:18:48.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.288+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.288+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.288+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.292+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:18:48.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.296+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.296+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.296+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.300+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:18:48.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.304+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.304+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.308+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.308+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:18:48.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.312+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.316+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.316+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.316+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:18:48.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.320+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.324+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:18:48.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.324+0000 7f6577b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:18:48.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.328+0000 7f64277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:18:48.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.332+0000 7f6577b4f9c0 20 remove_watcher() i=0 2024-09-12T18:18:48.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.332+0000 7f6577b4f9c0 2 removed watcher, disabling cache 2024-09-12T18:18:48.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.336+0000 7f6577b4f9c0 20 remove_watcher() i=1 2024-09-12T18:18:48.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.340+0000 7f6577b4f9c0 20 remove_watcher() i=2 2024-09-12T18:18:48.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.340+0000 7f6577b4f9c0 20 remove_watcher() i=3 2024-09-12T18:18:48.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.344+0000 7f6577b4f9c0 20 remove_watcher() i=4 2024-09-12T18:18:48.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.344+0000 7f6577b4f9c0 20 remove_watcher() i=5 2024-09-12T18:18:48.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.348+0000 7f6577b4f9c0 20 remove_watcher() i=6 2024-09-12T18:18:48.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:48.352+0000 7f6577b4f9c0 20 remove_watcher() i=7 2024-09-12T18:18:48.382 DEBUG:teuthology.orchestra.run.smithi097:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T18:18:49.102 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :clean 2024-09-12T18:18:49.999 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileJava 2024-09-12T18:18:49.999 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processResources 2024-09-12T18:18:49.999 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :classes 2024-09-12T18:18:50.499 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:50.500 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileTestJava 2024-09-12T18:18:50.500 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:50.500 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:18:50.500 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :testClasses 2024-09-12T18:18:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:18:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:18:52.499 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:52.499 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :test 2024-09-12T18:18:52.499 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:52.499 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T18:18:52.501 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12 18:18:51,816 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:18:52.501 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:52.501 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T18:18:52.501 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:52.501 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T18:18:52.899 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:52.899 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T18:18:52.999 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:52.999 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T18:18:53.699 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:53.699 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T18:18:53.799 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:53.799 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T18:18:54.499 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:54.499 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T18:18:55.099 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:55.099 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T18:18:55.199 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:55.199 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T18:18:55.599 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:55.600 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T18:18:56.399 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:56.399 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T18:18:56.499 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:56.499 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T18:18:56.599 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:56.599 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T18:18:56.999 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:56.999 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T18:18:58.299 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:58.299 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T18:18:58.599 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:58.599 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T18:18:59.299 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:59.299 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T18:18:59.399 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:59.400 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T18:18:59.576 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:59.577 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------- 2024-09-12T18:18:59.577 INFO:teuthology.orchestra.run.smithi097.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T18:18:59.577 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------- 2024-09-12T18:18:59.577 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:59.578 INFO:teuthology.orchestra.run.smithi097.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:18:59.578 INFO:teuthology.orchestra.run.smithi097.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:18:59.578 INFO:teuthology.orchestra.run.smithi097.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:18:59.578 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:18:59.578 INFO:teuthology.orchestra.run.smithi097.stdout:BUILD SUCCESSFUL in 11s 2024-09-12T18:18:59.579 INFO:teuthology.orchestra.run.smithi097.stdout:5 actionable tasks: 5 executed 2024-09-12T18:18:59.583 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:18:59.610 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:18:59.611 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:18:59.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.847+0000 7f474bfff640 0 --2- 172.21.15.97:0/738225331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563f97bbc040 0x563f97bd0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:18:59.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.863+0000 7f47551359c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:59.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.863+0000 7f47551359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:59.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.863+0000 7f47551359c0 20 realm 2024-09-12T18:18:59.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.863+0000 7f47551359c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:59.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.863+0000 7f47551359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:59.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.863+0000 7f47551359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:18:59.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.863+0000 7f47551359c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:59.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.863+0000 7f47551359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:18:59.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.863+0000 7f47551359c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:59.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.867+0000 7f47551359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:18:59.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.867+0000 7f47551359c0 20 rados->read ofs=0 len=0 2024-09-12T18:18:59.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.867+0000 7f47551359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:18:59.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.867+0000 7f47551359c0 20 searching for the correct realm 2024-09-12T18:18:59.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.871+0000 7f474bfff640 0 -- 172.21.15.97:0/3197152309 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x563f97c2a8d0 msgr2=0x563f97c2cce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:18:59.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:18:59.879+0000 7f4752c3b640 0 -- 172.21.15.97:0/3197152309 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f474c00e070 msgr2=0x7f474c060000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:00.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.095+0000 7f47551359c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:19:00.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.095+0000 7f47551359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:00.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.095+0000 7f47551359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:00.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.095+0000 7f47551359c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:19:00.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.095+0000 7f47551359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:00.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.095+0000 7f47551359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:00.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.095+0000 7f47551359c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.095+0000 7f47551359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:00.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.095+0000 7f47551359c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:00.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:00.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 zone default found 2024-09-12T18:19:00.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 4 Realm: () 2024-09-12T18:19:00.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:19:00.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:19:00.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:00.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 zonegroup default 2024-09-12T18:19:00.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:00.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:00.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:00.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 started sync module instance, tier type = 2024-09-12T18:19:00.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.099+0000 7f47551359c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:19:00.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.123+0000 7f47551359c0 20 add_watcher() i=0 2024-09-12T18:19:00.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.123+0000 7f47551359c0 20 add_watcher() i=1 2024-09-12T18:19:00.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.123+0000 7f47551359c0 20 add_watcher() i=2 2024-09-12T18:19:00.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.123+0000 7f47551359c0 20 add_watcher() i=3 2024-09-12T18:19:00.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.123+0000 7f47551359c0 20 add_watcher() i=4 2024-09-12T18:19:00.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.123+0000 7f47551359c0 20 add_watcher() i=5 2024-09-12T18:19:00.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.123+0000 7f47551359c0 20 add_watcher() i=6 2024-09-12T18:19:00.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.123+0000 7f47551359c0 20 add_watcher() i=7 2024-09-12T18:19:00.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.123+0000 7f47551359c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:00.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.127+0000 7f4609fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:00.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.127+0000 7f47551359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:00.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.127+0000 7f47551359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:00.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.207+0000 7f4608fe1640 20 reqs_thread_entry: start 2024-09-12T18:19:00.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.211+0000 7f47551359c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:00.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.211+0000 7f47551359c0 20 Filter name: none 2024-09-12T18:19:00.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.211+0000 7f4601ffb640 20 reqs_thread_entry: start 2024-09-12T18:19:00.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.211+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:19:00.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.215+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.215+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.215+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.219+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:19:00.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.223+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.223+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.223+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.223+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:19:00.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.227+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.227+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.231+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.231+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:19:00.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.235+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.235+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.239+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.239+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:19:00.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.243+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.243+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.243+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.247+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:19:00.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.251+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.251+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.251+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.255+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:19:00.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.259+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.259+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.263+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.263+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:19:00.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.267+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.271+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.271+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.275+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:19:00.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.275+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.279+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.279+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.279+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:19:00.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.283+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.287+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.287+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:19:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.287+0000 7f47551359c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16968637531495687712', time=2024-09-12T20:18:55.795774+0000, chain.objs.size()=1 2024-09-12T18:19:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.287+0000 7f47551359c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.71__shadow_.nMM8rv7KvLBbSlQV20fX_YYLb0PdmmM_0 2024-09-12T18:19:00.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.291+0000 7f47551359c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:00.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.295+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:19:00.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.299+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.299+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.299+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.303+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:19:00.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.307+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.307+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.307+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.311+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:19:00.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.315+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.315+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.315+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.319+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:19:00.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.323+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.323+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.323+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.323+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:19:00.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.327+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.331+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.331+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.331+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:19:00.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.335+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.339+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.339+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.339+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:19:00.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.343+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.343+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.343+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.347+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:19:00.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.351+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.351+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.355+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.359+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:19:00.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.363+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.363+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.363+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.367+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:19:00.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.371+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.371+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.371+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.375+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:19:00.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.379+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.379+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.383+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.383+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:19:00.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.387+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.391+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.391+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.395+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:19:00.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.399+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.399+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.399+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.403+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:19:00.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.407+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.407+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.411+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.411+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:19:00.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.415+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.415+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.419+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.419+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:19:00.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.423+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.423+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.423+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.427+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:19:00.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.431+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.431+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.431+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.435+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:19:00.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.439+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.439+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.443+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.443+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:19:00.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.447+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.447+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.451+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.455+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:19:00.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.455+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.459+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.459+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:19:00.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.459+0000 7f47551359c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14885046232284246006', time=2024-09-12T20:18:57.204843+0000, chain.objs.size()=1 2024-09-12T18:19:00.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.459+0000 7f47551359c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.72__shadow_.8GdDY77QiW1OhcymrDwjQrzA7jQSxJu_0 2024-09-12T18:19:00.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.463+0000 7f47551359c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:00.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.467+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:19:00.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.471+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.471+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.475+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.475+0000 7f47551359c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:19:00.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.479+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.479+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.479+0000 7f47551359c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.487+0000 7f4609fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.491+0000 7f47551359c0 20 remove_watcher() i=0 2024-09-12T18:19:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.491+0000 7f47551359c0 2 removed watcher, disabling cache 2024-09-12T18:19:00.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.495+0000 7f47551359c0 20 remove_watcher() i=1 2024-09-12T18:19:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.495+0000 7f47551359c0 20 remove_watcher() i=2 2024-09-12T18:19:00.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.499+0000 7f47551359c0 20 remove_watcher() i=3 2024-09-12T18:19:00.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.503+0000 7f47551359c0 20 remove_watcher() i=4 2024-09-12T18:19:00.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.503+0000 7f47551359c0 20 remove_watcher() i=5 2024-09-12T18:19:00.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.507+0000 7f47551359c0 20 remove_watcher() i=6 2024-09-12T18:19:00.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.511+0000 7f47551359c0 20 remove_watcher() i=7 2024-09-12T18:19:00.532 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:19:00.605 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:00.605 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:00.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.647+0000 7f36e64239c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.651+0000 7f36e64239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:00.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.651+0000 7f36e64239c0 20 realm 2024-09-12T18:19:00.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.651+0000 7f36e64239c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.651+0000 7f36e64239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:00.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.651+0000 7f36e64239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:00.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.651+0000 7f36e64239c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.651+0000 7f36e64239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:00.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.651+0000 7f36e64239c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.651+0000 7f36e64239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:00.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.651+0000 7f36e64239c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.655+0000 7f36e64239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:00.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.655+0000 7f36e64239c0 20 searching for the correct realm 2024-09-12T18:19:00.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.659+0000 7f36e472a640 0 -- 172.21.15.97:0/2114730924 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f36cc03d060 msgr2=0x7f36cc063980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:00.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.667+0000 7f36e3f29640 0 -- 172.21.15.97:0/2114730924 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f36dc122020 msgr2=0x7f36dc10e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:00.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.671+0000 7f36e64239c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:19:00.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.671+0000 7f36e64239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:00.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.671+0000 7f36e64239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:00.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.671+0000 7f36e64239c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:19:00.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.671+0000 7f36e64239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:00.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.671+0000 7f36e64239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:00.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.671+0000 7f36e64239c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.671+0000 7f36e64239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:00.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.671+0000 7f36e64239c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:00.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:00.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 zone default found 2024-09-12T18:19:00.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 4 Realm: () 2024-09-12T18:19:00.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:19:00.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:19:00.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:00.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 zonegroup default 2024-09-12T18:19:00.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:00.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:00.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:00.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:00.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 started sync module instance, tier type = 2024-09-12T18:19:00.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.675+0000 7f36e64239c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:19:00.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.695+0000 7f36e64239c0 20 add_watcher() i=0 2024-09-12T18:19:00.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.695+0000 7f36e64239c0 20 add_watcher() i=1 2024-09-12T18:19:00.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.695+0000 7f36e64239c0 20 add_watcher() i=2 2024-09-12T18:19:00.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.695+0000 7f36e64239c0 20 add_watcher() i=3 2024-09-12T18:19:00.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.695+0000 7f36e64239c0 20 add_watcher() i=4 2024-09-12T18:19:00.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.695+0000 7f36e64239c0 20 add_watcher() i=5 2024-09-12T18:19:00.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.695+0000 7f36e64239c0 20 add_watcher() i=6 2024-09-12T18:19:00.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.695+0000 7f36e64239c0 20 add_watcher() i=7 2024-09-12T18:19:00.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.695+0000 7f36e64239c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:00.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.699+0000 7f359a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:00.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.699+0000 7f36e64239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:00.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.699+0000 7f36e64239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:00.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.775+0000 7f35997e2640 20 reqs_thread_entry: start 2024-09-12T18:19:00.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.775+0000 7f36e64239c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:00.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.775+0000 7f36e64239c0 20 Filter name: none 2024-09-12T18:19:00.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.775+0000 7f35927fc640 20 reqs_thread_entry: start 2024-09-12T18:19:00.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.775+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:19:00.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.779+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.779+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.779+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.783+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:19:00.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.787+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.787+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.787+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.791+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:19:00.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.795+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.795+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.795+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.799+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:19:00.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.799+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.803+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.803+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.803+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:19:00.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.807+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.811+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.811+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.811+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:19:00.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.815+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.815+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.815+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.819+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:19:00.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.823+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.823+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.823+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.827+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:19:00.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.831+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.831+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.831+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.831+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:19:00.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.835+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.835+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.835+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.835+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:19:00.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.839+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.839+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.839+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.843+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:19:00.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.847+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.847+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.847+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.851+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:19:00.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.851+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.855+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.855+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.855+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:19:00.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.859+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.859+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.859+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.863+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:19:00.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.867+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.867+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.867+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.871+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:19:00.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.875+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.875+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.875+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.879+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:19:00.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.879+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.879+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.879+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.883+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:19:00.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.887+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.887+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.887+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.891+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:19:00.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.895+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.899+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.899+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.899+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:19:00.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.903+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.907+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.907+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.911+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:19:00.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.911+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.915+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.915+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.915+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:19:00.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.919+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.919+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.919+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.923+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:19:00.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.927+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.931+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.931+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.935+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:19:00.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.935+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.939+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.939+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.939+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:19:00.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.943+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.947+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.947+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.947+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:19:00.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.951+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.955+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.955+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.959+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:19:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.959+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.963+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.963+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.963+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:19:00.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.967+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.967+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.971+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.971+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:19:00.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.975+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.975+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.979+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.979+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:19:00.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.983+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.987+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.987+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.991+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:19:00.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.995+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:00.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.995+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:00.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.995+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:00.999+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:19:01.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.003+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.007+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.007+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.011+0000 7f36e64239c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:19:01.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.015+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.015+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.015+0000 7f36e64239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.019+0000 7f359a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:01.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.027+0000 7f36e64239c0 20 remove_watcher() i=0 2024-09-12T18:19:01.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.027+0000 7f36e64239c0 2 removed watcher, disabling cache 2024-09-12T18:19:01.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.027+0000 7f36e64239c0 20 remove_watcher() i=1 2024-09-12T18:19:01.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.031+0000 7f36e64239c0 20 remove_watcher() i=2 2024-09-12T18:19:01.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.031+0000 7f36e64239c0 20 remove_watcher() i=3 2024-09-12T18:19:01.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.035+0000 7f36e64239c0 20 remove_watcher() i=4 2024-09-12T18:19:01.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.039+0000 7f36e64239c0 20 remove_watcher() i=5 2024-09-12T18:19:01.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.043+0000 7f36e64239c0 20 remove_watcher() i=6 2024-09-12T18:19:01.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.043+0000 7f36e64239c0 20 remove_watcher() i=7 2024-09-12T18:19:01.066 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:19:01.138 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:01.139 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:01.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.183+0000 7f1e5bf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.183+0000 7f1e5bf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.183+0000 7f1e5bf7d9c0 20 realm 2024-09-12T18:19:01.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.183+0000 7f1e5bf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.183+0000 7f1e5bf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.183+0000 7f1e5bf7d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:01.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.183+0000 7f1e5bf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.187+0000 7f1e5bf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.187+0000 7f1e5bf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.187+0000 7f1e5bf7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:01.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.187+0000 7f1e5bf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.187+0000 7f1e5bf7d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:01.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.187+0000 7f1e5bf7d9c0 20 searching for the correct realm 2024-09-12T18:19:01.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.195+0000 7f1e5a284640 0 -- 172.21.15.97:0/2065930588 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f1e50008040 msgr2=0x7f1e5004d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:01.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.199+0000 7f1e59a83640 0 -- 172.21.15.97:0/2065930588 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f1e540cd400 msgr2=0x7f1e540cd880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:01.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:19:01.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:01.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:01.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:19:01.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:01.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:01.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:01.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:01.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 zone default found 2024-09-12T18:19:01.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 4 Realm: () 2024-09-12T18:19:01.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:19:01.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:19:01.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:01.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 zonegroup default 2024-09-12T18:19:01.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.207+0000 7f1e5bf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.211+0000 7f1e5bf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.211+0000 7f1e5bf7d9c0 20 started sync module instance, tier type = 2024-09-12T18:19:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.211+0000 7f1e5bf7d9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:19:01.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.227+0000 7f1e5bf7d9c0 20 add_watcher() i=0 2024-09-12T18:19:01.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.227+0000 7f1e5bf7d9c0 20 add_watcher() i=1 2024-09-12T18:19:01.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.227+0000 7f1e5bf7d9c0 20 add_watcher() i=2 2024-09-12T18:19:01.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.227+0000 7f1e5bf7d9c0 20 add_watcher() i=3 2024-09-12T18:19:01.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.227+0000 7f1e5bf7d9c0 20 add_watcher() i=4 2024-09-12T18:19:01.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.227+0000 7f1e5bf7d9c0 20 add_watcher() i=5 2024-09-12T18:19:01.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.227+0000 7f1e5bf7d9c0 20 add_watcher() i=6 2024-09-12T18:19:01.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.231+0000 7f1e5bf7d9c0 20 add_watcher() i=7 2024-09-12T18:19:01.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.231+0000 7f1e5bf7d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:01.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.235+0000 7f1d0ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:01.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.235+0000 7f1e5bf7d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:01.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.235+0000 7f1e5bf7d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:01.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.311+0000 7f1d0efe5640 20 reqs_thread_entry: start 2024-09-12T18:19:01.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.311+0000 7f1e5bf7d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:01.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.311+0000 7f1e5bf7d9c0 20 Filter name: none 2024-09-12T18:19:01.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.311+0000 7f1d0cfe1640 20 reqs_thread_entry: start 2024-09-12T18:19:01.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.311+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:19:01.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.315+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.319+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.319+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.319+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:19:01.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.323+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.323+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.323+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.327+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:19:01.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.331+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.331+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.335+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.335+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:19:01.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.339+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.343+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.343+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.343+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:19:01.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.347+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.351+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.351+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.351+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:19:01.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.355+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.359+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.359+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.363+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:19:01.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.363+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.367+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.367+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.371+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:19:01.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.375+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.375+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.375+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.379+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:19:01.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.383+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.383+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.383+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.387+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:19:01.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.391+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.391+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.391+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.395+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:19:01.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.399+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.399+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.399+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.403+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:19:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.403+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.407+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.407+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.411+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:19:01.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.411+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.411+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.411+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.415+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:19:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.419+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.419+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.419+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.423+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:19:01.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.423+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.423+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.427+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.427+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:19:01.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.431+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.431+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.435+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.435+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:19:01.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.439+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.443+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.443+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.443+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:19:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.447+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.451+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.451+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.455+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:19:01.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.455+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.459+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.459+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.463+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:19:01.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.463+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.467+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.467+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.467+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:19:01.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.471+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.471+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.471+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.475+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:19:01.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.479+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.479+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.479+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.483+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:19:01.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.487+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.487+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.487+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.491+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:19:01.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.495+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.495+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.495+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.499+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:19:01.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.503+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.503+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.503+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.507+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:19:01.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.507+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.511+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.511+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.511+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:19:01.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.515+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.515+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.515+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.523+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:19:01.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.523+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.523+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.523+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.527+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:19:01.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.531+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.531+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.535+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.535+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:19:01.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.539+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.539+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.543+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.543+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:19:01.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.547+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.547+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.551+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.551+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:19:01.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.555+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.555+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.555+0000 7f1e5bf7d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.559+0000 7f1d0ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.567+0000 7f1e5bf7d9c0 20 remove_watcher() i=0 2024-09-12T18:19:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.567+0000 7f1e5bf7d9c0 2 removed watcher, disabling cache 2024-09-12T18:19:01.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.567+0000 7f1e5bf7d9c0 20 remove_watcher() i=1 2024-09-12T18:19:01.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.571+0000 7f1e5bf7d9c0 20 remove_watcher() i=2 2024-09-12T18:19:01.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.571+0000 7f1e5bf7d9c0 20 remove_watcher() i=3 2024-09-12T18:19:01.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.575+0000 7f1e5bf7d9c0 20 remove_watcher() i=4 2024-09-12T18:19:01.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.575+0000 7f1e5bf7d9c0 20 remove_watcher() i=5 2024-09-12T18:19:01.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.579+0000 7f1e5bf7d9c0 20 remove_watcher() i=6 2024-09-12T18:19:01.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.583+0000 7f1e5bf7d9c0 20 remove_watcher() i=7 2024-09-12T18:19:01.606 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:19:01.685 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:01.685 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:01.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.727+0000 7fa2c819e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 20 realm 2024-09-12T18:19:01.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:01.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:01.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.731+0000 7fa2c819e9c0 20 searching for the correct realm 2024-09-12T18:19:01.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.739+0000 7fa2c64a5640 0 -- 172.21.15.97:0/2934972375 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fa2bc031040 msgr2=0x7fa2bc071710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:01.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.743+0000 7fa2c5ca4640 0 -- 172.21.15.97:0/2934972375 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fa2c000e050 msgr2=0x7fa2c005c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:01.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:19:01.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:01.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:01.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:19:01.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:01.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:01.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:01.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:01.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 zone default found 2024-09-12T18:19:01.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 4 Realm: () 2024-09-12T18:19:01.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:19:01.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:19:01.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:01.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 zonegroup default 2024-09-12T18:19:01.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.751+0000 7fa2c819e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.755+0000 7fa2c819e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.755+0000 7fa2c819e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.755+0000 7fa2c819e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.755+0000 7fa2c819e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:01.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.755+0000 7fa2c819e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:01.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.755+0000 7fa2c819e9c0 20 started sync module instance, tier type = 2024-09-12T18:19:01.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.755+0000 7fa2c819e9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:19:01.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.771+0000 7fa2c819e9c0 20 add_watcher() i=0 2024-09-12T18:19:01.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.771+0000 7fa2c819e9c0 20 add_watcher() i=1 2024-09-12T18:19:01.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.771+0000 7fa2c819e9c0 20 add_watcher() i=2 2024-09-12T18:19:01.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.771+0000 7fa2c819e9c0 20 add_watcher() i=3 2024-09-12T18:19:01.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.771+0000 7fa2c819e9c0 20 add_watcher() i=4 2024-09-12T18:19:01.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.771+0000 7fa2c819e9c0 20 add_watcher() i=5 2024-09-12T18:19:01.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.771+0000 7fa2c819e9c0 20 add_watcher() i=6 2024-09-12T18:19:01.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.775+0000 7fa2c819e9c0 20 add_watcher() i=7 2024-09-12T18:19:01.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.775+0000 7fa2c819e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:01.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.779+0000 7fa177fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:01.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.779+0000 7fa2c819e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:01.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.779+0000 7fa2c819e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:01.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.851+0000 7fa176ffd640 20 reqs_thread_entry: start 2024-09-12T18:19:01.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.851+0000 7fa2c819e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:01.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.851+0000 7fa2c819e9c0 20 Filter name: none 2024-09-12T18:19:01.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.851+0000 7fa174ff9640 20 reqs_thread_entry: start 2024-09-12T18:19:01.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.851+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:19:01.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.851+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.855+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.855+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.855+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:19:01.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.859+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.863+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.863+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.863+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:19:01.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.867+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.867+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.867+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.871+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:19:01.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.875+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.875+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.875+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.879+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:19:01.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.879+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.879+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.883+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.883+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:19:01.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.887+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.887+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.887+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.887+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:19:01.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.891+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.891+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.891+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.895+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:19:01.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.899+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.899+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.899+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.903+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:19:01.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.903+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.907+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.907+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.911+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:19:01.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.911+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.915+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.915+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.919+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:19:01.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.919+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.923+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.923+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.927+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:19:01.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.931+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.931+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.931+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.931+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:19:01.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.935+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.939+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.939+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.943+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:19:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.943+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.943+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.943+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.947+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:19:01.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.951+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.951+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.955+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.955+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:19:01.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.959+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.963+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.963+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.963+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:19:01.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.967+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.971+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.971+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.971+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:19:01.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.975+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.979+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.979+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.983+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:19:01.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.987+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.987+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:01.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.987+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.991+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:19:01.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.995+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:01.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.995+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.999+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:01.999+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:19:02.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.003+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.003+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.007+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.007+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:19:02.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.011+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.011+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.015+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.015+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:19:02.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.019+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.019+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.019+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.023+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:19:02.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.027+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.031+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.031+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.035+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:19:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.035+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.039+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.039+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.043+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:19:02.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.043+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.043+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.043+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.047+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:19:02.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.051+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.051+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.051+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.055+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:19:02.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.055+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.059+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.059+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.063+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:19:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.067+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.067+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.067+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.067+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:19:02.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.071+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.075+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.075+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.075+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:19:02.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.079+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.083+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.083+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.087+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:19:02.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.087+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.091+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:02.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.091+0000 7fa2c819e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:02.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.095+0000 7fa177fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:02.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.099+0000 7fa2c819e9c0 20 remove_watcher() i=0 2024-09-12T18:19:02.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.099+0000 7fa2c819e9c0 2 removed watcher, disabling cache 2024-09-12T18:19:02.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.103+0000 7fa2c819e9c0 20 remove_watcher() i=1 2024-09-12T18:19:02.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.103+0000 7fa2c819e9c0 20 remove_watcher() i=2 2024-09-12T18:19:02.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.107+0000 7fa2c819e9c0 20 remove_watcher() i=3 2024-09-12T18:19:02.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.111+0000 7fa2c819e9c0 20 remove_watcher() i=4 2024-09-12T18:19:02.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.111+0000 7fa2c819e9c0 20 remove_watcher() i=5 2024-09-12T18:19:02.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.115+0000 7fa2c819e9c0 20 remove_watcher() i=6 2024-09-12T18:19:02.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:19:02.119+0000 7fa2c819e9c0 20 remove_watcher() i=7 2024-09-12T18:19:02.143 DEBUG:teuthology.orchestra.run.smithi097:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T18:19:02.842 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :clean 2024-09-12T18:19:03.540 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileJava 2024-09-12T18:19:03.540 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processResources 2024-09-12T18:19:03.540 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :classes 2024-09-12T18:19:04.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:04.040 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileTestJava 2024-09-12T18:19:04.040 INFO:teuthology.orchestra.run.smithi097.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:19:04.041 INFO:teuthology.orchestra.run.smithi097.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:19:04.041 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:04.041 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:19:04.041 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :testClasses 2024-09-12T18:19:06.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:06.041 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :test 2024-09-12T18:19:06.041 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:06.041 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests STANDARD_OUT 2024-09-12T18:19:06.042 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12 18:19:05,330 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:19:06.042 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:06.042 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T18:19:06.042 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:06.042 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T18:19:07.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:07.240 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T18:19:07.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:07.440 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T18:19:08.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:08.240 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T18:19:08.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:08.440 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T18:19:09.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:09.140 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T18:19:20.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:20.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T18:19:21.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:21.240 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T18:19:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:21.440 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T18:19:22.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:22.140 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T18:19:22.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:22.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T18:19:23.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:23.340 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T18:19:23.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:23.440 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T18:19:23.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:23.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T18:19:23.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:23.740 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T18:19:24.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:24.440 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T18:19:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:32.941 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T18:19:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:33.640 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T18:19:33.940 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:33.940 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T18:19:34.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:34.740 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T18:19:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:35.040 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T18:19:35.840 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:35.840 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T18:19:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:36.040 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T18:19:36.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:36.740 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T18:19:36.940 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:36.940 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T18:19:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:37.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T18:19:37.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:37.741 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T18:19:38.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:38.440 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T18:19:38.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:38.640 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T18:19:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:39.340 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T18:19:39.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:39.741 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T18:19:40.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:40.440 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T18:19:53.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:53.041 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T18:19:54.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:19:54.340 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T18:20:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:20:39.341 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T18:20:40.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:20:40.740 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T18:20:40.840 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:20:40.840 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T18:20:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:20:41.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T18:20:41.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:20:41.740 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T18:20:42.940 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:20:42.940 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T18:21:04.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:21:04.441 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T18:21:05.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:21:05.140 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T18:21:05.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:21:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T18:21:05.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:21:05.440 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T18:21:22.241 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:21:22.241 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T18:21:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:21:27.041 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests STANDARD_OUT 2024-09-12T18:21:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12 18:21:26,951 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T18:21:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12 18:21:26,956 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T18:21:28.241 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:21:28.241 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T18:22:07.841 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:22:07.841 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T18:22:08.940 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:22:08.940 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T18:22:20.141 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:22:20.141 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T18:22:20.940 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:22:20.941 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T18:23:38.841 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:23:38.842 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T18:23:39.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:23:39.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T18:23:55.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:23:55.741 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T18:23:56.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:23:56.440 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T18:24:08.241 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:08.241 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T18:24:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:09.040 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T18:24:13.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:13.241 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T18:24:32.241 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:32.241 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T18:24:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:32.940 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T18:24:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:33.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T18:24:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:33.741 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T18:24:34.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:34.541 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T18:24:34.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:34.741 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T18:24:35.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:35.340 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T18:24:35.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:35.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T18:24:36.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:36.240 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T18:24:36.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:36.441 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T18:24:37.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:37.141 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T18:24:37.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:37.340 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T18:24:37.940 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:37.940 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T18:24:38.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:38.240 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T18:24:39.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:39.040 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T18:24:39.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:39.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T18:24:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:40.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T18:24:41.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:41.040 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T18:24:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:42.040 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T18:24:42.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:42.640 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T18:24:43.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:43.641 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T18:24:44.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:44.141 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T18:24:45.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:45.141 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T18:24:45.641 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:45.641 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T18:24:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:46.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T18:24:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:47.140 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T18:24:48.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:48.141 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T18:24:48.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:48.740 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T18:24:49.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:49.741 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T18:24:50.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:50.240 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T18:24:51.241 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:51.241 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T18:24:51.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:51.740 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T18:24:52.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:52.740 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T18:24:53.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:53.341 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T18:24:54.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:54.340 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T18:24:54.840 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:54.840 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T18:24:55.840 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:55.840 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T18:24:56.341 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:56.342 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T18:24:57.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:57.140 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T18:24:57.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:57.640 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T18:24:58.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:58.540 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T18:24:59.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:24:59.140 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T18:25:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:00.140 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T18:25:00.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:00.641 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T18:25:01.541 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:01.541 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T18:25:02.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:02.141 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T18:25:03.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:03.141 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T18:25:03.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:03.641 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T18:25:04.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:04.640 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T18:25:05.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T18:25:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:06.240 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T18:25:06.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:06.641 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T18:25:07.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:07.640 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T18:25:08.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:08.040 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T18:25:08.940 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:08.940 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T18:25:09.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:09.441 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T18:25:10.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:10.340 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T18:25:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:10.740 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T18:25:11.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:11.640 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T18:25:11.840 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:11.840 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T18:25:12.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:12.440 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T18:25:12.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:12.641 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T18:25:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:13.340 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T18:25:13.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:13.640 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T18:25:14.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:14.440 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T18:25:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:14.640 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T18:25:15.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:15.441 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T18:25:16.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:16.040 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T18:25:16.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:16.740 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T18:25:16.840 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:16.841 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T18:25:17.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:17.040 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T18:25:17.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:17.240 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T18:25:18.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:18.040 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T18:25:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:18.340 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T18:25:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:19.140 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T18:25:19.640 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:19.641 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T18:25:20.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:20.340 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T18:25:20.541 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:20.541 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T18:25:21.240 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:21.241 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T18:25:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:33.541 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T18:25:34.340 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:34.340 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T18:25:46.940 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:46.941 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T18:25:47.741 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:47.741 INFO:teuthology.orchestra.run.smithi097.stdout:---------------------------------------------------------------------- 2024-09-12T18:25:47.741 INFO:teuthology.orchestra.run.smithi097.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T18:25:47.741 INFO:teuthology.orchestra.run.smithi097.stdout:---------------------------------------------------------------------- 2024-09-12T18:25:47.741 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:47.741 INFO:teuthology.orchestra.run.smithi097.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:25:47.741 INFO:teuthology.orchestra.run.smithi097.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:25:47.741 INFO:teuthology.orchestra.run.smithi097.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:25:47.741 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:47.742 INFO:teuthology.orchestra.run.smithi097.stdout:BUILD SUCCESSFUL in 6m 45s 2024-09-12T18:25:47.742 INFO:teuthology.orchestra.run.smithi097.stdout:5 actionable tasks: 5 executed 2024-09-12T18:25:47.761 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:25:47.788 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:47.788 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:47.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.825+0000 7eff1a8fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:47.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:47.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 20 realm 2024-09-12T18:25:47.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:47.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:47.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:47.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:47.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:47.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:47.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:47.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:47.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:47.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.829+0000 7eff1a8fc9c0 20 searching for the correct realm 2024-09-12T18:25:47.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:47.837+0000 7eff18c03640 0 -- 172.21.15.97:0/2794286034 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7eff0c00d910 msgr2=0x7eff0c01f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:48.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.045+0000 7eff18c03640 0 -- 172.21.15.97:0/2794286034 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x56325fef1520 msgr2=0x56325fef3960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:48.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.057+0000 7eff1a8fc9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:48.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:48.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:48.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:48.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:48.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:48.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:48.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:48.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:48.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:48.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 zone default found 2024-09-12T18:25:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 4 Realm: () 2024-09-12T18:25:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 zonegroup default 2024-09-12T18:25:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:48.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:48.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.061+0000 7eff1a8fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:48.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.065+0000 7eff1a8fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:48.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.065+0000 7eff1a8fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:48.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.065+0000 7eff1a8fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:48.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.065+0000 7eff1a8fc9c0 20 started sync module instance, tier type = 2024-09-12T18:25:48.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.065+0000 7eff1a8fc9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:48.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.089+0000 7eff1a8fc9c0 20 add_watcher() i=0 2024-09-12T18:25:48.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.089+0000 7eff1a8fc9c0 20 add_watcher() i=1 2024-09-12T18:25:48.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.089+0000 7eff1a8fc9c0 20 add_watcher() i=2 2024-09-12T18:25:48.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.089+0000 7eff1a8fc9c0 20 add_watcher() i=3 2024-09-12T18:25:48.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.089+0000 7eff1a8fc9c0 20 add_watcher() i=4 2024-09-12T18:25:48.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.089+0000 7eff1a8fc9c0 20 add_watcher() i=5 2024-09-12T18:25:48.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.089+0000 7eff1a8fc9c0 20 add_watcher() i=6 2024-09-12T18:25:48.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.089+0000 7eff1a8fc9c0 20 add_watcher() i=7 2024-09-12T18:25:48.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.089+0000 7eff1a8fc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:48.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.093+0000 7efdcefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:48.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.093+0000 7eff1a8fc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:48.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.093+0000 7eff1a8fc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:48.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.185+0000 7efdcdfdb640 20 reqs_thread_entry: start 2024-09-12T18:25:48.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.185+0000 7eff1a8fc9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:48.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.185+0000 7eff1a8fc9c0 20 Filter name: none 2024-09-12T18:25:48.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.185+0000 7efd3f7fe640 20 reqs_thread_entry: start 2024-09-12T18:25:48.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.185+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:25:48.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.189+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:25:48.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4346801486253205860', time=2024-09-12T20:23:39.003931+0000, chain.objs.size()=7 2024-09-12T18:25:48.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~Mw7rL0-HCpNcyq8kXcDXAhWp94llyJ2.1 2024-09-12T18:25:48.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~Mw7rL0-HCpNcyq8kXcDXAhWp94llyJ2.1_1 2024-09-12T18:25:48.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~Mw7rL0-HCpNcyq8kXcDXAhWp94llyJ2.1_2 2024-09-12T18:25:48.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~Mw7rL0-HCpNcyq8kXcDXAhWp94llyJ2.2 2024-09-12T18:25:48.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~Mw7rL0-HCpNcyq8kXcDXAhWp94llyJ2.2_1 2024-09-12T18:25:48.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~Mw7rL0-HCpNcyq8kXcDXAhWp94llyJ2.2_2 2024-09-12T18:25:48.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~Mw7rL0-HCpNcyq8kXcDXAhWp94llyJ2.3 2024-09-12T18:25:48.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10198303462394513090', time=2024-09-12T20:24:57.852273+0000, chain.objs.size()=1 2024-09-12T18:25:48.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.124__shadow_.xgUt0EuT43YpJEd8erCD-XBSyA3lVx-_0 2024-09-12T18:25:48.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15891813673431363382', time=2024-09-12T20:25:00.875264+0000, chain.objs.size()=1 2024-09-12T18:25:48.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.193+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.126__shadow_.4M-AEASSzswOApnnxBSJfzJnAsvWv5Z_0 2024-09-12T18:25:48.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.201+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.205+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:25:48.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.209+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.209+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.209+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:25:48.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.209+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8723501487435140197', time=2024-09-12T20:25:09.680521+0000, chain.objs.size()=1 2024-09-12T18:25:48.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.209+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.132__shadow_.4fFA-0BVE_vvyxGT9yrchpL8OegC9OO_0 2024-09-12T18:25:48.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.213+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.217+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:25:48.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:25:48.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6434006646472201217', time=2024-09-12T20:19:53.209800+0000, chain.objs.size()=9 2024-09-12T18:25:48.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__multipart_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.1 2024-09-12T18:25:48.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__shadow_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.1_1 2024-09-12T18:25:48.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__multipart_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.2 2024-09-12T18:25:48.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__shadow_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.2_1 2024-09-12T18:25:48.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__multipart_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.3 2024-09-12T18:25:48.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__shadow_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.3_1 2024-09-12T18:25:48.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__multipart_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.4 2024-09-12T18:25:48.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__shadow_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.4_1 2024-09-12T18:25:48.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.221+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__multipart_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.5 2024-09-12T18:25:48.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10401885066526079632', time=2024-09-12T20:19:53.810242+0000, chain.objs.size()=9 2024-09-12T18:25:48.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__multipart_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.1 2024-09-12T18:25:48.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__shadow_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.1_1 2024-09-12T18:25:48.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__multipart_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.2 2024-09-12T18:25:48.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__shadow_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.2_1 2024-09-12T18:25:48.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__multipart_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.3 2024-09-12T18:25:48.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__shadow_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.3_1 2024-09-12T18:25:48.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__multipart_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.4 2024-09-12T18:25:48.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__shadow_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.4_1 2024-09-12T18:25:48.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.91__multipart_key1.2~SWzzFqroEoEzQtAbzFNP_CgK04x14jh.5 2024-09-12T18:25:48.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8657062880778819960', time=2024-09-12T20:24:39.966837+0000, chain.objs.size()=1 2024-09-12T18:25:48.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.112__shadow_.41x-eYGfC9HDEkW4KMdCSlQNMvO67T4_0 2024-09-12T18:25:48.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6405791548558695271', time=2024-09-12T20:24:45.942536+0000, chain.objs.size()=1 2024-09-12T18:25:48.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.225+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.116__shadow_.sgGEd6vxuYeh3En_BS9nBOyvv96_e4r_0 2024-09-12T18:25:48.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.229+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17333015725303503503', time=2024-09-12T20:25:00.928753+0000, chain.objs.size()=1 2024-09-12T18:25:48.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.229+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.126__shadow_.osl8KJV9Q4iaBh1jHMKE2DmcGlOozH0_0 2024-09-12T18:25:48.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.229+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2337763611642851902', time=2024-09-12T20:25:06.847212+0000, chain.objs.size()=1 2024-09-12T18:25:48.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.229+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.130__shadow_.dn_5JPhKVRM7pODnyPfSxvACLP7u8jV_0 2024-09-12T18:25:48.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.229+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17384870744430128595', time=2024-09-12T20:25:47.160710+0000, chain.objs.size()=1 2024-09-12T18:25:48.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.229+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.144__shadow_.ZH_ugzb3x9_5FdlDh9fJPaTPBQF4RPx_0 2024-09-12T18:25:48.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.233+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.241+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:25:48.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.241+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.245+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.245+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:25:48.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.245+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2065745699295946496', time=2024-09-12T20:24:44.371880+0000, chain.objs.size()=1 2024-09-12T18:25:48.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.245+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.115__shadow_.IUHjgG5UMPN9c5FOT2b_-thzPIrgXs-_0 2024-09-12T18:25:48.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.245+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.253+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:25:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.253+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.257+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.257+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:25:48.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.257+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.814156562125436586', time=2024-09-12T20:24:39.761490+0000, chain.objs.size()=1 2024-09-12T18:25:48.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.257+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.112__shadow_.ErAQRofUmwzWoWGSOtRvmlNvLmL9LE2_0 2024-09-12T18:25:48.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.257+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.265+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:25:48.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.265+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:25:48.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14048596379907353367', time=2024-09-12T20:22:08.298834+0000, chain.objs.size()=1 2024-09-12T18:25:48.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__shadow_.gynhIktK11VWNxEz3Jd4C1cmDuqFuwk_0 2024-09-12T18:25:48.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15048596716411577831', time=2024-09-12T20:24:39.889872+0000, chain.objs.size()=1 2024-09-12T18:25:48.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.112__shadow_.Sr5YkeLLSeeC9Ps_UTCHOTuKPfIvV0b_0 2024-09-12T18:25:48.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.360704136215080904', time=2024-09-12T20:24:47.568917+0000, chain.objs.size()=1 2024-09-12T18:25:48.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.117__shadow_.RQe5EuyFz92JghzOvrzuOtQFm2DaBhe_0 2024-09-12T18:25:48.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5739182718093965356', time=2024-09-12T20:24:51.996212+0000, chain.objs.size()=1 2024-09-12T18:25:48.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.120__shadow_.AcpD94554yf1D7G4rT5Jl7wlmwOBSgj_0 2024-09-12T18:25:48.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1454292581121801174', time=2024-09-12T20:24:57.922001+0000, chain.objs.size()=1 2024-09-12T18:25:48.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.124__shadow_.9598sbBj8m5lZCbvM5vCKddXTWmwDd-_0 2024-09-12T18:25:48.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17477345015215084220', time=2024-09-12T20:25:03.855215+0000, chain.objs.size()=1 2024-09-12T18:25:48.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.269+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.128__shadow_.K_8nuv8wtp_tDQYFF6Yly4D55ovAmBm_0 2024-09-12T18:25:48.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.273+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.277+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:25:48.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.277+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:25:48.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8938297854333070505', time=2024-09-12T20:20:39.258967+0000, chain.objs.size()=7 2024-09-12T18:25:48.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~bPZ21kfRgq8_jjla_rfZK6r5o9UftaR.1 2024-09-12T18:25:48.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~bPZ21kfRgq8_jjla_rfZK6r5o9UftaR.1_1 2024-09-12T18:25:48.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~bPZ21kfRgq8_jjla_rfZK6r5o9UftaR.1_2 2024-09-12T18:25:48.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~bPZ21kfRgq8_jjla_rfZK6r5o9UftaR.2 2024-09-12T18:25:48.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~bPZ21kfRgq8_jjla_rfZK6r5o9UftaR.2_1 2024-09-12T18:25:48.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~bPZ21kfRgq8_jjla_rfZK6r5o9UftaR.2_2 2024-09-12T18:25:48.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~bPZ21kfRgq8_jjla_rfZK6r5o9UftaR.3 2024-09-12T18:25:48.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12289861189416886848', time=2024-09-12T20:24:55.254821+0000, chain.objs.size()=1 2024-09-12T18:25:48.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.122__shadow_.7rvBD8Wc-PWveEFp0--_vepDd85zTdH_0 2024-09-12T18:25:48.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4349024183582202556', time=2024-09-12T20:25:05.411745+0000, chain.objs.size()=1 2024-09-12T18:25:48.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.281+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.129__shadow_.SC3cAwXif73NkKuuw8Fa_X1AIo7n12-_0 2024-09-12T18:25:48.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.289+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.293+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:25:48.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15880589156717942090', time=2024-09-12T20:20:18.144545+0000, chain.objs.size()=9 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~avYLqjPKJJmKU4AKxpDHYOw64bRppd-.1 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~avYLqjPKJJmKU4AKxpDHYOw64bRppd-.1_1 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~avYLqjPKJJmKU4AKxpDHYOw64bRppd-.2 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~avYLqjPKJJmKU4AKxpDHYOw64bRppd-.2_1 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~avYLqjPKJJmKU4AKxpDHYOw64bRppd-.3 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~avYLqjPKJJmKU4AKxpDHYOw64bRppd-.3_1 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~avYLqjPKJJmKU4AKxpDHYOw64bRppd-.4 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~avYLqjPKJJmKU4AKxpDHYOw64bRppd-.4_1 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~avYLqjPKJJmKU4AKxpDHYOw64bRppd-.5 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7314921298896350850', time=2024-09-12T20:20:34.951886+0000, chain.objs.size()=7 2024-09-12T18:25:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~tBrBvU-1VU51FJ_2ckpdU4T6ReYOP5A.1 2024-09-12T18:25:48.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~tBrBvU-1VU51FJ_2ckpdU4T6ReYOP5A.1_1 2024-09-12T18:25:48.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.297+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~tBrBvU-1VU51FJ_2ckpdU4T6ReYOP5A.1_2 2024-09-12T18:25:48.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.301+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~tBrBvU-1VU51FJ_2ckpdU4T6ReYOP5A.2 2024-09-12T18:25:48.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.301+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~tBrBvU-1VU51FJ_2ckpdU4T6ReYOP5A.2_1 2024-09-12T18:25:48.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~tBrBvU-1VU51FJ_2ckpdU4T6ReYOP5A.2_2 2024-09-12T18:25:48.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~tBrBvU-1VU51FJ_2ckpdU4T6ReYOP5A.3 2024-09-12T18:25:48.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6804719779784214135', time=2024-09-12T20:23:05.621023+0000, chain.objs.size()=9 2024-09-12T18:25:48.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~KG3IxRsj3EY0YgGHB4wl5-9MTinWp5Y.1 2024-09-12T18:25:48.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~KG3IxRsj3EY0YgGHB4wl5-9MTinWp5Y.1_1 2024-09-12T18:25:48.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~KG3IxRsj3EY0YgGHB4wl5-9MTinWp5Y.2 2024-09-12T18:25:48.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~KG3IxRsj3EY0YgGHB4wl5-9MTinWp5Y.2_1 2024-09-12T18:25:48.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~KG3IxRsj3EY0YgGHB4wl5-9MTinWp5Y.3 2024-09-12T18:25:48.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~KG3IxRsj3EY0YgGHB4wl5-9MTinWp5Y.3_1 2024-09-12T18:25:48.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~KG3IxRsj3EY0YgGHB4wl5-9MTinWp5Y.4 2024-09-12T18:25:48.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~KG3IxRsj3EY0YgGHB4wl5-9MTinWp5Y.4_1 2024-09-12T18:25:48.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.305+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~KG3IxRsj3EY0YgGHB4wl5-9MTinWp5Y.5 2024-09-12T18:25:48.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.321+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16379781091699529630', time=2024-09-12T20:24:45.864518+0000, chain.objs.size()=1 2024-09-12T18:25:48.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.321+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.116__shadow_.UtEx7y_U-Us1iwS62HMl1jBWDaov1-o_0 2024-09-12T18:25:48.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.321+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11683467187170228682', time=2024-09-12T20:25:04.006203+0000, chain.objs.size()=1 2024-09-12T18:25:48.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.321+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.128__shadow_.Q5l5duw_HEAz6XCRqmOOupeBPYwfvlB_0 2024-09-12T18:25:48.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.321+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17391225258400954817', time=2024-09-12T20:25:05.557959+0000, chain.objs.size()=1 2024-09-12T18:25:48.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.321+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.129__shadow_.QkAA5pRpKfUQ-2iDe5GUTQ1WY7DXuyY_0 2024-09-12T18:25:48.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.325+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.329+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:25:48.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.329+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.333+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.333+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:25:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.333+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6839401585682212835', time=2024-09-12T20:19:07.669288+0000, chain.objs.size()=1 2024-09-12T18:25:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.333+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.77__shadow_.PrMs0CyaTKZmb0ea_W7_Zqky_Evf8a4_0 2024-09-12T18:25:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.333+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3249837825621806083', time=2024-09-12T20:24:45.793350+0000, chain.objs.size()=1 2024-09-12T18:25:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.333+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.116__shadow_.gcIt3uzcEFEehExFzbSujO7ImXqBKBx_0 2024-09-12T18:25:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.333+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7683898001996975286', time=2024-09-12T20:24:55.178864+0000, chain.objs.size()=1 2024-09-12T18:25:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.333+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.122__shadow_.vZeZrY-m15Cbr-S5FvDPhavDEndRAMN_0 2024-09-12T18:25:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.333+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.234735592922695555', time=2024-09-12T20:24:56.474178+0000, chain.objs.size()=1 2024-09-12T18:25:48.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.333+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.123__shadow_.bWHVxx83ccsAvMtF1s1GilRKf6yntjA_0 2024-09-12T18:25:48.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.337+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.341+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:25:48.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.341+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:25:48.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5351190579238509907', time=2024-09-12T20:23:16.534103+0000, chain.objs.size()=9 2024-09-12T18:25:48.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~JFA78BAd9XB37161fatICqLu2us0TTv.1 2024-09-12T18:25:48.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~JFA78BAd9XB37161fatICqLu2us0TTv.1_1 2024-09-12T18:25:48.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~JFA78BAd9XB37161fatICqLu2us0TTv.2 2024-09-12T18:25:48.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~JFA78BAd9XB37161fatICqLu2us0TTv.2_1 2024-09-12T18:25:48.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~JFA78BAd9XB37161fatICqLu2us0TTv.3 2024-09-12T18:25:48.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~JFA78BAd9XB37161fatICqLu2us0TTv.3_1 2024-09-12T18:25:48.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~JFA78BAd9XB37161fatICqLu2us0TTv.4 2024-09-12T18:25:48.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~JFA78BAd9XB37161fatICqLu2us0TTv.4_1 2024-09-12T18:25:48.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~JFA78BAd9XB37161fatICqLu2us0TTv.5 2024-09-12T18:25:48.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7506353464311839941', time=2024-09-12T20:24:41.250327+0000, chain.objs.size()=1 2024-09-12T18:25:48.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.113__shadow_.aRlgmpkp-74Sf8iIo0dmVBzeZnIQAV8_0 2024-09-12T18:25:48.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4797080851394041997', time=2024-09-12T20:24:46.010511+0000, chain.objs.size()=1 2024-09-12T18:25:48.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.116__shadow_.p_bI6nF0aw-Oo0eYTMP5P5IWkgPaxEy_0 2024-09-12T18:25:48.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.469732266065464132', time=2024-09-12T20:24:56.608091+0000, chain.objs.size()=1 2024-09-12T18:25:48.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.345+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.123__shadow_.9PSvo19s7pwBBAKfESMGsLr5AEgZzzL_0 2024-09-12T18:25:48.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.353+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.357+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:25:48.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.361+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:25:48.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9303984180861911653', time=2024-09-12T20:19:33.079130+0000, chain.objs.size()=3 2024-09-12T18:25:48.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.83__shadow_.I4u5LT9SToL7-oGyXj7SSnu3bsKjYYf_0 2024-09-12T18:25:48.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.83__shadow_.I4u5LT9SToL7-oGyXj7SSnu3bsKjYYf_1 2024-09-12T18:25:48.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.83__shadow_.I4u5LT9SToL7-oGyXj7SSnu3bsKjYYf_2 2024-09-12T18:25:48.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4406900809011912551', time=2024-09-12T20:20:39.560788+0000, chain.objs.size()=7 2024-09-12T18:25:48.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~g2bOccl1bn8_-Cxe-NaMLYkS2Rn9ADW.1 2024-09-12T18:25:48.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~g2bOccl1bn8_-Cxe-NaMLYkS2Rn9ADW.1_1 2024-09-12T18:25:48.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~g2bOccl1bn8_-Cxe-NaMLYkS2Rn9ADW.1_2 2024-09-12T18:25:48.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~g2bOccl1bn8_-Cxe-NaMLYkS2Rn9ADW.2 2024-09-12T18:25:48.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~g2bOccl1bn8_-Cxe-NaMLYkS2Rn9ADW.2_1 2024-09-12T18:25:48.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~g2bOccl1bn8_-Cxe-NaMLYkS2Rn9ADW.2_2 2024-09-12T18:25:48.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~g2bOccl1bn8_-Cxe-NaMLYkS2Rn9ADW.3 2024-09-12T18:25:48.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7100841969514724942', time=2024-09-12T20:22:08.375242+0000, chain.objs.size()=1 2024-09-12T18:25:48.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__shadow_.f1mhidmx6q7mmLx-RGFAv8QKY1vnkL4_0 2024-09-12T18:25:48.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5640565960352909105', time=2024-09-12T20:24:41.398903+0000, chain.objs.size()=1 2024-09-12T18:25:48.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.365+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.113__shadow_.t0oy7R2pBrwH2Qa9Gz3FWPzAYzczWTQ_0 2024-09-12T18:25:48.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4082533737684113141', time=2024-09-12T20:24:59.445229+0000, chain.objs.size()=1 2024-09-12T18:25:48.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.125__shadow_.r4nGjDvQ2AqK7fhFfNs5KNxHb8wggSX_0 2024-09-12T18:25:48.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3339765467961917233', time=2024-09-12T20:25:11.087109+0000, chain.objs.size()=1 2024-09-12T18:25:48.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.133__shadow_.Em4sK6mHMSgh0szwn1ql-mXP_Pzkk7Y_0 2024-09-12T18:25:48.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3408909834994166504', time=2024-09-12T20:25:33.720211+0000, chain.objs.size()=9 2024-09-12T18:25:48.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.143__multipart_key1.2~BbgsikwLWMM-rMz-kI7wlesUPiS0DkE.1 2024-09-12T18:25:48.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.143__shadow_key1.2~BbgsikwLWMM-rMz-kI7wlesUPiS0DkE.1_1 2024-09-12T18:25:48.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.143__multipart_key1.2~BbgsikwLWMM-rMz-kI7wlesUPiS0DkE.2 2024-09-12T18:25:48.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.143__shadow_key1.2~BbgsikwLWMM-rMz-kI7wlesUPiS0DkE.2_1 2024-09-12T18:25:48.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.143__multipart_key1.2~BbgsikwLWMM-rMz-kI7wlesUPiS0DkE.3 2024-09-12T18:25:48.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.143__shadow_key1.2~BbgsikwLWMM-rMz-kI7wlesUPiS0DkE.3_1 2024-09-12T18:25:48.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.143__multipart_key1.2~BbgsikwLWMM-rMz-kI7wlesUPiS0DkE.4 2024-09-12T18:25:48.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.143__shadow_key1.2~BbgsikwLWMM-rMz-kI7wlesUPiS0DkE.4_1 2024-09-12T18:25:48.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.373+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.143__multipart_key1.2~BbgsikwLWMM-rMz-kI7wlesUPiS0DkE.5 2024-09-12T18:25:48.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.385+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.389+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:25:48.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:25:48.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~5omfdD_DCr_840bBn56hqv0HBDeYvIq', time=2024-09-12T20:19:20.468915+0000, chain.objs.size()=9 2024-09-12T18:25:48.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.79__multipart_key1.2~5omfdD_DCr_840bBn56hqv0HBDeYvIq.1 2024-09-12T18:25:48.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.79__shadow_key1.2~5omfdD_DCr_840bBn56hqv0HBDeYvIq.1_1 2024-09-12T18:25:48.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.79__multipart_key1.2~5omfdD_DCr_840bBn56hqv0HBDeYvIq.2 2024-09-12T18:25:48.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.79__shadow_key1.2~5omfdD_DCr_840bBn56hqv0HBDeYvIq.2_1 2024-09-12T18:25:48.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.79__multipart_key1.2~5omfdD_DCr_840bBn56hqv0HBDeYvIq.3 2024-09-12T18:25:48.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.79__shadow_key1.2~5omfdD_DCr_840bBn56hqv0HBDeYvIq.3_1 2024-09-12T18:25:48.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.79__multipart_key1.2~5omfdD_DCr_840bBn56hqv0HBDeYvIq.4 2024-09-12T18:25:48.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.79__shadow_key1.2~5omfdD_DCr_840bBn56hqv0HBDeYvIq.4_1 2024-09-12T18:25:48.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.79__multipart_key1.2~5omfdD_DCr_840bBn56hqv0HBDeYvIq.5 2024-09-12T18:25:48.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14939128928793418301', time=2024-09-12T20:22:08.243197+0000, chain.objs.size()=5 2024-09-12T18:25:48.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__multipart_file2.mpg.2~Zfd1Yf79Dl4DZWCoAXpiGDxqXgiEseU.1 2024-09-12T18:25:48.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__multipart_file2.mpg.2~Zfd1Yf79Dl4DZWCoAXpiGDxqXgiEseU.2 2024-09-12T18:25:48.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.393+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__multipart_file2.mpg.2~Zfd1Yf79Dl4DZWCoAXpiGDxqXgiEseU.3 2024-09-12T18:25:48.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.401+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__multipart_file2.mpg.2~Zfd1Yf79Dl4DZWCoAXpiGDxqXgiEseU.4 2024-09-12T18:25:48.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.401+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__multipart_file2.mpg.2~Zfd1Yf79Dl4DZWCoAXpiGDxqXgiEseU.5 2024-09-12T18:25:48.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.401+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~JVaOYnIy7eMvsLLzrzICP-w-rTX9quU', time=2024-09-12T20:22:20.622841+0000, chain.objs.size()=9 2024-09-12T18:25:48.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.401+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.101__multipart_key1.2~JVaOYnIy7eMvsLLzrzICP-w-rTX9quU.7 2024-09-12T18:25:48.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.401+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.101__shadow_key1.2~JVaOYnIy7eMvsLLzrzICP-w-rTX9quU.7_1 2024-09-12T18:25:48.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.401+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.101__multipart_key1.2~JVaOYnIy7eMvsLLzrzICP-w-rTX9quU.8 2024-09-12T18:25:48.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.401+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.101__shadow_key1.2~JVaOYnIy7eMvsLLzrzICP-w-rTX9quU.8_1 2024-09-12T18:25:48.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.401+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.101__multipart_key1.2~JVaOYnIy7eMvsLLzrzICP-w-rTX9quU.9 2024-09-12T18:25:48.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.401+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.101__shadow_key1.2~JVaOYnIy7eMvsLLzrzICP-w-rTX9quU.9_1 2024-09-12T18:25:48.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.405+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.101__multipart_key1.2~JVaOYnIy7eMvsLLzrzICP-w-rTX9quU.10 2024-09-12T18:25:48.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.405+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.101__shadow_key1.2~JVaOYnIy7eMvsLLzrzICP-w-rTX9quU.10_1 2024-09-12T18:25:48.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.405+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.101__multipart_key1.2~JVaOYnIy7eMvsLLzrzICP-w-rTX9quU.11 2024-09-12T18:25:48.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.405+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4878862489787807170', time=2024-09-12T20:24:48.984649+0000, chain.objs.size()=1 2024-09-12T18:25:48.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.405+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.118__shadow_.blwmI3AwQGyz97Rmhdle3whqsCrXGAU_0 2024-09-12T18:25:48.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.405+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6205589255435172107', time=2024-09-12T20:24:50.462635+0000, chain.objs.size()=1 2024-09-12T18:25:48.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.405+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.119__shadow_.66cxoV-RvMsR72cmkiZn0EaF-uEhs_0_0 2024-09-12T18:25:48.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.409+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3221546171464651140', time=2024-09-12T20:25:00.804425+0000, chain.objs.size()=1 2024-09-12T18:25:48.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.409+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.126__shadow_.0EHCJrycQxVl_4gO6uT0Er9kyym9E7e_0 2024-09-12T18:25:48.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.409+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8970425002282030963', time=2024-09-12T20:25:05.481246+0000, chain.objs.size()=1 2024-09-12T18:25:48.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.409+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.129__shadow_.V-CdafwmBAZbG9zjcUz7VigljwJyrlo_0 2024-09-12T18:25:48.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.413+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.413+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:25:48.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.417+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.417+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:25:48.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9847413401102746749', time=2024-09-12T20:20:13.056620+0000, chain.objs.size()=9 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~voy5luPDvm2-GHEi74pNxTGi5G7EIBm.1 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~voy5luPDvm2-GHEi74pNxTGi5G7EIBm.1_1 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~voy5luPDvm2-GHEi74pNxTGi5G7EIBm.2 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~voy5luPDvm2-GHEi74pNxTGi5G7EIBm.2_1 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~voy5luPDvm2-GHEi74pNxTGi5G7EIBm.3 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~voy5luPDvm2-GHEi74pNxTGi5G7EIBm.3_1 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~voy5luPDvm2-GHEi74pNxTGi5G7EIBm.4 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~voy5luPDvm2-GHEi74pNxTGi5G7EIBm.4_1 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~voy5luPDvm2-GHEi74pNxTGi5G7EIBm.5 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7370278687249494385', time=2024-09-12T20:24:44.301181+0000, chain.objs.size()=1 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.115__shadow_._MGkGusCbEneZpIqNkpClxmsfDmWWng_0 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4855962638033350849', time=2024-09-12T20:25:11.015353+0000, chain.objs.size()=1 2024-09-12T18:25:48.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.421+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.133__shadow_.k4opNTKLcaC_aCiIYWoWoUPXRM4VeXf_0 2024-09-12T18:25:48.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.425+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.429+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:25:48.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.433+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.433+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:25:48.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16487081213835301042', time=2024-09-12T20:24:08.412527+0000, chain.objs.size()=9 2024-09-12T18:25:48.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.104__multipart_key1.2~p8tiCA_5XZPvdDxVQULv1jm4kR15Yip.1 2024-09-12T18:25:48.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.104__shadow_key1.2~p8tiCA_5XZPvdDxVQULv1jm4kR15Yip.1_1 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.104__multipart_key1.2~p8tiCA_5XZPvdDxVQULv1jm4kR15Yip.2 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.104__shadow_key1.2~p8tiCA_5XZPvdDxVQULv1jm4kR15Yip.2_1 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.104__multipart_key1.2~p8tiCA_5XZPvdDxVQULv1jm4kR15Yip.3 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.104__shadow_key1.2~p8tiCA_5XZPvdDxVQULv1jm4kR15Yip.3_1 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.104__multipart_key1.2~p8tiCA_5XZPvdDxVQULv1jm4kR15Yip.4 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.104__shadow_key1.2~p8tiCA_5XZPvdDxVQULv1jm4kR15Yip.4_1 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.104__multipart_key1.2~p8tiCA_5XZPvdDxVQULv1jm4kR15Yip.5 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6750752324591851179', time=2024-09-12T20:24:42.795889+0000, chain.objs.size()=1 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.114__shadow_.R1VApntQcn-vYl4_6W26Jal4u83dBMF_0 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4138512556833376710', time=2024-09-12T20:24:50.649159+0000, chain.objs.size()=1 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.119__shadow_.F2gHP3IVgBJtEF1xscMhpuV-Bic9-Hv_0 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7642248706041296985', time=2024-09-12T20:25:02.312711+0000, chain.objs.size()=1 2024-09-12T18:25:48.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.437+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.127__shadow_.8B7CR_akALxunFK2Z5sTUzHmAGZONoU_0 2024-09-12T18:25:48.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.441+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.445+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:25:48.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:25:48.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10749786264604664790', time=2024-09-12T20:23:38.723231+0000, chain.objs.size()=7 2024-09-12T18:25:48.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~V01RSCDAY0g4rNRSPK2AWSjec_0NPcJ.1 2024-09-12T18:25:48.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~V01RSCDAY0g4rNRSPK2AWSjec_0NPcJ.1_1 2024-09-12T18:25:48.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~V01RSCDAY0g4rNRSPK2AWSjec_0NPcJ.1_2 2024-09-12T18:25:48.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~V01RSCDAY0g4rNRSPK2AWSjec_0NPcJ.2 2024-09-12T18:25:48.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~V01RSCDAY0g4rNRSPK2AWSjec_0NPcJ.2_1 2024-09-12T18:25:48.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~V01RSCDAY0g4rNRSPK2AWSjec_0NPcJ.2_2 2024-09-12T18:25:48.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~V01RSCDAY0g4rNRSPK2AWSjec_0NPcJ.3 2024-09-12T18:25:48.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6297531016975265069', time=2024-09-12T20:24:44.445813+0000, chain.objs.size()=1 2024-09-12T18:25:48.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.115__shadow_.U0STCi2klquzKr1jfFargiyb7Xk1Qqe_0 2024-09-12T18:25:48.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.210847697684751240', time=2024-09-12T20:24:53.648308+0000, chain.objs.size()=1 2024-09-12T18:25:48.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.449+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.121__shadow_.F2LJowYxE5uMnVXfMsDlxsCRbarOh4N_0 2024-09-12T18:25:48.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.457+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.461+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:25:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:25:48.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3443385038463583886', time=2024-09-12T20:23:27.767957+0000, chain.objs.size()=7 2024-09-12T18:25:48.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~14blNP1sB_DY4BVIo823tEfIrE4pogK.1 2024-09-12T18:25:48.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~14blNP1sB_DY4BVIo823tEfIrE4pogK.1_1 2024-09-12T18:25:48.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~14blNP1sB_DY4BVIo823tEfIrE4pogK.1_2 2024-09-12T18:25:48.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~14blNP1sB_DY4BVIo823tEfIrE4pogK.2 2024-09-12T18:25:48.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~14blNP1sB_DY4BVIo823tEfIrE4pogK.2_1 2024-09-12T18:25:48.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~14blNP1sB_DY4BVIo823tEfIrE4pogK.2_2 2024-09-12T18:25:48.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~14blNP1sB_DY4BVIo823tEfIrE4pogK.3 2024-09-12T18:25:48.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4140909096471561015', time=2024-09-12T20:24:41.466688+0000, chain.objs.size()=1 2024-09-12T18:25:48.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.113__shadow_.Cad8iyPrR6DqagEHBOhTirML-8ZVyuF_0 2024-09-12T18:25:48.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7028244479736345424', time=2024-09-12T20:24:50.575592+0000, chain.objs.size()=1 2024-09-12T18:25:48.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.119__shadow_.VINmzVIGO-d0g7VSD-GiL2V6ffIWxL0_0 2024-09-12T18:25:48.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13064532702248295269', time=2024-09-12T20:25:02.452579+0000, chain.objs.size()=1 2024-09-12T18:25:48.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.127__shadow_.6hJmfD0Uc0d3K9O5SRlgj7RndTd8zYB_0 2024-09-12T18:25:48.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4601205067303417338', time=2024-09-12T20:25:03.932802+0000, chain.objs.size()=1 2024-09-12T18:25:48.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.465+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.128__shadow_.wgGQok706aPM-FQRefylDESKTaKKZkn_0 2024-09-12T18:25:48.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.473+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.477+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:25:48.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.481+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.481+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.481+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:25:48.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.481+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15733179938836487531', time=2024-09-12T20:22:08.164038+0000, chain.objs.size()=1 2024-09-12T18:25:48.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.481+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__shadow_.3DqA8fBuRKOV1Gjt8EGzOA7So4QeOm8_0 2024-09-12T18:25:48.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.481+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12274346720570778469', time=2024-09-12T20:24:33.942722+0000, chain.objs.size()=1 2024-09-12T18:25:48.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.481+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.106__shadow_.jdaPnlJF7lhbpoguAeHxbmpOnV3K0Rf_0 2024-09-12T18:25:48.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.481+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.570792516394609080', time=2024-09-12T20:24:53.500783+0000, chain.objs.size()=1 2024-09-12T18:25:48.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.481+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.121__shadow_.hC1egH1dTlPTDs9xFkaAtF224pVf33x_0 2024-09-12T18:25:48.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.481+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17394279491527908514', time=2024-09-12T20:25:15.770750+0000, chain.objs.size()=1 2024-09-12T18:25:48.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.481+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.138__shadow_.QSYIkeVrEluUwS7C0kK_UQ-WIaxmxcz_0 2024-09-12T18:25:48.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.485+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.489+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:25:48.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.493+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.493+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.493+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:25:48.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.493+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1685265068197944132', time=2024-09-12T20:24:59.298610+0000, chain.objs.size()=1 2024-09-12T18:25:48.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.493+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.125__shadow_.2pjPwCWbPJ-j8YBH24-5BTuYr8rSz7I_0 2024-09-12T18:25:48.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.493+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1343637068985515545', time=2024-09-12T20:24:59.371382+0000, chain.objs.size()=1 2024-09-12T18:25:48.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.493+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.125__shadow_.00UskreZSUTVXVGry0LrU7KRgFqwJhZ_0 2024-09-12T18:25:48.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.497+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.501+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:25:48.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:25:48.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13554506671924846957', time=2024-09-12T20:21:26.235184+0000, chain.objs.size()=9 2024-09-12T18:25:48.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.99__multipart_key1.2~ySQlQ3gE1NCqs51QO83Z2eM-wD7cq6N.1 2024-09-12T18:25:48.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.99__shadow_key1.2~ySQlQ3gE1NCqs51QO83Z2eM-wD7cq6N.1_1 2024-09-12T18:25:48.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.99__multipart_key1.2~ySQlQ3gE1NCqs51QO83Z2eM-wD7cq6N.2 2024-09-12T18:25:48.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.99__shadow_key1.2~ySQlQ3gE1NCqs51QO83Z2eM-wD7cq6N.2_1 2024-09-12T18:25:48.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.99__multipart_key1.2~ySQlQ3gE1NCqs51QO83Z2eM-wD7cq6N.3 2024-09-12T18:25:48.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.99__shadow_key1.2~ySQlQ3gE1NCqs51QO83Z2eM-wD7cq6N.3_1 2024-09-12T18:25:48.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.99__multipart_key1.2~ySQlQ3gE1NCqs51QO83Z2eM-wD7cq6N.4 2024-09-12T18:25:48.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.99__shadow_key1.2~ySQlQ3gE1NCqs51QO83Z2eM-wD7cq6N.4_1 2024-09-12T18:25:48.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.99__multipart_key1.2~ySQlQ3gE1NCqs51QO83Z2eM-wD7cq6N.5 2024-09-12T18:25:48.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7687682174822955007', time=2024-09-12T20:23:55.869240+0000, chain.objs.size()=9 2024-09-12T18:25:48.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.103__multipart_key1.2~iWFOyDoV4NgpYH5cGg5Mxsb-939ticP.1 2024-09-12T18:25:48.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.103__shadow_key1.2~iWFOyDoV4NgpYH5cGg5Mxsb-939ticP.1_1 2024-09-12T18:25:48.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.505+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.103__multipart_key1.2~iWFOyDoV4NgpYH5cGg5Mxsb-939ticP.2 2024-09-12T18:25:48.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.513+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.103__shadow_key1.2~iWFOyDoV4NgpYH5cGg5Mxsb-939ticP.2_1 2024-09-12T18:25:48.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.513+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.103__multipart_key1.2~iWFOyDoV4NgpYH5cGg5Mxsb-939ticP.3 2024-09-12T18:25:48.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.513+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.103__shadow_key1.2~iWFOyDoV4NgpYH5cGg5Mxsb-939ticP.3_1 2024-09-12T18:25:48.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.513+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.103__multipart_key1.2~iWFOyDoV4NgpYH5cGg5Mxsb-939ticP.4 2024-09-12T18:25:48.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.513+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.103__shadow_key1.2~iWFOyDoV4NgpYH5cGg5Mxsb-939ticP.4_1 2024-09-12T18:25:48.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.513+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.103__multipart_key1.2~iWFOyDoV4NgpYH5cGg5Mxsb-939ticP.5 2024-09-12T18:25:48.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.513+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12770180222543709891', time=2024-09-12T20:24:51.927721+0000, chain.objs.size()=1 2024-09-12T18:25:48.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.513+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.120__shadow_.BnZH8mAboUS5_N5nxyJkO1RzbANXSy5_0 2024-09-12T18:25:48.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.513+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6273636919756012490', time=2024-09-12T20:24:53.724082+0000, chain.objs.size()=1 2024-09-12T18:25:48.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.513+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.121__shadow_._LBMFfuWD8YLEkD9lIUyIM5hTFylGWw_0 2024-09-12T18:25:48.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.517+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8128540973023484300', time=2024-09-12T20:25:06.921370+0000, chain.objs.size()=1 2024-09-12T18:25:48.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.517+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.130__shadow_.esT7QMXjJrCCSd50mlZhAsKizXR9bLE_0 2024-09-12T18:25:48.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.521+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10681598808741836372', time=2024-09-12T20:25:10.940245+0000, chain.objs.size()=1 2024-09-12T18:25:48.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.521+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.133__shadow_.4ajRxgypcijTjZBmB8zgH8hz-fGBIbU_0 2024-09-12T18:25:48.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.525+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.529+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:25:48.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:25:48.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4645903792427552782', time=2024-09-12T20:22:08.088880+0000, chain.objs.size()=9 2024-09-12T18:25:48.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__multipart_file.mpg.2~8lnnlpa76TTQezYO4gojCwtsvGAs1p1.1 2024-09-12T18:25:48.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__shadow_file.mpg.2~8lnnlpa76TTQezYO4gojCwtsvGAs1p1.1_1 2024-09-12T18:25:48.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__multipart_file.mpg.2~8lnnlpa76TTQezYO4gojCwtsvGAs1p1.2 2024-09-12T18:25:48.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__shadow_file.mpg.2~8lnnlpa76TTQezYO4gojCwtsvGAs1p1.2_1 2024-09-12T18:25:48.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__multipart_file.mpg.2~8lnnlpa76TTQezYO4gojCwtsvGAs1p1.3 2024-09-12T18:25:48.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__shadow_file.mpg.2~8lnnlpa76TTQezYO4gojCwtsvGAs1p1.3_1 2024-09-12T18:25:48.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__multipart_file.mpg.2~8lnnlpa76TTQezYO4gojCwtsvGAs1p1.4 2024-09-12T18:25:48.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__shadow_file.mpg.2~8lnnlpa76TTQezYO4gojCwtsvGAs1p1.4_1 2024-09-12T18:25:48.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.533+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.100__multipart_file.mpg.2~8lnnlpa76TTQezYO4gojCwtsvGAs1p1.5 2024-09-12T18:25:48.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.541+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.545+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:25:48.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.545+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:25:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17040874705058027466', time=2024-09-12T20:20:31.232438+0000, chain.objs.size()=9 2024-09-12T18:25:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~rbo6KzGFa93wdGJogyOrRLkBiMxudaA.1 2024-09-12T18:25:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~rbo6KzGFa93wdGJogyOrRLkBiMxudaA.1_1 2024-09-12T18:25:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~rbo6KzGFa93wdGJogyOrRLkBiMxudaA.2 2024-09-12T18:25:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~rbo6KzGFa93wdGJogyOrRLkBiMxudaA.2_1 2024-09-12T18:25:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~rbo6KzGFa93wdGJogyOrRLkBiMxudaA.3 2024-09-12T18:25:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~rbo6KzGFa93wdGJogyOrRLkBiMxudaA.3_1 2024-09-12T18:25:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~rbo6KzGFa93wdGJogyOrRLkBiMxudaA.4 2024-09-12T18:25:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__shadow_key1.2~rbo6KzGFa93wdGJogyOrRLkBiMxudaA.4_1 2024-09-12T18:25:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.94__multipart_key1.2~rbo6KzGFa93wdGJogyOrRLkBiMxudaA.5 2024-09-12T18:25:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10994301909600998029', time=2024-09-12T20:24:39.816324+0000, chain.objs.size()=1 2024-09-12T18:25:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.112__shadow_.Y4rvqTJTaYDHcMA_-wROkwsKv5HVm4F_0 2024-09-12T18:25:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18225343934610967918', time=2024-09-12T20:24:42.989248+0000, chain.objs.size()=1 2024-09-12T18:25:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.114__shadow_.TJ9f2ogIwJokP1d196PR_axgOU2xxbK_0 2024-09-12T18:25:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13219744512983638863', time=2024-09-12T20:25:14.864450+0000, chain.objs.size()=1 2024-09-12T18:25:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.549+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.137__shadow_.isLksW8YPjGcyJklksh7AAzDA5xs-wN_0 2024-09-12T18:25:48.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.557+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.561+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:25:48.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.565+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.565+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.565+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:25:48.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.565+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9378065052283284045', time=2024-09-12T20:19:22.760732+0000, chain.objs.size()=1 2024-09-12T18:25:48.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.565+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.81__shadow_.qqH6JBAUJ0GxVgGXtgMiQ2LMz1T3EwW_0 2024-09-12T18:25:48.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.565+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17481600414065482537', time=2024-09-12T20:24:48.920422+0000, chain.objs.size()=1 2024-09-12T18:25:48.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.565+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.118__shadow_.4KS5BwOnsIGvb8axrM0LVnddy_Sep_B_0 2024-09-12T18:25:48.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.565+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6259464851295657988', time=2024-09-12T20:25:08.297564+0000, chain.objs.size()=1 2024-09-12T18:25:48.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.565+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.131__shadow_.n_5aFeZE81oYvgeNP3zYboF8qqRCddJ_0 2024-09-12T18:25:48.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.565+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13255402155972550705', time=2024-09-12T20:25:18.551966+0000, chain.objs.size()=1 2024-09-12T18:25:48.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.565+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.140__shadow_.C0kqjkE5W4v_q5vYyW9gpiN8eEZ8VTr_0 2024-09-12T18:25:48.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.569+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.573+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:25:48.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:25:48.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11927585177360145846', time=2024-09-12T20:24:47.404303+0000, chain.objs.size()=1 2024-09-12T18:25:48.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.117__shadow_.2uRjebF9u_lNPtdh1LMquEtDskrpV-U_0 2024-09-12T18:25:48.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2936687129833210642', time=2024-09-12T20:24:52.067854+0000, chain.objs.size()=1 2024-09-12T18:25:48.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.120__shadow_.l1bOaJq6LbZ7H7h2VnuIUwTDkKisM9I_0 2024-09-12T18:25:48.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9593271383460227024', time=2024-09-12T20:24:53.571693+0000, chain.objs.size()=1 2024-09-12T18:25:48.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.121__shadow_.q57x67ggnJmL0hwyxNV84uN1Mp7ek5C_0 2024-09-12T18:25:48.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9743555818830856394', time=2024-09-12T20:24:55.034330+0000, chain.objs.size()=1 2024-09-12T18:25:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.122__shadow_.dK4RMypfySZULW0DFXpHzzZxBXH8A98_0 2024-09-12T18:25:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16756772713171331664', time=2024-09-12T20:25:02.381247+0000, chain.objs.size()=1 2024-09-12T18:25:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.127__shadow_.UqqFOoaEZZ8j9xirTtngykk3qaMYkQ6_0 2024-09-12T18:25:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9343571519897517114', time=2024-09-12T20:25:08.233802+0000, chain.objs.size()=1 2024-09-12T18:25:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.131__shadow_.VeikvXnv_s3pxI8bxuD2lbWYgrdHYSa_0 2024-09-12T18:25:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10624958458520477094', time=2024-09-12T20:25:13.814416+0000, chain.objs.size()=1 2024-09-12T18:25:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.136__shadow_.UcPygWluW7w-GWLbMUpL7TCLXNz3fHz_0 2024-09-12T18:25:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5013981386480966119', time=2024-09-12T20:25:15.933183+0000, chain.objs.size()=1 2024-09-12T18:25:48.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.577+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.138__shadow_.DWxs3-DSEai-dOkRhMAIyBynD-_iZ3Z_0 2024-09-12T18:25:48.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.585+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.589+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:25:48.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.589+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:25:48.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6962376949285523277', time=2024-09-12T20:19:34.139411+0000, chain.objs.size()=1 2024-09-12T18:25:48.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.84__shadow_.XFU0XtnVp79MatJXlceNuhAIHiGvc-M_0 2024-09-12T18:25:48.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17626086510165157214', time=2024-09-12T20:20:40.133547+0000, chain.objs.size()=6 2024-09-12T18:25:48.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.93__shadow_.T7oiZHmmZAUSW2S5j1_SKyUttVB7F0U_0 2024-09-12T18:25:48.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.93__shadow_.T7oiZHmmZAUSW2S5j1_SKyUttVB7F0U_1 2024-09-12T18:25:48.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.93__shadow_.T7oiZHmmZAUSW2S5j1_SKyUttVB7F0U_2 2024-09-12T18:25:48.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.93__shadow_.T7oiZHmmZAUSW2S5j1_SKyUttVB7F0U_3 2024-09-12T18:25:48.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.93__shadow_.T7oiZHmmZAUSW2S5j1_SKyUttVB7F0U_4 2024-09-12T18:25:48.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.93__shadow_.T7oiZHmmZAUSW2S5j1_SKyUttVB7F0U_5 2024-09-12T18:25:48.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12564145513612027024', time=2024-09-12T20:21:04.599310+0000, chain.objs.size()=9 2024-09-12T18:25:48.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.98__multipart_key1.2~u1QMRKtKN6QMp6zk_v0xbZyOQor56LF.1 2024-09-12T18:25:48.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.98__shadow_key1.2~u1QMRKtKN6QMp6zk_v0xbZyOQor56LF.1_1 2024-09-12T18:25:48.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.98__multipart_key1.2~u1QMRKtKN6QMp6zk_v0xbZyOQor56LF.2 2024-09-12T18:25:48.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.98__shadow_key1.2~u1QMRKtKN6QMp6zk_v0xbZyOQor56LF.2_1 2024-09-12T18:25:48.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.593+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.98__multipart_key1.2~u1QMRKtKN6QMp6zk_v0xbZyOQor56LF.3 2024-09-12T18:25:48.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.597+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.98__shadow_key1.2~u1QMRKtKN6QMp6zk_v0xbZyOQor56LF.3_1 2024-09-12T18:25:48.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.597+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.98__multipart_key1.2~u1QMRKtKN6QMp6zk_v0xbZyOQor56LF.4 2024-09-12T18:25:48.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.601+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.98__shadow_key1.2~u1QMRKtKN6QMp6zk_v0xbZyOQor56LF.4_1 2024-09-12T18:25:48.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.601+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.98__multipart_key1.2~u1QMRKtKN6QMp6zk_v0xbZyOQor56LF.5 2024-09-12T18:25:48.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.601+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1274859568045687688', time=2024-09-12T20:24:42.867636+0000, chain.objs.size()=1 2024-09-12T18:25:48.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.601+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.114__shadow_.Fv22HEpmx-i43bFppUA2DxqOx0BA3x8_0 2024-09-12T18:25:48.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.601+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1779712563331771896', time=2024-09-12T20:24:49.057537+0000, chain.objs.size()=1 2024-09-12T18:25:48.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.601+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.118__shadow_.z7nR9DD9RWcISWnvn1zpSpms9f8OAIx_0 2024-09-12T18:25:48.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.601+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3030884297281699943', time=2024-09-12T20:24:55.107806+0000, chain.objs.size()=1 2024-09-12T18:25:48.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.601+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.122__shadow_.QanlriSx_1JrlwQOS_SEt1gkh31IjB5_0 2024-09-12T18:25:48.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.605+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.609+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:25:48.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.613+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.613+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.617+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:25:48.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.617+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9980953713162796816', time=2024-09-12T20:24:42.919945+0000, chain.objs.size()=1 2024-09-12T18:25:48.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.617+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.114__shadow_.xJM4mX8gkigm2BwSut69Z7F3tdm7CQ2_0 2024-09-12T18:25:48.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.617+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13388351729312971820', time=2024-09-12T20:24:56.548575+0000, chain.objs.size()=1 2024-09-12T18:25:48.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.617+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.123__shadow_.n5KCAJQ2UYy2Mp5TCoar9m0IptuHUxH_0 2024-09-12T18:25:48.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.617+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.159627462512062936', time=2024-09-12T20:24:59.520978+0000, chain.objs.size()=1 2024-09-12T18:25:48.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.617+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.125__shadow_.iw89azjGeDQhxrgKD8LCULcLKCmnQzA_0 2024-09-12T18:25:48.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.617+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.625+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:25:48.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.625+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.629+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.629+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:25:48.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.629+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17009942465016191586', time=2024-09-12T20:19:35.197362+0000, chain.objs.size()=1 2024-09-12T18:25:48.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.629+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.85__shadow_.MW_uqKwfVyillapb0tbf_N9xRrFaSO2_0 2024-09-12T18:25:48.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.629+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7429235788877190400', time=2024-09-12T20:24:52.143307+0000, chain.objs.size()=1 2024-09-12T18:25:48.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.629+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.120__shadow_.rgEqalKOR6234zPfLuSmSil7NNdS-T4_0 2024-09-12T18:25:48.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.629+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10741661396357794045', time=2024-09-12T20:25:00.997462+0000, chain.objs.size()=1 2024-09-12T18:25:48.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.629+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.126__shadow_.fzKs95ZTzDVOxqWusQJRRfTyvUzTJJV_0 2024-09-12T18:25:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.633+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.637+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:25:48.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.637+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.637+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.641+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:25:48.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.641+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18357315227004960377', time=2024-09-12T20:24:49.129414+0000, chain.objs.size()=1 2024-09-12T18:25:48.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.641+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.118__shadow_.iC_Jqw41tqvuAuW2oUcIu2fnXtGJ_NZ_0 2024-09-12T18:25:48.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.641+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2789557235188194146', time=2024-09-12T20:24:50.518481+0000, chain.objs.size()=1 2024-09-12T18:25:48.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.641+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.119__shadow_.Rn0gl7E5_8qhUSoUt8M2YZvKC9YBsj7_0 2024-09-12T18:25:48.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.641+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15896345745502657566', time=2024-09-12T20:24:58.006313+0000, chain.objs.size()=1 2024-09-12T18:25:48.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.641+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.124__shadow_.OiE0Esh8uvbpdDeiucU9Z6YSgvcNv9C_0 2024-09-12T18:25:48.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.641+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.645+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:25:48.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.649+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.649+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.653+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:25:48.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.653+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16912038179205476657', time=2024-09-12T20:24:47.478939+0000, chain.objs.size()=1 2024-09-12T18:25:48.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.653+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.117__shadow_.lj0H99TFwyTu6do5ur9ae_ZB55oD-g1_0 2024-09-12T18:25:48.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.653+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3709127430496326222', time=2024-09-12T20:25:04.071787+0000, chain.objs.size()=1 2024-09-12T18:25:48.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.653+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.128__shadow_.stGYD4pdhNqP4Dng0dfPhARlQBjo6x9_0 2024-09-12T18:25:48.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.653+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1186026633389064589', time=2024-09-12T20:25:05.624030+0000, chain.objs.size()=1 2024-09-12T18:25:48.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.653+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.129__shadow_.UNNlGdtoH8amgDpfBwq3fFYE4CdBr6c_0 2024-09-12T18:25:48.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.653+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.661+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:25:48.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.661+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.665+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.665+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:25:48.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.665+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3212985729995865699', time=2024-09-12T20:23:52.048241+0000, chain.objs.size()=1 2024-09-12T18:25:48.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.665+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.103__shadow_.SzmJVYsPiSGsUIqYLQuH_3XErlaA3di_0 2024-09-12T18:25:48.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.665+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1368604959381344408', time=2024-09-12T20:25:09.605163+0000, chain.objs.size()=1 2024-09-12T18:25:48.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.665+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.132__shadow_.2wpOx0gvIi_d5aGvZPvRw0vMfci2dSL_0 2024-09-12T18:25:48.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.665+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.673+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:25:48.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.673+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:25:48.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5290745397236813048', time=2024-09-12T20:24:47.336403+0000, chain.objs.size()=1 2024-09-12T18:25:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.117__shadow_.ZQrke3bqbDzNUj3u_58HKUB2Y6tqAbc_0 2024-09-12T18:25:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15012381281654970157', time=2024-09-12T20:25:02.528653+0000, chain.objs.size()=1 2024-09-12T18:25:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.127__shadow_.L0HzShXE19Gmj5-x28Z9P5qmJ52f-pk_0 2024-09-12T18:25:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5412570411419898209', time=2024-09-12T20:25:06.982146+0000, chain.objs.size()=1 2024-09-12T18:25:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.130__shadow_.M-OAgXYxmZ83P9NBHc88WAYoj_ljknM_0 2024-09-12T18:25:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15662983863522320628', time=2024-09-12T20:25:08.366317+0000, chain.objs.size()=1 2024-09-12T18:25:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.131__shadow_.X3RgKamgP8uEoWZKqupreQ7p-mV6oh8_0 2024-09-12T18:25:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10087743322900862450', time=2024-09-12T20:25:09.745592+0000, chain.objs.size()=1 2024-09-12T18:25:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.132__shadow_.AvzfNX8886sbLvt8Zn-u2XDkZSexDSV_0 2024-09-12T18:25:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12017185630826205210', time=2024-09-12T20:25:47.087007+0000, chain.objs.size()=9 2024-09-12T18:25:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.144__multipart_key1/data/file.mpg.2~RPUeEWY9ssyNWIPdlqT-N3tWpz7us8R.1 2024-09-12T18:25:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.144__shadow_key1/data/file.mpg.2~RPUeEWY9ssyNWIPdlqT-N3tWpz7us8R.1_1 2024-09-12T18:25:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.144__multipart_key1/data/file.mpg.2~RPUeEWY9ssyNWIPdlqT-N3tWpz7us8R.2 2024-09-12T18:25:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.144__shadow_key1/data/file.mpg.2~RPUeEWY9ssyNWIPdlqT-N3tWpz7us8R.2_1 2024-09-12T18:25:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.144__multipart_key1/data/file.mpg.2~RPUeEWY9ssyNWIPdlqT-N3tWpz7us8R.3 2024-09-12T18:25:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.144__shadow_key1/data/file.mpg.2~RPUeEWY9ssyNWIPdlqT-N3tWpz7us8R.3_1 2024-09-12T18:25:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.677+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.144__multipart_key1/data/file.mpg.2~RPUeEWY9ssyNWIPdlqT-N3tWpz7us8R.4 2024-09-12T18:25:48.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.681+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.144__shadow_key1/data/file.mpg.2~RPUeEWY9ssyNWIPdlqT-N3tWpz7us8R.4_1 2024-09-12T18:25:48.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.681+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.144__multipart_key1/data/file.mpg.2~RPUeEWY9ssyNWIPdlqT-N3tWpz7us8R.5 2024-09-12T18:25:48.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.685+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.689+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:25:48.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.693+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:25:48.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10998139598138266510', time=2024-09-12T20:19:39.588492+0000, chain.objs.size()=1 2024-09-12T18:25:48.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.90__shadow_.GRgTPxFIv1DpljE5gSas2mq5M5Cy9vj_0 2024-09-12T18:25:48.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.148982474565922742', time=2024-09-12T20:22:53.839516+0000, chain.objs.size()=9 2024-09-12T18:25:48.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~9Qq786UrmupiBUeMEynV3Sre019Vwfw.1 2024-09-12T18:25:48.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~9Qq786UrmupiBUeMEynV3Sre019Vwfw.1_1 2024-09-12T18:25:48.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~9Qq786UrmupiBUeMEynV3Sre019Vwfw.2 2024-09-12T18:25:48.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~9Qq786UrmupiBUeMEynV3Sre019Vwfw.2_1 2024-09-12T18:25:48.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~9Qq786UrmupiBUeMEynV3Sre019Vwfw.3 2024-09-12T18:25:48.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~9Qq786UrmupiBUeMEynV3Sre019Vwfw.3_1 2024-09-12T18:25:48.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~9Qq786UrmupiBUeMEynV3Sre019Vwfw.4 2024-09-12T18:25:48.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__shadow_key1.2~9Qq786UrmupiBUeMEynV3Sre019Vwfw.4_1 2024-09-12T18:25:48.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.102__multipart_key1.2~9Qq786UrmupiBUeMEynV3Sre019Vwfw.5 2024-09-12T18:25:48.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc', time=2024-09-12T20:24:23.419926+0000, chain.objs.size()=1 2024-09-12T18:25:48.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.18 2024-09-12T18:25:48.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc', time=2024-09-12T20:24:23.627074+0000, chain.objs.size()=46 2024-09-12T18:25:48.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.697+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.1 2024-09-12T18:25:48.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.705+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.2 2024-09-12T18:25:48.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.705+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.3 2024-09-12T18:25:48.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.705+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.4 2024-09-12T18:25:48.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.705+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.5 2024-09-12T18:25:48.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.705+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.6 2024-09-12T18:25:48.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.705+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.7 2024-09-12T18:25:48.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.705+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.8 2024-09-12T18:25:48.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.705+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.9 2024-09-12T18:25:48.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.705+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.10 2024-09-12T18:25:48.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.705+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.11 2024-09-12T18:25:48.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.705+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.12 2024-09-12T18:25:48.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.709+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.13 2024-09-12T18:25:48.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.709+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.14 2024-09-12T18:25:48.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.709+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.15 2024-09-12T18:25:48.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.709+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.16 2024-09-12T18:25:48.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.709+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.17 2024-09-12T18:25:48.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.709+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.JFKRmfVD5ygFgCW4lbhGO782ir05Ffzc.18 2024-09-12T18:25:48.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.709+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.19 2024-09-12T18:25:48.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.709+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.20 2024-09-12T18:25:48.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.709+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.21 2024-09-12T18:25:48.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.709+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.22 2024-09-12T18:25:48.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.709+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.23 2024-09-12T18:25:48.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.713+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.24 2024-09-12T18:25:48.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.713+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.25 2024-09-12T18:25:48.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.713+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.26 2024-09-12T18:25:48.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.713+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.27 2024-09-12T18:25:48.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.713+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.28 2024-09-12T18:25:48.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.713+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.29 2024-09-12T18:25:48.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.713+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.30 2024-09-12T18:25:48.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.713+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.31 2024-09-12T18:25:48.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.713+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.32 2024-09-12T18:25:48.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.713+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.33 2024-09-12T18:25:48.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.717+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.34 2024-09-12T18:25:48.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.717+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.35 2024-09-12T18:25:48.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.717+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.36 2024-09-12T18:25:48.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.717+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.37 2024-09-12T18:25:48.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.717+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.38 2024-09-12T18:25:48.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.39 2024-09-12T18:25:48.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.40 2024-09-12T18:25:48.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.41 2024-09-12T18:25:48.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.42 2024-09-12T18:25:48.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.43 2024-09-12T18:25:48.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.44 2024-09-12T18:25:48.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.45 2024-09-12T18:25:48.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.105__multipart_key1.2~_GS91sJzQKtRBSkHG0ju0s-Mz9BTEMc.46 2024-09-12T18:25:48.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17812218270797227363', time=2024-09-12T20:24:44.522044+0000, chain.objs.size()=1 2024-09-12T18:25:48.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.115__shadow_.Gv88sIXVof3y4sqwcOn7twW60Gxjyq4_0 2024-09-12T18:25:48.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8759974746801150951', time=2024-09-12T20:25:17.459620+0000, chain.objs.size()=1 2024-09-12T18:25:48.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.721+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.139__shadow_.dE08K01TwP-HqgEb_rrxa_9LAK0fRdR_0 2024-09-12T18:25:48.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.725+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.733+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:25:48.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.733+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:48.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.737+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:48.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.737+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:25:48.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.737+0000 7eff1a8fc9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17812173525477788655', time=2024-09-12T20:24:41.322948+0000, chain.objs.size()=1 2024-09-12T18:25:48.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.737+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.113__shadow_.-IuxCN5wuWJ8J_GnPNAq_4ejnDXWGOe_0 2024-09-12T18:25:48.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.737+0000 7eff1a8fc9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:25:48.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.745+0000 7efdcefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:48.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.749+0000 7eff1a8fc9c0 20 remove_watcher() i=0 2024-09-12T18:25:48.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.749+0000 7eff1a8fc9c0 2 removed watcher, disabling cache 2024-09-12T18:25:48.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.749+0000 7eff1a8fc9c0 20 remove_watcher() i=1 2024-09-12T18:25:48.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.753+0000 7eff1a8fc9c0 20 remove_watcher() i=2 2024-09-12T18:25:48.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.753+0000 7eff1a8fc9c0 20 remove_watcher() i=3 2024-09-12T18:25:48.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.757+0000 7eff1a8fc9c0 20 remove_watcher() i=4 2024-09-12T18:25:48.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.757+0000 7eff1a8fc9c0 20 remove_watcher() i=5 2024-09-12T18:25:48.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.761+0000 7eff1a8fc9c0 20 remove_watcher() i=6 2024-09-12T18:25:48.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.765+0000 7eff1a8fc9c0 20 remove_watcher() i=7 2024-09-12T18:25:48.788 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-12T18:25:48.859 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:48.859 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.901+0000 7f49ca3889c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:48.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.901+0000 7f49ca3889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:48.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.901+0000 7f49ca3889c0 20 realm 2024-09-12T18:25:48.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.901+0000 7f49ca3889c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:48.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.905+0000 7f49ca3889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:48.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.905+0000 7f49ca3889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:48.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.905+0000 7f49ca3889c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:48.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.905+0000 7f49ca3889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:48.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.905+0000 7f49ca3889c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:48.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.905+0000 7f49ca3889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:48.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.905+0000 7f49ca3889c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:48.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.905+0000 7f49ca3889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:48.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.905+0000 7f49ca3889c0 20 searching for the correct realm 2024-09-12T18:25:48.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:48.909+0000 7f49c7e8e640 0 -- 172.21.15.97:0/2727469457 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f49c00e8040 msgr2=0x7f49c00e7410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:25:49.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.121+0000 7f49c7e8e640 0 -- 172.21.15.97:0/2727469457 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f49b801a040 msgr2=0x7f49b800a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:49.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.345+0000 7f49ca3889c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:49.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.345+0000 7f49ca3889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:49.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.345+0000 7f49ca3889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:49.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.345+0000 7f49ca3889c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:49.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.345+0000 7f49ca3889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:49.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.345+0000 7f49ca3889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:49.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.345+0000 7f49ca3889c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.345+0000 7f49ca3889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.345+0000 7f49ca3889c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.345+0000 7f49ca3889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.345+0000 7f49ca3889c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 20 zone default found 2024-09-12T18:25:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 4 Realm: () 2024-09-12T18:25:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 20 zonegroup default 2024-09-12T18:25:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:49.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:49.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:49.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:49.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:49.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:49.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 20 started sync module instance, tier type = 2024-09-12T18:25:49.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.349+0000 7f49ca3889c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:49.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.373+0000 7f49ca3889c0 20 add_watcher() i=0 2024-09-12T18:25:49.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.373+0000 7f49ca3889c0 20 add_watcher() i=1 2024-09-12T18:25:49.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.373+0000 7f49ca3889c0 20 add_watcher() i=2 2024-09-12T18:25:49.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.373+0000 7f49ca3889c0 20 add_watcher() i=3 2024-09-12T18:25:49.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.373+0000 7f49ca3889c0 20 add_watcher() i=4 2024-09-12T18:25:49.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.373+0000 7f49ca3889c0 20 add_watcher() i=5 2024-09-12T18:25:49.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.373+0000 7f49ca3889c0 20 add_watcher() i=6 2024-09-12T18:25:49.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.377+0000 7f49ca3889c0 20 add_watcher() i=7 2024-09-12T18:25:49.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.377+0000 7f49ca3889c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:49.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.381+0000 7f487dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:49.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.381+0000 7f49ca3889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:49.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.381+0000 7f49ca3889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:49.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.473+0000 7f487cfe1640 20 reqs_thread_entry: start 2024-09-12T18:25:49.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.473+0000 7f49ca3889c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:49.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.473+0000 7f49ca3889c0 20 Filter name: none 2024-09-12T18:25:49.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.473+0000 7f47f67fc640 20 reqs_thread_entry: start 2024-09-12T18:25:49.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.473+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:25:49.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.473+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.477+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.477+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.477+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:25:49.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.481+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.481+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.485+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.485+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:25:49.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.489+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.489+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.489+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.493+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:25:49.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.497+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.497+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.497+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.501+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:25:49.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.505+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.505+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.509+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.509+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:25:49.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.513+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.513+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.513+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.517+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:25:49.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.521+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.521+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.521+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.525+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:25:49.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.525+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.529+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.529+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.533+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:25:49.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.533+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.537+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.537+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.537+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:25:49.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.541+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.545+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.545+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.549+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:25:49.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.553+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.553+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.553+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.557+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:25:49.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.561+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.561+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.561+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.565+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:25:49.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.569+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.569+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.569+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.573+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:25:49.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.577+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.581 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.577+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.577+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.581+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:25:49.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.585+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.585+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.585+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.589+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:25:49.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.593+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.593+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.593+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.597+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:25:49.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.601+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.601+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.601+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.605+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:25:49.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.605+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.605+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.609+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.609+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:25:49.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.613+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.613+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.613+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.617+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:25:49.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.621+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.621+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.621+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.621+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:25:49.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.625+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.625+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.629+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.629+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:25:49.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.633+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.633+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.633+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.637+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:25:49.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.641+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.641+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.641+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.645+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:25:49.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.649+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.649+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.649+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.653+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:25:49.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.657+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.657+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.657+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.661+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:25:49.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.665+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.665+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.665+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.669+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:25:49.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.673+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.673+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.677+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.677+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:25:49.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.681+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.685+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.685+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.685+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:25:49.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.689+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.693+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.693+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.697+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:25:49.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.701+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.701+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.701+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.705+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:25:49.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.709+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.709+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.713+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.713+0000 7f49ca3889c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:25:49.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.717+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.721+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:25:49.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.721+0000 7f49ca3889c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:25:49.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.725+0000 7f487dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:49.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.729+0000 7f49ca3889c0 20 remove_watcher() i=0 2024-09-12T18:25:49.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.729+0000 7f49ca3889c0 2 removed watcher, disabling cache 2024-09-12T18:25:49.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.733+0000 7f49ca3889c0 20 remove_watcher() i=1 2024-09-12T18:25:49.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.733+0000 7f49ca3889c0 20 remove_watcher() i=2 2024-09-12T18:25:49.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.737+0000 7f49ca3889c0 20 remove_watcher() i=3 2024-09-12T18:25:49.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.737+0000 7f49ca3889c0 20 remove_watcher() i=4 2024-09-12T18:25:49.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.741+0000 7f49ca3889c0 20 remove_watcher() i=5 2024-09-12T18:25:49.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.745+0000 7f49ca3889c0 20 remove_watcher() i=6 2024-09-12T18:25:49.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:49.745+0000 7f49ca3889c0 20 remove_watcher() i=7 2024-09-12T18:25:49.770 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T18:25:49.789 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T18:25:49.790 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T18:25:49.790 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T18:25:49.790 DEBUG:teuthology.orchestra.run.smithi097:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:25:49.818 INFO:teuthology.orchestra.run.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T18:25:50.721 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T18:25:50.722 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T18:25:50.763 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:50.763 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:50.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.801+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.801+0000 7fe38e5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:50.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.801+0000 7fe38e5099c0 20 realm 2024-09-12T18:25:50.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.801+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.801+0000 7fe38e5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:50.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.801+0000 7fe38e5099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:50.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.801+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.805+0000 7fe38e5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:50.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.805+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.805+0000 7fe38e5099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:50.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.805+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.805+0000 7fe38e5099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.805+0000 7fe38e5099c0 20 searching for the correct realm 2024-09-12T18:25:50.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.813+0000 7fe38c810640 0 -- 172.21.15.97:0/3084267792 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fe3800d9020 msgr2=0x7fe380120a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.817+0000 7fe38c00f640 0 -- 172.21.15.97:0/3084267792 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fe38401f440 msgr2=0x7fe38401f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.825+0000 7fe38e5099c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.825+0000 7fe38e5099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.825+0000 7fe38e5099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.825+0000 7fe38e5099c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.825+0000 7fe38e5099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.825+0000 7fe38e5099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.825+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.825+0000 7fe38e5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.825+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.825+0000 7fe38e5099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.825+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 20 zone default found 2024-09-12T18:25:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 4 Realm: () 2024-09-12T18:25:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 20 zonegroup default 2024-09-12T18:25:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:50.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 20 started sync module instance, tier type = 2024-09-12T18:25:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.829+0000 7fe38e5099c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.849+0000 7fe38e5099c0 20 add_watcher() i=0 2024-09-12T18:25:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.849+0000 7fe38e5099c0 20 add_watcher() i=1 2024-09-12T18:25:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.849+0000 7fe38e5099c0 20 add_watcher() i=2 2024-09-12T18:25:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.849+0000 7fe38e5099c0 20 add_watcher() i=3 2024-09-12T18:25:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.849+0000 7fe38e5099c0 20 add_watcher() i=4 2024-09-12T18:25:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.849+0000 7fe38e5099c0 20 add_watcher() i=5 2024-09-12T18:25:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.849+0000 7fe38e5099c0 20 add_watcher() i=6 2024-09-12T18:25:50.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.849+0000 7fe38e5099c0 20 add_watcher() i=7 2024-09-12T18:25:50.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.849+0000 7fe38e5099c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe242fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 5 note: GC not initialized 2024-09-12T18:25:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe241fdb640 20 reqs_thread_entry: start 2024-09-12T18:25:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 20 Filter name: none 2024-09-12T18:25:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe1b37fe640 20 reqs_thread_entry: start 2024-09-12T18:25:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T18:25:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T18:25:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:25:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T18:25:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T18:25:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.853+0000 7fe38e5099c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.857+0000 7fe38e5099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.857+0000 7fe38e5099c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T18:25:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.857+0000 7fe38e5099c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:25:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.857+0000 7fe38e5099c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T18:25:50.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.857+0000 7fe38e5099c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:25:50.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.857+0000 7fe38e5099c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:25:50.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.857+0000 7fe38e5099c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T18:25:50.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.857+0000 7fe2637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431795 cookie 94254333942080 notifier 8441 bl.length()=384 2024-09-12T18:25:50.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.857+0000 7fe2637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:25:50.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.857+0000 7fe2637fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:25:50.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.861+0000 7fe38e5099c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T18:25:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.861+0000 7fe38e5099c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:25:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.861+0000 7fe38e5099c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T18:25:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.861+0000 7fe2637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431796 cookie 94254333952368 notifier 8441 bl.length()=225 2024-09-12T18:25:50.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.861+0000 7fe2637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T18:25:50.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.861+0000 7fe2637fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:25:50.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.869+0000 7fe38e5099c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T18:25:50.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.869+0000 7fe38e5099c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:25:50.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.869+0000 7fe38e5099c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T18:25:50.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.869+0000 7fe262ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431668 cookie 94254333948592 notifier 8441 bl.length()=234 2024-09-12T18:25:50.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.869+0000 7fe262ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T18:25:50.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.869+0000 7fe262ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:25:50.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.873+0000 7fe242fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.877+0000 7fe38e5099c0 20 remove_watcher() i=0 2024-09-12T18:25:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.877+0000 7fe38e5099c0 2 removed watcher, disabling cache 2024-09-12T18:25:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.877+0000 7fe38e5099c0 20 remove_watcher() i=1 2024-09-12T18:25:50.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.877+0000 7fe38e5099c0 20 remove_watcher() i=2 2024-09-12T18:25:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.881+0000 7fe38e5099c0 20 remove_watcher() i=3 2024-09-12T18:25:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.881+0000 7fe38e5099c0 20 remove_watcher() i=4 2024-09-12T18:25:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.885+0000 7fe38e5099c0 20 remove_watcher() i=5 2024-09-12T18:25:50.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.889+0000 7fe38e5099c0 20 remove_watcher() i=6 2024-09-12T18:25:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:50.889+0000 7fe38e5099c0 20 remove_watcher() i=7 2024-09-12T18:25:50.907 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:25:50.907 INFO:teuthology.orchestra.run.smithi097.stdout: "id": "RGW11111111111111111", 2024-09-12T18:25:50.907 INFO:teuthology.orchestra.run.smithi097.stdout: "tenant": "", 2024-09-12T18:25:50.907 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T18:25:50.907 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "quota": { 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:50.908 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:50.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:50.909 INFO:teuthology.orchestra.run.smithi097.stdout: "max_users": 1000, 2024-09-12T18:25:50.909 INFO:teuthology.orchestra.run.smithi097.stdout: "max_roles": 1000, 2024-09-12T18:25:50.909 INFO:teuthology.orchestra.run.smithi097.stdout: "max_groups": 1000, 2024-09-12T18:25:50.909 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:25:50.909 INFO:teuthology.orchestra.run.smithi097.stdout: "max_access_keys": 4 2024-09-12T18:25:50.909 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:25:50.910 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T18:25:50.911 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key VLSUVBJRNKPZPLXIJSAV --secret iSGD1IPfINKupGa2NVSPIh9tsr744efRoSHo8XuvnrRLM3CQ8k4wJA== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T18:25:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.033+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.037+0000 7f5a4aedb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.037+0000 7f5a4aedb9c0 20 realm 2024-09-12T18:25:51.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.037+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.037+0000 7f5a4aedb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.037+0000 7f5a4aedb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.037+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.037+0000 7f5a4aedb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.037+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.037+0000 7f5a4aedb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.037+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.041+0000 7f5a4aedb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:51.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.041+0000 7f5a4aedb9c0 20 searching for the correct realm 2024-09-12T18:25:51.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.045+0000 7f5a481e0640 0 -- 172.21.15.97:0/1874229326 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f5a3c0787a0 msgr2=0x7f5a3c067040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.053+0000 7f5a489e1640 0 -- 172.21.15.97:0/1874229326 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f5a3805e9d0 msgr2=0x7f5a38079920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:51.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.269+0000 7f5a4aedb9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:51.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.269+0000 7f5a4aedb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:51.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.269+0000 7f5a4aedb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.269+0000 7f5a4aedb9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.269+0000 7f5a4aedb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.269+0000 7f5a4aedb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.269+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.269+0000 7f5a4aedb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.269+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.269+0000 7f5a4aedb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.269+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 20 zone default found 2024-09-12T18:25:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 4 Realm: () 2024-09-12T18:25:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 20 zonegroup default 2024-09-12T18:25:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 20 started sync module instance, tier type = 2024-09-12T18:25:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.273+0000 7f5a4aedb9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:51.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.293+0000 7f5a4aedb9c0 20 add_watcher() i=0 2024-09-12T18:25:51.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.293+0000 7f5a4aedb9c0 20 add_watcher() i=1 2024-09-12T18:25:51.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.293+0000 7f5a4aedb9c0 20 add_watcher() i=2 2024-09-12T18:25:51.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.293+0000 7f5a4aedb9c0 20 add_watcher() i=3 2024-09-12T18:25:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.293+0000 7f5a4aedb9c0 20 add_watcher() i=4 2024-09-12T18:25:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.293+0000 7f5a4aedb9c0 20 add_watcher() i=5 2024-09-12T18:25:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.293+0000 7f5a4aedb9c0 20 add_watcher() i=6 2024-09-12T18:25:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.297+0000 7f5a4aedb9c0 20 add_watcher() i=7 2024-09-12T18:25:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.297+0000 7f5a4aedb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.301+0000 7f58ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.301+0000 7f5a4aedb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.301+0000 7f5a4aedb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.301+0000 7f5a4aedb9c0 5 note: GC not initialized 2024-09-12T18:25:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.301+0000 7f58fe7e4640 20 reqs_thread_entry: start 2024-09-12T18:25:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.301+0000 7f5a4aedb9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.301+0000 7f5a4aedb9c0 20 Filter name: none 2024-09-12T18:25:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f58f77fe640 20 reqs_thread_entry: start 2024-09-12T18:25:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T18:25:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T18:25:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:25:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T18:25:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T18:25:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:25:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 10 cache get: name=default.rgw.meta+users.keys+VLSUVBJRNKPZPLXIJSAV : miss 2024-09-12T18:25:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 10 cache put: name=default.rgw.meta+users.keys+VLSUVBJRNKPZPLXIJSAV info.flags=0x0 2024-09-12T18:25:51.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 10 adding default.rgw.meta+users.keys+VLSUVBJRNKPZPLXIJSAV to cache LRU end 2024-09-12T18:25:51.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T18:25:51.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.305+0000 7f5a4aedb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.309+0000 7f5a4aedb9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:25:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.309+0000 7f5a4aedb9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:25:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.309+0000 7f5a4aedb9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:25:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.309+0000 7f5a4aedb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:25:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.309+0000 7f5a4aedb9c0 10 cache get: name=default.rgw.meta+users.keys+VLSUVBJRNKPZPLXIJSAV : hit (negative entry) 2024-09-12T18:25:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.309+0000 7f5a4aedb9c0 10 cache get: name=default.rgw.meta+users.keys+VLSUVBJRNKPZPLXIJSAV : hit (negative entry) 2024-09-12T18:25:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.313+0000 7f5a4aedb9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:25:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.313+0000 7f5a4aedb9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:25:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.313+0000 7f5a4aedb9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T18:25:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.313+0000 7f591ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431692 cookie 94121918852784 notifier 8459 bl.length()=673 2024-09-12T18:25:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.313+0000 7f591ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:25:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.313+0000 7f591ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:25:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.317+0000 7f5a4aedb9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T18:25:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.317+0000 7f5a4aedb9c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:25:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.317+0000 7f5a4aedb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T18:25:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.317+0000 7f591f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431797 cookie 94121918863216 notifier 8459 bl.length()=185 2024-09-12T18:25:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.317+0000 7f591f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T18:25:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.317+0000 7f591f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:25:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.321+0000 7f5a4aedb9c0 10 cache put: name=default.rgw.meta+users.keys+VLSUVBJRNKPZPLXIJSAV info.flags=0x7 2024-09-12T18:25:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.321+0000 7f5a4aedb9c0 10 moving default.rgw.meta+users.keys+VLSUVBJRNKPZPLXIJSAV to cache LRU end 2024-09-12T18:25:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.321+0000 7f5a4aedb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:VLSUVBJRNKPZPLXIJSAV, ofs0, ns] 2024-09-12T18:25:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.325+0000 7f591ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431656 cookie 94121918858416 notifier 8459 bl.length()=186 2024-09-12T18:25:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.325+0000 7f591ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VLSUVBJRNKPZPLXIJSAV info.flags=0x7 2024-09-12T18:25:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.325+0000 7f591ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VLSUVBJRNKPZPLXIJSAV to cache LRU end 2024-09-12T18:25:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.329+0000 7f5a4aedb9c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T18:25:51.334 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:25:51.334 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "foo.client.0", 2024-09-12T18:25:51.334 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T18:25:51.334 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "foo+test@test.test", 2024-09-12T18:25:51.334 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-12T18:25:51.334 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:25:51.334 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-12T18:25:51.335 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-12T18:25:51.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T18:25:51.335 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "foo.client.0", 2024-09-12T18:25:51.335 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "VLSUVBJRNKPZPLXIJSAV", 2024-09-12T18:25:51.335 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "iSGD1IPfINKupGa2NVSPIh9tsr744efRoSHo8XuvnrRLM3CQ8k4wJA==", 2024-09-12T18:25:51.335 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-12T18:25:51.335 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:51.312298Z" 2024-09-12T18:25:51.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-12T18:25:51.335 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T18:25:51.335 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-12T18:25:51.335 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-12T18:25:51.336 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T18:25:51.336 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-12T18:25:51.336 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-12T18:25:51.336 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-12T18:25:51.336 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:25:51.336 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:51.336 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:51.336 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:51.336 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:51.336 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:51.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:51.337 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-12T18:25:51.337 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:51.337 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:51.337 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:51.337 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:51.337 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:51.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:51.337 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-12T18:25:51.337 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "root", 2024-09-12T18:25:51.337 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-12T18:25:51.338 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "RGW11111111111111111", 2024-09-12T18:25:51.338 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-12T18:25:51.338 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:51.312260Z", 2024-09-12T18:25:51.338 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-12T18:25:51.338 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-12T18:25:51.338 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:25:51.338 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.329+0000 7f58ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.333+0000 7f5a4aedb9c0 20 remove_watcher() i=0 2024-09-12T18:25:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.333+0000 7f5a4aedb9c0 2 removed watcher, disabling cache 2024-09-12T18:25:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.337+0000 7f5a4aedb9c0 20 remove_watcher() i=1 2024-09-12T18:25:51.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.337+0000 7f5a4aedb9c0 20 remove_watcher() i=2 2024-09-12T18:25:51.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.341+0000 7f5a4aedb9c0 20 remove_watcher() i=3 2024-09-12T18:25:51.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.341+0000 7f5a4aedb9c0 20 remove_watcher() i=4 2024-09-12T18:25:51.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.345+0000 7f5a4aedb9c0 20 remove_watcher() i=5 2024-09-12T18:25:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.349+0000 7f5a4aedb9c0 20 remove_watcher() i=6 2024-09-12T18:25:51.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.349+0000 7f5a4aedb9c0 20 remove_watcher() i=7 2024-09-12T18:25:51.372 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 3942094685 --totp-seed FQXTZTGWFN2BWGZZXV4NMSUDHJC5DPQKBI24BKZ3HYXDT5JYMJM3JDAWBLJAWKET --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:25:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:51.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.493+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.497+0000 7fd68287a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.497+0000 7fd68287a9c0 20 realm 2024-09-12T18:25:51.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.497+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.497+0000 7fd68287a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.497+0000 7fd68287a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:51.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.497+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.497+0000 7fd68287a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.497+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.501+0000 7fd68287a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:51.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.501+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.501+0000 7fd68287a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:51.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.501+0000 7fd68287a9c0 20 searching for the correct realm 2024-09-12T18:25:51.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.509+0000 7fd680380640 0 -- 172.21.15.97:0/610126659 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7fd67802d060 msgr2=0x7fd67808b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:25:51.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.513+0000 7fd680380640 0 -- 172.21.15.97:0/610126659 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fd6700fd0c0 msgr2=0x7fd6700fbb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:51.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:51.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:51.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:51.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:51.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:51.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:51.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:51.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:51.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 zone default found 2024-09-12T18:25:51.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 4 Realm: () 2024-09-12T18:25:51.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:51.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:51.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:51.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 zonegroup default 2024-09-12T18:25:51.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.521+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.525+0000 7fd68287a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:51.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.525+0000 7fd68287a9c0 20 started sync module instance, tier type = 2024-09-12T18:25:51.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.525+0000 7fd68287a9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.541+0000 7fd68287a9c0 20 add_watcher() i=0 2024-09-12T18:25:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.541+0000 7fd68287a9c0 20 add_watcher() i=1 2024-09-12T18:25:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.541+0000 7fd68287a9c0 20 add_watcher() i=2 2024-09-12T18:25:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.541+0000 7fd68287a9c0 20 add_watcher() i=3 2024-09-12T18:25:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.541+0000 7fd68287a9c0 20 add_watcher() i=4 2024-09-12T18:25:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.541+0000 7fd68287a9c0 20 add_watcher() i=5 2024-09-12T18:25:51.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.541+0000 7fd68287a9c0 20 add_watcher() i=6 2024-09-12T18:25:51.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.545+0000 7fd68287a9c0 20 add_watcher() i=7 2024-09-12T18:25:51.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.545+0000 7fd68287a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.545+0000 7fd5377de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.545+0000 7fd68287a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.545+0000 7fd68287a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.545+0000 7fd68287a9c0 5 note: GC not initialized 2024-09-12T18:25:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.545+0000 7fd5367dc640 20 reqs_thread_entry: start 2024-09-12T18:25:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.549+0000 7fd68287a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.549+0000 7fd68287a9c0 20 Filter name: none 2024-09-12T18:25:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.549+0000 7fd52f7fe640 20 reqs_thread_entry: start 2024-09-12T18:25:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.549+0000 7fd68287a9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T18:25:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.549+0000 7fd68287a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.549+0000 7fd68287a9c0 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T18:25:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.549+0000 7fd68287a9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T18:25:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.549+0000 7fd68287a9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:25:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:51.549+0000 7fd68287a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:25:52.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.621+0000 7fd68287a9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:25:52.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.621+0000 7fd68287a9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:25:52.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.621+0000 7fd68287a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T18:25:52.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.621+0000 7fd556ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366285 cookie 94450622508656 notifier 8474 bl.length()=687 2024-09-12T18:25:52.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.621+0000 7fd556ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:25:52.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.621+0000 7fd556ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:25:52.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.625+0000 7fd5377de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:52.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.633+0000 7fd68287a9c0 20 remove_watcher() i=0 2024-09-12T18:25:52.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.633+0000 7fd68287a9c0 2 removed watcher, disabling cache 2024-09-12T18:25:52.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.633+0000 7fd68287a9c0 20 remove_watcher() i=1 2024-09-12T18:25:52.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.637+0000 7fd68287a9c0 20 remove_watcher() i=2 2024-09-12T18:25:52.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.637+0000 7fd68287a9c0 20 remove_watcher() i=3 2024-09-12T18:25:52.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.641+0000 7fd68287a9c0 20 remove_watcher() i=4 2024-09-12T18:25:52.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.645+0000 7fd68287a9c0 20 remove_watcher() i=5 2024-09-12T18:25:52.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.645+0000 7fd68287a9c0 20 remove_watcher() i=6 2024-09-12T18:25:52.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.649+0000 7fd68287a9c0 20 remove_watcher() i=7 2024-09-12T18:25:52.674 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T18:25:52.674 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key QGOPQQYHEYRPTWKYMIQS --secret wDkWt+fS5Mh3iK+QB4xge6glufdfEf0u/EJ5wGcYmmTKJyVRgPOhaw== --cluster ceph 2024-09-12T18:25:52.718 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:52.718 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:52.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.753+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:52.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.757+0000 7f6844fdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:52.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.757+0000 7f6844fdd9c0 20 realm 2024-09-12T18:25:52.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.757+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:52.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.757+0000 7f6844fdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:52.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.757+0000 7f6844fdd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:52.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.757+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:52.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.757+0000 7f6844fdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:52.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.757+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:52.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.757+0000 7f6844fdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:52.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.757+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:52.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.761+0000 7f6844fdd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:52.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.761+0000 7f6844fdd9c0 20 searching for the correct realm 2024-09-12T18:25:52.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.765+0000 7f68422e2640 0 -- 172.21.15.97:0/2565756742 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f683800f3d0 msgr2=0x7f683800f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:52.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.977+0000 7f68432e4640 0 -- 172.21.15.97:0/2565756742 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5577e1f1b810 msgr2=0x5577e1f1dcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:52.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.989+0000 7f6844fdd9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:52.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.989+0000 7f6844fdd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:52.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.989+0000 7f6844fdd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:52.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.989+0000 7f6844fdd9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:52.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.989+0000 7f6844fdd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:52.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.989+0000 7f6844fdd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:52.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.989+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:52.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.989+0000 7f6844fdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:52.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.989+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:53.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:53.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 zone default found 2024-09-12T18:25:53.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 4 Realm: () 2024-09-12T18:25:53.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:53.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:53.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:53.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 zonegroup default 2024-09-12T18:25:53.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 started sync module instance, tier type = 2024-09-12T18:25:53.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:52.993+0000 7f6844fdd9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:53.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.017+0000 7f6844fdd9c0 20 add_watcher() i=0 2024-09-12T18:25:53.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.017+0000 7f6844fdd9c0 20 add_watcher() i=1 2024-09-12T18:25:53.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.017+0000 7f6844fdd9c0 20 add_watcher() i=2 2024-09-12T18:25:53.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.017+0000 7f6844fdd9c0 20 add_watcher() i=3 2024-09-12T18:25:53.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.017+0000 7f6844fdd9c0 20 add_watcher() i=4 2024-09-12T18:25:53.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.017+0000 7f6844fdd9c0 20 add_watcher() i=5 2024-09-12T18:25:53.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.017+0000 7f6844fdd9c0 20 add_watcher() i=6 2024-09-12T18:25:53.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.017+0000 7f6844fdd9c0 20 add_watcher() i=7 2024-09-12T18:25:53.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.017+0000 7f6844fdd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:53.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.021+0000 7f66f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:53.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.021+0000 7f6844fdd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:53.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.021+0000 7f6844fdd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:53.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 5 note: GC not initialized 2024-09-12T18:25:53.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f66f8fe1640 20 reqs_thread_entry: start 2024-09-12T18:25:53.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:53.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 20 Filter name: none 2024-09-12T18:25:53.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T18:25:53.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f66f1ffb640 20 reqs_thread_entry: start 2024-09-12T18:25:53.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T18:25:53.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:25:53.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T18:25:53.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T18:25:53.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:25:53.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 10 cache get: name=default.rgw.meta+users.keys+QGOPQQYHEYRPTWKYMIQS : miss 2024-09-12T18:25:53.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 10 cache put: name=default.rgw.meta+users.keys+QGOPQQYHEYRPTWKYMIQS info.flags=0x0 2024-09-12T18:25:53.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 10 adding default.rgw.meta+users.keys+QGOPQQYHEYRPTWKYMIQS to cache LRU end 2024-09-12T18:25:53.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 10 cache get: name=default.rgw.meta+users.keys+QGOPQQYHEYRPTWKYMIQS : hit (negative entry) 2024-09-12T18:25:53.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.025+0000 7f6844fdd9c0 10 cache get: name=default.rgw.meta+users.keys+QGOPQQYHEYRPTWKYMIQS : hit (negative entry) 2024-09-12T18:25:53.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.029+0000 7f6844fdd9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:25:53.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.029+0000 7f6844fdd9c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:25:53.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.029+0000 7f6844fdd9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T18:25:53.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.029+0000 7f67267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366390 cookie 93973380189120 notifier 9102 bl.length()=645 2024-09-12T18:25:53.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.029+0000 7f67267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:25:53.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.029+0000 7f67267fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:25:53.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.033+0000 7f6844fdd9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T18:25:53.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.033+0000 7f6844fdd9c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:25:53.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.033+0000 7f6844fdd9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T18:25:53.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.033+0000 7f67267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366394 cookie 93973380244384 notifier 9102 bl.length()=185 2024-09-12T18:25:53.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.033+0000 7f67267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T18:25:53.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.033+0000 7f67267fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:25:53.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.041+0000 7f6844fdd9c0 10 cache put: name=default.rgw.meta+users.keys+QGOPQQYHEYRPTWKYMIQS info.flags=0x7 2024-09-12T18:25:53.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.041+0000 7f6844fdd9c0 10 moving default.rgw.meta+users.keys+QGOPQQYHEYRPTWKYMIQS to cache LRU end 2024-09-12T18:25:53.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.041+0000 7f6844fdd9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:QGOPQQYHEYRPTWKYMIQS, ofs0, ns] 2024-09-12T18:25:53.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.041+0000 7f67267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366286 cookie 93973380191024 notifier 9102 bl.length()=186 2024-09-12T18:25:53.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.041+0000 7f67267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QGOPQQYHEYRPTWKYMIQS info.flags=0x7 2024-09-12T18:25:53.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.041+0000 7f67267fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QGOPQQYHEYRPTWKYMIQS to cache LRU end 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "bar.client.0", 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "bar+test@test.test", 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "bar.client.0", 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "QGOPQQYHEYRPTWKYMIQS", 2024-09-12T18:25:53.047 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "wDkWt+fS5Mh3iK+QB4xge6glufdfEf0u/EJ5wGcYmmTKJyVRgPOhaw==", 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:53.030910Z" 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:53.048 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-12T18:25:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:53.049 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:53.030888Z", 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:25:53.050 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:53.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.041+0000 7f66f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:53.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.045+0000 7f6844fdd9c0 20 remove_watcher() i=0 2024-09-12T18:25:53.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.045+0000 7f6844fdd9c0 2 removed watcher, disabling cache 2024-09-12T18:25:53.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.049+0000 7f6844fdd9c0 20 remove_watcher() i=1 2024-09-12T18:25:53.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.053+0000 7f6844fdd9c0 20 remove_watcher() i=2 2024-09-12T18:25:53.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.053+0000 7f6844fdd9c0 20 remove_watcher() i=3 2024-09-12T18:25:53.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.057+0000 7f6844fdd9c0 20 remove_watcher() i=4 2024-09-12T18:25:53.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.057+0000 7f6844fdd9c0 20 remove_watcher() i=5 2024-09-12T18:25:53.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.061+0000 7f6844fdd9c0 20 remove_watcher() i=6 2024-09-12T18:25:53.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.065+0000 7f6844fdd9c0 20 remove_watcher() i=7 2024-09-12T18:25:53.084 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 0729900000 --totp-seed G2DFEQRZBGLSM7XIVMLIJHNBCFWPFCIEYJTXOMKTSCHCW6E2XBLB45QGABXPGR7Z --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:25:53.175 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:53.175 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.213+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.213+0000 7fa93a2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.213+0000 7fa93a2499c0 20 realm 2024-09-12T18:25:53.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.213+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.213+0000 7fa93a2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.213+0000 7fa93a2499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.213+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.213+0000 7fa93a2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.213+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.213+0000 7fa93a2499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:53.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.213+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.217+0000 7fa93a2499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:53.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.217+0000 7fa93a2499c0 20 searching for the correct realm 2024-09-12T18:25:53.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.221+0000 7fa93754e640 0 -- 172.21.15.97:0/735580938 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fa92011d450 msgr2=0x7fa9200f6cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:25:53.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.229+0000 7fa93754e640 0 -- 172.21.15.97:0/735580938 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x56120b1ab030 msgr2=0x56120b1ad4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:53.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:53.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:53.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:53.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:53.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:53.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:53.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:53.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:53.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 zone default found 2024-09-12T18:25:53.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 4 Realm: () 2024-09-12T18:25:53.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:53.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:53.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:53.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 zonegroup default 2024-09-12T18:25:53.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.237+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.241+0000 7fa93a2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.241+0000 7fa93a2499c0 20 started sync module instance, tier type = 2024-09-12T18:25:53.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.241+0000 7fa93a2499c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:53.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.257+0000 7fa93a2499c0 20 add_watcher() i=0 2024-09-12T18:25:53.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.257+0000 7fa93a2499c0 20 add_watcher() i=1 2024-09-12T18:25:53.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.257+0000 7fa93a2499c0 20 add_watcher() i=2 2024-09-12T18:25:53.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.257+0000 7fa93a2499c0 20 add_watcher() i=3 2024-09-12T18:25:53.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.257+0000 7fa93a2499c0 20 add_watcher() i=4 2024-09-12T18:25:53.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.257+0000 7fa93a2499c0 20 add_watcher() i=5 2024-09-12T18:25:53.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.257+0000 7fa93a2499c0 20 add_watcher() i=6 2024-09-12T18:25:53.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.261+0000 7fa93a2499c0 20 add_watcher() i=7 2024-09-12T18:25:53.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.261+0000 7fa93a2499c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:53.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa7edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:53.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa93a2499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:53.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa93a2499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:53.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa93a2499c0 5 note: GC not initialized 2024-09-12T18:25:53.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa7ecfe1640 20 reqs_thread_entry: start 2024-09-12T18:25:53.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa93a2499c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:53.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa93a2499c0 20 Filter name: none 2024-09-12T18:25:53.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa7667fc640 20 reqs_thread_entry: start 2024-09-12T18:25:53.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa93a2499c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T18:25:53.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa93a2499c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa93a2499c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T18:25:53.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa93a2499c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T18:25:53.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa93a2499c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:25:53.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.265+0000 7fa93a2499c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:25:53.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.269+0000 7fa93a2499c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:25:53.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.269+0000 7fa93a2499c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:25:53.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.269+0000 7fa93a2499c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T18:25:53.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.269+0000 7fa816ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366391 cookie 94635495749184 notifier 8507 bl.length()=659 2024-09-12T18:25:53.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.269+0000 7fa816ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:25:53.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.269+0000 7fa816ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:25:53.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.273+0000 7fa7edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:53.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.277+0000 7fa93a2499c0 20 remove_watcher() i=0 2024-09-12T18:25:53.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.277+0000 7fa93a2499c0 2 removed watcher, disabling cache 2024-09-12T18:25:53.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.277+0000 7fa93a2499c0 20 remove_watcher() i=1 2024-09-12T18:25:53.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.281+0000 7fa93a2499c0 20 remove_watcher() i=2 2024-09-12T18:25:53.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.281+0000 7fa93a2499c0 20 remove_watcher() i=3 2024-09-12T18:25:53.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.285+0000 7fa93a2499c0 20 remove_watcher() i=4 2024-09-12T18:25:53.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.285+0000 7fa93a2499c0 20 remove_watcher() i=5 2024-09-12T18:25:53.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.289+0000 7fa93a2499c0 20 remove_watcher() i=6 2024-09-12T18:25:53.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.293+0000 7fa93a2499c0 20 remove_watcher() i=7 2024-09-12T18:25:53.311 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T18:25:53.348 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:53.348 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:53.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.381+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.385+0000 7f6edb1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.385+0000 7f6edb1b09c0 20 realm 2024-09-12T18:25:53.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.385+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.385+0000 7f6edb1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.385+0000 7f6edb1b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:53.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.385+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.385+0000 7f6edb1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.385+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.385+0000 7f6edb1b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:53.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.385+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.389+0000 7f6edb1b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:53.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.389+0000 7f6edb1b09c0 20 searching for the correct realm 2024-09-12T18:25:53.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.393+0000 7f6ed8cb6640 0 -- 172.21.15.97:0/1003528924 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x563ecba68b10 msgr2=0x563ecba6af60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:53.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.401+0000 7f6ed3fff640 0 -- 172.21.15.97:0/1003528924 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x563ecba68b10 msgr2=0x7f6da4086090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:53.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.649+0000 7f6edb1b09c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:53.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.649+0000 7f6edb1b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:53.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.649+0000 7f6edb1b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:53.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.649+0000 7f6edb1b09c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:53.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.649+0000 7f6edb1b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:53.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.649+0000 7f6edb1b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:53.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.649+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.653+0000 7f6edb1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.653+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:53.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:53.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 zone default found 2024-09-12T18:25:53.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 4 Realm: () 2024-09-12T18:25:53.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:53.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:53.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:53.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 zonegroup default 2024-09-12T18:25:53.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 started sync module instance, tier type = 2024-09-12T18:25:53.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.657+0000 7f6edb1b09c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:53.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.681+0000 7f6edb1b09c0 20 add_watcher() i=0 2024-09-12T18:25:53.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.681+0000 7f6edb1b09c0 20 add_watcher() i=1 2024-09-12T18:25:53.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.681+0000 7f6edb1b09c0 20 add_watcher() i=2 2024-09-12T18:25:53.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.681+0000 7f6edb1b09c0 20 add_watcher() i=3 2024-09-12T18:25:53.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.681+0000 7f6edb1b09c0 20 add_watcher() i=4 2024-09-12T18:25:53.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.681+0000 7f6edb1b09c0 20 add_watcher() i=5 2024-09-12T18:25:53.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.681+0000 7f6edb1b09c0 20 add_watcher() i=6 2024-09-12T18:25:53.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.685+0000 7f6edb1b09c0 20 add_watcher() i=7 2024-09-12T18:25:53.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.685+0000 7f6edb1b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:53.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.689+0000 7f6d8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:53.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.689+0000 7f6edb1b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:53.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.689+0000 7f6edb1b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:53.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.689+0000 7f6edb1b09c0 5 note: GC not initialized 2024-09-12T18:25:53.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.689+0000 7f6d8dfe3640 20 reqs_thread_entry: start 2024-09-12T18:25:53.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.689+0000 7f6edb1b09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:53.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.689+0000 7f6edb1b09c0 20 Filter name: none 2024-09-12T18:25:53.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6cff7fe640 20 reqs_thread_entry: start 2024-09-12T18:25:53.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T18:25:53.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T18:25:53.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T18:25:53.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T18:25:53.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T18:25:53.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T18:25:53.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T18:25:53.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T18:25:53.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T18:25:53.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T18:25:53.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.693+0000 7f6edb1b09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T18:25:53.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.697+0000 7f6daffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333688 cookie 94827704672560 notifier 8525 bl.length()=389 2024-09-12T18:25:53.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.697+0000 7f6daffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T18:25:53.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.697+0000 7f6daffff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T18:25:53.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.701+0000 7f6edb1b09c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T18:25:53.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.701+0000 7f6edb1b09c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T18:25:53.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.701+0000 7f6edb1b09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T18:25:53.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.701+0000 7f6daf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333689 cookie 94827704684304 notifier 8525 bl.length()=230 2024-09-12T18:25:53.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.701+0000 7f6daf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T18:25:53.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.701+0000 7f6daf7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T18:25:53.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.705+0000 7f6edb1b09c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T18:25:53.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.705+0000 7f6edb1b09c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T18:25:53.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.705+0000 7f6edb1b09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T18:25:53.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.705+0000 7f6daf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333557 cookie 94827704653968 notifier 8525 bl.length()=234 2024-09-12T18:25:53.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.705+0000 7f6daf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T18:25:53.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.705+0000 7f6daf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T18:25:53.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.709+0000 7f6d8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:53.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.713+0000 7f6edb1b09c0 20 remove_watcher() i=0 2024-09-12T18:25:53.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.713+0000 7f6edb1b09c0 2 removed watcher, disabling cache 2024-09-12T18:25:53.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.717+0000 7f6edb1b09c0 20 remove_watcher() i=1 2024-09-12T18:25:53.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.717+0000 7f6edb1b09c0 20 remove_watcher() i=2 2024-09-12T18:25:53.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.721+0000 7f6edb1b09c0 20 remove_watcher() i=3 2024-09-12T18:25:53.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.721+0000 7f6edb1b09c0 20 remove_watcher() i=4 2024-09-12T18:25:53.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.725+0000 7f6edb1b09c0 20 remove_watcher() i=5 2024-09-12T18:25:53.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.725+0000 7f6edb1b09c0 20 remove_watcher() i=6 2024-09-12T18:25:53.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.729+0000 7f6edb1b09c0 20 remove_watcher() i=7 2024-09-12T18:25:53.749 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:25:53.749 INFO:teuthology.orchestra.run.smithi097.stdout: "id": "RGW33333333333333333", 2024-09-12T18:25:53.749 INFO:teuthology.orchestra.run.smithi097.stdout: "tenant": "testx", 2024-09-12T18:25:53.749 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T18:25:53.749 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "quota": { 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:53.750 INFO:teuthology.orchestra.run.smithi097.stdout: "max_users": 1000, 2024-09-12T18:25:53.751 INFO:teuthology.orchestra.run.smithi097.stdout: "max_roles": 1000, 2024-09-12T18:25:53.751 INFO:teuthology.orchestra.run.smithi097.stdout: "max_groups": 1000, 2024-09-12T18:25:53.751 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:25:53.751 INFO:teuthology.orchestra.run.smithi097.stdout: "max_access_keys": 4 2024-09-12T18:25:53.751 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:25:53.752 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T18:25:53.753 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key BAQNDFDCDXZLDIQXMPMM --secret /kZ4J7DTpHCLkfpVRETD25IfDRKvU7S0spD38dcusIL/wwKdMemcWw== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T18:25:53.845 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:53.845 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:53.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.881+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.885+0000 7f8f2d72f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.885+0000 7f8f2d72f9c0 20 realm 2024-09-12T18:25:53.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.885+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.885+0000 7f8f2d72f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.885+0000 7f8f2d72f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:53.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.885+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.885+0000 7f8f2d72f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.885+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.885+0000 7f8f2d72f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:53.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.885+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.889+0000 7f8f2d72f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:53.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.889+0000 7f8f2d72f9c0 20 searching for the correct realm 2024-09-12T18:25:53.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.893+0000 7f8f2ba36640 0 -- 172.21.15.97:0/1093064745 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f8f200eec20 msgr2=0x7f8f200f41b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:53.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.901+0000 7f8f2b235640 0 -- 172.21.15.97:0/1093064745 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f8f1c060b30 msgr2=0x7f8f1c05f5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:53.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.905+0000 7f8f2d72f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:53.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.905+0000 7f8f2d72f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:53.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.905+0000 7f8f2d72f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:53.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.905+0000 7f8f2d72f9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:53.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.905+0000 7f8f2d72f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:53.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.905+0000 7f8f2d72f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:53.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.905+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 zone default found 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 4 Realm: () 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 zonegroup default 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 started sync module instance, tier type = 2024-09-12T18:25:53.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.909+0000 7f8f2d72f9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:53.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.929+0000 7f8f2d72f9c0 20 add_watcher() i=0 2024-09-12T18:25:53.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.929+0000 7f8f2d72f9c0 20 add_watcher() i=1 2024-09-12T18:25:53.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.929+0000 7f8f2d72f9c0 20 add_watcher() i=2 2024-09-12T18:25:53.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.929+0000 7f8f2d72f9c0 20 add_watcher() i=3 2024-09-12T18:25:53.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.929+0000 7f8f2d72f9c0 20 add_watcher() i=4 2024-09-12T18:25:53.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.929+0000 7f8f2d72f9c0 20 add_watcher() i=5 2024-09-12T18:25:53.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.929+0000 7f8f2d72f9c0 20 add_watcher() i=6 2024-09-12T18:25:53.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.929+0000 7f8f2d72f9c0 20 add_watcher() i=7 2024-09-12T18:25:53.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.929+0000 7f8f2d72f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.933+0000 7f8de1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.933+0000 7f8f2d72f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.933+0000 7f8f2d72f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.933+0000 7f8f2d72f9c0 5 note: GC not initialized 2024-09-12T18:25:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.933+0000 7f8de0fe1640 20 reqs_thread_entry: start 2024-09-12T18:25:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.933+0000 7f8f2d72f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.933+0000 7f8f2d72f9c0 20 Filter name: none 2024-09-12T18:25:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.933+0000 7f8d5a7fc640 20 reqs_thread_entry: start 2024-09-12T18:25:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.933+0000 7f8f2d72f9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T18:25:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.933+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T18:25:53.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:25:53.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T18:25:53.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T18:25:53.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:25:53.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 cache get: name=default.rgw.meta+users.keys+BAQNDFDCDXZLDIQXMPMM : miss 2024-09-12T18:25:53.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:53.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 cache put: name=default.rgw.meta+users.keys+BAQNDFDCDXZLDIQXMPMM info.flags=0x0 2024-09-12T18:25:53.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 adding default.rgw.meta+users.keys+BAQNDFDCDXZLDIQXMPMM to cache LRU end 2024-09-12T18:25:53.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T18:25:53.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:53.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:25:53.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T18:25:53.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T18:25:53.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:25:53.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 cache get: name=default.rgw.meta+users.keys+BAQNDFDCDXZLDIQXMPMM : hit (negative entry) 2024-09-12T18:25:53.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.937+0000 7f8f2d72f9c0 10 cache get: name=default.rgw.meta+users.keys+BAQNDFDCDXZLDIQXMPMM : hit (negative entry) 2024-09-12T18:25:53.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.941+0000 7f8f2d72f9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:25:53.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.941+0000 7f8f2d72f9c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:25:53.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.941+0000 7f8f2d72f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T18:25:53.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.941+0000 7f8e0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333691 cookie 94661291397328 notifier 9153 bl.length()=732 2024-09-12T18:25:53.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.941+0000 7f8e0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:25:53.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.941+0000 7f8e0effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:25:53.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.945+0000 7f8f2d72f9c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T18:25:53.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.945+0000 7f8f2d72f9c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:25:53.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.945+0000 7f8f2d72f9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T18:25:53.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.949+0000 7f8e0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333692 cookie 94661291400928 notifier 9153 bl.length()=215 2024-09-12T18:25:53.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.949+0000 7f8e0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T18:25:53.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.949+0000 7f8e0effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:25:53.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.953+0000 7f8f2d72f9c0 10 cache put: name=default.rgw.meta+users.keys+BAQNDFDCDXZLDIQXMPMM info.flags=0x7 2024-09-12T18:25:53.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.953+0000 7f8f2d72f9c0 10 moving default.rgw.meta+users.keys+BAQNDFDCDXZLDIQXMPMM to cache LRU end 2024-09-12T18:25:53.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.953+0000 7f8f2d72f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:BAQNDFDCDXZLDIQXMPMM, ofs0, ns] 2024-09-12T18:25:53.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.953+0000 7f8e0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333690 cookie 94661291379360 notifier 9153 bl.length()=201 2024-09-12T18:25:53.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.953+0000 7f8e0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BAQNDFDCDXZLDIQXMPMM info.flags=0x7 2024-09-12T18:25:53.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.953+0000 7f8e0e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BAQNDFDCDXZLDIQXMPMM to cache LRU end 2024-09-12T18:25:53.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.957+0000 7f8f2d72f9c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "BAQNDFDCDXZLDIQXMPMM", 2024-09-12T18:25:53.962 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "/kZ4J7DTpHCLkfpVRETD25IfDRKvU7S0spD38dcusIL/wwKdMemcWw==", 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:53.942285Z" 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:53.963 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:53.964 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:53.964 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:53.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:53.964 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-12T18:25:53.964 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:53.964 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:53.964 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:53.964 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:53.964 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:53.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:53.965 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-12T18:25:53.965 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "root", 2024-09-12T18:25:53.965 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-12T18:25:53.965 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "RGW33333333333333333", 2024-09-12T18:25:53.965 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-12T18:25:53.965 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:53.942267Z", 2024-09-12T18:25:53.965 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-12T18:25:53.965 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-12T18:25:53.965 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:25:53.966 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:53.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.957+0000 7f8de1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:53.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.961+0000 7f8f2d72f9c0 20 remove_watcher() i=0 2024-09-12T18:25:53.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.961+0000 7f8f2d72f9c0 2 removed watcher, disabling cache 2024-09-12T18:25:53.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.965+0000 7f8f2d72f9c0 20 remove_watcher() i=1 2024-09-12T18:25:53.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.965+0000 7f8f2d72f9c0 20 remove_watcher() i=2 2024-09-12T18:25:53.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.969+0000 7f8f2d72f9c0 20 remove_watcher() i=3 2024-09-12T18:25:53.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.969+0000 7f8f2d72f9c0 20 remove_watcher() i=4 2024-09-12T18:25:53.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.973+0000 7f8f2d72f9c0 20 remove_watcher() i=5 2024-09-12T18:25:53.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.973+0000 7f8f2d72f9c0 20 remove_watcher() i=6 2024-09-12T18:25:53.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:53.977+0000 7f8f2d72f9c0 20 remove_watcher() i=7 2024-09-12T18:25:53.998 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 3332911601 --totp-seed 4P43D7ERBLBU3IE6JITGDIZVI5CEPTQLTUA54EYS2CT7JMB3FMZ6C4YV4PYIVELG --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:25:54.039 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:54.039 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:54.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.076+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.076+0000 7f4663f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.076+0000 7f4663f359c0 20 realm 2024-09-12T18:25:54.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.076+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.076+0000 7f4663f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.076+0000 7f4663f359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:54.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.076+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.076+0000 7f4663f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.076+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.080+0000 7f4663f359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:54.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.080+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.080+0000 7f4663f359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:54.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.080+0000 7f4663f359c0 20 searching for the correct realm 2024-09-12T18:25:54.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.088+0000 7f4661a3b640 0 -- 172.21.15.97:0/2203730236 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f46540ca020 msgr2=0x7f46540f8290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:54.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.092+0000 7f4661a3b640 0 -- 172.21.15.97:0/2203730236 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f465c028020 msgr2=0x7f465c060a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:54.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:54.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:54.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:54.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:54.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:54.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:54.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:54.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 zone default found 2024-09-12T18:25:54.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 4 Realm: () 2024-09-12T18:25:54.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:54.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:54.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:54.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 zonegroup default 2024-09-12T18:25:54.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.100+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.104+0000 7f4663f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.104+0000 7f4663f359c0 20 started sync module instance, tier type = 2024-09-12T18:25:54.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.104+0000 7f4663f359c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:54.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.120+0000 7f4663f359c0 20 add_watcher() i=0 2024-09-12T18:25:54.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.120+0000 7f4663f359c0 20 add_watcher() i=1 2024-09-12T18:25:54.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.120+0000 7f4663f359c0 20 add_watcher() i=2 2024-09-12T18:25:54.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.120+0000 7f4663f359c0 20 add_watcher() i=3 2024-09-12T18:25:54.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.120+0000 7f4663f359c0 20 add_watcher() i=4 2024-09-12T18:25:54.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.120+0000 7f4663f359c0 20 add_watcher() i=5 2024-09-12T18:25:54.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.120+0000 7f4663f359c0 20 add_watcher() i=6 2024-09-12T18:25:54.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.124+0000 7f4663f359c0 20 add_watcher() i=7 2024-09-12T18:25:54.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.124+0000 7f4663f359c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:54.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4517fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:54.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4663f359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:54.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4663f359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:54.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4663f359c0 5 note: GC not initialized 2024-09-12T18:25:54.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4516fe5640 20 reqs_thread_entry: start 2024-09-12T18:25:54.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4663f359c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:54.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4663f359c0 20 Filter name: none 2024-09-12T18:25:54.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4514fe1640 20 reqs_thread_entry: start 2024-09-12T18:25:54.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4663f359c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T18:25:54.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4663f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4663f359c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T18:25:54.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4663f359c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T18:25:54.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4663f359c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:25:54.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.128+0000 7f4663f359c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:25:54.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.136+0000 7f4663f359c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:25:54.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.136+0000 7f4663f359c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:25:54.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.136+0000 7f4663f359c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T18:25:54.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.136+0000 7f45457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333693 cookie 94300989520032 notifier 9171 bl.length()=746 2024-09-12T18:25:54.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.136+0000 7f45457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:25:54.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.136+0000 7f45457fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:25:54.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.140+0000 7f4517fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:54.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.144+0000 7f4663f359c0 20 remove_watcher() i=0 2024-09-12T18:25:54.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.144+0000 7f4663f359c0 2 removed watcher, disabling cache 2024-09-12T18:25:54.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.144+0000 7f4663f359c0 20 remove_watcher() i=1 2024-09-12T18:25:54.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.148+0000 7f4663f359c0 20 remove_watcher() i=2 2024-09-12T18:25:54.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.148+0000 7f4663f359c0 20 remove_watcher() i=3 2024-09-12T18:25:54.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.152+0000 7f4663f359c0 20 remove_watcher() i=4 2024-09-12T18:25:54.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.152+0000 7f4663f359c0 20 remove_watcher() i=5 2024-09-12T18:25:54.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.156+0000 7f4663f359c0 20 remove_watcher() i=6 2024-09-12T18:25:54.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.160+0000 7f4663f359c0 20 remove_watcher() i=7 2024-09-12T18:25:54.180 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T18:25:54.180 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key SBEMUOZQDGXSDFGTZGNF --secret qDR/L3gC8AqiDP6yecZQIhFUUI6yQNCuoot7lmCyfGouun8fmh64cw== --cluster ceph 2024-09-12T18:25:54.264 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:54.264 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:54.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.300+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.304+0000 7f83ab3e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.304+0000 7f83ab3e79c0 20 realm 2024-09-12T18:25:54.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.304+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.304+0000 7f83ab3e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.304+0000 7f83ab3e79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:54.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.304+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.304+0000 7f83ab3e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.304+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.304+0000 7f83ab3e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:54.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.304+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.308+0000 7f83ab3e79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:54.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.308+0000 7f83ab3e79c0 20 searching for the correct realm 2024-09-12T18:25:54.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.312+0000 7f83a86ec640 0 -- 172.21.15.97:0/1816104078 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f83900f6ec0 msgr2=0x7f83900ff040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:54.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.528+0000 7f83a96ee640 0 -- 172.21.15.97:0/1816104078 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5591546759b0 msgr2=0x559154677e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:54.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.540+0000 7f83ab3e79c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:54.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.540+0000 7f83ab3e79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:54.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.540+0000 7f83ab3e79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:54.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.540+0000 7f83ab3e79c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:54.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.540+0000 7f83ab3e79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:54.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.540+0000 7f83ab3e79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:54.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.540+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.540+0000 7f83ab3e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.540+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.540+0000 7f83ab3e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:54.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.540+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:54.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 20 zone default found 2024-09-12T18:25:54.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 4 Realm: () 2024-09-12T18:25:54.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:54.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:54.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:54.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 20 zonegroup default 2024-09-12T18:25:54.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 20 started sync module instance, tier type = 2024-09-12T18:25:54.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.544+0000 7f83ab3e79c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:54.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.568+0000 7f83ab3e79c0 20 add_watcher() i=0 2024-09-12T18:25:54.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.568+0000 7f83ab3e79c0 20 add_watcher() i=1 2024-09-12T18:25:54.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.568+0000 7f83ab3e79c0 20 add_watcher() i=2 2024-09-12T18:25:54.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.568+0000 7f83ab3e79c0 20 add_watcher() i=3 2024-09-12T18:25:54.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.568+0000 7f83ab3e79c0 20 add_watcher() i=4 2024-09-12T18:25:54.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.568+0000 7f83ab3e79c0 20 add_watcher() i=5 2024-09-12T18:25:54.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.568+0000 7f83ab3e79c0 20 add_watcher() i=6 2024-09-12T18:25:54.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.572+0000 7f83ab3e79c0 20 add_watcher() i=7 2024-09-12T18:25:54.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.572+0000 7f83ab3e79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:54.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.576+0000 7f825efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:54.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.576+0000 7f83ab3e79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:54.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.576+0000 7f83ab3e79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:54.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.576+0000 7f83ab3e79c0 5 note: GC not initialized 2024-09-12T18:25:54.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.576+0000 7f825dfe3640 20 reqs_thread_entry: start 2024-09-12T18:25:54.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:54.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 20 Filter name: none 2024-09-12T18:25:54.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f81cf7fe640 20 reqs_thread_entry: start 2024-09-12T18:25:54.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:25:54.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T18:25:54.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:25:54.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T18:25:54.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T18:25:54.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:25:54.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 10 cache get: name=default.rgw.meta+users.keys+SBEMUOZQDGXSDFGTZGNF : miss 2024-09-12T18:25:54.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 10 cache put: name=default.rgw.meta+users.keys+SBEMUOZQDGXSDFGTZGNF info.flags=0x0 2024-09-12T18:25:54.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 10 adding default.rgw.meta+users.keys+SBEMUOZQDGXSDFGTZGNF to cache LRU end 2024-09-12T18:25:54.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 10 cache get: name=default.rgw.meta+users.keys+SBEMUOZQDGXSDFGTZGNF : hit (negative entry) 2024-09-12T18:25:54.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.580+0000 7f83ab3e79c0 10 cache get: name=default.rgw.meta+users.keys+SBEMUOZQDGXSDFGTZGNF : hit (negative entry) 2024-09-12T18:25:54.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.584+0000 7f83ab3e79c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:25:54.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.584+0000 7f83ab3e79c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:25:54.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.584+0000 7f83ab3e79c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:25:54.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.584+0000 7f827ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333694 cookie 94082674749888 notifier 9189 bl.length()=660 2024-09-12T18:25:54.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.584+0000 7f827ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:25:54.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.584+0000 7f827ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:25:54.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.588+0000 7f83ab3e79c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T18:25:54.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.588+0000 7f83ab3e79c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:25:54.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.588+0000 7f83ab3e79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T18:25:54.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.588+0000 7f827f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333691 cookie 94082674731504 notifier 9189 bl.length()=191 2024-09-12T18:25:54.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.588+0000 7f827f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T18:25:54.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.588+0000 7f827f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:25:54.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.592+0000 7f83ab3e79c0 10 cache put: name=default.rgw.meta+users.keys+SBEMUOZQDGXSDFGTZGNF info.flags=0x7 2024-09-12T18:25:54.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.592+0000 7f83ab3e79c0 10 moving default.rgw.meta+users.keys+SBEMUOZQDGXSDFGTZGNF to cache LRU end 2024-09-12T18:25:54.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.592+0000 7f83ab3e79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:SBEMUOZQDGXSDFGTZGNF, ofs0, ns] 2024-09-12T18:25:54.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.596+0000 7f827f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333558 cookie 94082674732816 notifier 9189 bl.length()=189 2024-09-12T18:25:54.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.596+0000 7f827f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SBEMUOZQDGXSDFGTZGNF info.flags=0x7 2024-09-12T18:25:54.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.596+0000 7f827f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SBEMUOZQDGXSDFGTZGNF to cache LRU end 2024-09-12T18:25:54.603 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:25:54.603 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "foobar.client.0", 2024-09-12T18:25:54.603 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T18:25:54.603 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "foobar+test@test.test", 2024-09-12T18:25:54.603 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-12T18:25:54.603 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:25:54.603 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-12T18:25:54.603 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-12T18:25:54.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T18:25:54.603 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "foobar.client.0", 2024-09-12T18:25:54.604 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "SBEMUOZQDGXSDFGTZGNF", 2024-09-12T18:25:54.604 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "qDR/L3gC8AqiDP6yecZQIhFUUI6yQNCuoot7lmCyfGouun8fmh64cw==", 2024-09-12T18:25:54.604 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-12T18:25:54.604 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:54.586575Z" 2024-09-12T18:25:54.604 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-12T18:25:54.604 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T18:25:54.604 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-12T18:25:54.604 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-12T18:25:54.605 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T18:25:54.605 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-12T18:25:54.605 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-12T18:25:54.605 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-12T18:25:54.605 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:25:54.605 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:54.605 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:54.605 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:54.605 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:54.605 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-12T18:25:54.606 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-12T18:25:54.607 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-12T18:25:54.607 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:54.586544Z", 2024-09-12T18:25:54.607 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-12T18:25:54.607 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-12T18:25:54.607 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:25:54.607 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:54.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.600+0000 7f825efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:54.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.604+0000 7f83ab3e79c0 20 remove_watcher() i=0 2024-09-12T18:25:54.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.604+0000 7f83ab3e79c0 2 removed watcher, disabling cache 2024-09-12T18:25:54.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.604+0000 7f83ab3e79c0 20 remove_watcher() i=1 2024-09-12T18:25:54.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.608+0000 7f83ab3e79c0 20 remove_watcher() i=2 2024-09-12T18:25:54.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.612+0000 7f83ab3e79c0 20 remove_watcher() i=3 2024-09-12T18:25:54.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.612+0000 7f83ab3e79c0 20 remove_watcher() i=4 2024-09-12T18:25:54.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.616+0000 7f83ab3e79c0 20 remove_watcher() i=5 2024-09-12T18:25:54.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.620+0000 7f83ab3e79c0 20 remove_watcher() i=6 2024-09-12T18:25:54.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.620+0000 7f83ab3e79c0 20 remove_watcher() i=7 2024-09-12T18:25:54.644 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 5486158844 --totp-seed MMSSBO46NWKFHIZX2MK4WDBT6J5JV22XQDW45I4VCNNJRQM7QX7AKT3F4LQUXBJR --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:25:54.732 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:54.733 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:54.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.764+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.768+0000 7f720683a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.768+0000 7f720683a9c0 20 realm 2024-09-12T18:25:54.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.768+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.768+0000 7f720683a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.768+0000 7f720683a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:54.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.768+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.768+0000 7f720683a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:54.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.768+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.768+0000 7f720683a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:54.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.768+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:54.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.772+0000 7f720683a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:54.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.772+0000 7f720683a9c0 20 searching for the correct realm 2024-09-12T18:25:54.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.776+0000 7f7203b3f640 0 -- 172.21.15.97:0/2679072730 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f71f80eab80 msgr2=0x7f71f80fa1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:54.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:54.992+0000 7f7204b41640 0 -- 172.21.15.97:0/2679072730 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x565065b93b60 msgr2=0x565065b95ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:55.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:55.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:55.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 zone default found 2024-09-12T18:25:55.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 4 Realm: () 2024-09-12T18:25:55.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:55.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:55.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:55.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 zonegroup default 2024-09-12T18:25:55.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.004+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.008+0000 7f720683a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.008+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.008+0000 7f720683a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.008+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.008+0000 7f720683a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.008+0000 7f720683a9c0 20 started sync module instance, tier type = 2024-09-12T18:25:55.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.008+0000 7f720683a9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:55.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.032+0000 7f720683a9c0 20 add_watcher() i=0 2024-09-12T18:25:55.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.032+0000 7f720683a9c0 20 add_watcher() i=1 2024-09-12T18:25:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.032+0000 7f720683a9c0 20 add_watcher() i=2 2024-09-12T18:25:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.032+0000 7f720683a9c0 20 add_watcher() i=3 2024-09-12T18:25:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.032+0000 7f720683a9c0 20 add_watcher() i=4 2024-09-12T18:25:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.032+0000 7f720683a9c0 20 add_watcher() i=5 2024-09-12T18:25:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.032+0000 7f720683a9c0 20 add_watcher() i=6 2024-09-12T18:25:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.032+0000 7f720683a9c0 20 add_watcher() i=7 2024-09-12T18:25:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.032+0000 7f720683a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.036+0000 7f70ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.036+0000 7f720683a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.036+0000 7f720683a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.036+0000 7f720683a9c0 5 note: GC not initialized 2024-09-12T18:25:55.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.040+0000 7f70b97e2640 20 reqs_thread_entry: start 2024-09-12T18:25:55.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.040+0000 7f720683a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:55.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.040+0000 7f720683a9c0 20 Filter name: none 2024-09-12T18:25:55.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.040+0000 7f720683a9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:25:55.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.040+0000 7f702affd640 20 reqs_thread_entry: start 2024-09-12T18:25:55.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.040+0000 7f720683a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.040+0000 7f720683a9c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T18:25:55.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.040+0000 7f720683a9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T18:25:55.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.040+0000 7f720683a9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:25:55.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.040+0000 7f720683a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:25:55.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.044+0000 7f720683a9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:25:55.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.044+0000 7f720683a9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:25:55.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.044+0000 7f720683a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:25:55.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.044+0000 7f70e37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333695 cookie 94903304080688 notifier 8594 bl.length()=674 2024-09-12T18:25:55.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.044+0000 7f70e37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:25:55.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.044+0000 7f70e37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:25:55.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.048+0000 7f70ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:55.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.052+0000 7f720683a9c0 20 remove_watcher() i=0 2024-09-12T18:25:55.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.052+0000 7f720683a9c0 2 removed watcher, disabling cache 2024-09-12T18:25:55.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.056+0000 7f720683a9c0 20 remove_watcher() i=1 2024-09-12T18:25:55.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.060+0000 7f720683a9c0 20 remove_watcher() i=2 2024-09-12T18:25:55.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.060+0000 7f720683a9c0 20 remove_watcher() i=3 2024-09-12T18:25:55.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.064+0000 7f720683a9c0 20 remove_watcher() i=4 2024-09-12T18:25:55.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.064+0000 7f720683a9c0 20 remove_watcher() i=5 2024-09-12T18:25:55.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.068+0000 7f720683a9c0 20 remove_watcher() i=6 2024-09-12T18:25:55.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.068+0000 7f720683a9c0 20 remove_watcher() i=7 2024-09-12T18:25:55.092 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T18:25:55.126 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:55.126 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:55.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.160+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.164+0000 7fec655719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.164+0000 7fec655719c0 20 realm 2024-09-12T18:25:55.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.164+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.164+0000 7fec655719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.164+0000 7fec655719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:55.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.164+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.164+0000 7fec655719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.164+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.164+0000 7fec655719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:55.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.164+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.168+0000 7fec655719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:55.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.168+0000 7fec655719c0 20 searching for the correct realm 2024-09-12T18:25:55.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.172+0000 7fec63878640 0 -- 172.21.15.97:0/3314080567 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fec58028020 msgr2=0x7fec5805d710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.380+0000 7fec63077640 0 -- 172.21.15.97:0/3314080567 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fec5c0a9070 msgr2=0x7fec5c1150b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:55.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.396+0000 7fec655719c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:55.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.396+0000 7fec655719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:55.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.396+0000 7fec655719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:55.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.396+0000 7fec655719c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:55.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.396+0000 7fec655719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:55.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.396+0000 7fec655719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:55.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.396+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.396+0000 7fec655719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.396+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.396+0000 7fec655719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:55.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.396+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:55.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 20 zone default found 2024-09-12T18:25:55.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 4 Realm: () 2024-09-12T18:25:55.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:55.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:55.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:55.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 20 zonegroup default 2024-09-12T18:25:55.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 20 started sync module instance, tier type = 2024-09-12T18:25:55.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.400+0000 7fec655719c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:55.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.424+0000 7fec655719c0 20 add_watcher() i=0 2024-09-12T18:25:55.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.424+0000 7fec655719c0 20 add_watcher() i=1 2024-09-12T18:25:55.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.424+0000 7fec655719c0 20 add_watcher() i=2 2024-09-12T18:25:55.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.424+0000 7fec655719c0 20 add_watcher() i=3 2024-09-12T18:25:55.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.424+0000 7fec655719c0 20 add_watcher() i=4 2024-09-12T18:25:55.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.424+0000 7fec655719c0 20 add_watcher() i=5 2024-09-12T18:25:55.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.424+0000 7fec655719c0 20 add_watcher() i=6 2024-09-12T18:25:55.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.428+0000 7fec655719c0 20 add_watcher() i=7 2024-09-12T18:25:55.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.428+0000 7fec655719c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:55.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.432+0000 7feb19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:55.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.432+0000 7fec655719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:55.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.432+0000 7fec655719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:55.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.432+0000 7fec655719c0 5 note: GC not initialized 2024-09-12T18:25:55.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.432+0000 7feb18fe1640 20 reqs_thread_entry: start 2024-09-12T18:25:55.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.432+0000 7fec655719c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:55.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.432+0000 7fec655719c0 20 Filter name: none 2024-09-12T18:25:55.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.432+0000 7fea927fc640 20 reqs_thread_entry: start 2024-09-12T18:25:55.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.432+0000 7fec655719c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:25:55.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.432+0000 7fec655719c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.436+0000 7fec655719c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T18:25:55.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.436+0000 7fec655719c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T18:25:55.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.436+0000 7fec655719c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:25:55.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.436+0000 7fec655719c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:25:55.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.440+0000 7fec655719c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:25:55.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.440+0000 7fec655719c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:25:55.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.440+0000 7fec655719c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:25:55.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.440+0000 7feb46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333696 cookie 93998065968560 notifier 9219 bl.length()=727 2024-09-12T18:25:55.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.440+0000 7feb46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:25:55.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.440+0000 7feb46ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:25:55.449 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:25:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "foobar.client.0", 2024-09-12T18:25:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T18:25:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "foobar+test@test.test", 2024-09-12T18:25:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-12T18:25:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:25:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-12T18:25:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-12T18:25:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T18:25:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "foobar.client.0", 2024-09-12T18:25:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "SBEMUOZQDGXSDFGTZGNF", 2024-09-12T18:25:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "qDR/L3gC8AqiDP6yecZQIhFUUI6yQNCuoot7lmCyfGouun8fmh64cw==", 2024-09-12T18:25:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-12T18:25:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:54.586575Z" 2024-09-12T18:25:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-12T18:25:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T18:25:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-12T18:25:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [ 2024-09-12T18:25:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "oidc-provider", 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "perm": "*" 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "roles", 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "perm": "*" 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "user-policy", 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "perm": "*" 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T18:25:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-12T18:25:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-12T18:25:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [ 2024-09-12T18:25:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "5486158844" 2024-09-12T18:25:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T18:25:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-12T18:25:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-12T18:25:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:54.586544Z", 2024-09-12T18:25:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-12T18:25:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-12T18:25:55.454 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:25:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:55.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.444+0000 7feb19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:55.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.448+0000 7fec655719c0 20 remove_watcher() i=0 2024-09-12T18:25:55.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.448+0000 7fec655719c0 2 removed watcher, disabling cache 2024-09-12T18:25:55.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.452+0000 7fec655719c0 20 remove_watcher() i=1 2024-09-12T18:25:55.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.452+0000 7fec655719c0 20 remove_watcher() i=2 2024-09-12T18:25:55.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.456+0000 7fec655719c0 20 remove_watcher() i=3 2024-09-12T18:25:55.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.456+0000 7fec655719c0 20 remove_watcher() i=4 2024-09-12T18:25:55.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.460+0000 7fec655719c0 20 remove_watcher() i=5 2024-09-12T18:25:55.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.460+0000 7fec655719c0 20 remove_watcher() i=6 2024-09-12T18:25:55.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.464+0000 7fec655719c0 20 remove_watcher() i=7 2024-09-12T18:25:55.485 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T18:25:55.569 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:55.569 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:55.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.604+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.608+0000 7fbbd55f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.608+0000 7fbbd55f69c0 20 realm 2024-09-12T18:25:55.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.608+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.608+0000 7fbbd55f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.608+0000 7fbbd55f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:55.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.608+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.608+0000 7fbbd55f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.608+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.608+0000 7fbbd55f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:55.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.608+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.612+0000 7fbbd55f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:55.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.612+0000 7fbbd55f69c0 20 searching for the correct realm 2024-09-12T18:25:55.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.616+0000 7fbbd38fd640 0 -- 172.21.15.97:0/3585397971 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fbbc803c070 msgr2=0x7fbbc80643c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:55.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.624+0000 7fbbd30fc640 0 -- 172.21.15.97:0/3585397971 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fbbc4033040 msgr2=0x7fbbc400a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:55.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.628+0000 7fbbd55f69c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:55.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.628+0000 7fbbd55f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:55.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.628+0000 7fbbd55f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:55.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.628+0000 7fbbd55f69c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:55.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.628+0000 7fbbd55f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:55.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.628+0000 7fbbd55f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:55.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.628+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.628+0000 7fbbd55f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.628+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:55.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:55.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 zone default found 2024-09-12T18:25:55.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 4 Realm: () 2024-09-12T18:25:55.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:55.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:55.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:55.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 zonegroup default 2024-09-12T18:25:55.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 started sync module instance, tier type = 2024-09-12T18:25:55.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.632+0000 7fbbd55f69c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:55.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.652+0000 7fbbd55f69c0 20 add_watcher() i=0 2024-09-12T18:25:55.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.652+0000 7fbbd55f69c0 20 add_watcher() i=1 2024-09-12T18:25:55.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.652+0000 7fbbd55f69c0 20 add_watcher() i=2 2024-09-12T18:25:55.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.652+0000 7fbbd55f69c0 20 add_watcher() i=3 2024-09-12T18:25:55.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.652+0000 7fbbd55f69c0 20 add_watcher() i=4 2024-09-12T18:25:55.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.652+0000 7fbbd55f69c0 20 add_watcher() i=5 2024-09-12T18:25:55.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.652+0000 7fbbd55f69c0 20 add_watcher() i=6 2024-09-12T18:25:55.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.652+0000 7fbbd55f69c0 20 add_watcher() i=7 2024-09-12T18:25:55.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.652+0000 7fbbd55f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:55.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.656+0000 7fba89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:55.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.656+0000 7fbbd55f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:55.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.656+0000 7fbbd55f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:55.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.656+0000 7fbbd55f69c0 5 note: GC not initialized 2024-09-12T18:25:55.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.656+0000 7fba88fe1640 20 reqs_thread_entry: start 2024-09-12T18:25:55.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.656+0000 7fbbd55f69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:55.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 20 Filter name: none 2024-09-12T18:25:55.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fba027fc640 20 reqs_thread_entry: start 2024-09-12T18:25:55.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T18:25:55.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T18:25:55.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:25:55.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T18:25:55.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T18:25:55.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T18:25:55.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:25:55.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.660+0000 7fbbd55f69c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T18:25:55.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.664+0000 7fbbd55f69c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:25:55.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.664+0000 7fbbd55f69c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:25:55.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.664+0000 7fbbd55f69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T18:25:55.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.664+0000 7fbab6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333692 cookie 93878832371488 notifier 8627 bl.length()=384 2024-09-12T18:25:55.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.664+0000 7fbab6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:25:55.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.664+0000 7fbab6ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:25:55.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.668+0000 7fbbd55f69c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T18:25:55.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.668+0000 7fbbd55f69c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:25:55.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.668+0000 7fbbd55f69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T18:25:55.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.668+0000 7fbab6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333693 cookie 93878832385984 notifier 8627 bl.length()=225 2024-09-12T18:25:55.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.668+0000 7fbab6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T18:25:55.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.668+0000 7fbab6ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:25:55.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.672+0000 7fbbd55f69c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T18:25:55.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.672+0000 7fbbd55f69c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:25:55.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.672+0000 7fbbd55f69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T18:25:55.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.672+0000 7fbab6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333559 cookie 93878832382384 notifier 8627 bl.length()=234 2024-09-12T18:25:55.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.672+0000 7fbab6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T18:25:55.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.672+0000 7fbab6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:25:55.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.676+0000 7fba89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:55.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.680+0000 7fbbd55f69c0 20 remove_watcher() i=0 2024-09-12T18:25:55.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.680+0000 7fbbd55f69c0 2 removed watcher, disabling cache 2024-09-12T18:25:55.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.684+0000 7fbbd55f69c0 20 remove_watcher() i=1 2024-09-12T18:25:55.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.684+0000 7fbbd55f69c0 20 remove_watcher() i=2 2024-09-12T18:25:55.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.688+0000 7fbbd55f69c0 20 remove_watcher() i=3 2024-09-12T18:25:55.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.688+0000 7fbbd55f69c0 20 remove_watcher() i=4 2024-09-12T18:25:55.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.692+0000 7fbbd55f69c0 20 remove_watcher() i=5 2024-09-12T18:25:55.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.696+0000 7fbbd55f69c0 20 remove_watcher() i=6 2024-09-12T18:25:55.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.696+0000 7fbbd55f69c0 20 remove_watcher() i=7 2024-09-12T18:25:55.715 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:25:55.716 INFO:teuthology.orchestra.run.smithi097.stdout: "id": "RGW88888888888888888", 2024-09-12T18:25:55.716 INFO:teuthology.orchestra.run.smithi097.stdout: "tenant": "", 2024-09-12T18:25:55.716 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T18:25:55.716 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T18:25:55.716 INFO:teuthology.orchestra.run.smithi097.stdout: "quota": { 2024-09-12T18:25:55.716 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:55.716 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:55.716 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:55.716 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "max_users": 1000, 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "max_roles": 1000, 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "max_groups": 1000, 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:25:55.717 INFO:teuthology.orchestra.run.smithi097.stdout: "max_access_keys": 4 2024-09-12T18:25:55.718 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:25:55.719 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T18:25:55.719 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key OETPOOJDKESTFGQIMUPQ --secret XwklwKeJLfR1ABOKSXPmrPn6zqg9286QwuBk0Jch22k8JbaKHXinYA== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T18:25:55.808 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:55.808 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:55.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.844+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 20 realm 2024-09-12T18:25:55.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:55.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:55.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.848+0000 7fa74a16a9c0 20 searching for the correct realm 2024-09-12T18:25:55.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.856+0000 7fa748471640 0 -- 172.21.15.97:0/4014376285 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7fa73c008050 msgr2=0x7fa73c046460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:25:55.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.860+0000 7fa747c70640 0 -- 172.21.15.97:0/4014376285 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fa740029040 msgr2=0x7fa740016400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:55.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.868+0000 7fa74a16a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:55.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.868+0000 7fa74a16a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:55.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.868+0000 7fa74a16a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:55.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.868+0000 7fa74a16a9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:55.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.868+0000 7fa74a16a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:55.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.868+0000 7fa74a16a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:55.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.868+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.868+0000 7fa74a16a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.868+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.868+0000 7fa74a16a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:55.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.868+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:55.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 20 zone default found 2024-09-12T18:25:55.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 4 Realm: () 2024-09-12T18:25:55.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:55.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:55.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:55.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 20 zonegroup default 2024-09-12T18:25:55.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 20 started sync module instance, tier type = 2024-09-12T18:25:55.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.872+0000 7fa74a16a9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:55.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.892+0000 7fa74a16a9c0 20 add_watcher() i=0 2024-09-12T18:25:55.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.892+0000 7fa74a16a9c0 20 add_watcher() i=1 2024-09-12T18:25:55.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.892+0000 7fa74a16a9c0 20 add_watcher() i=2 2024-09-12T18:25:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.892+0000 7fa74a16a9c0 20 add_watcher() i=3 2024-09-12T18:25:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.892+0000 7fa74a16a9c0 20 add_watcher() i=4 2024-09-12T18:25:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.892+0000 7fa74a16a9c0 20 add_watcher() i=5 2024-09-12T18:25:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.892+0000 7fa74a16a9c0 20 add_watcher() i=6 2024-09-12T18:25:55.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.892+0000 7fa74a16a9c0 20 add_watcher() i=7 2024-09-12T18:25:55.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.892+0000 7fa74a16a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:55.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa5fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:55.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:55.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:55.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 5 note: GC not initialized 2024-09-12T18:25:55.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa5fcfe1640 20 reqs_thread_entry: start 2024-09-12T18:25:55.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:55.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 20 Filter name: none 2024-09-12T18:25:55.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa5767fc640 20 reqs_thread_entry: start 2024-09-12T18:25:55.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T18:25:55.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T18:25:55.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:25:55.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T18:25:55.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T18:25:55.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:25:55.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 10 cache get: name=default.rgw.meta+users.keys+OETPOOJDKESTFGQIMUPQ : miss 2024-09-12T18:25:55.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.896+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.900+0000 7fa74a16a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:55.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.900+0000 7fa74a16a9c0 10 cache put: name=default.rgw.meta+users.keys+OETPOOJDKESTFGQIMUPQ info.flags=0x0 2024-09-12T18:25:55.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.900+0000 7fa74a16a9c0 10 adding default.rgw.meta+users.keys+OETPOOJDKESTFGQIMUPQ to cache LRU end 2024-09-12T18:25:55.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.900+0000 7fa74a16a9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T18:25:55.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.900+0000 7fa74a16a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:55.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.900+0000 7fa74a16a9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:25:55.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.900+0000 7fa74a16a9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:25:55.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.900+0000 7fa74a16a9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:25:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.900+0000 7fa74a16a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:25:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.900+0000 7fa74a16a9c0 10 cache get: name=default.rgw.meta+users.keys+OETPOOJDKESTFGQIMUPQ : hit (negative entry) 2024-09-12T18:25:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.900+0000 7fa74a16a9c0 10 cache get: name=default.rgw.meta+users.keys+OETPOOJDKESTFGQIMUPQ : hit (negative entry) 2024-09-12T18:25:55.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.904+0000 7fa74a16a9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:25:55.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.904+0000 7fa74a16a9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:25:55.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.904+0000 7fa74a16a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T18:25:55.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.904+0000 7fa626ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333694 cookie 93961170307344 notifier 9255 bl.length()=681 2024-09-12T18:25:55.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.904+0000 7fa626ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:25:55.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.904+0000 7fa626ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:25:55.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.908+0000 7fa74a16a9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T18:25:55.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.908+0000 7fa74a16a9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:25:55.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.908+0000 7fa74a16a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T18:25:55.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.908+0000 7fa626ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333697 cookie 93961170312624 notifier 9255 bl.length()=189 2024-09-12T18:25:55.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.908+0000 7fa626ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T18:25:55.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.908+0000 7fa626ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:25:55.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.916+0000 7fa74a16a9c0 10 cache put: name=default.rgw.meta+users.keys+OETPOOJDKESTFGQIMUPQ info.flags=0x7 2024-09-12T18:25:55.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.916+0000 7fa74a16a9c0 10 moving default.rgw.meta+users.keys+OETPOOJDKESTFGQIMUPQ to cache LRU end 2024-09-12T18:25:55.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.916+0000 7fa74a16a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:OETPOOJDKESTFGQIMUPQ, ofs0, ns] 2024-09-12T18:25:55.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.916+0000 7fa626ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333698 cookie 93961170312624 notifier 9255 bl.length()=188 2024-09-12T18:25:55.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.916+0000 7fa626ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OETPOOJDKESTFGQIMUPQ info.flags=0x7 2024-09-12T18:25:55.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.916+0000 7fa626ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OETPOOJDKESTFGQIMUPQ to cache LRU end 2024-09-12T18:25:55.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.920+0000 7fa74a16a9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T18:25:55.927 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:25:55.927 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "root1.client.0", 2024-09-12T18:25:55.927 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T18:25:55.927 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "root1+test@test.test", 2024-09-12T18:25:55.927 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-12T18:25:55.927 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:25:55.928 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-12T18:25:55.928 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-12T18:25:55.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T18:25:55.928 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "root1.client.0", 2024-09-12T18:25:55.928 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "OETPOOJDKESTFGQIMUPQ", 2024-09-12T18:25:55.928 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "XwklwKeJLfR1ABOKSXPmrPn6zqg9286QwuBk0Jch22k8JbaKHXinYA==", 2024-09-12T18:25:55.928 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-12T18:25:55.928 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:55.905103Z" 2024-09-12T18:25:55.928 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-12T18:25:55.928 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T18:25:55.929 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-12T18:25:55.929 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-12T18:25:55.929 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T18:25:55.929 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-12T18:25:55.929 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-12T18:25:55.929 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-12T18:25:55.929 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:25:55.929 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:55.929 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:55.929 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:55.929 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:55.930 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:55.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:55.930 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-12T18:25:55.930 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:55.930 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:55.930 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:55.930 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "root", 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "RGW88888888888888888", 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:55.905085Z", 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:25:55.931 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:55.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.920+0000 7fa5fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:55.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.928+0000 7fa74a16a9c0 20 remove_watcher() i=0 2024-09-12T18:25:55.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.928+0000 7fa74a16a9c0 2 removed watcher, disabling cache 2024-09-12T18:25:55.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.928+0000 7fa74a16a9c0 20 remove_watcher() i=1 2024-09-12T18:25:55.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.932+0000 7fa74a16a9c0 20 remove_watcher() i=2 2024-09-12T18:25:55.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.932+0000 7fa74a16a9c0 20 remove_watcher() i=3 2024-09-12T18:25:55.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.936+0000 7fa74a16a9c0 20 remove_watcher() i=4 2024-09-12T18:25:55.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.936+0000 7fa74a16a9c0 20 remove_watcher() i=5 2024-09-12T18:25:55.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.940+0000 7fa74a16a9c0 20 remove_watcher() i=6 2024-09-12T18:25:55.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:55.944+0000 7fa74a16a9c0 20 remove_watcher() i=7 2024-09-12T18:25:55.966 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 1565098793 --totp-seed WMQWU22PMOPSSXXAKYVZY6XCW55QVA6MDMNXHCHGY6RLIPTVJC3QBRU2LQAS4YBX --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:25:56.008 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:56.008 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:56.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.040+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.044+0000 7fb420deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.044+0000 7fb420deb9c0 20 realm 2024-09-12T18:25:56.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.044+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.044+0000 7fb420deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.044+0000 7fb420deb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:56.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.044+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.044+0000 7fb420deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.044+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.044+0000 7fb420deb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:56.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.044+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.048+0000 7fb420deb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:56.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.048+0000 7fb420deb9c0 20 searching for the correct realm 2024-09-12T18:25:56.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.052+0000 7fb41e0f0640 0 -- 172.21.15.97:0/652920756 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fb4140b6900 msgr2=0x7fb4140d13c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:56.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.268+0000 7fb41f0f2640 0 -- 172.21.15.97:0/652920756 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55d772162710 msgr2=0x55d772164bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:56.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.280+0000 7fb420deb9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.280+0000 7fb420deb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.280+0000 7fb420deb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.280+0000 7fb420deb9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.280+0000 7fb420deb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.280+0000 7fb420deb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.280+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.280+0000 7fb420deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.280+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.280+0000 7fb420deb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:56.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.280+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:56.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 20 zone default found 2024-09-12T18:25:56.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 4 Realm: () 2024-09-12T18:25:56.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:56.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:56.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:56.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 20 zonegroup default 2024-09-12T18:25:56.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 20 started sync module instance, tier type = 2024-09-12T18:25:56.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.284+0000 7fb420deb9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:56.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.308+0000 7fb420deb9c0 20 add_watcher() i=0 2024-09-12T18:25:56.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.308+0000 7fb420deb9c0 20 add_watcher() i=1 2024-09-12T18:25:56.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.308+0000 7fb420deb9c0 20 add_watcher() i=2 2024-09-12T18:25:56.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.308+0000 7fb420deb9c0 20 add_watcher() i=3 2024-09-12T18:25:56.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.308+0000 7fb420deb9c0 20 add_watcher() i=4 2024-09-12T18:25:56.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.308+0000 7fb420deb9c0 20 add_watcher() i=5 2024-09-12T18:25:56.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.308+0000 7fb420deb9c0 20 add_watcher() i=6 2024-09-12T18:25:56.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.312+0000 7fb420deb9c0 20 add_watcher() i=7 2024-09-12T18:25:56.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.312+0000 7fb420deb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:56.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb2d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:56.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb420deb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:56.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb420deb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:56.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb420deb9c0 5 note: GC not initialized 2024-09-12T18:25:56.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb2d4fe1640 20 reqs_thread_entry: start 2024-09-12T18:25:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb420deb9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb420deb9c0 20 Filter name: none 2024-09-12T18:25:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb2cdffb640 20 reqs_thread_entry: start 2024-09-12T18:25:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb420deb9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T18:25:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb420deb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb420deb9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T18:25:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb420deb9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T18:25:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb420deb9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:25:56.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.316+0000 7fb420deb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:25:56.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.324+0000 7fb420deb9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:25:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.324+0000 7fb420deb9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:25:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.324+0000 7fb420deb9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T18:25:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.324+0000 7fb3027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333695 cookie 94383820435088 notifier 9276 bl.length()=695 2024-09-12T18:25:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.324+0000 7fb3027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:25:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.324+0000 7fb3027fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:25:56.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.328+0000 7fb2d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:56.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.332+0000 7fb420deb9c0 20 remove_watcher() i=0 2024-09-12T18:25:56.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.332+0000 7fb420deb9c0 2 removed watcher, disabling cache 2024-09-12T18:25:56.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.336+0000 7fb420deb9c0 20 remove_watcher() i=1 2024-09-12T18:25:56.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.336+0000 7fb420deb9c0 20 remove_watcher() i=2 2024-09-12T18:25:56.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.340+0000 7fb420deb9c0 20 remove_watcher() i=3 2024-09-12T18:25:56.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.344+0000 7fb420deb9c0 20 remove_watcher() i=4 2024-09-12T18:25:56.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.344+0000 7fb420deb9c0 20 remove_watcher() i=5 2024-09-12T18:25:56.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.352+0000 7fb420deb9c0 20 remove_watcher() i=6 2024-09-12T18:25:56.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.352+0000 7fb420deb9c0 20 remove_watcher() i=7 2024-09-12T18:25:56.375 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T18:25:56.457 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:56.458 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:56.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.492+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.496+0000 7fd3b88f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.496+0000 7fd3b88f19c0 20 realm 2024-09-12T18:25:56.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.496+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.496+0000 7fd3b88f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.496+0000 7fd3b88f19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:56.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.496+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.496+0000 7fd3b88f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.496+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.496+0000 7fd3b88f19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:56.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.496+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.500+0000 7fd3b88f19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:56.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.500+0000 7fd3b88f19c0 20 searching for the correct realm 2024-09-12T18:25:56.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.504+0000 7fd3b5bf6640 0 -- 172.21.15.97:0/817017412 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fd3ac0662e0 msgr2=0x7fd3ac09b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:56.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.716+0000 7fd3b6bf8640 0 -- 172.21.15.97:0/817017412 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55abfd9f8b70 msgr2=0x55abfd9fafe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:56.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.728+0000 7fd3b88f19c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:56.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.728+0000 7fd3b88f19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:56.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.728+0000 7fd3b88f19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:56.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.728+0000 7fd3b88f19c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:56.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.728+0000 7fd3b88f19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:56.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.728+0000 7fd3b88f19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:56.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.728+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:56.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:56.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 zone default found 2024-09-12T18:25:56.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 4 Realm: () 2024-09-12T18:25:56.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:56.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:56.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:56.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 zonegroup default 2024-09-12T18:25:56.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.732+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.736+0000 7fd3b88f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.736+0000 7fd3b88f19c0 20 started sync module instance, tier type = 2024-09-12T18:25:56.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.736+0000 7fd3b88f19c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:56.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.760+0000 7fd3b88f19c0 20 add_watcher() i=0 2024-09-12T18:25:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.760+0000 7fd3b88f19c0 20 add_watcher() i=1 2024-09-12T18:25:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.760+0000 7fd3b88f19c0 20 add_watcher() i=2 2024-09-12T18:25:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.760+0000 7fd3b88f19c0 20 add_watcher() i=3 2024-09-12T18:25:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.760+0000 7fd3b88f19c0 20 add_watcher() i=4 2024-09-12T18:25:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.760+0000 7fd3b88f19c0 20 add_watcher() i=5 2024-09-12T18:25:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.760+0000 7fd3b88f19c0 20 add_watcher() i=6 2024-09-12T18:25:56.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.764+0000 7fd3b88f19c0 20 add_watcher() i=7 2024-09-12T18:25:56.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.764+0000 7fd3b88f19c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:56.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.768+0000 7fd26cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:56.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.768+0000 7fd3b88f19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:56.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.768+0000 7fd3b88f19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:56.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.768+0000 7fd3b88f19c0 5 note: GC not initialized 2024-09-12T18:25:56.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.768+0000 7fd1e77fe640 20 reqs_thread_entry: start 2024-09-12T18:25:56.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.768+0000 7fd3b88f19c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:56.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.768+0000 7fd3b88f19c0 20 Filter name: none 2024-09-12T18:25:56.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.768+0000 7fd1e57fa640 20 reqs_thread_entry: start 2024-09-12T18:25:56.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.768+0000 7fd3b88f19c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T18:25:56.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.768+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T18:25:56.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:25:56.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T18:25:56.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T18:25:56.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T18:25:56.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:25:56.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T18:25:56.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:25:56.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:25:56.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.772+0000 7fd3b88f19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T18:25:56.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.776+0000 7fd299ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333696 cookie 94197182915088 notifier 8675 bl.length()=384 2024-09-12T18:25:56.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.776+0000 7fd299ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:25:56.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.776+0000 7fd299ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:25:56.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.780+0000 7fd3b88f19c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T18:25:56.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.780+0000 7fd3b88f19c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:25:56.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.780+0000 7fd3b88f19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T18:25:56.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.780+0000 7fd299ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333697 cookie 94197182924048 notifier 8675 bl.length()=225 2024-09-12T18:25:56.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.780+0000 7fd299ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T18:25:56.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.780+0000 7fd299ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:25:56.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.784+0000 7fd3b88f19c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T18:25:56.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.784+0000 7fd3b88f19c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:25:56.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.784+0000 7fd3b88f19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T18:25:56.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.784+0000 7fd2997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333560 cookie 94197182920416 notifier 8675 bl.length()=234 2024-09-12T18:25:56.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.784+0000 7fd2997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T18:25:56.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.784+0000 7fd2997fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:25:56.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.788+0000 7fd26cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:56.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.792+0000 7fd3b88f19c0 20 remove_watcher() i=0 2024-09-12T18:25:56.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.792+0000 7fd3b88f19c0 2 removed watcher, disabling cache 2024-09-12T18:25:56.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.796+0000 7fd3b88f19c0 20 remove_watcher() i=1 2024-09-12T18:25:56.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.796+0000 7fd3b88f19c0 20 remove_watcher() i=2 2024-09-12T18:25:56.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.800+0000 7fd3b88f19c0 20 remove_watcher() i=3 2024-09-12T18:25:56.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.800+0000 7fd3b88f19c0 20 remove_watcher() i=4 2024-09-12T18:25:56.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.804+0000 7fd3b88f19c0 20 remove_watcher() i=5 2024-09-12T18:25:56.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.808+0000 7fd3b88f19c0 20 remove_watcher() i=6 2024-09-12T18:25:56.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.808+0000 7fd3b88f19c0 20 remove_watcher() i=7 2024-09-12T18:25:56.828 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:25:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "id": "RGW99999999999999999", 2024-09-12T18:25:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "tenant": "", 2024-09-12T18:25:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T18:25:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T18:25:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "quota": { 2024-09-12T18:25:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:56.829 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "max_users": 1000, 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "max_roles": 1000, 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "max_groups": 1000, 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:25:56.830 INFO:teuthology.orchestra.run.smithi097.stdout: "max_access_keys": 4 2024-09-12T18:25:56.831 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:25:56.832 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T18:25:56.832 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key KPYAFSFGCCVMXKFXELCY --secret x2WfEI6mF1tExFJjye9wkYhZhF6gwMmAjd513xLhiwtdHuMFDQOJYg== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T18:25:56.920 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:56.920 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:56.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.956+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.960+0000 7fcef53729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.960+0000 7fcef53729c0 20 realm 2024-09-12T18:25:56.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.960+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.960+0000 7fcef53729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.960+0000 7fcef53729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:56.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.960+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.960+0000 7fcef53729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.960+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.964+0000 7fcef53729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:56.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.964+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.964+0000 7fcef53729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:56.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.964+0000 7fcef53729c0 20 searching for the correct realm 2024-09-12T18:25:56.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.968+0000 7fcef2677640 0 -- 172.21.15.97:0/416400530 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fcee80c4bd0 msgr2=0x7fcee80df960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:56.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.976+0000 7fcef2e78640 0 -- 172.21.15.97:0/416400530 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7fcee4008040 msgr2=0x7fcee4036940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:56.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:56.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:56.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:56.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:56.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:56.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:56.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:56.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:56.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 zone default found 2024-09-12T18:25:56.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 4 Realm: () 2024-09-12T18:25:56.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:56.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:56.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:56.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 zonegroup default 2024-09-12T18:25:56.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.984+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.988+0000 7fcef53729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.988+0000 7fcef53729c0 20 started sync module instance, tier type = 2024-09-12T18:25:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:56.988+0000 7fcef53729c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:57.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.004+0000 7fcef53729c0 20 add_watcher() i=0 2024-09-12T18:25:57.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.004+0000 7fcef53729c0 20 add_watcher() i=1 2024-09-12T18:25:57.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.004+0000 7fcef53729c0 20 add_watcher() i=2 2024-09-12T18:25:57.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.004+0000 7fcef53729c0 20 add_watcher() i=3 2024-09-12T18:25:57.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.004+0000 7fcef53729c0 20 add_watcher() i=4 2024-09-12T18:25:57.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.004+0000 7fcef53729c0 20 add_watcher() i=5 2024-09-12T18:25:57.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.004+0000 7fcef53729c0 20 add_watcher() i=6 2024-09-12T18:25:57.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.008+0000 7fcef53729c0 20 add_watcher() i=7 2024-09-12T18:25:57.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.008+0000 7fcef53729c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:57.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcda97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:57.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:57.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:57.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 5 note: GC not initialized 2024-09-12T18:25:57.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcd23fff640 20 reqs_thread_entry: start 2024-09-12T18:25:57.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:57.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 Filter name: none 2024-09-12T18:25:57.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcd21ffb640 20 reqs_thread_entry: start 2024-09-12T18:25:57.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T18:25:57.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:57.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T18:25:57.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:25:57.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T18:25:57.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:57.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T18:25:57.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:25:57.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 cache get: name=default.rgw.meta+users.keys+KPYAFSFGCCVMXKFXELCY : miss 2024-09-12T18:25:57.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:57.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 cache put: name=default.rgw.meta+users.keys+KPYAFSFGCCVMXKFXELCY info.flags=0x0 2024-09-12T18:25:57.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 adding default.rgw.meta+users.keys+KPYAFSFGCCVMXKFXELCY to cache LRU end 2024-09-12T18:25:57.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T18:25:57.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:25:57.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:25:57.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:25:57.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:25:57.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 cache get: name=default.rgw.meta+users.keys+KPYAFSFGCCVMXKFXELCY : hit (negative entry) 2024-09-12T18:25:57.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.012+0000 7fcef53729c0 10 cache get: name=default.rgw.meta+users.keys+KPYAFSFGCCVMXKFXELCY : hit (negative entry) 2024-09-12T18:25:57.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.016+0000 7fcef53729c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:25:57.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.016+0000 7fcef53729c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:25:57.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.016+0000 7fcef53729c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T18:25:57.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.016+0000 7fcdd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333698 cookie 94812161767280 notifier 8693 bl.length()=681 2024-09-12T18:25:57.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.016+0000 7fcdd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:25:57.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.016+0000 7fcdd67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:25:57.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.020+0000 7fcef53729c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T18:25:57.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.020+0000 7fcef53729c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:25:57.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.020+0000 7fcef53729c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T18:25:57.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.024+0000 7fcdd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333699 cookie 94812161784144 notifier 8693 bl.length()=189 2024-09-12T18:25:57.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.024+0000 7fcdd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T18:25:57.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.024+0000 7fcdd67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:25:57.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.028+0000 7fcef53729c0 10 cache put: name=default.rgw.meta+users.keys+KPYAFSFGCCVMXKFXELCY info.flags=0x7 2024-09-12T18:25:57.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.028+0000 7fcef53729c0 10 moving default.rgw.meta+users.keys+KPYAFSFGCCVMXKFXELCY to cache LRU end 2024-09-12T18:25:57.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.028+0000 7fcef53729c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:KPYAFSFGCCVMXKFXELCY, ofs0, ns] 2024-09-12T18:25:57.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.028+0000 7fcdd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333699 cookie 94812161781840 notifier 8693 bl.length()=188 2024-09-12T18:25:57.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.028+0000 7fcdd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KPYAFSFGCCVMXKFXELCY info.flags=0x7 2024-09-12T18:25:57.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.028+0000 7fcdd67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KPYAFSFGCCVMXKFXELCY to cache LRU end 2024-09-12T18:25:57.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.032+0000 7fcef53729c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T18:25:57.037 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T18:25:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "root2.client.0", 2024-09-12T18:25:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T18:25:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "root2+test@test.test", 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "root2.client.0", 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "KPYAFSFGCCVMXKFXELCY", 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "x2WfEI6mF1tExFJjye9wkYhZhF6gwMmAjd513xLhiwtdHuMFDQOJYg==", 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:57.019481Z" 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-12T18:25:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-12T18:25:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "root", 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "RGW99999999999999999", 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-12T18:25:57.019464Z", 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T18:25:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:25:57.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.032+0000 7fcda97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:57.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.036+0000 7fcef53729c0 20 remove_watcher() i=0 2024-09-12T18:25:57.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.036+0000 7fcef53729c0 2 removed watcher, disabling cache 2024-09-12T18:25:57.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.040+0000 7fcef53729c0 20 remove_watcher() i=1 2024-09-12T18:25:57.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.040+0000 7fcef53729c0 20 remove_watcher() i=2 2024-09-12T18:25:57.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.044+0000 7fcef53729c0 20 remove_watcher() i=3 2024-09-12T18:25:57.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.044+0000 7fcef53729c0 20 remove_watcher() i=4 2024-09-12T18:25:57.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.048+0000 7fcef53729c0 20 remove_watcher() i=5 2024-09-12T18:25:57.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.048+0000 7fcef53729c0 20 remove_watcher() i=6 2024-09-12T18:25:57.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.052+0000 7fcef53729c0 20 remove_watcher() i=7 2024-09-12T18:25:57.073 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 0579539471 --totp-seed RI6ZME4D6SOZO4JGBWULJ5YMXIB6XAGBWZAFZOKX7TLW2DD57H4EZPXZROSVWPCB --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:25:57.115 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:57.115 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:57.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.148+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.148+0000 7ffada0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.148+0000 7ffada0109c0 20 realm 2024-09-12T18:25:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.148+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.152+0000 7ffada0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.152+0000 7ffada0109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:25:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.152+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.152+0000 7ffada0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.152+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.152+0000 7ffada0109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.152+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.152+0000 7ffada0109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:25:57.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.152+0000 7ffada0109c0 20 searching for the correct realm 2024-09-12T18:25:57.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.160+0000 7ffad7b16640 0 -- 172.21.15.97:0/1386233369 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7ffac801e060 msgr2=0x7ffac8071340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:25:57.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.164+0000 7ffad7b16640 0 -- 172.21.15.97:0/1386233369 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x55a2d56da540 msgr2=0x55a2d56dc990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:25:57.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T18:25:57.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:25:57.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:25:57.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T18:25:57.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:25:57.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:25:57.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:57.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:25:57.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:25:57.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 zone default found 2024-09-12T18:25:57.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 4 Realm: () 2024-09-12T18:25:57.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T18:25:57.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T18:25:57.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:25:57.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 zonegroup default 2024-09-12T18:25:57.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.172+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.176+0000 7ffada0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:57.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.176+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.176+0000 7ffada0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:57.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.176+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.176+0000 7ffada0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:25:57.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.176+0000 7ffada0109c0 20 started sync module instance, tier type = 2024-09-12T18:25:57.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.176+0000 7ffada0109c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T18:25:57.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.192+0000 7ffada0109c0 20 add_watcher() i=0 2024-09-12T18:25:57.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.192+0000 7ffada0109c0 20 add_watcher() i=1 2024-09-12T18:25:57.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.192+0000 7ffada0109c0 20 add_watcher() i=2 2024-09-12T18:25:57.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.192+0000 7ffada0109c0 20 add_watcher() i=3 2024-09-12T18:25:57.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.192+0000 7ffada0109c0 20 add_watcher() i=4 2024-09-12T18:25:57.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.192+0000 7ffada0109c0 20 add_watcher() i=5 2024-09-12T18:25:57.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.192+0000 7ffada0109c0 20 add_watcher() i=6 2024-09-12T18:25:57.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.196+0000 7ffada0109c0 20 add_watcher() i=7 2024-09-12T18:25:57.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.196+0000 7ffada0109c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:25:57.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ff98dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:57.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ffada0109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:25:57.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ffada0109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:25:57.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ffada0109c0 5 note: GC not initialized 2024-09-12T18:25:57.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ff98cfe1640 20 reqs_thread_entry: start 2024-09-12T18:25:57.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ffada0109c0 20 init_complete bucket index max shards: 11 2024-09-12T18:25:57.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ffada0109c0 20 Filter name: none 2024-09-12T18:25:57.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ff9067fc640 20 reqs_thread_entry: start 2024-09-12T18:25:57.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ffada0109c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T18:25:57.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ffada0109c0 20 rados->read ofs=0 len=0 2024-09-12T18:25:57.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ffada0109c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T18:25:57.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ffada0109c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T18:25:57.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ffada0109c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:25:57.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.200+0000 7ffada0109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:25:57.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.208+0000 7ffada0109c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:25:57.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.208+0000 7ffada0109c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:25:57.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.208+0000 7ffada0109c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T18:25:57.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.208+0000 7ff9b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333700 cookie 94157853800608 notifier 9330 bl.length()=695 2024-09-12T18:25:57.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.208+0000 7ff9b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:25:57.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.208+0000 7ff9b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:25:57.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.208+0000 7ff98dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:25:57.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.212+0000 7ffada0109c0 20 remove_watcher() i=0 2024-09-12T18:25:57.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.212+0000 7ffada0109c0 2 removed watcher, disabling cache 2024-09-12T18:25:57.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.216+0000 7ffada0109c0 20 remove_watcher() i=1 2024-09-12T18:25:57.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.216+0000 7ffada0109c0 20 remove_watcher() i=2 2024-09-12T18:25:57.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.220+0000 7ffada0109c0 20 remove_watcher() i=3 2024-09-12T18:25:57.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.220+0000 7ffada0109c0 20 remove_watcher() i=4 2024-09-12T18:25:57.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.224+0000 7ffada0109c0 20 remove_watcher() i=5 2024-09-12T18:25:57.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.228+0000 7ffada0109c0 20 remove_watcher() i=6 2024-09-12T18:25:57.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T18:25:57.232+0000 7ffada0109c0 20 remove_watcher() i=7 2024-09-12T18:25:57.252 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T18:25:57.253 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T18:25:57.253 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T18:25:57.297 INFO:tasks.s3tests:Configuring boto... 2024-09-12T18:25:57.298 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T18:25:57.298 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:25:57.346 DEBUG:teuthology.orchestra.run.smithi097:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T18:25:57.519 INFO:teuthology.orchestra.run.smithi097.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T18:25:57.713 INFO:teuthology.orchestra.run.smithi097.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T18:25:58.035 INFO:teuthology.orchestra.run.smithi097.stdout:py installdeps: -rrequirements.txt 2024-09-12T18:27:54.584 INFO:teuthology.orchestra.run.smithi097.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T18:27:56.411 INFO:teuthology.orchestra.run.smithi097.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=1468fce92a3d5e8a586517eaeda942a881bdaf128e677a6279792a1f3386608f,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T18:27:56.411 INFO:teuthology.orchestra.run.smithi097.stdout:py run-test-pre: PYTHONHASHSEED='2283301664' 2024-09-12T18:27:56.411 INFO:teuthology.orchestra.run.smithi097.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T18:27:56.593 INFO:teuthology.orchestra.run.smithi097.stdout:============================= test session starts ============================== 2024-09-12T18:27:56.593 INFO:teuthology.orchestra.run.smithi097.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T18:27:56.594 INFO:teuthology.orchestra.run.smithi097.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T18:27:56.594 INFO:teuthology.orchestra.run.smithi097.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:27:56.594 INFO:teuthology.orchestra.run.smithi097.stdout:configfile: pytest.ini 2024-09-12T18:27:58.389 INFO:teuthology.orchestra.run.smithi097.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T18:27:58.389 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T18:27:59.845 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T18:28:00.703 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T18:28:01.566 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T18:28:02.445 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T18:28:03.314 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T18:28:04.064 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T18:28:05.096 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T18:28:05.801 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T18:28:05.974 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T18:28:06.151 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T18:28:06.999 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T18:28:07.862 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T18:28:08.720 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T18:28:09.615 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T18:28:09.803 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T18:28:09.986 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T18:28:10.115 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T18:28:10.242 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T18:28:10.372 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T18:28:10.506 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T18:28:10.626 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T18:28:10.755 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T18:28:10.881 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T18:28:11.012 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T18:28:11.138 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T18:28:11.262 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T18:28:11.392 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T18:28:11.521 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T18:28:11.650 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T18:28:11.774 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T18:28:11.904 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T18:28:12.032 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T18:28:12.168 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T18:28:12.305 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T18:28:12.434 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T18:28:12.564 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T18:28:12.691 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T18:28:12.820 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T18:28:12.949 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:28:13.079 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T18:28:13.207 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T18:28:13.340 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:28:13.482 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:28:13.610 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T18:28:13.740 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T18:28:13.868 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T18:28:13.995 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T18:28:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T18:28:14.275 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T18:28:14.403 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T18:28:14.530 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T18:28:14.659 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T18:28:14.787 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T18:28:16.481 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T18:28:33.089 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T18:28:51.580 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T18:29:19.015 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T18:29:54.508 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T18:30:04.077 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T18:30:14.195 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T18:30:17.748 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T18:30:18.737 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T18:30:21.693 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T18:30:24.608 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T18:30:26.685 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T18:30:27.927 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T18:30:28.910 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T18:30:28.913 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T18:30:28.915 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T18:30:28.917 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T18:30:28.924 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T18:30:28.926 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T18:30:28.928 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T18:30:28.930 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T18:30:28.931 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:30:28.933 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:30:28.934 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:30:28.936 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:30:28.938 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T18:30:28.940 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:30:28.942 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:30:28.944 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:30:28.946 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:30:28.947 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:30:28.948 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:30:28.950 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:30:28.952 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T18:30:28.954 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T18:30:28.955 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T18:30:28.957 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T18:30:28.958 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T18:30:28.959 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T18:30:28.961 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T18:30:28.962 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T18:30:29.060 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T18:30:29.069 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T18:30:31.348 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T18:30:42.822 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T18:30:44.521 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T18:30:46.610 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T18:30:48.652 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T18:30:50.671 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T18:30:52.729 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T18:30:54.389 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T18:30:56.550 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T18:30:58.408 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T18:31:00.253 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T18:31:01.951 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T18:31:03.480 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T18:31:04.956 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T18:31:05.966 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T18:31:07.603 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T18:31:09.490 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T18:31:11.360 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T18:31:13.035 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T18:31:14.680 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T18:31:16.373 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T18:31:18.019 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T18:31:19.658 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T18:31:21.232 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T18:31:22.761 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T18:31:23.737 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T18:31:24.781 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T18:31:25.765 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T18:31:26.726 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T18:31:27.692 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T18:31:29.543 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T18:31:30.514 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:31:31.575 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T18:31:34.167 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T18:31:35.159 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:31:36.450 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T18:31:37.717 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:31:39.301 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T18:31:40.463 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T18:31:41.768 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T18:31:43.051 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T18:31:44.832 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T18:31:49.085 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T18:31:51.374 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:31:53.675 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:31:58.108 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:32:02.359 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:32:07.242 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:32:09.164 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T18:32:11.350 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T18:32:12.833 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T18:32:15.769 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T18:32:17.698 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T18:32:20.001 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T18:32:24.192 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T18:32:29.645 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T18:32:32.956 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T18:32:35.984 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T18:32:38.391 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T18:32:40.085 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T18:32:42.902 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T18:32:44.905 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T18:32:47.487 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T18:32:49.371 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T18:32:52.733 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T18:32:55.932 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T18:32:59.528 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T18:33:03.082 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T18:33:05.783 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T18:33:08.255 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T18:33:10.257 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T18:33:14.461 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T18:33:17.737 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T18:33:21.262 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T18:33:24.648 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T18:33:28.057 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T18:33:31.433 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T18:33:34.352 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T18:33:36.437 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T18:33:38.777 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T18:33:42.785 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T18:33:47.785 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T18:33:50.132 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T18:33:53.463 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T18:33:56.784 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T18:34:00.229 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T18:34:04.079 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T18:34:08.268 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T18:34:12.132 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T18:34:15.700 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T18:34:18.066 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T18:34:19.970 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:34:21.846 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:34:23.797 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T18:34:27.576 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:34:31.337 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:34:35.058 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:34:38.795 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:34:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:34:46.386 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:34:50.167 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T18:34:53.914 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T18:34:57.718 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T18:35:01.466 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:35:05.159 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T18:35:08.852 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T18:35:11.526 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T18:35:14.289 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T18:35:16.888 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:35:19.448 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T18:35:21.619 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T18:35:24.210 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T18:35:26.523 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T18:35:28.847 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T18:35:31.073 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T18:35:33.390 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T18:35:35.907 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T18:35:38.224 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T18:35:40.517 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T18:35:44.370 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T18:35:48.214 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T18:35:50.140 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:35:52.037 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:35:54.349 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T18:35:56.576 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T18:36:00.432 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:36:04.342 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:36:06.564 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T18:36:08.861 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T18:36:11.139 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:36:13.393 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:36:15.647 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T18:36:17.911 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T18:36:20.346 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:36:22.646 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:36:25.014 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T18:36:27.187 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T18:36:29.488 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T18:36:31.748 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T18:36:34.015 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T18:36:36.216 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T18:36:38.271 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T18:36:40.579 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:36:42.872 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:38:51.607 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T18:38:53.779 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T18:38:55.982 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T18:38:58.219 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T18:39:00.414 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T18:39:02.618 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T18:39:04.698 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T18:39:06.924 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T18:39:09.092 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T18:39:11.199 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T18:39:13.462 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T18:39:15.611 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T18:39:17.778 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T18:39:20.013 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:39:22.353 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:39:24.558 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:39:26.894 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:39:29.172 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T18:39:31.444 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T18:39:33.747 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:39:36.064 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:39:38.382 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:39:40.642 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:39:43.089 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T18:39:45.644 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T18:39:47.939 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T18:39:50.138 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T18:39:52.454 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T18:39:54.771 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T18:39:55.765 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T18:39:57.690 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T18:40:03.082 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T18:40:08.858 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T18:40:11.157 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T18:40:13.441 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T18:40:15.706 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T18:40:18.015 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T18:40:20.389 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T18:40:23.045 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T18:40:25.289 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T18:40:27.590 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T18:40:29.790 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T18:40:32.120 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T18:40:34.435 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T18:40:36.715 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T18:40:39.443 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T18:40:42.932 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T18:40:44.757 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T18:40:46.712 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T18:40:48.403 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:40:50.043 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:40:51.004 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T18:40:51.965 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T18:40:52.936 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T18:40:54.948 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T18:41:03.907 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T18:41:04.830 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T18:41:06.637 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T18:41:08.266 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T18:41:10.008 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T18:41:11.664 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T18:41:17.637 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T18:41:20.200 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T18:41:22.706 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T18:43:31.117 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T18:45:39.378 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T18:45:41.292 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T18:45:43.121 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T18:45:45.051 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T18:45:46.984 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T18:45:49.102 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T18:45:51.008 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T18:45:52.919 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T18:45:55.093 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T18:45:57.102 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T18:45:59.046 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T18:46:01.097 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T18:46:03.269 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T18:46:05.146 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T18:46:06.852 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T18:46:08.620 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T18:46:10.364 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T18:46:14.028 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T18:46:15.992 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T18:46:17.828 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T18:46:19.664 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T18:46:21.692 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T18:46:23.837 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T18:46:25.462 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T18:46:27.117 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T18:46:28.798 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T18:46:30.466 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T18:46:32.228 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T18:46:33.921 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T18:46:35.958 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T18:46:37.624 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T18:46:39.319 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T18:46:40.994 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T18:46:42.693 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T18:46:45.028 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T18:46:46.675 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T18:46:48.320 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T18:46:49.951 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T18:46:51.690 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T18:46:53.373 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T18:46:55.028 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T18:46:56.724 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T18:47:00.341 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T18:47:02.100 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T18:47:04.021 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T18:47:05.890 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T18:47:07.905 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T18:47:09.749 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T18:47:11.654 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T18:47:14.745 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T18:47:17.010 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T18:47:19.126 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T18:47:21.418 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T18:47:23.662 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T18:47:25.820 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T18:47:27.738 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T18:47:29.897 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T18:47:32.098 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T18:47:34.038 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T18:47:36.203 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T18:47:38.094 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T18:47:39.940 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T18:47:41.770 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T18:47:43.844 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T18:47:45.526 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T18:47:46.416 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T18:47:48.972 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T18:47:50.820 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T18:47:52.697 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T18:47:57.675 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T18:47:59.539 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T18:48:01.415 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T18:48:03.350 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T18:48:05.207 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T18:48:06.941 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T18:48:08.775 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T18:48:10.845 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T18:48:12.938 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T18:48:14.766 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T18:48:16.633 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T18:48:18.551 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T18:48:20.472 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T18:48:22.455 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T18:48:24.303 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T18:48:26.336 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T18:48:28.402 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T18:48:30.326 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T18:48:31.278 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T18:48:32.255 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T18:48:33.241 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T18:48:34.737 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T18:48:36.199 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T18:48:37.616 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T18:48:39.150 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T18:48:40.737 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T18:48:41.713 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T18:48:42.682 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T18:48:44.168 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T18:48:45.181 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T18:48:46.151 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T18:48:47.110 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T18:48:48.076 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T18:48:49.806 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T18:48:51.385 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T18:48:53.060 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T18:48:54.743 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T18:48:56.343 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T18:48:58.016 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T18:48:59.629 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T18:49:01.230 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T18:49:02.836 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:49:04.476 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:49:06.401 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T18:49:08.305 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T18:49:10.480 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T18:49:12.429 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:49:14.433 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:49:16.619 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T18:49:18.780 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T18:49:20.974 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T18:49:23.245 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T18:49:25.229 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T18:49:27.318 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T18:49:29.533 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T18:49:31.604 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T18:49:33.858 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T18:49:35.972 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T18:49:39.040 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T18:49:41.646 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T18:49:44.288 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T18:49:47.111 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T18:49:49.782 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T18:49:51.594 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T18:49:53.570 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T18:49:55.643 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T18:49:57.557 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T18:49:59.483 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T18:50:01.643 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T18:50:04.790 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T18:50:07.683 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T18:50:10.662 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T18:50:13.609 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T18:50:16.630 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:50:19.613 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T18:50:22.535 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T18:50:25.526 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T18:50:28.548 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:50:31.469 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T18:50:34.343 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T18:50:37.194 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T18:50:41.455 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T18:50:45.957 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T18:50:46.931 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T18:50:47.890 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T18:50:48.865 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T18:50:50.750 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T18:50:52.519 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T18:50:53.998 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T18:50:55.539 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T18:50:58.048 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T18:51:03.849 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T18:51:06.536 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T18:51:08.719 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T18:51:16.838 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T18:51:19.040 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T18:51:21.243 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T18:51:23.276 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T18:51:25.364 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T18:51:28.271 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T18:51:30.803 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T18:51:33.456 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T18:51:36.043 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T18:51:40.192 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T18:51:44.050 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T18:51:45.729 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T18:51:47.369 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T18:51:53.227 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T18:51:55.814 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T18:52:36.977 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T18:52:38.878 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T18:52:41.364 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T18:52:48.594 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T18:52:50.813 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T18:52:54.659 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T18:53:18.222 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T18:53:52.327 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T18:54:41.231 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T18:58:03.520 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T18:58:30.934 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T18:59:04.316 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T18:59:07.673 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T18:59:21.353 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T18:59:31.343 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T18:59:37.929 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T18:59:39.904 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T18:59:49.705 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T18:59:52.113 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T18:59:54.195 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T18:59:56.215 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T19:00:24.765 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T19:00:31.419 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T19:00:33.472 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T19:00:35.726 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T19:00:37.802 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T19:00:47.964 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T19:00:53.109 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T19:00:57.983 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T19:01:00.045 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T19:01:02.205 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T19:01:04.332 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T19:01:06.460 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T19:01:08.530 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T19:01:10.565 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T19:01:12.680 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T19:01:16.669 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T19:01:24.566 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T19:01:37.117 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T19:01:41.940 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T19:01:51.694 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T19:02:06.769 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T19:02:10.984 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T19:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T19:02:33.637 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T19:02:37.960 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T19:02:40.213 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T19:02:43.368 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T19:02:45.346 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T19:02:55.295 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T19:02:57.220 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T19:02:59.192 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T19:03:01.136 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T19:03:03.085 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T19:03:05.837 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T19:03:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T19:03:33.426 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T19:03:35.961 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T19:03:39.078 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T19:03:42.172 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T19:03:52.925 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T19:03:56.268 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T19:04:08.395 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T19:04:50.925 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T19:05:50.427 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T19:05:56.535 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T19:06:02.286 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T19:06:05.057 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T19:06:08.085 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T19:06:10.494 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T19:06:13.852 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T19:06:17.012 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T19:06:22.746 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T19:06:24.581 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T19:06:26.426 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T19:06:28.201 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T19:06:29.897 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T19:06:31.686 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T19:06:33.537 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T19:06:35.251 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T19:06:36.970 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T19:06:39.055 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T19:06:40.796 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T19:06:42.467 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T19:06:44.180 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T19:06:45.974 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T19:06:47.714 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T19:06:49.622 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T19:06:51.575 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T19:06:54.279 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T19:06:56.311 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T19:06:58.371 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T19:07:00.329 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T19:07:02.362 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T19:07:04.023 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T19:07:05.786 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T19:07:07.544 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T19:07:09.234 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T19:08:19.527 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T19:09:28.062 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T19:09:48.138 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T19:09:50.229 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T19:10:53.370 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T19:11:55.790 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T19:11:57.901 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T19:11:59.823 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T19:12:01.528 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T19:12:03.196 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T19:12:51.756 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T19:13:10.044 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T19:13:28.640 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T19:13:30.859 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T19:13:32.832 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T19:13:34.855 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T19:13:37.684 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T19:13:39.653 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T19:13:41.612 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T19:13:43.660 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T19:13:45.835 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T19:13:48.207 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T19:13:50.560 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T19:13:52.631 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T19:13:54.684 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T19:13:58.080 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T19:14:01.559 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T19:14:06.615 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T19:14:11.963 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T19:14:17.126 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T19:14:22.267 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T19:14:27.521 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T19:14:32.831 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T19:14:37.981 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T19:14:43.265 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T19:14:49.053 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T19:14:51.170 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T19:14:53.121 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T19:14:55.188 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T19:15:00.532 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T19:15:06.161 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T19:15:11.978 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T19:15:16.561 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T19:16:04.673 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T19:16:07.671 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T19:16:10.733 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T19:16:13.775 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T19:16:17.710 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T19:16:21.175 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T19:16:23.410 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T19:16:26.777 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T19:16:28.457 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T19:16:30.093 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T19:16:31.964 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T19:16:33.687 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T19:16:35.766 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T19:16:37.628 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T19:16:40.484 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T19:16:42.277 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T19:16:43.874 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T19:16:45.462 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T19:16:47.088 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T19:16:48.745 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T19:16:50.376 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T19:16:51.975 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T19:16:53.623 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T19:16:55.305 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T19:16:56.917 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T19:16:58.986 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T19:17:00.680 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T19:17:02.628 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T19:17:04.686 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T19:17:06.638 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T19:17:08.503 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T19:17:10.825 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T19:17:12.981 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T19:17:15.166 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T19:17:17.267 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T19:17:19.751 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T19:17:21.988 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T19:17:24.286 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T19:17:26.587 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T19:17:28.847 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T19:17:30.870 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T19:17:32.705 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T19:17:34.642 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T19:17:36.891 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T19:17:38.766 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T19:17:40.836 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T19:17:43.165 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T19:17:45.135 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T19:17:47.229 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T19:17:49.257 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T19:18:00.681 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T19:18:02.638 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T19:18:13.176 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T19:18:15.374 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T19:18:17.448 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T19:18:19.187 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T19:18:20.964 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T19:18:22.774 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T19:18:24.622 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T19:18:26.472 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T19:18:28.314 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T19:18:30.044 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T19:18:31.819 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T19:18:33.802 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T19:18:35.618 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T19:18:37.697 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T19:18:39.639 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T19:18:41.437 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T19:18:43.169 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T19:18:45.780 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T19:19:14.711 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T19:19:16.499 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T19:19:18.399 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T19:19:20.399 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T19:19:22.540 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T19:19:27.380 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T19:19:29.436 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T19:19:32.776 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T19:19:43.587 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T19:19:47.514 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T19:20:11.674 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T19:20:33.421 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T19:20:35.238 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T19:20:37.989 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T19:20:56.186 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T19:21:22.804 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T19:21:36.893 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T19:21:41.127 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T19:21:51.183 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T19:21:54.656 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T19:21:56.469 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T19:22:14.873 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T19:22:22.886 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T19:25:03.197 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T19:25:23.383 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T19:25:27.230 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T19:25:30.593 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T19:25:32.544 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T19:25:41.224 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T19:25:46.690 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T19:25:49.407 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T19:25:54.101 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T19:26:03.147 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T19:26:08.860 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T19:26:16.209 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T19:26:19.688 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T19:26:20.447 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T19:26:41.827 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T19:26:48.738 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T19:26:52.960 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T19:26:58.972 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T19:27:01.665 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T19:27:53.881 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T19:27:54.746 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T19:27:57.151 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T19:27:58.924 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T19:28:00.971 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T19:28:03.410 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T19:28:03.547 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T19:28:03.547 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.547 INFO:teuthology.orchestra.run.smithi097.stdout:=============================== warnings summary =============================== 2024-09-12T19:28:03.547 INFO:teuthology.orchestra.run.smithi097.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T19:28:03.547 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T19:28:03.547 INFO:teuthology.orchestra.run.smithi097.stdout: import imp 2024-09-12T19:28:03.547 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.547 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py:120 2024-09-12T19:28:03.548 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T19:28:03.548 INFO:teuthology.orchestra.run.smithi097.stdout: if boto_type is 'S3Connection': 2024-09-12T19:28:03.548 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.548 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py:124 2024-09-12T19:28:03.548 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T19:28:03.548 INFO:teuthology.orchestra.run.smithi097.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T19:28:03.548 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.548 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py:359 2024-09-12T19:28:03.548 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T19:28:03.548 INFO:teuthology.orchestra.run.smithi097.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T19:28:03.549 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.549 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T19:28:03.549 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T19:28:03.549 INFO:teuthology.orchestra.run.smithi097.stdout: if k is 'BucketName': 2024-09-12T19:28:03.549 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.549 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T19:28:03.549 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T19:28:03.549 INFO:teuthology.orchestra.run.smithi097.stdout: @pytest.mark.timeout(10) 2024-09-12T19:28:03.549 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.549 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T19:28:03.550 INFO:teuthology.orchestra.run.smithi097.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T19:28:03.550 INFO:teuthology.orchestra.run.smithi097.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T19:28:03.550 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.550 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T19:28:03.550 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:28:03.550 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:28:03.550 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.550 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T19:28:03.550 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:28:03.550 INFO:teuthology.orchestra.run.smithi097.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T19:28:03.550 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T19:28:03.551 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.552 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T19:28:03.552 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:28:03.552 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:28:03.552 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.552 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T19:28:03.552 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:28:03.552 INFO:teuthology.orchestra.run.smithi097.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T19:28:03.552 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.552 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T19:28:03.552 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:28:03.552 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:28:03.553 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi097.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout: warnings.warn( 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:28:03.554 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-12T19:28:03.555 INFO:teuthology.orchestra.run.smithi097.stdout: s = ssl.wrap_socket(s); 2024-09-12T19:28:03.555 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.555 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:28:03.555 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:28:03.555 INFO:teuthology.orchestra.run.smithi097.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-12T19:28:03.555 INFO:teuthology.orchestra.run.smithi097.stdout: context = SSLContext(ssl_version) 2024-09-12T19:28:03.555 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:28:03.555 INFO:teuthology.orchestra.run.smithi097.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T19:28:03.555 INFO:teuthology.orchestra.run.smithi097.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 3606.95s (1:00:06) = 2024-09-12T19:28:03.746 INFO:teuthology.orchestra.run.smithi097.stdout:___________________________________ summary ____________________________________ 2024-09-12T19:28:03.746 INFO:teuthology.orchestra.run.smithi097.stdout: py: commands succeeded 2024-09-12T19:28:03.746 INFO:teuthology.orchestra.run.smithi097.stdout: congratulations :) 2024-09-12T19:28:03.784 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T19:28:03.785 DEBUG:teuthology.orchestra.run.smithi097:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T19:28:03.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:28:03.882 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T19:28:03.882 DEBUG:teuthology.orchestra.run.smithi097:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T19:28:03.887 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T19:28:03.887 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T19:28:04.068 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T19:28:04.079 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T19:28:04.079 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T19:28:04.079 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T19:28:04.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:28:04.086 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T19:28:04.086 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T19:28:04.132 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T19:28:04.133 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T19:28:04.181 INFO:tasks.workunit:timeout=3h 2024-09-12T19:28:04.181 INFO:tasks.workunit:cleanup=True 2024-09-12T19:28:04.181 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T19:28:04.231 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T19:29:01.565 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T19:29:01.565 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T19:29:01.565 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T19:29:01.565 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T19:29:01.565 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T19:29:01.566 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T19:29:01.573 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T19:29:01.622 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T19:29:01.625 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T19:29:01.625 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T19:29:01.677 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T19:29:01.729 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T19:29:01.769 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T19:29:01.772 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T19:29:01.772 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T19:29:01.817 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T19:29:01.820 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T19:29:01.821 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T19:29:01.869 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T19:29:01.870 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T19:29:01.870 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T19:29:01.926 INFO:tasks.workunit.client.0.smithi097.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T19:29:01.927 INFO:tasks.workunit.client.0.smithi097.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T19:29:01.927 INFO:tasks.workunit.client.0.smithi097.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T19:29:04.785 INFO:tasks.workunit.client.0.smithi097.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ deactivate nondestructive 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ unset VIRTUAL_ENV 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ export VIRTUAL_ENV 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T19:29:04.786 INFO:tasks.workunit.client.0.smithi097.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T19:29:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PATH 2024-09-12T19:29:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-12T19:29:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -z '' ']' 2024-09-12T19:29:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T19:29:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:++ PS1='(rgw) ' 2024-09-12T19:29:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PS1 2024-09-12T19:29:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T19:29:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T19:29:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T19:29:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-12T19:29:04.787 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install pip --upgrade 2024-09-12T19:29:05.160 INFO:tasks.workunit.client.0.smithi097.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T19:29:05.365 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting pip 2024-09-12T19:29:05.371 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T19:29:05.405 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: pip 2024-09-12T19:29:05.405 INFO:tasks.workunit.client.0.smithi097.stdout: Attempting uninstall: pip 2024-09-12T19:29:05.406 INFO:tasks.workunit.client.0.smithi097.stdout: Found existing installation: pip 22.0.2 2024-09-12T19:29:05.662 INFO:tasks.workunit.client.0.smithi097.stdout: Uninstalling pip-22.0.2: 2024-09-12T19:29:05.669 INFO:tasks.workunit.client.0.smithi097.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T19:29:06.418 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed pip-24.2 2024-09-12T19:29:06.480 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install boto3 2024-09-12T19:29:07.400 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting boto3 2024-09-12T19:29:07.401 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T19:29:07.898 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T19:29:07.899 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T19:29:07.953 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T19:29:07.954 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T19:29:07.999 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T19:29:08.000 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T19:29:08.053 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T19:29:08.054 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T19:29:08.144 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T19:29:08.145 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T19:29:08.298 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T19:29:08.300 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T19:29:08.303 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T19:29:08.305 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T19:29:08.315 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T19:29:08.316 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T19:29:08.317 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T19:29:08.318 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T19:29:08.320 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T19:29:08.392 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T19:29:09.406 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T19:29:09.601 INFO:tasks.workunit.client.0.smithi097.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T19:29:09.734 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T19:29:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:29:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:29:09.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.808+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.808+0000 7fda6b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:09.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.808+0000 7fda6b4739c0 20 realm 2024-09-12T19:29:09.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.808+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.808+0000 7fda6b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:09.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.808+0000 7fda6b4739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:29:09.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.808+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.808+0000 7fda6b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:09.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.808+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.812+0000 7fda6b4739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:09.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.812+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.812+0000 7fda6b4739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:29:09.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.812+0000 7fda6b4739c0 20 searching for the correct realm 2024-09-12T19:29:09.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.820+0000 7fda6977a640 0 -- 172.21.15.97:0/856599716 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x5633fff84790 msgr2=0x5633fff86bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:09.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.824+0000 7fda68778640 0 -- 172.21.15.97:0/856599716 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x5633fff8c2e0 msgr2=0x5633fff8e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:09.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.828+0000 7fda6b4739c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T19:29:09.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.828+0000 7fda6b4739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:29:09.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.828+0000 7fda6b4739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:29:09.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.828+0000 7fda6b4739c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T19:29:09.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.828+0000 7fda6b4739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:29:09.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.828+0000 7fda6b4739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:29:09.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.828+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:09.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:09.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:29:09.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 zone default found 2024-09-12T19:29:09.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 4 Realm: () 2024-09-12T19:29:09.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T19:29:09.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T19:29:09.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:29:09.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 zonegroup default 2024-09-12T19:29:09.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:09.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:09.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:09.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 started sync module instance, tier type = 2024-09-12T19:29:09.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.832+0000 7fda6b4739c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T19:29:09.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.852+0000 7fda6b4739c0 20 add_watcher() i=0 2024-09-12T19:29:09.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.852+0000 7fda6b4739c0 20 add_watcher() i=1 2024-09-12T19:29:09.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.852+0000 7fda6b4739c0 20 add_watcher() i=2 2024-09-12T19:29:09.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.852+0000 7fda6b4739c0 20 add_watcher() i=3 2024-09-12T19:29:09.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.852+0000 7fda6b4739c0 20 add_watcher() i=4 2024-09-12T19:29:09.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.852+0000 7fda6b4739c0 20 add_watcher() i=5 2024-09-12T19:29:09.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.852+0000 7fda6b4739c0 20 add_watcher() i=6 2024-09-12T19:29:09.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.852+0000 7fda6b4739c0 20 add_watcher() i=7 2024-09-12T19:29:09.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.852+0000 7fda6b4739c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:29:09.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fd91efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:09.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:29:09.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:29:09.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 5 note: GC not initialized 2024-09-12T19:29:09.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fd91dfe3640 20 reqs_thread_entry: start 2024-09-12T19:29:09.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 20 init_complete bucket index max shards: 11 2024-09-12T19:29:09.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 20 Filter name: none 2024-09-12T19:29:09.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fd88f7fe640 20 reqs_thread_entry: start 2024-09-12T19:29:09.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T19:29:09.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:09.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T19:29:09.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T19:29:09.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T19:29:09.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:09.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:09.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T19:29:09.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T19:29:09.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T19:29:09.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.856+0000 7fda6b4739c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T19:29:09.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.860+0000 7fda6b4739c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T19:29:09.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.860+0000 7fda6b4739c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T19:29:09.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.860+0000 7fda6b4739c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T19:29:09.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.860+0000 7fd93ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166334076 cookie 94781337842144 notifier 8726 bl.length()=613 2024-09-12T19:29:09.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.860+0000 7fd93ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T19:29:09.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.860+0000 7fd93ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T19:29:09.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.864+0000 7fda6b4739c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T19:29:09.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.864+0000 7fda6b4739c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T19:29:09.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.864+0000 7fda6b4739c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T19:29:09.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.864+0000 7fd93f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166334077 cookie 94781337838816 notifier 8726 bl.length()=191 2024-09-12T19:29:09.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.864+0000 7fd93f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T19:29:09.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.864+0000 7fd93f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T19:29:09.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.868+0000 7fd91efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:09.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.872+0000 7fda6b4739c0 20 remove_watcher() i=0 2024-09-12T19:29:09.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.872+0000 7fda6b4739c0 2 removed watcher, disabling cache 2024-09-12T19:29:09.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.872+0000 7fda6b4739c0 20 remove_watcher() i=1 2024-09-12T19:29:09.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.876+0000 7fda6b4739c0 20 remove_watcher() i=2 2024-09-12T19:29:09.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.876+0000 7fda6b4739c0 20 remove_watcher() i=3 2024-09-12T19:29:09.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.880+0000 7fda6b4739c0 20 remove_watcher() i=4 2024-09-12T19:29:09.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.880+0000 7fda6b4739c0 20 remove_watcher() i=5 2024-09-12T19:29:09.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.884+0000 7fda6b4739c0 20 remove_watcher() i=6 2024-09-12T19:29:09.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:09.884+0000 7fda6b4739c0 20 remove_watcher() i=7 2024-09-12T19:29:10.116 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:10.116 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:10.174 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:10.174 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:10.250 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:10.250 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:10.436 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:10.437 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:10.512 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T19:29:10.513 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T19:29:10.521 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:10.521 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:10.612 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:10.612 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:10.700 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:10.700 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:10.811 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T19:29:10.844 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:29:10.844 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:29:10.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.884+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.888+0000 7f0c258439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.888+0000 7f0c258439c0 20 realm 2024-09-12T19:29:10.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.888+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.888+0000 7f0c258439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.888+0000 7f0c258439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:29:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.888+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.888+0000 7f0c258439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.888+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.888+0000 7f0c258439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.888+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.892+0000 7f0c258439c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:29:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.892+0000 7f0c258439c0 20 searching for the correct realm 2024-09-12T19:29:10.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.900+0000 7f0c23349640 0 -- 172.21.15.97:0/3577168192 >> [v2:172.21.15.97:6808/1696697607,v1:172.21.15.97:6809/1696697607] conn(0x559ba5627370 msgr2=0x559ba5629760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:10.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.904+0000 7f0c23b4a640 0 -- 172.21.15.97:0/3577168192 >> [v2:172.21.15.154:6808/3304684764,v1:172.21.15.154:6809/3304684764] conn(0x7f0c1405e780 msgr2=0x7f0c1405b4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:10.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T19:29:10.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:29:10.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:29:10.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T19:29:10.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:29:10.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:29:10.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:10.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:10.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:29:10.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 zone default found 2024-09-12T19:29:10.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 4 Realm: () 2024-09-12T19:29:10.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T19:29:10.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T19:29:10.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:29:10.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 zonegroup default 2024-09-12T19:29:10.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 started sync module instance, tier type = 2024-09-12T19:29:10.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.912+0000 7f0c258439c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T19:29:10.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.932+0000 7f0c258439c0 20 add_watcher() i=0 2024-09-12T19:29:10.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.932+0000 7f0c258439c0 20 add_watcher() i=1 2024-09-12T19:29:10.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.932+0000 7f0c258439c0 20 add_watcher() i=2 2024-09-12T19:29:10.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.932+0000 7f0c258439c0 20 add_watcher() i=3 2024-09-12T19:29:10.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.932+0000 7f0c258439c0 20 add_watcher() i=4 2024-09-12T19:29:10.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.932+0000 7f0c258439c0 20 add_watcher() i=5 2024-09-12T19:29:10.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.932+0000 7f0c258439c0 20 add_watcher() i=6 2024-09-12T19:29:10.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.936+0000 7f0c258439c0 20 add_watcher() i=7 2024-09-12T19:29:10.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.936+0000 7f0c258439c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:29:10.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.936+0000 7f0ad9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:29:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:29:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 5 note: GC not initialized 2024-09-12T19:29:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0ad8fe1640 20 reqs_thread_entry: start 2024-09-12T19:29:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 init_complete bucket index max shards: 11 2024-09-12T19:29:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 Filter name: none 2024-09-12T19:29:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0a527fc640 20 reqs_thread_entry: start 2024-09-12T19:29:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T19:29:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T19:29:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T19:29:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T19:29:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 INFO: main: starting shard=0 2024-09-12T19:29:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.940+0000 7f0c258439c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.0 2024-09-12T19:29:10.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:10.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 INFO: main: starting shard=1 2024-09-12T19:29:10.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.1 2024-09-12T19:29:10.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:10.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 INFO: main: starting shard=2 2024-09-12T19:29:10.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.2 2024-09-12T19:29:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 INFO: main: starting shard=3 2024-09-12T19:29:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.3 2024-09-12T19:29:10.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:10.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 INFO: main: starting shard=4 2024-09-12T19:29:10.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.4 2024-09-12T19:29:10.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:10.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 INFO: main: starting shard=5 2024-09-12T19:29:10.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.944+0000 7f0c258439c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.5 2024-09-12T19:29:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 INFO: main: starting shard=6 2024-09-12T19:29:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.6 2024-09-12T19:29:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 INFO: main: starting shard=7 2024-09-12T19:29:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.7 2024-09-12T19:29:10.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:10.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 INFO: main: starting shard=8 2024-09-12T19:29:10.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.8 2024-09-12T19:29:10.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:10.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 INFO: main: starting shard=9 2024-09-12T19:29:10.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.9 2024-09-12T19:29:10.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:10.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 INFO: main: starting shard=10 2024-09-12T19:29:10.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.948+0000 7f0c258439c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.10 2024-09-12T19:29:10.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.952+0000 7f0c258439c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:10.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.952+0000 7f0c258439c0 20 INFO: main: done 2024-09-12T19:29:10.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.952+0000 7f0ad9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:10.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.956+0000 7f0c258439c0 20 remove_watcher() i=0 2024-09-12T19:29:10.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.956+0000 7f0c258439c0 2 removed watcher, disabling cache 2024-09-12T19:29:10.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.960+0000 7f0c258439c0 20 remove_watcher() i=1 2024-09-12T19:29:10.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.960+0000 7f0c258439c0 20 remove_watcher() i=2 2024-09-12T19:29:10.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.964+0000 7f0c258439c0 20 remove_watcher() i=3 2024-09-12T19:29:10.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.964+0000 7f0c258439c0 20 remove_watcher() i=4 2024-09-12T19:29:10.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.968+0000 7f0c258439c0 20 remove_watcher() i=5 2024-09-12T19:29:10.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.968+0000 7f0c258439c0 20 remove_watcher() i=6 2024-09-12T19:29:10.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:10.972+0000 7f0c258439c0 20 remove_watcher() i=7 2024-09-12T19:29:10.994 INFO:tasks.workunit.client.0.smithi097.stderr:rados -p default.rgw.buckets.data ls | grep ca6efac9-54d1-4421-95ce-7e4c857ceaed 2024-09-12T19:29:11.018 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:29:11.018 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:29:11.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:11.144+0000 7efe26c40640 0 -- 172.21.15.97:0/1616870477 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x55ae49a9cc80 msgr2=0x55ae49a9f070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:11.205 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T19:29:11.205 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T19:29:11.205 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T19:29:12.681 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:12.681 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:12.766 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T19:29:13.206 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T19:29:13.231 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:29:13.231 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:29:13.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.272+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.272+0000 7f0e1267f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:13.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.272+0000 7f0e1267f9c0 20 realm 2024-09-12T19:29:13.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.272+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.276+0000 7f0e1267f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:13.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.276+0000 7f0e1267f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:29:13.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.276+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.276+0000 7f0e1267f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:13.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.276+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.276+0000 7f0e1267f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:13.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.276+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.276+0000 7f0e1267f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:29:13.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.276+0000 7f0e1267f9c0 20 searching for the correct realm 2024-09-12T19:29:13.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.284+0000 7f0e10986640 0 -- 172.21.15.97:0/3591051058 >> [v2:172.21.15.97:6824/193866730,v1:172.21.15.97:6825/193866730] conn(0x7f0e04039040 msgr2=0x7f0e0402b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:13.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.288+0000 7f0e10185640 0 -- 172.21.15.97:0/3591051058 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f0e080c2950 msgr2=0x7f0e080f0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:13.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T19:29:13.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:29:13.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:29:13.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T19:29:13.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:29:13.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:29:13.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:13.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:13.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:29:13.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 zone default found 2024-09-12T19:29:13.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 4 Realm: () 2024-09-12T19:29:13.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T19:29:13.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T19:29:13.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:29:13.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 zonegroup default 2024-09-12T19:29:13.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:13.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.296+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.300+0000 7f0e1267f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:13.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.300+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.300+0000 7f0e1267f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:13.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.300+0000 7f0e1267f9c0 20 started sync module instance, tier type = 2024-09-12T19:29:13.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.300+0000 7f0e1267f9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T19:29:13.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.316+0000 7f0e1267f9c0 20 add_watcher() i=0 2024-09-12T19:29:13.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.316+0000 7f0e1267f9c0 20 add_watcher() i=1 2024-09-12T19:29:13.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.316+0000 7f0e1267f9c0 20 add_watcher() i=2 2024-09-12T19:29:13.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.316+0000 7f0e1267f9c0 20 add_watcher() i=3 2024-09-12T19:29:13.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.316+0000 7f0e1267f9c0 20 add_watcher() i=4 2024-09-12T19:29:13.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.316+0000 7f0e1267f9c0 20 add_watcher() i=5 2024-09-12T19:29:13.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.316+0000 7f0e1267f9c0 20 add_watcher() i=6 2024-09-12T19:29:13.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.320+0000 7f0e1267f9c0 20 add_watcher() i=7 2024-09-12T19:29:13.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.320+0000 7f0e1267f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:29:13.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.320+0000 7f0cc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:13.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:29:13.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:29:13.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 5 note: GC not initialized 2024-09-12T19:29:13.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0cc57e2640 20 reqs_thread_entry: start 2024-09-12T19:29:13.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 init_complete bucket index max shards: 11 2024-09-12T19:29:13.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 Filter name: none 2024-09-12T19:29:13.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0c3effd640 20 reqs_thread_entry: start 2024-09-12T19:29:13.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T19:29:13.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:13.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T19:29:13.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T19:29:13.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T19:29:13.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 INFO: main: starting shard=0 2024-09-12T19:29:13.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.0 2024-09-12T19:29:13.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:13.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 INFO: main: starting shard=1 2024-09-12T19:29:13.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.324+0000 7f0e1267f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.1 2024-09-12T19:29:13.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:13.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: starting shard=2 2024-09-12T19:29:13.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.2 2024-09-12T19:29:13.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:13.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: starting shard=3 2024-09-12T19:29:13.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.3 2024-09-12T19:29:13.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:13.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: starting shard=4 2024-09-12T19:29:13.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.4 2024-09-12T19:29:13.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:13.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: starting shard=5 2024-09-12T19:29:13.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.5 2024-09-12T19:29:13.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:13.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: starting shard=6 2024-09-12T19:29:13.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.6 2024-09-12T19:29:13.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:13.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 INFO: main: starting shard=7 2024-09-12T19:29:13.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.328+0000 7f0e1267f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.7 2024-09-12T19:29:13.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0e1267f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:13.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0e1267f9c0 20 INFO: main: starting shard=8 2024-09-12T19:29:13.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0e1267f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.8 2024-09-12T19:29:13.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0e1267f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:13.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0e1267f9c0 20 INFO: main: starting shard=9 2024-09-12T19:29:13.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0e1267f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.9 2024-09-12T19:29:13.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0e1267f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:13.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0e1267f9c0 20 INFO: main: starting shard=10 2024-09-12T19:29:13.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0e1267f9c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.10 2024-09-12T19:29:13.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0e1267f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:29:13.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0e1267f9c0 20 INFO: main: done 2024-09-12T19:29:13.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.332+0000 7f0cc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:13.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.336+0000 7f0e1267f9c0 20 remove_watcher() i=0 2024-09-12T19:29:13.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.336+0000 7f0e1267f9c0 2 removed watcher, disabling cache 2024-09-12T19:29:13.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.340+0000 7f0e1267f9c0 20 remove_watcher() i=1 2024-09-12T19:29:13.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.340+0000 7f0e1267f9c0 20 remove_watcher() i=2 2024-09-12T19:29:13.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.344+0000 7f0e1267f9c0 20 remove_watcher() i=3 2024-09-12T19:29:13.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.344+0000 7f0e1267f9c0 20 remove_watcher() i=4 2024-09-12T19:29:13.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.348+0000 7f0e1267f9c0 20 remove_watcher() i=5 2024-09-12T19:29:13.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.352+0000 7f0e1267f9c0 20 remove_watcher() i=6 2024-09-12T19:29:13.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.352+0000 7f0e1267f9c0 20 remove_watcher() i=7 2024-09-12T19:29:13.374 INFO:tasks.workunit.client.0.smithi097.stderr:rados -p default.rgw.buckets.data ls | grep d7c8a136-41cc-4d75-9358-68c3a1213b18 2024-09-12T19:29:13.397 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:29:13.397 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:29:13.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:13.532+0000 7fd0e79c6640 0 -- 172.21.15.97:0/1914273904 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x7fd0e0028790 msgr2=0x7fd0e0001260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:13.563 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T19:29:13.564 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T19:29:13.566 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:13.566 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:13.626 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:13.626 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:13.732 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:13.732 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:13.809 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T19:29:15.256 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:15.257 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:15.437 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T19:29:15.437 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T19:29:15.893 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:15.893 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:16.002 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:16.002 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:16.068 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T19:29:16.068 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-12T19:29:16.071 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:16.071 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:16.200 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:16.200 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:16.361 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:16.361 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:16.435 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T19:29:17.890 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:17.890 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:18.028 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:18.028 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:20.165 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T19:29:20.619 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T19:29:20.651 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:29:20.651 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:29:20.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.688+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.692+0000 7fab6a1089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:20.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.692+0000 7fab6a1089c0 20 realm 2024-09-12T19:29:20.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.692+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.692+0000 7fab6a1089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:20.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.692+0000 7fab6a1089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:29:20.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.692+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.692+0000 7fab6a1089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:20.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.692+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.692+0000 7fab6a1089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:20.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.692+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.696+0000 7fab6a1089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:29:20.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.696+0000 7fab6a1089c0 20 searching for the correct realm 2024-09-12T19:29:20.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.700+0000 7fab5ffff640 0 -- 172.21.15.97:0/3932037183 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7fab58067040 msgr2=0x7fab58083150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:20.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.704+0000 7fab6840f640 0 -- 172.21.15.97:0/3932037183 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55d59d1dc9a0 msgr2=0x55d59d1dee20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:20.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T19:29:20.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:29:20.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:29:20.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T19:29:20.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:29:20.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:29:20.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:20.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:20.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:29:20.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 zone default found 2024-09-12T19:29:20.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 4 Realm: () 2024-09-12T19:29:20.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T19:29:20.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T19:29:20.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:29:20.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 zonegroup default 2024-09-12T19:29:20.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.712+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.716+0000 7fab6a1089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:20.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.716+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.716+0000 7fab6a1089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:20.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.716+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.716+0000 7fab6a1089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:20.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.716+0000 7fab6a1089c0 20 started sync module instance, tier type = 2024-09-12T19:29:20.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.716+0000 7fab6a1089c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T19:29:20.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.736+0000 7fab6a1089c0 20 add_watcher() i=0 2024-09-12T19:29:20.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.736+0000 7fab6a1089c0 20 add_watcher() i=1 2024-09-12T19:29:20.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.736+0000 7fab6a1089c0 20 add_watcher() i=2 2024-09-12T19:29:20.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.736+0000 7fab6a1089c0 20 add_watcher() i=3 2024-09-12T19:29:20.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.736+0000 7fab6a1089c0 20 add_watcher() i=4 2024-09-12T19:29:20.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.736+0000 7fab6a1089c0 20 add_watcher() i=5 2024-09-12T19:29:20.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.736+0000 7fab6a1089c0 20 add_watcher() i=6 2024-09-12T19:29:20.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.736+0000 7fab6a1089c0 20 add_watcher() i=7 2024-09-12T19:29:20.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.736+0000 7fab6a1089c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:29:20.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7faa1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:20.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:29:20.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:29:20.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 5 note: GC not initialized 2024-09-12T19:29:20.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7faa1cfe1640 20 reqs_thread_entry: start 2024-09-12T19:29:20.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 20 init_complete bucket index max shards: 11 2024-09-12T19:29:20.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 20 Filter name: none 2024-09-12T19:29:20.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fa9967fc640 20 reqs_thread_entry: start 2024-09-12T19:29:20.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T19:29:20.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T19:29:20.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T19:29:20.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T19:29:20.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.782 : miss 2024-09-12T19:29:20.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.740+0000 7fab6a1089c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:20.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T19:29:20.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.782 info.flags=0x17 2024-09-12T19:29:20.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.782 to cache LRU end 2024-09-12T19:29:20.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T19:29:20.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T19:29:20.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:98539659-fdaf-41ce-847d-239ff89323af.4641.782 2024-09-12T19:29:20.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.0 2024-09-12T19:29:20.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T19:29:20.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.1 2024-09-12T19:29:20.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T19:29:20.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.2 2024-09-12T19:29:20.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T19:29:20.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.3 2024-09-12T19:29:20.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T19:29:20.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.744+0000 7fab6a1089c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.4 2024-09-12T19:29:20.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T19:29:20.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.5 2024-09-12T19:29:20.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T19:29:20.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.6 2024-09-12T19:29:20.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T19:29:20.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.7 2024-09-12T19:29:20.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T19:29:20.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.8 2024-09-12T19:29:20.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T19:29:20.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.9 2024-09-12T19:29:20.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T19:29:20.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.748+0000 7fab6a1089c0 20 bucket index object: :.dir.98539659-fdaf-41ce-847d-239ff89323af.4641.782.10 2024-09-12T19:29:20.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.752+0000 7fab6a1089c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T19:29:20.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.752+0000 7fab6a1089c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T19:29:20.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.752+0000 7faa1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:20.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.756+0000 7fab6a1089c0 20 remove_watcher() i=0 2024-09-12T19:29:20.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.756+0000 7fab6a1089c0 2 removed watcher, disabling cache 2024-09-12T19:29:20.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.756+0000 7fab6a1089c0 20 remove_watcher() i=1 2024-09-12T19:29:20.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.760+0000 7fab6a1089c0 20 remove_watcher() i=2 2024-09-12T19:29:20.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.760+0000 7fab6a1089c0 20 remove_watcher() i=3 2024-09-12T19:29:20.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.764+0000 7fab6a1089c0 20 remove_watcher() i=4 2024-09-12T19:29:20.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.764+0000 7fab6a1089c0 20 remove_watcher() i=5 2024-09-12T19:29:20.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.768+0000 7fab6a1089c0 20 remove_watcher() i=6 2024-09-12T19:29:20.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-12T19:29:20.772+0000 7fab6a1089c0 20 remove_watcher() i=7 2024-09-12T19:29:20.791 INFO:tasks.workunit.client.0.smithi097.stderr:Deleting bucket versioning-bucket 2024-09-12T19:29:20.793 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:20.793 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:20.833 INFO:tasks.workunit.client.0.smithi097.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:29:20.833 INFO:tasks.workunit.client.0.smithi097.stderr: warnings.warn( 2024-09-12T19:29:21.144 INFO:tasks.workunit.client.0.smithi097.stderr:Completed bucket versioning tests 2024-09-12T19:29:21.144 INFO:tasks.workunit.client.0.smithi097.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T19:29:21.144 INFO:tasks.workunit.client.0.smithi097.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T19:29:21.145 INFO:tasks.workunit.client.0.smithi097.stdout:connected to https://localhost:443 2024-09-12T19:29:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:+ deactivate 2024-09-12T19:29:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T19:29:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T19:29:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:+ export PATH 2024-09-12T19:29:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T19:29:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-12T19:29:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T19:29:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:+ hash -r 2024-09-12T19:29:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-12T19:29:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset VIRTUAL_ENV 2024-09-12T19:29:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T19:29:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T19:29:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset -f deactivate 2024-09-12T19:29:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:+ echo OK. 2024-09-12T19:29:21.249 INFO:tasks.workunit.client.0.smithi097.stdout:OK. 2024-09-12T19:29:21.249 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T19:29:21.250 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T19:29:21.306 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T19:29:21.306 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T19:29:21.688 DEBUG:teuthology.parallel:result is None 2024-09-12T19:29:21.689 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T19:29:21.700 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T19:29:21.701 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T19:29:21.748 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T19:29:21.748 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T19:29:21.758 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T19:29:21.795 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T19:29:21.795 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T19:29:21.796 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T19:29:21.846 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T19:29:21.846 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T19:29:21.877 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:29:21.877 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:29:21.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.912+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:21.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.912+0000 7f86079a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:21.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.912+0000 7f86079a89c0 20 realm 2024-09-12T19:29:21.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.912+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:21.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.916+0000 7f86079a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:21.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.916+0000 7f86079a89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:29:21.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.916+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:21.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.916+0000 7f86079a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:21.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.916+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:21.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.916+0000 7f86079a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:21.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.916+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:21.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.916+0000 7f86079a89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:29:21.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.916+0000 7f86079a89c0 20 searching for the correct realm 2024-09-12T19:29:21.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.924+0000 7f86054ae640 0 -- 172.21.15.97:0/1166755460 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f85f80f1430 msgr2=0x7f85f80f1850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T19:29:21.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.932+0000 7f86054ae640 0 -- 172.21.15.97:0/1166755460 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f8600019460 msgr2=0x7f86000198e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:21.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.936+0000 7f86079a89c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T19:29:21.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.936+0000 7f86079a89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:29:21.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.936+0000 7f86079a89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:29:21.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.936+0000 7f86079a89c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T19:29:21.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.936+0000 7f86079a89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:29:21.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.936+0000 7f86079a89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:29:21.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.936+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:21.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.936+0000 7f86079a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:21.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.936+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:21.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:21.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:21.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:29:21.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 zone default found 2024-09-12T19:29:21.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 4 Realm: () 2024-09-12T19:29:21.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T19:29:21.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T19:29:21.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:29:21.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 zonegroup default 2024-09-12T19:29:21.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:21.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:21.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:21.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:21.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:21.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:21.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 started sync module instance, tier type = 2024-09-12T19:29:21.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.940+0000 7f86079a89c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T19:29:21.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.960+0000 7f86079a89c0 20 add_watcher() i=0 2024-09-12T19:29:21.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.960+0000 7f86079a89c0 20 add_watcher() i=1 2024-09-12T19:29:21.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.960+0000 7f86079a89c0 20 add_watcher() i=2 2024-09-12T19:29:21.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.960+0000 7f86079a89c0 20 add_watcher() i=3 2024-09-12T19:29:21.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.960+0000 7f86079a89c0 20 add_watcher() i=4 2024-09-12T19:29:21.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.960+0000 7f86079a89c0 20 add_watcher() i=5 2024-09-12T19:29:21.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.960+0000 7f86079a89c0 20 add_watcher() i=6 2024-09-12T19:29:21.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.960+0000 7f86079a89c0 20 add_watcher() i=7 2024-09-12T19:29:21.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.960+0000 7f86079a89c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:29:21.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.964+0000 7f84bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:21.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.964+0000 7f86079a89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:29:21.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:21.964+0000 7f86079a89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:29:22.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.044+0000 7f84ba7e4640 20 reqs_thread_entry: start 2024-09-12T19:29:22.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.048+0000 7f86079a89c0 20 init_complete bucket index max shards: 11 2024-09-12T19:29:22.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.048+0000 7f86079a89c0 20 Filter name: none 2024-09-12T19:29:22.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.048+0000 7f86079a89c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T19:29:22.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.048+0000 7f842bfff640 20 reqs_thread_entry: start 2024-09-12T19:29:22.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.048+0000 7f86079a89c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:22.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.048+0000 7f86079a89c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T19:29:22.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.048+0000 7f86079a89c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T19:29:22.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.048+0000 7f86079a89c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T19:29:22.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.048+0000 7f86079a89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T19:29:22.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.048+0000 7f86079a89c0 10 removing key index: KQORFSLZHORDRXRBNCNJ 2024-09-12T19:29:22.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.052+0000 7f86079a89c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:KQORFSLZHORDRXRBNCNJ, ofs0, ns] 2024-09-12T19:29:22.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.052+0000 7f84e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166334085 cookie 93873460658992 notifier 9474 bl.length()=170 2024-09-12T19:29:22.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.052+0000 7f86079a89c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T19:29:22.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.056+0000 7f86079a89c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T19:29:22.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.056+0000 7f84d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333715 cookie 93873460638464 notifier 9474 bl.length()=181 2024-09-12T19:29:22.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.060+0000 7f86079a89c0 10 removing user buckets index 2024-09-12T19:29:22.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.060+0000 7f86079a89c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T19:29:22.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.060+0000 7f84d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166334086 cookie 93873460658992 notifier 9474 bl.length()=172 2024-09-12T19:29:22.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.064+0000 7f86079a89c0 10 removing user index: tester.client.0 2024-09-12T19:29:22.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.064+0000 7f86079a89c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T19:29:22.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.064+0000 7f86079a89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T19:29:22.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.064+0000 7f84d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166334087 cookie 93873460656144 notifier 9474 bl.length()=164 2024-09-12T19:29:22.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.068+0000 7f84bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:22.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.072+0000 7f86079a89c0 20 remove_watcher() i=0 2024-09-12T19:29:22.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.072+0000 7f86079a89c0 2 removed watcher, disabling cache 2024-09-12T19:29:22.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.076+0000 7f86079a89c0 20 remove_watcher() i=1 2024-09-12T19:29:22.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.076+0000 7f86079a89c0 20 remove_watcher() i=2 2024-09-12T19:29:22.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.080+0000 7f86079a89c0 20 remove_watcher() i=3 2024-09-12T19:29:22.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.080+0000 7f86079a89c0 20 remove_watcher() i=4 2024-09-12T19:29:22.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.084+0000 7f86079a89c0 20 remove_watcher() i=5 2024-09-12T19:29:22.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.084+0000 7f86079a89c0 20 remove_watcher() i=6 2024-09-12T19:29:22.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:22.088+0000 7f86079a89c0 20 remove_watcher() i=7 2024-09-12T19:29:22.109 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T19:29:22.119 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T19:29:22.148 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T19:29:22.196 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T19:29:22.207 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T19:29:22.207 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:29:22.215 INFO:tasks.rgw.client.0.smithi097.stdout:2024-09-12T19:29:22.208+0000 e571640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 39819) UID: 0 2024-09-12T19:29:22.218 INFO:tasks.rgw.client.0.smithi097.stdout:2024-09-12T19:29:22.212+0000 8ed9f80 -1 shutting down 2024-09-12T19:29:39.070 INFO:tasks.rgw.client.0.smithi097.stderr:==00:01:52:50.429 39822== could not unlink /tmp/vgdb-pipe-from-vgdb-to-39822-by-root-on-??? 2024-09-12T19:29:39.071 INFO:tasks.rgw.client.0.smithi097.stderr:==00:01:52:50.429 39822== could not unlink /tmp/vgdb-pipe-to-vgdb-from-39822-by-root-on-??? 2024-09-12T19:29:39.071 INFO:tasks.rgw.client.0.smithi097.stderr:==00:01:52:50.429 39822== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-39822-by-root-on-??? 2024-09-12T19:29:40.512 INFO:tasks.rgw.client.0:Stopped 2024-09-12T19:29:40.512 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T19:29:40.519 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T19:29:40.573 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T19:29:40.627 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T19:29:40.628 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T19:29:40.628 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T19:29:40.707 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:29:40.708 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:29:40.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.747+0000 7f1deb59e9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:40.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:40.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 20 realm 2024-09-12T19:29:40.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:40.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:40.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:29:40.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:40.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:40.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:40.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:40.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:40.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:29:40.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.751+0000 7f1deb59e9c0 20 searching for the correct realm 2024-09-12T19:29:40.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.755+0000 7f1de90a4640 0 -- 172.21.15.97:0/2458095298 >> [v2:172.21.15.97:6800/642959985,v1:172.21.15.97:6801/642959985] conn(0x7f1ddc0cc070 msgr2=0x7f1ddc0fa440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:40.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.763+0000 7f1de90a4640 0 -- 172.21.15.97:0/2458095298 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f1de4075c20 msgr2=0x7f1de4094ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T19:29:40.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.979+0000 7f1deb59e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6 2024-09-12T19:29:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.979+0000 7f1deb59e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:29:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.979+0000 7f1deb59e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:29:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.979+0000 7f1deb59e9c0 20 RGWRados::pool_iterate: got zone_info.98539659-fdaf-41ce-847d-239ff89323af 2024-09-12T19:29:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.979+0000 7f1deb59e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:29:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.979+0000 7f1deb59e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:29:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.979+0000 7f1deb59e9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:29:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:29:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 zone default found 2024-09-12T19:29:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 4 Realm: () 2024-09-12T19:29:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 4 ZoneGroup: default (8c49bbe2-7b0d-4e00-98f2-1897dc74e5a6) 2024-09-12T19:29:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 4 Zone: default (98539659-fdaf-41ce-847d-239ff89323af) 2024-09-12T19:29:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:29:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 zonegroup default 2024-09-12T19:29:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.983+0000 7f1deb59e9c0 20 rados->read ofs=0 len=0 2024-09-12T19:29:40.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.987+0000 7f1deb59e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:29:40.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.987+0000 7f1deb59e9c0 20 started sync module instance, tier type = 2024-09-12T19:29:40.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:40.987+0000 7f1deb59e9c0 20 started zone id=98539659-fdaf-41ce-847d-239ff89323af (name=default) with tier type = 2024-09-12T19:29:41.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.007+0000 7f1deb59e9c0 20 add_watcher() i=0 2024-09-12T19:29:41.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.007+0000 7f1deb59e9c0 20 add_watcher() i=1 2024-09-12T19:29:41.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.007+0000 7f1deb59e9c0 20 add_watcher() i=2 2024-09-12T19:29:41.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.007+0000 7f1deb59e9c0 20 add_watcher() i=3 2024-09-12T19:29:41.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.007+0000 7f1deb59e9c0 20 add_watcher() i=4 2024-09-12T19:29:41.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.007+0000 7f1deb59e9c0 20 add_watcher() i=5 2024-09-12T19:29:41.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.007+0000 7f1deb59e9c0 20 add_watcher() i=6 2024-09-12T19:29:41.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.011+0000 7f1deb59e9c0 20 add_watcher() i=7 2024-09-12T19:29:41.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.011+0000 7f1deb59e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:29:41.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.015+0000 7f1deb59e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:29:41.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.015+0000 7f1deb59e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:29:41.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.015+0000 7f1c9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:41.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.103+0000 7f1c9e7e4640 20 reqs_thread_entry: start 2024-09-12T19:29:41.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.103+0000 7f1deb59e9c0 20 init_complete bucket index max shards: 11 2024-09-12T19:29:41.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.103+0000 7f1deb59e9c0 20 Filter name: none 2024-09-12T19:29:41.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.103+0000 7f1c0ffff640 20 reqs_thread_entry: start 2024-09-12T19:29:41.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T19:29:41.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53448' 2024-09-12T19:29:41.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3018909922802567858', time=2024-09-12T20:30:15.615966+0000, chain.objs.size()=1 2024-09-12T19:29:41.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.166__shadow_.BeOh1HRYjiom6KqLMyPHJ6xSY7pBLIj_0 2024-09-12T19:29:41.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14335550583110887797', time=2024-09-12T20:31:08.511709+0000, chain.objs.size()=1 2024-09-12T19:29:41.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.188__shadow_.kRU6MVDu-tCvj2V79gkksaDSMrBStpJ_0 2024-09-12T19:29:41.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ZzxDmfP-PiPVYE4dUxK5J1UUakQiq9b', time=2024-09-12T20:31:56.779367+0000, chain.objs.size()=1 2024-09-12T19:29:41.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.201__multipart_mymultipart.2~ZzxDmfP-PiPVYE4dUxK5J1UUakQiq9b.1 2024-09-12T19:29:41.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17087183913786967041', time=2024-09-12T20:35:25.536795+0000, chain.objs.size()=1 2024-09-12T19:29:41.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.230__shadow_.7Dbvk-a6W-T8zWag9ahIYsUTRhdr5zx_0 2024-09-12T19:29:41.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1392846212933860767', time=2024-09-12T20:35:37.246390+0000, chain.objs.size()=1 2024-09-12T19:29:41.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.235__shadow_.sP4uml54_cu8LJsfS0xyTdJmsoaOnNI_0 2024-09-12T19:29:41.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7158587868001859015', time=2024-09-12T20:35:59.519470+0000, chain.objs.size()=1 2024-09-12T19:29:41.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.243__shadow_.TN_YtD3jnYorkKhVgq0LojxO_1sG06Q_0 2024-09-12T19:29:41.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10429405246177947078', time=2024-09-12T20:36:10.201996+0000, chain.objs.size()=1 2024-09-12T19:29:41.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.247__shadow_.EGbigCx30eHc3yv92OZpNkgejv3Tmgz_0 2024-09-12T19:29:41.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.34925345334405230', time=2024-09-12T20:38:22.400430+0000, chain.objs.size()=1 2024-09-12T19:29:41.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vQjAaoT_MIDee8D-3W3xlxO2sWauI7v_0 2024-09-12T19:29:41.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16026278389946477241', time=2024-09-12T20:38:22.907379+0000, chain.objs.size()=1 2024-09-12T19:29:41.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.p2vL3xZMf4A6VvAU5h9bpRZ2xp4aUgS_0 2024-09-12T19:29:41.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16534663724975401960', time=2024-09-12T20:38:22.993397+0000, chain.objs.size()=1 2024-09-12T19:29:41.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.oWo8Jq_NLexTabvj6-VIW19F90U86dy_0 2024-09-12T19:29:41.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3635827377354712330', time=2024-09-12T20:38:23.154168+0000, chain.objs.size()=1 2024-09-12T19:29:41.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.VW2RQSKXPGvyhJW6NtFcINLiZUJlPtk_0 2024-09-12T19:29:41.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15109860763958542185', time=2024-09-12T20:38:23.375629+0000, chain.objs.size()=1 2024-09-12T19:29:41.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jQM-zOghNZUaCbsp1e7efqwwLKYsYc5_0 2024-09-12T19:29:41.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16284236838019281200', time=2024-09-12T20:38:23.582570+0000, chain.objs.size()=1 2024-09-12T19:29:41.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.f3YgVZlclrU2MyMDoW3QTnMmD-VM4C6_0 2024-09-12T19:29:41.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4509481605626889991', time=2024-09-12T20:38:23.870848+0000, chain.objs.size()=1 2024-09-12T19:29:41.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.uN0ht7IRFsTQY3vPSnG_rgRXWf4nukP_0 2024-09-12T19:29:41.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11624404617500284931', time=2024-09-12T20:38:24.303994+0000, chain.objs.size()=1 2024-09-12T19:29:41.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.N9nIssVzPo354BgILuFov3g1TNKQvo5_0 2024-09-12T19:29:41.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7653584635078236723', time=2024-09-12T20:38:24.552851+0000, chain.objs.size()=1 2024-09-12T19:29:41.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.cvG-X3h6w0kAOnpvY2bctWz9lmN81u4_0 2024-09-12T19:29:41.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14140379982334066979', time=2024-09-12T20:38:24.565486+0000, chain.objs.size()=1 2024-09-12T19:29:41.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ps0dzQXS9xqCV4qz0cC0PfH-pkaIdQL_0 2024-09-12T19:29:41.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3167493801956876111', time=2024-09-12T20:38:24.910236+0000, chain.objs.size()=1 2024-09-12T19:29:41.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WTLKH3qIr3iOOPxUuZLSkaKYjmxjk6D_0 2024-09-12T19:29:41.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12196072364884551397', time=2024-09-12T20:38:25.350161+0000, chain.objs.size()=1 2024-09-12T19:29:41.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.H50d8sACifgIEFaAnu8t79muh2Ve23z_0 2024-09-12T19:29:41.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10073001831810341862', time=2024-09-12T20:38:27.223573+0000, chain.objs.size()=1 2024-09-12T19:29:41.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.2tpNgWsqAv_qR6ZlI6fADzyyoIrBof2_0 2024-09-12T19:29:41.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15371508046574714930', time=2024-09-12T20:38:28.320181+0000, chain.objs.size()=1 2024-09-12T19:29:41.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.FcLRQ-qWkucG3cSarvCZCSJRxQdIX3k_0 2024-09-12T19:29:41.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5443573372946652285', time=2024-09-12T20:38:28.921233+0000, chain.objs.size()=1 2024-09-12T19:29:41.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.n0j_CDXhx6oNDrUbKyJoH1-_APHiBwW_0 2024-09-12T19:29:41.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9788422781287980310', time=2024-09-12T20:38:30.285196+0000, chain.objs.size()=1 2024-09-12T19:29:41.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.w6za8WIMyN2HnMs0V8EXuoLtgPRwtCg_0 2024-09-12T19:29:41.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3519773777081918954', time=2024-09-12T20:38:30.785036+0000, chain.objs.size()=1 2024-09-12T19:29:41.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.56ywFgFkO_huf4kiIZ2gWxaAs7TlA4K_0 2024-09-12T19:29:41.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12722447120081825995', time=2024-09-12T20:38:33.133329+0000, chain.objs.size()=1 2024-09-12T19:29:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.N8vupDaAkc6UFs8odHPmH7W2uszhVh4_0 2024-09-12T19:29:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11276150604424742338', time=2024-09-12T20:38:34.342548+0000, chain.objs.size()=1 2024-09-12T19:29:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rhLjXjno0dQv2VDv6BsZcHOfWRKk-97_0 2024-09-12T19:29:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.275768195468253140', time=2024-09-12T20:38:35.073185+0000, chain.objs.size()=1 2024-09-12T19:29:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.iWKDK5WbjiM3NI2elbkxY7ikrH82k2S_0 2024-09-12T19:29:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10699108801581520842', time=2024-09-12T20:38:35.847728+0000, chain.objs.size()=1 2024-09-12T19:29:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nDzi5bNkIl2GfWjyW5gv-z6aeV6GPOZ_0 2024-09-12T19:29:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1844456381957987774', time=2024-09-12T20:38:38.179136+0000, chain.objs.size()=1 2024-09-12T19:29:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._kfAQQSyjxP5Q66yaYWx9kifibzACQT_0 2024-09-12T19:29:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4109766839475406741', time=2024-09-12T20:38:39.535275+0000, chain.objs.size()=1 2024-09-12T19:29:41.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4n9lLZ5AMmX8GesP3xgIckeqhJNm10I_0 2024-09-12T19:29:41.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8721585124603279398', time=2024-09-12T20:38:40.477878+0000, chain.objs.size()=1 2024-09-12T19:29:41.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.IcxMcInTHS7C-RFIxwZQ51QjIyGF_-z_0 2024-09-12T19:29:41.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3872321100980873932', time=2024-09-12T20:38:42.894601+0000, chain.objs.size()=1 2024-09-12T19:29:41.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GQdbVZboK6u7QoBRxpyZ6ZdypIF_sP6_0 2024-09-12T19:29:41.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3979498843508330233', time=2024-09-12T20:38:44.987657+0000, chain.objs.size()=1 2024-09-12T19:29:41.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dA8YLdMpqEWFezdrmOUvca-gy5M9yoI_0 2024-09-12T19:29:41.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8764470745159818835', time=2024-09-12T20:38:45.845443+0000, chain.objs.size()=1 2024-09-12T19:29:41.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wVcNXh3uq1A0YgdSgPw23WtF4xEG99e_0 2024-09-12T19:29:41.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15369302424021820037', time=2024-09-12T20:38:47.412303+0000, chain.objs.size()=1 2024-09-12T19:29:41.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5vf0Bhyp8KvxyxvKtvQhIA6hgoJssTT_0 2024-09-12T19:29:41.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3151510026951737312', time=2024-09-12T20:38:49.548328+0000, chain.objs.size()=1 2024-09-12T19:29:41.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.TbwAG2cXayo8o6ESo7NEyPqGJ0oOM9q_0 2024-09-12T19:29:41.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17192354986793496181', time=2024-09-12T20:39:12.493481+0000, chain.objs.size()=1 2024-09-12T19:29:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.272__shadow_.YTFwp9qvBqAdn4CH6woQUIOw6hO32To_0 2024-09-12T19:29:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2497363141616522667', time=2024-09-12T20:39:21.319568+0000, chain.objs.size()=1 2024-09-12T19:29:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.276__shadow_.NARBOtSlFI3L56MQszOdM6Fav5gaoIN_0 2024-09-12T19:29:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8405598654466312591', time=2024-09-12T20:39:21.348872+0000, chain.objs.size()=1 2024-09-12T19:29:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.276__shadow_.cxRbI3QxOZ2rRvtM4cRWoXnMWwsI6c8_0 2024-09-12T19:29:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5139366997217852365', time=2024-09-12T20:39:23.586724+0000, chain.objs.size()=1 2024-09-12T19:29:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.277__shadow_.SwqGEOj4qB9Bu2jUeqKqkJ3EWVSiYDs_0 2024-09-12T19:29:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13610184046435506110', time=2024-09-12T20:39:49.225719+0000, chain.objs.size()=1 2024-09-12T19:29:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.288__shadow_.TCVV8-rsbAMB_o2dqZkXZGgFh2w_h9D_0 2024-09-12T19:29:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14501991849810677777', time=2024-09-12T20:39:53.794666+0000, chain.objs.size()=1 2024-09-12T19:29:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.290__shadow_.1ImAGhxqvZ101llsXNjZhaMiYangL25_0 2024-09-12T19:29:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8952072819894642159', time=2024-09-12T20:40:01.742969+0000, chain.objs.size()=1 2024-09-12T19:29:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.Nmt9Z9boP1nkp3908p36OtIyeoBaXpg_0 2024-09-12T19:29:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16967761613305851754', time=2024-09-12T20:40:21.942441+0000, chain.objs.size()=1 2024-09-12T19:29:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.299__shadow_.7kt-tROR-DHiHoNXB2Uo6E7oxDfLUaQ_0 2024-09-12T19:29:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2790440697547104687', time=2024-09-12T20:40:24.376028+0000, chain.objs.size()=1 2024-09-12T19:29:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.300__shadow_.0LmF7dQSejTmvWWh5woj8ncUrKiL34c_0 2024-09-12T19:29:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2691567173914385491', time=2024-09-12T20:40:31.165289+0000, chain.objs.size()=1 2024-09-12T19:29:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.303__shadow_.V6L6uwS3mBEq6NJJHww6YUgaPL0AXNl_0 2024-09-12T19:29:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12909170877868807360', time=2024-09-12T20:43:02.341009+0000, chain.objs.size()=1 2024-09-12T19:29:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.swPRmtXkBxz5WrweLp8u0Rz7h1Z2Kmw_0 2024-09-12T19:29:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2331858541599366303', time=2024-09-12T20:43:03.262489+0000, chain.objs.size()=1 2024-09-12T19:29:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jcV4MHxyL7MsHeFoFMxUEH_3ODWakW3_0 2024-09-12T19:29:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1576903445178189408', time=2024-09-12T20:43:04.684262+0000, chain.objs.size()=1 2024-09-12T19:29:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.oVqbY8GUXdZlLG-Bu9QpoqaalmJAsvX_0 2024-09-12T19:29:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6531810963989311737', time=2024-09-12T20:43:04.816460+0000, chain.objs.size()=1 2024-09-12T19:29:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.MzRANLULuOtSFjpMqbLdckL2gVN6iFj_0 2024-09-12T19:29:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18234616895255087841', time=2024-09-12T20:43:04.952571+0000, chain.objs.size()=1 2024-09-12T19:29:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0Av2HUDF7eMMk2lOm-byedqJ5Q6sqt8_0 2024-09-12T19:29:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9883085724404755299', time=2024-09-12T20:43:05.204957+0000, chain.objs.size()=1 2024-09-12T19:29:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ET3DNCfmpsdWcpkXQXYGF341z3qzb-p_0 2024-09-12T19:29:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.735823422909309545', time=2024-09-12T20:43:07.477499+0000, chain.objs.size()=1 2024-09-12T19:29:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KSb8coj1zE5_HqV0E4ZaSXL3mS8r_8__0 2024-09-12T19:29:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16192760534317406882', time=2024-09-12T20:43:07.540002+0000, chain.objs.size()=1 2024-09-12T19:29:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-UYxW9W5rrsVHzfDlBi2P052Uiayyh9_0 2024-09-12T19:29:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4984556371779652772', time=2024-09-12T20:43:07.636049+0000, chain.objs.size()=1 2024-09-12T19:29:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.iboUdHrMPDbsY9B5XdnELtqeBLMGfqR_0 2024-09-12T19:29:41.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7308265058964360869', time=2024-09-12T20:43:07.876279+0000, chain.objs.size()=1 2024-09-12T19:29:41.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.48eXJSXgQY6RZtQfGtN33K6-1BH-Pdm_0 2024-09-12T19:29:41.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2942653474507138496', time=2024-09-12T20:43:08.238333+0000, chain.objs.size()=1 2024-09-12T19:29:41.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._YUh6pTQslJdXjLNcjRzFCGmjXb3yyH_0 2024-09-12T19:29:41.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6052246491654225169', time=2024-09-12T20:43:08.868599+0000, chain.objs.size()=1 2024-09-12T19:29:41.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.OUyIIgc4tc78SZoFdC8vxs_WKx9v76B_0 2024-09-12T19:29:41.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17656729662285978434', time=2024-09-12T20:43:10.424266+0000, chain.objs.size()=1 2024-09-12T19:29:41.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cbaKdclcEkBj_eDXyx-hdvB8SnpoQDb_0 2024-09-12T19:29:41.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13791463143243655517', time=2024-09-12T20:43:14.301479+0000, chain.objs.size()=1 2024-09-12T19:29:41.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fdbemvJqS256buResuczoLuFqbW0Ui4_0 2024-09-12T19:29:41.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8779692026506581389', time=2024-09-12T20:43:14.392688+0000, chain.objs.size()=1 2024-09-12T19:29:41.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TAHtF52wbO8OXYMOvYnpcXQ8J3bc3f5_0 2024-09-12T19:29:41.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1376282599921358832', time=2024-09-12T20:43:14.504101+0000, chain.objs.size()=1 2024-09-12T19:29:41.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.UdNgQ72oDqJ8edSrxuor47qCRV86ouo_0 2024-09-12T19:29:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15798239996231928542', time=2024-09-12T20:43:16.414279+0000, chain.objs.size()=1 2024-09-12T19:29:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.44CG-PmdJXGqPRCuvJ33IKmgieppiRX_0 2024-09-12T19:29:41.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1163334805708489472', time=2024-09-12T20:43:17.701487+0000, chain.objs.size()=1 2024-09-12T19:29:41.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.aMfvJs_IU1npb6_w3CzSuHGq8pP7wm2_0 2024-09-12T19:29:41.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6896728229803374559', time=2024-09-12T20:43:21.312355+0000, chain.objs.size()=1 2024-09-12T19:29:41.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xIqjt7eOqT5CvfgDZ5UYXzr-kvXG1Ey_0 2024-09-12T19:29:41.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6351354306167217229', time=2024-09-12T20:43:21.321508+0000, chain.objs.size()=1 2024-09-12T19:29:41.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tlQvy_R0eCgApT_OSvfwqRuV3Z0ikMO_0 2024-09-12T19:29:41.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6258377767238778087', time=2024-09-12T20:43:21.625080+0000, chain.objs.size()=1 2024-09-12T19:29:41.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jt--AYFKDIcrLNhonUQFEzUQ_5Zq6I8_0 2024-09-12T19:29:41.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13060024484612049815', time=2024-09-12T20:43:23.184301+0000, chain.objs.size()=1 2024-09-12T19:29:41.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Tbhy41iXTkCcQy5jsB6gskTrRA10eEn_0 2024-09-12T19:29:41.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11212751430322253722', time=2024-09-12T20:43:25.543572+0000, chain.objs.size()=1 2024-09-12T19:29:41.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.poPu9VVgmxJJlEHTSneFFhMsS7U0Pfu_0 2024-09-12T19:29:41.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6511937069223344462', time=2024-09-12T20:43:26.461424+0000, chain.objs.size()=1 2024-09-12T19:29:41.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IMZrO4AkEbvfmDnjn606-Gt1fIwwJb9_0 2024-09-12T19:29:41.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1701743487719958298', time=2024-09-12T20:43:26.463546+0000, chain.objs.size()=1 2024-09-12T19:29:41.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.wQiX1uy3ds3zvJfgWGXxECcem7vsMvv_0 2024-09-12T19:29:41.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18383363213491195079', time=2024-09-12T20:43:26.562696+0000, chain.objs.size()=1 2024-09-12T19:29:41.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.BOkjq91vlpYFBuVJKbzx9qVwNdTVSK__0 2024-09-12T19:29:41.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6875076640604797601', time=2024-09-12T20:43:26.914933+0000, chain.objs.size()=1 2024-09-12T19:29:41.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.uz7HbqyaHKJYBPxg4gcHvv2GUFdvhxs_0 2024-09-12T19:29:41.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13932498974920319697', time=2024-09-12T20:43:27.208005+0000, chain.objs.size()=1 2024-09-12T19:29:41.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.NBWBmvnVaOWofwcynl-MYLNZY4MBfHd_0 2024-09-12T19:29:41.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9362830559513751441', time=2024-09-12T20:43:29.328455+0000, chain.objs.size()=1 2024-09-12T19:29:41.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.e9HwKYgYNm-I3-3b9twvbuj2SyAsLfD_0 2024-09-12T19:29:41.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2211372027941212371', time=2024-09-12T20:43:29.358105+0000, chain.objs.size()=1 2024-09-12T19:29:41.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jWIQVadpVM2nz5pTKiSn-SKA1EITzeI_0 2024-09-12T19:29:41.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10967078621886757833', time=2024-09-12T20:43:29.505945+0000, chain.objs.size()=1 2024-09-12T19:29:41.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VctQE37BI1R9rhvOAb50ssLx34YjDMM_0 2024-09-12T19:29:41.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15304599081484142303', time=2024-09-12T20:43:29.762614+0000, chain.objs.size()=1 2024-09-12T19:29:41.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.FOSGV7b7KFQuv0wlC4qzCjxjki4kzaU_0 2024-09-12T19:29:41.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3204099231385784009', time=2024-09-12T20:45:10.859406+0000, chain.objs.size()=1 2024-09-12T19:29:41.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cxq108MxQjEYtkfnR9KJE8fhI55hjeK_0 2024-09-12T19:29:41.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8313642773110741154', time=2024-09-12T20:45:11.698785+0000, chain.objs.size()=1 2024-09-12T19:29:41.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qnMZMbqZMtlA-aCSIx2FaPZit8MWjTL_0 2024-09-12T19:29:41.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8218820337282805502', time=2024-09-12T20:45:16.513820+0000, chain.objs.size()=1 2024-09-12T19:29:41.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GexHZGS7v5j36cQgomq9eaJWFzhwxKs_0 2024-09-12T19:29:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10132889099636800262', time=2024-09-12T20:45:16.599788+0000, chain.objs.size()=1 2024-09-12T19:29:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YNqocVTC7923oao8Ly5Mw9WLsoPhGi-_0 2024-09-12T19:29:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3995512110137190081', time=2024-09-12T20:45:18.516100+0000, chain.objs.size()=1 2024-09-12T19:29:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8vOYXrC2JTL3eFbzY99mLL3N4eL3RoG_0 2024-09-12T19:29:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8717221042902438398', time=2024-09-12T20:45:19.020903+0000, chain.objs.size()=1 2024-09-12T19:29:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.bVCt_LYe4UmKSEUjUTDvNrBjsatghfk_0 2024-09-12T19:29:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.765124052236867873', time=2024-09-12T20:45:19.611269+0000, chain.objs.size()=1 2024-09-12T19:29:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YV5Xh1yD8cgfKK1l2Sxh0iobU7o_YVW_0 2024-09-12T19:29:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12160913186815820809', time=2024-09-12T20:45:19.613238+0000, chain.objs.size()=1 2024-09-12T19:29:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.d1ZM_onqGpl4XsUH5XGDNJ3ICxH-8Id_0 2024-09-12T19:29:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15737223772384757647', time=2024-09-12T20:45:20.277074+0000, chain.objs.size()=1 2024-09-12T19:29:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oV5VgQKyE6y3oR6FMi_rnBX9oqmiwPj_0 2024-09-12T19:29:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13074744575860556258', time=2024-09-12T20:45:23.323128+0000, chain.objs.size()=1 2024-09-12T19:29:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GSKRW0LmxlHLImaA0aUUsNPj4yrTkTG_0 2024-09-12T19:29:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17267445950085507518', time=2024-09-12T20:45:23.571771+0000, chain.objs.size()=1 2024-09-12T19:29:41.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.R7qN-e5ZzJLWg_W746enQdA19gwjt30_0 2024-09-12T19:29:41.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14793460124736692539', time=2024-09-12T20:45:24.563197+0000, chain.objs.size()=1 2024-09-12T19:29:41.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.QuGQalw1DRqPuvVFGI79w9bAeBv_yA0_0 2024-09-12T19:29:41.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9056916777042151721', time=2024-09-12T20:45:24.874231+0000, chain.objs.size()=1 2024-09-12T19:29:41.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3MTxwhk75eo4SFzMQy7i1FYvvrAY5D4_0 2024-09-12T19:29:41.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11205080747683707018', time=2024-09-12T20:45:26.996314+0000, chain.objs.size()=1 2024-09-12T19:29:41.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.utYzfryadx7NzuKCNhqg8C31N3xrZyx_0 2024-09-12T19:29:41.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7394930371088604910', time=2024-09-12T20:45:27.443063+0000, chain.objs.size()=1 2024-09-12T19:29:41.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.F8x7YjRt7FprpUyprIyPLZmSKbwjfT0_0 2024-09-12T19:29:41.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15830830695038705380', time=2024-09-12T20:45:29.307713+0000, chain.objs.size()=1 2024-09-12T19:29:41.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.r3kHC9qnYMTg_7SSaXe7ZOGA-3hTl_c_0 2024-09-12T19:29:41.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16404126780346559026', time=2024-09-12T20:45:30.559809+0000, chain.objs.size()=1 2024-09-12T19:29:41.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Dhqdk9j5S4DCP1jLWNQzxG6DVcp1qOZ_0 2024-09-12T19:29:41.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4149319434101166309', time=2024-09-12T20:45:31.762473+0000, chain.objs.size()=1 2024-09-12T19:29:41.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fPWE7Cy0A8tU7AevadhFatYuercOBNK_0 2024-09-12T19:29:41.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4034086866201614311', time=2024-09-12T20:45:32.863357+0000, chain.objs.size()=1 2024-09-12T19:29:41.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.AyomvNhn_doT4V5qAOoyoKJXzKY4cnB_0 2024-09-12T19:29:41.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8923297548635438004', time=2024-09-12T20:45:34.646693+0000, chain.objs.size()=1 2024-09-12T19:29:41.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.emm3sr31S9XeN4Ajz6XJo1xncF4CsK5_0 2024-09-12T19:29:41.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13455562454724698648', time=2024-09-12T20:45:34.743540+0000, chain.objs.size()=1 2024-09-12T19:29:41.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ZeOMx7a1SVn_va6VAbiepOeh6z9JSNs_0 2024-09-12T19:29:41.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11240625009091185013', time=2024-09-12T20:45:36.184709+0000, chain.objs.size()=1 2024-09-12T19:29:41.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PU-RaWoOZ8fp273cm8EecrtcEPe99PE_0 2024-09-12T19:29:41.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53448 2024-09-12T19:29:41.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T19:29:41.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10795925030517650661', time=2024-09-12T20:45:36.528049+0000, chain.objs.size()=1 2024-09-12T19:29:41.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.vE94iC1KW1zJsqEQ5cgjESghkxHvLWT_0 2024-09-12T19:29:41.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7704102135087637607', time=2024-09-12T20:45:37.470117+0000, chain.objs.size()=1 2024-09-12T19:29:41.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.x2_IW5bgOQxRPORBiBVzPzhLlIHv_-t_0 2024-09-12T19:29:41.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7706897048944872936', time=2024-09-12T20:45:37.727194+0000, chain.objs.size()=1 2024-09-12T19:29:41.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5aJ82_dWtuMII4eH8-bd5bu1WSFcQaW_0 2024-09-12T19:29:41.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3728218771802185779', time=2024-09-12T20:49:35.021624+0000, chain.objs.size()=1 2024-09-12T19:29:41.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.443__shadow_.MwWgZtFjZVSxMgdajmfoZ-njZfaB3ZX_0 2024-09-12T19:29:41.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16010079061730852214', time=2024-09-12T20:50:03.593286+0000, chain.objs.size()=1 2024-09-12T19:29:41.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.455__shadow_.57XUgYhyINEebIH0fkeY0MNlwti-_5Q_0 2024-09-12T19:29:41.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3322563336492190743', time=2024-09-12T20:51:02.841179+0000, chain.objs.size()=1 2024-09-12T19:29:41.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.zBV00ivNI38SQP6ulMFiSAr3IDlQkMx_0 2024-09-12T19:29:41.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2912571545859720196', time=2024-09-12T20:51:34.406555+0000, chain.objs.size()=1 2024-09-12T19:29:41.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.496__shadow_.VNAShtq7LRWUVXR3mtMsRs3LUpabDC5_0 2024-09-12T19:29:41.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12927962498978926260', time=2024-09-12T20:52:36.008113+0000, chain.objs.size()=6 2024-09-12T19:29:41.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.1 2024-09-12T19:29:41.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.2 2024-09-12T19:29:41.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.3 2024-09-12T19:29:41.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.4 2024-09-12T19:29:41.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.5 2024-09-12T19:29:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.6 2024-09-12T19:29:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2975046755744754691', time=2024-09-12T20:54:39.550549+0000, chain.objs.size()=4 2024-09-12T19:29:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.520__shadow:9s9GliScqGQwR1a6WPg8xZUiGeUceZD_.DJAUBGrTvadReBzGcAvNgWwpax_RCg2_0 2024-09-12T19:29:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.520__shadow:9s9GliScqGQwR1a6WPg8xZUiGeUceZD_.DJAUBGrTvadReBzGcAvNgWwpax_RCg2_1 2024-09-12T19:29:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.520__shadow:9s9GliScqGQwR1a6WPg8xZUiGeUceZD_.DJAUBGrTvadReBzGcAvNgWwpax_RCg2_2 2024-09-12T19:29:41.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.520__shadow:9s9GliScqGQwR1a6WPg8xZUiGeUceZD_.DJAUBGrTvadReBzGcAvNgWwpax_RCg2_3 2024-09-12T19:29:41.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KYkucFnaVrphmzOXCWgR7XA8E9iZscC', time=2024-09-12T20:59:55.451587+0000, chain.objs.size()=1 2024-09-12T19:29:41.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.534__multipart_mymultipart.2~KYkucFnaVrphmzOXCWgR7XA8E9iZscC.1 2024-09-12T19:29:41.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6674559938382452066', time=2024-09-12T21:01:15.654694+0000, chain.objs.size()=1 2024-09-12T19:29:41.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.550__shadow_.wFWj7DdlDA0u47BZHLDNzL0mV33Kh2U_0 2024-09-12T19:29:41.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2649656121275974667', time=2024-09-12T21:03:54.736052+0000, chain.objs.size()=1 2024-09-12T19:29:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.575__shadow_.UX4agvQo3Q7P5L3eD9LPdW6aAwKed4P_0 2024-09-12T19:29:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6598647450939595614', time=2024-09-12T21:04:13.268522+0000, chain.objs.size()=1 2024-09-12T19:29:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:-.LmRotLIv5lEGd3p3dm4OG4kGBCbcu_.2CFwJtPQBX6hnqu1IrJTjFDkgpz__FX_0 2024-09-12T19:29:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11909647097485125838', time=2024-09-12T21:04:27.456666+0000, chain.objs.size()=1 2024-09-12T19:29:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:Wg9HJoEhj1TPua.97drh.VJzNgo0hWd_.eYwVzvyvEh2eiYjxxNK8ZcxYIN4i9eN_0 2024-09-12T19:29:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9931343143397273663', time=2024-09-12T21:04:46.074248+0000, chain.objs.size()=1 2024-09-12T19:29:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:-xfJAlUDZo6twrf2SNnSZbxeS7KLqsp_.WM5jViVKL0IR_xYLTVQBO3Y_ZyYui2D_0 2024-09-12T19:29:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7225754103646701042', time=2024-09-12T21:04:47.811334+0000, chain.objs.size()=1 2024-09-12T19:29:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:Py2FJEeSNkcx3tFODoKRWHUMgCkl.OV_.qDCYy6wY55x_d9opoZRtZkkFc_dulc1_0 2024-09-12T19:29:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8230830366711975552', time=2024-09-12T21:06:16.037780+0000, chain.objs.size()=1 2024-09-12T19:29:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.586__shadow:ZgOWLbZ29h3PU9HV0Gi61pjn-78Jcwy_.A2nn-RphdzIsyKXThuRzJvKbTCk2xop_0 2024-09-12T19:29:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16966488691002270592', time=2024-09-12T21:06:20.820311+0000, chain.objs.size()=1 2024-09-12T19:29:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.587__shadow:AkqGFSOK4EzfxcyOyvhorzM8ZCv-wE2_.nFiItHtGcofm-aDwaX11UPwy-Z_fAP9_0 2024-09-12T19:29:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17795815522748675558', time=2024-09-12T21:06:48.730760+0000, chain.objs.size()=1 2024-09-12T19:29:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.602__shadow_.TDqWMPM_7njOpw_2mesFupxdpBYGO4Q_0 2024-09-12T19:29:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W', time=2024-09-12T21:13:09.255855+0000, chain.objs.size()=12 2024-09-12T19:29:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__multipart_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.1 2024-09-12T19:29:41.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__shadow_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.1_1 2024-09-12T19:29:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__multipart_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.2 2024-09-12T19:29:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__shadow_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.2_1 2024-09-12T19:29:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__multipart_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.3 2024-09-12T19:29:41.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__shadow_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.3_1 2024-09-12T19:29:41.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__multipart_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.4 2024-09-12T19:29:41.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__shadow_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.4_1 2024-09-12T19:29:41.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__multipart_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.5 2024-09-12T19:29:41.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__shadow_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.5_1 2024-09-12T19:29:41.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__multipart_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.6 2024-09-12T19:29:41.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.624__shadow_multipart_enc.2~y4nXh86HQ6g-NoNkZkGcjK59NpOL15W.6_1 2024-09-12T19:29:41.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7242127984994163621', time=2024-09-12T21:13:54.028903+0000, chain.objs.size()=1 2024-09-12T19:29:41.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.637__shadow_.iIilo3aCcsEthHujKq8E7N4zXl4G2OM_0 2024-09-12T19:29:41.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.171+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10283503715349612447', time=2024-09-12T21:16:16.708746+0000, chain.objs.size()=1 2024-09-12T19:29:41.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.171+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.666__shadow_.8FbOhkPUCptYOMLRpDbef3eG881JwHc_0 2024-09-12T19:29:41.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.171+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2728701629342404480', time=2024-09-12T21:16:20.226833+0000, chain.objs.size()=1 2024-09-12T19:29:41.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.171+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.668__shadow_.MjucuqtzzLjuBc6YbB4EOMrnYvYWGpz_0 2024-09-12T19:29:41.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.171+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.970123298727560053', time=2024-09-12T21:18:44.866265+0000, chain.objs.size()=1 2024-09-12T19:29:41.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.171+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.734__shadow_.ICtDDBQhg3s4lA4fjnaCREdTNCT7eGA_0 2024-09-12T19:29:41.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.179+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T19:29:41.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/58795' 2024-09-12T19:29:41.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9980125624103066880', time=2024-09-12T20:28:57.635713+0000, chain.objs.size()=3 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.L3BIz86MLEJoBpDxVk_16WHfNMr0EyE_0 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.L3BIz86MLEJoBpDxVk_16WHfNMr0EyE_1 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.L3BIz86MLEJoBpDxVk_16WHfNMr0EyE_2 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7191861289415184960', time=2024-09-12T20:29:27.170823+0000, chain.objs.size()=3 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.161__multipart_foo-STANDARD.2~jwi063nE8a0nZCcNPRZ3XnwOlKoewXu.1 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.161__multipart_foo-STANDARD.2~jwi063nE8a0nZCcNPRZ3XnwOlKoewXu.2 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.161__multipart_foo-STANDARD.2~jwi063nE8a0nZCcNPRZ3XnwOlKoewXu.3 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2320613129706537321', time=2024-09-12T20:36:12.423020+0000, chain.objs.size()=1 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.248__shadow_.wLwMXrMaPOu7Ptvh_5YipxAKuZI3BCN_0 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10202492093308327184', time=2024-09-12T20:36:30.795063+0000, chain.objs.size()=1 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.256__shadow_.aMDnJPn6Xp2Te4PY5b_zFU-NQlB5fv0_0 2024-09-12T19:29:41.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8800096678157041679', time=2024-09-12T20:38:22.561826+0000, chain.objs.size()=1 2024-09-12T19:29:41.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fWrnkF-xrG7ZP6cUuKmVThzuUW7Ty4k_0 2024-09-12T19:29:41.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6463552408681485395', time=2024-09-12T20:38:23.483754+0000, chain.objs.size()=1 2024-09-12T19:29:41.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7C1eUQeo3W64zVZO8rUWT2VecYCAs5m_0 2024-09-12T19:29:41.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5308234570059605683', time=2024-09-12T20:38:23.646743+0000, chain.objs.size()=1 2024-09-12T19:29:41.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.F13aVG7uZIAjp6wp5a8ZfOu4duxX9Gr_0 2024-09-12T19:29:41.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.905779355423228652', time=2024-09-12T20:38:25.318870+0000, chain.objs.size()=1 2024-09-12T19:29:41.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jXRU4UknzR_WtaAo4wwO4pakd2cLSKN_0 2024-09-12T19:29:41.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12847735245035631500', time=2024-09-12T20:38:29.049215+0000, chain.objs.size()=1 2024-09-12T19:29:41.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Tc9tLleb-NoQN6isGw3k7PToLP_Xohb_0 2024-09-12T19:29:41.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14736067378404087022', time=2024-09-12T20:38:30.791518+0000, chain.objs.size()=1 2024-09-12T19:29:41.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lBr8TRCTz495vt8fEXX8TD1d48AKTfX_0 2024-09-12T19:29:41.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6318446762996087512', time=2024-09-12T20:38:31.379497+0000, chain.objs.size()=1 2024-09-12T19:29:41.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.anuSXrN_8JeHvQDa8Aq_o3B7wfEi69c_0 2024-09-12T19:29:41.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11983486338598028029', time=2024-09-12T20:38:32.104882+0000, chain.objs.size()=1 2024-09-12T19:29:41.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dDUZ--pEt3paHaxzbJGoCV4tTy1w5Zs_0 2024-09-12T19:29:41.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17776735704930263605', time=2024-09-12T20:38:34.339200+0000, chain.objs.size()=1 2024-09-12T19:29:41.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.VjOxdOG_ukCpI9sAQOEh_hbDRlT32AY_0 2024-09-12T19:29:41.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.501107544040789336', time=2024-09-12T20:38:34.760123+0000, chain.objs.size()=1 2024-09-12T19:29:41.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.97iLu-nXYQ3o-syxDq_m4uwLffOjXtF_0 2024-09-12T19:29:41.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13241736203976474690', time=2024-09-12T20:38:35.246698+0000, chain.objs.size()=1 2024-09-12T19:29:41.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.BeZFn61-rz98ClXyknVSyyGMChKi2zA_0 2024-09-12T19:29:41.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17054552919281690111', time=2024-09-12T20:38:35.546615+0000, chain.objs.size()=1 2024-09-12T19:29:41.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MUZwN1eGhMjDOcOjDoKxldki1bRfwZO_0 2024-09-12T19:29:41.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7194195837157775708', time=2024-09-12T20:38:35.920726+0000, chain.objs.size()=1 2024-09-12T19:29:41.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.62-tkz7ZN-0hvucKgStOhuAcx7ZMPdt_0 2024-09-12T19:29:41.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7533007149005875999', time=2024-09-12T20:38:36.673018+0000, chain.objs.size()=1 2024-09-12T19:29:41.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Tnwl-WHuvB4-7-WVsfVPaZBlaEjaumr_0 2024-09-12T19:29:41.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8420963534873366349', time=2024-09-12T20:38:38.105078+0000, chain.objs.size()=1 2024-09-12T19:29:41.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.uQU-u8xfopqYtIS-VWfVrSbBF1u-fuq_0 2024-09-12T19:29:41.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.632344762797383746', time=2024-09-12T20:38:38.401339+0000, chain.objs.size()=1 2024-09-12T19:29:41.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vJ-AK4ZFcTT9jRH_T34WdQMTnKy1Z_v_0 2024-09-12T19:29:41.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14943269859427170359', time=2024-09-12T20:38:40.385314+0000, chain.objs.size()=1 2024-09-12T19:29:41.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-zgVX1lH0Enz1pk0Qth3PjYqFTQgJzh_0 2024-09-12T19:29:41.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5939692612739874881', time=2024-09-12T20:38:41.521234+0000, chain.objs.size()=1 2024-09-12T19:29:41.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.smHKzijzWNBV5x6lHYXlO_KDASGn90o_0 2024-09-12T19:29:41.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3713630015238900263', time=2024-09-12T20:38:41.649296+0000, chain.objs.size()=1 2024-09-12T19:29:41.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.yCR1E7KuOz6UXpKFIv6IDEu215_K7z-_0 2024-09-12T19:29:41.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9546300695199202612', time=2024-09-12T20:38:41.848996+0000, chain.objs.size()=1 2024-09-12T19:29:41.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.KZxViI7DUkhn09xpvFhMDVPslYmQ9do_0 2024-09-12T19:29:41.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17609176848929642053', time=2024-09-12T20:38:46.335465+0000, chain.objs.size()=1 2024-09-12T19:29:41.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Lra5P4OKoZIqWoyRzCj64OoNZ0bJA4A_0 2024-09-12T19:29:41.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6693694762277467161', time=2024-09-12T20:38:46.697425+0000, chain.objs.size()=1 2024-09-12T19:29:41.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.B4DomM24oo_l7rWBa7FqyHBo8POXb2c_0 2024-09-12T19:29:41.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5087910738860359837', time=2024-09-12T20:38:47.298207+0000, chain.objs.size()=1 2024-09-12T19:29:41.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.94IzHvwQlxZhdoMW-i0c_5aq7y9ROxF_0 2024-09-12T19:29:41.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10612197123910290929', time=2024-09-12T20:38:47.299863+0000, chain.objs.size()=1 2024-09-12T19:29:41.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.PZ_Lfw8dvo068CTtEBreEvOX_4WLLZt_0 2024-09-12T19:29:41.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7429509227962387243', time=2024-09-12T20:38:47.478453+0000, chain.objs.size()=1 2024-09-12T19:29:41.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aaSXXQcfCRCEWynKbHi_nzN1Zu-qpLj_0 2024-09-12T19:29:41.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12902059687818315264', time=2024-09-12T20:38:47.481027+0000, chain.objs.size()=1 2024-09-12T19:29:41.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.BrIJs5v_5msPWFAG_BUMfgZ5O-AKgtc_0 2024-09-12T19:29:41.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12241002697932542890', time=2024-09-12T20:38:47.609489+0000, chain.objs.size()=1 2024-09-12T19:29:41.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RCsAmmd_BI7dsO_itkfUHkQzCXefCOn_0 2024-09-12T19:29:41.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5169548191926210137', time=2024-09-12T20:38:48.250512+0000, chain.objs.size()=1 2024-09-12T19:29:41.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.KjNGw8fv_6X6aF-WeRnKQrIKvRzvuoa_0 2024-09-12T19:29:41.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12106748591081872453', time=2024-09-12T20:38:48.695061+0000, chain.objs.size()=1 2024-09-12T19:29:41.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.x5XK6_plHss7etzgP-Icl3oApV4Y_fn_0 2024-09-12T19:29:41.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12512764806467971489', time=2024-09-12T20:40:02.088189+0000, chain.objs.size()=1 2024-09-12T19:29:41.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.Llr6A3VeZRacY0x9AD5xke0fwySUgVC_0 2024-09-12T19:29:41.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14668775217627665175', time=2024-09-12T20:40:07.835198+0000, chain.objs.size()=1 2024-09-12T19:29:41.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.bw65wEByEG_u3xyOiZqViE2rPTEww9X_0 2024-09-12T19:29:41.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17077508170105332473', time=2024-09-12T20:40:24.372030+0000, chain.objs.size()=1 2024-09-12T19:29:41.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.300__shadow_.p03MDoU5LCcLvl_CtYTqjuLqM2jfni7_0 2024-09-12T19:29:41.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6981960697412786175', time=2024-09-12T20:43:02.499375+0000, chain.objs.size()=1 2024-09-12T19:29:41.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.BoVhpRJ0XyE-1ltdwiRwOR5dNpPV2Eo_0 2024-09-12T19:29:41.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5383638437052638644', time=2024-09-12T20:43:02.767230+0000, chain.objs.size()=1 2024-09-12T19:29:41.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vmJcknTtq1gmtwlMssWsFWqq0jcj2Oi_0 2024-09-12T19:29:41.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6837703642973943019', time=2024-09-12T20:43:03.876294+0000, chain.objs.size()=1 2024-09-12T19:29:41.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.aTssYZ8BNKEu5JDzLP8ineNhCb1WCV5_0 2024-09-12T19:29:41.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7981522248034435061', time=2024-09-12T20:43:04.553500+0000, chain.objs.size()=1 2024-09-12T19:29:41.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.JCaZUwrYreKTpHZKNktFbc3D_gJrhly_0 2024-09-12T19:29:41.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17641961557222360623', time=2024-09-12T20:43:04.785580+0000, chain.objs.size()=1 2024-09-12T19:29:41.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.t-duPl5xFINYAeWaO4cUW4Xlj3CDarV_0 2024-09-12T19:29:41.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15032909090308926350', time=2024-09-12T20:43:06.313479+0000, chain.objs.size()=1 2024-09-12T19:29:41.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gvkoqqQCpKr3jQfFCiDzvT6c3mJUtau_0 2024-09-12T19:29:41.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10904339677471090408', time=2024-09-12T20:43:07.037263+0000, chain.objs.size()=1 2024-09-12T19:29:41.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cuUryXno-vt_cVbxevGGkvYmJWLZG0H_0 2024-09-12T19:29:41.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2446771030998883204', time=2024-09-12T20:43:10.063998+0000, chain.objs.size()=1 2024-09-12T19:29:41.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fN83_sUrlgcdk1AX-ufULxAvn1vx4UK_0 2024-09-12T19:29:41.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2586992822563764167', time=2024-09-12T20:43:12.046923+0000, chain.objs.size()=1 2024-09-12T19:29:41.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.R-7j4fh2bZcrx46OF8mgLFZ6oWrDQwC_0 2024-09-12T19:29:41.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5952157828512596876', time=2024-09-12T20:43:12.426470+0000, chain.objs.size()=1 2024-09-12T19:29:41.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.24tMrUSf3F7dO5ttujbAza_T1i2A5uv_0 2024-09-12T19:29:41.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10852458046518851740', time=2024-09-12T20:43:14.145222+0000, chain.objs.size()=1 2024-09-12T19:29:41.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xHkm09EIG2cT0w9y5EAErfKNYjzVEM4_0 2024-09-12T19:29:41.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17021179778684812305', time=2024-09-12T20:43:14.395749+0000, chain.objs.size()=1 2024-09-12T19:29:41.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YIPElYOWGHkONElV4EW9-PukIXId-se_0 2024-09-12T19:29:41.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6083457646907396236', time=2024-09-12T20:43:14.523957+0000, chain.objs.size()=1 2024-09-12T19:29:41.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-wuhhVMaMcYy2nzD9S4l83NmAQFTIXH_0 2024-09-12T19:29:41.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2594498882112567991', time=2024-09-12T20:43:15.642131+0000, chain.objs.size()=1 2024-09-12T19:29:41.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.dtlmKLSQES40C1uLrj8sp7_W3InYgjf_0 2024-09-12T19:29:41.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12265811707654840195', time=2024-09-12T20:43:16.429906+0000, chain.objs.size()=1 2024-09-12T19:29:41.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.byVCmjmGUtMXkkcK00EVej_XvoiZMjp_0 2024-09-12T19:29:41.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17476290564575088107', time=2024-09-12T20:43:17.725802+0000, chain.objs.size()=1 2024-09-12T19:29:41.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vXy3pHFelkEEaq1bVbgsrgrx2hYhhk7_0 2024-09-12T19:29:41.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7258084911948639014', time=2024-09-12T20:43:18.138585+0000, chain.objs.size()=1 2024-09-12T19:29:41.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VTcupkhxqaO0urrL_jE7g0lYX9Ox9DR_0 2024-09-12T19:29:41.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18260183725674809275', time=2024-09-12T20:43:21.322267+0000, chain.objs.size()=1 2024-09-12T19:29:41.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tKnEDH4iPa6vZS6_4bMji3ovVXMfoFn_0 2024-09-12T19:29:41.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1387316985534656510', time=2024-09-12T20:43:21.323792+0000, chain.objs.size()=1 2024-09-12T19:29:41.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.GNi4783_AGWl1EFDV-fcfhuzfVZ-11G_0 2024-09-12T19:29:41.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11631470456636210573', time=2024-09-12T20:43:21.655972+0000, chain.objs.size()=1 2024-09-12T19:29:41.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.y-ez6R7yiOGHLxlCnCTma50jpXSxiQU_0 2024-09-12T19:29:41.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.488365124614576389', time=2024-09-12T20:43:22.588807+0000, chain.objs.size()=1 2024-09-12T19:29:41.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9m58kejzqPiSRIsfQexQH4CrGs_49YF_0 2024-09-12T19:29:41.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16417926268215820293', time=2024-09-12T20:43:23.062038+0000, chain.objs.size()=1 2024-09-12T19:29:41.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.V7NAjIrC2-SSdibd7n9_FjJT7tL1iuh_0 2024-09-12T19:29:41.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2775450416381586790', time=2024-09-12T20:43:23.251632+0000, chain.objs.size()=1 2024-09-12T19:29:41.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AJIxW0srmNtc1a3KEj51JbCCfdXuxaD_0 2024-09-12T19:29:41.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5120900584986350779', time=2024-09-12T20:43:24.790096+0000, chain.objs.size()=1 2024-09-12T19:29:41.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IWYcb2hUu8dQdBkYQSt18Ea1-99Tg6u_0 2024-09-12T19:29:41.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7847589746556621804', time=2024-09-12T20:43:25.271183+0000, chain.objs.size()=1 2024-09-12T19:29:41.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.D0G-fixA0f_DFQj4ofHgOO9CFznRufj_0 2024-09-12T19:29:41.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3069451041021950836', time=2024-09-12T20:43:25.957539+0000, chain.objs.size()=1 2024-09-12T19:29:41.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.aUZw-iGugqsdXDRMy7O7UnkRGYmGeLI_0 2024-09-12T19:29:41.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15838114655795659038', time=2024-09-12T20:43:26.754077+0000, chain.objs.size()=1 2024-09-12T19:29:41.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.2-Ot8Z1jH4XccXOGIdKlonxxBcyBJNA_0 2024-09-12T19:29:41.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14878946598699701801', time=2024-09-12T20:45:10.782899+0000, chain.objs.size()=1 2024-09-12T19:29:41.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nkkLZWQ5ig4dL8ieCAaqbiVhgA-EH-p_0 2024-09-12T19:29:41.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.170110670659060022', time=2024-09-12T20:45:11.097018+0000, chain.objs.size()=1 2024-09-12T19:29:41.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.gwbx48iPrV5JfWxRwcy2BJi2SlDSFKb_0 2024-09-12T19:29:41.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3511447881317626073', time=2024-09-12T20:45:11.359730+0000, chain.objs.size()=1 2024-09-12T19:29:41.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dgRDrgYLuqm41c_t39oj4uapHjlsxJT_0 2024-09-12T19:29:41.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8972027915947738270', time=2024-09-12T20:45:11.624566+0000, chain.objs.size()=1 2024-09-12T19:29:41.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2kKqH0257fTTjIzV6J3zDwmf8kwZpwm_0 2024-09-12T19:29:41.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12784930935001158855', time=2024-09-12T20:45:12.737546+0000, chain.objs.size()=1 2024-09-12T19:29:41.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.q4E-EjuCqxq609nYgxBWU6Y1Jf31WOC_0 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11502500566710527558', time=2024-09-12T20:45:17.484384+0000, chain.objs.size()=1 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FK_mSehd4WsZCO1UFcrbRLbNDjfeIhW_0 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16161582931611296681', time=2024-09-12T20:45:18.915975+0000, chain.objs.size()=1 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.N5WpFw34ZtLk9GZRbTFCzXctjAkcjXF_0 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13575655363762307669', time=2024-09-12T20:45:20.735346+0000, chain.objs.size()=1 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ka47KjkxwBqjzapmZpfc6bScEsTqRA8_0 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14847148941745261939', time=2024-09-12T20:45:20.955408+0000, chain.objs.size()=1 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6k7ooSWmrl9HgTvM73Z0p_B-M75Brk__0 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15013017871656804724', time=2024-09-12T20:45:22.611496+0000, chain.objs.size()=1 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.7m2W8eK6s28gyEXg4RYGvwOomFq7438_0 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4293060399083610440', time=2024-09-12T20:45:22.711257+0000, chain.objs.size()=1 2024-09-12T19:29:41.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0QZ6BLQFS7XA-RWq9NKhGLVRZQSibLd_0 2024-09-12T19:29:41.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12771426402024149844', time=2024-09-12T20:45:23.408960+0000, chain.objs.size()=1 2024-09-12T19:29:41.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fv4i0o0l82UElyrs35MPYj7UlNXuAJW_0 2024-09-12T19:29:41.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13443646326900353282', time=2024-09-12T20:45:24.558469+0000, chain.objs.size()=1 2024-09-12T19:29:41.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.N-z8wTv9shPW69jW1lWaVzsAmfuPHTX_0 2024-09-12T19:29:41.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18341741813566401248', time=2024-09-12T20:45:25.753156+0000, chain.objs.size()=1 2024-09-12T19:29:41.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.JQpTcTmNksobZT7UnL4cNFeZCqg649N_0 2024-09-12T19:29:41.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5468605153628458351', time=2024-09-12T20:45:25.791984+0000, chain.objs.size()=1 2024-09-12T19:29:41.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.jJxpQ95f7PJN-SfqNfjteE54VlFHbqm_0 2024-09-12T19:29:41.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10400365007722833165', time=2024-09-12T20:45:26.425385+0000, chain.objs.size()=1 2024-09-12T19:29:41.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.gB6_RDDjRR9ZlQjTZorJizyHN--7NRB_0 2024-09-12T19:29:41.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5375353964424583680', time=2024-09-12T20:45:26.626642+0000, chain.objs.size()=1 2024-09-12T19:29:41.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.apeex8vho_YneCnmUYJkkBGNHyjtcNZ_0 2024-09-12T19:29:41.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4860970611237549810', time=2024-09-12T20:45:26.720276+0000, chain.objs.size()=1 2024-09-12T19:29:41.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9Udgv7JizqUIJ1dTAZstZzE__2Wzldw_0 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5189805243723018478', time=2024-09-12T20:45:26.829999+0000, chain.objs.size()=1 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.91ENShDI1Rtqml2hAX37Am8qptiY09Z_0 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5101705341166073723', time=2024-09-12T20:45:27.066518+0000, chain.objs.size()=1 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ZLXRtmdzCR-F7RLBNV7R8VCfnClNBWD_0 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8807483325943156438', time=2024-09-12T20:45:27.602097+0000, chain.objs.size()=1 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FVFdPGJKJaUgNEUe-LwMxu_93au0isv_0 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8372277607935440465', time=2024-09-12T20:45:28.032998+0000, chain.objs.size()=1 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.c1cgxSGVWuXQKiyVqcAaxsRxYFk2gtN_0 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.445998958647645828', time=2024-09-12T20:45:29.278405+0000, chain.objs.size()=1 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.yX3jl3ujeNUNgF4cISbXcXhsalWlrd__0 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17501509914388977358', time=2024-09-12T20:45:29.562253+0000, chain.objs.size()=1 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oBQc9VWv7bx8OlhmwdehRS5Afd4x0EL_0 2024-09-12T19:29:41.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14421313951487305973', time=2024-09-12T20:45:31.718615+0000, chain.objs.size()=1 2024-09-12T19:29:41.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.H5qzG2MTfCo_ypJUmYUw1PttqDi8hTT_0 2024-09-12T19:29:41.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4168586095196525139', time=2024-09-12T20:45:33.804584+0000, chain.objs.size()=1 2024-09-12T19:29:41.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zbq5fjDz3hxi6ca3KIQFBD1AoC4TzY1_0 2024-09-12T19:29:41.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5422379624402187180', time=2024-09-12T20:45:34.447555+0000, chain.objs.size()=1 2024-09-12T19:29:41.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PoMKXNKJlj79QWYD5X_jVMOQkW0FBkA_0 2024-09-12T19:29:41.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16125648615401505778', time=2024-09-12T20:45:34.826145+0000, chain.objs.size()=1 2024-09-12T19:29:41.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hQWBIecgtVq34Px3lGSPlKH9JQfyPtm_0 2024-09-12T19:29:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.163611224030161283', time=2024-09-12T20:45:37.010644+0000, chain.objs.size()=1 2024-09-12T19:29:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.e95uTD-xkMoIf-_nVVDek1sANjLDBPe_0 2024-09-12T19:29:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8246574961706661023', time=2024-09-12T20:45:46.030659+0000, chain.objs.size()=1 2024-09-12T19:29:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.328__shadow_.xGx62svEY-zjLm1xrzfv8kXD6-yPaAB_0 2024-09-12T19:29:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16650546081414555857', time=2024-09-12T20:49:46.133739+0000, chain.objs.size()=1 2024-09-12T19:29:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.447__shadow_.fqL1tfQX1dpnlcLAw3msPbbBGX5uu2h_0 2024-09-12T19:29:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13138818778075470882', time=2024-09-12T20:50:33.389145+0000, chain.objs.size()=1 2024-09-12T19:29:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.465__shadow_.X4EMYeMeXSjJNHWNdLWrRfNv2u6gdHt_0 2024-09-12T19:29:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12850203502598944193', time=2024-09-12T20:53:16.630599+0000, chain.objs.size()=1 2024-09-12T19:29:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.517__shadow_.XHUQ4DSgdTEzqq2D7w4_AC5inPkIobv_0 2024-09-12T19:29:41.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1921087466002460698', time=2024-09-12T20:54:25.308493+0000, chain.objs.size()=3 2024-09-12T19:29:41.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.521__multipart_mymultipart.2~6Mpvq6x-kwS0ti3CsajbcknQ7iVCKO5.1 2024-09-12T19:29:41.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.521__multipart_mymultipart.2~6Mpvq6x-kwS0ti3CsajbcknQ7iVCKO5.2 2024-09-12T19:29:41.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.521__multipart_mymultipart.2~6Mpvq6x-kwS0ti3CsajbcknQ7iVCKO5.3 2024-09-12T19:29:41.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10845384931651391334', time=2024-09-12T20:55:34.664013+0000, chain.objs.size()=6 2024-09-12T19:29:41.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.AE6k_Qnjm8NJy8BJKEd6IQs3fhakJHhV.1 2024-09-12T19:29:41.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~W5cSLTiIQYf8yrK6uDtkzAs2nQ50CWv.2 2024-09-12T19:29:41.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~W5cSLTiIQYf8yrK6uDtkzAs2nQ50CWv.3 2024-09-12T19:29:41.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~W5cSLTiIQYf8yrK6uDtkzAs2nQ50CWv.4 2024-09-12T19:29:41.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~W5cSLTiIQYf8yrK6uDtkzAs2nQ50CWv.5 2024-09-12T19:29:41.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~W5cSLTiIQYf8yrK6uDtkzAs2nQ50CWv.6 2024-09-12T19:29:41.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15880310301636602781', time=2024-09-12T20:59:30.389631+0000, chain.objs.size()=2 2024-09-12T19:29:41.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.528__multipart_mymultipart.2~zqJi0jw3OQpiFFcpSlCW7O2jyH4Cvco.1 2024-09-12T19:29:41.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.528__multipart_mymultipart.2~zqJi0jw3OQpiFFcpSlCW7O2jyH4Cvco.2 2024-09-12T19:29:41.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5842665479931756385', time=2024-09-12T21:01:40.920168+0000, chain.objs.size()=1 2024-09-12T19:29:41.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.553__shadow_.8Aax5l2nfqKVRbppl5RTx-jmlxjpXZ1_0 2024-09-12T19:29:41.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/58795 2024-09-12T19:29:41.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T19:29:41.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10354055208431269015', time=2024-09-12T21:02:18.340222+0000, chain.objs.size()=1 2024-09-12T19:29:41.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.557__shadow_.jFkiKKxecJzcONxWpBLkjOIu83Oy0Vc_0 2024-09-12T19:29:41.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5185468600635482265', time=2024-09-12T21:03:46.834057+0000, chain.objs.size()=1 2024-09-12T19:29:41.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.574__shadow:XlJZ3x7bFh-HPp1H4w8LDFFTcEo.pfI_.sclzlpdx25eGS8UrB18QuROtRiMMbMT_0 2024-09-12T19:29:41.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10848363345127351413', time=2024-09-12T21:03:47.882070+0000, chain.objs.size()=1 2024-09-12T19:29:41.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.574__shadow:CQ8NPdiPI.f2C2r2ufdqnN.W0IQ7iJs_.-M96EsrlMbM-ou7ZM890t5Awqwj0Rmf_0 2024-09-12T19:29:41.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14563295746376064805', time=2024-09-12T21:06:01.308766+0000, chain.objs.size()=1 2024-09-12T19:29:41.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.580__shadow:vgSg4KMLp7KtXsz8K40IhU-hQfBgGp4_.W-XrT-8iI2jqeG0wwVf0_iMhy2AaZEV_0 2024-09-12T19:29:41.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14755546158856690927', time=2024-09-12T21:06:03.422680+0000, chain.objs.size()=1 2024-09-12T19:29:41.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.582__shadow:-jmDVxXTtzTBOpRKPd1ObEHT0pI-A5s_.8cuCo-5KLEzGB9Mi-jE0oKAtSvvqFtP_0 2024-09-12T19:29:41.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1601047062622593316', time=2024-09-12T21:13:33.879952+0000, chain.objs.size()=1 2024-09-12T19:29:41.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.628__shadow_.Leovosv7dqxg8iDRRATQ_jTXTMLVFjy_0 2024-09-12T19:29:41.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18143354585678370873', time=2024-09-12T21:14:16.173990+0000, chain.objs.size()=1 2024-09-12T19:29:41.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.644__shadow_.ZT8Z0eYfHWvpplPQomj_DMi4shxN8jL_0 2024-09-12T19:29:41.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T19:29:41.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44865' 2024-09-12T19:29:41.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14947792791736536575', time=2024-09-12T20:31:52.887604+0000, chain.objs.size()=1 2024-09-12T19:29:41.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.200__shadow_.5vIrogjaMkQdHpEDKb0uqoNt8Ii8p7i_0 2024-09-12T19:29:41.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14888867805978115175', time=2024-09-12T20:35:32.391249+0000, chain.objs.size()=1 2024-09-12T19:29:41.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.233__shadow_.XPgJRIzH3L-tYsMEJD4JJm_uvQ29FW5_0 2024-09-12T19:29:41.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10544391418465506862', time=2024-09-12T20:35:55.681540+0000, chain.objs.size()=1 2024-09-12T19:29:41.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.242__shadow_.XvBOfMu0S3DgG5QGGMNt2YkshOcuGxG_0 2024-09-12T19:29:41.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4422518381502286719', time=2024-09-12T20:36:19.353979+0000, chain.objs.size()=1 2024-09-12T19:29:41.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.251__shadow_._gBMYx5meBHX4wNPsuzqoHTQd4GBZWB_0 2024-09-12T19:29:41.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15152474315535190599', time=2024-09-12T20:36:30.816265+0000, chain.objs.size()=1 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.256__shadow_.ogaWymxDyeKFtJjm5_wtzwaKvxAKcf5_0 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12582468659645790815', time=2024-09-12T20:36:32.965772+0000, chain.objs.size()=1 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.257__shadow_.q8AxolpF0V-ZCaSkjavQlzlnkCxXR6v_0 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2835753322183254687', time=2024-09-12T20:38:23.154201+0000, chain.objs.size()=1 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ltgAL3V_DxAStbquGpY0DTMkN0TF8s0_0 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5031732560801526113', time=2024-09-12T20:38:24.196330+0000, chain.objs.size()=1 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9Pz145euWccUcuJzJ4-iFVPPh6MjHcq_0 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4880792847880120170', time=2024-09-12T20:38:25.117728+0000, chain.objs.size()=1 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.v3ZCJ0pXAzKKTDoDJ8KjwFPkZxWsfN1_0 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11183087933548134272', time=2024-09-12T20:38:28.485299+0000, chain.objs.size()=1 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Rg2XH_Sw-wOzOP8giaJyvULL29MQI1p_0 2024-09-12T19:29:41.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2686788562348568742', time=2024-09-12T20:38:28.813524+0000, chain.objs.size()=1 2024-09-12T19:29:41.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.56COvIBzp8Z4QP_bqxCn9QMQlN-tO45_0 2024-09-12T19:29:41.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8974737533234480892', time=2024-09-12T20:38:29.251106+0000, chain.objs.size()=1 2024-09-12T19:29:41.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.XJLRJyCAzUrmVYrMFIJHai_euYVfVbE_0 2024-09-12T19:29:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14109599467494253261', time=2024-09-12T20:38:30.668687+0000, chain.objs.size()=1 2024-09-12T19:29:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vmZOsen4v8rrF7HmOMb4nDgWS1ac_wC_0 2024-09-12T19:29:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1840003447425887093', time=2024-09-12T20:38:32.051294+0000, chain.objs.size()=1 2024-09-12T19:29:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4nyAyweEsqo8n48fMEWaHzvUsV2bf7D_0 2024-09-12T19:29:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16817201975752153628', time=2024-09-12T20:38:32.580280+0000, chain.objs.size()=1 2024-09-12T19:29:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wxZQPkbZMAsnOqcnAlv6EIVwl1G5-Md_0 2024-09-12T19:29:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17019705760143794511', time=2024-09-12T20:38:32.750071+0000, chain.objs.size()=1 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.VzsEMTSqWt144JI1_65wgECOP4MIENv_0 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9466409082691742646', time=2024-09-12T20:38:34.823798+0000, chain.objs.size()=1 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.V27T9u5YsFr0QIfkCklD1eDfmYSzRtH_0 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18358690211415087623', time=2024-09-12T20:38:35.220921+0000, chain.objs.size()=1 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.by5qJltL1ZamW6a1IJHfTTbnYYwu_QW_0 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14879189206120894923', time=2024-09-12T20:38:35.451600+0000, chain.objs.size()=1 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.yXFhI1up4We9vEStp-865TLxpZuLnXW_0 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10752687703074387537', time=2024-09-12T20:38:36.448798+0000, chain.objs.size()=1 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qYHc47DhDBxewjTMS-gWG1YEQ-cMpd1_0 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12330509651376379087', time=2024-09-12T20:38:36.675645+0000, chain.objs.size()=1 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AozGUaG4o7qpmhJI5H67UCvxjNb4dsf_0 2024-09-12T19:29:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1362401075387309318', time=2024-09-12T20:38:37.821806+0000, chain.objs.size()=1 2024-09-12T19:29:41.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.O7AWmV4Jp0su3i6vTRd5TGRjtEfr6hd_0 2024-09-12T19:29:41.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11693170152567605478', time=2024-09-12T20:38:37.823789+0000, chain.objs.size()=1 2024-09-12T19:29:41.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.XbF-2HXgpUxTZSCdjW1M1-7EIFuhqtR_0 2024-09-12T19:29:41.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11401433553902456113', time=2024-09-12T20:38:39.089567+0000, chain.objs.size()=1 2024-09-12T19:29:41.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.PqtOFu6TO7NVroDIx28ExYwK2eCjD-t_0 2024-09-12T19:29:41.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13239563837615594955', time=2024-09-12T20:38:39.667879+0000, chain.objs.size()=1 2024-09-12T19:29:41.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.bjv0rxQ7_bz-IDtk6uc1FMZwmCvNLae_0 2024-09-12T19:29:41.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8550000910000784889', time=2024-09-12T20:38:40.007633+0000, chain.objs.size()=1 2024-09-12T19:29:41.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.z1bDhSdoClZmqyVAHeSbmGgUGWp569F_0 2024-09-12T19:29:41.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8016784922739997531', time=2024-09-12T20:38:42.756432+0000, chain.objs.size()=1 2024-09-12T19:29:41.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Xt7nYKLgZSPj0me_A6GDwFIwFsA_L8C_0 2024-09-12T19:29:41.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10938614139040645903', time=2024-09-12T20:38:46.620763+0000, chain.objs.size()=1 2024-09-12T19:29:41.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aBsbAOqrjQXVa4FmOfMynQkY0tMBxrT_0 2024-09-12T19:29:41.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1242596826918108004', time=2024-09-12T20:38:48.621684+0000, chain.objs.size()=1 2024-09-12T19:29:41.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9zVIJGJv7jgbWPUEZ9A3NrdAGlYl15c_0 2024-09-12T19:29:41.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8580773668068979177', time=2024-09-12T20:38:50.278252+0000, chain.objs.size()=1 2024-09-12T19:29:41.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.3oxJCFojemwmlPhlqBn-nstDj276PYy_0 2024-09-12T19:29:41.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11726947220819705766', time=2024-09-12T20:39:01.616445+0000, chain.objs.size()=1 2024-09-12T19:29:41.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.267__shadow_.yySVGBQtqtSXHOqOXXlv7WEYcli8_iL_0 2024-09-12T19:29:41.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7303304298557621113', time=2024-09-12T20:39:03.816142+0000, chain.objs.size()=1 2024-09-12T19:29:41.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.268__shadow_.4YYn5E-ylQbFxly6VguD-d3LR6X45z8_0 2024-09-12T19:29:41.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13928337793357279043', time=2024-09-12T20:39:51.436653+0000, chain.objs.size()=1 2024-09-12T19:29:41.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.289__shadow_.F0vMm0nUwNqUphGgnI2pSzKCZwxwIJ1_0 2024-09-12T19:29:41.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13892971963467456718', time=2024-09-12T20:40:01.890375+0000, chain.objs.size()=1 2024-09-12T19:29:41.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.lkLLF1_-pCuQmUe-cKiT60Tj93Ag8fw_0 2024-09-12T19:29:41.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12435166486071916494', time=2024-09-12T20:40:07.529758+0000, chain.objs.size()=1 2024-09-12T19:29:41.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.0x5w6jZORggZbTDAU6g_bSTEhgBHW7A_0 2024-09-12T19:29:41.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5588865228396346604', time=2024-09-12T20:40:07.620734+0000, chain.objs.size()=1 2024-09-12T19:29:41.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.S4N7PJzcj8w8P92Y9_7bFegMQBHIMq__0 2024-09-12T19:29:41.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3532435534243599962', time=2024-09-12T20:41:14.837859+0000, chain.objs.size()=1 2024-09-12T19:29:41.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.319__shadow:C0.NGeyJ4AKLTK3beLdZ5oZW0rXmSYQ_.6vs7F9pPr-C79kairf7wfOfGUGyduft_0 2024-09-12T19:29:41.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6653609733569360785', time=2024-09-12T20:43:02.471313+0000, chain.objs.size()=1 2024-09-12T19:29:41.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QxHUfr9uuGJdiXcdqb9KSJJGVHwNfeA_0 2024-09-12T19:29:41.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10939985277277461826', time=2024-09-12T20:43:02.848612+0000, chain.objs.size()=1 2024-09-12T19:29:41.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YkwwvWdHHN9nRPUA3fQxsx_R5-B0Dun_0 2024-09-12T19:29:41.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11070166256526182774', time=2024-09-12T20:43:02.858983+0000, chain.objs.size()=1 2024-09-12T19:29:41.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._Qao-SU2Cs1sn-RHP5c59QYqRKvxnhA_0 2024-09-12T19:29:41.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13843130621155720120', time=2024-09-12T20:43:03.887940+0000, chain.objs.size()=1 2024-09-12T19:29:41.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.02Lo45z05QImY82bYAfO1aXejStVq7A_0 2024-09-12T19:29:41.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1181388453320387675', time=2024-09-12T20:43:04.042129+0000, chain.objs.size()=1 2024-09-12T19:29:41.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pJZ7yqS7HPa0EpUsopB9j45fXhVwQlM_0 2024-09-12T19:29:41.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4973561178049622344', time=2024-09-12T20:43:04.598862+0000, chain.objs.size()=1 2024-09-12T19:29:41.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gjzZFViIcLyOMNC00fluw-3-2ekfKSV_0 2024-09-12T19:29:41.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4999932616759103806', time=2024-09-12T20:43:05.162743+0000, chain.objs.size()=1 2024-09-12T19:29:41.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IO2xnBVNIFTDnqO27cpAXg-txAuCCUR_0 2024-09-12T19:29:41.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15939245004834574006', time=2024-09-12T20:43:06.421210+0000, chain.objs.size()=1 2024-09-12T19:29:41.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eDoDwhU2Mg1-TDQaPJqxjlEKOfrNTzG_0 2024-09-12T19:29:41.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5158168389455015609', time=2024-09-12T20:43:07.316501+0000, chain.objs.size()=1 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QGyJx-RVgoUAPJT-6sQHbw2e7o9oG08_0 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.392837419572835583', time=2024-09-12T20:43:07.636973+0000, chain.objs.size()=1 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yjPXTJky4sVOzsfkUslEaeF_ogqr11U_0 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9838983018703896347', time=2024-09-12T20:43:10.661076+0000, chain.objs.size()=1 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SX7DJcyYWb4bT0bhQeCKwm_eA_yAgAP_0 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17694193570053526671', time=2024-09-12T20:43:11.477599+0000, chain.objs.size()=1 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cnRKAnaHo1EE21tnm8D_tuixNXHc0-a_0 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13667297506039181265', time=2024-09-12T20:43:11.571108+0000, chain.objs.size()=1 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.lyTxtYm-kUosabkiMwd0z_JRKjB1b45_0 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18008493910882198809', time=2024-09-12T20:43:12.696636+0000, chain.objs.size()=1 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._qvTMHSBnQ7ochThkJSh79votm8IGYC_0 2024-09-12T19:29:41.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15243043948840758805', time=2024-09-12T20:43:14.900740+0000, chain.objs.size()=1 2024-09-12T19:29:41.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.j3TR4zOcsxsN3S7_Lzv2E5hTxvyjV3y_0 2024-09-12T19:29:41.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1097612330323282469', time=2024-09-12T20:43:15.081957+0000, chain.objs.size()=1 2024-09-12T19:29:41.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.S-9JCNDGEfCUeOsVjQ6bC4MblKHuklP_0 2024-09-12T19:29:41.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2982501150727660241', time=2024-09-12T20:43:15.330135+0000, chain.objs.size()=1 2024-09-12T19:29:41.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.qpgNaEYAa4W-xzqmJmK_mfSWbvR10JU_0 2024-09-12T19:29:41.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13347587078988953663', time=2024-09-12T20:43:17.369183+0000, chain.objs.size()=1 2024-09-12T19:29:41.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.r_gfzSuviV57FKPM9WoLaZmNxm3P3jX_0 2024-09-12T19:29:41.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9812052684411486211', time=2024-09-12T20:43:18.844016+0000, chain.objs.size()=1 2024-09-12T19:29:41.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.n43U7fvlQtMzZRsr5xYBtQADrkQY0aU_0 2024-09-12T19:29:41.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6504740247592288991', time=2024-09-12T20:43:19.141924+0000, chain.objs.size()=1 2024-09-12T19:29:41.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vmnycBk4x8_jiO3hgudza3vnODdsZD3_0 2024-09-12T19:29:41.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7532259793078176145', time=2024-09-12T20:43:19.143622+0000, chain.objs.size()=1 2024-09-12T19:29:41.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._mBsf37fVTtqdriCMcwW8oOxGgKjxUg_0 2024-09-12T19:29:41.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2340263680130374884', time=2024-09-12T20:43:20.929226+0000, chain.objs.size()=1 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ctfDSXk7xB_QWfNgzaTkT_l6YZVTUuM_0 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11937620904395216351', time=2024-09-12T20:43:21.977599+0000, chain.objs.size()=1 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9ifJc5H3bVHVP6vl-l1iGXbkREhMKsI_0 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18319301904868983461', time=2024-09-12T20:43:22.095846+0000, chain.objs.size()=1 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.etby8UHRanZ3IIznMb9zUFrK4WASjNM_0 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7324161486536074346', time=2024-09-12T20:43:22.777265+0000, chain.objs.size()=1 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.e1iFPYoORhgEtCll_ITDGgA-WeflT-i_0 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8205496248031376622', time=2024-09-12T20:43:22.779573+0000, chain.objs.size()=1 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.rRyXXKxOj8MWAGUzHOvwSy_T0Isk-hF_0 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2461032551443123774', time=2024-09-12T20:43:24.926999+0000, chain.objs.size()=1 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VOVcNVeRWIygULNAhtFdp1VZZK4eQqP_0 2024-09-12T19:29:41.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9119244344123525207', time=2024-09-12T20:43:25.694795+0000, chain.objs.size()=1 2024-09-12T19:29:41.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.__90KhCpwNcJF_VCEUOpOFyIfWNjesQ_0 2024-09-12T19:29:41.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1024077020654526074', time=2024-09-12T20:43:26.406546+0000, chain.objs.size()=1 2024-09-12T19:29:41.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.hPCRzMPLwfySQwsu1XkbnhOs4Dmtns7_0 2024-09-12T19:29:41.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14835840631711665040', time=2024-09-12T20:43:26.461613+0000, chain.objs.size()=1 2024-09-12T19:29:41.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-iDOpt6xIQHJ260HLvZsfpzntIYaAkt_0 2024-09-12T19:29:41.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4514384329833887422', time=2024-09-12T20:43:27.039306+0000, chain.objs.size()=1 2024-09-12T19:29:41.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.anY72IiyGEO9W9ICjGX5omEDyjA2_2p_0 2024-09-12T19:29:41.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18087800844916291383', time=2024-09-12T20:43:28.213661+0000, chain.objs.size()=1 2024-09-12T19:29:41.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.BHCAxBlANYbCcvqBMnfjAC3kkcV9W8I_0 2024-09-12T19:29:41.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2844024798138568095', time=2024-09-12T20:43:29.252216+0000, chain.objs.size()=1 2024-09-12T19:29:41.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VNFeRTA1cC0reBWBVnZXNeWRDvAw2CW_0 2024-09-12T19:29:41.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18333933916386393303', time=2024-09-12T20:43:29.677629+0000, chain.objs.size()=1 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IU4A_pM93o1e-P803i0TfeYcSPes6CU_0 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11721918328813577326', time=2024-09-12T20:45:11.367792+0000, chain.objs.size()=1 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WNqOfhMdpl7StEgWJc3mBZTqjks5-br_0 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11722778920292663417', time=2024-09-12T20:45:12.033886+0000, chain.objs.size()=1 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0Y0X_isw2aJiWrrYG0YVRrCR8-Da7fN_0 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8423805835475614382', time=2024-09-12T20:45:12.638570+0000, chain.objs.size()=1 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pLu4bfcyqBcdr3CIQZXDxL0oyb2zoRi_0 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16888300046354140462', time=2024-09-12T20:45:12.747218+0000, chain.objs.size()=1 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.TskQ8CPOmgfct6J8ZElGGECw5AF0oAs_0 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9442609662324961478', time=2024-09-12T20:45:16.801774+0000, chain.objs.size()=1 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2nhwbr_T6OZpQC12sigvLEF8E8ZWNMq_0 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9993149267303618795', time=2024-09-12T20:45:17.158437+0000, chain.objs.size()=1 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.sxLy1_b9Jl1Bb71voHVvyYEFziuN3_x_0 2024-09-12T19:29:41.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11802673741165816971', time=2024-09-12T20:45:17.479636+0000, chain.objs.size()=1 2024-09-12T19:29:41.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.sZFyxVLLvNnXyOYZZp4dnFEZ8jAJMDs_0 2024-09-12T19:29:41.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16391520733641629744', time=2024-09-12T20:45:17.481988+0000, chain.objs.size()=1 2024-09-12T19:29:41.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.l0EjTHreBFFB-4WAIfMCasFMJ_zUgP1_0 2024-09-12T19:29:41.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17992174037023645533', time=2024-09-12T20:45:18.921958+0000, chain.objs.size()=1 2024-09-12T19:29:41.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8b1WI69aeFr0rhC3MyfAxh1GSX42TUV_0 2024-09-12T19:29:41.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15771444518525482253', time=2024-09-12T20:45:20.006341+0000, chain.objs.size()=1 2024-09-12T19:29:41.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WMtE5hlVNP2t4_dKWJDebu1OUB14ahz_0 2024-09-12T19:29:41.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16408805118673707040', time=2024-09-12T20:45:24.226387+0000, chain.objs.size()=1 2024-09-12T19:29:41.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.mX_IpbJEu1It_feKGtQlhChY0HpCm3o_0 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3119838387471396749', time=2024-09-12T20:45:26.059760+0000, chain.objs.size()=1 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ri1pBybSvU2tAWLCMXn-u6P00Sdc0-S_0 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7450520213480782977', time=2024-09-12T20:45:27.517112+0000, chain.objs.size()=1 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.mLqrL0C3svp1IeH6g1UB-mXcqAH_j_a_0 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5493780829725634941', time=2024-09-12T20:45:29.557860+0000, chain.objs.size()=1 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.viJd1qEJZ7QmXOU2q933cf9TL0KDDo5_0 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5080760887359212382', time=2024-09-12T20:45:30.427300+0000, chain.objs.size()=1 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WNLL79jGSVVNTN3WPgK0Coykk6OwuRi_0 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11906388667130098183', time=2024-09-12T20:45:30.857171+0000, chain.objs.size()=1 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.RpMoMLqpMZX7iLCMQI49F78TWQrVma6_0 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6662591050766960590', time=2024-09-12T20:45:31.541440+0000, chain.objs.size()=1 2024-09-12T19:29:41.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dyyfJAwH46ixQhAjTx1O4HpZpgCRdpA_0 2024-09-12T19:29:41.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17944275519044351600', time=2024-09-12T20:45:32.863335+0000, chain.objs.size()=1 2024-09-12T19:29:41.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.sQcjDvNeLgVW6uCySjjX0paHk4atYR8_0 2024-09-12T19:29:41.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4934851775854278661', time=2024-09-12T20:45:33.501468+0000, chain.objs.size()=1 2024-09-12T19:29:41.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ixh826cEbECWvwc1xEJrvRaYflJEwil_0 2024-09-12T19:29:41.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17509510906219717251', time=2024-09-12T20:45:35.233435+0000, chain.objs.size()=1 2024-09-12T19:29:41.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.SeJzQCrNpc7GObodjxyYXIsu7Jmy_t8_0 2024-09-12T19:29:41.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16057304422070597896', time=2024-09-12T20:45:35.393277+0000, chain.objs.size()=1 2024-09-12T19:29:41.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GNUYBEO8Ue4P2nxoKrRZQwyipJqvFYL_0 2024-09-12T19:29:41.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2864878451331275690', time=2024-09-12T20:45:36.836903+0000, chain.objs.size()=1 2024-09-12T19:29:41.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.T0ya3cspuuwx2r3JhfpK3aRq9nbexiY_0 2024-09-12T19:29:41.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8643814714258389636', time=2024-09-12T20:45:36.924049+0000, chain.objs.size()=1 2024-09-12T19:29:41.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Ye5QosSrCYBQvmS1Z-K-Pye3vVC2OY4_0 2024-09-12T19:29:41.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6533587131549099337', time=2024-09-12T20:45:38.014891+0000, chain.objs.size()=1 2024-09-12T19:29:41.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6E9BhmXFuqUAwbtyQ07vtfT3s9TG3Za_0 2024-09-12T19:29:41.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9150001981641013116', time=2024-09-12T20:45:53.643614+0000, chain.objs.size()=1 2024-09-12T19:29:41.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.255+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.332__shadow_.H2pTzoYxKy_GP0MgiKXeIrsIvzEqHCa_0 2024-09-12T19:29:41.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17689047160380108712', time=2024-09-12T20:45:55.661920+0000, chain.objs.size()=1 2024-09-12T19:29:41.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.333__shadow_.OodTftduOklqO300v2HiSEldynpz8a5_0 2024-09-12T19:29:41.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6334637312229860675', time=2024-09-12T20:46:16.914929+0000, chain.objs.size()=1 2024-09-12T19:29:41.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.343__shadow_.cbaAKxpB29ynvFGWMuGDFdhx69sUg7a_0 2024-09-12T19:29:41.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17248953450018502888', time=2024-09-12T20:49:09.509307+0000, chain.objs.size()=1 2024-09-12T19:29:41.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.431__shadow_.B2DxI-MRTz5aenwlcbKqKFCs9QZeuGj_0 2024-09-12T19:29:41.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2928743712489615679', time=2024-09-12T20:49:20.007353+0000, chain.objs.size()=1 2024-09-12T19:29:41.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.436__shadow_.ItguftmQTLPQQ01eNgqGyY-RD1S-GJh_0 2024-09-12T19:29:41.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44865 2024-09-12T19:29:41.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T19:29:41.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1241619510199399551', time=2024-09-12T20:51:02.894145+0000, chain.objs.size()=1 2024-09-12T19:29:41.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.ixbwPzIvN-prAIqSelDscZEgnbkq9K3_0 2024-09-12T19:29:41.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6067114683123972304', time=2024-09-12T20:51:05.565075+0000, chain.objs.size()=1 2024-09-12T19:29:41.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.484__shadow_.5lKK3erKSvDa6PoWSFLFd7SVar38N_M_0 2024-09-12T19:29:41.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1693039073525802831', time=2024-09-12T20:51:18.063599+0000, chain.objs.size()=1 2024-09-12T19:29:41.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.487__shadow_.bTkVCAv4Hp_dqI4YcO5i_d3U-MgO-V2_0 2024-09-12T19:29:41.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11668944683143418669', time=2024-09-12T20:51:42.456177+0000, chain.objs.size()=1 2024-09-12T19:29:41.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.499__shadow_.EC62OWFoLxo592EnBWAMEkI4mTWtn_u_0 2024-09-12T19:29:41.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3693807626123780934', time=2024-09-12T20:52:34.731024+0000, chain.objs.size()=6 2024-09-12T19:29:41.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.1 2024-09-12T19:29:41.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.2 2024-09-12T19:29:41.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.3 2024-09-12T19:29:41.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.4 2024-09-12T19:29:41.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.5 2024-09-12T19:29:41.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.6 2024-09-12T19:29:41.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UKaWjRZHkXHF4A37Qare7moPea_0KQZ', time=2024-09-12T20:56:49.488586+0000, chain.objs.size()=1 2024-09-12T19:29:41.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UKaWjRZHkXHF4A37Qare7moPea_0KQZ.2 2024-09-12T19:29:41.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UKaWjRZHkXHF4A37Qare7moPea_0KQZ', time=2024-09-12T20:56:49.498076+0000, chain.objs.size()=1 2024-09-12T19:29:41.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UKaWjRZHkXHF4A37Qare7moPea_0KQZ.3 2024-09-12T19:29:41.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~kQvmyD_EE-FmkXNuCVzZf0zIhVEnEhV', time=2024-09-12T20:59:48.313334+0000, chain.objs.size()=2 2024-09-12T19:29:41.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.531__multipart_mymultipart.2~kQvmyD_EE-FmkXNuCVzZf0zIhVEnEhV.1 2024-09-12T19:29:41.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.531__multipart_mymultipart.2~kQvmyD_EE-FmkXNuCVzZf0zIhVEnEhV.2 2024-09-12T19:29:41.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14541124981762937861', time=2024-09-12T21:01:40.049835+0000, chain.objs.size()=1 2024-09-12T19:29:41.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.553__shadow_.Utl6JB3zaePLUlddPCMfgExKbXFHeVn_0 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8762510983491303359', time=2024-09-12T21:02:09.072554+0000, chain.objs.size()=1 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.556__shadow_.r7AvPEwyQ1JKtYqsiFJHqwvkAS4NX89_0 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7461355394804559922', time=2024-09-12T21:02:56.280656+0000, chain.objs.size()=1 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.564__shadow_.fJNw25V3IBCdYj7YKUYIMolPUi3rfd0_0 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13696764220904274160', time=2024-09-12T21:04:05.916041+0000, chain.objs.size()=1 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.576__shadow:l5fxmOPjj0CR7TTO9MkRhOKCsCl.L2m_.TM71PnfTFKp8CG_MDR-qDbRUn4qPJHZ_0 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14273513293665746321', time=2024-09-12T21:04:14.477570+0000, chain.objs.size()=1 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:6awLPgRWwwhZnvdie0nrVD-RJx.80q6_.MAE4n816EgATyEurNFbDUcipZqQbcVm_0 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2316255668749592920', time=2024-09-12T21:04:24.681234+0000, chain.objs.size()=1 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:U.ZGASFYwWhnuRnj4RCXuE7tLutYWFx_.LaIUVRKpRhyZxeGr6SuqjLCJaJ6xJIM_0 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9737765081711488515', time=2024-09-12T21:19:28.499031+0000, chain.objs.size()=1 2024-09-12T19:29:41.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.741__shadow_.s-bCIT9NQFK13cN8gC4aLsaMTR6_H-5_0 2024-09-12T19:29:41.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.267+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T19:29:41.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51664' 2024-09-12T19:29:41.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.821390299289279127', time=2024-09-12T20:32:05.949740+0000, chain.objs.size()=1 2024-09-12T19:29:41.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.204__shadow_.uAiySbMWrWrdWOr9XUwo3SmSWaH62GP_0 2024-09-12T19:29:41.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16730617708147505354', time=2024-09-12T20:35:43.397028+0000, chain.objs.size()=1 2024-09-12T19:29:41.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.237__shadow_.5IjMOxwwD9r8pHweR6aaflzR7SmBsOn_0 2024-09-12T19:29:41.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16536815481774434254', time=2024-09-12T20:35:47.174547+0000, chain.objs.size()=1 2024-09-12T19:29:41.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.238__shadow_.r3Y3ZZJ0IXZZmR1Dq0K4J8v2XelvT5b_0 2024-09-12T19:29:41.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13149204502586904486', time=2024-09-12T20:36:05.622081+0000, chain.objs.size()=1 2024-09-12T19:29:41.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.245__shadow_.8d5h5XDgwb1jE9LwfoMzzEa0d1DJ5_r_0 2024-09-12T19:29:41.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16450572971686910918', time=2024-09-12T20:36:16.992321+0000, chain.objs.size()=1 2024-09-12T19:29:41.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.250__shadow_.YNwRMgt0jeGlNoN7U9cOzh84pKzxGpd_0 2024-09-12T19:29:41.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.942423366845258342', time=2024-09-12T20:36:41.906580+0000, chain.objs.size()=1 2024-09-12T19:29:41.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.261__shadow_.-SYTmCEgwtmQmuMxuWuZCg1sdBbQjNy_0 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2229522839211106559', time=2024-09-12T20:38:23.170165+0000, chain.objs.size()=1 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MrBzhAIcZso39oL14S0ygKD5nDrcBR8_0 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3119703573835441962', time=2024-09-12T20:38:24.087350+0000, chain.objs.size()=1 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.PKoIdrQCbCwVV4FSaDKLLKuyXUqSNRj_0 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16299485753401872958', time=2024-09-12T20:38:24.190211+0000, chain.objs.size()=1 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.B8USzfwMGiE7pN6nFu_MRZgoacd9UPr_0 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9679077753385716072', time=2024-09-12T20:38:25.347280+0000, chain.objs.size()=1 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QylQUchphtEv_TU9u__8W5Qn4Zj7Nhr_0 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13926565993813429651', time=2024-09-12T20:38:26.814847+0000, chain.objs.size()=1 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rJ4CouU6Xcx2x5KjZRQarH7fF9KJsVw_0 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14962561592590317964', time=2024-09-12T20:38:26.897360+0000, chain.objs.size()=1 2024-09-12T19:29:41.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0fvziXhPjr_LeLQUyGYCV5orLvkHlyu_0 2024-09-12T19:29:41.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4307485009302270448', time=2024-09-12T20:38:26.940260+0000, chain.objs.size()=1 2024-09-12T19:29:41.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8bOOD-3s2LhJVEJn-TVXC5RtIwzRxvJ_0 2024-09-12T19:29:41.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7100201393752066413', time=2024-09-12T20:38:27.670779+0000, chain.objs.size()=1 2024-09-12T19:29:41.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dgUE3fUCLC9zW3VTsjN97UFTCnVorTn_0 2024-09-12T19:29:41.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9590565324581735023', time=2024-09-12T20:38:29.249114+0000, chain.objs.size()=1 2024-09-12T19:29:41.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rewJiNY0wkHrE9Z07PPDqIo5Dos075U_0 2024-09-12T19:29:41.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8917332370054256129', time=2024-09-12T20:38:30.374141+0000, chain.objs.size()=1 2024-09-12T19:29:41.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lZnPvizRLx-vSu91Owpn5PIBNZq4KQZ_0 2024-09-12T19:29:41.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11756319475729873003', time=2024-09-12T20:38:30.397012+0000, chain.objs.size()=1 2024-09-12T19:29:41.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.xtUzANJwDzTlTCxgaSSUttNQS40-m7D_0 2024-09-12T19:29:41.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17973231914786779487', time=2024-09-12T20:38:32.029233+0000, chain.objs.size()=1 2024-09-12T19:29:41.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1PXsaZG-CSzqEPATY5PhrgUAzRgzWK1_0 2024-09-12T19:29:41.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17706803512324277695', time=2024-09-12T20:38:34.281480+0000, chain.objs.size()=1 2024-09-12T19:29:41.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.l2unToXlayNP4kG14jWKEoAC8nM--8Q_0 2024-09-12T19:29:41.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8682397042409427950', time=2024-09-12T20:38:34.436286+0000, chain.objs.size()=1 2024-09-12T19:29:41.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ne_6_uWcJBukz1EuzD5BTb9YTnXs_ob_0 2024-09-12T19:29:41.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8168621056038064223', time=2024-09-12T20:38:35.538598+0000, chain.objs.size()=1 2024-09-12T19:29:41.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZKFcuegvARzQeDBRBotHvo_pN2U-bTB_0 2024-09-12T19:29:41.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11639201924275079442', time=2024-09-12T20:38:36.762898+0000, chain.objs.size()=1 2024-09-12T19:29:41.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Ds8q2BWxdHE0xN9tHfIZoydGuXspR7X_0 2024-09-12T19:29:41.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10511009956304373681', time=2024-09-12T20:38:36.801948+0000, chain.objs.size()=1 2024-09-12T19:29:41.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8P2Zq0sYs4c-8Koj7aaSqhsQN48lOnW_0 2024-09-12T19:29:41.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6467940789349952090', time=2024-09-12T20:38:38.505283+0000, chain.objs.size()=1 2024-09-12T19:29:41.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.tKt3ZdYsyiy5GhFxj-zk4rysZuoq1eT_0 2024-09-12T19:29:41.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11675916350089479355', time=2024-09-12T20:38:39.044245+0000, chain.objs.size()=1 2024-09-12T19:29:41.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.20JayrwIXEbm3QNTDQbmdAHeXI4Dc8v_0 2024-09-12T19:29:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14083313872967880021', time=2024-09-12T20:38:39.291975+0000, chain.objs.size()=1 2024-09-12T19:29:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Yo0EeZsfOuq7Msduswafe2cGk4Fr_CI_0 2024-09-12T19:29:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8161842344155222846', time=2024-09-12T20:38:39.537479+0000, chain.objs.size()=1 2024-09-12T19:29:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.bX62bWvqaRBHfUjSOlpjVTEI_uojS3z_0 2024-09-12T19:29:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15973870939213287005', time=2024-09-12T20:38:41.702243+0000, chain.objs.size()=1 2024-09-12T19:29:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8UukKr5kzNWAJANPVcdLLRD_MbdF3YJ_0 2024-09-12T19:29:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9183009508138233607', time=2024-09-12T20:38:42.266571+0000, chain.objs.size()=1 2024-09-12T19:29:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.sJG9VJk2d6e6w117Drh-pduigPZKEx7_0 2024-09-12T19:29:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1475934317588282962', time=2024-09-12T20:38:42.405541+0000, chain.objs.size()=1 2024-09-12T19:29:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Tc-jISnqM6D_a7iyZyi1KTa4FKsQx9G_0 2024-09-12T19:29:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13672048036889057780', time=2024-09-12T20:38:43.552070+0000, chain.objs.size()=1 2024-09-12T19:29:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.OQ5bRxCXmC3LIp4aigl_Pkb6Q_xm3PC_0 2024-09-12T19:29:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5607942552966732624', time=2024-09-12T20:38:43.651098+0000, chain.objs.size()=1 2024-09-12T19:29:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.18xZpZ4tNjFrNXMyMn6Vm-WqhF0PfSp_0 2024-09-12T19:29:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2823828086809488148', time=2024-09-12T20:38:43.743124+0000, chain.objs.size()=1 2024-09-12T19:29:41.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.mlTgAQX9Qa6vgYB8_ALjBlob-gyFBqU_0 2024-09-12T19:29:41.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13081496222795171670', time=2024-09-12T20:38:45.161654+0000, chain.objs.size()=1 2024-09-12T19:29:41.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.I4UpiCllpfq1yXLFMuPsfcIvPS4r0zQ_0 2024-09-12T19:29:41.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17404482695680823936', time=2024-09-12T20:38:46.227120+0000, chain.objs.size()=1 2024-09-12T19:29:41.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.h7mB6VnzPvapUtaXSPtvKy-_fLAFn7W_0 2024-09-12T19:29:41.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14053324961155099769', time=2024-09-12T20:38:46.634366+0000, chain.objs.size()=1 2024-09-12T19:29:41.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Xbt5vXcJAgJN_CXC5YG_39jweABj1pl_0 2024-09-12T19:29:41.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.831067155376131543', time=2024-09-12T20:38:46.888008+0000, chain.objs.size()=1 2024-09-12T19:29:41.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MsD35UjooVkKyj5bo2spZxDkMB0HKqn_0 2024-09-12T19:29:41.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15588949732448307781', time=2024-09-12T20:38:47.153204+0000, chain.objs.size()=1 2024-09-12T19:29:41.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1N1fz8JNy1g_fPn1WBJ5YrlxGJnN0y-_0 2024-09-12T19:29:41.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12965347801787376532', time=2024-09-12T20:38:47.488100+0000, chain.objs.size()=1 2024-09-12T19:29:41.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.i718WtvoNJVdPEycCXuIXWfsgmi8JC__0 2024-09-12T19:29:41.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15092344354387520957', time=2024-09-12T20:38:49.099508+0000, chain.objs.size()=1 2024-09-12T19:29:41.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.KgivuqTZk4rCrGy-Zz0xtfkkF8sgYE6_0 2024-09-12T19:29:41.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6151564625190748479', time=2024-09-12T20:38:49.433541+0000, chain.objs.size()=1 2024-09-12T19:29:41.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wWanERBfT5WJM6CMEj5xoLkQc1fCyGH_0 2024-09-12T19:29:41.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9266785143652769595', time=2024-09-12T20:38:52.800702+0000, chain.objs.size()=1 2024-09-12T19:29:41.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.263__shadow_.vHV5IbTIajLNpWXNPf88bW9fTph5fzd_0 2024-09-12T19:29:41.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16224724968304527177', time=2024-09-12T20:39:12.500167+0000, chain.objs.size()=1 2024-09-12T19:29:41.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.272__shadow_.JbCyyMTTcQ0V21wm3EFW-mELQkBzWux_0 2024-09-12T19:29:41.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6412637621088245899', time=2024-09-12T20:39:16.844222+0000, chain.objs.size()=1 2024-09-12T19:29:41.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.274__shadow_.DyH3hBA2fwpjMtAfNDhU9nSEhdvmabw_0 2024-09-12T19:29:41.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10062763438715003582', time=2024-09-12T20:40:02.112410+0000, chain.objs.size()=1 2024-09-12T19:29:41.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.OQtcawn2_6jIBWFNBGk5P5RfSBEm_34_0 2024-09-12T19:29:41.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3889167829715597122', time=2024-09-12T20:40:07.851696+0000, chain.objs.size()=1 2024-09-12T19:29:41.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.PnlTwdN7Qzy0ajV5PzQEqIRrSDPcTqr_0 2024-09-12T19:29:41.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17285953555670681744', time=2024-09-12T20:40:19.435912+0000, chain.objs.size()=1 2024-09-12T19:29:41.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.298__shadow_.fkgiVr6cTQMLqMdkirn3Ryt4BLyDnGi_0 2024-09-12T19:29:41.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2375873305009157646', time=2024-09-12T20:40:28.881352+0000, chain.objs.size()=1 2024-09-12T19:29:41.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.302__shadow_.6oqFwBeH-IT63hPBB0qgUdEudjKV5ok_0 2024-09-12T19:29:41.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16171888498520821607', time=2024-09-12T20:41:14.932664+0000, chain.objs.size()=1 2024-09-12T19:29:41.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.319__shadow:23KkX1Iu7RdtKjYlLRJTk8pw6jcd04O_.7Bdksmwmt-HscGrFq8XvzIBCLEFyPwo_0 2024-09-12T19:29:41.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1437470913717347688', time=2024-09-12T20:43:03.762090+0000, chain.objs.size()=1 2024-09-12T19:29:41.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0bl0mGB8JZvqLP2TKheQibEty5P6t65_0 2024-09-12T19:29:41.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3183668743157356870', time=2024-09-12T20:43:06.403040+0000, chain.objs.size()=1 2024-09-12T19:29:41.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vORP_h9t1O5A0lGX_nQfEVaJiUHJwKB_0 2024-09-12T19:29:41.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5504911829236829442', time=2024-09-12T20:43:06.687662+0000, chain.objs.size()=1 2024-09-12T19:29:41.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IcAfitt3Cc3JgZxMPAFYZwnIrHectTH_0 2024-09-12T19:29:41.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7782615060894189355', time=2024-09-12T20:43:07.992716+0000, chain.objs.size()=1 2024-09-12T19:29:41.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jIkJzGwBmvnUT6gfbGF-yWiida9EJIb_0 2024-09-12T19:29:41.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.325592740031429566', time=2024-09-12T20:43:10.427173+0000, chain.objs.size()=1 2024-09-12T19:29:41.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xkT6MN-tZjWsoj7VzdCGo-wCAPaa9he_0 2024-09-12T19:29:41.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3655740966519069663', time=2024-09-12T20:43:11.889536+0000, chain.objs.size()=1 2024-09-12T19:29:41.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.B1-lM9C8h3bgR9QerLm6ibdq0HSiDok_0 2024-09-12T19:29:41.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16595816705946437607', time=2024-09-12T20:43:12.009884+0000, chain.objs.size()=1 2024-09-12T19:29:41.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.b6qQHCWxlTrLP9mxjyCMerEzrCDHbJE_0 2024-09-12T19:29:41.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14408010540517739030', time=2024-09-12T20:43:12.136095+0000, chain.objs.size()=1 2024-09-12T19:29:41.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.mYoCGkiHhU-BzciSKpl5iYQkObERwL2_0 2024-09-12T19:29:41.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13758546529030612328', time=2024-09-12T20:43:13.964396+0000, chain.objs.size()=1 2024-09-12T19:29:41.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pB5ZjhdjeZYMLYRqmHwIIFH0urP5gS-_0 2024-09-12T19:29:41.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7803215278968419802', time=2024-09-12T20:43:14.012392+0000, chain.objs.size()=1 2024-09-12T19:29:41.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.uOwwzfqFKp7__V4OBbDao_heGveKfI-_0 2024-09-12T19:29:41.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16342229576651001258', time=2024-09-12T20:43:15.837398+0000, chain.objs.size()=1 2024-09-12T19:29:41.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.a4hdYT69rfLTeS1fkG99TRUJ20DQHhL_0 2024-09-12T19:29:41.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10540667755759791322', time=2024-09-12T20:43:16.390880+0000, chain.objs.size()=1 2024-09-12T19:29:41.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KPCC35KX5c86-CtP42pNyhIVs2Stae2_0 2024-09-12T19:29:41.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10424348702955985810', time=2024-09-12T20:43:18.847818+0000, chain.objs.size()=1 2024-09-12T19:29:41.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.c9vllyWf_7OX6ZK8Ff3f54TUEf1E3Xz_0 2024-09-12T19:29:41.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15137085804033152029', time=2024-09-12T20:43:20.784785+0000, chain.objs.size()=1 2024-09-12T19:29:41.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yku94dNnueIwSMDaewDSu8d3VlFvK4x_0 2024-09-12T19:29:41.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15429151764842778004', time=2024-09-12T20:43:22.342515+0000, chain.objs.size()=1 2024-09-12T19:29:41.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.8LARHbYZhWylV8FJ7dU4u351--R2DVY_0 2024-09-12T19:29:41.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2758680162285495383', time=2024-09-12T20:43:22.892622+0000, chain.objs.size()=1 2024-09-12T19:29:41.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YBB8vUwVEBLoLEp0ei0cjPjvwlDXu5v_0 2024-09-12T19:29:41.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12390067464715824592', time=2024-09-12T20:43:23.103128+0000, chain.objs.size()=1 2024-09-12T19:29:41.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.1a_3t3NQ1CXKXUFZ93WrG26MiDZnICc_0 2024-09-12T19:29:41.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3921534879235179922', time=2024-09-12T20:43:23.254764+0000, chain.objs.size()=1 2024-09-12T19:29:41.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gVTdHzFESUwclW-uDgaAGb_n6ksYUqu_0 2024-09-12T19:29:41.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11565388388742616467', time=2024-09-12T20:43:24.490754+0000, chain.objs.size()=1 2024-09-12T19:29:41.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yrO8kZRVkGdwDaO4Nci1f2OKgmaYOrn_0 2024-09-12T19:29:41.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3521256142957197559', time=2024-09-12T20:43:24.560536+0000, chain.objs.size()=1 2024-09-12T19:29:41.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.U9Hu3xpFUH1Y8new8wTAgvEbvBNbWTR_0 2024-09-12T19:29:41.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14993889863928210645', time=2024-09-12T20:43:25.325498+0000, chain.objs.size()=1 2024-09-12T19:29:41.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gMrrwjbBxqLweveLm8Xa4gTGhsW-bG1_0 2024-09-12T19:29:41.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13865218934636437776', time=2024-09-12T20:43:28.057738+0000, chain.objs.size()=1 2024-09-12T19:29:41.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.psOFbwcfS_a5qIcPkLOhnLq9SUwmgMI_0 2024-09-12T19:29:41.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6724684963356529511', time=2024-09-12T20:43:28.302754+0000, chain.objs.size()=1 2024-09-12T19:29:41.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AvVyriorDLFjyn5yPthk1_CtQPlmk9O_0 2024-09-12T19:29:41.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16789731029695671660', time=2024-09-12T20:43:29.029888+0000, chain.objs.size()=1 2024-09-12T19:29:41.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.wfpLtuRK0a5sc4ksSPK8apfnhdr4wmg_0 2024-09-12T19:29:41.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10409299921730644546', time=2024-09-12T20:43:29.305481+0000, chain.objs.size()=1 2024-09-12T19:29:41.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.I0OzKqdSFdbobgqm57-YlgSfOqJAdG2_0 2024-09-12T19:29:41.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13882837721996588485', time=2024-09-12T20:43:29.425481+0000, chain.objs.size()=1 2024-09-12T19:29:41.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YRarvd-JLiM4h_qxJJed7sIY6HkKG9G_0 2024-09-12T19:29:41.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6980629242836841239', time=2024-09-12T20:45:10.917231+0000, chain.objs.size()=1 2024-09-12T19:29:41.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WU01blR2zWG_1HOWE8g8ecner5JA4lb_0 2024-09-12T19:29:41.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2761422065094048407', time=2024-09-12T20:45:11.911111+0000, chain.objs.size()=1 2024-09-12T19:29:41.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.VNkCbn9pgFZKLlsbK8iKBfDkswVBDOm_0 2024-09-12T19:29:41.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.227248751355445628', time=2024-09-12T20:45:12.546910+0000, chain.objs.size()=1 2024-09-12T19:29:41.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FhOubFGV6ZFKdKdiqWja89CgU93v4Tu_0 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5077372269084205702', time=2024-09-12T20:45:13.123946+0000, chain.objs.size()=1 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OQHX5we7gR5TevFwjFK1JqnAODgcsf1_0 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14685094213158533174', time=2024-09-12T20:45:13.577513+0000, chain.objs.size()=1 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OoaO4lS6D1BnZQh7xUuxrM6Heiqo7JG_0 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9432046152693525363', time=2024-09-12T20:45:15.103909+0000, chain.objs.size()=1 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Jf_Z8GtDpVKMKDLesm9nWOYO5mXQgmK_0 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15676892347777073910', time=2024-09-12T20:45:15.802844+0000, chain.objs.size()=1 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.w1kDxHTk3gjQjoehqoK8H4AVWV_Db5j_0 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8315588964723894123', time=2024-09-12T20:45:17.218445+0000, chain.objs.size()=1 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kSQzv2q71dImZVzIeqI0J_h2Rs22adM_0 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12770421384697081338', time=2024-09-12T20:45:18.907357+0000, chain.objs.size()=1 2024-09-12T19:29:41.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cnIUMs-lBrs2ETeTue9wHnKqVb2Ql8Z_0 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15028140655747773174', time=2024-09-12T20:45:19.958239+0000, chain.objs.size()=1 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.44gBUiu6VAsHyzAqnGksKUTTAgyh8DA_0 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2463738163641504745', time=2024-09-12T20:45:20.383907+0000, chain.objs.size()=1 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.s9M0u-FYuO141k3bYtwh_U0oeei8Fuz_0 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.687114232098976312', time=2024-09-12T20:45:24.038766+0000, chain.objs.size()=1 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dKZINLu0TWae4L0E9uzZQR2mud8c60V_0 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9143388023845442252', time=2024-09-12T20:45:25.757534+0000, chain.objs.size()=1 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.CBUiOgOfF8y3jbe4KWFRR6xogIippPl_0 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15056132540316677041', time=2024-09-12T20:45:26.200271+0000, chain.objs.size()=1 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.K55bLWTlnePLJ6BawA2RMofOz4hJ-GK_0 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13690635495131093164', time=2024-09-12T20:45:29.205682+0000, chain.objs.size()=1 2024-09-12T19:29:41.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ZIPbSehl91p3psSn3KI3E-AvHGWKyiI_0 2024-09-12T19:29:41.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4316032522818328829', time=2024-09-12T20:45:29.303445+0000, chain.objs.size()=1 2024-09-12T19:29:41.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pR7LR8Qy-uzbJw73IB1ky09nzK0ArLJ_0 2024-09-12T19:29:41.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16466444567710869550', time=2024-09-12T20:45:29.305089+0000, chain.objs.size()=1 2024-09-12T19:29:41.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.D6rQbRh7TjU5iCJoF-0lPvjP2lq3v1B_0 2024-09-12T19:29:41.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18160345068093434689', time=2024-09-12T20:45:29.626892+0000, chain.objs.size()=1 2024-09-12T19:29:41.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.M1PPLKvfPYx2xT5ZCy7kMNBqsggP-bt_0 2024-09-12T19:29:41.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13772892173510098267', time=2024-09-12T20:45:29.628966+0000, chain.objs.size()=1 2024-09-12T19:29:41.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5NW1vkZ-_W46ealHt3ire2L6le1Lgu0_0 2024-09-12T19:29:41.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.878777578085731306', time=2024-09-12T20:45:30.479959+0000, chain.objs.size()=1 2024-09-12T19:29:41.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0qFMkT_rVQ1LC6T6-5srQ_UhRAP4JxL_0 2024-09-12T19:29:41.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.299+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13014221553409939508', time=2024-09-12T20:45:30.564654+0000, chain.objs.size()=1 2024-09-12T19:29:41.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GJjUf4LwJsiSPs5Of0_s-47vxrzIuDE_0 2024-09-12T19:29:41.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.299+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9626082332060963995', time=2024-09-12T20:45:31.680363+0000, chain.objs.size()=1 2024-09-12T19:29:41.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OURhXnNyQok0MpjwmPWIvZ2SMGv1bAR_0 2024-09-12T19:29:41.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.299+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10245597025201145599', time=2024-09-12T20:45:33.091191+0000, chain.objs.size()=1 2024-09-12T19:29:41.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fFC-I3ox9MF-2tXk-ZC1oyisu95fFPR_0 2024-09-12T19:29:41.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.299+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6920572994642220822', time=2024-09-12T20:45:33.819259+0000, chain.objs.size()=1 2024-09-12T19:29:41.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.RBMj6hd44_5E4TxJJuXOmiyWPqBNE8D_0 2024-09-12T19:29:41.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.299+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11828057447779376124', time=2024-09-12T20:45:33.821408+0000, chain.objs.size()=1 2024-09-12T19:29:41.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.SkBfubzcNbm5TvOLRGKF7fZLF7HDnsk_0 2024-09-12T19:29:41.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51664 2024-09-12T19:29:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T19:29:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15560346795952973229', time=2024-09-12T20:45:35.077269+0000, chain.objs.size()=1 2024-09-12T19:29:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ptUkTseyHb444LUr-7rbUhZyLGZXoHF_0 2024-09-12T19:29:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15331179819882790857', time=2024-09-12T20:45:36.149775+0000, chain.objs.size()=1 2024-09-12T19:29:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.BZhCeSfUbzTjVgJyxGYDpzyVoP_veKE_0 2024-09-12T19:29:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2693989739110559703', time=2024-09-12T20:45:36.162662+0000, chain.objs.size()=1 2024-09-12T19:29:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UeA93nv_3puJORIKfb_JkYGJOvOIu80_0 2024-09-12T19:29:41.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4602561892449714016', time=2024-09-12T20:45:38.104599+0000, chain.objs.size()=1 2024-09-12T19:29:41.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WmDJoWxajGOEdfr2MiYWg-w3WS_lBZo_0 2024-09-12T19:29:41.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3204529590476582015', time=2024-09-12T20:45:38.213487+0000, chain.objs.size()=1 2024-09-12T19:29:41.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lx6jQQOGqkSvjFTxAti4Y0SZT9_RjDi_0 2024-09-12T19:29:41.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13097093555093776313', time=2024-09-12T20:47:15.769224+0000, chain.objs.size()=1 2024-09-12T19:29:41.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.375__shadow_.D6GU-IdkPv6MKSfR5TH69GmU04Vqovv_0 2024-09-12T19:29:41.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14256682909556970914', time=2024-09-12T20:47:24.351031+0000, chain.objs.size()=1 2024-09-12T19:29:41.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.379__shadow_.G4fA3_f5ue-via6QIEo2ccVWAk546oJ_0 2024-09-12T19:29:41.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10576035709527578470', time=2024-09-12T20:51:35.033471+0000, chain.objs.size()=1 2024-09-12T19:29:41.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.496__shadow_.VNAShtq7LRWUVXR3mtMsRs3LUpabDC5_0 2024-09-12T19:29:41.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16487004105684018818', time=2024-09-12T20:58:49.267061+0000, chain.objs.size()=3 2024-09-12T19:29:41.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~tp6VtYEjQbL44Ih9g58jcidqBSB25Ln.1 2024-09-12T19:29:41.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__shadow_mymultipart.2~tp6VtYEjQbL44Ih9g58jcidqBSB25Ln.1_1 2024-09-12T19:29:41.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~tp6VtYEjQbL44Ih9g58jcidqBSB25Ln.2 2024-09-12T19:29:41.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5616156677774948214', time=2024-09-12T21:02:36.996771+0000, chain.objs.size()=1 2024-09-12T19:29:41.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.559__shadow_.AaZEFZc56gC5EcQi6CTRZ6qNDW7zHD5_0 2024-09-12T19:29:41.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3735029580226797694', time=2024-09-12T21:02:44.397105+0000, chain.objs.size()=1 2024-09-12T19:29:41.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.562__shadow_.VnrPusdJjmSt-eQoNXOW2SSIifii0Y7_0 2024-09-12T19:29:41.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2301843363708528602', time=2024-09-12T21:03:19.128762+0000, chain.objs.size()=1 2024-09-12T19:29:41.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:foOkmrbChU-ufo0Fz5d.OVxJ9oDQ8Pr_.AB_ie3u2v8ICqqaQR23rHK7POEn9Pa-_0 2024-09-12T19:29:41.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1980180199463767287', time=2024-09-12T21:03:20.432064+0000, chain.objs.size()=1 2024-09-12T19:29:41.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.303+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:Shfy1JlznDsBjHJ.ig5dsSS6q4nMaCF_.SrRQP-wGkfzuMXF1J3boDNjudv8AnFQ_0 2024-09-12T19:29:41.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2121251467045389613', time=2024-09-12T21:03:40.345263+0000, chain.objs.size()=1 2024-09-12T19:29:41.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.573__shadow_.w3sjhc2TdAAcdPagF4f15YytqTbPhiD_0 2024-09-12T19:29:41.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7288284326050840038', time=2024-09-12T21:09:47.169302+0000, chain.objs.size()=12 2024-09-12T19:29:41.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__multipart_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.1 2024-09-12T19:29:41.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__shadow_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.1_1 2024-09-12T19:29:41.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__multipart_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.2 2024-09-12T19:29:41.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__shadow_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.2_1 2024-09-12T19:29:41.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__multipart_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.3 2024-09-12T19:29:41.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__shadow_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.3_1 2024-09-12T19:29:41.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__multipart_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.4 2024-09-12T19:29:41.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__shadow_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.4_1 2024-09-12T19:29:41.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__multipart_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.5 2024-09-12T19:29:41.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__shadow_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.5_1 2024-09-12T19:29:41.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__multipart_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.6 2024-09-12T19:29:41.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.615__shadow_multipart_enc.2~foyQty5jAGm7sEKlJp2Ty2POSE8mso7.6_1 2024-09-12T19:29:41.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T19:29:41.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/60156' 2024-09-12T19:29:41.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10790670693913949475', time=2024-09-12T20:35:39.552416+0000, chain.objs.size()=1 2024-09-12T19:29:41.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.236__shadow_.LySDa7RY0JJKANLoEvx0ulAsvCRRkNn_0 2024-09-12T19:29:41.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18332668536104403077', time=2024-09-12T20:35:53.378149+0000, chain.objs.size()=1 2024-09-12T19:29:41.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.241__shadow_.I4KiWMtuVdq3HKFxTHC1qTKAVpF3VKv_0 2024-09-12T19:29:41.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11190311815832397996', time=2024-09-12T20:36:26.349651+0000, chain.objs.size()=1 2024-09-12T19:29:41.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.254__shadow_.ppvN5aLV48nnNXkCEun9N1ziUfgKDSV_0 2024-09-12T19:29:41.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17124103657824677378', time=2024-09-12T20:38:24.183574+0000, chain.objs.size()=1 2024-09-12T19:29:41.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.zzfFjedioefCAgEylojaQYUKgtaQ5NO_0 2024-09-12T19:29:41.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11865713988485058914', time=2024-09-12T20:38:26.724542+0000, chain.objs.size()=1 2024-09-12T19:29:41.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.i1nneOPrRvjyjRFU_RUiy8oqodQitcm_0 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7563319291849373158', time=2024-09-12T20:38:28.138789+0000, chain.objs.size()=1 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.PUeAMln_hwZ_bTWBcE_4wXIrwQOCSoN_0 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5989231872605372522', time=2024-09-12T20:38:30.626888+0000, chain.objs.size()=1 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.XQUCz19OINwiFDioXQZqHtQaXPt4_Go_0 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9663165322640626839', time=2024-09-12T20:38:30.775389+0000, chain.objs.size()=1 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1UYL2zdAgOGhgqaqzxTdFju1_YftDiQ_0 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8659635790334208249', time=2024-09-12T20:38:30.975088+0000, chain.objs.size()=1 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9aY9L2JmAZMKBTbDXe1c3c5xEur6IvI_0 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2329751966062364676', time=2024-09-12T20:38:31.909754+0000, chain.objs.size()=1 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1bleAmVZK2sl0-h1WI9KicynPyrJ0ME_0 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16273363802705036030', time=2024-09-12T20:38:35.366670+0000, chain.objs.size()=1 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jpoh124GDYXbSndlxDg3Kwm9P-UCxip_0 2024-09-12T19:29:41.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13341226487591845451', time=2024-09-12T20:38:36.104331+0000, chain.objs.size()=1 2024-09-12T19:29:41.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dv0WJHRaFfcJ6BJApHKh19hyNp0W8wa_0 2024-09-12T19:29:41.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13589655252078841990', time=2024-09-12T20:38:37.767901+0000, chain.objs.size()=1 2024-09-12T19:29:41.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.gr8LXAJLfmqoDCcrtg2hKZ8seDc3VXE_0 2024-09-12T19:29:41.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4459681055086274934', time=2024-09-12T20:38:38.170439+0000, chain.objs.size()=1 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.zrw3NARGYOKRmpvkLPVEOWAqYZGTIOb_0 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9118902996779003598', time=2024-09-12T20:38:38.588889+0000, chain.objs.size()=1 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5Gfik4H8m-w91Zd4t4UXFWPxQvEJu-g_0 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8653630653212097403', time=2024-09-12T20:38:38.969662+0000, chain.objs.size()=1 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rw1ragN-HwsVfmto2Cl46zUnb69gefs_0 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4966946715591445025', time=2024-09-12T20:38:39.340917+0000, chain.objs.size()=1 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RxwNWaZ8HOPsHydeVtGm3qmKpbNZobI_0 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14373948329302956243', time=2024-09-12T20:38:41.255780+0000, chain.objs.size()=1 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7mpTvj6thJw2rfSJJDCgypzm0ZjL1YQ_0 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1719633145754764062', time=2024-09-12T20:38:41.334349+0000, chain.objs.size()=1 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.IyGQNFZ1Gzi7f1pmvi74m_Ej-iKQK1k_0 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6542778038348410583', time=2024-09-12T20:38:41.337607+0000, chain.objs.size()=1 2024-09-12T19:29:41.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.plAUBQ-X3oasfReG53dVxuvLtXPG5ik_0 2024-09-12T19:29:41.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14857940932539911342', time=2024-09-12T20:38:41.655375+0000, chain.objs.size()=1 2024-09-12T19:29:41.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.DP3u12uLwiGg71YJIBVSNjj2YcHu5G0_0 2024-09-12T19:29:41.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17581966063963056029', time=2024-09-12T20:38:42.559659+0000, chain.objs.size()=1 2024-09-12T19:29:41.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4V_S9YQyX2_Zo_uhdvTZ6tHxhawy7or_0 2024-09-12T19:29:41.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18290677018771518796', time=2024-09-12T20:38:43.318217+0000, chain.objs.size()=1 2024-09-12T19:29:41.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5aqjLFXIgkaUkihJwGuF3B9dg-rSVaq_0 2024-09-12T19:29:41.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9449101545457281557', time=2024-09-12T20:38:43.854196+0000, chain.objs.size()=1 2024-09-12T19:29:41.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._wQL6VZWwrY5j3PPUJ_zSVZI4IKsSAt_0 2024-09-12T19:29:41.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14188698978754574665', time=2024-09-12T20:38:44.911812+0000, chain.objs.size()=1 2024-09-12T19:29:41.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.xRwnqJ_fR6Os2bzt9s8baTfluqiKzDu_0 2024-09-12T19:29:41.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14885010588071727112', time=2024-09-12T20:38:45.389659+0000, chain.objs.size()=1 2024-09-12T19:29:41.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EFuv3XXIiFpC7_U1I7j84wpwlCZh_eX_0 2024-09-12T19:29:41.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12638910664577776948', time=2024-09-12T20:38:45.620027+0000, chain.objs.size()=1 2024-09-12T19:29:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Ros7XN3YnM3NdfeQcG3BsG61LUPn7t2_0 2024-09-12T19:29:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.691128539663501325', time=2024-09-12T20:38:45.767228+0000, chain.objs.size()=1 2024-09-12T19:29:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.BgyLJQpoLjisU74AhoiI-iYRb33w0Vl_0 2024-09-12T19:29:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.143111229802072346', time=2024-09-12T20:38:45.828189+0000, chain.objs.size()=1 2024-09-12T19:29:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.uNnKJ3luf7nQa5QGXEtdUX15Jc_6EkW_0 2024-09-12T19:29:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16814149059042977620', time=2024-09-12T20:38:46.522980+0000, chain.objs.size()=1 2024-09-12T19:29:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fz1CZf1Hir3x-TjbLe3OYxz0eQXcRXF_0 2024-09-12T19:29:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.312793083275642810', time=2024-09-12T20:38:47.091565+0000, chain.objs.size()=1 2024-09-12T19:29:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9DqqW-PQZlATRYStkGE3LsSYZDjwz1e_0 2024-09-12T19:29:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18182657368018917504', time=2024-09-12T20:38:47.570716+0000, chain.objs.size()=1 2024-09-12T19:29:41.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kPQ4M8pRoV8BdrS-lZoYYLVeezaQn2K_0 2024-09-12T19:29:41.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1336453499579755537', time=2024-09-12T20:38:48.398239+0000, chain.objs.size()=1 2024-09-12T19:29:41.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.2FSs1BGJikqW__bDcHM153dxUFwhwdm_0 2024-09-12T19:29:41.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8962315939638477492', time=2024-09-12T20:39:03.801944+0000, chain.objs.size()=1 2024-09-12T19:29:41.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.268__shadow_.UhbH93V7wGvxLELRwj0Q6ZkAKE1355U_0 2024-09-12T19:29:41.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12981419209843500902', time=2024-09-12T20:39:14.630849+0000, chain.objs.size()=1 2024-09-12T19:29:41.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.273__shadow_.98d4ZH0SsFdAghgyoDF6MyX4RZelFwu_0 2024-09-12T19:29:41.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2413636490587353222', time=2024-09-12T20:39:19.058742+0000, chain.objs.size()=1 2024-09-12T19:29:41.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.275__shadow_.BXtuHn540WpxEJWO2GdLt90c-VVBy0T_0 2024-09-12T19:29:41.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12605790969836895361', time=2024-09-12T20:40:07.702030+0000, chain.objs.size()=1 2024-09-12T19:29:41.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.LZeq_g1ULYZItrY8e01taGFEwvJIWUk_0 2024-09-12T19:29:41.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3419377196735320903', time=2024-09-12T20:40:07.845733+0000, chain.objs.size()=1 2024-09-12T19:29:41.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.S84crwHqand_AGggCOc6aqwTRAyfLbu_0 2024-09-12T19:29:41.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14093631227507391464', time=2024-09-12T20:43:02.407071+0000, chain.objs.size()=1 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.OxFA7Eupzc4B8lusvhdzEo2-qFmChjZ_0 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9321681349841096409', time=2024-09-12T20:43:02.927740+0000, chain.objs.size()=1 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cTuHbLZ0EvX914p2-yUB8hdqFubMTGV_0 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.873260224216548492', time=2024-09-12T20:43:03.756318+0000, chain.objs.size()=1 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.v7TGcsm97dsZB69TNIezCn2rJyYgEcB_0 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17779732196065037038', time=2024-09-12T20:43:07.118268+0000, chain.objs.size()=1 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xq9hSo8U9XEanod5rcZad-FurxGOdCz_0 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12879051185425923055', time=2024-09-12T20:43:07.578762+0000, chain.objs.size()=1 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.T1wZUqH4PNIirkSXsFaBghIjLFXaqOM_0 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6302879295986282740', time=2024-09-12T20:43:07.840968+0000, chain.objs.size()=1 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.G-0GLd6qX6rGydvw7PLYa2FdlujD6N2_0 2024-09-12T19:29:41.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4670539836020864108', time=2024-09-12T20:43:08.876054+0000, chain.objs.size()=1 2024-09-12T19:29:41.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.K6UTa5TJTi6h_73wJuFAAWStonLdqO1_0 2024-09-12T19:29:41.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3135362782064598894', time=2024-09-12T20:43:10.451462+0000, chain.objs.size()=1 2024-09-12T19:29:41.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.P0pFudfXoC3_bf4swEfWsMhRPh7rwf7_0 2024-09-12T19:29:41.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1706388101699992400', time=2024-09-12T20:43:10.746290+0000, chain.objs.size()=1 2024-09-12T19:29:41.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.RFdC-O6K_drLzyWtAdl29sed3UMcNpQ_0 2024-09-12T19:29:41.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12265264842369449227', time=2024-09-12T20:43:11.806764+0000, chain.objs.size()=1 2024-09-12T19:29:41.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xEKjvyq9lDWuxm1k8VBgvqf1oaGpLt7_0 2024-09-12T19:29:41.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11543738251254345737', time=2024-09-12T20:43:11.923878+0000, chain.objs.size()=1 2024-09-12T19:29:41.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VM2EJoH1E_xzVx53oVQPIDeBAKCtzX1_0 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11129783639380694046', time=2024-09-12T20:43:12.401041+0000, chain.objs.size()=1 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.bbnvzMCi5jXpV2bwG1bY_DY2MBM18cC_0 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5060845316051936930', time=2024-09-12T20:43:12.649278+0000, chain.objs.size()=1 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.a1BxeBCSZAP3sYNPTsqWtV8SrGelFfk_0 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9462513875502341013', time=2024-09-12T20:43:12.707316+0000, chain.objs.size()=1 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.K4hhYbskGla2uyz0yK8I4DVGnCVk3Ki_0 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13210305488276972097', time=2024-09-12T20:43:14.013580+0000, chain.objs.size()=1 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.51V8PnVQX245DyJDuSDZkdnMEgYCFbU_0 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8887214142206680770', time=2024-09-12T20:43:14.090755+0000, chain.objs.size()=1 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Bcb2FN3jT0LKxJ4oqoFC-D6J9h4Zr3B_0 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12507338356292980971', time=2024-09-12T20:43:15.217029+0000, chain.objs.size()=1 2024-09-12T19:29:41.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.31vGE8FZJxXOnC0YWJj7tOJcOlom35w_0 2024-09-12T19:29:41.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4151296212563288163', time=2024-09-12T20:43:15.218987+0000, chain.objs.size()=1 2024-09-12T19:29:41.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.NomkEKN-atdnkDtoE-rGx292P5V49wb_0 2024-09-12T19:29:41.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16671592859323018548', time=2024-09-12T20:43:17.970693+0000, chain.objs.size()=1 2024-09-12T19:29:41.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4Nm0F4ChSTZ8YNPk0aC7pbfy96oSpaX_0 2024-09-12T19:29:41.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14371050286031466495', time=2024-09-12T20:43:18.408677+0000, chain.objs.size()=1 2024-09-12T19:29:41.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.g0FI17YDHTpSzEtHTkJ5THU7bdzFYL__0 2024-09-12T19:29:41.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8381011936810923028', time=2024-09-12T20:43:19.706064+0000, chain.objs.size()=1 2024-09-12T19:29:41.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.euK-4GizqG-4xqw5ErWYXEsoGp8JTOS_0 2024-09-12T19:29:41.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4830448629682288662', time=2024-09-12T20:43:20.887117+0000, chain.objs.size()=1 2024-09-12T19:29:41.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Gs0NUw82knTrrxqQmCc7HDq_Ie2tg2D_0 2024-09-12T19:29:41.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15331944050869050385', time=2024-09-12T20:43:21.107357+0000, chain.objs.size()=1 2024-09-12T19:29:41.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.oOLr1eBmgfn2eIGCddWySScv8pFv08f_0 2024-09-12T19:29:41.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16077349000172586417', time=2024-09-12T20:43:21.900045+0000, chain.objs.size()=1 2024-09-12T19:29:41.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.1DJgOb4cGRMwGFGjmBLes8RZ3_7a5u3_0 2024-09-12T19:29:41.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3387079122782788010', time=2024-09-12T20:43:22.050325+0000, chain.objs.size()=1 2024-09-12T19:29:41.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.66a5v_rMmxeERTjdpdVqPwIk66yKB_L_0 2024-09-12T19:29:41.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4250649114132162349', time=2024-09-12T20:43:22.147312+0000, chain.objs.size()=1 2024-09-12T19:29:41.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Q9U8rSLUuPiG-erbmAgfVzI3A2J41eA_0 2024-09-12T19:29:41.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9215110175259108122', time=2024-09-12T20:43:23.462040+0000, chain.objs.size()=1 2024-09-12T19:29:41.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.39U9kb8EjFtS1VnCr3gEVqqvupkpoBF_0 2024-09-12T19:29:41.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8327089757370610671', time=2024-09-12T20:43:23.483476+0000, chain.objs.size()=1 2024-09-12T19:29:41.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.MsZwg4g7YLouVgjddKSCZ8TJN7VHnzm_0 2024-09-12T19:29:41.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15710413225667615851', time=2024-09-12T20:43:25.741710+0000, chain.objs.size()=1 2024-09-12T19:29:41.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.bFFmY4n7EXACeZtDwKhzEfWjbHJhrZw_0 2024-09-12T19:29:41.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9678839584847959301', time=2024-09-12T20:45:11.745846+0000, chain.objs.size()=1 2024-09-12T19:29:41.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.-zSLVjjiP-rrNjqVuektv9qHlsDIpsv_0 2024-09-12T19:29:41.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9468103628054295816', time=2024-09-12T20:45:12.017056+0000, chain.objs.size()=1 2024-09-12T19:29:41.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Zyr-WK1WVQtYomUeG7vcd2_ChS-NqpU_0 2024-09-12T19:29:41.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2919999024071947844', time=2024-09-12T20:45:12.141911+0000, chain.objs.size()=1 2024-09-12T19:29:41.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2aFAOHZqUn0grOnRrx0Jgo2JOjNM-qb_0 2024-09-12T19:29:41.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11856668439548909879', time=2024-09-12T20:45:12.209806+0000, chain.objs.size()=1 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zONf_5l1ma0xwOGBbK7YvG-KcmK9WJP_0 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8792858970264861541', time=2024-09-12T20:45:12.502052+0000, chain.objs.size()=1 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.tPrUS8DRR8EHoWr-HU1fcCyR_z1ZKBk_0 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12778740359067431006', time=2024-09-12T20:45:12.969466+0000, chain.objs.size()=1 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qZp_MvKp19WJ3DP1oN4slaSxCkr8yFB_0 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3976454811008511480', time=2024-09-12T20:45:13.367962+0000, chain.objs.size()=1 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OfETZHm3XePwLkysuzY9HW5wIu5R_o4_0 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13205260582359965636', time=2024-09-12T20:45:16.890473+0000, chain.objs.size()=1 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kFs58Rfcse6-K8oyTCcUKU2xxGlSI_A_0 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14852362531675351097', time=2024-09-12T20:45:16.892584+0000, chain.objs.size()=1 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ujP4Ua8A9P7uo5GzqxnTgDuolr939HW_0 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11895857655623000511', time=2024-09-12T20:45:18.494482+0000, chain.objs.size()=1 2024-09-12T19:29:41.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Ur76e5OTIYshyYPybMgB7Xw5mEb03mt_0 2024-09-12T19:29:41.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12338401155044023228', time=2024-09-12T20:45:18.496443+0000, chain.objs.size()=1 2024-09-12T19:29:41.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ELN4tGB_x-wXL6lQex_Jx0NU2kfzcHT_0 2024-09-12T19:29:41.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15134022789776829209', time=2024-09-12T20:45:18.655267+0000, chain.objs.size()=1 2024-09-12T19:29:41.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.S_Cr1gmO4O1_xnUe_lscpKkk9FZ8NHj_0 2024-09-12T19:29:41.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14488119276058516367', time=2024-09-12T20:45:19.331459+0000, chain.objs.size()=1 2024-09-12T19:29:41.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.q2OquGEmtM-l_BPxVXZjgNtPhCEvYtl_0 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5704756724597428469', time=2024-09-12T20:45:20.477653+0000, chain.objs.size()=1 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UY61OYOGzdbTXBIvkNcB5JgcI8VKkV3_0 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9277796203116146787', time=2024-09-12T20:45:22.008969+0000, chain.objs.size()=1 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UUptNAx_hPwX9PK8oyDFRdsiZrGYCp__0 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3738818984363864117', time=2024-09-12T20:45:22.178307+0000, chain.objs.size()=1 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2mx9SLjQPLBS0754nDtDSyoJeDB-AJF_0 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4214763438807631896', time=2024-09-12T20:45:23.120804+0000, chain.objs.size()=1 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.IMYNZNbEPt0mcOdA5i9B6bopxqcZWCi_0 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8946278423434502368', time=2024-09-12T20:45:23.532321+0000, chain.objs.size()=1 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xcdyWVbv9zWW5MkFTom0EuwPVQ9lbQs_0 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5231555412069991901', time=2024-09-12T20:45:23.729420+0000, chain.objs.size()=1 2024-09-12T19:29:41.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.NFb3ZxAg61jdMTB5KPSfz3AZOigB0SE_0 2024-09-12T19:29:41.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17229457618412302163', time=2024-09-12T20:45:23.824657+0000, chain.objs.size()=1 2024-09-12T19:29:41.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.sUgW-i0HpaObym00iWxPhkGFEpM34ON_0 2024-09-12T19:29:41.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16490562028599755918', time=2024-09-12T20:45:25.754140+0000, chain.objs.size()=1 2024-09-12T19:29:41.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2jysJsLpzeT-KvbItKZ-Lg3ad8lHu2S_0 2024-09-12T19:29:41.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4260550661043928508', time=2024-09-12T20:45:25.755823+0000, chain.objs.size()=1 2024-09-12T19:29:41.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dCo7syX0ts0TgUhD6SFxHbLON2PAQJn_0 2024-09-12T19:29:41.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14911978031171965088', time=2024-09-12T20:45:25.872612+0000, chain.objs.size()=1 2024-09-12T19:29:41.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1LTgkrGh4nyYYZ4fBwwAkzlW2vNKpJE_0 2024-09-12T19:29:41.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14452308909279871718', time=2024-09-12T20:45:26.288418+0000, chain.objs.size()=1 2024-09-12T19:29:41.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.TqiJFGqcq7bXzdnwGYengBIU4w8Fwso_0 2024-09-12T19:29:41.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1785022631867212532', time=2024-09-12T20:45:27.073425+0000, chain.objs.size()=1 2024-09-12T19:29:41.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cyX0lqIXKDWmDs_65fYJUtDtZP16YsV_0 2024-09-12T19:29:41.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10262001270057513145', time=2024-09-12T20:45:27.677063+0000, chain.objs.size()=1 2024-09-12T19:29:41.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nyu5E1wp40EUx2zlb0NcDWiHx2x1FWL_0 2024-09-12T19:29:41.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11321398217779678669', time=2024-09-12T20:45:27.678738+0000, chain.objs.size()=1 2024-09-12T19:29:41.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nxibmHdODk7K1tjjU4QBF1168R3EqmF_0 2024-09-12T19:29:41.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10817975075540295857', time=2024-09-12T20:45:27.926892+0000, chain.objs.size()=1 2024-09-12T19:29:41.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ac6yz7jdkuSGFoKTfXY84H0q0rGCBI4_0 2024-09-12T19:29:41.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7656751150266375525', time=2024-09-12T20:45:28.261567+0000, chain.objs.size()=1 2024-09-12T19:29:41.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Lb01Wj003-oYDNbPzDh4TAL1JszF7TQ_0 2024-09-12T19:29:41.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5667843195426029114', time=2024-09-12T20:45:29.307248+0000, chain.objs.size()=1 2024-09-12T19:29:41.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wOg84GoiUWUq1Ut72ylh6DRGQiVKZNH_0 2024-09-12T19:29:41.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7292770673542488946', time=2024-09-12T20:45:29.720178+0000, chain.objs.size()=1 2024-09-12T19:29:41.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.gNAoQs15biycURwQ8tQ9ykAE7vuNQbz_0 2024-09-12T19:29:41.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13857913728657519395', time=2024-09-12T20:45:31.670745+0000, chain.objs.size()=1 2024-09-12T19:29:41.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Gm3TR0upBPpX8YGOQKjS5Gp2816-db1_0 2024-09-12T19:29:41.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15585864936094906988', time=2024-09-12T20:45:31.867935+0000, chain.objs.size()=1 2024-09-12T19:29:41.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.jZHb8qaj1HHQv835U4JtEKDuigXb3OJ_0 2024-09-12T19:29:41.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/60156 2024-09-12T19:29:41.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T19:29:41.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8973105181632547055', time=2024-09-12T20:45:33.460511+0000, chain.objs.size()=1 2024-09-12T19:29:41.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5VYhg4k26JCoUwlhzegzhg-Sft4O4bD_0 2024-09-12T19:29:41.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12444040872779443264', time=2024-09-12T20:45:34.627746+0000, chain.objs.size()=1 2024-09-12T19:29:41.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.g_aCoU2a1SvwFndyEFmn4sobqzFke_Z_0 2024-09-12T19:29:41.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6385510348119276139', time=2024-09-12T20:45:34.916327+0000, chain.objs.size()=1 2024-09-12T19:29:41.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nc91AALJMHI47l7rtdiwdrT2sgVfV97_0 2024-09-12T19:29:41.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13336459702311023373', time=2024-09-12T20:45:34.948848+0000, chain.objs.size()=1 2024-09-12T19:29:41.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dKSdYbmoZhVTpSba0Hb7o34Kr9rZ0t-_0 2024-09-12T19:29:41.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.706199416521020312', time=2024-09-12T20:45:35.410102+0000, chain.objs.size()=1 2024-09-12T19:29:41.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lff0-L8KXaYD2UrlgkXORk3RloZVClZ_0 2024-09-12T19:29:41.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.141305003678444105', time=2024-09-12T20:45:36.874186+0000, chain.objs.size()=1 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8SdBLXOe2zKL5jg81XdSPfgO73vhFrR_0 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4149098649579593379', time=2024-09-12T20:45:36.875884+0000, chain.objs.size()=1 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ZQ33rpXA9jHIj70b0KWhnKfpSoRxUAu_0 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7594966046094464357', time=2024-09-12T20:45:37.622460+0000, chain.objs.size()=1 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.XUOe-4iZuNdIaTM1MyzmHMMuqQ1a4l1_0 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2871448885735165603', time=2024-09-12T20:45:38.071102+0000, chain.objs.size()=1 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Yugm5xuKfXLl1cmkJCmBBKYDi048cf5_0 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14361530699992789081', time=2024-09-12T20:47:04.943810+0000, chain.objs.size()=1 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.370__shadow_.AaEmukE3DJ2qz4nR9AdZua4R45khhU4_0 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7908661861250582477', time=2024-09-12T20:50:35.369864+0000, chain.objs.size()=1 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.466__shadow_.vGkRpQWAlwYTv8po5ImmYctMHtOOD_n_0 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12574514912825016922', time=2024-09-12T20:50:36.254516+0000, chain.objs.size()=1 2024-09-12T19:29:41.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.466__shadow_.kVAeX6iJucF0e-g7XZozRbZCjamYsKt_0 2024-09-12T19:29:41.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10768883084184179950', time=2024-09-12T20:51:51.076809+0000, chain.objs.size()=1 2024-09-12T19:29:41.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.503__shadow:ZaN5iQFdkxMluSElq-iCxGVc.IoNdB._.0iAzXRtuwU4n61WPRJhvnPJx8SSDQ8I_0 2024-09-12T19:29:41.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~EdB-sb0C6gTcUyn4JwenZHVR-ZOZxvH', time=2024-09-12T20:59:06.883037+0000, chain.objs.size()=10 2024-09-12T19:29:41.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.526__multipart_mymultipart.2~EdB-sb0C6gTcUyn4JwenZHVR-ZOZxvH.1 2024-09-12T19:29:41.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.526__multipart_mymultipart.2~EdB-sb0C6gTcUyn4JwenZHVR-ZOZxvH.2 2024-09-12T19:29:41.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.526__multipart_mymultipart.2~EdB-sb0C6gTcUyn4JwenZHVR-ZOZxvH.3 2024-09-12T19:29:41.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.526__multipart_mymultipart.2~EdB-sb0C6gTcUyn4JwenZHVR-ZOZxvH.4 2024-09-12T19:29:41.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.526__multipart_mymultipart.2~EdB-sb0C6gTcUyn4JwenZHVR-ZOZxvH.5 2024-09-12T19:29:41.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.526__multipart_mymultipart.2~EdB-sb0C6gTcUyn4JwenZHVR-ZOZxvH.6 2024-09-12T19:29:41.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.526__multipart_mymultipart.2~EdB-sb0C6gTcUyn4JwenZHVR-ZOZxvH.7 2024-09-12T19:29:41.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.526__multipart_mymultipart.2~EdB-sb0C6gTcUyn4JwenZHVR-ZOZxvH.8 2024-09-12T19:29:41.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.526__multipart_mymultipart.2~EdB-sb0C6gTcUyn4JwenZHVR-ZOZxvH.9 2024-09-12T19:29:41.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.526__multipart_mymultipart.2~EdB-sb0C6gTcUyn4JwenZHVR-ZOZxvH.10 2024-09-12T19:29:41.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3095075130246233803', time=2024-09-12T21:00:32.519715+0000, chain.objs.size()=1 2024-09-12T19:29:41.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.537__shadow_.15kyIUHoeRScQqDAGfHgAtWA_KEvlWh_0 2024-09-12T19:29:41.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7174368564626643063', time=2024-09-12T21:03:12.373880+0000, chain.objs.size()=1 2024-09-12T19:29:41.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:iT9a3CJvwwon0qqka15p.80nPKvbJ5Y_.bSZVz8nS6SWopKhA5HtbQt9gLLfO5jZ_0 2024-09-12T19:29:41.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7305735286250571991', time=2024-09-12T21:04:02.329592+0000, chain.objs.size()=1 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.576__shadow:TRxdRxoIkebac2n50JXAjBQ6xv4qieA_.EE-n0-GO-4rbd_pRD82IekasTxAKNGj_0 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2045423930425469741', time=2024-09-12T21:06:15.907375+0000, chain.objs.size()=1 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.586__shadow:dR558c4SjkfJDBTHUrCKxBErIM8h400_.piXeUDiKi9xNflYHWXOzPvngv2CjFyN_0 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9201248317534207182', time=2024-09-12T21:06:38.067818+0000, chain.objs.size()=1 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.596__shadow_.DwKrbyyg_S1T-vidVXFFjjh_dLVNWV4_0 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4020137480653249997', time=2024-09-12T21:10:52.396843+0000, chain.objs.size()=1 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.617__shadow_.P5R3efnUrw52GdoprDZr8zP9swcCr4x_0 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8672137721922175185', time=2024-09-12T21:15:05.138702+0000, chain.objs.size()=2 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.655__shadow_.iPAS6JDyURh67HJYsrxw17rL3I-J47p_0 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.655__shadow_.iPAS6JDyURh67HJYsrxw17rL3I-J47p_1 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14342748046844578715', time=2024-09-12T21:16:22.478245+0000, chain.objs.size()=1 2024-09-12T19:29:41.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.670__shadow_.hkMKUw4AnaHTf3f4HEGazuvAGjFveRp_0 2024-09-12T19:29:41.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T19:29:41.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48470' 2024-09-12T19:29:41.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7126582962221184676', time=2024-09-12T20:29:38.339600+0000, chain.objs.size()=5 2024-09-12T19:29:41.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.161__multipart_foo-LUKEWARM.2~vjZwUKWJxCc17i75rs1WvKeiWTovz4W.1 2024-09-12T19:29:41.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_foo-LUKEWARM.2~vjZwUKWJxCc17i75rs1WvKeiWTovz4W.1_1 2024-09-12T19:29:41.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.161__multipart_foo-LUKEWARM.2~vjZwUKWJxCc17i75rs1WvKeiWTovz4W.2 2024-09-12T19:29:41.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_foo-LUKEWARM.2~vjZwUKWJxCc17i75rs1WvKeiWTovz4W.2_1 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.161__multipart_foo-LUKEWARM.2~vjZwUKWJxCc17i75rs1WvKeiWTovz4W.3 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2708557076504326997', time=2024-09-12T20:35:34.761943+0000, chain.objs.size()=1 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.234__shadow_.daTn8sVGkpG0beYZssi746dd4-fgd0H_0 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12145452594461077294', time=2024-09-12T20:35:47.202618+0000, chain.objs.size()=1 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.238__shadow_.iCJ1R1dECZ4tSdCQGuXvdlVd8kxfOMv_0 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16307541420594146231', time=2024-09-12T20:36:03.361013+0000, chain.objs.size()=1 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.244__shadow_.nKxMJrzS48tCohXHIAnUuonQNMD_KTa_0 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13063333748450317239', time=2024-09-12T20:36:16.964319+0000, chain.objs.size()=1 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.250__shadow_.W_4rp1gAf9LzHy7A0zyp4Fme-eb2IrX_0 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18038453983911412530', time=2024-09-12T20:38:22.358870+0000, chain.objs.size()=1 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9_BB2VT44K9_mVjJXnojTLLCv7xiEdZ_0 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.298976731085340940', time=2024-09-12T20:38:23.388742+0000, chain.objs.size()=1 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WMOmKRkCBau4RF8gPL27_XTWqdMzTL8_0 2024-09-12T19:29:41.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16833841062668059442', time=2024-09-12T20:38:23.479253+0000, chain.objs.size()=1 2024-09-12T19:29:41.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.yYYfzzo_XqIgQbRtBQhylgT8XcIFLzU_0 2024-09-12T19:29:41.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3476140512832618961', time=2024-09-12T20:38:23.911818+0000, chain.objs.size()=1 2024-09-12T19:29:41.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hw6k3_kcTQE-V7e0JIipPq2NT99RHXO_0 2024-09-12T19:29:41.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2346555033965377923', time=2024-09-12T20:38:24.569610+0000, chain.objs.size()=1 2024-09-12T19:29:41.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AM-HShDV6HjIreMtn4SX3ejLdZCezuB_0 2024-09-12T19:29:41.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12997020457035431364', time=2024-09-12T20:38:24.796960+0000, chain.objs.size()=1 2024-09-12T19:29:41.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Eal9GprKuC_9tsQPREFkugGjjya_Iq-_0 2024-09-12T19:29:41.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3694237852069567660', time=2024-09-12T20:38:26.590786+0000, chain.objs.size()=1 2024-09-12T19:29:41.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.e7RDnlZmwwjqf5pwg_xhEaaJisXjOIW_0 2024-09-12T19:29:41.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11923101555046571795', time=2024-09-12T20:38:26.592706+0000, chain.objs.size()=1 2024-09-12T19:29:41.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.FDOoeF5wucfo9S4NRapWiqJnWlS6uYw_0 2024-09-12T19:29:41.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10422248825472913896', time=2024-09-12T20:38:28.123007+0000, chain.objs.size()=1 2024-09-12T19:29:41.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fW9K41BHsQZPKVlvYIHup097u4YMSFE_0 2024-09-12T19:29:41.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5672691407481510787', time=2024-09-12T20:38:28.358525+0000, chain.objs.size()=1 2024-09-12T19:29:41.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.58-pifyk9CZPlGKmj0GKbFv3D6Iol15_0 2024-09-12T19:29:41.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5124584924811271436', time=2024-09-12T20:38:29.320704+0000, chain.objs.size()=1 2024-09-12T19:29:41.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.6FKIdDnNnXzD5M2szz6VTHoE2pHOdJ-_0 2024-09-12T19:29:41.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4225860827789219688', time=2024-09-12T20:38:30.366594+0000, chain.objs.size()=1 2024-09-12T19:29:41.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EBf9C3_OhvMG58PjBHtNBCUBpEyUHcJ_0 2024-09-12T19:29:41.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.26390884326100183', time=2024-09-12T20:38:30.970982+0000, chain.objs.size()=1 2024-09-12T19:29:41.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.f08EKbxp0PrEi-YLTTZMG5NAG9om106_0 2024-09-12T19:29:41.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4446868064500175501', time=2024-09-12T20:38:36.361301+0000, chain.objs.size()=1 2024-09-12T19:29:41.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.s5_BQixeqQo2AV-V4lboN2qnYzkTzdt_0 2024-09-12T19:29:41.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10537162717190226606', time=2024-09-12T20:38:37.693597+0000, chain.objs.size()=1 2024-09-12T19:29:41.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.I5ErqCoCpUvjKvQbFuVBm_hmI6JV6P5_0 2024-09-12T19:29:41.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15612233993226386073', time=2024-09-12T20:38:38.061710+0000, chain.objs.size()=1 2024-09-12T19:29:41.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.NOsgad7SxYBzaUKAj0qbgxwxZzxQik0_0 2024-09-12T19:29:41.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5012623489731943394', time=2024-09-12T20:38:38.148834+0000, chain.objs.size()=1 2024-09-12T19:29:41.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.tfLUndhNNtJErFhjRFp31EI8zBMiDvW_0 2024-09-12T19:29:41.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8998304776589769159', time=2024-09-12T20:38:38.886126+0000, chain.objs.size()=1 2024-09-12T19:29:41.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Z3ExKTUaQvJijb8Dwad9XGxyNB8izM0_0 2024-09-12T19:29:41.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9653004712011696219', time=2024-09-12T20:38:39.829672+0000, chain.objs.size()=1 2024-09-12T19:29:41.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MFv-XcPFW9OnJJnd_Ttau5Bf9OnVw8D_0 2024-09-12T19:29:41.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13854387066905876616', time=2024-09-12T20:38:40.311122+0000, chain.objs.size()=1 2024-09-12T19:29:41.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QKBaXtcs0B5xRmE6qHwbFKogLcUtPml_0 2024-09-12T19:29:41.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16161858303446901224', time=2024-09-12T20:38:41.366868+0000, chain.objs.size()=1 2024-09-12T19:29:41.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.q9JrxpeCE3_OgcOHSQRVi6vlrph9QMs_0 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10745390545927150194', time=2024-09-12T20:38:41.739867+0000, chain.objs.size()=1 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.mxvxMiZqLxsCPxT1k8kMQEd5U_aHis-_0 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17938231303856497513', time=2024-09-12T20:38:42.175623+0000, chain.objs.size()=1 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MBf_pqzmW6b-fRKEmTWP-k3fcDBy-k0_0 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11494354008709064707', time=2024-09-12T20:38:42.556717+0000, chain.objs.size()=1 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9LLwH8243TztfqGRqnkSiHITWrXsDvV_0 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4203833529091372668', time=2024-09-12T20:38:42.840722+0000, chain.objs.size()=1 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.oa_uat7yg6D4sff0FsFlGMa6w0ryM1L_0 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5764228474708719546', time=2024-09-12T20:38:45.349351+0000, chain.objs.size()=1 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.6SYzh3jURzE18bJpISIeoX2urNs4iT7_0 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6441959040367689720', time=2024-09-12T20:38:45.862624+0000, chain.objs.size()=1 2024-09-12T19:29:41.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.3ryntwAvJoce9PnqmutgiOZ51BHTNYB_0 2024-09-12T19:29:41.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6691756082620898786', time=2024-09-12T20:38:46.262198+0000, chain.objs.size()=1 2024-09-12T19:29:41.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.gd76UNAg9M_WgKnXiZehYh-wvvYewio_0 2024-09-12T19:29:41.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11720039143509558863', time=2024-09-12T20:38:47.526345+0000, chain.objs.size()=1 2024-09-12T19:29:41.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.UpY1xAOiVs5KnVvcG3XMTH7hUAeJOJA_0 2024-09-12T19:29:41.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.819085436445450198', time=2024-09-12T20:38:47.578432+0000, chain.objs.size()=1 2024-09-12T19:29:41.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9tD3lorX9jpTn-cyiyzbC5LxLgUj-mO_0 2024-09-12T19:29:41.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14252419811917448592', time=2024-09-12T20:38:48.252609+0000, chain.objs.size()=1 2024-09-12T19:29:41.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1onYBVh6rzw7DrQLULzereY5o2Kiff3_0 2024-09-12T19:29:41.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18335083166286403454', time=2024-09-12T20:38:48.683730+0000, chain.objs.size()=1 2024-09-12T19:29:41.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Wn3yhxwip21taMhCd1Vnpoilb-VPTqc_0 2024-09-12T19:29:41.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13527059651170911862', time=2024-09-12T20:38:48.685992+0000, chain.objs.size()=1 2024-09-12T19:29:41.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WOwLMZlol9S6vrh00DfzemzGW8qu-je_0 2024-09-12T19:29:41.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7562927353689162969', time=2024-09-12T20:38:49.013381+0000, chain.objs.size()=1 2024-09-12T19:29:41.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.O9m9JfIW950N6dHwhdnbbtggoPwZJfS_0 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6085603850270257072', time=2024-09-12T20:38:49.104628+0000, chain.objs.size()=1 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.UDD4ddvee8xql-MaBi65Bblb7KYiB2D_0 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12922474853631010248', time=2024-09-12T20:38:49.450930+0000, chain.objs.size()=1 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.NyJq9yUtTukUjnnZR-nwJqJiLpDzPev_0 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10267559649775350071', time=2024-09-12T20:38:49.661693+0000, chain.objs.size()=1 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Q8_3EITvV0mDMBD-VKF67vxZ0qKQ8v1_0 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3773286308654119442', time=2024-09-12T20:38:52.805865+0000, chain.objs.size()=1 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.263__shadow_.bFEB7VdN5O58whoXJGrCJtC5Aa8rsaF_0 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15342223057492955801', time=2024-09-12T20:39:30.463238+0000, chain.objs.size()=1 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.280__shadow_.Xz01HrD153XyavJF4m7onowZXqTVudA_0 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6277477170261321400', time=2024-09-12T20:39:32.769540+0000, chain.objs.size()=1 2024-09-12T19:29:41.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.281__shadow_.A6MWWbIJV0zX378h-Uit64niJ70kWh4_0 2024-09-12T19:29:41.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17702301750074377153', time=2024-09-12T20:39:35.074917+0000, chain.objs.size()=1 2024-09-12T19:29:41.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.282__shadow_.XRfPSkV89BZfJvMLZq5sDfo_H70Bl2y_0 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2582803882409868035', time=2024-09-12T20:39:44.721203+0000, chain.objs.size()=1 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.286__shadow_.e5CTvoTMx99SJhVpESmWIU3W-0DdEr1_0 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3296832196517826179', time=2024-09-12T20:40:01.713438+0000, chain.objs.size()=1 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_._D63EE_17etwjETFZVCvPha9Avme_Q1_0 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16582218926352242077', time=2024-09-12T20:40:01.748235+0000, chain.objs.size()=1 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.m079T0kq4HhqhH65gL0WdUa5QF-qvuC_0 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8054224967482512032', time=2024-09-12T20:40:17.021897+0000, chain.objs.size()=1 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.297__shadow_.ZH-Rtf4aThXx7XVNiI43lKI3HV5avnu_0 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9502907568745574791', time=2024-09-12T20:40:35.777732+0000, chain.objs.size()=1 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.305__shadow_.ZHH7qZCigkQTCE7xDHavL-_P0dZphCM_0 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9616724820028991750', time=2024-09-12T20:40:53.975367+0000, chain.objs.size()=1 2024-09-12T19:29:41.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.313__shadow_.m25arOvlxCjMTJLEYPldeyvlVzkPgba_0 2024-09-12T19:29:41.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3208041608422635787', time=2024-09-12T20:43:02.493345+0000, chain.objs.size()=1 2024-09-12T19:29:41.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7LhO6NcMrHYTs5rXn6_vGLCXab4KMUv_0 2024-09-12T19:29:41.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3012990561143550738', time=2024-09-12T20:43:03.229381+0000, chain.objs.size()=1 2024-09-12T19:29:41.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EWb3zDfcsJAm8QoR7L71krTH80f5Ued_0 2024-09-12T19:29:41.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3215380686926216143', time=2024-09-12T20:43:03.631660+0000, chain.objs.size()=1 2024-09-12T19:29:41.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vvCCgT3xUV8TvYf1l_sz0xP4Vn1yfYZ_0 2024-09-12T19:29:41.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8719021206632271014', time=2024-09-12T20:43:05.195282+0000, chain.objs.size()=1 2024-09-12T19:29:41.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3rfE7WtW7iC6IMK2NBFlkheV2Ylan0Q_0 2024-09-12T19:29:41.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1596568319430065287', time=2024-09-12T20:43:06.530711+0000, chain.objs.size()=1 2024-09-12T19:29:41.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.LVRL6c5CCxDscAtJOe_QwpFgUO27mQr_0 2024-09-12T19:29:41.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16798716545256640274', time=2024-09-12T20:43:06.897213+0000, chain.objs.size()=1 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jpUBI5rnHJVDdtPo_RpR54kxNXf3N-v_0 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13747364519941157718', time=2024-09-12T20:43:07.962619+0000, chain.objs.size()=1 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VhBayLm9bc2FPPyuYyFtw-f3kTWmhre_0 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13842991748743909163', time=2024-09-12T20:43:08.411648+0000, chain.objs.size()=1 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.lRmF5YiARrDGWl-cpa8y2tYGFCUaryH_0 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12864874428972079654', time=2024-09-12T20:43:08.633980+0000, chain.objs.size()=1 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AlQi4AWHU3AEVMLrdzM18BLu6uu_5jI_0 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14463152525985428047', time=2024-09-12T20:43:08.737253+0000, chain.objs.size()=1 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.RVzb9uCoVipgVZ-BCbH3g4iPSPXAeAe_0 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1168650389025110218', time=2024-09-12T20:43:08.971695+0000, chain.objs.size()=1 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6Yk4n0H0PamD24-sMYM3lAre5sK9em2_0 2024-09-12T19:29:41.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4514304981839649525', time=2024-09-12T20:43:10.560217+0000, chain.objs.size()=1 2024-09-12T19:29:41.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.dAZse7DKyjuVQplgjXRTYqdF_ixTXgw_0 2024-09-12T19:29:41.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.321447160059196763', time=2024-09-12T20:43:10.670677+0000, chain.objs.size()=1 2024-09-12T19:29:41.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SyGy_yco-CA88syhFK9bSyecNtzwnro_0 2024-09-12T19:29:41.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8866445033959324138', time=2024-09-12T20:43:12.700057+0000, chain.objs.size()=1 2024-09-12T19:29:41.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.WxVKSHp0fgSoHFP_cShDjFxG5Tb1CEt_0 2024-09-12T19:29:41.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3224862504874409840', time=2024-09-12T20:43:14.023422+0000, chain.objs.size()=1 2024-09-12T19:29:41.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YFFocy8krQB12OmwZDYJxab7yMFecBG_0 2024-09-12T19:29:41.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.711360150022459781', time=2024-09-12T20:43:14.916270+0000, chain.objs.size()=1 2024-09-12T19:29:41.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.mI5-FHmVfQ_bJbILda3VjHAM_JO_fMK_0 2024-09-12T19:29:41.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8678550508317793562', time=2024-09-12T20:43:15.034115+0000, chain.objs.size()=1 2024-09-12T19:29:41.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zz6O2UliPc3A7x2gSEHXJjODeiOwzmN_0 2024-09-12T19:29:41.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15407762374712026887', time=2024-09-12T20:43:18.131455+0000, chain.objs.size()=1 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.71To1b7RqbaDvP71PWhvCs1YdZQReL8_0 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3819100765491161000', time=2024-09-12T20:43:18.942444+0000, chain.objs.size()=1 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ApRW7aemdTy9I4lZVg_f6IrEDgUeCWa_0 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17530067744784797098', time=2024-09-12T20:43:21.537464+0000, chain.objs.size()=1 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.CX5Y8Hdmh9JUP9XJD2O2x6BTNluQBIC_0 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12934219744064217494', time=2024-09-12T20:43:21.908982+0000, chain.objs.size()=1 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yGSOU64RkQW9xs-xPfL5HxYLcHKCda0_0 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2356153463335686779', time=2024-09-12T20:43:22.003979+0000, chain.objs.size()=1 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eVRzaan-rANZ6TzEQtaWo99z9WmCxtC_0 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15156783449141923882', time=2024-09-12T20:43:24.516760+0000, chain.objs.size()=1 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.kmcV6KcJNOou-U6CS6JjMyaz9G3RRNe_0 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15815030690237331603', time=2024-09-12T20:43:25.180412+0000, chain.objs.size()=1 2024-09-12T19:29:41.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.1EDRl5Wi_GGjgais2vpxdPUG4_GiucK_0 2024-09-12T19:29:41.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7758139345389714909', time=2024-09-12T20:43:25.580915+0000, chain.objs.size()=1 2024-09-12T19:29:41.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.qdJW3fgMV8TkaFbG0DB8OwvqSGUxFa__0 2024-09-12T19:29:41.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16991186597641131489', time=2024-09-12T20:43:26.985018+0000, chain.objs.size()=1 2024-09-12T19:29:41.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tTWB5Ir175t9RYpSUzachcXpqXAfBpN_0 2024-09-12T19:29:41.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13091995431968044059', time=2024-09-12T20:43:27.100348+0000, chain.objs.size()=1 2024-09-12T19:29:41.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.2FngZ5E3DmqvMA1JEo4aynPdVsuUGbv_0 2024-09-12T19:29:41.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16983806875543977655', time=2024-09-12T20:43:28.501522+0000, chain.objs.size()=1 2024-09-12T19:29:41.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.375+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TyOkUUZJEF4A76FEPruZ9MF3UdKiNz-_0 2024-09-12T19:29:41.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7162131099866980336', time=2024-09-12T20:43:28.944210+0000, chain.objs.size()=1 2024-09-12T19:29:41.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.LRHRcDtwiPql6QbV3uxnbyHTnRN8NM-_0 2024-09-12T19:29:41.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10185510911717725311', time=2024-09-12T20:43:29.681812+0000, chain.objs.size()=1 2024-09-12T19:29:41.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._EsB6qJ_pVrMz4Ds7qcFRI6LKJPoZtI_0 2024-09-12T19:29:41.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17322727544557646065', time=2024-09-12T20:45:11.588772+0000, chain.objs.size()=1 2024-09-12T19:29:41.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9fHPyGVziyc38WaUI2v9DoDgGoQbzJx_0 2024-09-12T19:29:41.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10925154806653171636', time=2024-09-12T20:45:13.107634+0000, chain.objs.size()=1 2024-09-12T19:29:41.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2E8zSM-taaKx4vwFJ-N2Jl-Zbfm6Y1m_0 2024-09-12T19:29:41.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14068239785597183799', time=2024-09-12T20:45:14.657045+0000, chain.objs.size()=1 2024-09-12T19:29:41.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.HpAHItYHD2TayXo8gxAq8VVm3OiI3ry_0 2024-09-12T19:29:41.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15263523273376970811', time=2024-09-12T20:45:15.603158+0000, chain.objs.size()=1 2024-09-12T19:29:41.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fsqwqGo_iJfRHo_XBZgMn1ASr9rVDXt_0 2024-09-12T19:29:41.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3315634250185128947', time=2024-09-12T20:45:15.605571+0000, chain.objs.size()=1 2024-09-12T19:29:41.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.afJ2SYVvruWphLc7AFSCTYD7bQzfssu_0 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9830954268282300976', time=2024-09-12T20:45:15.855987+0000, chain.objs.size()=1 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.na_GUvC8ZfB-Otcgb1Mzv_VCw9r0Z44_0 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2167324128599414432', time=2024-09-12T20:45:16.190104+0000, chain.objs.size()=1 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OInwq3kXjjcHgmiqqyCV-Xm1_AypsdB_0 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8960952661253319549', time=2024-09-12T20:45:16.902778+0000, chain.objs.size()=1 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qecuXVPlx8JSlkMkPqS1yMANxClUNZF_0 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15409598298619419665', time=2024-09-12T20:45:17.054683+0000, chain.objs.size()=1 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9qFdU0HJ3439hcqFI7R9auDsn1YxpCP_0 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4392900727420337460', time=2024-09-12T20:45:17.484918+0000, chain.objs.size()=1 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.p0A1KTIDyy3hBsJaWclzhEwDi51Pnt7_0 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16094327980575223965', time=2024-09-12T20:45:19.991644+0000, chain.objs.size()=1 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.897fxMOjytTQrg2Ktd5V_sKrKoDDHDa_0 2024-09-12T19:29:41.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4680982711961853401', time=2024-09-12T20:45:19.993558+0000, chain.objs.size()=1 2024-09-12T19:29:41.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qP8w-5XSY8KdTTIKYn4ShsS5kqZCF7a_0 2024-09-12T19:29:41.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3097975172840662100', time=2024-09-12T20:45:20.124319+0000, chain.objs.size()=1 2024-09-12T19:29:41.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xClV8RYplY2NWLIHb3LrFqANK5NCsv__0 2024-09-12T19:29:41.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3175971049258112332', time=2024-09-12T20:45:20.206033+0000, chain.objs.size()=1 2024-09-12T19:29:41.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.gzeJvp7KE2pL2CO0kJqccMJvRIhd3RC_0 2024-09-12T19:29:41.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.183753133295181123', time=2024-09-12T20:45:21.102505+0000, chain.objs.size()=1 2024-09-12T19:29:41.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.92u1vAi0I9JDrFzAoCERvSlT_JqPkiC_0 2024-09-12T19:29:41.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6378282851591750016', time=2024-09-12T20:45:23.720992+0000, chain.objs.size()=1 2024-09-12T19:29:41.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WkKGCF2cYOTiCnKWppCMRYsoWzGYhFz_0 2024-09-12T19:29:41.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6533966929889231911', time=2024-09-12T20:45:23.837733+0000, chain.objs.size()=1 2024-09-12T19:29:41.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fo3r_LmJDCdiqNjv0_aCw-PpCSG5ozQ_0 2024-09-12T19:29:41.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7233878956861085422', time=2024-09-12T20:45:23.840016+0000, chain.objs.size()=1 2024-09-12T19:29:41.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ROzkBjuYuSdwLWV0g4FE0CTPIwk9Izp_0 2024-09-12T19:29:41.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48470 2024-09-12T19:29:41.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T19:29:41.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1227550130915689797', time=2024-09-12T20:45:23.961990+0000, chain.objs.size()=1 2024-09-12T19:29:41.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.q9bpr9tUA9mvwyL3ptcp_LxDSMxsAjw_0 2024-09-12T19:29:41.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12207098312968586044', time=2024-09-12T20:45:25.762343+0000, chain.objs.size()=1 2024-09-12T19:29:41.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9t8nTu_FyYbTNhkdJRMJsGCX_OODvvi_0 2024-09-12T19:29:41.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.115698693610411525', time=2024-09-12T20:45:26.055329+0000, chain.objs.size()=1 2024-09-12T19:29:41.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1IKPySf3GbokeEG0kFvolK67zljP0sB_0 2024-09-12T19:29:41.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10258870259494346986', time=2024-09-12T20:45:26.174848+0000, chain.objs.size()=1 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6LR4n-f2aXHxpyYb4UvE8ubLgTFxoCj_0 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15849762307408354444', time=2024-09-12T20:45:26.568372+0000, chain.objs.size()=1 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.RaMEwXKvT1FUWV9lOLAoYjQscI5sEfY_0 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15517156816599714655', time=2024-09-12T20:45:26.725944+0000, chain.objs.size()=1 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ebfg_JjtA4ySAyVE7b0hQXMxAuku2Wn_0 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14828231930231192822', time=2024-09-12T20:45:27.607261+0000, chain.objs.size()=1 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.IE4alqTbDpEGLEMyuwWY_dEbMDeLeTA_0 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17465568764832745009', time=2024-09-12T20:45:28.419253+0000, chain.objs.size()=1 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MTHCU--6mmYwI8ukfzSv5j0ldPGta8G_0 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9260297332181308404', time=2024-09-12T20:45:29.967696+0000, chain.objs.size()=1 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dfT03MSapZm34C-eIK5tIrmVdTCZ4n7_0 2024-09-12T19:29:41.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3325888289968767785', time=2024-09-12T20:45:30.440029+0000, chain.objs.size()=1 2024-09-12T19:29:41.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xIJPhsezR2CRwHgr6ufOfOmqLmeKCGX_0 2024-09-12T19:29:41.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1341249497309239774', time=2024-09-12T20:45:30.733053+0000, chain.objs.size()=1 2024-09-12T19:29:41.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WY7gCAo8A3cRR3eo9tZp9yUq3Pr4zW3_0 2024-09-12T19:29:41.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1526989596808674977', time=2024-09-12T20:45:31.387288+0000, chain.objs.size()=1 2024-09-12T19:29:41.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.yAG993E9QDf1ufHn7gQLFmgLUnI4zab_0 2024-09-12T19:29:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8603934391735981385', time=2024-09-12T20:45:31.969598+0000, chain.objs.size()=1 2024-09-12T19:29:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.foCP5undKn1rhoAUg1e5SWmjpKY6VNa_0 2024-09-12T19:29:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12450566935528973291', time=2024-09-12T20:45:33.739676+0000, chain.objs.size()=1 2024-09-12T19:29:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.F2AmdCC4TPLsAdDZeFb_p1qs47tzMgw_0 2024-09-12T19:29:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17854471826135403510', time=2024-09-12T20:45:34.885456+0000, chain.objs.size()=1 2024-09-12T19:29:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.BUVMBZLKrB4R64V_fSW_SqZnc_bfShU_0 2024-09-12T19:29:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5395581737200215819', time=2024-09-12T20:45:34.914510+0000, chain.objs.size()=1 2024-09-12T19:29:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.XerP8lQnwxHfVebj27QXT193Yvdff2-_0 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3951438116517387739', time=2024-09-12T20:45:35.144261+0000, chain.objs.size()=1 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WvM4GVGbaXPn-VT3O7Z43nfzSCnkoJL_0 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6820674668760759631', time=2024-09-12T20:45:37.783828+0000, chain.objs.size()=1 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.30kBST982mlbWwWkIoO0MXGj2viGHf8_0 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12392696892188151741', time=2024-09-12T20:45:42.158166+0000, chain.objs.size()=1 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.326__shadow_.z5pmUNPQwuv172clOSeYDrjwwUxLiln_0 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12002407582835490009', time=2024-09-12T20:47:22.689153+0000, chain.objs.size()=1 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.378__shadow_.fkSm_jbFD_eqebHDjhE2sLi35rJau_F_0 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6237291954214581215', time=2024-09-12T20:51:20.267378+0000, chain.objs.size()=1 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.488__shadow_.AV9nIHAICXLnflhO2W33w_OqhVzodvw_0 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.384484138882766046', time=2024-09-12T20:51:39.264332+0000, chain.objs.size()=1 2024-09-12T19:29:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.498__shadow_.K8c6ZsfhPkZiA61QltzSurF5yP8NzzA_0 2024-09-12T19:29:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10867364274516622411', time=2024-09-12T20:58:41.447399+0000, chain.objs.size()=1 2024-09-12T19:29:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~oHnZoZv8DSBg4PnhyhV8d924YN6AshQ.1 2024-09-12T19:29:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12424570089618526331', time=2024-09-12T21:02:17.203255+0000, chain.objs.size()=1 2024-09-12T19:29:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.557__shadow_.KD1CbdipRPav1X3hWof6KKDQZ8eklZC_0 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10683719461144307414', time=2024-09-12T21:02:32.678101+0000, chain.objs.size()=2 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.558__shadow_.mh40lEibp56_h8fn89bo-V-ecnDNN2C_0 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.558__shadow_.mh40lEibp56_h8fn89bo-V-ecnDNN2C_1 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16321897042360753614', time=2024-09-12T21:03:32.058087+0000, chain.objs.size()=1 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.570__shadow:OIVCtPyyq9WoHdjJtMbC-gY.bxZ2Ic-_.JSXC9flvSunbeTb2kWEVpeF2YTAybr6_0 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9672383455450698025', time=2024-09-12T21:05:54.576447+0000, chain.objs.size()=1 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.579__shadow:SVcDMYGtJ2vNL3SnJLao6vlvvIlWfWf_.p5KQ3NP_UTxF23e2yVPtGmIr3amYxC3_0 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.246320988497258491', time=2024-09-12T21:05:54.824244+0000, chain.objs.size()=1 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.579__shadow:NHmIoNWguh07rLJ8L6alaIGecQJY9Xp_.G4-RYJi6gUtH_6kWfuFouZN18CJAij__0 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9623256998859811921', time=2024-09-12T21:06:57.407182+0000, chain.objs.size()=1 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.606__shadow_.oYVIjvX7_dCF54buBYm-LpWSosp4x-L_0 2024-09-12T19:29:41.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5130476248704357382', time=2024-09-12T21:14:21.318393+0000, chain.objs.size()=1 2024-09-12T19:29:41.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.645__shadow_.9ppcPpL5FBmPSQ3xp0wguX8589rrBGt_0 2024-09-12T19:29:41.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3840929701719664863', time=2024-09-12T21:17:43.817180+0000, chain.objs.size()=1 2024-09-12T19:29:41.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.712__shadow:QM7SB-k9RsPAPufoAIz73qvTqLzyefu_.opwkjshPlTid5OyLweRcneDs1fNEWyG_0 2024-09-12T19:29:41.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4137319899506726876', time=2024-09-12T21:19:31.588161+0000, chain.objs.size()=1 2024-09-12T19:29:41.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.742__multipart_mymultipart3.2~H5pPIYRnxxoRh44mkm8NJsLIU-HB2y2.1 2024-09-12T19:29:41.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T19:29:41.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53836' 2024-09-12T19:29:41.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11155891588374577414', time=2024-09-12T20:30:26.243014+0000, chain.objs.size()=1 2024-09-12T19:29:41.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.170__shadow_.jLBSASDpnSchurqpzZ4HNrtvCUle2c__0 2024-09-12T19:29:41.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3846145211515159003', time=2024-09-12T20:36:14.681471+0000, chain.objs.size()=1 2024-09-12T19:29:41.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.249__shadow_.K5sWp4h7wzfVeb3W5a79PT3HJCxzUyD_0 2024-09-12T19:29:41.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15948335406465184399', time=2024-09-12T20:36:19.337684+0000, chain.objs.size()=1 2024-09-12T19:29:41.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.251__shadow_.YzmYNxcm7vOb1bZOGP22JgFk5kkE3wY_0 2024-09-12T19:29:41.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1502434597734959418', time=2024-09-12T20:36:35.251361+0000, chain.objs.size()=1 2024-09-12T19:29:41.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.258__shadow_.acPTV350uHmxR-xTJKyU5GYwP7-3oQA_0 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1167160264230678118', time=2024-09-12T20:38:24.693905+0000, chain.objs.size()=1 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ss91GT9-6E__OnbvAHycyS5HGTJmrGN_0 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7394051004013058240', time=2024-09-12T20:38:24.874508+0000, chain.objs.size()=1 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.55XIDQH_sT3-MTUv-N2nYbkeEsGCOmt_0 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15641033657943235855', time=2024-09-12T20:38:26.516805+0000, chain.objs.size()=1 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wCvPgstmE4J5yQSsnGDMzZ_WR-XSYkg_0 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13662483535878422677', time=2024-09-12T20:38:26.565904+0000, chain.objs.size()=1 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.R5ihJl0UBxcw4By2VPntBOd49s5pqzt_0 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12030990934126693201', time=2024-09-12T20:38:27.664341+0000, chain.objs.size()=1 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.YnTzp7eiKAAkryXsbYaRlv1XU26LNuz_0 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7285631426398578405', time=2024-09-12T20:38:28.887055+0000, chain.objs.size()=1 2024-09-12T19:29:41.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Y1p6lt_9e9MWLgVNjFbMHDbF_y3Snq5_0 2024-09-12T19:29:41.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6838062982077259862', time=2024-09-12T20:38:29.222636+0000, chain.objs.size()=1 2024-09-12T19:29:41.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8yxbNt7Te4zCkooaEfT3j68l8mpLkz5_0 2024-09-12T19:29:41.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15047620634505629853', time=2024-09-12T20:38:30.291621+0000, chain.objs.size()=1 2024-09-12T19:29:41.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.S9Bl9RBxbA3IVGaABOlWPfo68Gid-9Y_0 2024-09-12T19:29:41.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8033762301107297141', time=2024-09-12T20:38:30.307214+0000, chain.objs.size()=1 2024-09-12T19:29:41.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.pSqXnXWZa3GyTV-oR2Ku08QSvzHY7-9_0 2024-09-12T19:29:41.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.108276021504197691', time=2024-09-12T20:38:32.026171+0000, chain.objs.size()=1 2024-09-12T19:29:41.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.XU2M_jG_pGzHibkghje9Yyo_0k93qPd_0 2024-09-12T19:29:41.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15172987184028478465', time=2024-09-12T20:38:32.128381+0000, chain.objs.size()=1 2024-09-12T19:29:41.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CTVh5jeD7hInEqFqZX8PbItuumPUDEJ_0 2024-09-12T19:29:41.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8063473642044008978', time=2024-09-12T20:38:32.457828+0000, chain.objs.size()=1 2024-09-12T19:29:41.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aCkO6DF0graAcknUoLad240phipaHty_0 2024-09-12T19:29:41.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8541262745689510074', time=2024-09-12T20:38:32.546433+0000, chain.objs.size()=1 2024-09-12T19:29:41.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hlGBwZZ8p8rZrvLg4ftEby6LAAIuKUU_0 2024-09-12T19:29:41.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3407713649324272391', time=2024-09-12T20:38:32.658873+0000, chain.objs.size()=1 2024-09-12T19:29:41.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.3Ft505CzsbQS5BhfIci8hlR-rSjs6Ee_0 2024-09-12T19:29:41.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10720701978767759394', time=2024-09-12T20:38:32.741479+0000, chain.objs.size()=1 2024-09-12T19:29:41.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wwrk_01jZquoI4HlA-BRlzj9PsQ8hDj_0 2024-09-12T19:29:41.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16359123625558206303', time=2024-09-12T20:38:35.170565+0000, chain.objs.size()=1 2024-09-12T19:29:41.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.thVxx9C3x_4pzWiWvpQHXG-r-PCYte3_0 2024-09-12T19:29:41.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16801816930315846200', time=2024-09-12T20:38:38.028978+0000, chain.objs.size()=1 2024-09-12T19:29:41.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0z_whCJHlfy57uE55PY7hMz5ErHOi5B_0 2024-09-12T19:29:41.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14193130184877075086', time=2024-09-12T20:38:38.584291+0000, chain.objs.size()=1 2024-09-12T19:29:41.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.OtYqzSCJtiBblG12POI_lEzA44q4iSb_0 2024-09-12T19:29:41.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15857802527629869288', time=2024-09-12T20:38:38.588114+0000, chain.objs.size()=1 2024-09-12T19:29:41.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wD6XdVhLEWLeL4vZMWzs0ndPhXTK_Rt_0 2024-09-12T19:29:41.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17410169848115841360', time=2024-09-12T20:38:39.046171+0000, chain.objs.size()=1 2024-09-12T19:29:41.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fRipXNtSRaSVB-N7sJFH6k6n3QeqPpM_0 2024-09-12T19:29:41.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9208133775222065830', time=2024-09-12T20:38:40.405594+0000, chain.objs.size()=1 2024-09-12T19:29:41.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.cUO9glBnrxP-Pm6qKDnWPPPERRSVISk_0 2024-09-12T19:29:41.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.951092173334419422', time=2024-09-12T20:38:41.437578+0000, chain.objs.size()=1 2024-09-12T19:29:41.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.srp92NX6FLpJX1Ag2amky3xQrmNBwke_0 2024-09-12T19:29:41.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12943659657836088608', time=2024-09-12T20:38:42.704676+0000, chain.objs.size()=1 2024-09-12T19:29:41.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.stEcfXuzCKdpl5J0scwfbVYNovmyfDQ_0 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10361578514556227688', time=2024-09-12T20:38:43.544138+0000, chain.objs.size()=1 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._Mex8xUIjGly-jMCc59WFzZOOyt6JVJ_0 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12368115238338813546', time=2024-09-12T20:38:46.451698+0000, chain.objs.size()=1 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7uM44i3AZgodo5TZQR_QkSbN5CeLXgN_0 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6684323772532651888', time=2024-09-12T20:38:48.297332+0000, chain.objs.size()=1 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fgEsf5TCpxEjyuCKrmBeAL-YWFyPSeM_0 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9241507871456662028', time=2024-09-12T20:38:49.006019+0000, chain.objs.size()=1 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.oApZwJCKO4DRp3tyAyzTsUh25SrkJrW_0 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1032531828723512092', time=2024-09-12T20:38:49.193944+0000, chain.objs.size()=1 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WIOdHtRtuDaoP1h4CAqY0lspdMfa7uX_0 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10269742395005919155', time=2024-09-12T20:38:49.986403+0000, chain.objs.size()=1 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EsdHN-9GQlFrKpxCgC6RZIBIbrXag9O_0 2024-09-12T19:29:41.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5460110380576042003', time=2024-09-12T20:38:50.194706+0000, chain.objs.size()=1 2024-09-12T19:29:41.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hQbv5LADrZmMwDEV4agHslcn6TlaAVz_0 2024-09-12T19:29:41.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12884236486332544844', time=2024-09-12T20:38:50.494060+0000, chain.objs.size()=1 2024-09-12T19:29:41.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wBRTmRUlMChWgZVDBb-O-7Jw73iPpB__0 2024-09-12T19:29:41.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14044359788865905618', time=2024-09-12T20:39:49.230780+0000, chain.objs.size()=1 2024-09-12T19:29:41.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.288__shadow_.TtZemsaob3mPkUBjgtza_asoaQCbOUZ_0 2024-09-12T19:29:41.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2698972099076855733', time=2024-09-12T20:40:01.850055+0000, chain.objs.size()=1 2024-09-12T19:29:41.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.ShYP31rNdQg0EDZ1JdwKs_-L4B388jC_0 2024-09-12T19:29:41.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1027321977591728413', time=2024-09-12T20:40:02.110200+0000, chain.objs.size()=1 2024-09-12T19:29:41.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.hzFtfdxWx4ftLYvqtZOyUk8rBEoH_YU_0 2024-09-12T19:29:41.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7305275811348615405', time=2024-09-12T20:40:07.481424+0000, chain.objs.size()=1 2024-09-12T19:29:41.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.0yGheFh3BwZiexGJPyrwIko-FcxTXu6_0 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13759131544661550841', time=2024-09-12T20:40:07.482908+0000, chain.objs.size()=1 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.IU1mETScBocWHKkXUAK1cwfgZUrjEzX_0 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16282629163345069592', time=2024-09-12T20:40:07.764252+0000, chain.objs.size()=1 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.ULGcqJG4DZFkq0kkYBK2S-kvqyGuL7O_0 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8444049074549509027', time=2024-09-12T20:40:41.904848+0000, chain.objs.size()=1 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.307__shadow:.u4200j6rI-o40EDIc14P0ZUzNqK6Bc_.qQcZmtvTteXusj72i4C_F6gbDRia7rv_0 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8673384998775346621', time=2024-09-12T20:41:18.568020+0000, chain.objs.size()=1 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.321__shadow_.CauVjHdMvFKO4XbV6bcmoDG6v6f68bN_0 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10724158964867204588', time=2024-09-12T20:43:02.855033+0000, chain.objs.size()=1 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.J-quAsIrESj7ND6tdgPYcpuC41z3rOY_0 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15686887854276160178', time=2024-09-12T20:43:03.325788+0000, chain.objs.size()=1 2024-09-12T19:29:41.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.oUqbMn-JsuHTDudE2pabUGWlVxmgO0A_0 2024-09-12T19:29:41.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5942044757101194317', time=2024-09-12T20:43:03.923379+0000, chain.objs.size()=1 2024-09-12T19:29:41.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Z_DJYk7awa0kX88WB7SMcOAj2-iGwxH_0 2024-09-12T19:29:41.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11556397695558038864', time=2024-09-12T20:43:05.242139+0000, chain.objs.size()=1 2024-09-12T19:29:41.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.2Fti3xesve9LLT2yxckBd0mLuCDAs5S_0 2024-09-12T19:29:41.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8412000742014690928', time=2024-09-12T20:43:06.695135+0000, chain.objs.size()=1 2024-09-12T19:29:41.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.inTr9DeECCl3yOTvRtDpK9bS9Grk8K8_0 2024-09-12T19:29:41.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10620198620403637277', time=2024-09-12T20:43:06.867465+0000, chain.objs.size()=1 2024-09-12T19:29:41.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7ZOrYjGigxVDVJkU6uYkZIHpnf7ouCY_0 2024-09-12T19:29:41.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5642463124530720084', time=2024-09-12T20:43:08.341840+0000, chain.objs.size()=1 2024-09-12T19:29:41.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yAkNPkzOLBaLVdY11k40wG6f-AWwgjx_0 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17524372345948040154', time=2024-09-12T20:43:09.018338+0000, chain.objs.size()=1 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9266CT22wz3R025wG2jiM0kMA019TNj_0 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10822724577737455385', time=2024-09-12T20:43:09.109170+0000, chain.objs.size()=1 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0yuwub87SuAV8tBFLRaFJcli33WR0ho_0 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14006359581515211979', time=2024-09-12T20:43:10.881674+0000, chain.objs.size()=1 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.uHVEpQ3Y-dljiamMxkFLtnElZVNe1iB_0 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2595712316506100600', time=2024-09-12T20:43:12.013377+0000, chain.objs.size()=1 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.UqcO_LzQuQDvYOIraLjrh2H4o8twws0_0 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16594415040990682289', time=2024-09-12T20:43:12.692627+0000, chain.objs.size()=1 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5J44OWwT09sokIz5XWUxzKrAHJ3qhGM_0 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3784368643657531704', time=2024-09-12T20:43:13.712198+0000, chain.objs.size()=1 2024-09-12T19:29:41.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.z7QpYIfoAO1RfrFETRAl-X_jsKKlCLD_0 2024-09-12T19:29:41.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.585964111023373767', time=2024-09-12T20:43:15.323761+0000, chain.objs.size()=1 2024-09-12T19:29:41.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.noXOb5VWqD6p75bUX-vHs8yKEFJ3k_N_0 2024-09-12T19:29:41.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9348343001761813097', time=2024-09-12T20:43:15.327100+0000, chain.objs.size()=1 2024-09-12T19:29:41.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.l6vROCuqeS39uumaCHU5ugCzA9tXcpb_0 2024-09-12T19:29:41.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15525221148956315783', time=2024-09-12T20:43:15.537872+0000, chain.objs.size()=1 2024-09-12T19:29:41.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9HN0tSpcMlU-dgjwvaDbgRtDgr8apqD_0 2024-09-12T19:29:41.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4321844341949643809', time=2024-09-12T20:43:16.136546+0000, chain.objs.size()=1 2024-09-12T19:29:41.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ZgIFX3t2K17kr-c56pgM7eQfyDYN9dW_0 2024-09-12T19:29:41.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12006872713022646471', time=2024-09-12T20:43:18.025823+0000, chain.objs.size()=1 2024-09-12T19:29:41.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ah2ySvVAERPyB2mf3MR4NaUBaBq5_fL_0 2024-09-12T19:29:41.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6877804947587982682', time=2024-09-12T20:43:18.417079+0000, chain.objs.size()=1 2024-09-12T19:29:41.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fRfc14vnuiTLQprNWABvHrkf5bVSJHk_0 2024-09-12T19:29:41.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7839735963734434608', time=2024-09-12T20:43:18.938491+0000, chain.objs.size()=1 2024-09-12T19:29:41.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.K64_bZkChAwdRCsmfb9ZI6idjJRy3Ra_0 2024-09-12T19:29:41.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7179398468105468060', time=2024-09-12T20:43:21.807610+0000, chain.objs.size()=1 2024-09-12T19:29:41.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EH5lV965M1zbAsUHw7J3CZOjvF-_oWr_0 2024-09-12T19:29:41.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5205237046686705881', time=2024-09-12T20:43:22.293473+0000, chain.objs.size()=1 2024-09-12T19:29:41.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.CbExldA00SO86daeBLDWNTBtx_rVhtE_0 2024-09-12T19:29:41.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2315089840146102415', time=2024-09-12T20:43:22.465177+0000, chain.objs.size()=1 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.FMVntghpLFiYB-KAKaQi8Ke075L5Hma_0 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9394162906807503916', time=2024-09-12T20:43:22.882550+0000, chain.objs.size()=1 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.o0d_mOy-S6RKmOUuR5R97eSGRgxhMnB_0 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3629695827618435639', time=2024-09-12T20:43:23.257881+0000, chain.objs.size()=1 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vKG67uKiJHx4dxVwBxBNP9YEQYHIwxH_0 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6878873990493556930', time=2024-09-12T20:43:25.077563+0000, chain.objs.size()=1 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.g1_8rHCdzRlpVDamg-dniaKtndcgUai_0 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4289698448469229114', time=2024-09-12T20:43:25.237488+0000, chain.objs.size()=1 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.wREEGko29sftKPK_PTwXC7FLf_77AMo_0 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4179107833796649951', time=2024-09-12T20:43:26.072824+0000, chain.objs.size()=1 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vsBt6HMJpW9y_hKw32d_ee8ytBIXLLU_0 2024-09-12T19:29:41.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5766645404863705086', time=2024-09-12T20:43:26.450551+0000, chain.objs.size()=1 2024-09-12T19:29:41.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.GxNm4vwKOHF2SJNKOsQUgOswf2iysTj_0 2024-09-12T19:29:41.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1550307079418744373', time=2024-09-12T20:43:26.978009+0000, chain.objs.size()=1 2024-09-12T19:29:41.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7gq2NQUpTcaKtttAMBIVH7iZ4FwBohM_0 2024-09-12T19:29:41.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10238546826311019156', time=2024-09-12T20:43:28.202534+0000, chain.objs.size()=1 2024-09-12T19:29:41.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.qpJFsLyDv8Sg4lkZwjhY-a2bofZmRIj_0 2024-09-12T19:29:41.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.591622607212346359', time=2024-09-12T20:43:28.254017+0000, chain.objs.size()=1 2024-09-12T19:29:41.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.NmicxIDSqQgqztX5GY_A8r_5ALt5sev_0 2024-09-12T19:29:41.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8089388558664673535', time=2024-09-12T20:43:28.326988+0000, chain.objs.size()=1 2024-09-12T19:29:41.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7Ewk1lefBhmoks9Ldq8_C_4WCYZEhY0_0 2024-09-12T19:29:41.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1429782795522623077', time=2024-09-12T20:43:29.008907+0000, chain.objs.size()=1 2024-09-12T19:29:41.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zC4YBhYgYi8LMt-Q-YpgR9G6yspgG2W_0 2024-09-12T19:29:41.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7853574246199362514', time=2024-09-12T20:43:29.776005+0000, chain.objs.size()=1 2024-09-12T19:29:41.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.sJXMvzivwrNR4uFkr24xnulko1nLAOg_0 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5016995935947048829', time=2024-09-12T20:43:29.777919+0000, chain.objs.size()=1 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.JRHQTGekyU4-crWw92Rj5ssPnfSEhOh_0 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13876352876223252887', time=2024-09-12T20:45:11.256461+0000, chain.objs.size()=1 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.d1FeIwPcXpt0mKvntv9CALH4HuTyye1_0 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12589394604159689872', time=2024-09-12T20:45:11.372966+0000, chain.objs.size()=1 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.415+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DwKLKkq5YDi4sbsywUBlBw-fdYwfCLd_0 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7517296475928362922', time=2024-09-12T20:45:11.375159+0000, chain.objs.size()=1 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ZQNYbKRpV7dKjNkgJZH_f7VCxQsifIL_0 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7444815866009655188', time=2024-09-12T20:45:11.675075+0000, chain.objs.size()=1 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DpX62t_vsysKNos4B_Q8yBhrNxJaAu8_0 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17620608191411708581', time=2024-09-12T20:45:12.211174+0000, chain.objs.size()=1 2024-09-12T19:29:41.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.vxvueWVjw4VlBIc0Tx1Ok6WwI_N_Z4j_0 2024-09-12T19:29:41.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12390413180076284409', time=2024-09-12T20:45:12.983368+0000, chain.objs.size()=1 2024-09-12T19:29:41.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Ll9zBUAPXWKtUFXDSdM67TGklbqQjS2_0 2024-09-12T19:29:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7633447128189128727', time=2024-09-12T20:45:14.846627+0000, chain.objs.size()=1 2024-09-12T19:29:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.o_d-XFDhvgzYgcDhay3w3oQE6IQW3bT_0 2024-09-12T19:29:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6892496363262940216', time=2024-09-12T20:45:15.159587+0000, chain.objs.size()=1 2024-09-12T19:29:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PvwBToZzdieJNmbe4i-uGHE3ZeYvcqB_0 2024-09-12T19:29:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11630719671150287278', time=2024-09-12T20:45:15.578875+0000, chain.objs.size()=1 2024-09-12T19:29:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1K09_Q6209m-wS8qpNwSVxR5QPwOhcj_0 2024-09-12T19:29:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9327609651544482562', time=2024-09-12T20:45:15.625961+0000, chain.objs.size()=1 2024-09-12T19:29:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zx3FgCu56aN1ICTqceE7kXIoMge6AHC_0 2024-09-12T19:29:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14831672397757153540', time=2024-09-12T20:45:15.911488+0000, chain.objs.size()=1 2024-09-12T19:29:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wklUGwqo5Cjm2rG-0nZvyANNu3h5qhn_0 2024-09-12T19:29:41.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6065774438828673239', time=2024-09-12T20:45:16.072434+0000, chain.objs.size()=1 2024-09-12T19:29:41.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.h8clEfD5Eg_JbegFTr86VgVAo2lOCfy_0 2024-09-12T19:29:41.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13445531759283189522', time=2024-09-12T20:45:16.126381+0000, chain.objs.size()=1 2024-09-12T19:29:41.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.a9AMsM7uNPUKxxaun7FPxHYw8AscKBb_0 2024-09-12T19:29:41.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.913364844571287587', time=2024-09-12T20:45:16.273730+0000, chain.objs.size()=1 2024-09-12T19:29:41.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.419+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5lKuwUpqguJFlGua4KVJrKGIJE8_q8T_0 2024-09-12T19:29:41.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14228903597467924511', time=2024-09-12T20:45:16.487079+0000, chain.objs.size()=1 2024-09-12T19:29:41.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.LccHKqUvBn4RPQ1kclN_ANu__m6R2Nb_0 2024-09-12T19:29:41.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11700089184277546328', time=2024-09-12T20:45:16.808748+0000, chain.objs.size()=1 2024-09-12T19:29:41.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hu_G2QRY7uZZ3hjx3BSwBEMAi6ivveT_0 2024-09-12T19:29:41.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11807459497465624045', time=2024-09-12T20:45:17.260264+0000, chain.objs.size()=1 2024-09-12T19:29:41.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.jmF3Os34-6uCsclyYGKTRqILB0BvGAG_0 2024-09-12T19:29:41.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17964158109039669878', time=2024-09-12T20:45:17.261881+0000, chain.objs.size()=1 2024-09-12T19:29:41.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.L5_ksOw8-zha9uo3Bh-TFV3PCx7wo2t_0 2024-09-12T19:29:41.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10700939466260287417', time=2024-09-12T20:45:20.277977+0000, chain.objs.size()=1 2024-09-12T19:29:41.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4fF7gkU2vLonP7be-pNFW16rB0z22y3_0 2024-09-12T19:29:41.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11521661085448462798', time=2024-09-12T20:45:21.097251+0000, chain.objs.size()=1 2024-09-12T19:29:41.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.eeTWbqx2AvYoJqtwdGQqIGHDVNGPzYr_0 2024-09-12T19:29:41.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2782270450468144793', time=2024-09-12T20:45:22.088630+0000, chain.objs.size()=1 2024-09-12T19:29:41.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DAEuMlhRwQI7WivWBLale0wk0Ze8PiN_0 2024-09-12T19:29:41.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.423+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53836 2024-09-12T19:29:41.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-12T19:29:41.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12478080850922019336', time=2024-09-12T20:45:23.145010+0000, chain.objs.size()=1 2024-09-12T19:29:41.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oYBz8Ibxqg-T65BOXpNXMG9anGOHQJL_0 2024-09-12T19:29:41.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7510580325028718341', time=2024-09-12T20:45:23.281961+0000, chain.objs.size()=1 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.l545j_SerOraGz240ekZbh8PeazF8J6_0 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13840905187911146302', time=2024-09-12T20:45:24.743276+0000, chain.objs.size()=1 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.M59Ohg19WfKyQiLJ9NjdPnxdT-OlKNc_0 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3459725378001454252', time=2024-09-12T20:45:26.279563+0000, chain.objs.size()=1 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.TuCnglRnAaudipLxAXzyYK88LwFVBQy_0 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2343248475977681279', time=2024-09-12T20:45:27.953914+0000, chain.objs.size()=1 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qbRDUbpctksmrNaCCGEqHMMLX-Oe-md_0 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17372192432187438604', time=2024-09-12T20:45:28.342573+0000, chain.objs.size()=1 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4mxIH0Vcaffh_gnM9coeMWu-bWBOBEQ_0 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15117007061346439925', time=2024-09-12T20:45:28.389099+0000, chain.objs.size()=1 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8kpJ6EKR3AGTXX3R-vEjnNprn86SVu5_0 2024-09-12T19:29:41.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7515638309223483572', time=2024-09-12T20:45:29.655092+0000, chain.objs.size()=1 2024-09-12T19:29:41.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Eq-K8HEtGPcQ1MdHsfUqZ_RbCDeUJpE_0 2024-09-12T19:29:41.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13308180340446461402', time=2024-09-12T20:45:30.378807+0000, chain.objs.size()=1 2024-09-12T19:29:41.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UNaD-iWd56GMe_BfD5zQPGUut4FkxtI_0 2024-09-12T19:29:41.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5423525161273897288', time=2024-09-12T20:45:30.898621+0000, chain.objs.size()=1 2024-09-12T19:29:41.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WGHpx3nKwdB7x0wrFbU9uzgpM9ITKy2_0 2024-09-12T19:29:41.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18128560027704156202', time=2024-09-12T20:45:32.750180+0000, chain.objs.size()=1 2024-09-12T19:29:41.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6GJvy7hwtgXZnQHheWbX88mbUgCaYcW_0 2024-09-12T19:29:41.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15108040091599383419', time=2024-09-12T20:45:34.193719+0000, chain.objs.size()=1 2024-09-12T19:29:41.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.SqVFGKuEHU40L2reCkyD_W5aiCZtt9i_0 2024-09-12T19:29:41.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10560564302360553647', time=2024-09-12T20:45:34.275082+0000, chain.objs.size()=1 2024-09-12T19:29:41.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4IA7Tb1UfLafiAFmEtgpaTTLmKW9nMp_0 2024-09-12T19:29:41.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.589346370549539114', time=2024-09-12T20:45:34.520720+0000, chain.objs.size()=1 2024-09-12T19:29:41.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fW0__0QmP1bYqKdMnEXBQ9JSiDQ8qAZ_0 2024-09-12T19:29:41.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9537618310064694019', time=2024-09-12T20:45:35.282232+0000, chain.objs.size()=1 2024-09-12T19:29:41.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OKFCQsKUUyon00A8gcP1cjd_xmVZ7ka_0 2024-09-12T19:29:41.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13244139476028579150', time=2024-09-12T20:45:35.357635+0000, chain.objs.size()=1 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xlrzaqldkwf2dPjRY9OBDqp1E4a-BbO_0 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9478655279188247271', time=2024-09-12T20:45:37.156463+0000, chain.objs.size()=1 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.z4jwxJrbrMpsfibX5JmB6EsrJYJeREH_0 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10122908627788385447', time=2024-09-12T20:45:37.158475+0000, chain.objs.size()=1 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.sy67o7bKmnX4Yu3QKbWXPMKxHexG0-L_0 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5866650171605119222', time=2024-09-12T20:45:37.776900+0000, chain.objs.size()=1 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.60qf3kmOlB4kBbCLW2M8AXjjQrwoUcR_0 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13956601514976041815', time=2024-09-12T20:45:38.311271+0000, chain.objs.size()=1 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zOgiutLxs7cnlPniAucVkPQaHUXqSQ1_0 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7744485380741167540', time=2024-09-12T20:49:13.435088+0000, chain.objs.size()=1 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.433__shadow_.UqRI1dYPqYl80AoxQGwloxt7IxHkc1r_0 2024-09-12T19:29:41.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13092521432139033679', time=2024-09-12T20:50:18.618504+0000, chain.objs.size()=1 2024-09-12T19:29:41.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.427+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.460__shadow_.7kWdrwKPpvWJ1iSuK6vRogPB9DVB_x8_0 2024-09-12T19:29:41.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7242379051419641110', time=2024-09-12T20:50:30.505914+0000, chain.objs.size()=1 2024-09-12T19:29:41.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.464__shadow_.kOLImga1zuLLY9K6Rdss9fNBn8Ha3XV_0 2024-09-12T19:29:41.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6369806882053283330', time=2024-09-12T20:51:02.812136+0000, chain.objs.size()=1 2024-09-12T19:29:41.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.EEHysnM1MMkS84dz5DFfgdM8Xbau02e_0 2024-09-12T19:29:41.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7007135875289857669', time=2024-09-12T20:51:02.815261+0000, chain.objs.size()=1 2024-09-12T19:29:41.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.nx4-bv99aKgypeFZY7Bcmv8oj-kwm6V_0 2024-09-12T19:29:41.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14814531667620379226', time=2024-09-12T20:51:02.839546+0000, chain.objs.size()=1 2024-09-12T19:29:41.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.fkZA4vzoDfLsmP3WTyEUZ3MiSw_cAPB_0 2024-09-12T19:29:41.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15440718709093448764', time=2024-09-12T20:56:10.681714+0000, chain.objs.size()=6 2024-09-12T19:29:41.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UuCCUlq-61sd-rnqnHDg72Ea-8xQ_vX.1 2024-09-12T19:29:41.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.oFQWi-drZfcUSJbhp-_wFMvUXE2x9UL-.2 2024-09-12T19:29:41.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UuCCUlq-61sd-rnqnHDg72Ea-8xQ_vX.3 2024-09-12T19:29:41.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UuCCUlq-61sd-rnqnHDg72Ea-8xQ_vX.4 2024-09-12T19:29:41.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UuCCUlq-61sd-rnqnHDg72Ea-8xQ_vX.5 2024-09-12T19:29:41.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UuCCUlq-61sd-rnqnHDg72Ea-8xQ_vX.6 2024-09-12T19:29:41.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17197809730286971780', time=2024-09-12T20:59:02.839002+0000, chain.objs.size()=1 2024-09-12T19:29:41.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.524__shadow_.asqSuCUnVMVSP_YCFt8fPy12leU9xvZ_0 2024-09-12T19:29:41.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16601690401008304876', time=2024-09-12T21:01:36.169451+0000, chain.objs.size()=1 2024-09-12T19:29:41.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.431+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.552__shadow_.7PRfgPM3a-gwax73hEdH7y6U1qVDa1z_0 2024-09-12T19:29:41.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9843142986929164250', time=2024-09-12T21:03:15.386486+0000, chain.objs.size()=1 2024-09-12T19:29:41.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:8GqquOYcw6ZVsqphnLMoV9D-1vwPV78_.NPAm_br0_jT2U7cnc__OQKGhHgPF3Na_0 2024-09-12T19:29:41.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18371235756589737730', time=2024-09-12T21:03:49.643798+0000, chain.objs.size()=1 2024-09-12T19:29:41.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.574__shadow:yjknERCl1MYPrOVUXM21HNztyUzIE-S_.oyLzWh1ARRZa-1ksQhJ-TYIVJX6TwiG_0 2024-09-12T19:29:41.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1983617102138976025', time=2024-09-12T21:04:33.706242+0000, chain.objs.size()=1 2024-09-12T19:29:41.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:DaPXi78ZIEmj43.2qRWRdH.OhSjEAmL_.gq0CmohZ3CXUfyy7AGrd760brv5Hm1E_0 2024-09-12T19:29:41.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9817534482115668704', time=2024-09-12T21:04:34.866720+0000, chain.objs.size()=1 2024-09-12T19:29:41.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:beDFRlU14yW75yPkUsFkkPmR9cnSRcB_.VfiL2vCkL05Tit4xmobI96a1j_oIn7I_0 2024-09-12T19:29:41.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2585748234381143081', time=2024-09-12T21:06:00.463616+0000, chain.objs.size()=1 2024-09-12T19:29:41.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.580__shadow:4SZ6RDLu00hxrTr8cO80g6K2pTDZgZY_.0zVEa9BDmkWsauEydkIlLqwUDdmOj2S_0 2024-09-12T19:29:41.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.58004713094245986', time=2024-09-12T21:06:50.610641+0000, chain.objs.size()=1 2024-09-12T19:29:41.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.603__shadow_.D8pYvWf3hR3WvB2M6tIPuTjoVfME7Ix_0 2024-09-12T19:29:41.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16095618765787589987', time=2024-09-12T21:16:03.071604+0000, chain.objs.size()=6 2024-09-12T19:29:41.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.661__multipart_baz.2~H4Y4Kh2vWIV3Oi1sMBGBjZ4Nl5zDwEt.1 2024-09-12T19:29:41.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.661__multipart_baz.2~H4Y4Kh2vWIV3Oi1sMBGBjZ4Nl5zDwEt.2 2024-09-12T19:29:41.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.661__multipart_baz.2~H4Y4Kh2vWIV3Oi1sMBGBjZ4Nl5zDwEt.3 2024-09-12T19:29:41.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.661__multipart_baz.2~H4Y4Kh2vWIV3Oi1sMBGBjZ4Nl5zDwEt.4 2024-09-12T19:29:41.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.661__multipart_baz.2~H4Y4Kh2vWIV3Oi1sMBGBjZ4Nl5zDwEt.5 2024-09-12T19:29:41.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.435+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.661__multipart_baz.2~H4Y4Kh2vWIV3Oi1sMBGBjZ4Nl5zDwEt.6 2024-09-12T19:29:41.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.439+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13024331259688132216', time=2024-09-12T21:18:12.216831+0000, chain.objs.size()=1 2024-09-12T19:29:41.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.439+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.717__shadow:-bU9rXLWKCJTY8m61FRs22z.l1m-I.X_.6Kqk5uCoRiATF1aqSYl2-oRbYpK-LPG_0 2024-09-12T19:29:41.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.439+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12312803434977802648', time=2024-09-12T21:18:14.377289+0000, chain.objs.size()=1 2024-09-12T19:29:41.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.439+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.718__shadow_.wSAouqI0bdbJZ2Y1FF0mjISMtB_iAfQ_0 2024-09-12T19:29:41.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.439+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T19:29:41.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45635' 2024-09-12T19:29:41.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7770704003318396716', time=2024-09-12T20:30:27.502281+0000, chain.objs.size()=1 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.171__shadow_.9Y1y_164qd2ODwgQMsceYUZpAusFQBh_0 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13288583007231349632', time=2024-09-12T20:35:32.404495+0000, chain.objs.size()=1 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.233__shadow_.osGnAteCARS8w4IH7XJEhhTImrQUHD4_0 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8651141730251925491', time=2024-09-12T20:35:53.377832+0000, chain.objs.size()=1 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.241__shadow_.t1mEP8wvw90AnvsxpeIBzr-fkVGIVGs_0 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2447667696190578789', time=2024-09-12T20:36:28.517301+0000, chain.objs.size()=1 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.255__shadow_.QZiShyjYkn20twgjKESdRTGbio8xliG_0 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9465968849393861746', time=2024-09-12T20:38:22.490180+0000, chain.objs.size()=1 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vJjTe-P5JKxNb1n0ZhfrXRwNHnbq8jS_0 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15359207529054251670', time=2024-09-12T20:38:24.304611+0000, chain.objs.size()=1 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.xfBlJKpDkEM9weYvBI_niTNhtgjk8sN_0 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16964849899046478208', time=2024-09-12T20:38:24.780123+0000, chain.objs.size()=1 2024-09-12T19:29:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GIHG84ETq1sgqmJ8p7XCQ83KwLEM0m2_0 2024-09-12T19:29:41.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8198484530201867486', time=2024-09-12T20:38:24.880895+0000, chain.objs.size()=1 2024-09-12T19:29:41.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Y2yRLV1NSvIGmVV3Ho2e-NDHUVFt6Ix_0 2024-09-12T19:29:41.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14142109297876471478', time=2024-09-12T20:38:24.987286+0000, chain.objs.size()=1 2024-09-12T19:29:41.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rL2Ip-ImMEnEkL6jj1S00wOK1N2N7LJ_0 2024-09-12T19:29:41.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3887744565200285530', time=2024-09-12T20:38:27.601639+0000, chain.objs.size()=1 2024-09-12T19:29:41.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Df-cqYdIelJjBjSXrwfu5eRFghue4hH_0 2024-09-12T19:29:41.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11416582138063883711', time=2024-09-12T20:38:27.696656+0000, chain.objs.size()=1 2024-09-12T19:29:41.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7Yaf_UFWv-5qmMjltT2GUB174nCPFJB_0 2024-09-12T19:29:41.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9595772063985379111', time=2024-09-12T20:38:28.450006+0000, chain.objs.size()=1 2024-09-12T19:29:41.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.443+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZvBryhenBG-WnRmGJuRF4AxdL2nQsZe_0 2024-09-12T19:29:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.719505393753645396', time=2024-09-12T20:38:30.422646+0000, chain.objs.size()=1 2024-09-12T19:29:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.BHA-WaKknCWpuAz5rnCMHE9Oqe708kE_0 2024-09-12T19:29:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7596086972610983085', time=2024-09-12T20:38:30.686659+0000, chain.objs.size()=1 2024-09-12T19:29:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dzZ5Oow0KMa-RnjIpVOTf-0M6-GQlc3_0 2024-09-12T19:29:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2875546192044715419', time=2024-09-12T20:38:31.255232+0000, chain.objs.size()=1 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-3sYACT3S7MUj0frd6WSg92tK5naJ1g_0 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12361883170548833284', time=2024-09-12T20:38:32.387743+0000, chain.objs.size()=1 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RYgI0w-er11Xv_V0T7wdTx3rzvASEo-_0 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7278739008661734778', time=2024-09-12T20:38:33.092105+0000, chain.objs.size()=1 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nJXxaNgJUkJ92FMGEnasDHKs0wtPvRy_0 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15236923750791876672', time=2024-09-12T20:38:34.437755+0000, chain.objs.size()=1 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Y-glL0xLhP43zkwX3fNGpG756gS1EL5_0 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5470472793970041486', time=2024-09-12T20:38:34.688920+0000, chain.objs.size()=1 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.NUtY7_0XOjpiNUYiGQ7Ju9cpmMf44-V_0 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12812877258200451874', time=2024-09-12T20:38:34.707019+0000, chain.objs.size()=1 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lqsDPoEp1grCW5IWEIehUQ1Z04otrlT_0 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7550019742085603903', time=2024-09-12T20:38:36.253364+0000, chain.objs.size()=1 2024-09-12T19:29:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.h-nFe2pADDf_duAKY7VYAaje2wRe8As_0 2024-09-12T19:29:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6727380505925303171', time=2024-09-12T20:38:37.746973+0000, chain.objs.size()=1 2024-09-12T19:29:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aWC_O5ow3_xG_VQeBu7Kr3jqB5lWKiq_0 2024-09-12T19:29:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8831910604574913469', time=2024-09-12T20:38:37.808728+0000, chain.objs.size()=1 2024-09-12T19:29:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._E05qeea3HpOUXj0nRjDfwBCo5KOlVA_0 2024-09-12T19:29:41.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9972337679349784564', time=2024-09-12T20:38:42.463663+0000, chain.objs.size()=1 2024-09-12T19:29:41.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.24HFtePEv3Av_bqHGQXeZp_N3Ay_hGy_0 2024-09-12T19:29:41.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2797494798445554231', time=2024-09-12T20:38:42.702064+0000, chain.objs.size()=1 2024-09-12T19:29:41.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.447+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.PAHlKZXtIfpBcQ7ttBQ-Cf24nviJRen_0 2024-09-12T19:29:41.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14802513290856948365', time=2024-09-12T20:38:43.785688+0000, chain.objs.size()=1 2024-09-12T19:29:41.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Vr87MYdWVsYZ5ZmkzZ11h92Lg21ENMm_0 2024-09-12T19:29:41.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11628202422659140296', time=2024-09-12T20:38:44.036910+0000, chain.objs.size()=1 2024-09-12T19:29:41.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.02Zg4sBrd6LhIyEg154JPvsyPemWriC_0 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12583685996047646525', time=2024-09-12T20:38:44.913049+0000, chain.objs.size()=1 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kdeL-A314J8CakIWSylKnshBYXF81zc_0 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.311654933805491022', time=2024-09-12T20:38:45.406342+0000, chain.objs.size()=1 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.W8d7tHo5mENnvLi6zACu2vM8Ajb7Ihf_0 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10960661534047732097', time=2024-09-12T20:38:46.519119+0000, chain.objs.size()=1 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hrBbDRfkFF6G9TZGapplLMA6I5t8ygQ_0 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2358984455200549314', time=2024-09-12T20:38:49.266257+0000, chain.objs.size()=1 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.mIHPDUqnMXi5KqHt3BLOjbvcReI-zxC_0 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1867785456775519270', time=2024-09-12T20:38:49.916950+0000, chain.objs.size()=1 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.b7Af9XTrpCHfdKDF_mdAf5KStfIOZ3i_0 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11065677059301449541', time=2024-09-12T20:38:57.293881+0000, chain.objs.size()=1 2024-09-12T19:29:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.265__shadow_.wkb0aa2XQ-vD9y8nxy5zQuobJF7Y3lf_0 2024-09-12T19:29:41.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.469379609983557025', time=2024-09-12T20:39:23.587900+0000, chain.objs.size()=1 2024-09-12T19:29:41.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.277__shadow_.5_a6G2gs9Otf7eYMpttZiFGyaMwuvqr_0 2024-09-12T19:29:41.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18091692016952358635', time=2024-09-12T20:39:28.206702+0000, chain.objs.size()=1 2024-09-12T19:29:41.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.279__shadow_.07CNJ_X4ELAf2nCYe132GS0MLEcnCVI_0 2024-09-12T19:29:41.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7936909386420928723', time=2024-09-12T20:39:35.077121+0000, chain.objs.size()=1 2024-09-12T19:29:41.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.282__shadow_.k0_TbVTlys2OTorYFM5jj2iFQ_sgBAU_0 2024-09-12T19:29:41.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14558654680066779059', time=2024-09-12T20:39:46.977514+0000, chain.objs.size()=1 2024-09-12T19:29:41.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.287__shadow_.DKnwzSMi3BQcu4MRYf7WFiHXNYR5UdF_0 2024-09-12T19:29:41.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5379348923010027163', time=2024-09-12T20:39:53.767939+0000, chain.objs.size()=1 2024-09-12T19:29:41.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.290__shadow_.MG44Od5h8Zv0PSymZCsmCREX2uCwNK7_0 2024-09-12T19:29:41.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14246961664635754988', time=2024-09-12T20:39:53.789570+0000, chain.objs.size()=1 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.290__shadow_.TzqOONtBss6moT7wAbM24_X4M1nxSeZ_0 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13285585824601430333', time=2024-09-12T20:40:41.888810+0000, chain.objs.size()=1 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.307__shadow:OtlcIBX.K0KaCMFscJhAft.bIdjbLEh_.6MlMjbD2Kibg7RpomLVdqWPZecroM42_0 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12228932388165657130', time=2024-09-12T20:41:18.569270+0000, chain.objs.size()=1 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.451+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.321__shadow_.ovBZlp8ySFXRkvR4yi5ld8yYiPyM9WZ_0 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2136436288129461133', time=2024-09-12T20:43:02.371342+0000, chain.objs.size()=1 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.FUhLLIrCdjyeNayQWumFwBTE4ywTHB8_0 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13403903096511863645', time=2024-09-12T20:43:02.375098+0000, chain.objs.size()=1 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vNBmAIKxttAcYCuxVCmLov-FE6LAbjA_0 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1772652578282081132', time=2024-09-12T20:43:02.378354+0000, chain.objs.size()=1 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jyFLX_tM-b8sKzH51Bg0jsndj8L69L9_0 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13466011910607092739', time=2024-09-12T20:43:02.478479+0000, chain.objs.size()=1 2024-09-12T19:29:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pctCBRhUxtBi7GADIRp4RfgcKx2aIYf_0 2024-09-12T19:29:41.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4674876489845919392', time=2024-09-12T20:43:02.750854+0000, chain.objs.size()=1 2024-09-12T19:29:41.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YrmZ2Zud_BnqjfB8rDOLHvgyG1_BWBr_0 2024-09-12T19:29:41.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9043686748310564241', time=2024-09-12T20:43:02.753170+0000, chain.objs.size()=1 2024-09-12T19:29:41.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ZC6n-712o69u1ASOlwrdUWidm6b8aGc_0 2024-09-12T19:29:41.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4323727087809413346', time=2024-09-12T20:43:03.199210+0000, chain.objs.size()=1 2024-09-12T19:29:41.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.PEZ1fsWdWOt7jmhjcs7FJg3WbmLAUYZ_0 2024-09-12T19:29:41.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1516797334170550784', time=2024-09-12T20:43:03.381415+0000, chain.objs.size()=1 2024-09-12T19:29:41.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.S65CrjhY1wnzVkecLb13J4MgNJiuLmS_0 2024-09-12T19:29:41.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12237598701406792277', time=2024-09-12T20:43:03.753474+0000, chain.objs.size()=1 2024-09-12T19:29:41.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.msAeKFUVPLIsvqOWuO9E2NZZ8miEE6Q_0 2024-09-12T19:29:41.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2714595955153555379', time=2024-09-12T20:43:03.957669+0000, chain.objs.size()=1 2024-09-12T19:29:41.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.CdORonX_WEs1Tx1ye-wqyecSBpbirn__0 2024-09-12T19:29:41.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12164288621585546522', time=2024-09-12T20:43:04.221238+0000, chain.objs.size()=1 2024-09-12T19:29:41.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AWcoo7w02A5BmhD0FdtSCeKepJUxsNz_0 2024-09-12T19:29:41.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11481610365207610356', time=2024-09-12T20:43:06.430258+0000, chain.objs.size()=1 2024-09-12T19:29:41.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eJZRf6Lf-AvbcNkAa83nb9t8Gun5TQP_0 2024-09-12T19:29:41.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18060571464743282832', time=2024-09-12T20:43:06.432911+0000, chain.objs.size()=1 2024-09-12T19:29:41.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.lJmqNez4WbmjQjLa1Oulw5dcrKJnaw4_0 2024-09-12T19:29:41.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17276775759361636063', time=2024-09-12T20:43:08.256139+0000, chain.objs.size()=1 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.uyCMknS0Fabd0tYebsi-LTLdKndQHIR_0 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17567298653048162129', time=2024-09-12T20:43:08.258249+0000, chain.objs.size()=1 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.raa7830Qhu8D_ra921iT2wYQACrzcr7_0 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11706609992093467864', time=2024-09-12T20:43:08.954932+0000, chain.objs.size()=1 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.U7IDvyCI5EeMBDF_Pu9gT3ZqSiSMGyk_0 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16032000469328862257', time=2024-09-12T20:43:09.018033+0000, chain.objs.size()=1 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xP5wrKufVMESjEKauKJlx16x6mkGYgu_0 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2148401312391620856', time=2024-09-12T20:43:10.045405+0000, chain.objs.size()=1 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eVUagQlvBZno_F5vSJS2qR3Sm7e47aJ_0 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18303667869640136595', time=2024-09-12T20:43:12.013400+0000, chain.objs.size()=1 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-ry673fLFrLqEoCSr31bKyPeitWyHY0_0 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3646675095786133889', time=2024-09-12T20:43:12.574690+0000, chain.objs.size()=1 2024-09-12T19:29:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.uQ2qsjhHAh0cmch6Lqy2gaL4ZS-TW0a_0 2024-09-12T19:29:41.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15664662745016569616', time=2024-09-12T20:43:12.653307+0000, chain.objs.size()=1 2024-09-12T19:29:41.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.JQqQLGOz96p0QXBetID5k0xMmIHRUa6_0 2024-09-12T19:29:41.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7123697849049905635', time=2024-09-12T20:43:13.983992+0000, chain.objs.size()=1 2024-09-12T19:29:41.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.455+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Iri4Kb7RvLpd2ek252ENsEJvAoqeIv3_0 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15511858999554341578', time=2024-09-12T20:43:14.097803+0000, chain.objs.size()=1 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.t1mOseA4SFi1LmcVBzcZ0ycmOh_TZ4T_0 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15411963222755918098', time=2024-09-12T20:43:18.417222+0000, chain.objs.size()=1 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5Skori0BCJKF2A6NfJbPXxTxgv8A6hl_0 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11606233203111044661', time=2024-09-12T20:43:18.552356+0000, chain.objs.size()=1 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eVfH3_nJ-UsFERae7QeE9yvwQy1u3Wo_0 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14825013447679575067', time=2024-09-12T20:43:18.929848+0000, chain.objs.size()=1 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.e-7JBZK5mzAD96vNBX4FAQTbxNSFQyZ_0 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13252908551461391253', time=2024-09-12T20:43:19.495095+0000, chain.objs.size()=1 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EJtU4cIUIexAtXCE53ABg_5nBttBlgq_0 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5898643240363296625', time=2024-09-12T20:43:21.980558+0000, chain.objs.size()=1 2024-09-12T19:29:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.e8dmn70kwTKTrwE-LgcKVq2urJ3tDi0_0 2024-09-12T19:29:41.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4193341245607461204', time=2024-09-12T20:43:23.643125+0000, chain.objs.size()=1 2024-09-12T19:29:41.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.wRLJf8qxEGnrF5cc_46Xn9JbJiWj-MG_0 2024-09-12T19:29:41.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1564120992048548441', time=2024-09-12T20:43:24.570050+0000, chain.objs.size()=1 2024-09-12T19:29:41.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tTmgIFRRLOJ47dVbJZ7Phx-Oeap8j26_0 2024-09-12T19:29:41.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2710151679343281194', time=2024-09-12T20:43:26.076438+0000, chain.objs.size()=1 2024-09-12T19:29:41.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.PU-aajhbdHAv4EvQ90bMh-ban5OmIkK_0 2024-09-12T19:29:41.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6922877994926078743', time=2024-09-12T20:43:27.861171+0000, chain.objs.size()=1 2024-09-12T19:29:41.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4chasJ9VXaIAgtB9IgDGohoSTf2_8pb_0 2024-09-12T19:29:41.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15016465715846804691', time=2024-09-12T20:43:27.927016+0000, chain.objs.size()=1 2024-09-12T19:29:41.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tlsFrT4awkXYUp_f2uwJUFOzp7TQTR9_0 2024-09-12T19:29:41.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8618028458684882021', time=2024-09-12T20:43:29.778530+0000, chain.objs.size()=1 2024-09-12T19:29:41.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Qtid1_pbeqy8xAOZL1DDF9fpqYdTEfs_0 2024-09-12T19:29:41.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1033703595165771948', time=2024-09-12T20:43:29.841557+0000, chain.objs.size()=1 2024-09-12T19:29:41.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.2MRvvCfq3XHn6_wtrRhFVYzJLX0Rcrr_0 2024-09-12T19:29:41.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13123029560168889330', time=2024-09-12T20:43:30.002618+0000, chain.objs.size()=1 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.459+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._ZtjtaizBhveyYk26MhyJuu2s5F-FwW_0 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3089735095489472005', time=2024-09-12T20:43:30.011183+0000, chain.objs.size()=1 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.T8oXx646d-9e0SICmtPrJFlSq5VoUCm_0 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6697450334692413828', time=2024-09-12T20:45:12.038904+0000, chain.objs.size()=1 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0OJkSdRVQTUjKr--PIqNGj1BfB7bnKt_0 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18119097966760113299', time=2024-09-12T20:45:12.082909+0000, chain.objs.size()=1 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fQ27d2Uost4uVzeK-WmP2qezt5breIk_0 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.422815222365772466', time=2024-09-12T20:45:12.861990+0000, chain.objs.size()=1 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.-UPVsxXWU_IMWl23VOTp2NuKdigiAgK_0 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4032862017843174007', time=2024-09-12T20:45:13.213586+0000, chain.objs.size()=1 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.scsJ0JZ7g2x_U9gTIa03q9HSdf5Bmwd_0 2024-09-12T19:29:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11152031638847613135', time=2024-09-12T20:45:13.448010+0000, chain.objs.size()=1 2024-09-12T19:29:41.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OCKrdE1N_-bSiX7rbv1_6kDbdrC-GcX_0 2024-09-12T19:29:41.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3030579416642370727', time=2024-09-12T20:45:13.449616+0000, chain.objs.size()=1 2024-09-12T19:29:41.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PxOEoprZt5uvpBSDnpnpgLz3jtJ9dgq_0 2024-09-12T19:29:41.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12657724870950160049', time=2024-09-12T20:45:13.530103+0000, chain.objs.size()=1 2024-09-12T19:29:41.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YIN51irFQrWZ1FZTMQOhcALSsgqO2cL_0 2024-09-12T19:29:41.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14905087760935591267', time=2024-09-12T20:45:13.581074+0000, chain.objs.size()=1 2024-09-12T19:29:41.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.yVzKp2TA3Ed_IVXfCR1G86iPPlbaI2P_0 2024-09-12T19:29:41.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4537482024362594080', time=2024-09-12T20:45:15.944506+0000, chain.objs.size()=1 2024-09-12T19:29:41.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.QSKtHHrxJISxPP_PB0a-t9ykhROM4dx_0 2024-09-12T19:29:41.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16262901079564860111', time=2024-09-12T20:45:17.477482+0000, chain.objs.size()=1 2024-09-12T19:29:41.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MqAPNEV7ODS0iNnw-Dv7Av0s-OAZOj2_0 2024-09-12T19:29:41.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7817011116086894163', time=2024-09-12T20:45:20.277905+0000, chain.objs.size()=1 2024-09-12T19:29:41.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Z6cuPYB97VHsVzBpSUbwcokycxy5Puy_0 2024-09-12T19:29:41.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12017651032829412076', time=2024-09-12T20:45:20.607732+0000, chain.objs.size()=1 2024-09-12T19:29:41.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.G2nY_3Ww6YUtzUxKzVnlxZUHWhjcbQ5_0 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1462810845681689695', time=2024-09-12T20:45:20.681171+0000, chain.objs.size()=1 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.NSeR2NB9ThXZHaKCTax3fSHynYkCKo7_0 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3407449530391041568', time=2024-09-12T20:45:20.879650+0000, chain.objs.size()=1 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.HU1FDGzuA2APHGf9xQNOvUikXL_NewC_0 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17875934306444072482', time=2024-09-12T20:45:21.007457+0000, chain.objs.size()=1 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.gBlf9T3JnmSdQuqYku91EUNEwLf8c0U_0 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17554058775879497191', time=2024-09-12T20:45:21.170030+0000, chain.objs.size()=1 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ADA09tFe79fQVs-zhLjwsTo2GCOXNmm_0 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13520929267527381150', time=2024-09-12T20:45:22.742100+0000, chain.objs.size()=1 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.463+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Dzw6FqECIe60m-jzpf42wgtN_A-sMOx_0 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.467+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17346729033979569074', time=2024-09-12T20:45:22.907355+0000, chain.objs.size()=1 2024-09-12T19:29:41.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.467+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.m1vNCvlE5WpzDJwyAYjK5Fbwmk79sLm_0 2024-09-12T19:29:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.467+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9180074360353916925', time=2024-09-12T20:45:24.309754+0000, chain.objs.size()=1 2024-09-12T19:29:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.467+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ZXQOajnbTJMpHxJaNMFwcDMHeEGlAXp_0 2024-09-12T19:29:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.467+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10963944765885508255', time=2024-09-12T20:45:26.589283+0000, chain.objs.size()=1 2024-09-12T19:29:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.467+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dx_3qMQVBNw5M1lrA6x4uBkjZypdM-X_0 2024-09-12T19:29:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.467+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13018058625614577978', time=2024-09-12T20:45:26.855341+0000, chain.objs.size()=1 2024-09-12T19:29:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.467+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DRvJuTOlAD9R9fsu7w77aQ5kxOTLA-3_0 2024-09-12T19:29:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.467+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10769835099052551157', time=2024-09-12T20:45:26.935925+0000, chain.objs.size()=1 2024-09-12T19:29:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.467+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GKq0E9ROu8OCqTFbapBrbMI4VvSHzcc_0 2024-09-12T19:29:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.467+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45635 2024-09-12T19:29:41.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T19:29:41.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6955394763882260603', time=2024-09-12T20:45:28.058559+0000, chain.objs.size()=1 2024-09-12T19:29:41.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.czzb9_nTYPaT2orHFaSD3P8TMq7roIV_0 2024-09-12T19:29:41.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11529702469615239974', time=2024-09-12T20:45:29.215835+0000, chain.objs.size()=1 2024-09-12T19:29:41.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.CisnpLzKs1ybCBHlRCGFMRWGyoLlP2u_0 2024-09-12T19:29:41.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4365528248554626448', time=2024-09-12T20:45:29.655085+0000, chain.objs.size()=1 2024-09-12T19:29:41.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0wFNzcSwszjFA3f61tpyGeltuAr-Wd4_0 2024-09-12T19:29:41.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2085430233914469590', time=2024-09-12T20:45:30.211940+0000, chain.objs.size()=1 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ZNM0FkjbbLAhztt7D-_VGh4a5y2HGDM_0 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7889240429797575937', time=2024-09-12T20:45:30.539276+0000, chain.objs.size()=1 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5QVZ5DmNK4GoFEjYxYjTa4vMQYxuy7o_0 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5641808130450020113', time=2024-09-12T20:45:30.674203+0000, chain.objs.size()=1 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WB9JCT6dIKty_Q_ZLk8YvithT9x9Cd6_0 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3564859928467779221', time=2024-09-12T20:45:31.352081+0000, chain.objs.size()=1 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.J1RSVMhybEK_hg4WJqwLIp-7lWKyx2v_0 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7484127244794515178', time=2024-09-12T20:45:32.873026+0000, chain.objs.size()=1 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.NIuVFCuBNRg1Pgv2a5NreTh1-9o6sO-_0 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10906643442942187854', time=2024-09-12T20:45:33.212312+0000, chain.objs.size()=1 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.l9QwKJxF0zJwqRnniwk04StJ1QKwcKO_0 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10614811722891990113', time=2024-09-12T20:45:33.565239+0000, chain.objs.size()=1 2024-09-12T19:29:41.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qX9IH1xfvAidZdHWxL68Pi4BWF2jaT0_0 2024-09-12T19:29:41.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9545276350368073912', time=2024-09-12T20:45:33.822032+0000, chain.objs.size()=1 2024-09-12T19:29:41.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1Ybs-iXXwF6NA4VQPm4Aw4ifqjCS9Ge_0 2024-09-12T19:29:41.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16589663191575510826', time=2024-09-12T20:45:34.421578+0000, chain.objs.size()=1 2024-09-12T19:29:41.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.jlJ-sm1c00aMZzaQYn1Jrue_-dqSuk0_0 2024-09-12T19:29:41.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3000471752349540481', time=2024-09-12T20:45:34.734967+0000, chain.objs.size()=1 2024-09-12T19:29:41.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Vz77Yt3LUv-uEkkrOQ7PfS6HQ7nAEcK_0 2024-09-12T19:29:41.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10910947482677863427', time=2024-09-12T20:45:36.151759+0000, chain.objs.size()=1 2024-09-12T19:29:41.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.L5KYDecDkMY1xhjuQQZLSZErFbrspvl_0 2024-09-12T19:29:41.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18033104115750059639', time=2024-09-12T20:45:36.153633+0000, chain.objs.size()=1 2024-09-12T19:29:41.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.VnOy9sP6ZV7Fk7DLxf0fApws3RZvm0P_0 2024-09-12T19:29:41.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14359901284023974495', time=2024-09-12T20:45:37.301165+0000, chain.objs.size()=1 2024-09-12T19:29:41.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wretxLev_9FzFlwEmFWjTlRO0KiChT4_0 2024-09-12T19:29:41.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13732696119028554985', time=2024-09-12T20:45:51.950021+0000, chain.objs.size()=1 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.331__shadow_.RyBR6cl3e_TmQmmfs2_KeWs2yeU-y3S_0 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5769393397983542818', time=2024-09-12T20:46:35.004953+0000, chain.objs.size()=1 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.353__shadow_.KE7ofZ5KS5Ra8VxVcJKrgON1FQoHFkJ_0 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.205175949270483185', time=2024-09-12T20:48:23.343088+0000, chain.objs.size()=1 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.408__shadow_.B0Lw8IJE5rt0OJjDd8UvE0t-iMu8hJ1_0 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2429363750958365271', time=2024-09-12T20:50:00.694536+0000, chain.objs.size()=1 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.454__shadow_.Z2rZiC7us4aQzsDsLx8TCYir63FMIlM_0 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8781172098851376190', time=2024-09-12T20:51:02.890883+0000, chain.objs.size()=1 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.1R3SKdw-X9MqLU2eNEaMB9HAlw9_-pQ_0 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4936923480278924474', time=2024-09-12T20:51:29.346167+0000, chain.objs.size()=1 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.493__shadow_.rb8r_JXNfj_AvTo3UexoA_ycRm0m4cr_0 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1824214311124322755', time=2024-09-12T20:51:39.274664+0000, chain.objs.size()=1 2024-09-12T19:29:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.471+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.498__shadow_.K8c6ZsfhPkZiA61QltzSurF5yP8NzzA_0 2024-09-12T19:29:41.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7368563607487609629', time=2024-09-12T21:02:10.028720+0000, chain.objs.size()=1 2024-09-12T19:29:41.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.556__shadow_.XiDSeFIduNjX1o80--IKh-YXd8owt4i_0 2024-09-12T19:29:41.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15545543864874492311', time=2024-09-12T21:04:05.202507+0000, chain.objs.size()=1 2024-09-12T19:29:41.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.576__shadow:J2-dDqk-9wPTXO23RWYe1bZax170Kzh_.At8eVcbLxX40R1Cn4o_eTfYCfPfwPOm_0 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7369737233665244977', time=2024-09-12T21:04:30.972416+0000, chain.objs.size()=1 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:4qwgLhNxX7qn6PqakR5oNuRnjYpa66A_.XKYfra8mTMYv7WO0Qq2LlUt4CdRZbRU_0 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12898395854475237110', time=2024-09-12T21:04:37.637420+0000, chain.objs.size()=1 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:U4MMgzxPL2PBeUIYEhIOPohDpDWo5ZS_.nPviWyBdaKbx3B_qBMq85eKxC_FC37g_0 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14673048711316897276', time=2024-09-12T21:06:03.372628+0000, chain.objs.size()=1 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.582__shadow:nVxKHB2T2U9UNP2UZiN9aD68W.iOjTF_.PnUPYJWZd2Dqaz6Sp6tO9Xa1aBuAXwi_0 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2965988938138517667', time=2024-09-12T21:06:20.677346+0000, chain.objs.size()=1 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.587__shadow:R9pSMwekIHzJ-C7NlkDW7Dlwz-TYJJT_.1zn8l6sQHcbaf4F-YKN_22l3lrzrVBG_0 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4204342031428671244', time=2024-09-12T21:14:31.858166+0000, chain.objs.size()=1 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.647__shadow_.cTTignB60GlG_WJPA8rIGHtg5Lxe0Ts_0 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.103900755620997467', time=2024-09-12T21:16:16.077302+0000, chain.objs.size()=1 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.666__shadow_.ywQDaMy3hKJ_IBvgLFhxT0R1bwCxtrZ_0 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1391292704663558372', time=2024-09-12T21:17:18.277678+0000, chain.objs.size()=1 2024-09-12T19:29:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.700__shadow:UOCUKqIPj30kn6AXaLOuUSEUPitybNY_.C0Exg3SYBW0C03KD6P0449bxm1ht7nx_0 2024-09-12T19:29:41.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7198419412198977824', time=2024-09-12T21:17:29.893572+0000, chain.objs.size()=1 2024-09-12T19:29:41.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.475+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.705__shadow:fKuOF8Uqdc2xJ7BRb10jhbz9KOPITJM_.L5Cy4x41Hd0KFwmG4tc01FKuaOHm5Tr_0 2024-09-12T19:29:41.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.479+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.479+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T19:29:41.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48587' 2024-09-12T19:29:41.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14479785309987504306', time=2024-09-12T20:28:04.659194+0000, chain.objs.size()=1 2024-09-12T19:29:41.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.151__shadow_.8BFSKRmhSTuGl4B45bU3lDbhdoGX9Rr_0 2024-09-12T19:29:41.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6123972875791283902', time=2024-09-12T20:35:25.514555+0000, chain.objs.size()=1 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.230__shadow_.5yfD-jBx5-gcZVHHesaj6iiXB2Pcii5_0 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9736209537610773482', time=2024-09-12T20:35:59.527627+0000, chain.objs.size()=1 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.243__shadow_.fWhPcgZL3iKvbqEmHsGrVyz-iZoyLL6_0 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8460357358348134268', time=2024-09-12T20:36:10.178783+0000, chain.objs.size()=1 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.247__shadow_.Zdb9-OSq60U0Ut1yOdd9PL_nxAtKpJu_0 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4838149802532267060', time=2024-09-12T20:36:10.185014+0000, chain.objs.size()=1 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.247__shadow_.T4F1V32uE3DWKwovRQYL8daxIS3KfIc_0 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13828837749352349396', time=2024-09-12T20:36:14.668433+0000, chain.objs.size()=1 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.249__shadow_.y2DVUZZD3BELcznp44jKuTmiGptY_Pu_0 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14568702437399387270', time=2024-09-12T20:36:21.664808+0000, chain.objs.size()=1 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.252__shadow_.X8284BTRipj9WIf1PxhMk14TNlTXbi2_0 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.880673825280848854', time=2024-09-12T20:36:24.017876+0000, chain.objs.size()=1 2024-09-12T19:29:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.253__shadow_.EFDYGZzGo7638V8WvKxgboWoNCWsRZu_0 2024-09-12T19:29:41.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3416796195398225710', time=2024-09-12T20:36:35.232792+0000, chain.objs.size()=1 2024-09-12T19:29:41.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.258__shadow_.ES_K-gD_d422AnoTp7jMBnf1HVBcEqx_0 2024-09-12T19:29:41.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11101164070494351009', time=2024-09-12T20:36:39.567551+0000, chain.objs.size()=1 2024-09-12T19:29:41.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.260__shadow_.fqLdGQj_lxSk51-_0AuAHe4k4x2uW3t_0 2024-09-12T19:29:41.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10611249429812831158', time=2024-09-12T20:38:23.088190+0000, chain.objs.size()=1 2024-09-12T19:29:41.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1FiPMVeARYA6xZlSOZe53ZNQvoTelHi_0 2024-09-12T19:29:41.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5297112154107721823', time=2024-09-12T20:38:24.087222+0000, chain.objs.size()=1 2024-09-12T19:29:41.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nXM83rf8TsgQtPlNT6mjexcyRJ4FwrJ_0 2024-09-12T19:29:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12331575348476247561', time=2024-09-12T20:38:24.427415+0000, chain.objs.size()=1 2024-09-12T19:29:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.483+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.gcV-zkEFvzpV93syYi4DZYgafYNEmjf_0 2024-09-12T19:29:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14888481625266636285', time=2024-09-12T20:38:25.226471+0000, chain.objs.size()=1 2024-09-12T19:29:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.w_NoSMKwRSUOR4HW9_fuzFG_6T1GT7L_0 2024-09-12T19:29:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1678351242029101354', time=2024-09-12T20:38:26.483524+0000, chain.objs.size()=1 2024-09-12T19:29:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Gj32qe8qkHGPayX5o9x4AZAcF9Jqzsc_0 2024-09-12T19:29:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.373120481319977172', time=2024-09-12T20:38:26.562068+0000, chain.objs.size()=1 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MR8bRtM9-s2eShwvBCKeZUSSAzy68sJ_0 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6679658312765720515', time=2024-09-12T20:38:26.635649+0000, chain.objs.size()=1 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MEyOGrV5kjv1w4iousj2auPHJgb9NsT_0 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6729168978662686461', time=2024-09-12T20:38:26.898400+0000, chain.objs.size()=1 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.zynTch2ToziuMCIQURDfDSmE5voVnhd_0 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4347103512864433039', time=2024-09-12T20:38:27.904124+0000, chain.objs.size()=1 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.JfMwXIc4GhK6KUhPGExOs6DwBo3nR7v_0 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.433315644876417606', time=2024-09-12T20:38:29.324334+0000, chain.objs.size()=1 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MPMQJjPdS1QIIzi8Tsi1vz46Ep3Pb5p_0 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2002282974212552251', time=2024-09-12T20:38:30.389937+0000, chain.objs.size()=1 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-Ase6YaFjsCmq5tiFmWrUBIoYx_zbkX_0 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5430934243997244538', time=2024-09-12T20:38:30.727335+0000, chain.objs.size()=1 2024-09-12T19:29:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Nv3G1IhfZ1ciBeHwMbT2tyipgbBgtgU_0 2024-09-12T19:29:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18186436391138810931', time=2024-09-12T20:38:30.890561+0000, chain.objs.size()=1 2024-09-12T19:29:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7kURckGMbuKxZtJSwKrQG3PX7t7P9NU_0 2024-09-12T19:29:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12891242457450841752', time=2024-09-12T20:38:30.892172+0000, chain.objs.size()=1 2024-09-12T19:29:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZuU_--15IPVppsEQ6K4LoAELnzk7R4T_0 2024-09-12T19:29:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11159066528207010141', time=2024-09-12T20:38:31.205438+0000, chain.objs.size()=1 2024-09-12T19:29:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.487+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lR3VAZaPa1sp-xawIEI2T2fWYtv7ysm_0 2024-09-12T19:29:41.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9522228943857475155', time=2024-09-12T20:38:31.584455+0000, chain.objs.size()=1 2024-09-12T19:29:41.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-mSOzHYHjkhTwLPOKBr3qBzgkA4Yj_g_0 2024-09-12T19:29:41.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8228317013786650312', time=2024-09-12T20:38:32.842795+0000, chain.objs.size()=1 2024-09-12T19:29:41.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.h4LfUPucBWAm3Hs6p5GUldwKygPXCrt_0 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18278919818865698148', time=2024-09-12T20:38:33.991742+0000, chain.objs.size()=1 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.j21DkmsLExRy-MJrCC0ThnQwytHipVq_0 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4905735498703124924', time=2024-09-12T20:38:34.353393+0000, chain.objs.size()=1 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.TabOsXb3sV9EZU8K27xWwgVQ62xHWNq_0 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5205694191550654156', time=2024-09-12T20:38:34.821400+0000, chain.objs.size()=1 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7LCaOBM88yZqzJFHz1E46l9TU25-Rih_0 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6838594817006980283', time=2024-09-12T20:38:35.538718+0000, chain.objs.size()=1 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.J1Giuj9_c896ycAFzFOC0n2KQgI4WSk_0 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16430369935968980080', time=2024-09-12T20:38:35.699612+0000, chain.objs.size()=1 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.eCt91EWM_BYJoBlc0CTspGO8xH17leP_0 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8371980020207649637', time=2024-09-12T20:38:36.762797+0000, chain.objs.size()=1 2024-09-12T19:29:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QXISqsoPr6E8mNLq-iKJeooX6D5hyuV_0 2024-09-12T19:29:41.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.342263567004047526', time=2024-09-12T20:38:38.058030+0000, chain.objs.size()=1 2024-09-12T19:29:41.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8mV1SmlCGN97Lywmbzkos4zFi0LvbTR_0 2024-09-12T19:29:41.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18435168371952285611', time=2024-09-12T20:38:38.505353+0000, chain.objs.size()=1 2024-09-12T19:29:41.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0w-u20Sek14N1AdMEMueJqhbcxkh2bp_0 2024-09-12T19:29:41.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4874932405043548364', time=2024-09-12T20:38:40.195231+0000, chain.objs.size()=1 2024-09-12T19:29:41.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1OpeKcRoH9iRaGJpyGoCm299ErvNvtd_0 2024-09-12T19:29:41.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.76700873514211324', time=2024-09-12T20:38:40.410507+0000, chain.objs.size()=1 2024-09-12T19:29:41.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8K7KzA8sCr3ESNEDdF0mZX2sFGSaQL0_0 2024-09-12T19:29:41.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14288974513090638918', time=2024-09-12T20:38:42.091255+0000, chain.objs.size()=1 2024-09-12T19:29:41.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8j7ZUOOpbh_SqANHgZpcPrphIdgmzop_0 2024-09-12T19:29:41.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13143765087951662401', time=2024-09-12T20:38:43.406620+0000, chain.objs.size()=1 2024-09-12T19:29:41.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AKZ2MrNJQjD6VdtQNEb0WFZ5tPikjxj_0 2024-09-12T19:29:41.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8943663364887706242', time=2024-09-12T20:38:43.461004+0000, chain.objs.size()=1 2024-09-12T19:29:41.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.A64kMt8QFYssxTrjz7x5191NxnEfaGW_0 2024-09-12T19:29:41.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10284332682737027660', time=2024-09-12T20:38:43.946656+0000, chain.objs.size()=1 2024-09-12T19:29:41.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EXqcqA5esTFlqEexS4-KZmEtAaMnB1L_0 2024-09-12T19:29:41.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6812120927493387550', time=2024-09-12T20:38:44.820873+0000, chain.objs.size()=1 2024-09-12T19:29:41.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ARr-h1fXGtCH81BqFNwpS_HKlXaxgh6_0 2024-09-12T19:29:41.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17500165194702734241', time=2024-09-12T20:38:44.822502+0000, chain.objs.size()=1 2024-09-12T19:29:41.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.SgqQ9zZW7TErIX8ojLOLhJvlmq7rGxG_0 2024-09-12T19:29:41.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11334164794438470607', time=2024-09-12T20:38:45.393953+0000, chain.objs.size()=1 2024-09-12T19:29:41.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lXvU79yOyulVQzGPBcFCIB-3xVal3o1_0 2024-09-12T19:29:41.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1833801064534668650', time=2024-09-12T20:38:49.891416+0000, chain.objs.size()=1 2024-09-12T19:29:41.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Ur7AAmIwDhwdOCtftned_wcWE7n6eep_0 2024-09-12T19:29:41.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13593678864762846658', time=2024-09-12T20:38:50.204710+0000, chain.objs.size()=1 2024-09-12T19:29:41.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dSScLLVMZQhIyZEk0xhqCO2IlJwwGVN_0 2024-09-12T19:29:41.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14303030386743982949', time=2024-09-12T20:38:50.260317+0000, chain.objs.size()=1 2024-09-12T19:29:41.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.491+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.z8SY0b3SgAJX8uAJaBfeCR--GDSpvpA_0 2024-09-12T19:29:41.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9112981833367106411', time=2024-09-12T20:38:59.435733+0000, chain.objs.size()=1 2024-09-12T19:29:41.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.266__shadow_.7MP5V-PwjgNVmiSh65AhEq3fyYiO25t_0 2024-09-12T19:29:41.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12171732236116194818', time=2024-09-12T20:39:05.913747+0000, chain.objs.size()=1 2024-09-12T19:29:41.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.269__shadow_.G4UPPYQzXOGeUd5xtDDiqJPhQGPHiMl_0 2024-09-12T19:29:41.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6118647160567542708', time=2024-09-12T20:40:02.113323+0000, chain.objs.size()=1 2024-09-12T19:29:41.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.fHsLaW651A8EnWCKjxB5Z7BcpdlKrxE_0 2024-09-12T19:29:41.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11057917255394086531', time=2024-09-12T20:40:07.694729+0000, chain.objs.size()=1 2024-09-12T19:29:41.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.AkkI-ffLRVG1bCIQxIwnFJuIbyWqXGO_0 2024-09-12T19:29:41.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8586286896589791778', time=2024-09-12T20:40:12.527854+0000, chain.objs.size()=1 2024-09-12T19:29:41.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.295__shadow_.D7IfKAYPtwkQp89xbk1r4Up0rHiN0hk_0 2024-09-12T19:29:41.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10059661438735457000', time=2024-09-12T20:40:28.881366+0000, chain.objs.size()=1 2024-09-12T19:29:41.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.302__shadow_.7yoKK-Haols1QFZkdXQ5_YhynB9Wlno_0 2024-09-12T19:29:41.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8637994311567764015', time=2024-09-12T20:40:35.760632+0000, chain.objs.size()=1 2024-09-12T19:29:41.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.305__shadow_.q9skD3sSHmrpSirILiIWzoflNogPrax_0 2024-09-12T19:29:41.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6470345764369898973', time=2024-09-12T20:40:38.452904+0000, chain.objs.size()=1 2024-09-12T19:29:41.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.306__shadow_.zES6ET0SyUq2OmRn5dTS8UY9AK4nYZ7_0 2024-09-12T19:29:41.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6916387580684085322', time=2024-09-12T20:43:02.734639+0000, chain.objs.size()=1 2024-09-12T19:29:41.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.X_kd2ESEHUGChv_78J6ymnXMmeXYNr2_0 2024-09-12T19:29:41.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16422297780268228673', time=2024-09-12T20:43:03.402111+0000, chain.objs.size()=1 2024-09-12T19:29:41.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.LHS9c-gXSL8KJsY4MZHPoNlUiUWWTId_0 2024-09-12T19:29:41.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12742327953421756913', time=2024-09-12T20:43:03.665806+0000, chain.objs.size()=1 2024-09-12T19:29:41.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.DwS1164gFGqxiNGE3-nMhHeyGvy8T6r_0 2024-09-12T19:29:41.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16483001716747007955', time=2024-09-12T20:43:03.856597+0000, chain.objs.size()=1 2024-09-12T19:29:41.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3iTIhjM3KEQEdvwYnVhG6csp8wd8FEP_0 2024-09-12T19:29:41.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10083223906049737795', time=2024-09-12T20:43:04.028533+0000, chain.objs.size()=1 2024-09-12T19:29:41.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.h0U1IFQkHWu1aK46-Tkzk4Mkgg-a-eW_0 2024-09-12T19:29:41.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16729914453289125114', time=2024-09-12T20:43:04.603148+0000, chain.objs.size()=1 2024-09-12T19:29:41.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TwcWwjGZSe6D3KSuIRjqyhWKTDmmUeJ_0 2024-09-12T19:29:41.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4799287341537119902', time=2024-09-12T20:43:05.020389+0000, chain.objs.size()=1 2024-09-12T19:29:41.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.mgkzsKIGep7v9wTDekV2DFusvR9C0RJ_0 2024-09-12T19:29:41.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6824914807472938930', time=2024-09-12T20:43:06.767271+0000, chain.objs.size()=1 2024-09-12T19:29:41.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.psidwPjOxw6HsCBQrZhMT2nNGqK81Dz_0 2024-09-12T19:29:41.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5650419433319534406', time=2024-09-12T20:43:07.299235+0000, chain.objs.size()=1 2024-09-12T19:29:41.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.495+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.a3QfddYi5w3UepPYhWbOYpT1sW0rPwJ_0 2024-09-12T19:29:41.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10228351177064697388', time=2024-09-12T20:43:08.573255+0000, chain.objs.size()=1 2024-09-12T19:29:41.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-gV7YC9uIzdAjRjHexP4xxbZlj2XEz1_0 2024-09-12T19:29:41.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9333381632394893939', time=2024-09-12T20:43:09.126725+0000, chain.objs.size()=1 2024-09-12T19:29:41.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yzHwXDGkhPwjy-KHe-Z0Nimq9blTQOg_0 2024-09-12T19:29:41.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1704823488704864348', time=2024-09-12T20:43:10.425163+0000, chain.objs.size()=1 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pLWWVZj2oIUewSlVFGdqazOnFCXGxi8_0 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9055089082356494839', time=2024-09-12T20:43:10.776048+0000, chain.objs.size()=1 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.bqF41RX1W8k1XEzLmcJYOvwHE6uMhEs_0 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9547214027141930736', time=2024-09-12T20:43:10.814595+0000, chain.objs.size()=1 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.44lwub6Dq8LToR4HW9Aurm5B_BncOln_0 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7805640425460138520', time=2024-09-12T20:43:11.068557+0000, chain.objs.size()=1 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.klotzdpbOjH_HKCCQwreyUld_MpaceG_0 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7496441794082938340', time=2024-09-12T20:43:18.894406+0000, chain.objs.size()=1 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Qz6SYhf1BYrI9rsivOzDlTvZ4L_bgQR_0 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3435895611305771741', time=2024-09-12T20:43:19.885980+0000, chain.objs.size()=1 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.CAw7h4LGYIlBG54fu1gyGb24gphM3_Q_0 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9125172227064339831', time=2024-09-12T20:43:21.258355+0000, chain.objs.size()=1 2024-09-12T19:29:41.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.kMQci6IunY2fZMTrC2OqO656I-cDELe_0 2024-09-12T19:29:41.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.780868400268984443', time=2024-09-12T20:43:21.292185+0000, chain.objs.size()=1 2024-09-12T19:29:41.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.iqzoPupeGp_3qYM9j2i9opTcamLrhF3_0 2024-09-12T19:29:41.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.800629914188745775', time=2024-09-12T20:43:22.885845+0000, chain.objs.size()=1 2024-09-12T19:29:41.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.qZG6mxL2uB1SPc27Mh-2QpEK7HVrBst_0 2024-09-12T19:29:41.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12287495996842831790', time=2024-09-12T20:43:23.102779+0000, chain.objs.size()=1 2024-09-12T19:29:41.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.b3IV6yxM4V0P9MGsvF8OgeGDwtPehGJ_0 2024-09-12T19:29:41.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1212829257977035268', time=2024-09-12T20:43:24.490497+0000, chain.objs.size()=1 2024-09-12T19:29:41.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.XQDHBBBUYAL4iwuk2sfg1Nd1UnP0G8k_0 2024-09-12T19:29:41.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1089521158506002941', time=2024-09-12T20:43:25.012226+0000, chain.objs.size()=1 2024-09-12T19:29:41.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Ks_oyPrXN47IoE1gRG_TbkbCK1Gx_7x_0 2024-09-12T19:29:41.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4782791922401519788', time=2024-09-12T20:43:25.140877+0000, chain.objs.size()=1 2024-09-12T19:29:41.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tYncjj_Dwwy05I0bnV1TJ2ywzeQQQXo_0 2024-09-12T19:29:41.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16912362763161478954', time=2024-09-12T20:43:26.384980+0000, chain.objs.size()=1 2024-09-12T19:29:41.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yVQRSw3QRRKgD6okM3TP2JseBPbgfbi_0 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7655325523500565633', time=2024-09-12T20:43:26.402605+0000, chain.objs.size()=1 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.499+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Ml9mS_KCfsQVRf5t2ZwBTCcJ4LQR-Pi_0 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16475934256248240298', time=2024-09-12T20:43:26.507256+0000, chain.objs.size()=1 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.78fkzUPjTbwAp270kdmPseo8LVGXbWZ_0 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3993596668583023619', time=2024-09-12T20:43:26.814778+0000, chain.objs.size()=1 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zlKCcaDoYkXiAHgcs5D3eHY2cT00Qv-_0 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1958074257151830954', time=2024-09-12T20:43:28.963355+0000, chain.objs.size()=1 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.FoZCAX3w3N4uxpTRzxoQtGtGHcDZ7ns_0 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4773078213059393439', time=2024-09-12T20:43:29.501882+0000, chain.objs.size()=1 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HFC4eBLi_MqIcaoiVI6PcWkI6dDsqXA_0 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13440090792005119918', time=2024-09-12T20:45:11.371041+0000, chain.objs.size()=1 2024-09-12T19:29:41.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WFy5MxzmeXSQfLxa_7fQ2wI56AOPmCC_0 2024-09-12T19:29:41.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17868615629194812432', time=2024-09-12T20:45:11.787087+0000, chain.objs.size()=1 2024-09-12T19:29:41.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.q0TPezxiYx5bjmgRWHi7UJFjvMkgKyQ_0 2024-09-12T19:29:41.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2125293488103277397', time=2024-09-12T20:45:12.474335+0000, chain.objs.size()=1 2024-09-12T19:29:41.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.of9CFFLm4qIFM_FF7xiQVko4HpMR8hg_0 2024-09-12T19:29:41.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3150030328272021333', time=2024-09-12T20:45:12.590078+0000, chain.objs.size()=1 2024-09-12T19:29:41.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.rYvCY6d_w816GKGY5MtZLTOZDrMnw1Z_0 2024-09-12T19:29:41.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7811365328805619231', time=2024-09-12T20:45:14.999292+0000, chain.objs.size()=1 2024-09-12T19:29:41.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.503+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3_PYNEfbCnIpVEYaBgPL0kBCI9GKHZY_0 2024-09-12T19:29:41.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13296910623143505366', time=2024-09-12T20:45:15.478899+0000, chain.objs.size()=1 2024-09-12T19:29:41.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GmImlIQFhHeIE-as8AMtLi8UwIijzml_0 2024-09-12T19:29:41.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.281546060469905737', time=2024-09-12T20:45:15.943311+0000, chain.objs.size()=1 2024-09-12T19:29:41.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.TI6-gflhsH69FtHC0LEzgAHjxFd6Wb1_0 2024-09-12T19:29:41.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3742275373458183377', time=2024-09-12T20:45:16.180947+0000, chain.objs.size()=1 2024-09-12T19:29:41.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.snBPWP6o7E7vR9NT5MJm-zyXdT79W4w_0 2024-09-12T19:29:41.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6755867771603737784', time=2024-09-12T20:45:18.480925+0000, chain.objs.size()=1 2024-09-12T19:29:41.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3S6DnNxl4eSkwvF8LIampogBRoFDNoi_0 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10175668386708409404', time=2024-09-12T20:45:18.484547+0000, chain.objs.size()=1 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.XrH3-nHzZUHg0PmB7BVnYmoQFs0qs4v_0 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11571247976874007979', time=2024-09-12T20:45:18.744760+0000, chain.objs.size()=1 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0FKazGC69FznyoAjBiuV3ET8mPgP5RC_0 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12488888649467503272', time=2024-09-12T20:45:18.774318+0000, chain.objs.size()=1 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lFLcoyi20F8CTdT3Eh2oiLlsArJ1Fq1_0 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5911335118366331411', time=2024-09-12T20:45:18.831977+0000, chain.objs.size()=1 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9k-R9Qc9tF4iaXFepIyzt79IgaBE7G9_0 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7800132290810400435', time=2024-09-12T20:45:19.072668+0000, chain.objs.size()=1 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3DtTe4Z33fvQGs1JdAfLuqoRu34xGSn_0 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12489997144103916389', time=2024-09-12T20:45:19.467785+0000, chain.objs.size()=1 2024-09-12T19:29:41.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UO2ZtBkdGUt9zXJXtHtxA3U_3-nAtrN_0 2024-09-12T19:29:41.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.511+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48587 2024-09-12T19:29:41.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-12T19:29:41.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18272841574385665823', time=2024-09-12T20:45:22.041660+0000, chain.objs.size()=1 2024-09-12T19:29:41.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zhczRxhbohx88hvILwRgxkqXJO1O2ac_0 2024-09-12T19:29:41.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15392197849777842725', time=2024-09-12T20:45:22.078117+0000, chain.objs.size()=1 2024-09-12T19:29:41.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.vu30q0qUUiEkTpeBxZCNQd42Q0VEMWd_0 2024-09-12T19:29:41.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4904969298458949995', time=2024-09-12T20:45:23.180715+0000, chain.objs.size()=1 2024-09-12T19:29:41.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9eeNp5BXpxKaxCo3DxnXbJSz1CPRkfi_0 2024-09-12T19:29:41.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16080262645034884016', time=2024-09-12T20:45:25.758807+0000, chain.objs.size()=1 2024-09-12T19:29:41.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.LlUAm9WcpWZyp8RIJMG8D57ABZciPfr_0 2024-09-12T19:29:41.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12326272559967342595', time=2024-09-12T20:45:26.463538+0000, chain.objs.size()=1 2024-09-12T19:29:41.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.EOQbHURVYFRe76UPN8foYU3bNX1Mx2U_0 2024-09-12T19:29:41.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7929017253535651853', time=2024-09-12T20:45:26.715436+0000, chain.objs.size()=1 2024-09-12T19:29:41.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.snucPf8c1gQQQZkFwf4BCbJIEUl652n_0 2024-09-12T19:29:41.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1725711521232324020', time=2024-09-12T20:45:26.980671+0000, chain.objs.size()=1 2024-09-12T19:29:41.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.n0mMaCU0RyzsGf1dO4U-r7cs03bEIPZ_0 2024-09-12T19:29:41.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16901689567796888605', time=2024-09-12T20:45:28.019192+0000, chain.objs.size()=1 2024-09-12T19:29:41.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.A2cLwpHfYn8YJ-w4BlyZiOrMuA7v2Nb_0 2024-09-12T19:29:41.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10227362104928492407', time=2024-09-12T20:45:29.546099+0000, chain.objs.size()=1 2024-09-12T19:29:41.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MXT8NzskoKoY-t3WCFHzA_VGtMNvHXP_0 2024-09-12T19:29:41.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.566913329558586827', time=2024-09-12T20:45:29.588929+0000, chain.objs.size()=1 2024-09-12T19:29:41.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1YPc5XXp-JsRvLl0_DGnDY4TShSFugx_0 2024-09-12T19:29:41.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9277761482328822683', time=2024-09-12T20:45:30.722331+0000, chain.objs.size()=1 2024-09-12T19:29:41.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kGfYUa5o_Sg9HqyVKCv-2iZDzN4K67k_0 2024-09-12T19:29:41.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16020272174779138989', time=2024-09-12T20:45:31.132822+0000, chain.objs.size()=1 2024-09-12T19:29:41.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.yzLRF-ZDka_SsCO7u0YHurVO8jIVxY3_0 2024-09-12T19:29:41.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10468078748608217960', time=2024-09-12T20:45:31.789338+0000, chain.objs.size()=1 2024-09-12T19:29:41.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.515+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.VxA9KXtylEaN0MBGpvelPZ_sOLZ-6Uu_0 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7659733895250749305', time=2024-09-12T20:45:32.748651+0000, chain.objs.size()=1 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.33aqGt91V_HM5i6igDasET_yUU-wTry_0 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5269608787236900914', time=2024-09-12T20:45:33.332112+0000, chain.objs.size()=1 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.RzPIxrjwGiCsribfF4nwcX2DWTG7iki_0 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.423317834109328463', time=2024-09-12T20:45:33.642181+0000, chain.objs.size()=1 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1xV2NcEszkA3XZFlb942nWhVdl3nZlm_0 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3907062536523967889', time=2024-09-12T20:45:35.271562+0000, chain.objs.size()=1 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Y5-lo88h-bxcZ67uNFopASF7L8q7GjP_0 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9222596752683819136', time=2024-09-12T20:45:36.089713+0000, chain.objs.size()=1 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.CVx-4D8jYlydHdZ7Fk5wtWcASu2kXYe_0 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.722274131727859108', time=2024-09-12T20:45:36.253453+0000, chain.objs.size()=1 2024-09-12T19:29:41.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uq8ySPyQ533eTxun27I3jS77btw0_kP_0 2024-09-12T19:29:41.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8386650998120779164', time=2024-09-12T20:45:36.531808+0000, chain.objs.size()=1 2024-09-12T19:29:41.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wiBstgvncXap022t1LR4LJbn59YpxbH_0 2024-09-12T19:29:41.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13405306101507901635', time=2024-09-12T20:51:35.023956+0000, chain.objs.size()=1 2024-09-12T19:29:41.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.496__shadow_.VNAShtq7LRWUVXR3mtMsRs3LUpabDC5_0 2024-09-12T19:29:41.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.199773778735614285', time=2024-09-12T20:51:42.466966+0000, chain.objs.size()=1 2024-09-12T19:29:41.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.499__shadow_.EC62OWFoLxo592EnBWAMEkI4mTWtn_u_0 2024-09-12T19:29:41.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8827777205225250082', time=2024-09-12T20:58:09.733275+0000, chain.objs.size()=1 2024-09-12T19:29:41.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~XObu1WnXSrHG4YOVJ7sdPm9dm-Od_7y.1 2024-09-12T19:29:41.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8276207725601797590', time=2024-09-12T21:02:08.868479+0000, chain.objs.size()=1 2024-09-12T19:29:41.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.556__shadow_.NiEZ8JPFIlT42_13_G9PFajqUg5Qzzs_0 2024-09-12T19:29:41.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3893348933640340257', time=2024-09-12T21:02:41.033522+0000, chain.objs.size()=1 2024-09-12T19:29:41.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.561__multipart_mymultipart.2~YDPdx1162JabTEOdc95suzWb4Y7akAh.1 2024-09-12T19:29:41.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2864781019235723080', time=2024-09-12T21:03:37.492439+0000, chain.objs.size()=1 2024-09-12T19:29:41.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.572__shadow_.E1Bn9B8Rvp5-EVBKNAVe1xEVF3eaUAd_0 2024-09-12T19:29:41.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3870164082805731788', time=2024-09-12T21:05:36.640848+0000, chain.objs.size()=4 2024-09-12T19:29:41.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~8EiZFXw7pYBBoT0gnaNo04_4G86BEKc.1 2024-09-12T19:29:41.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~8EiZFXw7pYBBoT0gnaNo04_4G86BEKc.2 2024-09-12T19:29:41.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~8EiZFXw7pYBBoT0gnaNo04_4G86BEKc.3 2024-09-12T19:29:41.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~8EiZFXw7pYBBoT0gnaNo04_4G86BEKc.4 2024-09-12T19:29:41.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18439194297494278160', time=2024-09-12T21:06:06.371780+0000, chain.objs.size()=1 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.583__shadow:LvvFjeY3ds7nI1YrvqUiKeQ3e25pLnQ_.XiJWKa9sx2SGcQae5NUYHQ-278hpqEe_0 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5352472359981459694', time=2024-09-12T21:10:51.973321+0000, chain.objs.size()=1 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.617__shadow_.q1R3to8LuXsgWETxrrsqpnGX5SFJraD_0 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12069159118962837306', time=2024-09-12T21:11:56.917739+0000, chain.objs.size()=1 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.619__shadow_.b8jcPf8vR2XBxlQVnAMWUToQb05dT5D_0 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1262630738385346474', time=2024-09-12T21:11:58.859824+0000, chain.objs.size()=1 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.620__shadow_.4QbV_V4MXVoTfcwEv0PrjWggeCgrLNi_0 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15552969416778813618', time=2024-09-12T21:14:10.962581+0000, chain.objs.size()=2 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.519+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.643__shadow_.eAw5fxIjdDAYo2jxFgMmtTOXYPCzaeI_0 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.643__shadow_.eAw5fxIjdDAYo2jxFgMmtTOXYPCzaeI_1 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15900785528741967269', time=2024-09-12T21:16:12.814976+0000, chain.objs.size()=1 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.665__shadow_.SdAEN9Lf05KRNj2CjCTseadOFsJC-Z-_0 2024-09-12T19:29:41.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6782104950732381333', time=2024-09-12T21:16:16.714648+0000, chain.objs.size()=1 2024-09-12T19:29:41.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.666__shadow_.ywQDaMy3hKJ_IBvgLFhxT0R1bwCxtrZ_0 2024-09-12T19:29:41.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17238415298072415797', time=2024-09-12T21:16:59.778071+0000, chain.objs.size()=1 2024-09-12T19:29:41.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.691__shadow_.Ll3uRyKiqCaPndxdpLQy7LQ3A96tWpC_0 2024-09-12T19:29:41.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6654895470008161804', time=2024-09-12T21:17:03.382739+0000, chain.objs.size()=1 2024-09-12T19:29:41.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.693__shadow:hzD4Y8aHX6Xcj.wA-tJtbgATwV77.d4_.HZb-9SSRaZdpVcuKR79_dsd75Z7dL9D_0 2024-09-12T19:29:41.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3947091762432786254', time=2024-09-12T21:17:42.189238+0000, chain.objs.size()=1 2024-09-12T19:29:41.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.711__multipart_file1.2~QVgmjTXS-a6du1nfV4flkoqIo93tLZO.1 2024-09-12T19:29:41.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16325287193951083736', time=2024-09-12T21:20:36.721079+0000, chain.objs.size()=1 2024-09-12T19:29:41.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.523+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.745__shadow_.3uM7vil6vIKS8qHVTI58_jssCoApT3M_0 2024-09-12T19:29:41.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.527+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.527+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T19:29:41.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46767' 2024-09-12T19:29:41.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_SSVHkUODLWzWyVq-qP5C-UBWbBm7F8p', time=2024-09-12T20:30:03.661098+0000, chain.objs.size()=1 2024-09-12T19:29:41.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.163__shadow_.XqI7Hw7kVduwTSzO6GEKQbiCbRV6Rbp_0 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11387436352108988495', time=2024-09-12T20:30:49.729582+0000, chain.objs.size()=1 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.178__shadow_.P2_AV2IppMFdKPUXNYlPAFZY2DrPq1t_0 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17854102363714951225', time=2024-09-12T20:31:49.995014+0000, chain.objs.size()=1 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.199__shadow_.DlwT5E59J_7U9dIPBCDx6PMPrpsB58k_0 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1391757428056622090', time=2024-09-12T20:35:34.787773+0000, chain.objs.size()=1 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.234__shadow_.Xrazr3EAjxLo56Up5-rMTbPfv-QK2Vy_0 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5993077315766776786', time=2024-09-12T20:35:53.380962+0000, chain.objs.size()=1 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.241__shadow_.H2C0EOj-DaEzQsc-rh7VxaGWXaSpLwL_0 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17442271756491977709', time=2024-09-12T20:35:55.679283+0000, chain.objs.size()=1 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.242__shadow_.HKkQE0YLUNAZEkSE7Yfg-DJn5a2qG8V_0 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.230014049033933634', time=2024-09-12T20:36:28.508616+0000, chain.objs.size()=1 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.255__shadow_.9a2FzPSsBZohRn0O2zqYuf2cYUFpmOO_0 2024-09-12T19:29:41.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3010933659439544260', time=2024-09-12T20:38:22.520274+0000, chain.objs.size()=1 2024-09-12T19:29:41.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8VZLWeO_BkDajunBBEiOQrbe6J-BJMO_0 2024-09-12T19:29:41.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4574590123517553400', time=2024-09-12T20:38:23.070174+0000, chain.objs.size()=1 2024-09-12T19:29:41.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5IOCTqPySskaXDrytd6FWeDYGj-0He0_0 2024-09-12T19:29:41.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13599047635223170049', time=2024-09-12T20:38:23.581747+0000, chain.objs.size()=1 2024-09-12T19:29:41.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jUeqn6Aaj1lnV_3clr3wa0KoEauIuV5_0 2024-09-12T19:29:41.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15191752854743123313', time=2024-09-12T20:38:25.320100+0000, chain.objs.size()=1 2024-09-12T19:29:41.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lCmctHlZs8D3gODyEo4HqFro0S_Cf4z_0 2024-09-12T19:29:41.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14688924645291770968', time=2024-09-12T20:38:27.011998+0000, chain.objs.size()=1 2024-09-12T19:29:41.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.b9NwlXfOfnU6VnSMMMmLHGhAoqJNjzl_0 2024-09-12T19:29:41.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11116230757578486193', time=2024-09-12T20:38:27.686454+0000, chain.objs.size()=1 2024-09-12T19:29:41.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fRUtCl40zYEZNZP2HW_My2IKmdy5k4N_0 2024-09-12T19:29:41.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.575721246832092341', time=2024-09-12T20:38:28.555518+0000, chain.objs.size()=1 2024-09-12T19:29:41.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AI-59bB982a1aUk1o1Y-IiUjrXfZ_87_0 2024-09-12T19:29:41.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5363778258372047874', time=2024-09-12T20:38:29.287552+0000, chain.objs.size()=1 2024-09-12T19:29:41.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.531+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.KWhaWKI7-vNF6sNTElKIVF7IcapsvsK_0 2024-09-12T19:29:41.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12965385391635305844', time=2024-09-12T20:38:30.448464+0000, chain.objs.size()=1 2024-09-12T19:29:41.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AVTHzlkH0aWVzciWUAWfADYFVHam-qe_0 2024-09-12T19:29:41.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8842123846144946213', time=2024-09-12T20:38:31.424659+0000, chain.objs.size()=1 2024-09-12T19:29:41.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nKZOtFT1mWnffAcgRrnV5pQfFddkAkv_0 2024-09-12T19:29:41.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11455533213517706655', time=2024-09-12T20:38:31.643109+0000, chain.objs.size()=1 2024-09-12T19:29:41.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.shEGWy_a0xC2SeL6YoBhFvy4uaUzZY5_0 2024-09-12T19:29:41.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1052441391324520050', time=2024-09-12T20:38:31.761676+0000, chain.objs.size()=1 2024-09-12T19:29:41.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ilnfw9wTi_lxbdMCBcw67QmmM0p4ytZ_0 2024-09-12T19:29:41.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1639291284007293598', time=2024-09-12T20:38:31.909646+0000, chain.objs.size()=1 2024-09-12T19:29:41.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.B8iDSIFmHJUI-GDKmGZxZwnjQwXoyCC_0 2024-09-12T19:29:41.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2047770995948201026', time=2024-09-12T20:38:32.039544+0000, chain.objs.size()=1 2024-09-12T19:29:41.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.p36RAinHYGzG04RMI4k9dpsGSwyENdB_0 2024-09-12T19:29:41.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16530807965221821484', time=2024-09-12T20:38:32.349579+0000, chain.objs.size()=1 2024-09-12T19:29:41.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.F6zwo5TsRbMv14K28WUNeDItTrubNzN_0 2024-09-12T19:29:41.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16229060561264358679', time=2024-09-12T20:38:32.977215+0000, chain.objs.size()=1 2024-09-12T19:29:41.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.BkOzZHqaBW5unrHBhSkw6_VisaJ4JEB_0 2024-09-12T19:29:41.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10569708000657406594', time=2024-09-12T20:38:34.722100+0000, chain.objs.size()=1 2024-09-12T19:29:41.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QxfPpmxrDfgXukrmsk8sV5HQgNlNUsf_0 2024-09-12T19:29:41.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14351728301029437479', time=2024-09-12T20:38:35.180126+0000, chain.objs.size()=1 2024-09-12T19:29:41.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lJDkKo8NqPUwawNyjR3aBPaRb7xp5tc_0 2024-09-12T19:29:41.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4322817138179915503', time=2024-09-12T20:38:36.152553+0000, chain.objs.size()=1 2024-09-12T19:29:41.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.2elFFN0wZqlUl2vP1K_yxKKdr8Pu4p-_0 2024-09-12T19:29:41.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10743581162977872849', time=2024-09-12T20:38:37.745479+0000, chain.objs.size()=1 2024-09-12T19:29:41.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ngtP74Rieg26U4aBE4Qb6CCsIT2Ugor_0 2024-09-12T19:29:41.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2365720880651953862', time=2024-09-12T20:38:38.166338+0000, chain.objs.size()=1 2024-09-12T19:29:41.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Mk4U16Rp1IUba5bFJW6SwcKC45udgdT_0 2024-09-12T19:29:41.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9870682837685197982', time=2024-09-12T20:38:41.739879+0000, chain.objs.size()=1 2024-09-12T19:29:41.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5PQ3VcwVFBaScUU_nmtYbOzKcBn1LOZ_0 2024-09-12T19:29:41.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13529995518367897105', time=2024-09-12T20:38:41.897516+0000, chain.objs.size()=1 2024-09-12T19:29:41.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.O3UIGcyVWaveD6QF5i4CIJNeHKjjIkY_0 2024-09-12T19:29:41.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4372390055819996207', time=2024-09-12T20:38:42.272027+0000, chain.objs.size()=1 2024-09-12T19:29:41.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.SPx3o2ImjzLjJKprKXxQ_kMOeHI7nfW_0 2024-09-12T19:29:41.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6909628305827844048', time=2024-09-12T20:38:42.840535+0000, chain.objs.size()=1 2024-09-12T19:29:41.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.535+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.61ivVKT1DZ0m10blVAEkWNlc95kgvI2_0 2024-09-12T19:29:41.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16634345582811183945', time=2024-09-12T20:38:44.063401+0000, chain.objs.size()=1 2024-09-12T19:29:41.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.XlSGueOpbIWIArcjbA_PumrkcrPqVkV_0 2024-09-12T19:29:41.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2799460545197832218', time=2024-09-12T20:38:44.671381+0000, chain.objs.size()=1 2024-09-12T19:29:41.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Tx_ukIIp8JaYX2EksdyhfzCvekrARv0_0 2024-09-12T19:29:41.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16985246297852697619', time=2024-09-12T20:38:45.479233+0000, chain.objs.size()=1 2024-09-12T19:29:41.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.s4rrLjeN1rwNkYKVdgLeZQNWctez4ry_0 2024-09-12T19:29:41.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18267373340294344478', time=2024-09-12T20:38:45.574060+0000, chain.objs.size()=1 2024-09-12T19:29:41.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.KsPXNfJR1FBV7iFqHeis8-SKZoVSLQH_0 2024-09-12T19:29:41.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3057242775825947550', time=2024-09-12T20:38:46.020926+0000, chain.objs.size()=1 2024-09-12T19:29:41.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.F54FvNHfay5tNwXm29c0dFJEVk-WhIg_0 2024-09-12T19:29:41.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9272535780496178605', time=2024-09-12T20:38:46.188284+0000, chain.objs.size()=1 2024-09-12T19:29:41.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.zEFlRahymx2_vHhcOowyKDuxdOw-kd6_0 2024-09-12T19:29:41.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15850854758068866392', time=2024-09-12T20:38:50.039501+0000, chain.objs.size()=1 2024-09-12T19:29:41.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.33RsoPx1569hbyNjnyn5IDs8b9Sv9fj_0 2024-09-12T19:29:41.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1853836142094653099', time=2024-09-12T20:38:54.993605+0000, chain.objs.size()=1 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.264__shadow_.wXENNymPHnM85vwBrLtWa-3-8HK8i_w_0 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11999317409140938098', time=2024-09-12T20:39:10.275950+0000, chain.objs.size()=1 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.271__shadow_.URP06eyJZC-mRrD_in6cmR2WpumvVsc_0 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14564404623267541750', time=2024-09-12T20:39:16.845434+0000, chain.objs.size()=1 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.274__shadow_.CxFis3jsMtvsS97hKyOTIgn3pU0jcmi_0 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8634243925366411343', time=2024-09-12T20:39:42.082071+0000, chain.objs.size()=1 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.285__shadow_.W32XXX42HPvjaG-4MWzBBCRg6SrhW4w_0 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8053902204606893879', time=2024-09-12T20:40:14.758900+0000, chain.objs.size()=1 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.296__shadow_.UkpTxczTbbuohShqVxGJrtS1WVs9jz8_0 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2387309024097147388', time=2024-09-12T20:40:14.760650+0000, chain.objs.size()=1 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.296__shadow_.YVkYpy8DDwWXkvJXrIxGtMM5xJ6WW67_0 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6954736408963351687', time=2024-09-12T20:43:03.001742+0000, chain.objs.size()=1 2024-09-12T19:29:41.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._vn8ulaULe7UJqwMxcp3V936KfrJlpa_0 2024-09-12T19:29:41.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1078610879091384586', time=2024-09-12T20:43:03.172120+0000, chain.objs.size()=1 2024-09-12T19:29:41.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.539+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.PkdWSLj3v-0VoR4wH_glP4YDmjIXd74_0 2024-09-12T19:29:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13990591653928104663', time=2024-09-12T20:43:04.478461+0000, chain.objs.size()=1 2024-09-12T19:29:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QsTet8_sLQqxcCbQ2rUzC-Lj85A-IpP_0 2024-09-12T19:29:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15105127625714834517', time=2024-09-12T20:43:04.604203+0000, chain.objs.size()=1 2024-09-12T19:29:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.WLJNz0y6CGq36mtA7h-28LsAjrF3dIq_0 2024-09-12T19:29:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9220135601199505420', time=2024-09-12T20:43:06.675011+0000, chain.objs.size()=1 2024-09-12T19:29:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.XSP1M_XqKmqLDDRDTwAbrL-ylD-muTZ_0 2024-09-12T19:29:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15956789426401520972', time=2024-09-12T20:43:07.055846+0000, chain.objs.size()=1 2024-09-12T19:29:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cbAzCieWWN9DCzDk1cJWNq_8mEGf-Jz_0 2024-09-12T19:29:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15530741470671124643', time=2024-09-12T20:43:07.240186+0000, chain.objs.size()=1 2024-09-12T19:29:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TtXrw-pdzLdxrS7g-21wajGx4Q2OEol_0 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10997016124686193718', time=2024-09-12T20:43:07.851594+0000, chain.objs.size()=1 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nvbsASnQd92722IIX0RQ4Op-7G9xQ5h_0 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4131027517019006850', time=2024-09-12T20:43:08.371190+0000, chain.objs.size()=1 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.dtmvJYiS_RPKNeWGcPAbEYTwFcmUL56_0 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1650041553163142117', time=2024-09-12T20:43:08.373413+0000, chain.objs.size()=1 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yrIvWmKmZwrKl-AOiUTPFhlMy915Vrr_0 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15186881168360173091', time=2024-09-12T20:43:08.737253+0000, chain.objs.size()=1 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.8HxoJ0si2fh_RcpVIQGxuXyacIwZS0O_0 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2406440042621376573', time=2024-09-12T20:43:08.811240+0000, chain.objs.size()=1 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YRn_Pv7vCT24PMhb9rclygSGaGpxWXK_0 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10231610464272422596', time=2024-09-12T20:43:10.052557+0000, chain.objs.size()=1 2024-09-12T19:29:41.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EupsZHMx7fYranyUSxTPmUNoA69NMLX_0 2024-09-12T19:29:41.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2031397312170796929', time=2024-09-12T20:43:11.248614+0000, chain.objs.size()=1 2024-09-12T19:29:41.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.543+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VxqFN8tlNAN6epybfzDr2JKqxfYOMa1_0 2024-09-12T19:29:41.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.547+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7983057412355851124', time=2024-09-12T20:43:11.541835+0000, chain.objs.size()=1 2024-09-12T19:29:41.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.547+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zqAH9WgjTdbBViwwBEtEdu2bOHWR6nB_0 2024-09-12T19:29:41.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.547+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2485903355490956154', time=2024-09-12T20:43:11.915133+0000, chain.objs.size()=1 2024-09-12T19:29:41.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.547+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.8fxq_RkNN-GPjbz8dgp6lkFfygVNzI7_0 2024-09-12T19:29:41.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.547+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3105533309275451174', time=2024-09-12T20:43:12.731143+0000, chain.objs.size()=1 2024-09-12T19:29:41.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.547+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TH_XOLcpCPYEItO12UIRMOstWJzd98v_0 2024-09-12T19:29:41.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2000124695454644196', time=2024-09-12T20:43:15.034131+0000, chain.objs.size()=1 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.hS1yg6vEvRmZoMLlxe-om3ahKIVCRtf_0 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5392705591990845312', time=2024-09-12T20:43:15.441082+0000, chain.objs.size()=1 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gA1o7GbU0OKrJSHTY0knUAz166q65O4_0 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16203224236717789369', time=2024-09-12T20:43:15.814163+0000, chain.objs.size()=1 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._i6S_ei8quh2VlKMY2XyQAVlnXdHx29_0 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10155724732537710071', time=2024-09-12T20:43:17.565450+0000, chain.objs.size()=1 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.mZpR7K6m8dXct142JpuJyEJxvRyqoe1_0 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9117639931502484900', time=2024-09-12T20:43:18.047677+0000, chain.objs.size()=1 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KlskxjoVPGo7tdfissRfiUr2sHhxvml_0 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7193279273226882625', time=2024-09-12T20:43:19.149352+0000, chain.objs.size()=1 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.oITwa2A7IDMjJI1I4_gz0OhHnO2yZRC_0 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2964383988642364110', time=2024-09-12T20:43:19.606470+0000, chain.objs.size()=1 2024-09-12T19:29:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.g9AGwmsXWTpDtb9F9hKNLX43R3CgHST_0 2024-09-12T19:29:41.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15813427645574096663', time=2024-09-12T20:43:19.962154+0000, chain.objs.size()=1 2024-09-12T19:29:41.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.UByuYbXiCvxuHrrZBye8QzmdoxX840R_0 2024-09-12T19:29:41.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9520565004671378141', time=2024-09-12T20:43:19.964189+0000, chain.objs.size()=1 2024-09-12T19:29:41.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-BFSF1Pc-NaFhwOM9e-ttnk8lR1wFuf_0 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.842431042721468888', time=2024-09-12T20:43:20.010458+0000, chain.objs.size()=1 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7VCoqJVSd3gY8KgTHGr0nQwKeeneKz6_0 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9862308614570693983', time=2024-09-12T20:43:21.244825+0000, chain.objs.size()=1 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0TULTQSMd_kgwLC3bNAMR3EaJsgGWt-_0 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9797712644908182602', time=2024-09-12T20:43:21.333719+0000, chain.objs.size()=1 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0HlFOVs6fOa4oIqFCHEkFFqk4gzTmp-_0 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5157034945158356344', time=2024-09-12T20:43:21.621999+0000, chain.objs.size()=1 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VX5HsdRynsnMiJrFcQB6sP3w7G9tWBg_0 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3563678796776060638', time=2024-09-12T20:43:23.135413+0000, chain.objs.size()=1 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-PVRSkalBsDgrSDriAnTMXtKEVIgwyH_0 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13544924426117951909', time=2024-09-12T20:43:24.521223+0000, chain.objs.size()=1 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YoPZ6perhCQNUqljbRBAQw5l55lxLxi_0 2024-09-12T19:29:41.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8193864642542066032', time=2024-09-12T20:43:25.476553+0000, chain.objs.size()=1 2024-09-12T19:29:41.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.o14Hc328ZgL0O98zdbEbEmiciwNNLLl_0 2024-09-12T19:29:41.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14028333512679301496', time=2024-09-12T20:43:26.124602+0000, chain.objs.size()=1 2024-09-12T19:29:41.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zuelyP_xaOCY_jLT5MQrL9-OrjpBH1I_0 2024-09-12T19:29:41.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12416676672527978567', time=2024-09-12T20:43:28.678534+0000, chain.objs.size()=1 2024-09-12T19:29:41.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.km8JWvaE3ebv9ms-OCHzjf3bufV4nRF_0 2024-09-12T19:29:41.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15373982295664291493', time=2024-09-12T20:43:29.122362+0000, chain.objs.size()=1 2024-09-12T19:29:41.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.551+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.e7s7Z2W1KiRxOUwjmiWkYccAf891GLP_0 2024-09-12T19:29:41.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9764066172601130603', time=2024-09-12T20:43:29.352274+0000, chain.objs.size()=1 2024-09-12T19:29:41.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.XZGMNb6AjHyb4EkJVHnUv5ckRwURW2C_0 2024-09-12T19:29:41.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10701052948774242555', time=2024-09-12T20:43:30.045492+0000, chain.objs.size()=1 2024-09-12T19:29:41.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Twx93J_4ZzlXWeM0-aR6yxv3rPy0YRe_0 2024-09-12T19:29:41.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8009479821988601347', time=2024-09-12T20:45:10.924050+0000, chain.objs.size()=1 2024-09-12T19:29:41.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.j1SupVzlbWsxABNidN-kYi9DSF8xxID_0 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10938970336350800007', time=2024-09-12T20:45:11.171728+0000, chain.objs.size()=1 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nrASHBgwLwqHTd1hZu0EoTwVobxnH26_0 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8543048733768852437', time=2024-09-12T20:45:11.512976+0000, chain.objs.size()=1 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pHuWTNwcFQ-VeAij83J3FKccKdbcDx7_0 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6941742961766669405', time=2024-09-12T20:45:11.830109+0000, chain.objs.size()=1 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.S1SeCMxGTb2xEH7MccB7SQhEpW0NHNN_0 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15369579316287745304', time=2024-09-12T20:45:12.380003+0000, chain.objs.size()=1 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Do3LyGVl-e_slBzvGd965UhqIADTMq4_0 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6631937990079032422', time=2024-09-12T20:45:12.679284+0000, chain.objs.size()=1 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PHM6pkzTpdnjqvRyhrrzxATnpDsHEl-_0 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16128690957818468020', time=2024-09-12T20:45:12.913335+0000, chain.objs.size()=1 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Wq60AYZmG2J5_Bes3FHPA5geyg_8baH_0 2024-09-12T19:29:41.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11599809361383077434', time=2024-09-12T20:45:15.147839+0000, chain.objs.size()=1 2024-09-12T19:29:41.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.n-i1YSEzCHfsgIwKwoRDafI0G4QuI1U_0 2024-09-12T19:29:41.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11608036446356526879', time=2024-09-12T20:45:15.202404+0000, chain.objs.size()=1 2024-09-12T19:29:41.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1zSZyKx4cpdyI4SoLusIlBvmp_X7Yef_0 2024-09-12T19:29:41.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7447755096192333023', time=2024-09-12T20:45:17.172975+0000, chain.objs.size()=1 2024-09-12T19:29:41.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.tXZpz7q3FYzK3kh1ni94HxoVQrlgBvM_0 2024-09-12T19:29:41.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13474886323084624945', time=2024-09-12T20:45:18.410971+0000, chain.objs.size()=1 2024-09-12T19:29:41.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._sd_mpbSsHGFSgialJT34uX835iB4SK_0 2024-09-12T19:29:41.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7716547660428689239', time=2024-09-12T20:45:18.826066+0000, chain.objs.size()=1 2024-09-12T19:29:41.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.AtKeHub7StxYUjkM-ODUb1f3oHvteUx_0 2024-09-12T19:29:41.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13298673532035496144', time=2024-09-12T20:45:18.828447+0000, chain.objs.size()=1 2024-09-12T19:29:41.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ZOllupzoOM2I6KB6_iQCKsmReinnITj_0 2024-09-12T19:29:41.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2805743944691157345', time=2024-09-12T20:45:19.526811+0000, chain.objs.size()=1 2024-09-12T19:29:41.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.JbRzmgbkXIG0GaBu7KQiSiJ9uGNSfF6_0 2024-09-12T19:29:41.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3594142312631488861', time=2024-09-12T20:45:19.991495+0000, chain.objs.size()=1 2024-09-12T19:29:41.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.70gJXxOkDEwIEOhaDxvuAegsnWMCNg2_0 2024-09-12T19:29:41.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13425582513021310577', time=2024-09-12T20:45:20.386921+0000, chain.objs.size()=1 2024-09-12T19:29:41.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.HUNO0u3hNUbNKglY5PnXGY2fjpBu-pF_0 2024-09-12T19:29:41.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17808460080579228489', time=2024-09-12T20:45:22.212518+0000, chain.objs.size()=1 2024-09-12T19:29:41.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.555+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.O2mZb2R_cOlxdmx9bY_M2h2MPofNWd5_0 2024-09-12T19:29:41.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.559+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46767 2024-09-12T19:29:41.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T19:29:41.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14971572616161667312', time=2024-09-12T20:45:22.706656+0000, chain.objs.size()=1 2024-09-12T19:29:41.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zsap-l6C7-sjMcEKTfI5vJPo5BzbGXW_0 2024-09-12T19:29:41.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3920566689393396719', time=2024-09-12T20:45:22.849379+0000, chain.objs.size()=1 2024-09-12T19:29:41.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.q86LIN55BdumibSrMAIr31ALRyy0CUR_0 2024-09-12T19:29:41.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10168433283734278755', time=2024-09-12T20:45:22.931830+0000, chain.objs.size()=1 2024-09-12T19:29:41.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kovyyBl8B6YUEBZjDn5yaxmieLQG8N9_0 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9100425999517769175', time=2024-09-12T20:45:23.460810+0000, chain.objs.size()=1 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.818ejFYoYxpV9bPD3cL8jiMzO2UN-pb_0 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8729027145688574762', time=2024-09-12T20:45:24.738689+0000, chain.objs.size()=1 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.457TRF3DeFyIE5Y9pNJt5CfouHxeb5O_0 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14688507246366206817', time=2024-09-12T20:45:26.425941+0000, chain.objs.size()=1 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uaNVXu8f9O0jgxgv6hVbabCCVJC1UTM_0 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4460669592494850312', time=2024-09-12T20:45:27.343947+0000, chain.objs.size()=1 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.O7lb9_pHTFUHXOghRMS3fd5pdw2sBGI_0 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3532825516030897468', time=2024-09-12T20:45:30.123998+0000, chain.objs.size()=1 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.14dvtWP-Yq2eZbNZtJMGrlhxsNw8DLv_0 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9622602505146700693', time=2024-09-12T20:45:31.593568+0000, chain.objs.size()=1 2024-09-12T19:29:41.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MImJAxh2rmaU1KQIYIJx5zhoC_h5ikY_0 2024-09-12T19:29:41.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2983642723313534111', time=2024-09-12T20:45:34.010892+0000, chain.objs.size()=1 2024-09-12T19:29:41.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xni9UALo_9wQ2qkWiklNuGEzNHqUG6__0 2024-09-12T19:29:41.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4109935364573472722', time=2024-09-12T20:45:35.218927+0000, chain.objs.size()=1 2024-09-12T19:29:41.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.yW7U8AXxO40cD8D9Hn_NAFs7TEBz-jx_0 2024-09-12T19:29:41.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11837737314661863646', time=2024-09-12T20:45:38.242773+0000, chain.objs.size()=1 2024-09-12T19:29:41.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pdv-lMbBGFo2i79JMoayYgjGzTvq-Nz_0 2024-09-12T19:29:41.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12792796681548369714', time=2024-09-12T20:45:58.081233+0000, chain.objs.size()=1 2024-09-12T19:29:41.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.334__shadow_.xszNJebo4d9ne_VorOfKUy0vX2GCVOd_0 2024-09-12T19:29:41.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2120100026694934208', time=2024-09-12T20:47:35.224704+0000, chain.objs.size()=1 2024-09-12T19:29:41.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.563+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.384__shadow_.LCgb4diLIijhu5VSoDRDr-f9bEK7RWW_0 2024-09-12T19:29:41.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15906070250329561146', time=2024-09-12T20:49:38.011013+0000, chain.objs.size()=1 2024-09-12T19:29:41.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.444__shadow_.146GAODxamkWGDmpI6MFvLcPImtlNOA_0 2024-09-12T19:29:41.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7179066894035508054', time=2024-09-12T20:51:43.074332+0000, chain.objs.size()=1 2024-09-12T19:29:41.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.500__shadow_.shTky98hSSLCNHGANs9dnRi2Rul-WfF_0 2024-09-12T19:29:41.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6320595247004429434', time=2024-09-12T21:02:04.147858+0000, chain.objs.size()=2 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.555__shadow_.7HsdWofHUsA3Czda8JuZDYMbBE38rgc_0 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.555__shadow_.7HsdWofHUsA3Czda8JuZDYMbBE38rgc_1 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7908422234560018119', time=2024-09-12T21:03:09.801306+0000, chain.objs.size()=1 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:kqL8N.CHCR5Pl1bhgNqAo63oR.TQU-F_.y6e30_MbC8jgYKFQegMKNjYfX737cKp_0 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18311725138867747806', time=2024-09-12T21:03:48.826300+0000, chain.objs.size()=1 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.574__shadow:b.ncK4rNxns40nAn0-6BH4Ng1Gczw7f_.ZF0Xh7zMWp1-NsvveNOnoLIbV9HGwCT_0 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8805622798123073639', time=2024-09-12T21:04:26.648466+0000, chain.objs.size()=1 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:jKvhnuLQ72TSH4xPg1yiaGYIDHuLEdQ_.ZJknlt09fskB_O8PQI6RJXCJO56fMmi_0 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16649503691137120598', time=2024-09-12T21:04:32.366682+0000, chain.objs.size()=1 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:laKoNo0ga5SaqNXXwdw5TrGmWDMSSZs_.29pHPZADxd4QqlFboUw1suNpFjbZnPJ_0 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.899716907956511789', time=2024-09-12T21:05:54.420122+0000, chain.objs.size()=1 2024-09-12T19:29:41.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.579__shadow:QhHdFrW3pFRZrQVy9HU0XJFqZhdCmmr_.7RiOjalTf_LAZU7eWw3POelPCvbpkLU_0 2024-09-12T19:29:41.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13093601328511897389', time=2024-09-12T21:06:00.533098+0000, chain.objs.size()=1 2024-09-12T19:29:41.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.580__shadow:4SZ6RDLu00hxrTr8cO80g6K2pTDZgZY_.0zVEa9BDmkWsauEydkIlLqwUDdmOj2S_0 2024-09-12T19:29:41.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14731984507592582272', time=2024-09-12T21:13:40.644118+0000, chain.objs.size()=1 2024-09-12T19:29:41.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.631__shadow_.5Y1lAZjTmieXt91pl41UtF6ASvgEjMw_0 2024-09-12T19:29:41.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2183228523397808539', time=2024-09-12T21:14:00.045676+0000, chain.objs.size()=1 2024-09-12T19:29:41.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.640__shadow_.fFDBStbfZAXVYviE9uy-0JB9rzfU8FE_0 2024-09-12T19:29:41.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.462997861411985857', time=2024-09-12T21:14:00.625372+0000, chain.objs.size()=1 2024-09-12T19:29:41.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.641__shadow_.Wo3kGU93PFoz-rbWpIQdcSq-gjo3bkJ_0 2024-09-12T19:29:41.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9473932126821646053', time=2024-09-12T21:16:39.571481+0000, chain.objs.size()=1 2024-09-12T19:29:41.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.567+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.679__shadow_.MvAjnEs1LxnWq3f05z2-5r99knyJh_R_0 2024-09-12T19:29:41.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.571+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.571+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T19:29:41.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47972' 2024-09-12T19:29:41.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_sfTBbXc5mjSG9hW2ccA328Q4kyFgST3', time=2024-09-12T20:30:13.700837+0000, chain.objs.size()=1 2024-09-12T19:29:41.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.165__shadow_.VnKUC4vBCguWv4M7QM_9q5uc9a_KoTR_0 2024-09-12T19:29:41.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.254396526511240179', time=2024-09-12T20:35:47.164987+0000, chain.objs.size()=1 2024-09-12T19:29:41.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.238__shadow_.FV-EvQxYu5EcOR75Ja820pS7VOwU5xZ_0 2024-09-12T19:29:41.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14739098502278665986', time=2024-09-12T20:35:55.676511+0000, chain.objs.size()=1 2024-09-12T19:29:41.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.242__shadow_.OFgNEbqX_YGcbakCMzke_pXj_rfF6lq_0 2024-09-12T19:29:41.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7677919908348069069', time=2024-09-12T20:36:12.415777+0000, chain.objs.size()=1 2024-09-12T19:29:41.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.248__shadow_.c3mrisRxronABZH0WE-k9RoT11YwxX4_0 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10373872288925251722', time=2024-09-12T20:38:22.852158+0000, chain.objs.size()=1 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.YZxDpqOz_a9J1iT7u_ou3MhFCj9IZmF_0 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6407180508901770641', time=2024-09-12T20:38:23.087048+0000, chain.objs.size()=1 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.W6ddIUgVFeufe7Fqk9unizrbAmfKh4h_0 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12115628949988159016', time=2024-09-12T20:38:24.780082+0000, chain.objs.size()=1 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.l64S9HcQohe7sLzjEXmu17kN7LNxaVB_0 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1564713923366156712', time=2024-09-12T20:38:24.987133+0000, chain.objs.size()=1 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.LtXEuBSj_U06fwOW0AsdNTJIkgCNNkO_0 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7750206775070908049', time=2024-09-12T20:38:27.125202+0000, chain.objs.size()=1 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.n1JqhXTWzTB0zCud9XeHhgDC7edM5v8_0 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17212099838257242686', time=2024-09-12T20:38:28.325044+0000, chain.objs.size()=1 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.d9_Xj5kg6WihLCpFEYWQ5dztCPM5wn1_0 2024-09-12T19:29:41.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11763417574617603611', time=2024-09-12T20:38:29.020946+0000, chain.objs.size()=1 2024-09-12T19:29:41.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7h6nXtQjaCJqNsJn9d3P7_ncr-qXb5v_0 2024-09-12T19:29:41.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15152442118060898770', time=2024-09-12T20:38:31.137601+0000, chain.objs.size()=1 2024-09-12T19:29:41.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rJjQ6BdO-d7UhLEDLqAbUC7TZ1WVV6z_0 2024-09-12T19:29:41.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15611658497464955709', time=2024-09-12T20:38:31.206138+0000, chain.objs.size()=1 2024-09-12T19:29:41.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.575+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Wpv-qEs3Cd2silCCTa1e7BGAxaqIZRh_0 2024-09-12T19:29:41.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8886816485252781048', time=2024-09-12T20:38:32.312229+0000, chain.objs.size()=1 2024-09-12T19:29:41.581 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.06NjN69KFHRh-wwzH6Ots8xv4alTW4Q_0 2024-09-12T19:29:41.581 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5085076963834927020', time=2024-09-12T20:38:33.940434+0000, chain.objs.size()=1 2024-09-12T19:29:41.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.H106wGJFDj7HArUq5ArOvzw9n2vGQhs_0 2024-09-12T19:29:41.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5380023562424887984', time=2024-09-12T20:38:34.038344+0000, chain.objs.size()=1 2024-09-12T19:29:41.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.BkcqJA4DnFuCEGNZjsKM_OX4HFn8v5Y_0 2024-09-12T19:29:41.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5785437247166353839', time=2024-09-12T20:38:35.124734+0000, chain.objs.size()=1 2024-09-12T19:29:41.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5pY7t-GXuGopk5IhxouQ8IShJrxdP3y_0 2024-09-12T19:29:41.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.837496602080281100', time=2024-09-12T20:38:35.547889+0000, chain.objs.size()=1 2024-09-12T19:29:41.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1u-JCJVTxMDvTCFp9Hm8iAJLJ6jefzv_0 2024-09-12T19:29:41.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9986879326195632619', time=2024-09-12T20:38:38.230313+0000, chain.objs.size()=1 2024-09-12T19:29:41.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nNPClXiwWrWUx9Yf3Zqlmc67B1Q1ImD_0 2024-09-12T19:29:41.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4030305914626330896', time=2024-09-12T20:38:39.231155+0000, chain.objs.size()=1 2024-09-12T19:29:41.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Tqq3Ersv_dmlRAUxsBDdhTIn6CxTlfK_0 2024-09-12T19:29:41.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7647038924847062199', time=2024-09-12T20:38:41.437746+0000, chain.objs.size()=1 2024-09-12T19:29:41.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.klokeNmbtsa1raSDthkPWhrtXhvfw-V_0 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5848211502931986749', time=2024-09-12T20:38:42.333575+0000, chain.objs.size()=1 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-W7UvjIzUSaK9pcOYcUBgYhXwze4TW1_0 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4293590402195444452', time=2024-09-12T20:38:42.610215+0000, chain.objs.size()=1 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qFOZjovzk3q8fGtoV07FqU00QwNiMFk_0 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16689801219310052230', time=2024-09-12T20:38:45.547784+0000, chain.objs.size()=1 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.mSvj9RIRUiLkJulIXx2_yIJJiOIBE39_0 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.380829651461642542', time=2024-09-12T20:38:45.741101+0000, chain.objs.size()=1 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5YDrW5jec0jXAKN-3yovS7JQGmXql9L_0 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15512711205044175510', time=2024-09-12T20:38:46.778878+0000, chain.objs.size()=1 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.PDXYk22h0ntg_qN7pnmRGqPQSkY0qDe_0 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17968598603101629524', time=2024-09-12T20:38:47.264882+0000, chain.objs.size()=1 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.s5vJQEJIFe6OJCwWA8D66rwKEHRkPsI_0 2024-09-12T19:29:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3908759974569631250', time=2024-09-12T20:38:47.639200+0000, chain.objs.size()=1 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GjY6YTXD9r93ykWox6cKCSHh7Auab6I_0 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3520444078545864715', time=2024-09-12T20:38:48.791570+0000, chain.objs.size()=1 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.m3GMEHn1LlJTpWwH6txWDsvjsnvXgbx_0 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9888009406068673557', time=2024-09-12T20:38:49.006022+0000, chain.objs.size()=1 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.PkrdJs1yPe8o4M9uM-OTgvi3TrkTFMd_0 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9940006703542811258', time=2024-09-12T20:38:49.447236+0000, chain.objs.size()=1 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.OYfGlRukE91uHNq_Ab4Wh1nz9C-hhTq_0 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17839366507665619309', time=2024-09-12T20:38:50.399731+0000, chain.objs.size()=1 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.579+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aoPYHKSw5R9XQzxCZFHFm86GxkSZwGY_0 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5388005093606522791', time=2024-09-12T20:38:59.423055+0000, chain.objs.size()=1 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.266__shadow_.6H_a2DXJIY85F1rcf4jGUiLlfYqgQI5_0 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1200519720954669408', time=2024-09-12T20:39:16.859515+0000, chain.objs.size()=1 2024-09-12T19:29:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.274__shadow_.hMqXahbZgTPEokGwbpvrCdZriCCjfv__0 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3954163511489958552', time=2024-09-12T20:39:25.884622+0000, chain.objs.size()=1 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.278__shadow_.JwhrOD6vvmjBm9786jSoEEI4zj_eXtC_0 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16755576405093894924', time=2024-09-12T20:39:51.438473+0000, chain.objs.size()=1 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.289__shadow_.c1kBzfmqrQoPQSXx7tQkMvXLjxzXVme_0 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16469665711015548572', time=2024-09-12T20:40:24.346983+0000, chain.objs.size()=1 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.300__shadow_.KBqkYPVqCKbWURRQ9EVZwlONfNviyJI_0 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6259504565021535317', time=2024-09-12T20:40:33.455497+0000, chain.objs.size()=1 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.304__shadow_.2XP3HuzL0Oov6wva07NWSw_B0VVcatt_0 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4534146112191205379', time=2024-09-12T20:41:14.695834+0000, chain.objs.size()=1 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.319__shadow:3ZgqOYl.XtnZsRBlWHtr38PrpmKQRNW_.RlYvnzwJotGbFdsfDSo6CevnbGlXozE_0 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7995771257141036453', time=2024-09-12T20:43:04.506086+0000, chain.objs.size()=1 2024-09-12T19:29:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.PMv8NyVIybz6Xah11a--fBJIQKsrNyh_0 2024-09-12T19:29:41.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5022028178053867143', time=2024-09-12T20:43:05.226927+0000, chain.objs.size()=1 2024-09-12T19:29:41.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.2PK7rGMruL8Y9N7e8Vvq0-hlBr_fHY2_0 2024-09-12T19:29:41.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14244712875176237536', time=2024-09-12T20:43:07.430957+0000, chain.objs.size()=1 2024-09-12T19:29:41.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.y3lIHBA092JdC3H1_i4hMHA3qbUmqam_0 2024-09-12T19:29:41.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1387146768206250371', time=2024-09-12T20:43:07.989783+0000, chain.objs.size()=1 2024-09-12T19:29:41.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KidnD9fDB3QTbP0uWCDPm8hBi_6OEKm_0 2024-09-12T19:29:41.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7980744552220335223', time=2024-09-12T20:43:10.008302+0000, chain.objs.size()=1 2024-09-12T19:29:41.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SeKPdE8VANfWUMaoHbPusp_azEqwddz_0 2024-09-12T19:29:41.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10626673473857365066', time=2024-09-12T20:43:10.009990+0000, chain.objs.size()=1 2024-09-12T19:29:41.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.MQtACxZQLQahiw0ReZ2IIa4UuZJLC2p_0 2024-09-12T19:29:41.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2316365867735338615', time=2024-09-12T20:43:10.782140+0000, chain.objs.size()=1 2024-09-12T19:29:41.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._KhngdA3ttfXKl1W2b3If-EIK121uCF_0 2024-09-12T19:29:41.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7462813910539807509', time=2024-09-12T20:43:11.131327+0000, chain.objs.size()=1 2024-09-12T19:29:41.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._66xBva4SBDyKmHtAbaSedTv2rAXD3a_0 2024-09-12T19:29:41.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5951837107909926332', time=2024-09-12T20:43:11.456517+0000, chain.objs.size()=1 2024-09-12T19:29:41.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ZE5ftf3CSsenu3Y7hGi4fEF85XhGI6T_0 2024-09-12T19:29:41.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6693920979975202987', time=2024-09-12T20:43:11.603495+0000, chain.objs.size()=1 2024-09-12T19:29:41.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.583+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.y_6X_FeUFZcFMHBYP2yigYzlWuC7tFS_0 2024-09-12T19:29:41.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6688743571132745973', time=2024-09-12T20:43:12.297398+0000, chain.objs.size()=1 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.V1D9tLmkyJXmdbbVEaOQhjjFThqLU_d_0 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14230172699368199786', time=2024-09-12T20:43:12.575311+0000, chain.objs.size()=1 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.oQnxEvgqHCozqURp3pEJI4fIdiALxZk_0 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14053432729170332668', time=2024-09-12T20:43:12.692858+0000, chain.objs.size()=1 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Wl5LHJgE0vWW3aU48zrjf0aU-2cryHi_0 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6476596667886369304', time=2024-09-12T20:43:13.659457+0000, chain.objs.size()=1 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0FQo893VyBDwh6em7VZgttwZZ9f8Fbx_0 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16316395047414810656', time=2024-09-12T20:43:14.753565+0000, chain.objs.size()=1 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Wf-xEhqHusJUUjYtxm6gWXi_CWArg54_0 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9946596169095715657', time=2024-09-12T20:43:15.217493+0000, chain.objs.size()=1 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Y-2B6EqV-oFOCS5dRf4rStQbabflfPW_0 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10464925221502802096', time=2024-09-12T20:43:15.637738+0000, chain.objs.size()=1 2024-09-12T19:29:41.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9TCmoB4cdxXb5WGQ1106VIpWhOiYbZR_0 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12102886373794429806', time=2024-09-12T20:43:15.979606+0000, chain.objs.size()=1 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Eptttgdd6wDGfIzvzIy9heDo3o2iEcQ_0 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4523355916706934684', time=2024-09-12T20:43:16.133025+0000, chain.objs.size()=1 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.D56ikI6lOZPz8zKFlub0B-cUKD29-7h_0 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18204305405251745200', time=2024-09-12T20:43:18.556567+0000, chain.objs.size()=1 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Dx14-pZ8seB8UfCzmRqELYmx8-FUL3C_0 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3999625380965107499', time=2024-09-12T20:43:19.704250+0000, chain.objs.size()=1 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._n-WOhLL157RstTUYT3jrPaLpzlCoob_0 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12868438553869125018', time=2024-09-12T20:43:21.248410+0000, chain.objs.size()=1 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.OSfaySoCmWTjxyaCpZAbUqgUqKKwGgG_0 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.926168141340342178', time=2024-09-12T20:43:21.664294+0000, chain.objs.size()=1 2024-09-12T19:29:41.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zHtG0GaTfaDwMZaujavGFIxm75Sitz-_0 2024-09-12T19:29:41.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16145943566286325469', time=2024-09-12T20:43:21.750709+0000, chain.objs.size()=1 2024-09-12T19:29:41.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.LUEJWiZEdCvs9nG414GitLTeeZcUzcf_0 2024-09-12T19:29:41.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5651837367738721652', time=2024-09-12T20:43:22.546660+0000, chain.objs.size()=1 2024-09-12T19:29:41.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Oy-6qD28Jpv0Qm0NxtXOVWGe7IHz4or_0 2024-09-12T19:29:41.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12415947228901573992', time=2024-09-12T20:43:23.248733+0000, chain.objs.size()=1 2024-09-12T19:29:41.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.587+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.v99HrdGz2To9p5SjxRJc-sf006mEQDG_0 2024-09-12T19:29:41.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12401891396050721762', time=2024-09-12T20:43:26.699960+0000, chain.objs.size()=1 2024-09-12T19:29:41.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7C8b6wKjDjISyr0_6qtCxqP5D_i4yE2_0 2024-09-12T19:29:41.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3125955767999684546', time=2024-09-12T20:43:27.140371+0000, chain.objs.size()=1 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EiRJxyo8s66kkn1kR06nKoCtTlW5hom_0 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.171431458600254907', time=2024-09-12T20:45:10.720756+0000, chain.objs.size()=1 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.-9qwscr4csisPCISVDCg-mi5LL4btgF_0 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3311821726058168720', time=2024-09-12T20:45:10.793386+0000, chain.objs.size()=1 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.iwhBGJkQN3m4YRTnyoZ_J_Rx52ua1VR_0 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16199998536417149081', time=2024-09-12T20:45:11.084370+0000, chain.objs.size()=1 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.KdgIuJDooA8l5AiuP0Yx2d0EDeFh-Y-_0 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.276201191689607430', time=2024-09-12T20:45:12.983378+0000, chain.objs.size()=1 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.vmdN-GrLpOG_PHzueEQ6NYaurg1shZB_0 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16246027068984365203', time=2024-09-12T20:45:13.010851+0000, chain.objs.size()=1 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.35NxbwC3YvmJCxoqEoUVZ77nciq34sf_0 2024-09-12T19:29:41.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14949625657603267475', time=2024-09-12T20:45:15.579812+0000, chain.objs.size()=1 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.sRk2BvG3Oi4YSUo9pbhA-LlNqPMtUfE_0 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16737728105770330293', time=2024-09-12T20:45:15.809344+0000, chain.objs.size()=1 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._pcJQWxGixbIulLAYr-jglp2pqTvu8w_0 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13477396914324367627', time=2024-09-12T20:45:16.483372+0000, chain.objs.size()=1 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uE6JxDK7gKHmOF-nkX8cjIG7ttPxWCo_0 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8006024094324421611', time=2024-09-12T20:45:17.046867+0000, chain.objs.size()=1 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FNPBMSoKaQmQ2Ua46WluWOk5p-5yd4T_0 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5165382204257155669', time=2024-09-12T20:45:17.432910+0000, chain.objs.size()=1 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qldhtdaghHOwHF7Ip01lZlKInhKHsTJ_0 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8041909831926465201', time=2024-09-12T20:45:19.379585+0000, chain.objs.size()=1 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.JF8KIXiPT3uZNIXfqWTCvlu3LFxe0LK_0 2024-09-12T19:29:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10482895554687125711', time=2024-09-12T20:45:19.603039+0000, chain.objs.size()=1 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.c9-rnDAaRFuW-Dvd_3q_I291N5oPa7k_0 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8366108378156198630', time=2024-09-12T20:45:21.075046+0000, chain.objs.size()=1 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.unEW2UXyf2bVJvnEKBAEPzi1xTQo9RB_0 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14772675668303598316', time=2024-09-12T20:45:23.397029+0000, chain.objs.size()=1 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nQHwNPgfxbSU2yQuG94098OZYtKJvqC_0 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8214096959428656719', time=2024-09-12T20:45:26.062335+0000, chain.objs.size()=1 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.sgKA28OMFWfgEyW_hvobn42sJPRIQ2N_0 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10540878034709164982', time=2024-09-12T20:45:27.202279+0000, chain.objs.size()=1 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.NKYlYRlzVQqWaivKVAHuARoEX3G-WNH_0 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16700939013512680023', time=2024-09-12T20:45:27.867037+0000, chain.objs.size()=1 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hXNYDjzHLksHtdo_n31W-faAqTu3aIG_0 2024-09-12T19:29:41.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1110756534199265804', time=2024-09-12T20:45:30.241131+0000, chain.objs.size()=1 2024-09-12T19:29:41.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.591+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.LfCdb_g32T5d4T85O_6Jcjifj8en6MY_0 2024-09-12T19:29:41.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.558890759643278384', time=2024-09-12T20:45:30.540264+0000, chain.objs.size()=1 2024-09-12T19:29:41.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.S90DyrM6d4mSYxAi1ia8xEDwUYsupdk_0 2024-09-12T19:29:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11157669918467321185', time=2024-09-12T20:45:30.973366+0000, chain.objs.size()=1 2024-09-12T19:29:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6UeNPAoVrVig6yXTj7xEPjmNxnEp_OF_0 2024-09-12T19:29:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12146788930305551899', time=2024-09-12T20:45:31.048850+0000, chain.objs.size()=1 2024-09-12T19:29:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.NAnkUji-PjYyW9D-2fqfxTs_-FWUACP_0 2024-09-12T19:29:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8657316683119874571', time=2024-09-12T20:45:31.477350+0000, chain.objs.size()=1 2024-09-12T19:29:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5mn5jQ-s7I1wRh1otYJMmFIaUYAa02r_0 2024-09-12T19:29:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16347390247874927590', time=2024-09-12T20:45:31.755754+0000, chain.objs.size()=1 2024-09-12T19:29:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._5nlDd-x1tCDorFlMktHzxSoidH-Wxh_0 2024-09-12T19:29:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13496877659739886027', time=2024-09-12T20:45:34.663399+0000, chain.objs.size()=1 2024-09-12T19:29:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._Y9Z-C3w9Pi1xiTX1ySWg1fZbQ5W1-l_0 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8387748136774780011', time=2024-09-12T20:45:34.732029+0000, chain.objs.size()=1 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ByHb6Uq90oEdda6gl9mRc-oDM0nkpTZ_0 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15696202940289182955', time=2024-09-12T20:45:36.643967+0000, chain.objs.size()=1 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lo0ea_HT1dIYuRotKcNomcwDRg-zJU5_0 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10399772164452743467', time=2024-09-12T20:45:37.507312+0000, chain.objs.size()=1 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ZaA3R4IPelmK3ZcYFsqBjM21Kl16-97_0 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9347989903294812672', time=2024-09-12T20:45:37.578533+0000, chain.objs.size()=1 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.a422CvrjZiIun5GkHAp59WK6Wo544KB_0 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3041823226499861771', time=2024-09-12T20:45:37.705891+0000, chain.objs.size()=1 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.780GpmKhWGm_XNQXOX-dATThVEl9GsY_0 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1738174482129553559', time=2024-09-12T20:45:37.989479+0000, chain.objs.size()=1 2024-09-12T19:29:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.HoXQNF2GfmJb3ofLfRk1vq-HPc3XX9K_0 2024-09-12T19:29:41.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18197974168038329045', time=2024-09-12T20:50:09.710653+0000, chain.objs.size()=1 2024-09-12T19:29:41.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.595+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.457__shadow_.Nsej-hc94-2bc4EZvwq12p10OIgoScm_0 2024-09-12T19:29:41.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.599+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3491693293086825666', time=2024-09-12T20:50:15.675465+0000, chain.objs.size()=1 2024-09-12T19:29:41.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.599+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.459__shadow_.byrpPz901ou6qlTRixFZCJ4CvLmpmxE_0 2024-09-12T19:29:41.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.599+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6686583142726884465', time=2024-09-12T20:50:33.404938+0000, chain.objs.size()=1 2024-09-12T19:29:41.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.599+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.465__shadow_.vM6R6FLsLLVt52qsiLirXuLjU4xwVIB_0 2024-09-12T19:29:41.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.599+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47972 2024-09-12T19:29:41.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T19:29:41.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9127484389262208507', time=2024-09-12T20:51:15.855826+0000, chain.objs.size()=1 2024-09-12T19:29:41.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.486__shadow_.SEw5CruBn4w1ZiulF7TViLYK9eWK71F_0 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1215491565828781494', time=2024-09-12T20:51:20.269079+0000, chain.objs.size()=1 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.488__shadow_.AV9nIHAICXLnflhO2W33w_OqhVzodvw_0 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11586946164383887314', time=2024-09-12T20:58:02.596617+0000, chain.objs.size()=12 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.fl88amKF9CDzaHQe4q3ZalzOTuf-f_hV.1 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.fl88amKF9CDzaHQe4q3ZalzOTuf-f_hV.1_1 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.ldHqOtgNc8PMQjp23vTd4jA37ZRFLvCS.2 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.ldHqOtgNc8PMQjp23vTd4jA37ZRFLvCS.2_1 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.lzXXFnxCTdl-7ltmZF6MLjjiSTJ3wgE4.3 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.lzXXFnxCTdl-7ltmZF6MLjjiSTJ3wgE4.3_1 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.AlUSHsHnOM8D69Lnplu-ms_4gnuzyecv.4 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.AlUSHsHnOM8D69Lnplu-ms_4gnuzyecv.4_1 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.8KQTUNzcMpoKj9Z4RuWXY9Xyr3PSDNBa.5 2024-09-12T19:29:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.8KQTUNzcMpoKj9Z4RuWXY9Xyr3PSDNBa.5_1 2024-09-12T19:29:41.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.603+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.FgTICo-7Vu2FcDBEeTQe6MSr0U-Qa58e.6 2024-09-12T19:29:41.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.607+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.FgTICo-7Vu2FcDBEeTQe6MSr0U-Qa58e.6_1 2024-09-12T19:29:41.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.607+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vqShAb7ZXGG8F45GcXW_XEQDw11l8ow', time=2024-09-12T20:59:48.213600+0000, chain.objs.size()=1 2024-09-12T19:29:41.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.607+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.531__multipart_mymultipart.2~vqShAb7ZXGG8F45GcXW_XEQDw11l8ow.1 2024-09-12T19:29:41.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.607+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1007713730779297691', time=2024-09-12T21:06:59.378571+0000, chain.objs.size()=1 2024-09-12T19:29:41.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.607+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.607__shadow_.W3SGXKQwfQNjjM5JSM7HEMrVnGw-eli_0 2024-09-12T19:29:41.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.607+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17297998232872160496', time=2024-09-12T21:16:12.817083+0000, chain.objs.size()=1 2024-09-12T19:29:41.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.607+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.665__shadow_.xfN5ZbyvWdDB7ebep3qIJU7H5eAMpLY_0 2024-09-12T19:29:41.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.607+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2484258155393812018', time=2024-09-12T21:17:46.011090+0000, chain.objs.size()=1 2024-09-12T19:29:41.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.607+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.713__shadow:07Pv3gsLD.OUg7L80-L-Fh3lDPgVk.O_.qc6orqgQyDd4T2VSF_TEKg-nPwDSLUy_0 2024-09-12T19:29:41.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.607+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T19:29:41.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47801' 2024-09-12T19:29:41.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4042164523798543110', time=2024-09-12T20:28:01.136016+0000, chain.objs.size()=1 2024-09-12T19:29:41.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.147__shadow_.ovSkFyx2TeGY8jmjUhih8h_LaWURKfT_0 2024-09-12T19:29:41.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17037492327419337204', time=2024-09-12T20:28:32.589976+0000, chain.objs.size()=3 2024-09-12T19:29:41.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.158__shadow_.uy_DgLirthFNOa3uhTlkwXubg7jWrhP_0 2024-09-12T19:29:41.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.158__shadow_.uy_DgLirthFNOa3uhTlkwXubg7jWrhP_1 2024-09-12T19:29:41.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.158__shadow_.uy_DgLirthFNOa3uhTlkwXubg7jWrhP_2 2024-09-12T19:29:41.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_UJWEipdHnsAlln6yXRi4KkLFhqgDilB', time=2024-09-12T20:29:18.440942+0000, chain.objs.size()=3 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.HyYIj1IC_hvsNZZTgo3p_wSg7oFMdjh_0 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.HyYIj1IC_hvsNZZTgo3p_wSg7oFMdjh_1 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.HyYIj1IC_hvsNZZTgo3p_wSg7oFMdjh_2 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_IiuB9qTHFE_QprwotDt9vppF7ei3lME', time=2024-09-12T20:29:54.075886+0000, chain.objs.size()=1 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.NVcpnr8fLFlyxH9VpL6Tmyj6Al0UjDR_0 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16085793919002003176', time=2024-09-12T20:30:03.098220+0000, chain.objs.size()=1 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.162__shadow_.N3nDkPYbJ2OXimqs9xoF_j7xFKuRNor_0 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14902022133171233952', time=2024-09-12T20:30:55.563597+0000, chain.objs.size()=1 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.181__shadow_.NVUlJxoemH77VuVmHRY3xD1wAoQC2Fc_0 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7002460036653236947', time=2024-09-12T20:30:57.421901+0000, chain.objs.size()=1 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.182__shadow_.7czJsRr3jfR8lA9rIEr4mgbTpcSS4NI_0 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6120745448900279402', time=2024-09-12T20:35:43.389348+0000, chain.objs.size()=1 2024-09-12T19:29:41.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.611+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.237__shadow_.gH-YdJOJs1On1rjzj5aSECiQWXVpraV_0 2024-09-12T19:29:41.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15452236269423702336', time=2024-09-12T20:36:03.363620+0000, chain.objs.size()=1 2024-09-12T19:29:41.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.244__shadow_.ojW1KjeoPsZvfncZcE5yJt_HjhfUY3g_0 2024-09-12T19:29:41.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9888280856568450922', time=2024-09-12T20:36:16.975718+0000, chain.objs.size()=1 2024-09-12T19:29:41.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.250__shadow_.1fzy9oPxDuVS0CJn7fUkSYGWv0T28UY_0 2024-09-12T19:29:41.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16598115360366456913', time=2024-09-12T20:38:22.830114+0000, chain.objs.size()=1 2024-09-12T19:29:41.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.OFCTTX8JQfv1S6Rm5YGFekCjW0QdPuq_0 2024-09-12T19:29:41.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17785871474655444076', time=2024-09-12T20:38:23.139111+0000, chain.objs.size()=1 2024-09-12T19:29:41.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Gz-VUzr9b6iqTrRu7QhlYSqY4g7sxmT_0 2024-09-12T19:29:41.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4180795191475186930', time=2024-09-12T20:38:23.929174+0000, chain.objs.size()=1 2024-09-12T19:29:41.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.34hhp0mmwynzvSDh97duvYclRo87BrE_0 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11637158253321347091', time=2024-09-12T20:38:25.261440+0000, chain.objs.size()=1 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.eYqKblHszjvYxsx4RfeQS-QJzN4DZ6y_0 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16460280322280195934', time=2024-09-12T20:38:27.897096+0000, chain.objs.size()=1 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._9Y9e6OdDNO0eb53ktaWG7RiL41ZkoA_0 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5710144786054337965', time=2024-09-12T20:38:27.899408+0000, chain.objs.size()=1 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.YwdXyII17h11jS7jDiPAG3g7haDB-ro_0 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11990539943423856124', time=2024-09-12T20:38:31.464242+0000, chain.objs.size()=1 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.BEJiuMoD647ZDvJ1XGpVcGOvsjNnZz1_0 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.341858537681075849', time=2024-09-12T20:38:31.566475+0000, chain.objs.size()=1 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9X0sRXKN106Qedi-CAbBsXlSv-8UyrJ_0 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12456125600864370466', time=2024-09-12T20:38:31.669786+0000, chain.objs.size()=1 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.cz8IM87mDA_kgtacgpXwPfcTr-7Rhgn_0 2024-09-12T19:29:41.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16134799872899970091', time=2024-09-12T20:38:32.987014+0000, chain.objs.size()=1 2024-09-12T19:29:41.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.615+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.oWzQcNmVQ_1XPly6Dy43I3PqMCQ_KRX_0 2024-09-12T19:29:41.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5086622614401055082', time=2024-09-12T20:38:35.062850+0000, chain.objs.size()=1 2024-09-12T19:29:41.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.2JzLE4XuLfNJGADAsfBqorDSAoKUQHs_0 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17265200177864126531', time=2024-09-12T20:38:37.683396+0000, chain.objs.size()=1 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.UzmtogPmRY-j-F_DkXTSGPwpwXGlD0r_0 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2301695282814791987', time=2024-09-12T20:38:37.860249+0000, chain.objs.size()=1 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lzv9ZgwJ0Ut79clss9Y0bg2-vfcxrA6_0 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11878217279440812599', time=2024-09-12T20:38:38.163447+0000, chain.objs.size()=1 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.xtTrwEksl1tgG84AMQKh6JytPA_IrNY_0 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15833155637011769859', time=2024-09-12T20:38:39.010043+0000, chain.objs.size()=1 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.b0qnZ4On-cOHbgJ1kN7RUkgvoKtws5t_0 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2565558599066055769', time=2024-09-12T20:38:40.460185+0000, chain.objs.size()=1 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.HFRl2aNo3J_bAYHUaBKOEsEaUeUlJTt_0 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7715650782634448807', time=2024-09-12T20:38:40.461702+0000, chain.objs.size()=1 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.IX07pPFvD3FcMmjsXewTOWI8R5h9IlF_0 2024-09-12T19:29:41.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11003141113808603300', time=2024-09-12T20:38:42.200030+0000, chain.objs.size()=1 2024-09-12T19:29:41.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.v-oWtoP2b7x7EueJWq9HmwGasURuoPM_0 2024-09-12T19:29:41.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6528580206325121440', time=2024-09-12T20:38:45.391733+0000, chain.objs.size()=1 2024-09-12T19:29:41.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.FAO73OI6SC0Mcl5sFLd_8W_UFE8Kt7O_0 2024-09-12T19:29:41.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10265564735671919438', time=2024-09-12T20:38:46.695070+0000, chain.objs.size()=1 2024-09-12T19:29:41.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rNWflKFl1Hm1Ng_qX2UdM-ySVhXgqxy_0 2024-09-12T19:29:41.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6048372263396732087', time=2024-09-12T20:38:46.806229+0000, chain.objs.size()=1 2024-09-12T19:29:41.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.619+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.eOUQBGRA1Me7HhnGbPtrseu11TrhcRV_0 2024-09-12T19:29:41.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9041135285842183257', time=2024-09-12T20:38:47.623617+0000, chain.objs.size()=1 2024-09-12T19:29:41.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.3TsnVg6DSz4yfGqSukkVNsdkMGqO-4P_0 2024-09-12T19:29:41.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17275890939782422420', time=2024-09-12T20:38:48.672772+0000, chain.objs.size()=1 2024-09-12T19:29:41.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.r0haTJdK0WMDOuEgBQOmeuzWXtUD7JK_0 2024-09-12T19:29:41.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3665283189360005344', time=2024-09-12T20:38:49.755077+0000, chain.objs.size()=1 2024-09-12T19:29:41.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Nth9n5ZRIAAeseT5vDSNXvsyqeItVg8_0 2024-09-12T19:29:41.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10523039622477685963', time=2024-09-12T20:38:50.344874+0000, chain.objs.size()=1 2024-09-12T19:29:41.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QJfiMUFpPks-2ZHKo7KNoQm5-fdTq_x_0 2024-09-12T19:29:41.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10927153118102318915', time=2024-09-12T20:39:10.259368+0000, chain.objs.size()=1 2024-09-12T19:29:41.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.271__shadow_.aw7uoAvnriJCzBnmJp10McI_hlRlhe0_0 2024-09-12T19:29:41.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3300940824449764211', time=2024-09-12T20:39:25.881941+0000, chain.objs.size()=1 2024-09-12T19:29:41.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.278__shadow_.OAdujlNQYKtML3iRaHYSwkFkjS8hseD_0 2024-09-12T19:29:41.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.669341123208772570', time=2024-09-12T20:39:30.452008+0000, chain.objs.size()=1 2024-09-12T19:29:41.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.280__shadow_.GjeSo-hBiXvhNsCC7LPYispIDxDczVk_0 2024-09-12T19:29:41.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15094454685902798075', time=2024-09-12T20:39:37.386726+0000, chain.objs.size()=1 2024-09-12T19:29:41.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.283__shadow_.PHzzGf0KXV0t1VeIfTpc74LgSBhdUSm_0 2024-09-12T19:29:41.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8735278435755126633', time=2024-09-12T20:40:07.852144+0000, chain.objs.size()=1 2024-09-12T19:29:41.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.-xjaJ9gODobhQ_oRCX8NNf-YUlETgsU_0 2024-09-12T19:29:41.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6534146564007141261', time=2024-09-12T20:40:14.738272+0000, chain.objs.size()=1 2024-09-12T19:29:41.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.296__shadow_.B23n5syqk0YzA54yp1roqE14EMTraYv_0 2024-09-12T19:29:41.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1841286740009172598', time=2024-09-12T20:40:38.474712+0000, chain.objs.size()=1 2024-09-12T19:29:41.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.306__shadow_.pSNLX4hZD3qxeMjonR14q-BDup74GRa_0 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10602745433245952369', time=2024-09-12T20:41:05.664569+0000, chain.objs.size()=1 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.315__shadow_.TVylIUfozC_X4Qr_r0yin10Al5t7Vr7_0 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14928719809412049715', time=2024-09-12T20:41:14.660264+0000, chain.objs.size()=1 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.319__shadow:obYtM9jg2GRqeQtomT5jm04IqpfmZy4_.E4zhiM1qwV8enPELZILT_GpbqMQ7FzG_0 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11385038077298942', time=2024-09-12T20:43:02.838907+0000, chain.objs.size()=1 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TnwlalOXkwY6w4hIcwxrEEtKzbCjqUm_0 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8283880497758285063', time=2024-09-12T20:43:03.269800+0000, chain.objs.size()=1 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vPvdQFBgm6gEc0R2Omb3XBZEcCu9c0D_0 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1646899231715106813', time=2024-09-12T20:43:03.635636+0000, chain.objs.size()=1 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eqZVwDZNsU6jZxp8j0ytTBVnGOAYvP9_0 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10678182777623530341', time=2024-09-12T20:43:04.679858+0000, chain.objs.size()=1 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pCiuKpcd15vyShy0V5HurNaBmEmc7EL_0 2024-09-12T19:29:41.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7512405951671438984', time=2024-09-12T20:43:06.536659+0000, chain.objs.size()=1 2024-09-12T19:29:41.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.BeQlSdOno0UVKFMdrN70N1V-acWYezR_0 2024-09-12T19:29:41.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13643739458280832744', time=2024-09-12T20:43:09.078381+0000, chain.objs.size()=1 2024-09-12T19:29:41.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.623+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.esHtLKC3g1zrWg8Q-XQYXcmQgjPg57z_0 2024-09-12T19:29:41.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.909105593105076588', time=2024-09-12T20:43:10.365580+0000, chain.objs.size()=1 2024-09-12T19:29:41.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.l-_NFvNKoHSRZY0gFZwc9pQxbY51Hj7_0 2024-09-12T19:29:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13118193711273498772', time=2024-09-12T20:43:10.572604+0000, chain.objs.size()=1 2024-09-12T19:29:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.s0A5c7do9qUb93jsYeEzrpKdvlyliZP_0 2024-09-12T19:29:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15973129501796852425', time=2024-09-12T20:43:10.870936+0000, chain.objs.size()=1 2024-09-12T19:29:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.uGgIY32HquG3sKvezYZ0KKZ_2O_Wrn6_0 2024-09-12T19:29:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13670116076761406842', time=2024-09-12T20:43:11.364336+0000, chain.objs.size()=1 2024-09-12T19:29:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5RSGnDqQ9wzMvZVTj9frWejj3h4a75P_0 2024-09-12T19:29:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7035517350800959790', time=2024-09-12T20:43:12.262473+0000, chain.objs.size()=1 2024-09-12T19:29:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Nb2m89Lk5puHvY__6l1sgERrHbC9e3e_0 2024-09-12T19:29:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11509972534689640007', time=2024-09-12T20:43:12.655572+0000, chain.objs.size()=1 2024-09-12T19:29:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cUb_TPTfW7xQGdb8x2iZbsmBcMSkoDT_0 2024-09-12T19:29:41.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18320798459279755037', time=2024-09-12T20:43:14.510245+0000, chain.objs.size()=1 2024-09-12T19:29:41.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yWKxy9Kb8LOW_jnKSNgkO73FJ96w0ml_0 2024-09-12T19:29:41.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7212256771238710940', time=2024-09-12T20:43:14.824614+0000, chain.objs.size()=1 2024-09-12T19:29:41.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6KwQYOCpRRr6In3BXCEO4T_dcL2-PUF_0 2024-09-12T19:29:41.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.969163597955067559', time=2024-09-12T20:43:16.055245+0000, chain.objs.size()=1 2024-09-12T19:29:41.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ZgKrFAgn6P3e0VGcvdN4Fd5uBvgamIL_0 2024-09-12T19:29:41.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5110657422292506386', time=2024-09-12T20:43:19.195786+0000, chain.objs.size()=1 2024-09-12T19:29:41.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.NmxFdfsjRvFNOS0rhq0s__YwU0rYE7w_0 2024-09-12T19:29:41.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15886316815306504000', time=2024-09-12T20:43:19.322223+0000, chain.objs.size()=1 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.v5VJSD0Db2KSKBsp5Yep5Jtn6wSl-ao_0 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5915509524237144833', time=2024-09-12T20:43:21.294157+0000, chain.objs.size()=1 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.PFVQgo2rTdRlMZie8E74o1rvEam3CPk_0 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8666929474973213091', time=2024-09-12T20:43:22.432628+0000, chain.objs.size()=1 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HBw-IOcrblvIPcENwzSlP6MOkVnUMaA_0 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16136838454277612026', time=2024-09-12T20:43:24.923852+0000, chain.objs.size()=1 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._4r650A45R4UU_advM5vhcZViXsD4ho_0 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12187206922516411372', time=2024-09-12T20:43:25.787243+0000, chain.objs.size()=1 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.khbwFYkvw-UEmt_eB2pHsQNcauDDz0m_0 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12704384727848083176', time=2024-09-12T20:43:25.964316+0000, chain.objs.size()=1 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ZfWbclxTCsP3HQprTpJ_JXhqwakCo5D_0 2024-09-12T19:29:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15659880658795036719', time=2024-09-12T20:43:26.140731+0000, chain.objs.size()=1 2024-09-12T19:29:41.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.627+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KlVEetUYN-c6_VXDhT1GTw62L6tnp3D_0 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18421332234840310252', time=2024-09-12T20:43:26.225105+0000, chain.objs.size()=1 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vis1IwUVWB64Wsi-UdoYyiWiwk1NbIU_0 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6355311556792206485', time=2024-09-12T20:43:26.936276+0000, chain.objs.size()=1 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5wkupmGbUU8MoIU2Gkc_IvI9gcLcMfU_0 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10109126611982826594', time=2024-09-12T20:43:27.872149+0000, chain.objs.size()=1 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.OMAkY9ALJz7mVTaaI19PmHhF-Uqxg9D_0 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9250527708369870488', time=2024-09-12T20:43:28.564167+0000, chain.objs.size()=1 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.UbnqMQ-c5kNhG1aqNGFEhVh14jUuJxA_0 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8498278391652126703', time=2024-09-12T20:43:28.663620+0000, chain.objs.size()=1 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7oe20lXG9LQlMQAuLJwLpaIsjSg-nd5_0 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17917726471309904773', time=2024-09-12T20:43:29.897188+0000, chain.objs.size()=1 2024-09-12T19:29:41.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.b5rt321eC5XjpJ-ZX2Bfd8zzDWEL7CV_0 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8684578909312311757', time=2024-09-12T20:43:30.049276+0000, chain.objs.size()=1 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.It7mNlu5f12ToUMjXO9S17mQ9db7sQo_0 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13695859837595950493', time=2024-09-12T20:45:10.790379+0000, chain.objs.size()=1 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.w0X949oWZR7gL6xiIV56pcAh5OEPpoN_0 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15558377501529946886', time=2024-09-12T20:45:10.839644+0000, chain.objs.size()=1 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.HxucvumaKZz-beNJ_hNlLQxPHQQOE2W_0 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7435056515840384424', time=2024-09-12T20:45:11.272758+0000, chain.objs.size()=1 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.86y0pFuqyXw_peaLG0EqyeVxUblOQGi_0 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18212992699572306157', time=2024-09-12T20:45:12.570358+0000, chain.objs.size()=1 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.aqIG34rcdx8kvCgyeTlBealXAIkDjlk_0 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13866038745081921397', time=2024-09-12T20:45:13.080425+0000, chain.objs.size()=1 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DrCoWwhHwpN9KDlPDMbgBOV2CR6lx4N_0 2024-09-12T19:29:41.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3547746804449345028', time=2024-09-12T20:45:13.198968+0000, chain.objs.size()=1 2024-09-12T19:29:41.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fGhaIpmSKBZrhQB-kksWK1hMvnlph_b_0 2024-09-12T19:29:41.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9051142502661256540', time=2024-09-12T20:45:13.515949+0000, chain.objs.size()=1 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zHjZalHPQ26AuPTso0Nemt5Lauvp25B_0 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14469352602461159968', time=2024-09-12T20:45:13.587821+0000, chain.objs.size()=1 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.rUH5EEc3kRk7HwAiTgMVjaPFP1Xjz3o_0 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16920138222347127528', time=2024-09-12T20:45:14.999924+0000, chain.objs.size()=1 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YI4wKzqdJdn9cW75ixmNsKmpZgrFzLf_0 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13885448824847533379', time=2024-09-12T20:45:15.437192+0000, chain.objs.size()=1 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xkAHvhLkXabhTuNLYPfOQirING0rffU_0 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4687167955651973257', time=2024-09-12T20:45:15.738214+0000, chain.objs.size()=1 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.TPQ_qwQQ7Dt2A988W6mLK7oRA95MaVG_0 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9713206077549444917', time=2024-09-12T20:45:17.377509+0000, chain.objs.size()=1 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lWHTgBEqs20BGf1Rv0eBHvG3iiU1xem_0 2024-09-12T19:29:41.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1084917624062134276', time=2024-09-12T20:45:18.394231+0000, chain.objs.size()=1 2024-09-12T19:29:41.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.631+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ZukTSNSVPFn_fJScqkTwUhZapzfij52_0 2024-09-12T19:29:41.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6291904604443077103', time=2024-09-12T20:45:18.491569+0000, chain.objs.size()=1 2024-09-12T19:29:41.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kgEv-LUeEcNY5rw0zYgfh8BV4PehuxH_0 2024-09-12T19:29:41.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11529553044386202975', time=2024-09-12T20:45:18.738642+0000, chain.objs.size()=1 2024-09-12T19:29:41.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zEXsIzKJHdFw_tAUG5reJXKxV7K497d_0 2024-09-12T19:29:41.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14651813286231123994', time=2024-09-12T20:45:19.629304+0000, chain.objs.size()=1 2024-09-12T19:29:41.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.tT4jjUFEV8pB5WpJ4Je-ByEtOwk-J6q_0 2024-09-12T19:29:41.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.349740328204171071', time=2024-09-12T20:45:20.090111+0000, chain.objs.size()=1 2024-09-12T19:29:41.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2vhnYXwWNVT509DDi2KczCDJ8fPUAMO_0 2024-09-12T19:29:41.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12999744668735252574', time=2024-09-12T20:45:21.073688+0000, chain.objs.size()=1 2024-09-12T19:29:41.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.vEqy9e7Ot4FTtignkJfZd5AxDxJf8s3_0 2024-09-12T19:29:41.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14421873289455327965', time=2024-09-12T20:45:22.438032+0000, chain.objs.size()=1 2024-09-12T19:29:41.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.b_i__nFM8DiE3ZRJveI5DhHWwWHVh4Z_0 2024-09-12T19:29:41.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17631201759606985337', time=2024-09-12T20:45:22.801214+0000, chain.objs.size()=1 2024-09-12T19:29:41.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ALgFSTZaVIlFs4YZsSPtR5zutfldRIv_0 2024-09-12T19:29:41.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6311776572901138037', time=2024-09-12T20:45:23.017646+0000, chain.objs.size()=1 2024-09-12T19:29:41.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dnvoT89dCbdbcRJayfssTfAcj_nSahh_0 2024-09-12T19:29:41.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11355744210441823141', time=2024-09-12T20:45:23.019268+0000, chain.objs.size()=1 2024-09-12T19:29:41.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.bkfOWDSO3UlXjNPx0k3EJW3m-MBbNi1_0 2024-09-12T19:29:41.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16360428013038441627', time=2024-09-12T20:45:23.817603+0000, chain.objs.size()=1 2024-09-12T19:29:41.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OxkBprHcR8hyWXMR_-91BY0Jz5WdeuQ_0 2024-09-12T19:29:41.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16923185080957525623', time=2024-09-12T20:45:24.228220+0000, chain.objs.size()=1 2024-09-12T19:29:41.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xp1YWxXlqyqmmr-EGhFiY3Dp1OKt7pS_0 2024-09-12T19:29:41.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1426699830987108693', time=2024-09-12T20:45:26.655376+0000, chain.objs.size()=1 2024-09-12T19:29:41.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.NTnVBKB25ST8SEhv-Eu2_emwJ035eRM_0 2024-09-12T19:29:41.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15666987590352130516', time=2024-09-12T20:45:26.982312+0000, chain.objs.size()=1 2024-09-12T19:29:41.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.635+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.H113jXlnQ2wPPjjmC9cv-1-Mu5vT_my_0 2024-09-12T19:29:41.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47801 2024-09-12T19:29:41.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1663241579165900734', time=2024-09-12T20:45:27.138142+0000, chain.objs.size()=1 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.RCOIQ-UnAJfmTBaIqfCdqKwzYSvmd55_0 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16114004940959649328', time=2024-09-12T20:45:29.921534+0000, chain.objs.size()=1 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nZb-caWz0MjE9xU1TdCwJbNDtGZaqvR_0 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9979803288580055680', time=2024-09-12T20:45:31.355053+0000, chain.objs.size()=1 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pcp_YKz5fcCcdWZtViefbhlTIyl-w_y_0 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12707174842041806050', time=2024-09-12T20:45:32.861205+0000, chain.objs.size()=1 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9gsBhUi0tfEiNXlfRgef7UvtMaCZ-Ko_0 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8595805823345813315', time=2024-09-12T20:45:33.185267+0000, chain.objs.size()=1 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.F0_6hY1V-ASoCgy-h0TTcMOiubLA29o_0 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2019814628889306132', time=2024-09-12T20:45:33.658739+0000, chain.objs.size()=1 2024-09-12T19:29:41.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WIpYnVh-i66fv2iAk4vLBJg-KCGd0Xi_0 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4677283352518781268', time=2024-09-12T20:45:33.660370+0000, chain.objs.size()=1 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wppYoFIqXxvzEU6ptPjdspCB8m_5cvK_0 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5672082118652952015', time=2024-09-12T20:45:33.915891+0000, chain.objs.size()=1 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xyJKPJVnsnNi5GBamARG8_VqVZ8D12__0 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1616904886726163665', time=2024-09-12T20:45:36.563331+0000, chain.objs.size()=1 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Dq9_MxjGm96vmIoGw6qzgWe5qAj-bAn_0 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7416335145912601319', time=2024-09-12T20:45:36.976844+0000, chain.objs.size()=1 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dppLZyRYstCpUl8rzAB99wy0tnPQ3F1_0 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10621751063513714984', time=2024-09-12T20:49:17.237987+0000, chain.objs.size()=1 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.435__shadow_.9b84AemnKhj_MJzN8Ljvvg87Zk09keN_0 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12497436622548675401', time=2024-09-12T20:49:28.511666+0000, chain.objs.size()=1 2024-09-12T19:29:41.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.639+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.440__shadow_.kL7N2LuE0H8ScTwp-yVNpxldKEQfpcw_0 2024-09-12T19:29:41.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6969563164411858187', time=2024-09-12T20:50:21.596844+0000, chain.objs.size()=1 2024-09-12T19:29:41.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.461__shadow_.xed9X0z0ugY1kXutPqa_ZqbEU52fqJe_0 2024-09-12T19:29:41.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4598173193951180277', time=2024-09-12T20:50:33.378545+0000, chain.objs.size()=1 2024-09-12T19:29:41.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.465__shadow_.khI-uWfPdHDLcyzq1Apgm_O9hxyP7BF_0 2024-09-12T19:29:41.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15025210099319408200', time=2024-09-12T20:51:05.568479+0000, chain.objs.size()=1 2024-09-12T19:29:41.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.484__shadow_.3h4MHJJ__V0gLuTtD8t_r2O4hplo1tt_0 2024-09-12T19:29:41.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11459730007080759408', time=2024-09-12T20:51:22.301192+0000, chain.objs.size()=1 2024-09-12T19:29:41.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.489__shadow_.pmt7eWXNwwFNI1wRZE-4q-d7a3xVqUh_0 2024-09-12T19:29:41.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12834508594322256589', time=2024-09-12T20:51:51.050723+0000, chain.objs.size()=1 2024-09-12T19:29:41.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.503__shadow:ZaN5iQFdkxMluSElq-iCxGVc.IoNdB._.0iAzXRtuwU4n61WPRJhvnPJx8SSDQ8I_0 2024-09-12T19:29:41.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~W5cSLTiIQYf8yrK6uDtkzAs2nQ50CWv', time=2024-09-12T20:54:57.912652+0000, chain.objs.size()=1 2024-09-12T19:29:41.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~W5cSLTiIQYf8yrK6uDtkzAs2nQ50CWv.1 2024-09-12T19:29:41.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4194598098165152567', time=2024-09-12T21:00:30.471584+0000, chain.objs.size()=1 2024-09-12T19:29:41.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.536__multipart_mymultipart.2~OvRQndPCDLQTE5_k4exJYBPWsHtAkV9.1 2024-09-12T19:29:41.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10675533973254632579', time=2024-09-12T21:03:09.305995+0000, chain.objs.size()=1 2024-09-12T19:29:41.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:jaGU..Jw194GWPCV7ALwmdcLzetVtHZ_.rrwJuwnq44tcNg3zFa_hO1ZwUXw1bqG_0 2024-09-12T19:29:41.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14747929329087004104', time=2024-09-12T21:04:39.491900+0000, chain.objs.size()=1 2024-09-12T19:29:41.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:XD0Ezu9aBA0qCBq7zYiZiOaR80DWoxN_.OybWQb09T5k8SvNp2nKbdJRpyaMVXWs_0 2024-09-12T19:29:41.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9358841450719525124', time=2024-09-12T21:06:00.581069+0000, chain.objs.size()=1 2024-09-12T19:29:41.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.580__shadow:9SWHMK07uNKho9mrs5hZW6QVRnub9M3_.5irZmJ5WJpUMkHim7JCRTUYZaxK8I4I_0 2024-09-12T19:29:41.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10032559048854252957', time=2024-09-12T21:06:20.732975+0000, chain.objs.size()=1 2024-09-12T19:29:41.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.587__shadow:1GlERJTisOtePBALe8PH6lvUWAUm.dd_.wkTeSBbQSsTOt6XcYz4pCd30b96nY8N_0 2024-09-12T19:29:41.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9112696308149360084', time=2024-09-12T21:11:54.693331+0000, chain.objs.size()=1 2024-09-12T19:29:41.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.618__shadow_.SuH6ivAW2omLb_ot5w4L5839pIz3W9__0 2024-09-12T19:29:41.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5692127568640124454', time=2024-09-12T21:13:38.655806+0000, chain.objs.size()=1 2024-09-12T19:29:41.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.630__shadow_.4XG4sLOhw1HLB4DRHr4uXErFLFzAZlo_0 2024-09-12T19:29:41.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9681579928571183447', time=2024-09-12T21:14:48.095367+0000, chain.objs.size()=1 2024-09-12T19:29:41.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.650__shadow_.FYNP4_QSO6X64NeBVfXxNQcqqmZN5ic_0 2024-09-12T19:29:41.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9589659828868159896', time=2024-09-12T21:17:15.891560+0000, chain.objs.size()=1 2024-09-12T19:29:41.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.699__shadow:.Cz1vBNsjhBelL922Xog2-PinRYBJKL_.QBRDRnOfNffNS-X3KczIV5hnp7EaH6C_0 2024-09-12T19:29:41.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~YNq84vMUTudOP9EE35gniqtplmHCYpH', time=2024-09-12T21:19:31.952171+0000, chain.objs.size()=1 2024-09-12T19:29:41.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.742__multipart_mymultipart.2~YNq84vMUTudOP9EE35gniqtplmHCYpH.1 2024-09-12T19:29:41.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~5SNvT4QXY8rkopXvz4LTWvsrrv2lb7-', time=2024-09-12T21:19:31.991375+0000, chain.objs.size()=1 2024-09-12T19:29:41.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.643+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.742__multipart_mymultipart2.2~5SNvT4QXY8rkopXvz4LTWvsrrv2lb7-.1 2024-09-12T19:29:41.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.647+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.647+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T19:29:41.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46976' 2024-09-12T19:29:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_5gqKXiuw9ihojVEAZPhF94ubIZb9Dzy', time=2024-09-12T20:30:13.771861+0000, chain.objs.size()=1 2024-09-12T19:29:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.165__shadow_.rR0SHwX4kk-jjcJm7nTGbV1KZ4tqwap_0 2024-09-12T19:29:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7775972296527541949', time=2024-09-12T20:35:47.196847+0000, chain.objs.size()=1 2024-09-12T19:29:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.238__shadow_.ZHMRKt1egPh_rdRMwVN_S1PS_Xu5OE6_0 2024-09-12T19:29:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6030545147017635848', time=2024-09-12T20:35:55.693614+0000, chain.objs.size()=1 2024-09-12T19:29:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.242__shadow_.f8XBvSOxwvi0b3G53ULANs0oEV4uO7x_0 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9369576522014667762', time=2024-09-12T20:36:05.634231+0000, chain.objs.size()=1 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.245__shadow_.DYk0GHf_zbp4_c8sXAdps2St2WM5cjA_0 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2367910850074046838', time=2024-09-12T20:36:19.342082+0000, chain.objs.size()=1 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.251__shadow_.2JTJv8NXEVD7tJy2BzL6jhJ_FPLi2Zy_0 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.502428039921922613', time=2024-09-12T20:36:24.004901+0000, chain.objs.size()=1 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.253__shadow_.75WIXHxWf8vFhV_bCsXP-0LPGT3miwj_0 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7725328860649058980', time=2024-09-12T20:38:22.437534+0000, chain.objs.size()=1 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.bTbKNIURjeFyW26so5KL7UaIQlYJr-l_0 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10538077472925738263', time=2024-09-12T20:38:23.557771+0000, chain.objs.size()=1 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hPXI-e4YJi7t6_m25KRlnSEiN3X0mki_0 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1289402331591771303', time=2024-09-12T20:38:23.862644+0000, chain.objs.size()=1 2024-09-12T19:29:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.JQGcNvbOejjL5kbBYTiADkePZh8G_go_0 2024-09-12T19:29:41.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17233308267114804499', time=2024-09-12T20:38:24.305266+0000, chain.objs.size()=1 2024-09-12T19:29:41.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.iuodPwR0zJxPZKUqrU6SjJE9iK4Xn3b_0 2024-09-12T19:29:41.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7356205223419939831', time=2024-09-12T20:38:24.641350+0000, chain.objs.size()=1 2024-09-12T19:29:41.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qvuKEA7VRjmyClroyV9STeuS49nuaIC_0 2024-09-12T19:29:41.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3865144483034080285', time=2024-09-12T20:38:25.219043+0000, chain.objs.size()=1 2024-09-12T19:29:41.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.651+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RFZDb15OqnseEUhMFm1OKtOZrsp51_h_0 2024-09-12T19:29:41.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17467955556966356341', time=2024-09-12T20:38:26.557225+0000, chain.objs.size()=1 2024-09-12T19:29:41.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.O_jHZgASiBeVD1e7DXR_VwQ0vyV1QAn_0 2024-09-12T19:29:41.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1932328127624287644', time=2024-09-12T20:38:26.560523+0000, chain.objs.size()=1 2024-09-12T19:29:41.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.j7O7F2jtbNcIiNLbn9SJV7GNc2guLxd_0 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18418078002848651406', time=2024-09-12T20:38:26.923172+0000, chain.objs.size()=1 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.uhFsN9G3j5V9OWXBvy5TQrFm-CE4wm-_0 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14370404448892698116', time=2024-09-12T20:38:28.316588+0000, chain.objs.size()=1 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5i2x7Rv7Zq_obiYhEg7SB3CmQBzHOf8_0 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1709522492428871581', time=2024-09-12T20:38:28.717975+0000, chain.objs.size()=1 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WEsTnk5-pmplNDFwTLbPMUl0FkJonJD_0 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2477756763129502861', time=2024-09-12T20:38:31.495465+0000, chain.objs.size()=1 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4rpJJYiDN2p8fFQzhQUoYlDt5QDE21D_0 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6840564850170179264', time=2024-09-12T20:38:32.398440+0000, chain.objs.size()=1 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.s-L_VuvOccaay1mu1ULoXZS06WltSMI_0 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7710255084665928443', time=2024-09-12T20:38:32.742312+0000, chain.objs.size()=1 2024-09-12T19:29:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vlK8G6Jb87YhwLO6glh51QPKremSKpW_0 2024-09-12T19:29:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6410270180081199744', time=2024-09-12T20:38:33.011338+0000, chain.objs.size()=1 2024-09-12T19:29:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.oajC3nNhEp63v3qaaVNoIaLQ8K6Blli_0 2024-09-12T19:29:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11141628397174984410', time=2024-09-12T20:38:34.017561+0000, chain.objs.size()=1 2024-09-12T19:29:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7ylFdvViPRcgKxCms4pJzIYcqhczCyI_0 2024-09-12T19:29:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17339213905536335425', time=2024-09-12T20:38:34.080985+0000, chain.objs.size()=1 2024-09-12T19:29:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5r_iqXqfz2KJJkeiIDO0T1kl09AwnG2_0 2024-09-12T19:29:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15879173322554197878', time=2024-09-12T20:38:34.374890+0000, chain.objs.size()=1 2024-09-12T19:29:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rBVuYuHxKqGdohIHM5SrAlRy8HAkAR-_0 2024-09-12T19:29:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16095647939581243992', time=2024-09-12T20:38:34.726593+0000, chain.objs.size()=1 2024-09-12T19:29:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rc8hajr54hrKVa9A0iFy6wUtezF32va_0 2024-09-12T19:29:41.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13385427823693509787', time=2024-09-12T20:38:35.059378+0000, chain.objs.size()=1 2024-09-12T19:29:41.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.B8x_JO3pvPk4-Gr6P-1kYUykQOAV1DO_0 2024-09-12T19:29:41.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2938545888112920169', time=2024-09-12T20:38:36.796614+0000, chain.objs.size()=1 2024-09-12T19:29:41.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-pGffXsO8jMleCWaiSdZB7WgIX2ildA_0 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2345549067443125997', time=2024-09-12T20:38:37.746249+0000, chain.objs.size()=1 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jOrsmp0jAdDrTAsQ3L35BGzPAa5eLAG_0 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14266800731239375509', time=2024-09-12T20:38:38.301537+0000, chain.objs.size()=1 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MMXpuXUsjhoF5TGgVvwjLAj8008cduB_0 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12885294052995698260', time=2024-09-12T20:38:41.374251+0000, chain.objs.size()=1 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.6v_keeVKdXU9-9C11qVswHo0vMKLVR5_0 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.690373512864200161', time=2024-09-12T20:38:41.571803+0000, chain.objs.size()=1 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.egYxAzBY4zFkLClUtVkkYcQvXUfKpT6_0 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1402347586021179482', time=2024-09-12T20:38:42.707227+0000, chain.objs.size()=1 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.655+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.FRLSikLXfxoNlFoAvwb__UlEPCTTcBO_0 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16865046368130013343', time=2024-09-12T20:38:44.738727+0000, chain.objs.size()=1 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CrgaO3FiMBhACCEOdUMMN4-Nr9AmXKW_0 2024-09-12T19:29:41.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10337334830033198533', time=2024-09-12T20:38:46.465615+0000, chain.objs.size()=1 2024-09-12T19:29:41.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.sZCjvtRu4QCfi8tOQiB_FbPQAXs4hyA_0 2024-09-12T19:29:41.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6808646142910187892', time=2024-09-12T20:38:46.947974+0000, chain.objs.size()=1 2024-09-12T19:29:41.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ttaoGtNrUk67qCcE5TmocdUumeegxBI_0 2024-09-12T19:29:41.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12358016838650522689', time=2024-09-12T20:38:47.165649+0000, chain.objs.size()=1 2024-09-12T19:29:41.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.H_y6nIvkHn5TaCM0VchX_lT7WArEvWh_0 2024-09-12T19:29:41.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2178246887139165170', time=2024-09-12T20:38:49.593491+0000, chain.objs.size()=1 2024-09-12T19:29:41.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.p3LBNPxVHaHwqQRGiEvOlRopqKt7TCk_0 2024-09-12T19:29:41.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6354475850548369758', time=2024-09-12T20:38:52.817206+0000, chain.objs.size()=1 2024-09-12T19:29:41.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.263__shadow_.Q67OkbkXlKnrt8YJh_gpm8izEeyKhvF_0 2024-09-12T19:29:41.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11198301275585705279', time=2024-09-12T20:39:21.348657+0000, chain.objs.size()=1 2024-09-12T19:29:41.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.276__shadow_.ZXq4eFGpg7n-fkbwjKRu_TMUKvMb75S_0 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13026023380522673949', time=2024-09-12T20:39:32.788516+0000, chain.objs.size()=1 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.281__shadow_.tHBF4KhxsLzsMF2mXnBkMOTCYjsxtEc_0 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5445108043342980964', time=2024-09-12T20:39:37.412312+0000, chain.objs.size()=1 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.283__shadow_.n6tva1kC1d7T_oPgKQUHlnX4yrWMmo5_0 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9900042531865215622', time=2024-09-12T20:39:39.670902+0000, chain.objs.size()=1 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.284__shadow_.BhF11cHougssw1VB6UNlf-v0ii8gc3X_0 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7721157098351303201', time=2024-09-12T20:39:39.699686+0000, chain.objs.size()=1 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.284__shadow_.mOMdKIVr9E_p-PhJuGSJuAoMCHml312_0 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3485836455903497641', time=2024-09-12T20:39:42.082345+0000, chain.objs.size()=1 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.285__shadow_.SSG5kqdeI9jShyfwvo7p82yrNhBUFef_0 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4676817557522991503', time=2024-09-12T20:40:01.781051+0000, chain.objs.size()=1 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.Vb-ivBQ0Q_gKkxsD9X0pK3pf4lZJizR_0 2024-09-12T19:29:41.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13165190322012474541', time=2024-09-12T20:40:07.544256+0000, chain.objs.size()=1 2024-09-12T19:29:41.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.6zV-o9hFruuM61WIeq9RscGGFfE364c_0 2024-09-12T19:29:41.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9234186595731837042', time=2024-09-12T20:43:02.842493+0000, chain.objs.size()=1 2024-09-12T19:29:41.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.659+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.X4ebmVf0Ky-KS2j4ykpABavgQvoZa44_0 2024-09-12T19:29:41.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8388812586176885292', time=2024-09-12T20:43:04.044878+0000, chain.objs.size()=1 2024-09-12T19:29:41.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HYtoYXJ09Qdv0nRnr0DWbXQfTOOXPo6_0 2024-09-12T19:29:41.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8815799465612891340', time=2024-09-12T20:43:04.359313+0000, chain.objs.size()=1 2024-09-12T19:29:41.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jFLNagiDb2UjA3GkG-tnyparHJ3M85q_0 2024-09-12T19:29:41.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2439812835323164187', time=2024-09-12T20:43:06.383325+0000, chain.objs.size()=1 2024-09-12T19:29:41.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4c8xBZUXdHHdv-mLvmp72BWn7eHKLIr_0 2024-09-12T19:29:41.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10256684926525732037', time=2024-09-12T20:43:07.859620+0000, chain.objs.size()=1 2024-09-12T19:29:41.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9wOUR04biKbzyBed1L-wel14f7p0eJW_0 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6976368994930403242', time=2024-09-12T20:43:08.160050+0000, chain.objs.size()=1 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.m7P39coHmYmquiaHhQGN8cBRarGqR2U_0 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4489792022234801894', time=2024-09-12T20:43:10.012632+0000, chain.objs.size()=1 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.NLan8yvy3nAjb2gwK1bUx_DueqFOE0d_0 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7121440143168524133', time=2024-09-12T20:43:10.099913+0000, chain.objs.size()=1 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0DIHJrtE0EJ4988UUcj5_ZrdXkAcIm-_0 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.990060400874377283', time=2024-09-12T20:43:10.417334+0000, chain.objs.size()=1 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pKA9IKiYjRAzsMsWSOuS22fMTiIzeKu_0 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2594645646588543723', time=2024-09-12T20:43:11.723664+0000, chain.objs.size()=1 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9-thxqKAmCMgqwxSBbrEDsA4N_X6YRx_0 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14134747067170507329', time=2024-09-12T20:43:12.217768+0000, chain.objs.size()=1 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.GQ-vEN2rdN-mZPxwL4tr0jYy0l9WZCm_0 2024-09-12T19:29:41.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3325069768023572770', time=2024-09-12T20:43:12.428159+0000, chain.objs.size()=1 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.UH8bOeeSKWQ7pueQQBfofs5NhR07X-m_0 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8784851110727656148', time=2024-09-12T20:43:13.631156+0000, chain.objs.size()=1 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.dxchHjdgOl3LKjQvwBMAX49bIjyKYWL_0 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7905187250614919512', time=2024-09-12T20:43:14.607638+0000, chain.objs.size()=1 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.UeBNkeYFt6BSPT2Ny7PivbYha2lPpAh_0 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5968502544656390456', time=2024-09-12T20:43:18.409435+0000, chain.objs.size()=1 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._4PoHWUOfs_OanYsE8vBlqTg92WrxsZ_0 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5334929098064757348', time=2024-09-12T20:43:19.194994+0000, chain.objs.size()=1 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.j6ztUcDSXXQH2aKAufRNnRVmrA44JOd_0 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6182200705592594776', time=2024-09-12T20:43:19.423142+0000, chain.objs.size()=1 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.FvKiKMCIIrAwxGO9j3YGCrWFvRfB_-m_0 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.782928098018597533', time=2024-09-12T20:43:20.011606+0000, chain.objs.size()=1 2024-09-12T19:29:41.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Yufg_od_5pcYicSxzjXcBJhDlsNCj9B_0 2024-09-12T19:29:41.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10657584329089673166', time=2024-09-12T20:43:20.862799+0000, chain.objs.size()=1 2024-09-12T19:29:41.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.663+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cy1MfqI0SnrBVp8U7VibWMrQpdkdCUF_0 2024-09-12T19:29:41.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1209168375299562730', time=2024-09-12T20:43:20.869094+0000, chain.objs.size()=1 2024-09-12T19:29:41.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.czyljGwbWXRtXpNRwfnhmjB_i5jKJG5_0 2024-09-12T19:29:41.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17991942381854762711', time=2024-09-12T20:43:25.182035+0000, chain.objs.size()=1 2024-09-12T19:29:41.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Ux-ZDIDAMGiJSFs2ulJ0i_SN7QMfNXq_0 2024-09-12T19:29:41.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7032982011765996736', time=2024-09-12T20:43:26.563993+0000, chain.objs.size()=1 2024-09-12T19:29:41.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5mW_bw5NkUcPNawYR42I293oJ6SySdj_0 2024-09-12T19:29:41.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9424314521844622066', time=2024-09-12T20:43:27.191251+0000, chain.objs.size()=1 2024-09-12T19:29:41.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.2h1SFYsuEQ-8ii5kyQowp4NdIBM9z5b_0 2024-09-12T19:29:41.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.763179911486647519', time=2024-09-12T20:43:27.926376+0000, chain.objs.size()=1 2024-09-12T19:29:41.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.UEFvxrjNxOKwmmmHIeaP8Ou23dbEU3R_0 2024-09-12T19:29:41.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9853545455501629895', time=2024-09-12T20:43:28.275178+0000, chain.objs.size()=1 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6RmILdIQhQ2a9SpAK5hcydD1ic5yp1q_0 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9270291721980159112', time=2024-09-12T20:43:28.944719+0000, chain.objs.size()=1 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-7GT0J2gPBMmWIJens9dEPJCo1uP9PC_0 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7786218813617093928', time=2024-09-12T20:43:29.418080+0000, chain.objs.size()=1 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.lMHslQnyuQuiKNn0jB_0_lTXQbjkkzm_0 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16670722181034304716', time=2024-09-12T20:43:30.065253+0000, chain.objs.size()=1 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9AOiPwvF9g0iVsx9nu9ejSr6HVCI3Kj_0 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15327859803509755262', time=2024-09-12T20:45:16.027792+0000, chain.objs.size()=1 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.eCGGwM0710O9DREvJ0EO27RkQ2its2a_0 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3789277520453326980', time=2024-09-12T20:45:16.515932+0000, chain.objs.size()=1 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.S3gMh2wjUYQn6g1xI05rCvp6-929XeW_0 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15302451718471036847', time=2024-09-12T20:45:17.186214+0000, chain.objs.size()=1 2024-09-12T19:29:41.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.HDpGH2XKYgnf0xxvNrZWnJgBnz-pgTV_0 2024-09-12T19:29:41.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6703362858709971790', time=2024-09-12T20:45:18.524523+0000, chain.objs.size()=1 2024-09-12T19:29:41.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lpqLhiD5R1ILP1jxtgvtAmpYYsKTZ_x_0 2024-09-12T19:29:41.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.331606765657915379', time=2024-09-12T20:45:19.346182+0000, chain.objs.size()=1 2024-09-12T19:29:41.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qWZJrzydVOBCw2apkFrRVYCMfH4d7_j_0 2024-09-12T19:29:41.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14026718908021111251', time=2024-09-12T20:45:19.488042+0000, chain.objs.size()=1 2024-09-12T19:29:41.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PVuvdqjLuhIzB_dp7pIrogp4VQnwf6O_0 2024-09-12T19:29:41.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2725054153510276827', time=2024-09-12T20:45:19.579683+0000, chain.objs.size()=1 2024-09-12T19:29:41.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DsZVIk5_qtmHN-V1VpxiWzVr_DV83qb_0 2024-09-12T19:29:41.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8567577060886924930', time=2024-09-12T20:45:20.026322+0000, chain.objs.size()=1 2024-09-12T19:29:41.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.HzvyAU3G5uvp5iaJFo4RxfRRWNxqSCZ_0 2024-09-12T19:29:41.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4401595634630004302', time=2024-09-12T20:45:20.188807+0000, chain.objs.size()=1 2024-09-12T19:29:41.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8n5J2pgPX4wh_luzRWbmNj3a2DYM-ax_0 2024-09-12T19:29:41.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14484153319466673843', time=2024-09-12T20:45:22.106076+0000, chain.objs.size()=1 2024-09-12T19:29:41.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.R1Pri1tH775jVnxdvShhOBLQFkO15P5_0 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3945850389058360115', time=2024-09-12T20:45:24.223924+0000, chain.objs.size()=1 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.gq9wgIk8gZkN6wXHNwo42PfAE3Jdgxz_0 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4016119509452935360', time=2024-09-12T20:45:24.403435+0000, chain.objs.size()=1 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YSqAGjFUeIz3Lj5qcqwjkf4I314fTeu_0 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6222368166105606363', time=2024-09-12T20:45:24.866153+0000, chain.objs.size()=1 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.667+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.82za_-7YRAPYN1eIjoyOOe5KlGSAISD_0 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7573576299478638042', time=2024-09-12T20:45:26.150362+0000, chain.objs.size()=1 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.u4hbSAB2xAHm7VI6TGaI1iwAjFhJ3D8_0 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7054824140089766572', time=2024-09-12T20:45:28.045793+0000, chain.objs.size()=1 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.QXaaqU5Q7Ak7OrwXgHg2pQbdpvuaeqq_0 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9327582554383766608', time=2024-09-12T20:45:28.047441+0000, chain.objs.size()=1 2024-09-12T19:29:41.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.B31vwSJJedddwcX9mUPvqQfV9I2MYvH_0 2024-09-12T19:29:41.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16105873305938834374', time=2024-09-12T20:45:28.343512+0000, chain.objs.size()=1 2024-09-12T19:29:41.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fDwbBelnvcV9ddDxsfYkYpw6n2c1HkJ_0 2024-09-12T19:29:41.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14960104716779406171', time=2024-09-12T20:45:29.280255+0000, chain.objs.size()=1 2024-09-12T19:29:41.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cBJo7qIP6-7f9dwBGau1u-mwf9yrxwf_0 2024-09-12T19:29:41.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14107390048160557464', time=2024-09-12T20:45:29.766512+0000, chain.objs.size()=1 2024-09-12T19:29:41.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MivRNgwkMun9XqcXWni0jBNMbdsrFfI_0 2024-09-12T19:29:41.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10690756852341715359', time=2024-09-12T20:45:29.957463+0000, chain.objs.size()=1 2024-09-12T19:29:41.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.AUjjCS38WLJnswKL0_BsP58dtGKu4jC_0 2024-09-12T19:29:41.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8575677372466132426', time=2024-09-12T20:45:30.311427+0000, chain.objs.size()=1 2024-09-12T19:29:41.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xR9e7ervIwn1u7-ox9TNirOwaOAMegm_0 2024-09-12T19:29:41.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6411087304003616662', time=2024-09-12T20:45:30.313310+0000, chain.objs.size()=1 2024-09-12T19:29:41.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uBuuD2t_AVPuua_enloU3lu6MQF1QQL_0 2024-09-12T19:29:41.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11042299201863610891', time=2024-09-12T20:45:31.757221+0000, chain.objs.size()=1 2024-09-12T19:29:41.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pyFmpSnntiE-_PitgTx-IrJISZRV5Op_0 2024-09-12T19:29:41.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9243415886954262016', time=2024-09-12T20:45:33.901369+0000, chain.objs.size()=1 2024-09-12T19:29:41.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.i1OE-22mAfNPvPeak2J-YbLXXFxBxPu_0 2024-09-12T19:29:41.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14224227067336157923', time=2024-09-12T20:45:34.449438+0000, chain.objs.size()=1 2024-09-12T19:29:41.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.B1aPiwGHW8417H2_56lJmeyw4O_IX4r_0 2024-09-12T19:29:41.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16012061084389063488', time=2024-09-12T20:45:34.659094+0000, chain.objs.size()=1 2024-09-12T19:29:41.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.671+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hNu0kCxaNcZFdjyGA8ir1tdzIU21Hcx_0 2024-09-12T19:29:41.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46976 2024-09-12T19:29:41.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T19:29:41.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14042041287246699686', time=2024-09-12T20:45:36.479219+0000, chain.objs.size()=1 2024-09-12T19:29:41.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.AIc729e60zErYKcxdCLGMPPGNadCpfJ_0 2024-09-12T19:29:41.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10344715610848075696', time=2024-09-12T20:45:36.834672+0000, chain.objs.size()=1 2024-09-12T19:29:41.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2IjYkDY5svA8zVPDCvMLBA2FVdMijMF_0 2024-09-12T19:29:41.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14022019930067109454', time=2024-09-12T20:45:37.143866+0000, chain.objs.size()=1 2024-09-12T19:29:41.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OKVeCmAuB0-F69PIwgZcyonv9uwTWyj_0 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11255181011977561373', time=2024-09-12T20:45:37.228148+0000, chain.objs.size()=1 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hgnJ3pInkbLsV4kpzf1HUtcIUzEjUO6_0 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9252550529241704662', time=2024-09-12T20:45:37.639983+0000, chain.objs.size()=1 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.BxcKyUT-DyJyf0yY6qfQ8YON5jdGscS_0 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14569225675884794332', time=2024-09-12T20:45:38.194980+0000, chain.objs.size()=1 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.G7By7eoFgOPyGnPkfWY9CAuwoP1I5SA_0 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2634737381940564818', time=2024-09-12T20:45:38.291607+0000, chain.objs.size()=1 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.KGHb2sHuH5G0oa-FGbAEkv25ud6z3CX_0 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13514455822833950529', time=2024-09-12T20:47:48.014424+0000, chain.objs.size()=1 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.390__shadow_.K0wL7bHDV58uQlLHR_887KoGoH7JTzk_0 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9177455069083727936', time=2024-09-12T20:50:27.546439+0000, chain.objs.size()=1 2024-09-12T19:29:41.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.463__shadow_.MTphDV05jgi7yU8KIxAXyYyrLbSACUf_0 2024-09-12T19:29:41.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.502583918389804071', time=2024-09-12T20:53:16.617143+0000, chain.objs.size()=1 2024-09-12T19:29:41.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.517__shadow_.CBZwdkzYgR2ToQNqOn_YMhkYMIDGHo4_0 2024-09-12T19:29:41.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~0iMBNEA7iJMA6yiug-Ak_2hQLowLeP7', time=2024-09-12T20:59:36.554780+0000, chain.objs.size()=2 2024-09-12T19:29:41.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.529__multipart_mymultipart.2~0iMBNEA7iJMA6yiug-Ak_2hQLowLeP7.1 2024-09-12T19:29:41.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.675+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.529__multipart_mymultipart.2~0iMBNEA7iJMA6yiug-Ak_2hQLowLeP7.2 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16705008773833919208', time=2024-09-12T21:03:00.168053+0000, chain.objs.size()=1 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.566__shadow_.VG7EBB2bW4U45yoDMExYukFbR3AKDX6_0 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12879324965963691925', time=2024-09-12T21:03:24.179950+0000, chain.objs.size()=1 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:y0UvIdD5zPVqmCwIaA.Qj6cPdRlP67T_.6E039NozvDo5-d8Dm4tkJEBHLeN3jXZ_0 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14021171905760674319', time=2024-09-12T21:03:31.924758+0000, chain.objs.size()=1 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.570__shadow:B.t99WhbVQ-jOL-2Nrsh5QWz0QOzEE0_.vqwaS0PKCjqXgU745Lze5owE961PcX__0 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15596010149145589598', time=2024-09-12T21:03:51.432959+0000, chain.objs.size()=1 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.574__shadow:jNgXoaxf7dx-j2h5qODYC0KP4U9U6o7_.FinG478Rch7lA--S7It8nxzaHxKEmb-_0 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8450360406581226325', time=2024-09-12T21:04:06.997074+0000, chain.objs.size()=1 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.576__shadow:4O3.rD8gGXOqY2PxSEzaH9JU3KBqP2-_.sY5-0FirKBpT5RKTNBxNEBOokKcz5x6_0 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10890396060108926046', time=2024-09-12T21:04:10.625431+0000, chain.objs.size()=1 2024-09-12T19:29:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:uFZSdHKj781LRlNFxWF.kyJemrjH43K_.JIcm98LUryrFcu2KS8c-nBBYkBqiE6j_0 2024-09-12T19:29:41.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3936133353238015263', time=2024-09-12T21:06:12.789263+0000, chain.objs.size()=1 2024-09-12T19:29:41.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.585__shadow:hfmUVLg4jekUxfcE.6yPASfkfvtWAc8_.uaoFUTkDpxiuiWmp6PfY0ZAyEAbFtgj_0 2024-09-12T19:29:41.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5029411746324332300', time=2024-09-12T21:06:12.857275+0000, chain.objs.size()=1 2024-09-12T19:29:41.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.585__shadow:p1fBlRkfNUXDklxvyFHnnOwcE4Gqup0_.GePIuEIkVbNnXihpLXiN8RhL327RtjE_0 2024-09-12T19:29:41.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16956277569015184959', time=2024-09-12T21:08:18.580953+0000, chain.objs.size()=12 2024-09-12T19:29:41.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__multipart_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.1 2024-09-12T19:29:41.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__shadow_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.1_1 2024-09-12T19:29:41.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.679+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__multipart_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.2 2024-09-12T19:29:41.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__shadow_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.2_1 2024-09-12T19:29:41.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__multipart_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.3 2024-09-12T19:29:41.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__shadow_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.3_1 2024-09-12T19:29:41.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__multipart_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.4 2024-09-12T19:29:41.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__shadow_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.4_1 2024-09-12T19:29:41.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__multipart_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.5 2024-09-12T19:29:41.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__shadow_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.5_1 2024-09-12T19:29:41.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__multipart_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.6 2024-09-12T19:29:41.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.613__shadow_multipart_enc.2~fJdSKvNKMD3mEYLjfjNOQQ7KHzb4Wcw.6_1 2024-09-12T19:29:41.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15146252081149767818', time=2024-09-12T21:13:44.877731+0000, chain.objs.size()=1 2024-09-12T19:29:41.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.633__shadow_.xQX7Vi2r_bKLWizPhS0Fre05n0HLcoh_0 2024-09-12T19:29:41.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9040160711481553285', time=2024-09-12T21:14:26.563023+0000, chain.objs.size()=1 2024-09-12T19:29:41.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.646__shadow_.Kt5OzMC4pJYuX5W6HROYkaBPBJ16uQU_0 2024-09-12T19:29:41.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9184637253351695759', time=2024-09-12T21:17:11.623619+0000, chain.objs.size()=1 2024-09-12T19:29:41.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.697__shadow:2aIPom4jPU4vk3oeD6wra4vQCQxNyP5_.M4KAmdjjY08eQ41_kwU9NdbHigQQQsx_0 2024-09-12T19:29:41.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3300694272070238928', time=2024-09-12T21:17:59.701083+0000, chain.objs.size()=1 2024-09-12T19:29:41.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.683+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.715__shadow:67kr-bQFfzxZtPOyTUCDVUtdZoYkWvg_.35h47Lvl_N3GF5YReXWFqr0I7Mj-Hiw_0 2024-09-12T19:29:41.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.687+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.687+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T19:29:41.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52201' 2024-09-12T19:29:41.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8302841058434040567', time=2024-09-12T20:29:14.750624+0000, chain.objs.size()=3 2024-09-12T19:29:41.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.zPnVIQJnxTm4ASxKy1aXNoegFMaCLLK_0 2024-09-12T19:29:41.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.zPnVIQJnxTm4ASxKy1aXNoegFMaCLLK_1 2024-09-12T19:29:41.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.zPnVIQJnxTm4ASxKy1aXNoegFMaCLLK_2 2024-09-12T19:29:41.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2219378517373111944', time=2024-09-12T20:35:39.546223+0000, chain.objs.size()=1 2024-09-12T19:29:41.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.236__shadow_.2DGpino-Trp2UfdXCRiED_1kXudLRpl_0 2024-09-12T19:29:41.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12581689411188863458', time=2024-09-12T20:36:26.311435+0000, chain.objs.size()=1 2024-09-12T19:29:41.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.254__shadow_.FE10fNxV4x87ynUwa1jTUta83shmTz4_0 2024-09-12T19:29:41.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9628698913185581298', time=2024-09-12T20:36:39.597800+0000, chain.objs.size()=1 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.260__shadow_.2Qh509r6OXHOka7AC-ndKeE6V1v0VbZ_0 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11471762746327219933', time=2024-09-12T20:36:41.916829+0000, chain.objs.size()=1 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.261__shadow_.UK6DrnS2nc5pFNu5DVLbn-vvGJFFTbZ_0 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11596144742054833482', time=2024-09-12T20:38:23.388658+0000, chain.objs.size()=1 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WZpau4zrOHihGuNLujBFlnEK6koDqbF_0 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6918966174673172702', time=2024-09-12T20:38:23.857831+0000, chain.objs.size()=1 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dGBOtCqF9B7B3X_EV72EZKvAc5Nzhb2_0 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14358918381656587789', time=2024-09-12T20:38:24.796974+0000, chain.objs.size()=1 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QpZxLyNPdouWIfIBHZGbp9BYHmx9tOf_0 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4997835101526530192', time=2024-09-12T20:38:25.179959+0000, chain.objs.size()=1 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.LNM5GfcNSCtGbayG86VPqqUvVMPpu9V_0 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9960348394774990494', time=2024-09-12T20:38:25.182338+0000, chain.objs.size()=1 2024-09-12T19:29:41.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.691+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WhBi8zfEXeRNZksROv941nF6KR8uqTS_0 2024-09-12T19:29:41.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9814543140686981565', time=2024-09-12T20:38:26.590765+0000, chain.objs.size()=1 2024-09-12T19:29:41.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wHVFwHI-XIOj8ZX7Y-J7dG4jMIHV8-X_0 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6295742853477963817', time=2024-09-12T20:38:28.555616+0000, chain.objs.size()=1 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fTqPUINy_4xMpafKrSL226hz3KkvHsv_0 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18286724022344910127', time=2024-09-12T20:38:29.199444+0000, chain.objs.size()=1 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GtzGs8WHwMequ8sDiJI0Xgs80X_DMrf_0 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13965656439899168648', time=2024-09-12T20:38:30.714990+0000, chain.objs.size()=1 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.HrOc8VoX7PWAkI_3xuaHVgHXNRZ4FEG_0 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7178812105991745516', time=2024-09-12T20:38:31.494862+0000, chain.objs.size()=1 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Ji5ijDgZKdN5w__jAyXoGfOkNL_k1NV_0 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11767117376445769062', time=2024-09-12T20:38:31.546909+0000, chain.objs.size()=1 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.sAJTBHjbw6u8wxotIZgy2IeXLQXS7XQ_0 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3222492604979361806', time=2024-09-12T20:38:31.761504+0000, chain.objs.size()=1 2024-09-12T19:29:41.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.C6zMdiMpaQieRk7Of706hAzb_X_rWy7_0 2024-09-12T19:29:41.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15601542962870533559', time=2024-09-12T20:38:31.951843+0000, chain.objs.size()=1 2024-09-12T19:29:41.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.p3oPQO8WWYoBpNDS6eiehc2kmi9_QVS_0 2024-09-12T19:29:41.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13691679622736411706', time=2024-09-12T20:38:32.039393+0000, chain.objs.size()=1 2024-09-12T19:29:41.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.KlJ2kDmIVoK85NtuJiSMi_sYg4FfAPO_0 2024-09-12T19:29:41.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3762688739665481941', time=2024-09-12T20:38:32.349431+0000, chain.objs.size()=1 2024-09-12T19:29:41.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dqqQeDgwSOG7LPBWUekFmmzDeU241dS_0 2024-09-12T19:29:41.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17653713628897082701', time=2024-09-12T20:38:34.355185+0000, chain.objs.size()=1 2024-09-12T19:29:41.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.yErsrqJDeKnzD0IZ5GPdSNBe-UdRMkx_0 2024-09-12T19:29:41.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5328815900867351995', time=2024-09-12T20:38:35.586983+0000, chain.objs.size()=1 2024-09-12T19:29:41.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9ypR3DbEN78hQFK5TNuvcsKR72vt-tT_0 2024-09-12T19:29:41.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.608384239094118971', time=2024-09-12T20:38:36.249333+0000, chain.objs.size()=1 2024-09-12T19:29:41.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7BTfbhQBRImbBekmJ9-gYXVKsx2qQZO_0 2024-09-12T19:29:41.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13269594514017201957', time=2024-09-12T20:38:38.586989+0000, chain.objs.size()=1 2024-09-12T19:29:41.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lKfkNl7cn9MsYZAvZDs-i8xF_XsXead_0 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13421128478968994766', time=2024-09-12T20:38:39.681594+0000, chain.objs.size()=1 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RwemU8t0b5hHKKFngswo9y9Czy3nEx4_0 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1759507876185992701', time=2024-09-12T20:38:40.210892+0000, chain.objs.size()=1 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.3DAnFhKziZrR38l28JH6ZSbPf1dhT9y_0 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7969848628846245173', time=2024-09-12T20:38:42.175576+0000, chain.objs.size()=1 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.d9J9tJQ-lHy6iw59K-E5gt_bTOXs2qv_0 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4369802060073925593', time=2024-09-12T20:38:44.820273+0000, chain.objs.size()=1 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qMV7tkAfzI5W8FC8xd_s7nTgZlfzNBg_0 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8738534482384668264', time=2024-09-12T20:38:47.203682+0000, chain.objs.size()=1 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.G92SyHHi-hEx29LwTR7jgpLieH95rRT_0 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2696016333140672992', time=2024-09-12T20:38:47.291515+0000, chain.objs.size()=1 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.drDPb5XZE7rOdZD3LdrkRsVtKnuyaYe_0 2024-09-12T19:29:41.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11624871647308835171', time=2024-09-12T20:38:49.899412+0000, chain.objs.size()=1 2024-09-12T19:29:41.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-_RT6omVKGKAAEcGiRfr7a6G2hd7dPe_0 2024-09-12T19:29:41.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6579480975035386946', time=2024-09-12T20:38:49.941242+0000, chain.objs.size()=1 2024-09-12T19:29:41.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.695+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rC03V7f3TYbBLMCmK2S1FqN1Bmz3R03_0 2024-09-12T19:29:41.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2992516111433367042', time=2024-09-12T20:39:32.752609+0000, chain.objs.size()=1 2024-09-12T19:29:41.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.281__shadow_.xUQ8MB_pRo-_kPl5P9LD1nUJJ67jdT8_0 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16091791612887543924', time=2024-09-12T20:40:07.725584+0000, chain.objs.size()=1 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.Jl0qAK3Esby24uaXAom8HSkkjL16jI7_0 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12542092578053755284', time=2024-09-12T20:43:03.000983+0000, chain.objs.size()=1 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.mXO_6yauo7ym4O82QEIuK8bwy2jSv1g_0 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14466218291189814354', time=2024-09-12T20:43:03.538165+0000, chain.objs.size()=1 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pYSzpy4aS3cSNXwo9SIaF0lTgCtQTI1_0 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6069858181525361907', time=2024-09-12T20:43:03.748062+0000, chain.objs.size()=1 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.s8odtvuehgfBjqK6Jvw7SH2VnDj7qjz_0 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8035441025834013060', time=2024-09-12T20:43:03.749626+0000, chain.objs.size()=1 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nAWDEz1GzKQ20vYSa-XTkqqOj6ntxc3_0 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13215739731731106552', time=2024-09-12T20:43:04.958448+0000, chain.objs.size()=1 2024-09-12T19:29:41.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.bkaO0fk7ve_fVLKMOJvkIbzks5zgI-W_0 2024-09-12T19:29:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6711444132697663441', time=2024-09-12T20:43:06.281599+0000, chain.objs.size()=1 2024-09-12T19:29:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.egJ-ZUjerMKvgz3PxBQmVfdRhVJnasS_0 2024-09-12T19:29:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1808582887256026737', time=2024-09-12T20:43:06.897038+0000, chain.objs.size()=1 2024-09-12T19:29:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0WNGYnPfCEk7gyUbHFo3MAeoellsrkr_0 2024-09-12T19:29:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13013004560608156278', time=2024-09-12T20:43:07.240186+0000, chain.objs.size()=1 2024-09-12T19:29:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.NelHmVdfBKhAPysuZts1C0m_NZNZKbr_0 2024-09-12T19:29:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11790662844146463909', time=2024-09-12T20:43:10.013241+0000, chain.objs.size()=1 2024-09-12T19:29:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.W9ZKOUe-fkJeVJmm7IBC96M15-HBeSU_0 2024-09-12T19:29:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6983638200211744337', time=2024-09-12T20:43:11.101349+0000, chain.objs.size()=1 2024-09-12T19:29:41.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.699+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.1vWzr7PsGwe4BP0QtpjFxlQuc9I0Asf_0 2024-09-12T19:29:41.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17379657983435214295', time=2024-09-12T20:43:11.248678+0000, chain.objs.size()=1 2024-09-12T19:29:41.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gNUzvPnoojskVnDn3FRU5CuRMa-vh9I_0 2024-09-12T19:29:41.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10154350882007822009', time=2024-09-12T20:43:11.606122+0000, chain.objs.size()=1 2024-09-12T19:29:41.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tT2P2OoMb9mE-wbjgHlpMXNq8dOD_sf_0 2024-09-12T19:29:41.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14097582394263597371', time=2024-09-12T20:43:15.716110+0000, chain.objs.size()=1 2024-09-12T19:29:41.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.OecfLrchuLcDFnEse8rCYaunwNvMqvY_0 2024-09-12T19:29:41.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10594071335315675097', time=2024-09-12T20:43:16.090521+0000, chain.objs.size()=1 2024-09-12T19:29:41.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gEvJP5-ZHevcNz1-5SAHf8y_jQIh0f-_0 2024-09-12T19:29:41.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2531945445228532065', time=2024-09-12T20:43:18.046742+0000, chain.objs.size()=1 2024-09-12T19:29:41.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yZ7P7pWTgZ6T0onui7iYDjS2OP2g1re_0 2024-09-12T19:29:41.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3264068851559614053', time=2024-09-12T20:43:18.739044+0000, chain.objs.size()=1 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.qNEnCWREb-ZAWzklss1RbB7yLCszNZz_0 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7251343899436266858', time=2024-09-12T20:43:19.308583+0000, chain.objs.size()=1 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-ielsmFziiR0TzQARsB6ZQ1yyVRclU2_0 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6287150863080023353', time=2024-09-12T20:43:19.543538+0000, chain.objs.size()=1 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._DXnXT7uFiLqvIR7tL03QtQ7oeeyl6O_0 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6353931628836036433', time=2024-09-12T20:43:20.933499+0000, chain.objs.size()=1 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.E6AbTRJVDWUtEvVWPDLoD4KA9urC8Eb_0 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.586462745596090808', time=2024-09-12T20:43:22.005767+0000, chain.objs.size()=1 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EC2hy6pDoHKqPycgs_vz3jvdyPrfQ_k_0 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2904172635080025315', time=2024-09-12T20:43:23.494815+0000, chain.objs.size()=1 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3UAK-Di8F69A79d-g9t36sWV2m3y1R8_0 2024-09-12T19:29:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13031245429457047474', time=2024-09-12T20:43:24.933981+0000, chain.objs.size()=1 2024-09-12T19:29:41.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.OcQzDG-XocKC2OdNZnE1W6LDRSwohO5_0 2024-09-12T19:29:41.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.736209464033275796', time=2024-09-12T20:43:25.368824+0000, chain.objs.size()=1 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.f7ZQc2PbIHNV1FSQxduY22Jgxqqb1eN_0 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.282678793943915059', time=2024-09-12T20:43:25.611060+0000, chain.objs.size()=1 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.BBESr7juAJO1sgZkQnWU6oht1WcDauU_0 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11494656533540396982', time=2024-09-12T20:43:25.690388+0000, chain.objs.size()=1 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.aojHIWlnZPSmZHCkkjvVwBRF-5gpJSK_0 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7248368428035927389', time=2024-09-12T20:43:25.967936+0000, chain.objs.size()=1 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.PfzWmgvqDkVjeoFXat9t9Yeii63q4SR_0 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6270440240776510850', time=2024-09-12T20:43:25.989053+0000, chain.objs.size()=1 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6EgOEIzM96FeS8TxjQPnehwMIyHjDha_0 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15778763401934785791', time=2024-09-12T20:43:26.848640+0000, chain.objs.size()=1 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0fR8vJL69nRB-eev2kQlZQQXNRgWcqD_0 2024-09-12T19:29:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15426662667935069399', time=2024-09-12T20:43:27.189954+0000, chain.objs.size()=1 2024-09-12T19:29:41.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.PsuAT2PFdeA8tjsL5ZP3AasgP4avhFu_0 2024-09-12T19:29:41.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5135395910247427624', time=2024-09-12T20:43:27.860942+0000, chain.objs.size()=1 2024-09-12T19:29:41.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-w0XcqrBDzHep4kMDJpErVg7jnLJbaf_0 2024-09-12T19:29:41.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14591654874997453008', time=2024-09-12T20:43:28.681086+0000, chain.objs.size()=1 2024-09-12T19:29:41.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Zt9KkL8uoL2v3cezmR5Sp-PTIBo5Ndp_0 2024-09-12T19:29:41.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1993590822245966608', time=2024-09-12T20:43:29.122380+0000, chain.objs.size()=1 2024-09-12T19:29:41.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.703+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IwVRJffeHdQXSeDoDa36lApa-VZ9JmM_0 2024-09-12T19:29:41.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18092535035435237827', time=2024-09-12T20:43:29.772732+0000, chain.objs.size()=1 2024-09-12T19:29:41.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.mXgpBIAUGNd0X07iY6008iRofh79J46_0 2024-09-12T19:29:41.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10630139664143735012', time=2024-09-12T20:45:10.860301+0000, chain.objs.size()=1 2024-09-12T19:29:41.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cJVGmp4PJ0odWkgIB5sWcmAL0tT_gem_0 2024-09-12T19:29:41.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3112505467999115597', time=2024-09-12T20:45:11.676957+0000, chain.objs.size()=1 2024-09-12T19:29:41.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MPGEzQdgyDtKVV4ZUfdXZ0iyrjBDCtP_0 2024-09-12T19:29:41.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15324279495049296090', time=2024-09-12T20:45:12.240821+0000, chain.objs.size()=1 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cv5M57tJ-8NFa470sJ60_OKHJwFh_j1_0 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10201680716097122494', time=2024-09-12T20:45:14.637667+0000, chain.objs.size()=1 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8_tZwyYXwS0yOaS1I7-VMFIX4baKHLa_0 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7838116608805242327', time=2024-09-12T20:45:14.749245+0000, chain.objs.size()=1 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.q7L__-CNyKjBIN4oI4vbPuoarAUW105_0 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14315010649669373966', time=2024-09-12T20:45:14.857848+0000, chain.objs.size()=1 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.gbXYIk3DYApck8_8jr8_qe7CD0aO7ze_0 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6709314248190744952', time=2024-09-12T20:45:15.087378+0000, chain.objs.size()=1 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kvK9YCodsS2Hx6kZV9bPEhvjxUdJee2_0 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4470571195241628249', time=2024-09-12T20:45:15.202404+0000, chain.objs.size()=1 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hmuGz6-emYCJlrfslGGNlqNhBwCqD61_0 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12357801734267631138', time=2024-09-12T20:45:15.661242+0000, chain.objs.size()=1 2024-09-12T19:29:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UCXwzlk9YmLVvdoMibWVQtmzI1H_zR5_0 2024-09-12T19:29:41.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13244480232810476184', time=2024-09-12T20:45:15.850676+0000, chain.objs.size()=1 2024-09-12T19:29:41.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zDBwXaDhqzar7KBc9TzZ5nhcMN7KZIs_0 2024-09-12T19:29:41.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3057071156179745602', time=2024-09-12T20:45:16.321178+0000, chain.objs.size()=1 2024-09-12T19:29:41.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.HqAijuvQBHgtjEjOWvwA0NUzDxmg058_0 2024-09-12T19:29:41.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1510439972614123884', time=2024-09-12T20:45:17.513224+0000, chain.objs.size()=1 2024-09-12T19:29:41.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.XtXw_LGsEmPeVX9c5CdQWeS_9am2HVM_0 2024-09-12T19:29:41.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17349852386556103029', time=2024-09-12T20:45:19.012980+0000, chain.objs.size()=1 2024-09-12T19:29:41.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.707+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DjU45IqDdRGJZ8aICUbZ8WBPlX6qF0F_0 2024-09-12T19:29:41.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9971927180343175902', time=2024-09-12T20:45:20.658602+0000, chain.objs.size()=1 2024-09-12T19:29:41.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.tRRqDvslXJaQQdCWGLCQ5cXgu3e9LPQ_0 2024-09-12T19:29:41.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4318399895105360488', time=2024-09-12T20:45:20.869488+0000, chain.objs.size()=1 2024-09-12T19:29:41.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3W7Ehhs3LNBwsdJRD2f-aV4Wdzr-hH__0 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14260229811500383218', time=2024-09-12T20:45:22.454398+0000, chain.objs.size()=1 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cpNUB9l3fjf6MPcK4T_pWpMJl2Ud33O_0 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2934504839872737594', time=2024-09-12T20:45:22.704329+0000, chain.objs.size()=1 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.H_pM1A-TLK6PA-66TMPBDukxTNUHh07_0 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13280923319795122288', time=2024-09-12T20:45:23.460742+0000, chain.objs.size()=1 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.QCBYG96zfuifDa9aY3Az9a59mNtJJ-P_0 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12771843057914574063', time=2024-09-12T20:45:24.634133+0000, chain.objs.size()=1 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kUp-vclW23pDtCMmmHLnJPP0UrgNTiY_0 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16903506381097733330', time=2024-09-12T20:45:26.270927+0000, chain.objs.size()=1 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.U8vlPJbSMlf9ko4hOUsQ6WCGvyWvUbf_0 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17983827546729991576', time=2024-09-12T20:45:27.450219+0000, chain.objs.size()=1 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GnMge3EDSfp_3OZlVZp6TAL4mUbDANW_0 2024-09-12T19:29:41.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8687236082490491666', time=2024-09-12T20:45:29.299513+0000, chain.objs.size()=1 2024-09-12T19:29:41.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Xpp-AsuelCU_CksFDSY6uBU-ZEfhZuv_0 2024-09-12T19:29:41.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17295380268757251461', time=2024-09-12T20:45:31.872587+0000, chain.objs.size()=1 2024-09-12T19:29:41.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.No6ELdDodhZwakewVb7PJbaCkUYimLQ_0 2024-09-12T19:29:41.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10501680527135825317', time=2024-09-12T20:45:32.704523+0000, chain.objs.size()=1 2024-09-12T19:29:41.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Z61acHJ0glazP7FZOnurj0U8gidECGv_0 2024-09-12T19:29:41.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5469994672321668307', time=2024-09-12T20:45:33.442451+0000, chain.objs.size()=1 2024-09-12T19:29:41.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pgl6ndLOLt6feBiBWerMpsf77VGhoTP_0 2024-09-12T19:29:41.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11167108337578860205', time=2024-09-12T20:45:33.922887+0000, chain.objs.size()=1 2024-09-12T19:29:41.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fwT-gcvJTXMmqGfZ3-lnaeUhHeDIm1j_0 2024-09-12T19:29:41.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16696948820230724941', time=2024-09-12T20:45:33.924432+0000, chain.objs.size()=1 2024-09-12T19:29:41.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.tIjcFjkRedrHYGHD3BwKYogzGjM_xoj_0 2024-09-12T19:29:41.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2181124110393763083', time=2024-09-12T20:45:34.077264+0000, chain.objs.size()=1 2024-09-12T19:29:41.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zXqc92Kk9WvktmwkA0gQyF5MFh-16Mr_0 2024-09-12T19:29:41.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3028673108407630874', time=2024-09-12T20:45:34.104672+0000, chain.objs.size()=1 2024-09-12T19:29:41.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UlsqZdCMnVSy7wmd-3nOhH5k0jnjOSv_0 2024-09-12T19:29:41.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8836868777243607360', time=2024-09-12T20:45:34.678357+0000, chain.objs.size()=1 2024-09-12T19:29:41.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ELJD2oXgFYdjcvVCNu9NzAz-6tWBxSC_0 2024-09-12T19:29:41.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.863420153800250364', time=2024-09-12T20:45:34.885404+0000, chain.objs.size()=1 2024-09-12T19:29:41.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FrehKFGDgyNeChwBSBxX-bSlwo2NSiB_0 2024-09-12T19:29:41.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8167557697566189066', time=2024-09-12T20:45:36.464934+0000, chain.objs.size()=1 2024-09-12T19:29:41.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._5jR2g-deTto6TC_voteP1USML4zMa4_0 2024-09-12T19:29:41.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8028720796831025038', time=2024-09-12T20:45:37.417394+0000, chain.objs.size()=1 2024-09-12T19:29:41.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.711+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uW3tXZLq4eCpOWpVuSoQ-7IGzGrDSWy_0 2024-09-12T19:29:41.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.715+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52201 2024-09-12T19:29:41.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T19:29:41.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1640477670632620672', time=2024-09-12T20:45:38.343624+0000, chain.objs.size()=1 2024-09-12T19:29:41.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Un4iM11r5gQyHj5ecV3seh-UC4Isi5k_0 2024-09-12T19:29:41.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5027729972146973121', time=2024-09-12T20:46:04.180360+0000, chain.objs.size()=1 2024-09-12T19:29:41.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.337__shadow_.BkE342wn-A6HGphMHRoEjuBS-byPf2Y_0 2024-09-12T19:29:41.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9046019408400256802', time=2024-09-12T20:46:20.700552+0000, chain.objs.size()=1 2024-09-12T19:29:41.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.345__shadow_.glQvr1QdKhknXCE6-SSoeWWnu2EhKLO_0 2024-09-12T19:29:41.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13123389466212325765', time=2024-09-12T20:46:22.748850+0000, chain.objs.size()=1 2024-09-12T19:29:41.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.346__shadow_.IhqqH8EdejfGPVeFMGwctb2z6HDCBLy_0 2024-09-12T19:29:41.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8573436971143401198', time=2024-09-12T20:47:56.672686+0000, chain.objs.size()=1 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.394__shadow:MabJIKMwPoxOssWDIjoC2sfafyObGE-_.jA-iDvGRDt2R1RGj3k0q86rrX7XjlOx_0 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6561689172153739839', time=2024-09-12T20:49:11.466768+0000, chain.objs.size()=1 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.432__shadow_.y9_Ej1feg1I5Z_8cxA2fSBinmhouoTk_0 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12848477919412343814', time=2024-09-12T20:49:22.295448+0000, chain.objs.size()=1 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.437__shadow_.b6azUE6DbEFQjAH5fAE_Vdwqup2ks7S_0 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5360419505385841065', time=2024-09-12T20:50:18.622822+0000, chain.objs.size()=1 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.460__shadow_.ksRJ7eYtk5XZXNpxuJb9Uz0Ljw7gH_C_0 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17797832201769214152', time=2024-09-12T20:50:30.499084+0000, chain.objs.size()=1 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.464__shadow_.rek66aYkAVGZUUgOVEkg620U4cBpwye_0 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15074656535625308563', time=2024-09-12T20:58:12.915941+0000, chain.objs.size()=2 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~jJ997YvsDtU3AwleJlxByNGiAk-laxn.1 2024-09-12T19:29:41.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~jJ997YvsDtU3AwleJlxByNGiAk-laxn.2 2024-09-12T19:29:41.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.319064059478847332', time=2024-09-12T21:01:23.601095+0000, chain.objs.size()=1 2024-09-12T19:29:41.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.551__shadow_.Qdj8tUSVYZxxCTR-wPEPhuAMRCPNye2_0 2024-09-12T19:29:41.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10977031326554332164', time=2024-09-12T21:02:36.125209+0000, chain.objs.size()=1 2024-09-12T19:29:41.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.559__shadow_.M16JeFwx2E9QKiEgf3wspBz6YsDTZUN_0 2024-09-12T19:29:41.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6054083066254238400', time=2024-09-12T21:04:23.453703+0000, chain.objs.size()=1 2024-09-12T19:29:41.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:VfXWUPAbi4ZfmsYgc2kCKHyC52q7pWa_.gPK5wm7cD57zCFUpSIN8ocM1s-IJtPP_0 2024-09-12T19:29:41.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.794513332530626494', time=2024-09-12T21:06:20.555478+0000, chain.objs.size()=1 2024-09-12T19:29:41.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.587__shadow:QeQMzJE2z1hZJbBPN1cwphSPnY3Ks0Y_.DSKXwHF-B-HivGo69vt63H8AR84915W_0 2024-09-12T19:29:41.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2571575674143168036', time=2024-09-12T21:13:36.727478+0000, chain.objs.size()=1 2024-09-12T19:29:41.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.629__shadow_.C3h7HgC7Pz6TfQdSQDJfauLyhr5C2vL_0 2024-09-12T19:29:41.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11281540725334569455', time=2024-09-12T21:17:37.774665+0000, chain.objs.size()=1 2024-09-12T19:29:41.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.719+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.709__shadow_.pAxPFj41bHwtcmBTosQfJCDO5z0UJsF_0 2024-09-12T19:29:41.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.723+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.723+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T19:29:41.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54769' 2024-09-12T19:29:41.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_DyvrEJb0m6RzSf-EGSNzRyIasSNudV7', time=2024-09-12T20:29:18.590999+0000, chain.objs.size()=3 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.KGXXUK5myzhYisYmWFDlUaEhxmjBwd8_0 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.KGXXUK5myzhYisYmWFDlUaEhxmjBwd8_1 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.KGXXUK5myzhYisYmWFDlUaEhxmjBwd8_2 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9650286940665733556', time=2024-09-12T20:35:27.882481+0000, chain.objs.size()=1 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.231__shadow_.QX1Unzr7rSa5piV_gteuiGuYL6v5COp_0 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11218376167804088348', time=2024-09-12T20:35:39.552050+0000, chain.objs.size()=1 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.236__shadow_.tAgeM1HgOxJ857jdAS1g3XzFdlB-Uv4_0 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.830553378777720399', time=2024-09-12T20:35:43.395462+0000, chain.objs.size()=1 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.237__shadow_.ukivVvTnXRH7ZyeUECs_WVh6j0JHfRN_0 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5385638131492077655', time=2024-09-12T20:36:03.355508+0000, chain.objs.size()=1 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.244__shadow_.932Mjq-tWXnf3ICeyAhsR0F2Ux3i5Dz_0 2024-09-12T19:29:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11170908262320662681', time=2024-09-12T20:36:07.881570+0000, chain.objs.size()=1 2024-09-12T19:29:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.246__shadow_.GwKX1bPzxfy8BtMoMcRXkgRxx4rt52M_0 2024-09-12T19:29:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15026899520745880512', time=2024-09-12T20:36:07.883814+0000, chain.objs.size()=1 2024-09-12T19:29:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.246__shadow_.UoH8YIIih619rbO0rCNUJSYxGuT8Chq_0 2024-09-12T19:29:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5531911119768785408', time=2024-09-12T20:38:22.623654+0000, chain.objs.size()=1 2024-09-12T19:29:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.naD8VLE5P8Md9FUHUFcOQ17J9ihE7gt_0 2024-09-12T19:29:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.924852844557805614', time=2024-09-12T20:38:23.910147+0000, chain.objs.size()=1 2024-09-12T19:29:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hD1VUE9JUjlLf88Miy3hQbLzRpMoSZs_0 2024-09-12T19:29:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5160614300128614384', time=2024-09-12T20:38:27.269050+0000, chain.objs.size()=1 2024-09-12T19:29:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.727+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.JUVSytG6QVfL_aCa6-5ZaczNgmGaXRC_0 2024-09-12T19:29:41.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5947965360015456465', time=2024-09-12T20:38:27.329890+0000, chain.objs.size()=1 2024-09-12T19:29:41.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Pid3xE5Ffj7pWB_FJAoYRlwIyFU7y1b_0 2024-09-12T19:29:41.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3279665597590595027', time=2024-09-12T20:38:27.777046+0000, chain.objs.size()=1 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Pr5hXHbEM26j2wEC4bKX8Fx-iByz0q5_0 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6991297357215359790', time=2024-09-12T20:38:28.648022+0000, chain.objs.size()=1 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ILRPFnL6qWFrN-GUo8NTtuydf7As_il_0 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9938979113838481269', time=2024-09-12T20:38:28.921472+0000, chain.objs.size()=1 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5mDHFSBNUMH-Iteb2eq9CsS3A-5uc1E_0 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17985612592056651878', time=2024-09-12T20:38:31.524587+0000, chain.objs.size()=1 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.bCq76Xd-PR_GZvrE1D8h37ngj8lh5Ao_0 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3605610108933745064', time=2024-09-12T20:38:32.193933+0000, chain.objs.size()=1 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.UBE7pyMMeMBjYC3PoAc3iMNPRxn4js1_0 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3188048819441571814', time=2024-09-12T20:38:32.400586+0000, chain.objs.size()=1 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.98D_q0dzOqO6BwjoQ4NAlWV0N6lTG1p_0 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12724428401852380984', time=2024-09-12T20:38:32.750114+0000, chain.objs.size()=1 2024-09-12T19:29:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vYBtd9m7zdromZHiCv3fIZ6p5SqcM7G_0 2024-09-12T19:29:41.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2786765312799089846', time=2024-09-12T20:38:32.940289+0000, chain.objs.size()=1 2024-09-12T19:29:41.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.LCCvvhBApo5JFt0gkmF5E844IockC6i_0 2024-09-12T19:29:41.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18200009395020263394', time=2024-09-12T20:38:33.096245+0000, chain.objs.size()=1 2024-09-12T19:29:41.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5t57Qn3Z9aJkZI1G60ndvmH9K2JastC_0 2024-09-12T19:29:41.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6288856130912338352', time=2024-09-12T20:38:33.098236+0000, chain.objs.size()=1 2024-09-12T19:29:41.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.gEgE9hpq2QsW5OUyfliT0aUk35vwNb7_0 2024-09-12T19:29:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9199513034088060602', time=2024-09-12T20:38:34.036840+0000, chain.objs.size()=1 2024-09-12T19:29:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AW6Z04B-kY5xrt6KQpUCbrJnSGj55NS_0 2024-09-12T19:29:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6914944705194636934', time=2024-09-12T20:38:34.465881+0000, chain.objs.size()=1 2024-09-12T19:29:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rYN0kA4rKRU8QBe369in9Kjv5Su3m0r_0 2024-09-12T19:29:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2761153631832407507', time=2024-09-12T20:38:35.514422+0000, chain.objs.size()=1 2024-09-12T19:29:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.VZkVXsCRR5JOnOFnA1juxSF2iJPFM5c_0 2024-09-12T19:29:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5311251052276096093', time=2024-09-12T20:38:35.536912+0000, chain.objs.size()=1 2024-09-12T19:29:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.bGJn9lOKwN3hh0sM_q4bxtpSEnqg3ob_0 2024-09-12T19:29:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18353597212225436227', time=2024-09-12T20:38:35.656177+0000, chain.objs.size()=1 2024-09-12T19:29:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.F4udKX6O4vSsEcNpTrop9iEAOKtKCPs_0 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5775111899630173136', time=2024-09-12T20:38:36.619242+0000, chain.objs.size()=1 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qsDEVodC8Dgs0gJa2nQL0JAHxQFitod_0 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6538642824360864411', time=2024-09-12T20:38:36.745054+0000, chain.objs.size()=1 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.79dOvQJxqfmpV1vVdqlO1qvmbQ-etU4_0 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16102315544085631249', time=2024-09-12T20:38:38.178992+0000, chain.objs.size()=1 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ee4O6mxRaQ3Lf5q0FRe9MYOuSEtNWTH_0 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4196646699779925006', time=2024-09-12T20:38:38.501457+0000, chain.objs.size()=1 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.p6f6ckUkAB2QBw_v2VoxOGYva6Sok0F_0 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7716311637243885015', time=2024-09-12T20:38:38.895026+0000, chain.objs.size()=1 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.731+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Z4QedaetdcGRBWpYYxkuYS-KXy5frF5_0 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17511913710116722957', time=2024-09-12T20:38:38.981309+0000, chain.objs.size()=1 2024-09-12T19:29:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vg3i2JmWTMdvc5yi9Be5ZMPfVq5H9lW_0 2024-09-12T19:29:41.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3243363719498252744', time=2024-09-12T20:38:39.427653+0000, chain.objs.size()=1 2024-09-12T19:29:41.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.JelFDoGxla9R7r0ar6cPUQ2G7d3fcfG_0 2024-09-12T19:29:41.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3444716181651963137', time=2024-09-12T20:38:39.741709+0000, chain.objs.size()=1 2024-09-12T19:29:41.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vNww9d-MNm9IjWP79zwc_DtIcJJU-Io_0 2024-09-12T19:29:41.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7160235511954518665', time=2024-09-12T20:38:39.834800+0000, chain.objs.size()=1 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.npGwWAS70arIuUHHV2Otg0Rx9_e62MP_0 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10412067463547105937', time=2024-09-12T20:38:41.324945+0000, chain.objs.size()=1 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CL9P85hYykv5_dpvkjMpd8HoBKuH7DN_0 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15848592776514082967', time=2024-09-12T20:38:42.035797+0000, chain.objs.size()=1 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.70Tn7SL1m5VwFCgeONxj_6Y8FhZUjE1_0 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17125286576236789663', time=2024-09-12T20:38:42.100066+0000, chain.objs.size()=1 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0h4wfSA0DXNHRnuJ1cMkEcCfWG_tfjC_0 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14464316477673522630', time=2024-09-12T20:38:42.385271+0000, chain.objs.size()=1 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GNdIXgz7-AHxnQtVSAwTEDYlrUTpe85_0 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4105656890830690114', time=2024-09-12T20:38:42.827871+0000, chain.objs.size()=1 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.TiUhz5mrEwUP0S2EnBWLRmrx8XUeBYl_0 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7855190802935464536', time=2024-09-12T20:38:42.999366+0000, chain.objs.size()=1 2024-09-12T19:29:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aVI06HhtNVWaXiWbQW2L6nZTDIN4ghI_0 2024-09-12T19:29:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9063551187632036957', time=2024-09-12T20:38:43.099432+0000, chain.objs.size()=1 2024-09-12T19:29:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.LXog9E10vbT17BwHrMnBuwPm2eLTQMv_0 2024-09-12T19:29:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7541045144416921535', time=2024-09-12T20:38:45.982308+0000, chain.objs.size()=1 2024-09-12T19:29:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.735+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.y78rMiLxBCxNfmehpZdPdpNQ7FoQmtS_0 2024-09-12T19:29:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12566919581682365082', time=2024-09-12T20:38:46.267525+0000, chain.objs.size()=1 2024-09-12T19:29:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.zai5QVKcFIWBRQuN4EgZhfPna6XVOn8_0 2024-09-12T19:29:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1108734991090201165', time=2024-09-12T20:38:48.291527+0000, chain.objs.size()=1 2024-09-12T19:29:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Yrm31DwU0PSPpBQrdfDTtGpkD7gLwN__0 2024-09-12T19:29:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5648659015528085914', time=2024-09-12T20:38:48.387585+0000, chain.objs.size()=1 2024-09-12T19:29:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.gcmBF2-DMZjS8LUQdKIE7xRHrIo6Vbt_0 2024-09-12T19:29:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6058738540144063323', time=2024-09-12T20:38:48.787132+0000, chain.objs.size()=1 2024-09-12T19:29:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.NEi3mjT1MO0h1RMwmVc5mdpuIhwz8eA_0 2024-09-12T19:29:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15472647788780628126', time=2024-09-12T20:38:49.008460+0000, chain.objs.size()=1 2024-09-12T19:29:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EWFsUINKLvGNjYt9Yredqw9OC3t1a2W_0 2024-09-12T19:29:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9415066386305722017', time=2024-09-12T20:38:49.846401+0000, chain.objs.size()=1 2024-09-12T19:29:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.3e2CNpXLIisEEbASYy8mWFV1dGV48RK_0 2024-09-12T19:29:41.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3877174061159873994', time=2024-09-12T20:38:50.033605+0000, chain.objs.size()=1 2024-09-12T19:29:41.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QWHQUhlMoKxmLr4lE_OqBrllmikwue4_0 2024-09-12T19:29:41.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16115072089769824030', time=2024-09-12T20:38:50.278144+0000, chain.objs.size()=1 2024-09-12T19:29:41.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CS8V8ULlT47d7UNDrPBc9muqEqc99YX_0 2024-09-12T19:29:41.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16377153689320129660', time=2024-09-12T20:38:50.280114+0000, chain.objs.size()=1 2024-09-12T19:29:41.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.w8iFypGenvCXIozOQptE9OuOyeMwXqt_0 2024-09-12T19:29:41.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13626297983590618498', time=2024-09-12T20:38:54.979882+0000, chain.objs.size()=1 2024-09-12T19:29:41.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.264__shadow_.aKOSnEN1D6L0Kazl56H29zswmXrdYTL_0 2024-09-12T19:29:41.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11770488159729513577', time=2024-09-12T20:40:01.890411+0000, chain.objs.size()=1 2024-09-12T19:29:41.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.CxVPoTqleyQBWUbp91Bnzv3sE6q-dt0_0 2024-09-12T19:29:41.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18166041671677928960', time=2024-09-12T20:40:01.892276+0000, chain.objs.size()=1 2024-09-12T19:29:41.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.baTwaob7idVSWeN1FXVCFblCdJTp5_Q_0 2024-09-12T19:29:41.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15585195379813635224', time=2024-09-12T20:40:07.437811+0000, chain.objs.size()=1 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.Y057QxPxGgJTGO9vwSOqQkpxDowqR3I_0 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12946887670994716777', time=2024-09-12T20:40:07.834796+0000, chain.objs.size()=1 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.S30p9OqFTrQ2HcDgY3OTaFEFw3kR7QM_0 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13702673800698727865', time=2024-09-12T20:40:21.922682+0000, chain.objs.size()=1 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.299__shadow_.ri0K-j3bx8cCfqCHeI4Kr3sYQtwg2PD_0 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12976062282848175806', time=2024-09-12T20:40:26.622473+0000, chain.objs.size()=1 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.301__shadow_.U9lm3rJQzcF0pWQ_NDtBkHUA6UZJUax_0 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11001553357201076461', time=2024-09-12T20:40:41.888437+0000, chain.objs.size()=1 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.307__shadow:8OTxPc54U9dz01gAR.tLDtnEalnORX5_.mqvDp8AfPJfSaJX3ecrztl8Wk_6DDxk_0 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11772470386400284692', time=2024-09-12T20:43:07.689484+0000, chain.objs.size()=1 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6biDg97nyc4T7trDem-ybjHjxaJLOuT_0 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14829140795372961900', time=2024-09-12T20:43:08.482820+0000, chain.objs.size()=1 2024-09-12T19:29:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gfMt2hBOTzYMvGWc47pEUAi5yVYgsMV_0 2024-09-12T19:29:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9763921980830714371', time=2024-09-12T20:43:10.015242+0000, chain.objs.size()=1 2024-09-12T19:29:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.kMiNShflpvXNGLAEqGGbaDUHgPuteNS_0 2024-09-12T19:29:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3956817731855015586', time=2024-09-12T20:43:10.338522+0000, chain.objs.size()=1 2024-09-12T19:29:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.739+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.i6OxKzJatbU_NpNjg20mZ9nqBfVKH1k_0 2024-09-12T19:29:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8856116952655049960', time=2024-09-12T20:43:10.854637+0000, chain.objs.size()=1 2024-09-12T19:29:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6SFpPo60im66y-OpUUvhbIPXofo4rDP_0 2024-09-12T19:29:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.794462559177416215', time=2024-09-12T20:43:11.266519+0000, chain.objs.size()=1 2024-09-12T19:29:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AN-XHV7EhSbO_DpVE7ErbjH3--wuuyN_0 2024-09-12T19:29:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11261543156017497104', time=2024-09-12T20:43:11.268216+0000, chain.objs.size()=1 2024-09-12T19:29:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IyjkUqZaLMjFZVuTBc-54GF__DVaaau_0 2024-09-12T19:29:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3609114460303181626', time=2024-09-12T20:43:13.612645+0000, chain.objs.size()=1 2024-09-12T19:29:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.wQO_8Vc2VOsSt53rnehkUOjVMlTO2-V_0 2024-09-12T19:29:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11470206738366390246', time=2024-09-12T20:43:14.018430+0000, chain.objs.size()=1 2024-09-12T19:29:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.x9QNK2ZR1tfB0KLW_cYnb2eQvvl2ula_0 2024-09-12T19:29:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7341758184706548691', time=2024-09-12T20:43:15.669608+0000, chain.objs.size()=1 2024-09-12T19:29:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AI-6l0GHb2q68LQQEg4x6cPlhANXwDX_0 2024-09-12T19:29:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8691989456630967953', time=2024-09-12T20:43:15.972807+0000, chain.objs.size()=1 2024-09-12T19:29:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.adLiN9QLPgVL4s5-x4fOhgn1TsyL_OF_0 2024-09-12T19:29:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7580232371905592689', time=2024-09-12T20:43:18.423868+0000, chain.objs.size()=1 2024-09-12T19:29:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3ktNHm9-KUpwMhZ_OYvN2d4ljvv7co7_0 2024-09-12T19:29:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8746445530453918352', time=2024-09-12T20:43:20.049539+0000, chain.objs.size()=1 2024-09-12T19:29:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.1zIISrC05-_0pyj70exnvnMOq7T8eum_0 2024-09-12T19:29:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14477245544954107619', time=2024-09-12T20:43:20.851218+0000, chain.objs.size()=1 2024-09-12T19:29:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.DWHkA4xALseZjJn2A1Un-C8DJ6_ba41_0 2024-09-12T19:29:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14725409486127724751', time=2024-09-12T20:43:21.580431+0000, chain.objs.size()=1 2024-09-12T19:29:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.8cZmvqshWTiK7DmRtHBYSShmx9xvgrv_0 2024-09-12T19:29:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15004748854589493195', time=2024-09-12T20:43:22.777199+0000, chain.objs.size()=1 2024-09-12T19:29:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.mzWieGV2S7_tnAGwjB2hx7Dm8zqpiu1_0 2024-09-12T19:29:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14521826928505957077', time=2024-09-12T20:43:24.820928+0000, chain.objs.size()=1 2024-09-12T19:29:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9qS5EmIuUjdcPr5GYw0pxqS7hA6DXkg_0 2024-09-12T19:29:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18021922336443153500', time=2024-09-12T20:43:25.033219+0000, chain.objs.size()=1 2024-09-12T19:29:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.47b4ZDoyvlPmf1EjsyJX55fOAitvlwU_0 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18271990650953619138', time=2024-09-12T20:43:28.699168+0000, chain.objs.size()=1 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xLbfKfUh72BaRgcA6t1B8ztdoPKZU7c_0 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6863412307208583291', time=2024-09-12T20:43:29.175166+0000, chain.objs.size()=1 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TAiautcAatv9uWVPEB8HONmsh5w_n3B_0 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3361625205789418475', time=2024-09-12T20:43:29.505918+0000, chain.objs.size()=1 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nTQgD3uiOVS2L1TvJN16eMs9ryQbveM_0 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6300729295842621000', time=2024-09-12T20:43:29.606711+0000, chain.objs.size()=1 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.NZ_3LX5HlH8pFVZthg8sWXJnEC7Bi45_0 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12664413009853878892', time=2024-09-12T20:43:30.073185+0000, chain.objs.size()=1 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.MHzaducmpj14gB5sNDQdvnPIRFuRvzX_0 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5757261607426171315', time=2024-09-12T20:45:11.604345+0000, chain.objs.size()=1 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.743+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6baeqhx77fw3eRPhAsW7hEMrP3wegRu_0 2024-09-12T19:29:41.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8740625432708357057', time=2024-09-12T20:45:12.034161+0000, chain.objs.size()=1 2024-09-12T19:29:41.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.s2ymQF7l1LbAIFM99DLfqHMr5qg_PYn_0 2024-09-12T19:29:41.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18076913709114071815', time=2024-09-12T20:45:13.563461+0000, chain.objs.size()=1 2024-09-12T19:29:41.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3FQetLQLCiVak0uIajnwUrp9Yxy-NnY_0 2024-09-12T19:29:41.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10257875101341875009', time=2024-09-12T20:45:15.805128+0000, chain.objs.size()=1 2024-09-12T19:29:41.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.naIjLWgIBN6ghemlQlb6qoPT1Kg7L0m_0 2024-09-12T19:29:41.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2930096343567527648', time=2024-09-12T20:45:16.599595+0000, chain.objs.size()=1 2024-09-12T19:29:41.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.NTkoPSASk50N9o1Anps8XJW0ej6yjcL_0 2024-09-12T19:29:41.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14408755424672400675', time=2024-09-12T20:45:18.516308+0000, chain.objs.size()=1 2024-09-12T19:29:41.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zWNR5n-2nUCpTyGxFOSDW5o-oXSPi4H_0 2024-09-12T19:29:41.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16836493599392761324', time=2024-09-12T20:45:19.296374+0000, chain.objs.size()=1 2024-09-12T19:29:41.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FrGmFLAnTrVYwmds8TqQxHdDMfc5c4s_0 2024-09-12T19:29:41.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4181897535670285849', time=2024-09-12T20:45:19.840419+0000, chain.objs.size()=1 2024-09-12T19:29:41.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3pA-Ee5nat-3kzMmHuDs__iOvr8BxXm_0 2024-09-12T19:29:41.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2612162223664600285', time=2024-09-12T20:45:19.863616+0000, chain.objs.size()=1 2024-09-12T19:29:41.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.acyXuORZrxGNXzqz5pAAkvHwTzMYFk3_0 2024-09-12T19:29:41.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15503050914775800730', time=2024-09-12T20:45:20.205360+0000, chain.objs.size()=1 2024-09-12T19:29:41.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.RHxn0g1O71QDMli1O41ZIHS1RsvKENn_0 2024-09-12T19:29:41.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2970381308862826036', time=2024-09-12T20:45:20.276796+0000, chain.objs.size()=1 2024-09-12T19:29:41.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.F8nNAL0gJ9rC5hsNNM5gl0dqIwxdfRC_0 2024-09-12T19:29:41.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9279273831605426074', time=2024-09-12T20:45:20.391504+0000, chain.objs.size()=1 2024-09-12T19:29:41.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.IaiAmMTlZWfhKwvV_oC_Fgi6qB0eI-L_0 2024-09-12T19:29:41.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13897907488596373271', time=2024-09-12T20:45:22.044726+0000, chain.objs.size()=1 2024-09-12T19:29:41.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5BvHuSwrg9Fc_213KjBlQGY9Gjtyg_1_0 2024-09-12T19:29:41.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14959253071787207278', time=2024-09-12T20:45:22.077580+0000, chain.objs.size()=1 2024-09-12T19:29:41.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.747+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.b3jzA1-8EqNkITO69h5wFYzixtQGz7w_0 2024-09-12T19:29:41.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.751+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10600935429669027301', time=2024-09-12T20:45:23.146851+0000, chain.objs.size()=1 2024-09-12T19:29:41.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.751+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pc-75t1vyIEW4WKxXqx1hAEeXVoSLTJ_0 2024-09-12T19:29:41.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.751+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15344276422263732994', time=2024-09-12T20:45:23.372386+0000, chain.objs.size()=1 2024-09-12T19:29:41.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.751+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.-s3n3UPCoRQ3yg200mxDYXjMHaMxYTT_0 2024-09-12T19:29:41.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.751+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2965606874185390372', time=2024-09-12T20:45:23.710312+0000, chain.objs.size()=1 2024-09-12T19:29:41.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.751+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3kWvyNBl71hwvzls_pjGAgyFOgdeKLx_0 2024-09-12T19:29:41.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.751+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54769 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3878163708826183573', time=2024-09-12T20:45:23.896108+0000, chain.objs.size()=1 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lfPkvBRqZOMhdlSTtRpb91-qlWoJIlJ_0 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10006350184519065407', time=2024-09-12T20:45:23.964038+0000, chain.objs.size()=1 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qWPFZVKWTQIlDwjh8oR-1s79FtOtcJK_0 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4769546715136730504', time=2024-09-12T20:45:24.031572+0000, chain.objs.size()=1 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1itByAWP7oqwZV1bOaS9tN099ac09ro_0 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5758796552702557978', time=2024-09-12T20:45:25.858939+0000, chain.objs.size()=1 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2Phzz3MIbAoo7wTmg8LkL1FZ15XQrnN_0 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10066541373052150532', time=2024-09-12T20:45:26.860956+0000, chain.objs.size()=1 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oZ97ZO1RviRFFqZ3meMRJyAW8pg7n88_0 2024-09-12T19:29:41.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4575752539742840894', time=2024-09-12T20:45:27.517259+0000, chain.objs.size()=1 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8QnJZImIormBW0ZUtfIXRKtB3qEyYAK_0 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12124177636039464735', time=2024-09-12T20:45:27.782628+0000, chain.objs.size()=1 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8MDsndrgTjrm3h3Q0aUI1wKzVz8Jh6E_0 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12346095851032635378', time=2024-09-12T20:45:29.555452+0000, chain.objs.size()=1 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.TmmaRotEcHHxuFqGs4LIYt28fgDqXkx_0 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3529140321500796517', time=2024-09-12T20:45:30.110390+0000, chain.objs.size()=1 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3xkmMkCPfyjMsrDfmLeh_5JiKErTuLK_0 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11602233335339548814', time=2024-09-12T20:45:31.177999+0000, chain.objs.size()=1 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.KAXuSTd2TrFIEsGazNhd3SD1Nn3RGgy_0 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15224554302801856212', time=2024-09-12T20:45:33.222778+0000, chain.objs.size()=1 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fNsBllglTJO1uzqaIxw64tIww-cVzUj_0 2024-09-12T19:29:41.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9726160953490474060', time=2024-09-12T20:45:33.661103+0000, chain.objs.size()=1 2024-09-12T19:29:41.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.TdKzPQAp80nKJkm7MGRS5qRONvmNcVY_0 2024-09-12T19:29:41.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.593705446426824171', time=2024-09-12T20:45:34.040780+0000, chain.objs.size()=1 2024-09-12T19:29:41.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._gFSGlyhiRmor8y0B7358yBQzFetPle_0 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.870661712160759537', time=2024-09-12T20:45:34.043030+0000, chain.objs.size()=1 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DP6eBmAIX_r4X8rx3Hkn5fpVYg1dXp1_0 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11987236059074223465', time=2024-09-12T20:45:34.372210+0000, chain.objs.size()=1 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.iP3ieyuO-U24jyd-ZQZkHMse1owWqFJ_0 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4892239044622820099', time=2024-09-12T20:45:34.646698+0000, chain.objs.size()=1 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.e1hxDP8-NqG4PRf7ydsszRP-5ELOsY__0 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.168230042234753949', time=2024-09-12T20:45:35.333655+0000, chain.objs.size()=1 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3HeaArihoR8ldtp5EZN5Pb3RmqbdncJ_0 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6899445011151628389', time=2024-09-12T20:45:36.247458+0000, chain.objs.size()=1 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YwArUbTLea1iG1bhrckxymPd3zwHR76_0 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7842376175954036723', time=2024-09-12T20:45:36.981816+0000, chain.objs.size()=1 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.TZALNo3Ok_2qt5BpBC_MzNFZPIJacnq_0 2024-09-12T19:29:41.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12880285313133837578', time=2024-09-12T20:45:37.727111+0000, chain.objs.size()=1 2024-09-12T19:29:41.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.LvaOFddtkQbOFU19MweVohtkEmv1Vsj_0 2024-09-12T19:29:41.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17155200671281287848', time=2024-09-12T20:45:38.120300+0000, chain.objs.size()=1 2024-09-12T19:29:41.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uU3pP6Nxsnr-dOmtZnt_p42awYRM-d2_0 2024-09-12T19:29:41.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8226122592596118267', time=2024-09-12T20:46:07.723015+0000, chain.objs.size()=1 2024-09-12T19:29:41.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.339__shadow_.OD5lNBXV1Jmg5h1cBmOAdYL5hCFKul__0 2024-09-12T19:29:41.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9520457762793739421', time=2024-09-12T21:01:22.395096+0000, chain.objs.size()=1 2024-09-12T19:29:41.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.755+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.551__shadow_.FbORVqEAoWmDO6o_PHFCAYUToo7IGvQ_0 2024-09-12T19:29:41.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1673262535692872311', time=2024-09-12T21:03:13.511667+0000, chain.objs.size()=1 2024-09-12T19:29:41.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:JXhTJbWFQb9kGHcBsECL7Y4pWi2nzKl_.F-mg2iG0Re_XpBB3S8XsZ4OjcI0sqQu_0 2024-09-12T19:29:41.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14530368310908238949', time=2024-09-12T21:03:54.986344+0000, chain.objs.size()=1 2024-09-12T19:29:41.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.575__shadow:.4hL7NiTIMnXmKx5uu5ZLrdaRiLA9Z._.pAWqbGufrAMkk26aIh38zAfJCrUtOkZ_0 2024-09-12T19:29:41.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.108184928829982337', time=2024-09-12T21:04:19.129919+0000, chain.objs.size()=1 2024-09-12T19:29:41.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:uqMJD42ezgL-1QyBTobF4be6g60wTTa_.e8ezjq0MDNexIO_P025EEqYHerb-ca2_0 2024-09-12T19:29:41.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3592265339252936988', time=2024-09-12T21:04:25.713955+0000, chain.objs.size()=1 2024-09-12T19:29:41.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:gzGS4C82WBhgwcfQ79ycRQ-X9SlFE8Q_.B0AWnzORBCzVDYnpyKRSikeqC_rmctq_0 2024-09-12T19:29:41.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11284431976076798', time=2024-09-12T21:05:43.595040+0000, chain.objs.size()=4 2024-09-12T19:29:41.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~vHg1zoKuE5igAKSk3xPVR2d9K5le3TZ.1 2024-09-12T19:29:41.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~vHg1zoKuE5igAKSk3xPVR2d9K5le3TZ.2 2024-09-12T19:29:41.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~vHg1zoKuE5igAKSk3xPVR2d9K5le3TZ.3 2024-09-12T19:29:41.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~vHg1zoKuE5igAKSk3xPVR2d9K5le3TZ.4 2024-09-12T19:29:41.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11165543207036122980', time=2024-09-12T21:05:54.455136+0000, chain.objs.size()=1 2024-09-12T19:29:41.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.579__shadow:s-nT6Nw.hvrNIsO5zLgFmpsHpcPTSFE_.Aq2dp5h3xtKa-OwuGiJypayMQ1FAfjv_0 2024-09-12T19:29:41.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16337389606702241393', time=2024-09-12T21:06:00.472199+0000, chain.objs.size()=1 2024-09-12T19:29:41.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.580__shadow:vgSg4KMLp7KtXsz8K40IhU-hQfBgGp4_.W-XrT-8iI2jqeG0wwVf0_iMhy2AaZEV_0 2024-09-12T19:29:41.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4165417625782957301', time=2024-09-12T21:06:01.297135+0000, chain.objs.size()=1 2024-09-12T19:29:41.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.580__shadow:9SWHMK07uNKho9mrs5hZW6QVRnub9M3_.5irZmJ5WJpUMkHim7JCRTUYZaxK8I4I_0 2024-09-12T19:29:41.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16656824831569400239', time=2024-09-12T21:14:05.625296+0000, chain.objs.size()=1 2024-09-12T19:29:41.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.642__shadow_.MI1MZC8OjrJswIuks7F8CQbrMu1V3NZ_0 2024-09-12T19:29:41.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1296610934410311932', time=2024-09-12T21:16:19.679011+0000, chain.objs.size()=1 2024-09-12T19:29:41.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.759+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.668__shadow_.MjucuqtzzLjuBc6YbB4EOMrnYvYWGpz_0 2024-09-12T19:29:41.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.763+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T19:29:41.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51828' 2024-09-12T19:29:41.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6776072710007053174', time=2024-09-12T20:38:24.495307+0000, chain.objs.size()=1 2024-09-12T19:29:41.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CeuqNHAGD8K3A58-WZ3hWUD64GzK6Re_0 2024-09-12T19:29:41.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16335831747596021220', time=2024-09-12T20:38:25.180247+0000, chain.objs.size()=1 2024-09-12T19:29:41.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.yWLjrbtht5ghcfOCtPPMquiE23JvV0C_0 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7632421651625244490', time=2024-09-12T20:38:26.899592+0000, chain.objs.size()=1 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.pp2ejYsOQJTKWJMQaCk2TuFbRHEhkjB_0 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17238798543150775436', time=2024-09-12T20:38:28.009376+0000, chain.objs.size()=1 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CZWi_ayoSjL-V-1IE9Ar3XHfZMQwouh_0 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5182969217200603790', time=2024-09-12T20:38:29.044967+0000, chain.objs.size()=1 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.cVoT0egCkByN0AjlcMhc29xlXeW-mxL_0 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4127414188591582350', time=2024-09-12T20:38:29.046446+0000, chain.objs.size()=1 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QAghqcaF3M6QV_FHqqzszwJ1unlfEzE_0 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16444200955587375940', time=2024-09-12T20:38:31.153303+0000, chain.objs.size()=1 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.K30m_TWAK6W2pbYnGrPRXcq0qPr7zE9_0 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17244532105218082643', time=2024-09-12T20:38:31.297183+0000, chain.objs.size()=1 2024-09-12T19:29:41.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GR7fnlB7AZxwAC9HtI2EdweGRJUkD4o_0 2024-09-12T19:29:41.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9154301009110631387', time=2024-09-12T20:38:31.426127+0000, chain.objs.size()=1 2024-09-12T19:29:41.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.L8hgto5-G3N0PeqQd8uJDCS9NmXPlZ9_0 2024-09-12T19:29:41.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8053842641534329471', time=2024-09-12T20:38:32.233320+0000, chain.objs.size()=1 2024-09-12T19:29:41.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.h3swaNFn_EWlelcfNq445GvBJq97Fvg_0 2024-09-12T19:29:41.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7827437490634402604', time=2024-09-12T20:38:32.568278+0000, chain.objs.size()=1 2024-09-12T19:29:41.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QkGuj01hrOOUnDGX155GnldQOtMYVgZ_0 2024-09-12T19:29:41.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3820228984919218116', time=2024-09-12T20:38:33.106015+0000, chain.objs.size()=1 2024-09-12T19:29:41.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.767+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7mvAijX2KXF1Zqru8B8TmAlJohRQKOc_0 2024-09-12T19:29:41.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6920543552411010192', time=2024-09-12T20:38:33.949720+0000, chain.objs.size()=1 2024-09-12T19:29:41.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZVMqpdmAeAGb5IddbGfQ2hVB5f2WrP6_0 2024-09-12T19:29:41.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12545449084754505061', time=2024-09-12T20:38:35.058767+0000, chain.objs.size()=1 2024-09-12T19:29:41.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MdCGC9Qj8-jpHSFhfxenNsVu3Bg5BCh_0 2024-09-12T19:29:41.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10312099958086034998', time=2024-09-12T20:38:35.586961+0000, chain.objs.size()=1 2024-09-12T19:29:41.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.e19N1d-jyNI9LGxjc7xff9OHt9RbG2A_0 2024-09-12T19:29:41.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13177510899334669274', time=2024-09-12T20:38:35.957744+0000, chain.objs.size()=1 2024-09-12T19:29:41.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.s9ekerw7kJ7LpWZFE6fFdGLehgo8z3k_0 2024-09-12T19:29:41.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13965059767635771251', time=2024-09-12T20:38:38.100650+0000, chain.objs.size()=1 2024-09-12T19:29:41.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.LZW5DWWHDTBwsCuJWolutEyEsDMIW8J_0 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3259861556719362936', time=2024-09-12T20:38:38.148930+0000, chain.objs.size()=1 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Vz0_CG-dXUJR7LtQnoqJ828YvRatxiS_0 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9976039572843408043', time=2024-09-12T20:38:38.428171+0000, chain.objs.size()=1 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GrtmEYcEiFOClbHolaCsY3EGkC4RZ_7_0 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6073096947218758247', time=2024-09-12T20:38:38.586634+0000, chain.objs.size()=1 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.S-82S00dK1uCdNNeTGartFRiNmEWpqQ_0 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13589320542658220604', time=2024-09-12T20:38:38.972202+0000, chain.objs.size()=1 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.6fMxs9NrlJRcFqQMIMkvjLNBh3lwj2i_0 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9725572330058774507', time=2024-09-12T20:38:39.476156+0000, chain.objs.size()=1 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GKxqPiZu2J-UwTWSR-8gpZSnMuHqB0l_0 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9513527516836433005', time=2024-09-12T20:38:39.681541+0000, chain.objs.size()=1 2024-09-12T19:29:41.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0Q9yZx9ZTAFbjLbp4cl3Jo-K9d8o-Gt_0 2024-09-12T19:29:41.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12682950684740412830', time=2024-09-12T20:38:39.743730+0000, chain.objs.size()=1 2024-09-12T19:29:41.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-q-8c65Fzt2s27ZRjouWsZi831QICW3_0 2024-09-12T19:29:41.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4874771896564673432', time=2024-09-12T20:38:39.963796+0000, chain.objs.size()=1 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.sWg1g1mxsgL5Co6rgpGVknRZiHBYXVh_0 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8079326634271560077', time=2024-09-12T20:38:43.025499+0000, chain.objs.size()=1 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RqO5dBrX_mE2uu6PZF5EEqVo8DLEc6v_0 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14708605776122076057', time=2024-09-12T20:38:43.250718+0000, chain.objs.size()=1 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.zrW-8j5KR8sQ1ofa86b7EV1a9XHdarR_0 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3179453320027891148', time=2024-09-12T20:38:43.618831+0000, chain.objs.size()=1 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._HxJx06kEFQEeDHwT8pNWQ0sd2gO70P_0 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8954883337490168986', time=2024-09-12T20:38:43.763294+0000, chain.objs.size()=1 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.bhMMRiuVsw7NMmKPyTa9mR-ET8ivsjx_0 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7775301421680975237', time=2024-09-12T20:38:43.765684+0000, chain.objs.size()=1 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wQr8HbakgvbMZTAfVXKRAByUunD0YZ8_0 2024-09-12T19:29:41.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16720059528612193585', time=2024-09-12T20:38:44.773936+0000, chain.objs.size()=1 2024-09-12T19:29:41.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dQe2a69KSts6Nb2CcSuj7bRtL4wB0sk_0 2024-09-12T19:29:41.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12590537972055942450', time=2024-09-12T20:38:45.062362+0000, chain.objs.size()=1 2024-09-12T19:29:41.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.KnOuiV5_m4nVxLB1-W0MoAV5hRgyKQu_0 2024-09-12T19:29:41.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6406091118429404218', time=2024-09-12T20:38:46.189906+0000, chain.objs.size()=1 2024-09-12T19:29:41.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZN0w5G0116KJq4pntHMv2TluUgC4-oW_0 2024-09-12T19:29:41.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17193509575379615684', time=2024-09-12T20:38:46.834839+0000, chain.objs.size()=1 2024-09-12T19:29:41.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.771+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Xg-TNOE1GRLEwSH3LBWzEpAKeFro37Z_0 2024-09-12T19:29:41.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.807376117209729638', time=2024-09-12T20:38:47.044102+0000, chain.objs.size()=1 2024-09-12T19:29:41.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0ixHg2fRceZIRt7NlZzljq_VF4HJNGp_0 2024-09-12T19:29:41.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14327906623967978225', time=2024-09-12T20:38:48.396764+0000, chain.objs.size()=1 2024-09-12T19:29:41.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7UyUu6R5Im6xd9pCj96Gh0OVt8a2G6N_0 2024-09-12T19:29:41.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18250776589202352300', time=2024-09-12T20:38:49.219459+0000, chain.objs.size()=1 2024-09-12T19:29:41.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AS9yOrDdpv37NadW_tot2GNDHD0Kq3v_0 2024-09-12T19:29:41.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7880555905752616156', time=2024-09-12T20:38:50.297672+0000, chain.objs.size()=1 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.znctaRgW61cJx4N72g--K2K3Bit0SGs_0 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2402731571333865555', time=2024-09-12T20:39:05.911871+0000, chain.objs.size()=1 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.269__shadow_.chqJqiaKNGpwxdr2BqZvh1Caj3enHMh_0 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16213605960435879034', time=2024-09-12T20:39:46.998122+0000, chain.objs.size()=1 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.287__shadow_.gzsSfHnRJpoAUCmDeoYLrCPpYeC9F14_0 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14690036015431273846', time=2024-09-12T20:40:07.688311+0000, chain.objs.size()=1 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.SUXTgfj8EuI-VaCmE6o3G9vT_PDHlpL_0 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6436222686549793613', time=2024-09-12T20:41:21.066190+0000, chain.objs.size()=1 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.322__shadow_.AwcFMe4LNjeHdTDfE1RlPaeG4bGfQpH_0 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4031342414310023576', time=2024-09-12T20:43:03.363089+0000, chain.objs.size()=1 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4bHw3Ji7MQBEjGymIY0PgUTJi23l54e_0 2024-09-12T19:29:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15144823817253401642', time=2024-09-12T20:43:07.564120+0000, chain.objs.size()=1 2024-09-12T19:29:41.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.THLfQElh08GMkLgeH7-zj_krxlICrpZ_0 2024-09-12T19:29:41.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7974147207488268767', time=2024-09-12T20:43:08.259690+0000, chain.objs.size()=1 2024-09-12T19:29:41.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.775+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EA2exIvi5v-g6v9DVfqrtYc5HXAwHhm_0 2024-09-12T19:29:41.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5176313503406207988', time=2024-09-12T20:43:11.101462+0000, chain.objs.size()=1 2024-09-12T19:29:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.WbZruHpOwos-W2gqhl12FFxik1jVtK0_0 2024-09-12T19:29:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3868555018698710283', time=2024-09-12T20:43:11.443696+0000, chain.objs.size()=1 2024-09-12T19:29:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VV6xvu_KR-z-2kwb4bD3uGLwDn4rCVb_0 2024-09-12T19:29:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12785001199068497368', time=2024-09-12T20:43:11.885148+0000, chain.objs.size()=1 2024-09-12T19:29:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6doaBMnRdTb35XWSDbpPfpGNJiTRXJO_0 2024-09-12T19:29:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14524455284375558179', time=2024-09-12T20:43:12.612451+0000, chain.objs.size()=1 2024-09-12T19:29:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.wo-Hp8gXYnD5m6kou7EYxPUes3LQ3qc_0 2024-09-12T19:29:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12675978706406786459', time=2024-09-12T20:43:13.615089+0000, chain.objs.size()=1 2024-09-12T19:29:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fQmUBqQqg0uj9VsAY1k7ZB6M7c85v4v_0 2024-09-12T19:29:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8513652903598712166', time=2024-09-12T20:43:14.515803+0000, chain.objs.size()=1 2024-09-12T19:29:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Dopxrl-CJnDyX6YiembP11TnEn-hhpD_0 2024-09-12T19:29:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1974330753977015294', time=2024-09-12T20:43:14.517747+0000, chain.objs.size()=1 2024-09-12T19:29:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.hUClHEeYo6vTye3KrETPSvA9ynw0qAP_0 2024-09-12T19:29:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13626508290457481241', time=2024-09-12T20:43:14.916232+0000, chain.objs.size()=1 2024-09-12T19:29:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Y97Um0dcbx30AT-sQs4jBEiiB-HIeOo_0 2024-09-12T19:29:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13179903723797069889', time=2024-09-12T20:43:15.812491+0000, chain.objs.size()=1 2024-09-12T19:29:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.h1udBBcchml6HbwuymBtz2kPnBUAWXY_0 2024-09-12T19:29:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12365247945126310305', time=2024-09-12T20:43:16.304567+0000, chain.objs.size()=1 2024-09-12T19:29:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fOKLIB5e4D-L54FyTrda9KxolyFrWkn_0 2024-09-12T19:29:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4249395755557691211', time=2024-09-12T20:43:17.664255+0000, chain.objs.size()=1 2024-09-12T19:29:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.WfVqYIL4aCNt9ch4KiaML0E9cOx61Ts_0 2024-09-12T19:29:41.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5984481167807959314', time=2024-09-12T20:43:18.192033+0000, chain.objs.size()=1 2024-09-12T19:29:41.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VZnJsjx9GN5pjtSO0gRL8AVjakwT3-O_0 2024-09-12T19:29:41.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2478673264782882807', time=2024-09-12T20:43:18.942325+0000, chain.objs.size()=1 2024-09-12T19:29:41.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.idWDiRCln9_hQ21UDjim1ntioXasJ8w_0 2024-09-12T19:29:41.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3110181644873770325', time=2024-09-12T20:43:19.152656+0000, chain.objs.size()=1 2024-09-12T19:29:41.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TZhD7RAk7pihbdXimzAS_r-cRp5Zl7G_0 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5556410416975734247', time=2024-09-12T20:43:19.543311+0000, chain.objs.size()=1 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cQ_MM0e7Qa9mVaM0_2VLd6ouHl_nVYc_0 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7181815179215407394', time=2024-09-12T20:43:19.875950+0000, chain.objs.size()=1 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.j4h091UxtplA5TA4fC1vu1RJWd0Hzdz_0 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8637432267749171243', time=2024-09-12T20:43:20.887810+0000, chain.objs.size()=1 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.x60IWM7qfOgu6J-nyIPO8gIZHXmHcjF_0 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2642818058923113729', time=2024-09-12T20:43:20.892207+0000, chain.objs.size()=1 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.plA1kgqbwjyFd-041-8_GUaE1edoRPL_0 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12241525811862923678', time=2024-09-12T20:43:20.894620+0000, chain.objs.size()=1 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5cRusrBHtO9V6dVTypF7iCTFsIswf-P_0 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9577129799384282714', time=2024-09-12T20:43:23.038871+0000, chain.objs.size()=1 2024-09-12T19:29:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.12NKjOtSxw3E24SXUQlJyXEDraVjTjV_0 2024-09-12T19:29:41.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3782869353331183006', time=2024-09-12T20:43:23.393181+0000, chain.objs.size()=1 2024-09-12T19:29:41.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AfQzCFQxQpmZ7eERiosK6rwrxKUEeT7_0 2024-09-12T19:29:41.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7536375838476678839', time=2024-09-12T20:43:24.516780+0000, chain.objs.size()=1 2024-09-12T19:29:41.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.779+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.m-L2RlF4CkceyWsRu_xXnXt9H-CrnHw_0 2024-09-12T19:29:41.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.189589588551692919', time=2024-09-12T20:43:24.523886+0000, chain.objs.size()=1 2024-09-12T19:29:41.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fkOcLwlplKulU1iG463fKSzSQBCDQd1_0 2024-09-12T19:29:41.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4760881853605901585', time=2024-09-12T20:43:25.687601+0000, chain.objs.size()=1 2024-09-12T19:29:41.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.oX15TOhP-DDH-C7B6Xn8CTDq-imVh66_0 2024-09-12T19:29:41.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10148623034439237041', time=2024-09-12T20:43:25.898824+0000, chain.objs.size()=1 2024-09-12T19:29:41.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.F1OEUPVTAbn_dmOUxhljeFz8wk8uikG_0 2024-09-12T19:29:41.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10897299582570595330', time=2024-09-12T20:43:26.399714+0000, chain.objs.size()=1 2024-09-12T19:29:41.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.2hyyY9tcV_j5iQnKoEbfu235qwHBwgr_0 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15050332953347925543', time=2024-09-12T20:43:27.860930+0000, chain.objs.size()=1 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HuUbJbTvz01k2TREdKMvJn5Ih2PunGy_0 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15163102181460202218', time=2024-09-12T20:43:27.941382+0000, chain.objs.size()=1 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nmEDxbIRyBvq0dQ4CQyDa8H6Iz4Hz_J_0 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13321847750595345004', time=2024-09-12T20:43:28.685945+0000, chain.objs.size()=1 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7vM4feyraiPBKvN8R0rwEQp4eXSNuQF_0 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10329685278799109349', time=2024-09-12T20:43:29.624815+0000, chain.objs.size()=1 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.76sQh8A8AJVSX532ffLKyh5kHTsM6nf_0 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4917929719246165590', time=2024-09-12T20:43:30.099021+0000, chain.objs.size()=1 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7QPWFLxZ7j_CVIaInzNP_Ovaks2-HUy_0 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1196850241832883511', time=2024-09-12T20:45:11.932998+0000, chain.objs.size()=1 2024-09-12T19:29:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UYhT1NnUzwnM1qevK7-AoxMstGnt0QO_0 2024-09-12T19:29:41.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1645051408507703962', time=2024-09-12T20:45:12.738235+0000, chain.objs.size()=1 2024-09-12T19:29:41.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dcgBW3A_cKCt9Ztx0acJorAcbPrQg06_0 2024-09-12T19:29:41.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12621808338191620439', time=2024-09-12T20:45:13.621209+0000, chain.objs.size()=1 2024-09-12T19:29:41.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.783+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zGsmyZi_qhFdI-U6cyyWzjjIk1TD82j_0 2024-09-12T19:29:41.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16288600339894999890', time=2024-09-12T20:45:14.748651+0000, chain.objs.size()=1 2024-09-12T19:29:41.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.vHNcD7kM5f4caSzuGrybDMR2r1QexpB_0 2024-09-12T19:29:41.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14904022308650774435', time=2024-09-12T20:45:14.751545+0000, chain.objs.size()=1 2024-09-12T19:29:41.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Nrs4_xJ77vZlvYDmzV1Br_73ShZcB7b_0 2024-09-12T19:29:41.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4558233501631248388', time=2024-09-12T20:45:15.087372+0000, chain.objs.size()=1 2024-09-12T19:29:41.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.m9yThluBVaRJ15zoygfKX4VCm9H9gYR_0 2024-09-12T19:29:41.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8047192259983575274', time=2024-09-12T20:45:19.370138+0000, chain.objs.size()=1 2024-09-12T19:29:41.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.29tn4UnBSYmQmUh5OSOmT-Ckp7jlci0_0 2024-09-12T19:29:41.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9984128702387739962', time=2024-09-12T20:45:22.214066+0000, chain.objs.size()=1 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.HJb2C1eGVstPPBc0eejGt7uO3UzhJvt_0 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2432450692664718611', time=2024-09-12T20:45:22.704386+0000, chain.objs.size()=1 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8ehhom0mS4RsdwhFoGCBRt8cwudKwEE_0 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.57971536359747589', time=2024-09-12T20:45:23.145168+0000, chain.objs.size()=1 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0R3ZB8niZs9Y-4HmvPM1ontcrzWaR2C_0 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10381403044729281852', time=2024-09-12T20:45:23.519842+0000, chain.objs.size()=1 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UAoj-rbduK_CRDu8pMInl21PFVuJFIs_0 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13377804285132407792', time=2024-09-12T20:45:24.232510+0000, chain.objs.size()=1 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.IjHP1uWjgxu6TpOCb3VOtlbUA9v855x_0 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15973308390732087778', time=2024-09-12T20:45:26.055329+0000, chain.objs.size()=1 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MzMx0TYzS6xT-mYKRf9GZrg2sOgn5y1_0 2024-09-12T19:29:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14429731274935901682', time=2024-09-12T20:45:26.416825+0000, chain.objs.size()=1 2024-09-12T19:29:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YR_ND3pg2BTZsumquaYa26O8MmbwUf3_0 2024-09-12T19:29:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13616409877884187666', time=2024-09-12T20:45:27.148424+0000, chain.objs.size()=1 2024-09-12T19:29:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lhVubPCTrcmotfAnTxzGx4kouJNKZnP_0 2024-09-12T19:29:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1638084135347570114', time=2024-09-12T20:45:28.282587+0000, chain.objs.size()=1 2024-09-12T19:29:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oX-o1nFNyLIkzrrwdYkGeVEaId6LLNY_0 2024-09-12T19:29:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5593364669198240647', time=2024-09-12T20:45:30.147552+0000, chain.objs.size()=1 2024-09-12T19:29:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.787+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FluVfAAqJyLVivdb0S6YgcrWyguI_b1_0 2024-09-12T19:29:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18243541741780775558', time=2024-09-12T20:45:31.719263+0000, chain.objs.size()=1 2024-09-12T19:29:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.IqFouHls-oIM28UnG8d1tY0HjMm3p-3_0 2024-09-12T19:29:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12662068139076610573', time=2024-09-12T20:45:34.729356+0000, chain.objs.size()=1 2024-09-12T19:29:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.CBqA_Y5LzQxw69BJnIwvNHTsNvs1LEI_0 2024-09-12T19:29:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5627694061681883429', time=2024-09-12T20:45:36.465335+0000, chain.objs.size()=1 2024-09-12T19:29:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.M_rPlWWR8ogkd-k5B0QzAc_dgoTrX4V_0 2024-09-12T19:29:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7508982374236557917', time=2024-09-12T20:45:36.565568+0000, chain.objs.size()=1 2024-09-12T19:29:41.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FcsyZgpkukkKRK_cYbBH34PAVQAZ8Uq_0 2024-09-12T19:29:41.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12314575129294129843', time=2024-09-12T20:46:00.100887+0000, chain.objs.size()=1 2024-09-12T19:29:41.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.335__shadow_.86XFD1Y4EpsdjMosKPKC3NhlHFrnI1V_0 2024-09-12T19:29:41.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8725312485304758198', time=2024-09-12T20:47:48.007703+0000, chain.objs.size()=1 2024-09-12T19:29:41.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.390__shadow_.x8LAxSMLUFaqtO8mUKO0GDxq0mvWNLp_0 2024-09-12T19:29:41.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17981153178515701302', time=2024-09-12T20:48:21.494465+0000, chain.objs.size()=1 2024-09-12T19:29:41.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.407__shadow_.kFKR0P3Ifv29YcpDPft9QwbRhq1xw0v_0 2024-09-12T19:29:41.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.791+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51828 2024-09-12T19:29:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T19:29:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1315949160958250181', time=2024-09-12T20:49:52.607993+0000, chain.objs.size()=1 2024-09-12T19:29:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.450__shadow_.w-C_iQ5lZdBquJxueeKuIkaxsAWRI3j_0 2024-09-12T19:29:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4208122869186447456', time=2024-09-12T20:52:47.027993+0000, chain.objs.size()=1 2024-09-12T19:29:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.512__shadow_.3Z0tQNGuqZHGzfn0jLZ5ccLPSq6dxer_0 2024-09-12T19:29:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1495361914515090065', time=2024-09-12T21:03:13.024222+0000, chain.objs.size()=1 2024-09-12T19:29:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:.Gx-YY9WcZgkmspf5ATchZXL89uCLC8_.OHY1xB8s6WqS0oxlw2V6vwcJHXn22oq_0 2024-09-12T19:29:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15691515183025048083', time=2024-09-12T21:03:34.451947+0000, chain.objs.size()=1 2024-09-12T19:29:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.571__shadow_.zHSyOQQZTfibZyN35eZaasKYbVg-5Jt_0 2024-09-12T19:29:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2975711417872494068', time=2024-09-12T21:03:50.357669+0000, chain.objs.size()=1 2024-09-12T19:29:41.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.574__shadow:vQUCRfeF-jOxSsbDUwYfBYpdMjHOVn3_.S62UFl5j-GGfj1jy6NKoOeDvx00n7z8_0 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5889555158033175472', time=2024-09-12T21:03:54.493431+0000, chain.objs.size()=1 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.575__shadow_.UX4agvQo3Q7P5L3eD9LPdW6aAwKed4P_0 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17808934429069322553', time=2024-09-12T21:04:38.334480+0000, chain.objs.size()=1 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:QcqZOiSGmBEhPhwgjALYGG555sC-ksj_.9-htRB-5w-ePRcYZH8lsAfoFKZwyTAl_0 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14002972479375508311', time=2024-09-12T21:05:54.666613+0000, chain.objs.size()=1 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.579__shadow:2C0.c7RuW1hqNjO8zZJkNiADIO8fgF3_.LMAdR8WZawDeGHeEekeO30IbKoHDUm7_0 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15769450055397129944', time=2024-09-12T21:09:49.208685+0000, chain.objs.size()=1 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.616__shadow_.NnKqiBBtKYEBONWOnGw3B9Y70pNkMMU_0 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2393931247621961849', time=2024-09-12T21:16:03.685791+0000, chain.objs.size()=6 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.662__multipart_foo.2~SJS4NrUV66jN6nguNFTrj9cpZKUKZae.1 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.662__multipart_foo.2~SJS4NrUV66jN6nguNFTrj9cpZKUKZae.2 2024-09-12T19:29:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.662__multipart_foo.2~SJS4NrUV66jN6nguNFTrj9cpZKUKZae.3 2024-09-12T19:29:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.662__multipart_foo.2~SJS4NrUV66jN6nguNFTrj9cpZKUKZae.4 2024-09-12T19:29:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.795+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.662__multipart_foo.2~SJS4NrUV66jN6nguNFTrj9cpZKUKZae.5 2024-09-12T19:29:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.799+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.662__multipart_foo.2~SJS4NrUV66jN6nguNFTrj9cpZKUKZae.6 2024-09-12T19:29:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.799+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1845399806824546981', time=2024-09-12T21:16:25.240807+0000, chain.objs.size()=1 2024-09-12T19:29:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.799+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.671__shadow_.rHO1m7EOgRbaTLtXEBzBZ13pLb4ao_s_0 2024-09-12T19:29:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.799+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.799+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T19:29:41.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51900' 2024-09-12T19:29:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_yjTCeOaH8R1h4mVs6IUU6NfNA2X7UV7', time=2024-09-12T20:28:59.341678+0000, chain.objs.size()=3 2024-09-12T19:29:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.I5m1j2RM5-5mDuCwneOD6zfmEQGqbfF_0 2024-09-12T19:29:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.I5m1j2RM5-5mDuCwneOD6zfmEQGqbfF_1 2024-09-12T19:29:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.I5m1j2RM5-5mDuCwneOD6zfmEQGqbfF_2 2024-09-12T19:29:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16144989906432607264', time=2024-09-12T20:29:49.949500+0000, chain.objs.size()=5 2024-09-12T19:29:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.161__multipart_foo-FROZEN.2~lxjngheGy1cbatSXNGHVueIso8uM7HH.1 2024-09-12T19:29:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_foo-FROZEN.2~lxjngheGy1cbatSXNGHVueIso8uM7HH.1_1 2024-09-12T19:29:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.161__multipart_foo-FROZEN.2~lxjngheGy1cbatSXNGHVueIso8uM7HH.2 2024-09-12T19:29:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_foo-FROZEN.2~lxjngheGy1cbatSXNGHVueIso8uM7HH.2_1 2024-09-12T19:29:41.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.161__multipart_foo-FROZEN.2~lxjngheGy1cbatSXNGHVueIso8uM7HH.3 2024-09-12T19:29:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1785797166560645554', time=2024-09-12T20:35:47.194844+0000, chain.objs.size()=1 2024-09-12T19:29:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.238__shadow_.ypZvdLyvvggeHos8Ca1_1QGVUcO9_fz_0 2024-09-12T19:29:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.340678864142164853', time=2024-09-12T20:36:26.337660+0000, chain.objs.size()=1 2024-09-12T19:29:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.254__shadow_.p5HaGePWW6zdhpYFwadK73uAlN8j9PM_0 2024-09-12T19:29:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7815382191895683314', time=2024-09-12T20:36:28.497090+0000, chain.objs.size()=1 2024-09-12T19:29:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.255__shadow_.9YyvQIHpVnwKiZcnrLBoB1GlacwpofA_0 2024-09-12T19:29:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5456048014098862497', time=2024-09-12T20:36:37.370143+0000, chain.objs.size()=1 2024-09-12T19:29:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.803+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.259__shadow_.MqA94GQhc2UJZ3tuynJkBTtWQP2KG3P_0 2024-09-12T19:29:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17355030355896178276', time=2024-09-12T20:38:22.771735+0000, chain.objs.size()=1 2024-09-12T19:29:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kJh0gdvgQmPaQGooV6IwT1mmonU25UR_0 2024-09-12T19:29:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12529149640067744368', time=2024-09-12T20:38:24.562574+0000, chain.objs.size()=1 2024-09-12T19:29:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5ZOVisUGphjh7TSqH-D3PAcKFKGWpG-_0 2024-09-12T19:29:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10424114870221660452', time=2024-09-12T20:38:27.132641+0000, chain.objs.size()=1 2024-09-12T19:29:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.eDj3QtBRWUP0zJt7xs1vwEpy3ycIrm__0 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16253242286104301072', time=2024-09-12T20:38:27.322824+0000, chain.objs.size()=1 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.OMrvsj882pcfqVbw-OyGBOX1pLqYrWG_0 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2149508131977663827', time=2024-09-12T20:38:27.582457+0000, chain.objs.size()=1 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5-XgPAKpggDz3EYJG1I7eiT3n5HOFi2_0 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.901449758284661926', time=2024-09-12T20:38:27.906307+0000, chain.objs.size()=1 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.mwPQP50tblxo85CGgJufyIW_bSC9z2E_0 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13198201692535522708', time=2024-09-12T20:38:27.997160+0000, chain.objs.size()=1 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-t8HhVM74e-SLQVsw6DKgjeifJHQONy_0 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18186480376243089277', time=2024-09-12T20:38:28.172250+0000, chain.objs.size()=1 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GXCgqvdth_H9vf4STe228bOFCwM-9JR_0 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4067372577760049581', time=2024-09-12T20:38:28.551955+0000, chain.objs.size()=1 2024-09-12T19:29:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.h32hZhu50hPkisQwqbJ-2WFMNn6xNhb_0 2024-09-12T19:29:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14503905657116999506', time=2024-09-12T20:38:28.835251+0000, chain.objs.size()=1 2024-09-12T19:29:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.KecR08CKTiQi9YzSlvfenoyc743FBvD_0 2024-09-12T19:29:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10674666400251573785', time=2024-09-12T20:38:29.249160+0000, chain.objs.size()=1 2024-09-12T19:29:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9h6vqrG5-XQLdjaeB8WJf-1e_M7IxAr_0 2024-09-12T19:29:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4013050789287925725', time=2024-09-12T20:38:31.071131+0000, chain.objs.size()=1 2024-09-12T19:29:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.807+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.FkON1SIDgtzi3xoZaOA9JY64DwZMROz_0 2024-09-12T19:29:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5102558427131076579', time=2024-09-12T20:38:31.072649+0000, chain.objs.size()=1 2024-09-12T19:29:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Klgz6yDvLU8L_6tYfbKMRyKKfX-lDcu_0 2024-09-12T19:29:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12314026183080799918', time=2024-09-12T20:38:31.236216+0000, chain.objs.size()=1 2024-09-12T19:29:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Cuf3T7IebwQNUyjmZmrfUZU1d9UZuFo_0 2024-09-12T19:29:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11813691962543204918', time=2024-09-12T20:38:31.854661+0000, chain.objs.size()=1 2024-09-12T19:29:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hTedrglZV1a0DNC1xZDPM6o_xKbCLxn_0 2024-09-12T19:29:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14707038341311335957', time=2024-09-12T20:38:33.979225+0000, chain.objs.size()=1 2024-09-12T19:29:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GYVHfAqSBBjPPEFs86d0-bqRbMlRGrw_0 2024-09-12T19:29:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8625059501870967704', time=2024-09-12T20:38:34.638789+0000, chain.objs.size()=1 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nd8mqxBCJ8pYYJJJAgPr_2Bs4Bd2SDd_0 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14775762590682447579', time=2024-09-12T20:38:35.309175+0000, chain.objs.size()=1 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.2vgznjBH6cuziWBla65Wsk7mWRidrcx_0 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13570434624803210474', time=2024-09-12T20:38:35.459535+0000, chain.objs.size()=1 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.DfvXL2fFfUjeqBOJYCWFbH-Z9mGnHfh_0 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11890135763073154906', time=2024-09-12T20:38:36.547791+0000, chain.objs.size()=1 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.F3EUg3h8BQxi0r1ITTncKJn5XhgSOoJ_0 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4862185991266492837', time=2024-09-12T20:38:37.707480+0000, chain.objs.size()=1 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EXAxGx6yNwdIzObxMsVcUgoNaczxxVV_0 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13064916898669372393', time=2024-09-12T20:38:40.413431+0000, chain.objs.size()=1 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.A7KnX9Fijl-vNEX--WHs2768lbu2nnz_0 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8188146776555569802', time=2024-09-12T20:38:43.406129+0000, chain.objs.size()=1 2024-09-12T19:29:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.TVPS15hpumgzFtB8FfBst_Jn6z233uv_0 2024-09-12T19:29:41.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.438888554582319530', time=2024-09-12T20:38:45.464388+0000, chain.objs.size()=1 2024-09-12T19:29:41.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.T90Ye9aElwlVe-x-w-p891bM7lgDS6p_0 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1142981326846323719', time=2024-09-12T20:38:46.966037+0000, chain.objs.size()=1 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kN8a6zLh0BoqZzkr6bJK_h5ULn8sUEb_0 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3768808506066789827', time=2024-09-12T20:38:48.788191+0000, chain.objs.size()=1 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.IogY-R7HTdMFnFFhEFlAsmmXuRpOBbs_0 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9512278869877955749', time=2024-09-12T20:39:19.038640+0000, chain.objs.size()=1 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.275__shadow_.YZMK6Cgu3XCT_spxKRhqC03Tpp6hPKE_0 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1383907272362700011', time=2024-09-12T20:39:23.561109+0000, chain.objs.size()=1 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.277__shadow_.xezH_aa1bsyh6-obkB5rCDStLYFao57_0 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15884277211718646437', time=2024-09-12T20:39:39.670132+0000, chain.objs.size()=1 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.284__shadow_.5UO0YwO81bWblialBfMtXiftK91DU4h_0 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7794902474366888409', time=2024-09-12T20:40:07.808824+0000, chain.objs.size()=1 2024-09-12T19:29:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.gQBbCVJosvo23K9LeyUh_lezWRv6zjz_0 2024-09-12T19:29:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14008177790691351154', time=2024-09-12T20:40:07.822918+0000, chain.objs.size()=1 2024-09-12T19:29:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.Mx5ZqHQw108hn19DF56YaUEwVN9sNC3_0 2024-09-12T19:29:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11854084502578695435', time=2024-09-12T20:40:10.153589+0000, chain.objs.size()=1 2024-09-12T19:29:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.294__shadow_.7aNunkxZh7q21B621-BM2NrTzsJa_oJ_0 2024-09-12T19:29:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3603881197121442535', time=2024-09-12T20:40:10.179545+0000, chain.objs.size()=1 2024-09-12T19:29:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.294__shadow_.YpSxBC2Y7cB-d1S2vVvvhgjzm60z-dm_0 2024-09-12T19:29:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7863883813902231379', time=2024-09-12T20:43:02.734837+0000, chain.objs.size()=1 2024-09-12T19:29:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.811+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7ePHv9neiphAKtEf3E3CFO9vogX-Do2_0 2024-09-12T19:29:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18378014380425060534', time=2024-09-12T20:43:03.357357+0000, chain.objs.size()=1 2024-09-12T19:29:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.WPhqqQqhd4bpmk4WPpMVAM2vJPprZ6v_0 2024-09-12T19:29:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4231539308617407898', time=2024-09-12T20:43:03.607355+0000, chain.objs.size()=1 2024-09-12T19:29:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.BC9rHuRczZ7bQpZoEKONg6VSZIZtCDf_0 2024-09-12T19:29:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10548656000027842207', time=2024-09-12T20:43:05.020381+0000, chain.objs.size()=1 2024-09-12T19:29:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IrneXJvuGKmmHxpya9jSbH5XaV9WCEc_0 2024-09-12T19:29:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11994226950444339407', time=2024-09-12T20:43:06.331886+0000, chain.objs.size()=1 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YlUKAeeKAxtl5G279Li3rc6hQkyExPz_0 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3215275165196440276', time=2024-09-12T20:43:07.749051+0000, chain.objs.size()=1 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SVued0rOA21Yz-2GlO_wFSjA0_cPd0G_0 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10806593185698661013', time=2024-09-12T20:43:08.256566+0000, chain.objs.size()=1 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.BY5VdC_KnLD1Iy4UsrHyZhTRLFiO8uW_0 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14767971106848401913', time=2024-09-12T20:43:08.573253+0000, chain.objs.size()=1 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.muTVSbGRVzZx8QLHHMsgqNXdaQ1r_aG_0 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10648206282658369335', time=2024-09-12T20:43:08.604270+0000, chain.objs.size()=1 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.FLsMuLoFcoNekhhqJEbt8qSw_FUkj4Z_0 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10029204232236359691', time=2024-09-12T20:43:08.734260+0000, chain.objs.size()=1 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tg2Jiz5ntIkJrAwmh41VdDca_KHVAK__0 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11095609818272384749', time=2024-09-12T20:43:10.044109+0000, chain.objs.size()=1 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.DkXLVhOuiT5dmXDnsxQrey38gaTxPU5_0 2024-09-12T19:29:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12885705696620065177', time=2024-09-12T20:43:10.427210+0000, chain.objs.size()=1 2024-09-12T19:29:41.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.1FKbnwBpGiuZ5YG1ZDgs7hEVll2lX6H_0 2024-09-12T19:29:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6138878438063914143', time=2024-09-12T20:43:10.745783+0000, chain.objs.size()=1 2024-09-12T19:29:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.GTXxYS04niuThMk45txUHIfMH3A9P9e_0 2024-09-12T19:29:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2727343743330884020', time=2024-09-12T20:43:10.969860+0000, chain.objs.size()=1 2024-09-12T19:29:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KsnrCxOBPEqUfCjpeTKjCYbU8YJ4-DN_0 2024-09-12T19:29:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16444094665052454705', time=2024-09-12T20:43:11.440775+0000, chain.objs.size()=1 2024-09-12T19:29:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tUnZGeMSh3l1bY4iVXD6fdFJ-cs8XPO_0 2024-09-12T19:29:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3777489744436056518', time=2024-09-12T20:43:12.338624+0000, chain.objs.size()=1 2024-09-12T19:29:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.CiRbN4S7J1_X8pAidJCF-CaMy1y-Yxl_0 2024-09-12T19:29:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2997334078092468663', time=2024-09-12T20:43:12.358237+0000, chain.objs.size()=1 2024-09-12T19:29:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Be_4Haqf_Tl4G9Y_1EEhJHWSp5Q1ai1_0 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1223558357073418113', time=2024-09-12T20:43:13.671907+0000, chain.objs.size()=1 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.qo5yAjmk5ivDhP4KTid1zLBuSGzAvv1_0 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2975127600546808329', time=2024-09-12T20:43:13.673490+0000, chain.objs.size()=1 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.NVpDSK_f_4FJV3AS5OE54-4HdpZr7SP_0 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16247734312517096962', time=2024-09-12T20:43:14.092024+0000, chain.objs.size()=1 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yRZWuKGak8nJ2gLcYvYIpENonWb0RsO_0 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10919602594556618920', time=2024-09-12T20:43:14.372908+0000, chain.objs.size()=1 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YVY2eFXPSzF-4QBmrVIS0yAmaojROPH_0 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15946148471461231512', time=2024-09-12T20:43:14.917948+0000, chain.objs.size()=1 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9YfEJoyL_7F6KE5I9iENCcAIccCWSzr_0 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8661465293215246557', time=2024-09-12T20:43:15.213371+0000, chain.objs.size()=1 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.815+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Oy3voALthAhkKhNSgCoPG5dADppYj7E_0 2024-09-12T19:29:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4859312732297731162', time=2024-09-12T20:43:15.500035+0000, chain.objs.size()=1 2024-09-12T19:29:41.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6b4sPvhVJQG8R2heaglXppuoTNTZi1W_0 2024-09-12T19:29:41.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2149816223130170278', time=2024-09-12T20:43:16.346041+0000, chain.objs.size()=1 2024-09-12T19:29:41.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.NwXfahAxx2WqmFARVmD_bGS1FsD1gcM_0 2024-09-12T19:29:41.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7928736491473910280', time=2024-09-12T20:43:17.246413+0000, chain.objs.size()=1 2024-09-12T19:29:41.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.sIS86LxC1yehHiBS1FuqgULA1nNOLd7_0 2024-09-12T19:29:41.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6013463348588309566', time=2024-09-12T20:43:18.038195+0000, chain.objs.size()=1 2024-09-12T19:29:41.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SlDCnBXDU3LhUg2f9paeapu--Dz36WV_0 2024-09-12T19:29:41.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7619431363401745377', time=2024-09-12T20:43:18.040103+0000, chain.objs.size()=1 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Y_BV2uZdhwhp-T7TCIdsOm1loU-Fnsa_0 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11064334377593136321', time=2024-09-12T20:43:18.418743+0000, chain.objs.size()=1 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zdvQKz4r5d-YoM8pT394ecGzqdbDmmF_0 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5563749626476842236', time=2024-09-12T20:43:18.531025+0000, chain.objs.size()=1 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-O_xQghwtsMjC149oorlJQnUdih_Tno_0 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17923579438697399686', time=2024-09-12T20:43:19.401321+0000, chain.objs.size()=1 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HX2w8DFiNXelA--KUB1J2_0fL0oxO1x_0 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3920352738218248429', time=2024-09-12T20:43:19.403713+0000, chain.objs.size()=1 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QQjcAvufMAk1p29mXMoBGhtj1kilht5_0 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12196154846081967027', time=2024-09-12T20:43:19.544293+0000, chain.objs.size()=1 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.uWWnv67Hs0sX2QKKlz0KrLp4xm3jJYg_0 2024-09-12T19:29:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3804976304968332249', time=2024-09-12T20:43:19.594262+0000, chain.objs.size()=1 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ki04VCmywCUMlOVk7w-tuACQmk8qzlY_0 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12768604378121195843', time=2024-09-12T20:43:19.935349+0000, chain.objs.size()=1 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.t5-zc4xCExjp0TIVR7JRi9QMSu_urV9_0 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12269843435743056750', time=2024-09-12T20:43:21.556153+0000, chain.objs.size()=1 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.BLYP54kWHB2QbwZysX1wk0NyT5_GAv3_0 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18426616651482839803', time=2024-09-12T20:43:21.577109+0000, chain.objs.size()=1 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.1GirS2uscd_U9qnyfg1z8_r9taHNhmo_0 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9667902511070205671', time=2024-09-12T20:43:22.186978+0000, chain.objs.size()=1 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.819+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.63YE4YNVsv_xpDHVbdZwcRctyv98_S-_0 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14107121322838854956', time=2024-09-12T20:43:23.009493+0000, chain.objs.size()=1 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eRuEsh7HrwJc_EJUQ8xUgoWwtvrMtm9_0 2024-09-12T19:29:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5698194699805312504', time=2024-09-12T20:43:23.366918+0000, chain.objs.size()=1 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.8XCTiXSlegmMAuuQuPFh2Cfnoy4wnB__0 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5376100424844577827', time=2024-09-12T20:43:23.499355+0000, chain.objs.size()=1 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cqknAlf5tu1Y-kCFz1ZXAK6U0BqObde_0 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8219119836286016306', time=2024-09-12T20:43:23.571005+0000, chain.objs.size()=1 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gCCxGTPqvqAI6Rp6frFQLArVSl2lxHA_0 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2856559412535929238', time=2024-09-12T20:43:23.644515+0000, chain.objs.size()=1 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.x3XovXWgHQ-alseAmIEUjva651ovuFQ_0 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3050265409413701408', time=2024-09-12T20:43:24.776808+0000, chain.objs.size()=1 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.oWmQgeaiF4ZCaQWQZT5O-W1bNS2eH35_0 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8489818829017120937', time=2024-09-12T20:43:26.976751+0000, chain.objs.size()=1 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EWuY4BJFzyRqPZr5YDGmayeh17AG7EB_0 2024-09-12T19:29:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1476665908715157343', time=2024-09-12T20:43:28.152679+0000, chain.objs.size()=1 2024-09-12T19:29:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.qa_3MoOIM5Cv4TsgeZ7SBpUFdxv68GG_0 2024-09-12T19:29:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13153637946404876933', time=2024-09-12T20:43:29.093025+0000, chain.objs.size()=1 2024-09-12T19:29:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ju3yse_J5ynD4vczC-Ktq776traAY_t_0 2024-09-12T19:29:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2037194581986542834', time=2024-09-12T20:43:29.235723+0000, chain.objs.size()=1 2024-09-12T19:29:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.bC3mlQBRyMdHADpgmoOfEQugSkKUoZd_0 2024-09-12T19:29:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4366543477246348969', time=2024-09-12T20:43:29.901765+0000, chain.objs.size()=1 2024-09-12T19:29:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.56u3uufWStXzV03c3mtsxfcgqNElwus_0 2024-09-12T19:29:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18161294563943774527', time=2024-09-12T20:45:11.462227+0000, chain.objs.size()=1 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.jqtQ5MNNt8ogadIpwj40A5K5wkxUjeF_0 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15809233699596644588', time=2024-09-12T20:45:14.702950+0000, chain.objs.size()=1 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wPbiY8C-hFzQ5nv0YU1dTB-kdNhTFmk_0 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7623356367159932385', time=2024-09-12T20:45:15.255336+0000, chain.objs.size()=1 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Nvf-aSEcsmX95txzIW2JcPPM2GurXr9_0 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1927479780276260626', time=2024-09-12T20:45:16.290912+0000, chain.objs.size()=1 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YhvfX8cT4B-NcMZ2qp3R_hqDuTOO6bd_0 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18310837680010494232', time=2024-09-12T20:45:16.476890+0000, chain.objs.size()=1 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.IQjm4hCqU1YbAQzRDKc3Ff1T8UFvkse_0 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2928438687967756112', time=2024-09-12T20:45:18.907250+0000, chain.objs.size()=1 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.L_rHBEZPQcqgFHKJjlDeDmADa7Ax6CW_0 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.184807652655191732', time=2024-09-12T20:45:19.468496+0000, chain.objs.size()=1 2024-09-12T19:29:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WvtusRlkqE23wesmsCABuXTzbWIHFcQ_0 2024-09-12T19:29:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6078777444549855018', time=2024-09-12T20:45:20.767814+0000, chain.objs.size()=1 2024-09-12T19:29:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6w6yKwuYmFLiZA-pu4HRwTxJq95OEvJ_0 2024-09-12T19:29:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15563832015240874014', time=2024-09-12T20:45:22.395790+0000, chain.objs.size()=1 2024-09-12T19:29:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.BT4Ea_A516ammiHU-sg2QXfzjBWC0ls_0 2024-09-12T19:29:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10242636416651441343', time=2024-09-12T20:45:22.559756+0000, chain.objs.size()=1 2024-09-12T19:29:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.823+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lX1XviINigYE8z0Q6nHKpMA5vgb0o0I_0 2024-09-12T19:29:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.827+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8865011523719334477', time=2024-09-12T20:45:24.209246+0000, chain.objs.size()=1 2024-09-12T19:29:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.827+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GZjrZA4fwunzkAFBAc1NpT2f85cqZ1V_0 2024-09-12T19:29:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.827+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12750164251295255783', time=2024-09-12T20:45:26.064445+0000, chain.objs.size()=1 2024-09-12T19:29:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.827+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.-G1uoQvDoDz9PYUu0N7g1qM87EcU09Z_0 2024-09-12T19:29:41.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.827+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51900 2024-09-12T19:29:41.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T19:29:41.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11957905613850375685', time=2024-09-12T20:45:27.326832+0000, chain.objs.size()=1 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.n_LYsTGrxAjhDOU0BJWlS09TmGOKu7-_0 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14606677265589744161', time=2024-09-12T20:45:28.017302+0000, chain.objs.size()=1 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Orq6HAIolvYDUFimq2c3tXsEU-78Anv_0 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9611209828410307236', time=2024-09-12T20:45:28.178439+0000, chain.objs.size()=1 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Nj5guk9VucD81EuNFDQD12r4L0BTz6t_0 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11445182400921154278', time=2024-09-12T20:45:29.551258+0000, chain.objs.size()=1 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lkltDyePqKReIWLNFNdDUVLbxOkJRAc_0 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.477604339149009529', time=2024-09-12T20:45:29.851365+0000, chain.objs.size()=1 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OuzikGl_l0Z6poqWdShAc_mNatUHphU_0 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12349410979694639945', time=2024-09-12T20:45:30.621707+0000, chain.objs.size()=1 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.HLiwf_9DLcAiFlTBiHXV1mNN9JVtJZ9_0 2024-09-12T19:29:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13973292058150318768', time=2024-09-12T20:45:31.134954+0000, chain.objs.size()=1 2024-09-12T19:29:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zh4ozUpglG6CmNjsFMKTfgeJyPj2xju_0 2024-09-12T19:29:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16967008089756867690', time=2024-09-12T20:45:31.463334+0000, chain.objs.size()=1 2024-09-12T19:29:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ms4jIQZrm8bv70YcAhH6BCe2WmsZOph_0 2024-09-12T19:29:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16413909993540863526', time=2024-09-12T20:45:31.840222+0000, chain.objs.size()=1 2024-09-12T19:29:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uEE4pxY3QYnYT0hDkb4WJBenzoL7LIg_0 2024-09-12T19:29:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.971097097840543298', time=2024-09-12T20:45:32.684605+0000, chain.objs.size()=1 2024-09-12T19:29:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.f5nU0v3_RonSPXakt1ZFvX7UJxBFK-W_0 2024-09-12T19:29:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18061972212716344719', time=2024-09-12T20:45:33.090787+0000, chain.objs.size()=1 2024-09-12T19:29:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zS-eSAx9XpTT3ss41U905jXMMTjajc4_0 2024-09-12T19:29:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5818654122745251841', time=2024-09-12T20:45:36.068581+0000, chain.objs.size()=1 2024-09-12T19:29:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qGBBTq8_7_HvB62mEK6Y7Vhz0HOnYWE_0 2024-09-12T19:29:41.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9637036010312237027', time=2024-09-12T20:45:36.257224+0000, chain.objs.size()=1 2024-09-12T19:29:41.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.x3NTtH9nGZJjx9EEbxZcbB_A9k3iTCV_0 2024-09-12T19:29:41.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11357910679766458938', time=2024-09-12T20:45:36.893623+0000, chain.objs.size()=1 2024-09-12T19:29:41.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.XJJu_eRDZx4_gGV8wwQQ6iUtICgMTJy_0 2024-09-12T19:29:41.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12898370939174981404', time=2024-09-12T20:45:37.715807+0000, chain.objs.size()=1 2024-09-12T19:29:41.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.SI140p66SqHaB-xbTJYGeZ_gUBAbDZ4_0 2024-09-12T19:29:41.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4707113289168010030', time=2024-09-12T20:45:37.848377+0000, chain.objs.size()=1 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4pJf8Fl-5kNG7ci9rhZ08TXx5B9gT0k_0 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2466177996888821530', time=2024-09-12T20:45:38.338877+0000, chain.objs.size()=1 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xqfyjeXgp52duSETYiwmBhQxUebpBQp_0 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15700205382913721949', time=2024-09-12T20:47:03.095424+0000, chain.objs.size()=1 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.369__shadow_.eI6moqVIniM3oAZl0MNK3aZoH4rRUO0_0 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18149189514062060586', time=2024-09-12T20:47:31.098136+0000, chain.objs.size()=1 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.382__shadow_.mxUFiQfslZNTDjj4xq5k6YVemapOVrP_0 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1199865433401601668', time=2024-09-12T20:47:33.096641+0000, chain.objs.size()=1 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.383__shadow_.8D6R6Bk1_2PkQvUVxuEb__H_Ih1keIv_0 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15191169411082516396', time=2024-09-12T20:50:12.630514+0000, chain.objs.size()=1 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.458__shadow_.i5_eAvzuBknbjHNIooekJB6DF4jqWl7_0 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3891875995292033516', time=2024-09-12T20:51:02.837125+0000, chain.objs.size()=1 2024-09-12T19:29:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.el8eCvWTTa87bDQ-nrtloG5bIR83-PW_0 2024-09-12T19:29:41.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.713903263009062695', time=2024-09-12T20:51:02.883159+0000, chain.objs.size()=1 2024-09-12T19:29:41.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.831+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.C84bzKfY6i645EM_YEfAf4vJ_DpFKHV_0 2024-09-12T19:29:41.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13045060229004521825', time=2024-09-12T20:51:05.533467+0000, chain.objs.size()=1 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.484__shadow_.9jaNSWYGyE_kM9rCUwVzExuKwEzEoAD_0 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9904223283599867659', time=2024-09-12T20:51:05.572227+0000, chain.objs.size()=1 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.484__shadow_.up_63M7cz_Mq_YnAQjS8FYIgetxgMP0_0 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12287519391712766772', time=2024-09-12T20:51:38.641071+0000, chain.objs.size()=1 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.497__shadow_.A_TTqJ_QbAMy9ZUTcBLzePZ2MN87-1G_0 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4033226137282499228', time=2024-09-12T20:51:51.733316+0000, chain.objs.size()=1 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.503__shadow:ZaN5iQFdkxMluSElq-iCxGVc.IoNdB._.0iAzXRtuwU4n61WPRJhvnPJx8SSDQ8I_0 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3833484478711177270', time=2024-09-12T20:52:47.641939+0000, chain.objs.size()=1 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.513__multipart_mymultipart.2~QEjP8VRsPec6cyPlR9_upUjU99rBL5F.1 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18151809024377295781', time=2024-09-12T20:52:53.663935+0000, chain.objs.size()=1 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.516__multipart_mymultipartcopy.2~HU8DaNVtAjbkBZqjeVe_k3ZsiLyEz3p.1 2024-09-12T19:29:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17512614858277158804', time=2024-09-12T20:53:51.385593+0000, chain.objs.size()=6 2024-09-12T19:29:41.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.519__multipart_mymultipart.2~5IvJuMZaWW0FIz8J2kS0Jy37yysDE2B.1 2024-09-12T19:29:41.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.519__multipart_mymultipart.2~5IvJuMZaWW0FIz8J2kS0Jy37yysDE2B.2 2024-09-12T19:29:41.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.519__multipart_mymultipart.2~5IvJuMZaWW0FIz8J2kS0Jy37yysDE2B.3 2024-09-12T19:29:41.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.519__multipart_mymultipart.2~5IvJuMZaWW0FIz8J2kS0Jy37yysDE2B.4 2024-09-12T19:29:41.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.519__multipart_mymultipart.2~5IvJuMZaWW0FIz8J2kS0Jy37yysDE2B.5 2024-09-12T19:29:41.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.519__multipart_mymultipart.2~5IvJuMZaWW0FIz8J2kS0Jy37yysDE2B.6 2024-09-12T19:29:41.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11007531695665034320', time=2024-09-12T21:03:08.714887+0000, chain.objs.size()=1 2024-09-12T19:29:41.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:skgSHeUk8ZemIEFW3eJMjQNmFdLugIU_.P6RPFYplJOdHJ-ww7WovtGrgAObbIOs_0 2024-09-12T19:29:41.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5902532007198839711', time=2024-09-12T21:03:28.392142+0000, chain.objs.size()=1 2024-09-12T19:29:41.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.835+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:bNy4DFyF5n5.7KlgKGr342S1ldTabdu_.J0F1kHU8CtaVPK_6HwqeYjooYKekSU5_0 2024-09-12T19:29:41.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.839+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10590078092583076755', time=2024-09-12T21:05:55.072438+0000, chain.objs.size()=1 2024-09-12T19:29:41.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.839+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.579__shadow:zjsRMqAStraqceEmoj1zn3vQUVkzxT2_.HjK4XaU4PeNkjew-nI1Uf5qJUTj_yqQ_0 2024-09-12T19:29:41.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.839+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12605177663034972220', time=2024-09-12T21:06:01.314072+0000, chain.objs.size()=1 2024-09-12T19:29:41.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.839+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.580__shadow:4SZ6RDLu00hxrTr8cO80g6K2pTDZgZY_.0zVEa9BDmkWsauEydkIlLqwUDdmOj2S_0 2024-09-12T19:29:41.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.839+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17733597637105438594', time=2024-09-12T21:17:07.511711+0000, chain.objs.size()=1 2024-09-12T19:29:41.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.839+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.695__shadow_.8s72eD830VE_2EnxPUUaIOcBkwJarVY_0 2024-09-12T19:29:41.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.839+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8971365141472897080', time=2024-09-12T21:17:25.292083+0000, chain.objs.size()=1 2024-09-12T19:29:41.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.839+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.703__shadow:5Jrs7ZKwS6XSXvHvSW8K73AJLdviUDg_.fjKtu4u33gslQ61tyOq5EOAjtiJ2uZF_0 2024-09-12T19:29:41.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.839+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3709709695179184442', time=2024-09-12T21:17:33.695105+0000, chain.objs.size()=1 2024-09-12T19:29:41.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.839+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.707__shadow:3LAzHiK5e3oRBUFFQAki.cyZirh6qMZ_.tlLTgLm3tf4sqf-IPq0gwqJrxGSnF3A_0 2024-09-12T19:29:41.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.839+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.843+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T19:29:41.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.843+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.843+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54278' 2024-09-12T19:29:41.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13400861162120004279', time=2024-09-12T20:35:59.523910+0000, chain.objs.size()=1 2024-09-12T19:29:41.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.243__shadow_.3jtPE_ImMPL7nbWrYGrSu7F7i9zWP4z_0 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4011335529136002917', time=2024-09-12T20:36:21.674740+0000, chain.objs.size()=1 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.252__shadow_.NMV7xivrALKXBgEMubMNPtgZZn3hLxO_0 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15164889638429871239', time=2024-09-12T20:36:28.444499+0000, chain.objs.size()=1 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.255__shadow_.RVkpVaCXCfS4BFaqHTPLP2dxsZMG1Co_0 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5900012639124745618', time=2024-09-12T20:38:22.494691+0000, chain.objs.size()=1 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.t97RHT6SUwORSl6W9a4RsvgwYF-b1vg_0 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12443403494644959252', time=2024-09-12T20:38:23.281757+0000, chain.objs.size()=1 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QQxGuDTXWvie33unR4KKZpPRVZ-fCkn_0 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7428101771197910184', time=2024-09-12T20:38:23.718260+0000, chain.objs.size()=1 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.uMjLfhZRhM0UFckiD0LOi-8s22mqEfA_0 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18436950531038337081', time=2024-09-12T20:38:23.997131+0000, chain.objs.size()=1 2024-09-12T19:29:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8KMJ0zREhByblHwsXCkH5eDs90BaPF4_0 2024-09-12T19:29:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5611247246924036064', time=2024-09-12T20:38:24.795243+0000, chain.objs.size()=1 2024-09-12T19:29:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.sntygQmgWfcf7C0F_3bPBDrNeaaJAJE_0 2024-09-12T19:29:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2631936822304621746', time=2024-09-12T20:38:27.315034+0000, chain.objs.size()=1 2024-09-12T19:29:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Lpr0r224Ph7ytibKTTz9Terv93nyhE5_0 2024-09-12T19:29:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.639543311018803429', time=2024-09-12T20:38:27.317008+0000, chain.objs.size()=1 2024-09-12T19:29:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rKxgalrptHL4aZHLWmKPbv0AHYt4suw_0 2024-09-12T19:29:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13952296264050127556', time=2024-09-12T20:38:27.687634+0000, chain.objs.size()=1 2024-09-12T19:29:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8Ipe3kaEkbNTLsVo72f8R1_wNxLuf2w_0 2024-09-12T19:29:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6772018725224158533', time=2024-09-12T20:38:28.083102+0000, chain.objs.size()=1 2024-09-12T19:29:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.TTTkCXTdq7UehsGxee5kA2bjVR06i6U_0 2024-09-12T19:29:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11798503681835903615', time=2024-09-12T20:38:28.084965+0000, chain.objs.size()=1 2024-09-12T19:29:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.byoxKvmLYSiQ2yhq8o_b-e0DjNieXaW_0 2024-09-12T19:29:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10170199398844429056', time=2024-09-12T20:38:28.216562+0000, chain.objs.size()=1 2024-09-12T19:29:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.enyepEzsW1QEHr_5mMNRcNG53xj5587_0 2024-09-12T19:29:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13681964124526408008', time=2024-09-12T20:38:28.669499+0000, chain.objs.size()=1 2024-09-12T19:29:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.PfA7kqy69025ffffbubT_WZuvWqD59B_0 2024-09-12T19:29:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1678252929458363014', time=2024-09-12T20:38:29.261563+0000, chain.objs.size()=1 2024-09-12T19:29:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-2V6HQamaHGglx9EOgMGF5U07xx2vgS_0 2024-09-12T19:29:41.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18422365148198263228', time=2024-09-12T20:38:30.811945+0000, chain.objs.size()=1 2024-09-12T19:29:41.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.SdpVrvuAVXcNsdqlGAbZLwQvPdYWmBH_0 2024-09-12T19:29:41.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10785599616408939109', time=2024-09-12T20:38:33.982658+0000, chain.objs.size()=1 2024-09-12T19:29:41.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.DsHbktKStzOm8n0UtD6CxXKQSh-rkyc_0 2024-09-12T19:29:41.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14560640847400864623', time=2024-09-12T20:38:34.466937+0000, chain.objs.size()=1 2024-09-12T19:29:41.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qFSmlLs-6jZBJL_G0MrkuBIywjk79Tn_0 2024-09-12T19:29:41.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15115375966032287899', time=2024-09-12T20:38:36.770487+0000, chain.objs.size()=1 2024-09-12T19:29:41.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.JPlcFwqgbOkMbhmPFMN-xUrxsYgUMW4_0 2024-09-12T19:29:41.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13178761272883510742', time=2024-09-12T20:38:38.911152+0000, chain.objs.size()=1 2024-09-12T19:29:41.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Cn8s5X4W2mRJ9t6cTzW-y_ZHEn5T3hN_0 2024-09-12T19:29:41.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17964631130374467182', time=2024-09-12T20:38:39.312253+0000, chain.objs.size()=1 2024-09-12T19:29:41.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EjYW8pfoCoTrGE0zyF1TZW4glWel13g_0 2024-09-12T19:29:41.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17306120436070985874', time=2024-09-12T20:38:40.091584+0000, chain.objs.size()=1 2024-09-12T19:29:41.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.847+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.PPpRXLb7XoGfgFl1HFQf9890mCr94K9_0 2024-09-12T19:29:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12640807635480547157', time=2024-09-12T20:38:40.094134+0000, chain.objs.size()=1 2024-09-12T19:29:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jIwIBXuDB_DPuX3Xq4Xc9KJc7nez_QO_0 2024-09-12T19:29:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7450313628232205283', time=2024-09-12T20:38:41.361171+0000, chain.objs.size()=1 2024-09-12T19:29:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Hu-iI7CyJXb8cBNer17VyL57Pe6x2UD_0 2024-09-12T19:29:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8784064749749228455', time=2024-09-12T20:38:41.449196+0000, chain.objs.size()=1 2024-09-12T19:29:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7TFMMlPltExeZseFfm74tRbyk6JG0Rg_0 2024-09-12T19:29:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17425522590850334762', time=2024-09-12T20:38:42.023382+0000, chain.objs.size()=1 2024-09-12T19:29:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.svOck-M1j8XbhfWreV0Xxyt8UsX0v2A_0 2024-09-12T19:29:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12817295012380114703', time=2024-09-12T20:38:42.258986+0000, chain.objs.size()=1 2024-09-12T19:29:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZPRCMIumqzWZ_ntChyYN9hnO4RtXhQq_0 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4711887717402944335', time=2024-09-12T20:38:42.451255+0000, chain.objs.size()=1 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.C89SkJy8X5ahpSt5LqYY-mByVv7MhAA_0 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17343405173580705803', time=2024-09-12T20:38:42.957782+0000, chain.objs.size()=1 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AcxjyT0CHyaY42Q5aAIdjJrWEOVHXtk_0 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6802112986966661606', time=2024-09-12T20:38:43.754484+0000, chain.objs.size()=1 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kZqvbp-OyQCN3BY_uavYhBVTdsfC0aN_0 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6952030201918454', time=2024-09-12T20:38:45.818958+0000, chain.objs.size()=1 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fWEBQ-VorJ84hlo1g-4qe4aZRKmnfLF_0 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17710823667532536227', time=2024-09-12T20:38:45.948526+0000, chain.objs.size()=1 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4_IJwRX-5dvT9MQMvHZFtwRDLt0lju5_0 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2185256959983327308', time=2024-09-12T20:38:49.464096+0000, chain.objs.size()=1 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.TRWYOWyPeq9cu6N6FqOucuYVbLsk9-m_0 2024-09-12T19:29:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11793649199079099182', time=2024-09-12T20:39:08.112723+0000, chain.objs.size()=1 2024-09-12T19:29:41.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.270__shadow_.QBHPUDyKr9Yz2akvOZbidu1YgYZ3q-p_0 2024-09-12T19:29:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.962995701773607037', time=2024-09-12T20:39:51.456034+0000, chain.objs.size()=1 2024-09-12T19:29:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.289__shadow_.IPqwT0uDGhNIJiIaGluLFd7wfwbrwNk_0 2024-09-12T19:29:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1491145213622854808', time=2024-09-12T20:40:07.580954+0000, chain.objs.size()=1 2024-09-12T19:29:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.gr0V7M2wW-fk7pqUNg9xnhkBuS6ap_g_0 2024-09-12T19:29:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17378430001873596258', time=2024-09-12T20:40:07.582871+0000, chain.objs.size()=1 2024-09-12T19:29:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.foOgBb7qhPidB4dLl_t1pq_nxE15e-P_0 2024-09-12T19:29:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6868506193315904970', time=2024-09-12T20:40:17.067090+0000, chain.objs.size()=1 2024-09-12T19:29:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.297__shadow_.sTG58--ClMkTew9WlPhzYNKqHG6QIjd_0 2024-09-12T19:29:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11098044957083711276', time=2024-09-12T20:40:21.911695+0000, chain.objs.size()=1 2024-09-12T19:29:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.299__shadow_.fesq6K5POeCvzRxlrVHu_nonGVcpPAL_0 2024-09-12T19:29:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1450830226271223480', time=2024-09-12T20:43:02.500901+0000, chain.objs.size()=1 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5PBtPOqX4hsqL4rmKebFkRnbHjr9njC_0 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14185356875339379965', time=2024-09-12T20:43:02.703506+0000, chain.objs.size()=1 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.hwON5wFFVu6YoD8SquT4yS8y5zv76b3_0 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10333009126312969902', time=2024-09-12T20:43:03.086864+0000, chain.objs.size()=1 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pPIXj1TnEKgNkG9FfEf0psUGafug5En_0 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5749365832380142963', time=2024-09-12T20:43:03.679954+0000, chain.objs.size()=1 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-ZVeVa4qrFljoGqu0rQVspjwb2lIL6j_0 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12318136780270653351', time=2024-09-12T20:43:04.741687+0000, chain.objs.size()=1 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.851+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.8eIYGRAMHyOzuP0tkOrS0Vtm7ggSG4f_0 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10892931412028891818', time=2024-09-12T20:43:04.891382+0000, chain.objs.size()=1 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.inNZJ_Ihn8VCMLcQOrZlHt8S5aJnfVm_0 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3386938590353143690', time=2024-09-12T20:43:05.109343+0000, chain.objs.size()=1 2024-09-12T19:29:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QP3nTYN0bS80nQZt1LLE5tBnpQnTgCc_0 2024-09-12T19:29:41.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14049981723859665885', time=2024-09-12T20:43:06.476772+0000, chain.objs.size()=1 2024-09-12T19:29:41.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.PTYCdEMiVLZrhpNSbF2fRHI2PLJf5rr_0 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1165960232387472682', time=2024-09-12T20:43:08.247622+0000, chain.objs.size()=1 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.8SjM_iXL-YfUYk-IjpJE-6YTpwWverd_0 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1553928153880319650', time=2024-09-12T20:43:08.665690+0000, chain.objs.size()=1 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Mld9P1NpiJc_hdNkhW8S7FHdwjybGV4_0 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2334573789632296691', time=2024-09-12T20:43:08.707350+0000, chain.objs.size()=1 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QdES7m7rOnhK4FEIYoap7QjoQMfUElJ_0 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6904868038210913631', time=2024-09-12T20:43:10.047112+0000, chain.objs.size()=1 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vJTH7s60rrVj8mxbcILJLWZ3EMQEhWz_0 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17496217358719714131', time=2024-09-12T20:43:10.411123+0000, chain.objs.size()=1 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xhp2q8V4DYUKV-mukfyViXae9e8RsJp_0 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15188998964587041643', time=2024-09-12T20:43:10.413348+0000, chain.objs.size()=1 2024-09-12T19:29:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.PuRmATdbhpw2FoFftnuRsPWS3DpjUVm_0 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5686496680716992436', time=2024-09-12T20:43:11.136688+0000, chain.objs.size()=1 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zCwP1nHjzDJr16B_Q4xp0PH4RVvMvtE_0 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8416761321019187030', time=2024-09-12T20:43:11.257051+0000, chain.objs.size()=1 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ilO-MiIDF9I3e5TGnjidyULAkPd12vJ_0 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6315632364867225308', time=2024-09-12T20:43:11.801668+0000, chain.objs.size()=1 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IOcBGTKIGxLbyFiekZb_joihPbI_LWP_0 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9512848350490617260', time=2024-09-12T20:43:12.393283+0000, chain.objs.size()=1 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Z1L8Q3TpLw0Bmp5lxAyBu0vfI_22dzL_0 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11574962787582856253', time=2024-09-12T20:43:13.623142+0000, chain.objs.size()=1 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vCyoP5AB3mWbEDPJjNVucIcXZQ3bwyw_0 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8105914304801670915', time=2024-09-12T20:43:14.780564+0000, chain.objs.size()=1 2024-09-12T19:29:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.855+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.bfNSa9pfvecITykvG7AjMYwOsDTcYkc_0 2024-09-12T19:29:41.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11513300524731857591', time=2024-09-12T20:43:15.245896+0000, chain.objs.size()=1 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nP6FuC5XSvtgO_cezIuKKU25xsdvXYF_0 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11648792549628742096', time=2024-09-12T20:43:16.165551+0000, chain.objs.size()=1 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tsKrAmDPEyRqIWzzsfRro2yvkknwM16_0 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16763003103763458133', time=2024-09-12T20:43:17.337579+0000, chain.objs.size()=1 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4yFMamzwpJRrCcN6oj7m6o-ZLnlJkxJ_0 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10575027430147338663', time=2024-09-12T20:43:17.339605+0000, chain.objs.size()=1 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QZOdeSqENoxnJjBjvHdwOUUsw2bhsqz_0 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12779528521798738766', time=2024-09-12T20:43:17.703896+0000, chain.objs.size()=1 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tS6ZYPU_A4xm3X_-XBNsPrgV4xCiBVg_0 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5351810246936758028', time=2024-09-12T20:43:18.113425+0000, chain.objs.size()=1 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.URIgAcsnEoSFKIfSsLHt2NfBrYOHcYT_0 2024-09-12T19:29:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11930218547643287897', time=2024-09-12T20:43:19.027007+0000, chain.objs.size()=1 2024-09-12T19:29:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vvDWoxFGrYqZRQT0mZIHgZARoV5qQt0_0 2024-09-12T19:29:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4481027061412857739', time=2024-09-12T20:43:19.304654+0000, chain.objs.size()=1 2024-09-12T19:29:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.19HJui2YRxsJCM17qIjH8sln9gyWKic_0 2024-09-12T19:29:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7525074677472089977', time=2024-09-12T20:43:19.574911+0000, chain.objs.size()=1 2024-09-12T19:29:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VfW-gy8Nf-gL8Tqj9iK2HDmnuEg3pmM_0 2024-09-12T19:29:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2611871381235732330', time=2024-09-12T20:43:19.576501+0000, chain.objs.size()=1 2024-09-12T19:29:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.1aJ-n_aymoNPqmdEDUduyTOZa5f0SLR_0 2024-09-12T19:29:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8779869599024039053', time=2024-09-12T20:43:20.795032+0000, chain.objs.size()=1 2024-09-12T19:29:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5OBQF-2TnfJKTrNpOio9ZXUH2lxUw7Q_0 2024-09-12T19:29:41.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6041232593195232305', time=2024-09-12T20:43:25.433293+0000, chain.objs.size()=1 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.lVclY5tRhmhjqFOO6xun9pWhpQSEios_0 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4984615421599625719', time=2024-09-12T20:43:27.933028+0000, chain.objs.size()=1 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-g2q8EO5H6pEqPObg6vnCnodxLhmskI_0 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10786250495878771132', time=2024-09-12T20:43:30.038164+0000, chain.objs.size()=1 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jTkn104zPSjtNmFLNRWNYmd7dTSDlg5_0 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10038427164709943332', time=2024-09-12T20:45:12.030730+0000, chain.objs.size()=1 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nNHElhBWliSbfdoNoXcEW64-WefU6_N_0 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3208171978880136511', time=2024-09-12T20:45:13.472267+0000, chain.objs.size()=1 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xvPQWiEmgq7cT-dVelM0nsfFkOZ907w_0 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1093844976720850644', time=2024-09-12T20:45:16.285943+0000, chain.objs.size()=1 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.edKhopnrU7AFMis_NZgsDovFblr5TnB_0 2024-09-12T19:29:41.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10538897882523848271', time=2024-09-12T20:45:17.047715+0000, chain.objs.size()=1 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8ws7-rMMtiSuG959uv15pUTJN8XzNx5_0 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16202750431545309914', time=2024-09-12T20:45:19.135680+0000, chain.objs.size()=1 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.859+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._ZKjdMkgUnioNw6PUNvaZnut_CHrliw_0 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1750297635440086290', time=2024-09-12T20:45:20.024183+0000, chain.objs.size()=1 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.aFZyZwQq0VSGnWmBI5ZD8G5MNHYzRTx_0 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8855871078885667825', time=2024-09-12T20:45:20.383607+0000, chain.objs.size()=1 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.isMlg6u6FXisgCvfg5MQEQ1C0jaOKig_0 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14415359695093428056', time=2024-09-12T20:45:20.385783+0000, chain.objs.size()=1 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.iJ8HM25-55WZnUIweVjh_cp_ETSIabm_0 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4936293433710987004', time=2024-09-12T20:45:21.175383+0000, chain.objs.size()=1 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.LorQfHW505h5w3SuCjjeWyIT-m5LOuM_0 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16574398833517178351', time=2024-09-12T20:45:23.291737+0000, chain.objs.size()=1 2024-09-12T19:29:41.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.sol6iVnTi-ofbzZQGICHK1zR6nwayPK_0 2024-09-12T19:29:41.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1171001880546275136', time=2024-09-12T20:45:23.467688+0000, chain.objs.size()=1 2024-09-12T19:29:41.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.7BacQfk8T2P9GUqORxXgsbKVbFSlwYX_0 2024-09-12T19:29:41.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3456871979116881921', time=2024-09-12T20:45:24.078138+0000, chain.objs.size()=1 2024-09-12T19:29:41.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.bVOKVA4YXKTc6tbglsc6f0LEbYLsdho_0 2024-09-12T19:29:41.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10676534098575652345', time=2024-09-12T20:45:24.614783+0000, chain.objs.size()=1 2024-09-12T19:29:41.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.L9gjLmA0RAfLHPwwg4vtDKSUgFymCDo_0 2024-09-12T19:29:41.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12904147169928789268', time=2024-09-12T20:45:24.616396+0000, chain.objs.size()=1 2024-09-12T19:29:41.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Y34r7RDOPswLNFz05aP1q4JSfrB0_mS_0 2024-09-12T19:29:41.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18171307130186476233', time=2024-09-12T20:45:24.737583+0000, chain.objs.size()=1 2024-09-12T19:29:41.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lEPRxiJqoipHu8hUjJ8uABgIu1YAVkL_0 2024-09-12T19:29:41.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13202111485548001117', time=2024-09-12T20:45:24.807454+0000, chain.objs.size()=1 2024-09-12T19:29:41.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.yKhdml0hZBNf6ZC9y5ZKD05TsiQL8l2_0 2024-09-12T19:29:41.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8583014144554226260', time=2024-09-12T20:45:25.732259+0000, chain.objs.size()=1 2024-09-12T19:29:41.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Ok717CfFMQr4MUiTehZt7vleDCYc9zN_0 2024-09-12T19:29:41.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9647226486229967518', time=2024-09-12T20:45:25.734472+0000, chain.objs.size()=1 2024-09-12T19:29:41.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OocD1FWczLVTtTIJqwwCwH0LFigDDOJ_0 2024-09-12T19:29:41.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6081514459647377014', time=2024-09-12T20:45:26.420098+0000, chain.objs.size()=1 2024-09-12T19:29:41.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Fc96k0f-jgtW3F9kszvg2k0zGJEU4XV_0 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12366889829482755009', time=2024-09-12T20:45:26.536976+0000, chain.objs.size()=1 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.g2H34VqskPbFPWqNajH3BbDsbwVAFnU_0 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13897779738089408401', time=2024-09-12T20:45:26.665919+0000, chain.objs.size()=1 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4mo8wThsg0EuU3B2oCbWBQjlWoCbqHy_0 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16118711499590250215', time=2024-09-12T20:45:27.364495+0000, chain.objs.size()=1 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.AQwUIRgqxvvZ-z0s6yP7jsFqxCbt76N_0 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17526091465158277003', time=2024-09-12T20:45:28.363095+0000, chain.objs.size()=1 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.863+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lasN0qPyNy3wKOND9dn85tEfRwUGMex_0 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.867+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6625865629750241317', time=2024-09-12T20:45:28.402370+0000, chain.objs.size()=1 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.867+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.rl7moFLMX0VVvzKh59vjIoVjtNRaZHJ_0 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.867+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12946261217195020370', time=2024-09-12T20:45:31.921891+0000, chain.objs.size()=1 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.867+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4S8hQu8_lu2M8_I9_jp9SQYVvaA7BUD_0 2024-09-12T19:29:41.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.867+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13618622625843585613', time=2024-09-12T20:45:34.486428+0000, chain.objs.size()=1 2024-09-12T19:29:41.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.867+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.EHqMCpTD9oXwn-d41VtQQxzItRQL5ou_0 2024-09-12T19:29:41.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.867+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54278 2024-09-12T19:29:41.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T19:29:41.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14308708798852156663', time=2024-09-12T20:45:34.986794+0000, chain.objs.size()=1 2024-09-12T19:29:41.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.AlT6ju4d7dcLzUxsFq9cnAgIkkWD8hq_0 2024-09-12T19:29:41.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9918478812517844359', time=2024-09-12T20:45:35.058758+0000, chain.objs.size()=1 2024-09-12T19:29:41.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OblbRHq7lp2EnrdLUadNrmPI5cXLk4i_0 2024-09-12T19:29:41.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.577399112558627060', time=2024-09-12T20:45:36.960444+0000, chain.objs.size()=1 2024-09-12T19:29:41.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8G6a2K8HQkF9YZsNYIAdbTXQMKr3FQA_0 2024-09-12T19:29:41.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15733014854034147256', time=2024-09-12T20:46:15.068279+0000, chain.objs.size()=1 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.342__shadow_.u0RjmUGdnd5xlXMkEhkOdELvwud819a_0 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12469535824211485529', time=2024-09-12T20:47:24.880733+0000, chain.objs.size()=1 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.379__shadow_.GrlpFifZYQ_JTf_IISfhfDCvap4AFWj_0 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13214761523799710104', time=2024-09-12T20:50:12.622212+0000, chain.objs.size()=1 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.458__shadow_.3Iv65UV0FnOkBM1ySpBjDWYqV_L66gF_0 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5678009359491131192', time=2024-09-12T20:50:21.583568+0000, chain.objs.size()=1 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.461__shadow_.uGeAd95tyN79Ui3oTBc72hxYf2B9NdC_0 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8312791576946136938', time=2024-09-12T20:51:02.888971+0000, chain.objs.size()=1 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.kxPnQcotTCrFpzSBR1vXn3lpI1iFmeZ_0 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7139734289356170612', time=2024-09-12T20:51:38.632561+0000, chain.objs.size()=1 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.497__shadow_.A_TTqJ_QbAMy9ZUTcBLzePZ2MN87-1G_0 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.784233035258948825', time=2024-09-12T20:51:51.045793+0000, chain.objs.size()=1 2024-09-12T19:29:41.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.503__shadow:ZaN5iQFdkxMluSElq-iCxGVc.IoNdB._.0iAzXRtuwU4n61WPRJhvnPJx8SSDQ8I_0 2024-09-12T19:29:41.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11807246594270696819', time=2024-09-12T20:54:40.301487+0000, chain.objs.size()=3 2024-09-12T19:29:41.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.521__multipart_mymultipart.2~lWyhbY-UfS3bwuHL_dfbjX1j27JR6tG.1 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.521__multipart_mymultipart.2~lWyhbY-UfS3bwuHL_dfbjX1j27JR6tG.2 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.521__multipart_mymultipart.2~lWyhbY-UfS3bwuHL_dfbjX1j27JR6tG.3 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~hwxEizXDMAu5zYI2GqjJ0N5KdWzaxmD', time=2024-09-12T20:56:10.630984+0000, chain.objs.size()=1 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~hwxEizXDMAu5zYI2GqjJ0N5KdWzaxmD.3 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5182108922076563407', time=2024-09-12T20:58:17.883420+0000, chain.objs.size()=2 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~u2rIrT59cVpopOqVTQMw5cx5D72Q2HK.1 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~u2rIrT59cVpopOqVTQMw5cx5D72Q2HK.2 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11543437721450934299', time=2024-09-12T20:58:59.441146+0000, chain.objs.size()=3 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~SLl3oCAI4oPxXWq86vDjT6QDkL7hzo5.1 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~SLl3oCAI4oPxXWq86vDjT6QDkL7hzo5.2 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~SLl3oCAI4oPxXWq86vDjT6QDkL7hzo5.3 2024-09-12T19:29:41.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1070577260286262264', time=2024-09-12T21:02:42.410500+0000, chain.objs.size()=1 2024-09-12T19:29:41.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.561__multipart_mymultipart.OvtnycrjzLc6CcF83fPb1TFkk7QYHwV7.1 2024-09-12T19:29:41.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18073804255160452870', time=2024-09-12T21:03:14.577526+0000, chain.objs.size()=1 2024-09-12T19:29:41.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:JnTfQ5Jf93ltPf-e1H-5YS-WfzW4uAq_.C9_eOmwWo21Mwwf-2MZzLNDz2eQyIMW_0 2024-09-12T19:29:41.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4159395023039662206', time=2024-09-12T21:05:49.011600+0000, chain.objs.size()=7 2024-09-12T19:29:41.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~XJG3KCYqPLXmsz_tnyRPnRx2lRIUJUN.1 2024-09-12T19:29:41.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.871+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__shadow_testobj.2~XJG3KCYqPLXmsz_tnyRPnRx2lRIUJUN.1_1 2024-09-12T19:29:41.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~XJG3KCYqPLXmsz_tnyRPnRx2lRIUJUN.2 2024-09-12T19:29:41.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__shadow_testobj.2~XJG3KCYqPLXmsz_tnyRPnRx2lRIUJUN.2_1 2024-09-12T19:29:41.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~XJG3KCYqPLXmsz_tnyRPnRx2lRIUJUN.3 2024-09-12T19:29:41.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__shadow_testobj.2~XJG3KCYqPLXmsz_tnyRPnRx2lRIUJUN.3_1 2024-09-12T19:29:41.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.578__multipart_testobj.2~XJG3KCYqPLXmsz_tnyRPnRx2lRIUJUN.4 2024-09-12T19:29:41.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13124776251137442246', time=2024-09-12T21:06:21.091178+0000, chain.objs.size()=1 2024-09-12T19:29:41.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.587__shadow:p-EtYl02hy52ZbDtgvh.H8UG7EyjXDJ_.I2dselw45XmTdl_nqId72iXxu6KPm5a_0 2024-09-12T19:29:41.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2306942371604447492', time=2024-09-12T21:09:27.190809+0000, chain.objs.size()=12 2024-09-12T19:29:41.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__multipart_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.1 2024-09-12T19:29:41.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__shadow_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.1_1 2024-09-12T19:29:41.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__multipart_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.2 2024-09-12T19:29:41.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__shadow_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.2_1 2024-09-12T19:29:41.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__multipart_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.3 2024-09-12T19:29:41.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.875+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__shadow_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.3_1 2024-09-12T19:29:41.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__multipart_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.4 2024-09-12T19:29:41.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__shadow_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.4_1 2024-09-12T19:29:41.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__multipart_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.5 2024-09-12T19:29:41.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__shadow_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.5_1 2024-09-12T19:29:41.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__multipart_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.6 2024-09-12T19:29:41.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.614__shadow_multipart_enc.2~iT3ORlMyCUoLaDDV9UeUw7oeKqdH2s-.6_1 2024-09-12T19:29:41.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~mG7laFVZakkAYf8ohL85T31V9SFJm9m', time=2024-09-12T21:13:27.874795+0000, chain.objs.size()=12 2024-09-12T19:29:41.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__multipart_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.1 2024-09-12T19:29:41.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__shadow_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.1_1 2024-09-12T19:29:41.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__multipart_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.2 2024-09-12T19:29:41.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__shadow_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.2_1 2024-09-12T19:29:41.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__multipart_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.3 2024-09-12T19:29:41.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__shadow_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.3_1 2024-09-12T19:29:41.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.879+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__multipart_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.4 2024-09-12T19:29:41.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__shadow_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.4_1 2024-09-12T19:29:41.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__multipart_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.5 2024-09-12T19:29:41.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__shadow_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.5_1 2024-09-12T19:29:41.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__multipart_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.6 2024-09-12T19:29:41.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.625__shadow_multipart_enc.2~mG7laFVZakkAYf8ohL85T31V9SFJm9m.6_1 2024-09-12T19:29:41.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13428919977835526797', time=2024-09-12T21:14:37.008089+0000, chain.objs.size()=1 2024-09-12T19:29:41.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.648__shadow_.7qbHd50efZTe0iGq7i0C6f7igf-_G6X_0 2024-09-12T19:29:41.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2797906824324984976', time=2024-09-12T21:16:12.805181+0000, chain.objs.size()=1 2024-09-12T19:29:41.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.665__shadow_.H8y3ilCUM_fsXQY7otoxGM8Fptx02zL_0 2024-09-12T19:29:41.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2575773210741377527', time=2024-09-12T21:17:09.841420+0000, chain.objs.size()=1 2024-09-12T19:29:41.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.696__shadow:UfphBcMDl8cS3Szw49VA0Tub.RZmJsW_.QiMMX2xCG87P_DP_2Q_IrFZ4ipQrIbc_0 2024-09-12T19:29:41.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7036932592254578974', time=2024-09-12T21:19:46.566627+0000, chain.objs.size()=1 2024-09-12T19:29:41.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.883+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.744__shadow_.Yzr_3UpWMkkRa-1zx-0KbRYNkaz0n2B_0 2024-09-12T19:29:41.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.887+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.887+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T19:29:41.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46497' 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_5mC_JOZanAbCwTOmNJzDDPYe3FC7l1H', time=2024-09-12T20:29:08.064321+0000, chain.objs.size()=3 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.YiJ9SvxLjC99yXIwIAQV5-8nOoOejkq_0 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.YiJ9SvxLjC99yXIwIAQV5-8nOoOejkq_1 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.YiJ9SvxLjC99yXIwIAQV5-8nOoOejkq_2 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9363560239365205846', time=2024-09-12T20:35:37.228862+0000, chain.objs.size()=1 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.235__shadow_.64jMap_8GoAca4O3KUPsZ9LdSSM7ik9_0 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.199229307913228412', time=2024-09-12T20:35:53.377144+0000, chain.objs.size()=1 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.241__shadow_.ZMMPpLMttQ4UuwmKX-4HH17rpnmTWv4_0 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8975480426656239412', time=2024-09-12T20:38:22.771955+0000, chain.objs.size()=1 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.duFRHrrIlp5vyAaUPz4HRSF6BEQEVlQ_0 2024-09-12T19:29:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15975964492307541640', time=2024-09-12T20:38:23.245981+0000, chain.objs.size()=1 2024-09-12T19:29:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.YhYPbFFqLBd1XYanJtUvLCPWE37hECX_0 2024-09-12T19:29:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10388598408207529736', time=2024-09-12T20:38:23.592077+0000, chain.objs.size()=1 2024-09-12T19:29:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.d1CvYMhAhn0_HYkQEQ_C4L6Idt5F_Zw_0 2024-09-12T19:29:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9134955079478551421', time=2024-09-12T20:38:23.983572+0000, chain.objs.size()=1 2024-09-12T19:29:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Mjl6nbIN6DdJmURS2zrjDoEVybZd2-p_0 2024-09-12T19:29:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12901670427591186772', time=2024-09-12T20:38:25.043528+0000, chain.objs.size()=1 2024-09-12T19:29:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.s0Ax3m2ta2am3m9RxJ7VeUnoPPAUv2E_0 2024-09-12T19:29:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.97210155681759486', time=2024-09-12T20:38:25.103275+0000, chain.objs.size()=1 2024-09-12T19:29:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.OPYmd8zdzr_2IaLcdhqpriWH9kE4ztt_0 2024-09-12T19:29:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.262779242990018987', time=2024-09-12T20:38:26.816725+0000, chain.objs.size()=1 2024-09-12T19:29:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.891+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5QCcrymAMcoo68Wo-IpWAcQ7dji9pSI_0 2024-09-12T19:29:41.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7253989044464392708', time=2024-09-12T20:38:27.020379+0000, chain.objs.size()=1 2024-09-12T19:29:41.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4t_YokMyfmM0vPY51QtonoYdHZ9mVwj_0 2024-09-12T19:29:41.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17885170866955530861', time=2024-09-12T20:38:27.264632+0000, chain.objs.size()=1 2024-09-12T19:29:41.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RK47p2JrJZxhlw95YWwiQkbL-k69Qct_0 2024-09-12T19:29:41.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15787205997168712404', time=2024-09-12T20:38:28.887981+0000, chain.objs.size()=1 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5YQEPctLLoGAR9onIRh0eCDeWorebxi_0 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2942743433301114666', time=2024-09-12T20:38:28.890198+0000, chain.objs.size()=1 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.KH6fJb3ZzjainPd9cxSON2dPXnPjgfX_0 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7082819048339308263', time=2024-09-12T20:38:29.324315+0000, chain.objs.size()=1 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.NvAXq3lC9ntX6QcY9pp02Rai73Fd58H_0 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4111940938869152047', time=2024-09-12T20:38:30.377345+0000, chain.objs.size()=1 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QhD62W3wQbWhgGisejmOuumHbm5yokV_0 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.795248812780821258', time=2024-09-12T20:38:30.393123+0000, chain.objs.size()=1 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ptCfiB4HAaoy-Dd0nj1iDDGlmxJ9pEU_0 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8800455443877737571', time=2024-09-12T20:38:30.394911+0000, chain.objs.size()=1 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.2Kj1eEcBzkZfqTL0Fao3KCnSuUwkzKS_0 2024-09-12T19:29:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.688789920260051689', time=2024-09-12T20:38:30.399274+0000, chain.objs.size()=1 2024-09-12T19:29:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GbjTqYs2r61_pgTXN9m3X9Ddcj07Lme_0 2024-09-12T19:29:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1505334397661836526', time=2024-09-12T20:38:31.938873+0000, chain.objs.size()=1 2024-09-12T19:29:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.BN99GOGlc2yUL-kL1bLokfS81rUAUWp_0 2024-09-12T19:29:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3554406156109491406', time=2024-09-12T20:38:32.311369+0000, chain.objs.size()=1 2024-09-12T19:29:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.TZQ14sQ8ImNL1ZaM7y57EZwgv6nMXdz_0 2024-09-12T19:29:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10684755754667956606', time=2024-09-12T20:38:32.744113+0000, chain.objs.size()=1 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.IRdodE17gU7jJs6YbcY_mJj3X2Ol-DK_0 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6941067471941646002', time=2024-09-12T20:38:33.085454+0000, chain.objs.size()=1 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hwBIuB4CEQLRvOKataiGzcWJvryaSpn_0 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2077079536667428206', time=2024-09-12T20:38:33.087468+0000, chain.objs.size()=1 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.omthpfug2uTVLrwW04gt6dENVGJivur_0 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15853523239984431799', time=2024-09-12T20:38:34.437881+0000, chain.objs.size()=1 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.NFBL4m7yH1fQYcVQUpjXHPC3_lmAZJZ_0 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17060202103908681689', time=2024-09-12T20:38:35.807900+0000, chain.objs.size()=1 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-hqD5RICoai2DPhdPi9JNTF4VV_dPsn_0 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4385111043191688214', time=2024-09-12T20:38:36.078303+0000, chain.objs.size()=1 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5cK_KpVOPw26bq-FZSusEyUmAtk8oqb_0 2024-09-12T19:29:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17906381458346048845', time=2024-09-12T20:38:36.170911+0000, chain.objs.size()=1 2024-09-12T19:29:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-xz2ZUHKbW7gusfsIrEqJdIOybu-cQw_0 2024-09-12T19:29:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4614134224779038160', time=2024-09-12T20:38:36.727480+0000, chain.objs.size()=1 2024-09-12T19:29:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.UsjVOFyrKwMTh4faS-X9NxlTWUYww4k_0 2024-09-12T19:29:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1536595220305501383', time=2024-09-12T20:38:41.846034+0000, chain.objs.size()=1 2024-09-12T19:29:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nDrHTFJJpYYGWP9PCznJjIacyvL4ecb_0 2024-09-12T19:29:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3419905067379205086', time=2024-09-12T20:38:43.195463+0000, chain.objs.size()=1 2024-09-12T19:29:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lyLPVC4DjBTM-GZA9NrEijW2D6NyEqm_0 2024-09-12T19:29:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9219931406118915109', time=2024-09-12T20:38:43.327791+0000, chain.objs.size()=1 2024-09-12T19:29:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.895+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.l1_YV9ZAeZs4dKJPSAKXe76N2fZk202_0 2024-09-12T19:29:41.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14186557946572821459', time=2024-09-12T20:38:45.625262+0000, chain.objs.size()=1 2024-09-12T19:29:41.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.V023U4pUvJ_OQG4pOZ2cGo3eHxtiGaN_0 2024-09-12T19:29:41.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8815553991278593463', time=2024-09-12T20:38:46.225240+0000, chain.objs.size()=1 2024-09-12T19:29:41.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0zMdWR4KIlNVE87Fa_SvpHuEOnTqB2t_0 2024-09-12T19:29:41.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2492950854973013176', time=2024-09-12T20:38:47.275776+0000, chain.objs.size()=1 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.HqYBmopfcHHZTikZ3H6sqEGULl5vtz7_0 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12611455066707032571', time=2024-09-12T20:38:47.562265+0000, chain.objs.size()=1 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.DnOLnkvCtJhOUSl8MQbCDRjv2EANiqi_0 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10151701877921382118', time=2024-09-12T20:38:48.222075+0000, chain.objs.size()=1 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.05m_Wnr9jWf6zs27Robzz_FlRTdc49A_0 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4927383349103413209', time=2024-09-12T20:38:49.330567+0000, chain.objs.size()=1 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fez9Hs2JoVNbV_NRRttRouScCvXEZeK_0 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17514564908948625814', time=2024-09-12T20:38:50.067165+0000, chain.objs.size()=1 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jd3Zwg20UvRFabfr20dkntGF-MvRLhp_0 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1373111940057345740', time=2024-09-12T20:39:08.116302+0000, chain.objs.size()=1 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.270__shadow_.DNtqzmvq5Jkm4vyy8IVGutfgM5aPbwu_0 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7993742303007908511', time=2024-09-12T20:39:14.643829+0000, chain.objs.size()=1 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.273__shadow_.k36_ElF9pqCF6VUZpEA9HpWwXeWh22S_0 2024-09-12T19:29:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10411995734884458478', time=2024-09-12T20:39:42.074093+0000, chain.objs.size()=1 2024-09-12T19:29:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.285__shadow_.dz_foyGL6MBrLZjW5GizaLd94ln-J7A_0 2024-09-12T19:29:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2643808520492111801', time=2024-09-12T20:40:19.453668+0000, chain.objs.size()=1 2024-09-12T19:29:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.298__shadow_.EBneoTZhx6IFJd-4u6dpAtWpZIywRnL_0 2024-09-12T19:29:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16613622884196117096', time=2024-09-12T20:40:21.906988+0000, chain.objs.size()=1 2024-09-12T19:29:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.299__shadow_.UnZE-SkZS94FiO5zWwFWrSJWQsscRLP_0 2024-09-12T19:29:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7384225227359775280', time=2024-09-12T20:40:33.466842+0000, chain.objs.size()=1 2024-09-12T19:29:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.304__shadow_.LQO81bhBkh3rzIaHS4zp3WyRDM8LW4x_0 2024-09-12T19:29:41.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1256557729511418563', time=2024-09-12T20:40:35.745396+0000, chain.objs.size()=1 2024-09-12T19:29:41.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.899+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.305__shadow_.NNZnzmsj9ncH3VFpNo3BW16Pe5sCrb7_0 2024-09-12T19:29:41.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4977816400805000321', time=2024-09-12T20:43:02.932117+0000, chain.objs.size()=1 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.PfiONZeebRDFv441sPm7PyikAWeDQMf_0 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12958175715066538715', time=2024-09-12T20:43:03.158582+0000, chain.objs.size()=1 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HBRnKYsI894pTeWHlPK2yDyYJFczPf0_0 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5719489032976012029', time=2024-09-12T20:43:04.214660+0000, chain.objs.size()=1 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.aTVjIJb5fvFJnaXbu17j0mG26gryVvv_0 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10435202112263607819', time=2024-09-12T20:43:04.299274+0000, chain.objs.size()=1 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.1ged-eBi_dEu6z4Jp1o4VOU9TmIpQUB_0 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16805098167125701521', time=2024-09-12T20:43:04.301082+0000, chain.objs.size()=1 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cXqARjrKUgpduthJ4PlPFxfjsiq016m_0 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10238253228639070002', time=2024-09-12T20:43:04.347424+0000, chain.objs.size()=1 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.72aQaSVkAPjGwcFp7IPh-UpGgwb9PmN_0 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9022035139784483206', time=2024-09-12T20:43:05.159625+0000, chain.objs.size()=1 2024-09-12T19:29:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.kJral6R346U6pk3VxdqFfvBxC11t1Cg_0 2024-09-12T19:29:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10594294941652860075', time=2024-09-12T20:43:07.299235+0000, chain.objs.size()=1 2024-09-12T19:29:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.2xdMD44zfylmuKtVUVMTGuGUzKRKpsK_0 2024-09-12T19:29:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15382892470466867508', time=2024-09-12T20:43:07.830914+0000, chain.objs.size()=1 2024-09-12T19:29:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.LZpQ4MepgI2rEjtlAULJ49F8iWWmC0J_0 2024-09-12T19:29:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14407990212278450932', time=2024-09-12T20:43:08.252903+0000, chain.objs.size()=1 2024-09-12T19:29:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.NwwKewvg1cYpuhGngy4KqkmJgotPVyz_0 2024-09-12T19:29:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14172247132403165921', time=2024-09-12T20:43:08.257582+0000, chain.objs.size()=1 2024-09-12T19:29:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pHbWwWDjxoHzlkMxiBgRVVSBeGOpgsK_0 2024-09-12T19:29:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7660671983578682807', time=2024-09-12T20:43:09.053572+0000, chain.objs.size()=1 2024-09-12T19:29:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.M6RhEwDDv5Vd5SsTUbLU5R6BGxRTvv2_0 2024-09-12T19:29:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1111286423493575807', time=2024-09-12T20:43:12.138209+0000, chain.objs.size()=1 2024-09-12T19:29:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SG3m68cg0xFPtxOZpuHHTVuZ1ARyGe4_0 2024-09-12T19:29:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8043302893995405801', time=2024-09-12T20:43:12.434872+0000, chain.objs.size()=1 2024-09-12T19:29:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5oFBjr5tVmWVkCvvqg594zWhjVh1bqS_0 2024-09-12T19:29:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10130331873277220232', time=2024-09-12T20:43:14.294465+0000, chain.objs.size()=1 2024-09-12T19:29:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Kr9rXIKI3wXGS31zPVccknanS1lsVAC_0 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5125827601718472546', time=2024-09-12T20:43:16.096167+0000, chain.objs.size()=1 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.odnkqoWFq3olHcgQlvtLrHbo4XE67Ca_0 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6171263702682339289', time=2024-09-12T20:43:16.358090+0000, chain.objs.size()=1 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gINcOw_ObKzsKU9Qmvaja6-sLBFRKnV_0 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15751565046700821731', time=2024-09-12T20:43:17.669182+0000, chain.objs.size()=1 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.903+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-xpLnEy0mcRmzwt4njLpsOlBqQk-zXi_0 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11870024017599497904', time=2024-09-12T20:43:17.773953+0000, chain.objs.size()=1 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fWMYi0a7b2g9U5PhTzOA5axEGQvy2_A_0 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14310762883035568805', time=2024-09-12T20:43:17.838829+0000, chain.objs.size()=1 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.1UFkF4rkh-3-FrgRQGUud1qRk5dpZh9_0 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4261664393433929686', time=2024-09-12T20:43:18.039163+0000, chain.objs.size()=1 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.iUlgJaWeB3oZVIrCkvHmS5IpRcH5epL_0 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14765129072536226858', time=2024-09-12T20:43:19.891137+0000, chain.objs.size()=1 2024-09-12T19:29:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.FayyTaaggqbSvpKxGAeeyJkeMub1GAw_0 2024-09-12T19:29:41.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3578733073455077935', time=2024-09-12T20:43:19.935180+0000, chain.objs.size()=1 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nKF2KGDTCj9XMZvWJ83hbmgABtKb2Sz_0 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6592179654172356383', time=2024-09-12T20:43:21.657198+0000, chain.objs.size()=1 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.oPi4bwhkCmnQe2ziTJK2NpVpJc_T2xp_0 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17271657681661694533', time=2024-09-12T20:43:22.710727+0000, chain.objs.size()=1 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Mz13jdEu_blp2q5HIpFpQSlzEbJANKv_0 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10778819714810846770', time=2024-09-12T20:43:23.498793+0000, chain.objs.size()=1 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.p-U9VfNNr4aHhwwSftONXyqit9ZUTgj_0 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10681217827128954195', time=2024-09-12T20:43:25.258808+0000, chain.objs.size()=1 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tPkZTDCTctugYLXnc9DFtYcPRXHYf3a_0 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6526083243123236690', time=2024-09-12T20:43:25.261118+0000, chain.objs.size()=1 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.hw2bqUvz2qH70SzgjvvtWnhm8V9Nn1v_0 2024-09-12T19:29:41.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9837834894094140374', time=2024-09-12T20:43:25.358001+0000, chain.objs.size()=1 2024-09-12T19:29:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QomyF-ha4_ew_qPHgCAjO_cK-kr8NrV_0 2024-09-12T19:29:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18261618073439958800', time=2024-09-12T20:43:26.197238+0000, chain.objs.size()=1 2024-09-12T19:29:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.LhQh8xANDfa-vn6RHKamcPF3pTnjFeQ_0 2024-09-12T19:29:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12843364080878296506', time=2024-09-12T20:43:26.507171+0000, chain.objs.size()=1 2024-09-12T19:29:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pvDCqeD8teKtY6boFKfSY83B1a8clOp_0 2024-09-12T19:29:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11814113912022228976', time=2024-09-12T20:43:26.853347+0000, chain.objs.size()=1 2024-09-12T19:29:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0XCUBim49cYn1ofO7WlGMv9HejZvGPs_0 2024-09-12T19:29:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4085939778630295010', time=2024-09-12T20:43:29.820756+0000, chain.objs.size()=1 2024-09-12T19:29:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.GenpOhKM8dIWKxRSFC885I5BLmn2ay9_0 2024-09-12T19:29:41.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15573615526937741481', time=2024-09-12T20:45:11.095662+0000, chain.objs.size()=1 2024-09-12T19:29:41.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.tjFIGeGMZ31vbALFZpXn4gWa-Y5g_EX_0 2024-09-12T19:29:41.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13314052263820471752', time=2024-09-12T20:45:12.970903+0000, chain.objs.size()=1 2024-09-12T19:29:41.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hEImnNKieKgulXJH98jq7cbX5oKtK6i_0 2024-09-12T19:29:41.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10604952172499082822', time=2024-09-12T20:45:14.840149+0000, chain.objs.size()=1 2024-09-12T19:29:41.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Ml16-e8-OCdbUb0ltKggg3wrRCudqvY_0 2024-09-12T19:29:41.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2075032296567959775', time=2024-09-12T20:45:16.275727+0000, chain.objs.size()=1 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ExEFJ5P-Uf6LEJ9unisWDxld51tUm08_0 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5440968104854438192', time=2024-09-12T20:45:16.724793+0000, chain.objs.size()=1 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.907+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.iIDBrJVaeO-RMa6wRudBq_Y-tpFdQWT_0 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10388385560847614288', time=2024-09-12T20:45:17.410338+0000, chain.objs.size()=1 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.L55yVoEaA3M9nJ1F5SWqiq9MTy6fsLP_0 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10774535316114331141', time=2024-09-12T20:45:17.475289+0000, chain.objs.size()=1 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DlrSiIFaY9nD_hCMlybyIvtbnmUmPQU_0 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13172810824007935994', time=2024-09-12T20:45:18.391171+0000, chain.objs.size()=1 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Z3zrStLLNkaRlYOBbufF5adn6dw7WIk_0 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15381015320993295295', time=2024-09-12T20:45:18.392900+0000, chain.objs.size()=1 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.50LN7elJlt8INP_bU3oG6ey_Y-gz9FB_0 2024-09-12T19:29:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4544081033407511611', time=2024-09-12T20:45:20.379442+0000, chain.objs.size()=1 2024-09-12T19:29:41.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wh2jLD6L54kJgp1Qqupe8FZ1s7pnIF__0 2024-09-12T19:29:41.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16710627506904487246', time=2024-09-12T20:45:22.081566+0000, chain.objs.size()=1 2024-09-12T19:29:41.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.mAdEdeUVjljtaiqCJ6fE0qfikS3vsHl_0 2024-09-12T19:29:41.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6658062857081484524', time=2024-09-12T20:45:22.083817+0000, chain.objs.size()=1 2024-09-12T19:29:41.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.iAlQJQN6HlcyQbQp0wycozicZWwBupM_0 2024-09-12T19:29:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2302263784167246930', time=2024-09-12T20:45:24.216502+0000, chain.objs.size()=1 2024-09-12T19:29:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ccblOWutbQwf9ljan8PDWVTg1uuq9L-_0 2024-09-12T19:29:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5280666365855107798', time=2024-09-12T20:45:24.531964+0000, chain.objs.size()=1 2024-09-12T19:29:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.rD_dHIKg_UQnBVTguIOY8EN-FYhMDK7_0 2024-09-12T19:29:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5933883024861530568', time=2024-09-12T20:45:24.814044+0000, chain.objs.size()=1 2024-09-12T19:29:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.AZ0p20ycRn5dsPgDpYpBMm8_6inf-Ft_0 2024-09-12T19:29:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.249915348053181642', time=2024-09-12T20:45:26.078086+0000, chain.objs.size()=1 2024-09-12T19:29:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.riBL4V_s_pfo0VAYlf6ngonuEK-pZj5_0 2024-09-12T19:29:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9159286472215082002', time=2024-09-12T20:45:26.355452+0000, chain.objs.size()=1 2024-09-12T19:29:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nST1znQyCmGUk7UEAHXMQApASDdeMpp_0 2024-09-12T19:29:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12191636638273597411', time=2024-09-12T20:45:27.356833+0000, chain.objs.size()=1 2024-09-12T19:29:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xubSNifaN0M8QQm5xmzJJaxTPOOsvfh_0 2024-09-12T19:29:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16967680663276275919', time=2024-09-12T20:45:27.774215+0000, chain.objs.size()=1 2024-09-12T19:29:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dKCedTtB_d61myWqFbi3elA5KItCtpS_0 2024-09-12T19:29:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17676877698369807489', time=2024-09-12T20:45:29.164303+0000, chain.objs.size()=1 2024-09-12T19:29:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9nMZp2BFMnhGk93T0yI3NYTpCc0t-cP_0 2024-09-12T19:29:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1979631820190556954', time=2024-09-12T20:45:30.566562+0000, chain.objs.size()=1 2024-09-12T19:29:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.911+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.VCrl3FtK3YWyXAOJz3Vo-0JmKzj-myN_0 2024-09-12T19:29:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46497 2024-09-12T19:29:41.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T19:29:41.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1820162179634302247', time=2024-09-12T20:45:32.845799+0000, chain.objs.size()=1 2024-09-12T19:29:41.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.01EckJnLvCYwuEFS5x6tE0mAbJu64bz_0 2024-09-12T19:29:41.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2784189282925526542', time=2024-09-12T20:45:33.282310+0000, chain.objs.size()=1 2024-09-12T19:29:41.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.C_hXeLON_7eDPcxe5rws99vLPkhiS8e_0 2024-09-12T19:29:41.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9989201841493202014', time=2024-09-12T20:45:34.049414+0000, chain.objs.size()=1 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.E9ITcuvkzJJngTjBTFkXpz-wTlRFUNZ_0 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5679380609397970671', time=2024-09-12T20:45:34.162343+0000, chain.objs.size()=1 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pKMThY3vgCdpnW21JzmnjDBUeC7RSE6_0 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8127908701645077522', time=2024-09-12T20:45:34.226745+0000, chain.objs.size()=1 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.rzSNWaiMEJ3CMMqD_83e5DlDePIFusw_0 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11821270614049821501', time=2024-09-12T20:45:36.148176+0000, chain.objs.size()=1 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.QsZQ2zJVSveI2vc9Gh_DH773zYjFkZy_0 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.648144232871144726', time=2024-09-12T20:45:36.430463+0000, chain.objs.size()=1 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fKBvUe2GOS5DKdXCT2DrNIgZNMKAC5y_0 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2369172886697848549', time=2024-09-12T20:45:37.278586+0000, chain.objs.size()=1 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.o89pZhPRKzVN3h1FxnKcmGxCdgwn5ta_0 2024-09-12T19:29:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13396791670236321719', time=2024-09-12T20:45:37.390213+0000, chain.objs.size()=1 2024-09-12T19:29:41.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kXlyzvA8bW4WP5LZXHGyDiHftZSAz-o_0 2024-09-12T19:29:41.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11683325314700301690', time=2024-09-12T20:45:37.483161+0000, chain.objs.size()=1 2024-09-12T19:29:41.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.u05mVyaM-hVEk2aJiTjN48dbtrYg-R0_0 2024-09-12T19:29:41.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7378392382051524977', time=2024-09-12T20:45:38.052213+0000, chain.objs.size()=1 2024-09-12T19:29:41.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Z_ksiafNs0A5R-vFMoROu_t-4QX6L2x_0 2024-09-12T19:29:41.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8758712985057407224', time=2024-09-12T20:49:07.354122+0000, chain.objs.size()=1 2024-09-12T19:29:41.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.915+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.430__shadow_.2uitysIRV_TUr0fqIEwwtvzSWqnUrp2_0 2024-09-12T19:29:41.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5695441576306892555', time=2024-09-12T20:50:30.520993+0000, chain.objs.size()=1 2024-09-12T19:29:41.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.464__shadow_._D8Pljw0LXuz4W9psY3AbZTfVLAbtBP_0 2024-09-12T19:29:41.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3330701566486896860', time=2024-09-12T20:50:36.254911+0000, chain.objs.size()=1 2024-09-12T19:29:41.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.466__shadow_.CbpF5A8Acp-lROfMPVFsr9o-xwIpyoI_0 2024-09-12T19:29:41.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8149362287006870168', time=2024-09-12T20:50:57.114880+0000, chain.objs.size()=1 2024-09-12T19:29:41.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.481__shadow_.C_yuvcUYgomiskUnhcJakdnQBd158Of_0 2024-09-12T19:29:41.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2283628382977598321', time=2024-09-12T21:03:08.012926+0000, chain.objs.size()=1 2024-09-12T19:29:41.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:poDHOfJKqD77qL8j.gcj7zdiORpYoE7_.KAcU3YYKQoTlVhNZ_DhCfq63Z6-Kogu_0 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10269367939646913645', time=2024-09-12T21:03:31.642541+0000, chain.objs.size()=1 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.570__shadow:AxYRztIbCeXh4OquwBRcuU-oIUjRgys_.pZxnm-FMIPaPx1JG6bTBp1AoA8V0S5p_0 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2951618593108804516', time=2024-09-12T21:05:54.669392+0000, chain.objs.size()=1 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.579__shadow:U7ovhMpXh0VvIa-fLroiTYFP9ICNEDu_.cEBLy-l3naj67t0Cqb5w30vc3CBcnib_0 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5161257313304287068', time=2024-09-12T21:16:16.084751+0000, chain.objs.size()=1 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.666__shadow_.8FbOhkPUCptYOMLRpDbef3eG881JwHc_0 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17699616004402686885', time=2024-09-12T21:17:31.751355+0000, chain.objs.size()=1 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.706__shadow_.wmPmjCvyJiBc81KbNlHL7kVZvdTPEst_0 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2123096043232107528', time=2024-09-12T21:17:39.879406+0000, chain.objs.size()=1 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.710__shadow:y7QKbKrREEJT9Cg.GFdYxKMr3XGVk7i_.g696r1GYXdM3lCDgNCVb0s17-2iXAiN_0 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11323132790403175306', time=2024-09-12T21:17:47.934679+0000, chain.objs.size()=1 2024-09-12T19:29:41.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.714__shadow:hyu4ymKVOyys8i.sRajEc-r7jZQlcO6_.vt_5Y8y-L7VHK_HFLpD33OLAXMks5Er_0 2024-09-12T19:29:41.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5306797834273952422', time=2024-09-12T21:19:21.593730+0000, chain.objs.size()=1 2024-09-12T19:29:41.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.739__shadow_.4LgYWZcIZ_uzDMlxE6FUuSTxa2RudoP_0 2024-09-12T19:29:41.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.919+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.923+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T19:29:41.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.923+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.923+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48945' 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7517945703970346588', time=2024-09-12T20:28:02.006662+0000, chain.objs.size()=1 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.148__shadow_.Fh-lEOiguC_ko9fNVTd67aDiqF1qLcv_0 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9890658360762603029', time=2024-09-12T20:29:06.261688+0000, chain.objs.size()=3 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.BbWevxzy4cut-ROokvBAO_Ipm4fdiLW_0 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.BbWevxzy4cut-ROokvBAO_Ipm4fdiLW_1 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.BbWevxzy4cut-ROokvBAO_Ipm4fdiLW_2 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8001034198779036004', time=2024-09-12T20:30:59.287494+0000, chain.objs.size()=1 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.183__shadow_.nqytzH_i-m4S3YWhnD_PX5b2Eh54YsQ_0 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1450476174314021923', time=2024-09-12T20:35:27.865688+0000, chain.objs.size()=1 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.231__shadow_.rcIaD3y5lGBhgsjhB-HJY5zSvYKnlaw_0 2024-09-12T19:29:41.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6996585862698751853', time=2024-09-12T20:35:27.867788+0000, chain.objs.size()=1 2024-09-12T19:29:41.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.231__shadow_.WBaCreg0TkssmB4zJ1VGkT6HtGxoInh_0 2024-09-12T19:29:41.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18371047081494938056', time=2024-09-12T20:35:34.792278+0000, chain.objs.size()=1 2024-09-12T19:29:41.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.234__shadow_.1C9FWINLTrKTWiywAI5o9zHRUNE2pn8_0 2024-09-12T19:29:41.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9556161579189891216', time=2024-09-12T20:35:39.529672+0000, chain.objs.size()=1 2024-09-12T19:29:41.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.236__shadow_.sGLGKoLezEBodyyRjuCcIVOuNZA8HQJ_0 2024-09-12T19:29:41.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14620092344435383457', time=2024-09-12T20:35:43.367465+0000, chain.objs.size()=1 2024-09-12T19:29:41.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.237__shadow_.HISXoEo3jXyZeL7RioDk9UFt8q2c3Pj_0 2024-09-12T19:29:41.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2454548927597545933', time=2024-09-12T20:35:49.201540+0000, chain.objs.size()=1 2024-09-12T19:29:41.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.239__shadow_.H3FEYpbVPiILgsMStc3debSuuwtMsjr_0 2024-09-12T19:29:41.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18293666964324911485', time=2024-09-12T20:35:59.485636+0000, chain.objs.size()=1 2024-09-12T19:29:41.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.243__shadow_.gkN6Yf6jN6rEYDEoVT3qy18lT3bs8j4_0 2024-09-12T19:29:41.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15483030012866306534', time=2024-09-12T20:36:05.621086+0000, chain.objs.size()=1 2024-09-12T19:29:41.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.245__shadow_.jcmEdB3YEOSl5yT5kMUMPO1QwGtm7HY_0 2024-09-12T19:29:41.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5577668558321299363', time=2024-09-12T20:36:10.206042+0000, chain.objs.size()=1 2024-09-12T19:29:41.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.247__shadow_.srG1UYxwJOInE_cJQCLb-2kXDCZC2Ue_0 2024-09-12T19:29:41.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1561567107199673279', time=2024-09-12T20:36:35.249707+0000, chain.objs.size()=1 2024-09-12T19:29:41.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.258__shadow_.T79zt9eOjF9nIOUt6VUQB_JNj7LdNFw_0 2024-09-12T19:29:41.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12557735615604501126', time=2024-09-12T20:38:22.481897+0000, chain.objs.size()=1 2024-09-12T19:29:41.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.10W2aBp4eYEAvVCh8KvT2HDHK90pH9J_0 2024-09-12T19:29:41.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.300873072770478420', time=2024-09-12T20:38:23.983365+0000, chain.objs.size()=1 2024-09-12T19:29:41.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hp8zoQeHxjWuIsFpwOfhMkAqiybzN2U_0 2024-09-12T19:29:41.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14501745546541205042', time=2024-09-12T20:38:24.801348+0000, chain.objs.size()=1 2024-09-12T19:29:41.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CjUzcw1x6l6EkXPNibg6hsMH0gh398c_0 2024-09-12T19:29:41.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3729959340246947192', time=2024-09-12T20:38:24.822741+0000, chain.objs.size()=1 2024-09-12T19:29:41.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.umHQ1qG9Ea3aBRcSqHukcmz_051TONU_0 2024-09-12T19:29:41.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17646849721376269908', time=2024-09-12T20:38:26.481934+0000, chain.objs.size()=1 2024-09-12T19:29:41.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.927+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Engqvhq3LTuWq4iIID8Dn9BAOGpsDD1_0 2024-09-12T19:29:41.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5113793453711714853', time=2024-09-12T20:38:26.896835+0000, chain.objs.size()=1 2024-09-12T19:29:41.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._fJOh8tLrg3r8esLdCyVeKJQRaZAuQ4_0 2024-09-12T19:29:41.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9635471605624636110', time=2024-09-12T20:38:28.244817+0000, chain.objs.size()=1 2024-09-12T19:29:41.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.q1Hx29gyM7gAsikluKym_kGfTu85hhU_0 2024-09-12T19:29:41.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12858961544174428782', time=2024-09-12T20:38:28.660810+0000, chain.objs.size()=1 2024-09-12T19:29:41.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.cEYZ7FyQYtZl5IAfpo96gOCvpPn7XyH_0 2024-09-12T19:29:41.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1118491006191268420', time=2024-09-12T20:38:30.419810+0000, chain.objs.size()=1 2024-09-12T19:29:41.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aC8mzGLFIHDeEj1cek6cD5_VlWV21Is_0 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3564019590065465373', time=2024-09-12T20:38:30.421782+0000, chain.objs.size()=1 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rBtYntyir4TtgNUz9TOnhRlf8yiOYue_0 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10609661342490234557', time=2024-09-12T20:38:31.579398+0000, chain.objs.size()=1 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wiIHe6GOTUiOD8_ePk03ymIIHEg0XA__0 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13014746862085783262', time=2024-09-12T20:38:32.743985+0000, chain.objs.size()=1 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.coQRnFYlN1-A1GDv7bhzgsNOBh8AcqI_0 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11196255650406577504', time=2024-09-12T20:38:32.993828+0000, chain.objs.size()=1 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.3cbH5eS0Kwz29Jsdqlb8y7kS48PVH-t_0 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8755217612388894', time=2024-09-12T20:38:34.028605+0000, chain.objs.size()=1 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.R3N6op00Dcqzvs_UBc3cBGlm_ysV3WZ_0 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10395909633630234682', time=2024-09-12T20:38:34.032289+0000, chain.objs.size()=1 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Gsw8kW9_0fMPBsWo78vI69EM9DYKkSG_0 2024-09-12T19:29:41.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17812211495433298148', time=2024-09-12T20:38:34.436686+0000, chain.objs.size()=1 2024-09-12T19:29:41.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Tb5lFkIDYN21HBFhBlN22MOtlkpUTTF_0 2024-09-12T19:29:41.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6093322944011515755', time=2024-09-12T20:38:34.820026+0000, chain.objs.size()=1 2024-09-12T19:29:41.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.yR_iKwccveYyO7gHPptvXbk5xbGSzxJ_0 2024-09-12T19:29:41.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13481913702634921004', time=2024-09-12T20:38:36.687803+0000, chain.objs.size()=1 2024-09-12T19:29:41.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kA9EAG0TiipTaCZ69z8ddY9h8NDiwe9_0 2024-09-12T19:29:41.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8027740196584107142', time=2024-09-12T20:38:37.801569+0000, chain.objs.size()=1 2024-09-12T19:29:41.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._HuWIA6UdExSJ79tQLgXdRUU1ToEjH4_0 2024-09-12T19:29:41.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17415695319536736514', time=2024-09-12T20:38:38.921525+0000, chain.objs.size()=1 2024-09-12T19:29:41.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1SURQWu6PaN646-WxYEa79SKazTxuga_0 2024-09-12T19:29:41.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4694588321342700569', time=2024-09-12T20:38:38.963376+0000, chain.objs.size()=1 2024-09-12T19:29:41.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.931+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7ZrVkurLkRy3OuOGrLk7xkxefHOcNb9_0 2024-09-12T19:29:41.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4274773625265035916', time=2024-09-12T20:38:38.965087+0000, chain.objs.size()=1 2024-09-12T19:29:41.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5LF_iNxx2uMRDs4ZB0-gG8dxtSAgqbP_0 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.615575936789093584', time=2024-09-12T20:38:40.197590+0000, chain.objs.size()=1 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.3BwgAlhTT7vLDIB8v545uEF3YD5DEqT_0 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7676113660749453104', time=2024-09-12T20:38:41.269754+0000, chain.objs.size()=1 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.xjbKczEkldn4_8GFMsetiJtbDRU4Abv_0 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4162338402193232043', time=2024-09-12T20:38:41.702020+0000, chain.objs.size()=1 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fPv0_A2yeGwFXa4Adx4d1t52QiJP6RY_0 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17512617102415132189', time=2024-09-12T20:38:43.403641+0000, chain.objs.size()=1 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Z_AxC9afozTv1brfNHoJ_S0_-aMaPb__0 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14579866705987599647', time=2024-09-12T20:38:43.996300+0000, chain.objs.size()=1 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.d_rii5I26ykFcgoPgug_ioA8dRctUpD_0 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.612046470401859187', time=2024-09-12T20:38:46.888008+0000, chain.objs.size()=1 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GwoiDpc9qba38QXAtfT_5d1TzY7jXSU_0 2024-09-12T19:29:41.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7786590202345452554', time=2024-09-12T20:38:48.789037+0000, chain.objs.size()=1 2024-09-12T19:29:41.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.zzFIB7WYqE5YGV94xjmh54PQ7tpcJ1A_0 2024-09-12T19:29:41.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12087191633022777536', time=2024-09-12T20:38:49.667116+0000, chain.objs.size()=1 2024-09-12T19:29:41.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EzMz2RHdmYC08MzBfrMdQVJ-V2zI9ER_0 2024-09-12T19:29:41.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13527941792817043808', time=2024-09-12T20:39:28.209842+0000, chain.objs.size()=1 2024-09-12T19:29:41.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.279__shadow_.jTEpn0QQgsPMVqGKXZy9suqT8jGfobf_0 2024-09-12T19:29:41.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1734423273435527388', time=2024-09-12T20:39:49.226209+0000, chain.objs.size()=1 2024-09-12T19:29:41.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.288__shadow_.kM6GubNOWTlGqGPHD2W2ck-Kwy3PdO__0 2024-09-12T19:29:41.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2601845128972660461', time=2024-09-12T20:40:07.497496+0000, chain.objs.size()=1 2024-09-12T19:29:41.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.2yTqJwinvDjWq2N5fg87CjsVGzBTFat_0 2024-09-12T19:29:41.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8196965527968860701', time=2024-09-12T20:40:31.150617+0000, chain.objs.size()=1 2024-09-12T19:29:41.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.303__shadow_.kRmixQnvjIeZxi4ZRcfsRn0IWNoCjXI_0 2024-09-12T19:29:41.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1331062227609668806', time=2024-09-12T20:43:02.366728+0000, chain.objs.size()=1 2024-09-12T19:29:41.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.34JODYKe1pHkrdExHRgTIyzhg6iSBLP_0 2024-09-12T19:29:41.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8128763488430439154', time=2024-09-12T20:43:02.466838+0000, chain.objs.size()=1 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Ao-FdO6LFi6I60G0OmqFeFP5XVNwht2_0 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2295399339771320887', time=2024-09-12T20:43:02.932061+0000, chain.objs.size()=1 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AtRKr9bphR4UhnYLum9LnFr9766dUso_0 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9123963482811779768', time=2024-09-12T20:43:03.970801+0000, chain.objs.size()=1 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ZTIVeVb4BhuYh54xtuVJsoCpZTUcrhW_0 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15007836479201007395', time=2024-09-12T20:43:04.668398+0000, chain.objs.size()=1 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.K749n4wX_QEhA6lO0lPPOnFI2LfXb5G_0 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8049109041578024408', time=2024-09-12T20:43:06.708718+0000, chain.objs.size()=1 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9qoUfvAlXeINcKEHHdjflKk4NoRS7j7_0 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9173021556545740993', time=2024-09-12T20:43:07.139012+0000, chain.objs.size()=1 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EG5kCa5dcYh8wpKPiL7M1PK2FV-c-Qg_0 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7741985767523740594', time=2024-09-12T20:43:07.467080+0000, chain.objs.size()=1 2024-09-12T19:29:41.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.LkAfs9mZN_40Ntz50VRVPznbIUnChPh_0 2024-09-12T19:29:41.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12384140165895149990', time=2024-09-12T20:43:08.456469+0000, chain.objs.size()=1 2024-09-12T19:29:41.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Aj-wuwC8PkijlIx4GP70HNCDxqwcVzG_0 2024-09-12T19:29:41.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3164581052602284219', time=2024-09-12T20:43:08.775590+0000, chain.objs.size()=1 2024-09-12T19:29:41.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.935+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YnqvCiTrWBOxC7kwfwdexsskOS-JYez_0 2024-09-12T19:29:41.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4145663024667154176', time=2024-09-12T20:43:08.857663+0000, chain.objs.size()=1 2024-09-12T19:29:41.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.uflmy3fPVI0L7PUopzMLAy7ZVEMqJm8_0 2024-09-12T19:29:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18137957678667095470', time=2024-09-12T20:43:08.922067+0000, chain.objs.size()=1 2024-09-12T19:29:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Iw9m3hdogF0HG5gQMwITFNynsaDzD7P_0 2024-09-12T19:29:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16926683814465777137', time=2024-09-12T20:43:11.181867+0000, chain.objs.size()=1 2024-09-12T19:29:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.66T8lD2j9n6Zfxp7oypJhVzcmTlwDc-_0 2024-09-12T19:29:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1368907260872629571', time=2024-09-12T20:43:11.637886+0000, chain.objs.size()=1 2024-09-12T19:29:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.WAXiqU3ZPtKeuvIlZ1vaU0a-0i7uFTI_0 2024-09-12T19:29:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16223768589715235474', time=2024-09-12T20:43:11.795704+0000, chain.objs.size()=1 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.aGKqrPDeL0mv3d2bp1cgOIqItdctCtW_0 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11618331658018867439', time=2024-09-12T20:43:13.609530+0000, chain.objs.size()=1 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yoBYUtGgO_BuXMs-j9zJH2F597B8emd_0 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.191311660575069449', time=2024-09-12T20:43:14.372999+0000, chain.objs.size()=1 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SswWJ-A68tSaz03Pxdc4m9fvC5NrTVr_0 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3947466303691826690', time=2024-09-12T20:43:14.496822+0000, chain.objs.size()=1 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.iGf784OwdbnXcvUUi74lfUFT61uNenx_0 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17816683214151844414', time=2024-09-12T20:43:15.500080+0000, chain.objs.size()=1 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.CNVL-Ao2XMYPGKE9Allim2534NgH9lv_0 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2737281789160349367', time=2024-09-12T20:43:16.120570+0000, chain.objs.size()=1 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0VRrr2jJcBx8ewuaYwlO3NOwnY7eA1h_0 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5141760715040424622', time=2024-09-12T20:43:16.390789+0000, chain.objs.size()=1 2024-09-12T19:29:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0b44MBIu8PkVTCUaBRTbklkpN2iQaJ7_0 2024-09-12T19:29:41.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1719886305993183226', time=2024-09-12T20:43:17.250071+0000, chain.objs.size()=1 2024-09-12T19:29:41.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3-yP0pLUC-RfS68wyYEHkj3nTAPO6kP_0 2024-09-12T19:29:41.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8295892573755370016', time=2024-09-12T20:43:17.252071+0000, chain.objs.size()=1 2024-09-12T19:29:41.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9MboD8src97jyWeBhp-4cK3NTi5ojij_0 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1745146922175777325', time=2024-09-12T20:43:17.342909+0000, chain.objs.size()=1 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4R1Ypyi3MbpR3nWP_Oi_khuJ7L615ID_0 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17574467520665837705', time=2024-09-12T20:43:17.346251+0000, chain.objs.size()=1 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.8WG-apFZmdeajxJoP9FuFF4OAw-__45_0 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6422170996227332026', time=2024-09-12T20:43:17.665201+0000, chain.objs.size()=1 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TlLU6SPk3bNVjJNBgvXYwIw9LsTJnL3_0 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11211593927578002692', time=2024-09-12T20:43:17.668491+0000, chain.objs.size()=1 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.939+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ePxPj3PotpJt1ENaKTmIujR4HKv_qCm_0 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2748440989647492664', time=2024-09-12T20:43:18.173028+0000, chain.objs.size()=1 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zH6NVy-YvmzBFoBbhOODHT8n2xM4fJo_0 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5973732073334841780', time=2024-09-12T20:43:18.264633+0000, chain.objs.size()=1 2024-09-12T19:29:41.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3zRuSEod9LHS4IMDtPud8-wKbcFUX-O_0 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17219160733847125522', time=2024-09-12T20:43:18.465312+0000, chain.objs.size()=1 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3wdjHrbqm3zZ7cbup7IHAhvA-pOWkga_0 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1558317294763946707', time=2024-09-12T20:43:18.681389+0000, chain.objs.size()=1 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9HuXBlNZDL5Jba7cZ0Vid1cc5Hz6SaZ_0 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16021345263575566689', time=2024-09-12T20:43:18.682916+0000, chain.objs.size()=1 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.c9ZABwWEkrwBfqCLf5v9ploRi8XvcYI_0 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1304932367668663479', time=2024-09-12T20:43:19.081013+0000, chain.objs.size()=1 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vF0avENQzjck_5lzRRqLc9JVLu9xTIf_0 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2491470789070719734', time=2024-09-12T20:43:22.247121+0000, chain.objs.size()=1 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.w10PbUxNigBt7w2UVaoOL1otJ7gf-sf_0 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2515892950208897266', time=2024-09-12T20:43:22.893040+0000, chain.objs.size()=1 2024-09-12T19:29:41.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TcS7xCnKKIhGFnHbyO5JdZWz0hKax8s_0 2024-09-12T19:29:41.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.146543755871357870', time=2024-09-12T20:43:25.609991+0000, chain.objs.size()=1 2024-09-12T19:29:41.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nA8GwqpXudXxw4ccFjDcEoBn3SS0uDB_0 2024-09-12T19:29:41.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2485404085258105025', time=2024-09-12T20:43:25.742003+0000, chain.objs.size()=1 2024-09-12T19:29:41.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ANqycvH8dykiNdbyTCfwuSmZbwBKW_y_0 2024-09-12T19:29:41.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14674345215322952831', time=2024-09-12T20:43:25.959466+0000, chain.objs.size()=1 2024-09-12T19:29:41.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.i4Agz6j8vnxi557GfPulkjSbU5VGjVc_0 2024-09-12T19:29:41.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8028422478953080190', time=2024-09-12T20:43:26.198375+0000, chain.objs.size()=1 2024-09-12T19:29:41.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6_2ei1-X0p625is_2QCMBeBYY_0d2n-_0 2024-09-12T19:29:41.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16115289773300759634', time=2024-09-12T20:43:27.851152+0000, chain.objs.size()=1 2024-09-12T19:29:41.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.UURV3J2PRgeG3U64bG7sMWri5r3rNPV_0 2024-09-12T19:29:41.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9129441702780207563', time=2024-09-12T20:43:28.297263+0000, chain.objs.size()=1 2024-09-12T19:29:41.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gksqPG9jIlrvRawrWCnihoHP5hGoL89_0 2024-09-12T19:29:41.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17831921095677108658', time=2024-09-12T20:43:28.850687+0000, chain.objs.size()=1 2024-09-12T19:29:41.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ccuVdEQzLZNmTtrI7_-qBFZpR_v4O3N_0 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.445343571574362958', time=2024-09-12T20:43:30.099389+0000, chain.objs.size()=1 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.f2uKuDjRrp_z6EZXanyCBxajcZglzQM_0 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8283040021915942223', time=2024-09-12T20:45:12.588613+0000, chain.objs.size()=1 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.61TpEFqdoqQEazhggwei3istshTNIa9_0 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2324166128403735692', time=2024-09-12T20:45:12.591718+0000, chain.objs.size()=1 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.943+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.v8EjD4uGDb9kalg_SXE5qeWGAVNspey_0 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16904259273281601018', time=2024-09-12T20:45:14.651850+0000, chain.objs.size()=1 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3fQA7aqXMZyzjuFE9XzO3xEeNeefrRh_0 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15672991679494020298', time=2024-09-12T20:45:15.470845+0000, chain.objs.size()=1 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.HC2xCYZPBJR9GhUeZlckT7nM9u9UgPb_0 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8756556557444889655', time=2024-09-12T20:45:16.037036+0000, chain.objs.size()=1 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nJDmkLBFWpcrVG-XoncBrzWgTfxvHfd_0 2024-09-12T19:29:41.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2511412138973416192', time=2024-09-12T20:45:16.563455+0000, chain.objs.size()=1 2024-09-12T19:29:41.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dWiMlPQQF2t2xWjK3iF263E-SO8KzxP_0 2024-09-12T19:29:41.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1022036628933985454', time=2024-09-12T20:45:18.829778+0000, chain.objs.size()=1 2024-09-12T19:29:41.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hISMHpGj_sOW_PTt4F1gDajLN4oF1Ga_0 2024-09-12T19:29:41.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7032024724783996608', time=2024-09-12T20:45:19.119527+0000, chain.objs.size()=1 2024-09-12T19:29:41.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WMUOyjyhf3ugDj6ADLJi8o7Hv1Uye8I_0 2024-09-12T19:29:41.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8070020337977891429', time=2024-09-12T20:45:22.852186+0000, chain.objs.size()=1 2024-09-12T19:29:41.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.jMI8SXVg5LHaNo0H2m-Us0lSJk-AlA6_0 2024-09-12T19:29:41.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7855456566854042357', time=2024-09-12T20:45:22.860364+0000, chain.objs.size()=1 2024-09-12T19:29:41.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UolMpzKJ5tgcXJkoFT12AEFvnm0Veom_0 2024-09-12T19:29:41.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.947+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48945 2024-09-12T19:29:41.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4237724011137413598', time=2024-09-12T20:45:23.505200+0000, chain.objs.size()=1 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._T5gls2ubWrZ_aJrA05r62fKEYjNLQR_0 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6729599095085933278', time=2024-09-12T20:45:23.575876+0000, chain.objs.size()=1 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5lohIJw2SgrqUJuyBxRwsYykwFi97IB_0 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8557639079482473173', time=2024-09-12T20:45:23.651018+0000, chain.objs.size()=1 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GIgwKsPs2duxlLbhhhljJBkVcpbxZY1_0 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10093430159653296477', time=2024-09-12T20:45:24.232661+0000, chain.objs.size()=1 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.RuBb86y-uFl0hhmmpwMN1ghzOBliL2c_0 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4941457412085594150', time=2024-09-12T20:45:24.814202+0000, chain.objs.size()=1 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FMM-yLQGnR_-VZ-UZOPv-sizDDbgiAA_0 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15071581731591515579', time=2024-09-12T20:45:27.443610+0000, chain.objs.size()=1 2024-09-12T19:29:41.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PcrHZoYZZesqeNLMluaDzvWxbyYlcCF_0 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9195046585335609192', time=2024-09-12T20:45:28.016992+0000, chain.objs.size()=1 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Mq-f3SOGzv5Yo_UXZF67pobrEWAiduo_0 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13665504431208344002', time=2024-09-12T20:45:29.178762+0000, chain.objs.size()=1 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.M0noQGu3AtKVdkX1D8qus9Ea3zQU1zX_0 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12287158416214087937', time=2024-09-12T20:45:29.941471+0000, chain.objs.size()=1 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.BYftcr6Ao9Cw0K8IsufkIx94ldWexE3_0 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6377086062474211804', time=2024-09-12T20:45:30.033372+0000, chain.objs.size()=1 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9_A3bdWsnkvgMntmYRttTDQoIa6RRiK_0 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1314488912190137023', time=2024-09-12T20:45:30.477491+0000, chain.objs.size()=1 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oAh_KogDXQAtdLCjO5diSEeuIX0VZSO_0 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17816352924287155302', time=2024-09-12T20:45:30.977274+0000, chain.objs.size()=1 2024-09-12T19:29:41.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.H0AY3hMBnUfxywvTevqBBENStMx-EE3_0 2024-09-12T19:29:41.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16870148923696680589', time=2024-09-12T20:45:31.994356+0000, chain.objs.size()=1 2024-09-12T19:29:41.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ilX1MiThRIUUMgXA2XIwgSZ2XcttT1M_0 2024-09-12T19:29:41.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1298945894472989656', time=2024-09-12T20:45:33.382889+0000, chain.objs.size()=1 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uY5F5q9XC4In3JhW7DZGtllIn9RNK7p_0 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17018558041411624155', time=2024-09-12T20:45:36.104241+0000, chain.objs.size()=1 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hvx4Tv2DcwAvEIegs0-0zvIGJQoWFu8_0 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10181082791553375851', time=2024-09-12T20:45:37.718869+0000, chain.objs.size()=1 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3ZXol28G95PWcaHO4Shw_qZEObMb-2-_0 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16499763050126217600', time=2024-09-12T20:46:09.441882+0000, chain.objs.size()=1 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.340__shadow_.MkM_l_tS98_xC0TwubvyQmYBuB2FVfp_0 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16949646210023426630', time=2024-09-12T20:46:59.382658+0000, chain.objs.size()=1 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.367__shadow_.kVnI814XYWYApwAwTXKimkf7e9GzjmA_0 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16546898962777094926', time=2024-09-12T20:50:35.579207+0000, chain.objs.size()=1 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.466__shadow_.nuzYrjYESstuzWs5Yw5Sv4dln-XTD2Q_0 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10625434975986028688', time=2024-09-12T20:51:02.887104+0000, chain.objs.size()=1 2024-09-12T19:29:41.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.UTYqihcW0CQxz70GwJnBGxiHzyMbQzD_0 2024-09-12T19:29:41.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17075365136453157071', time=2024-09-12T20:51:05.543030+0000, chain.objs.size()=1 2024-09-12T19:29:41.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.484__shadow_.nCncg2rtETLZZA8xo7l5edPkdT6TCu7_0 2024-09-12T19:29:41.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8220051510030096697', time=2024-09-12T20:52:53.088755+0000, chain.objs.size()=1 2024-09-12T19:29:41.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.515__shadow_.aHEVRAlWE-uYYeE13VBDJyJynEd4J6I_0 2024-09-12T19:29:41.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9495971655534572908', time=2024-09-12T20:53:17.227222+0000, chain.objs.size()=1 2024-09-12T19:29:41.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.951+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.518__multipart_mymultipart.2~PA8YguXzlw7-xRVzWz5Vmmyc0k2JcmF.1 2024-09-12T19:29:41.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16092742461663169152', time=2024-09-12T21:00:23.804113+0000, chain.objs.size()=4 2024-09-12T19:29:41.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.535__multipart_mymultipart.2~RD2BwNBDUoDI9rdNqtPDpA0biFbcCrJ.1 2024-09-12T19:29:41.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.535__multipart_mymultipart.2~RD2BwNBDUoDI9rdNqtPDpA0biFbcCrJ.2 2024-09-12T19:29:41.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.535__multipart_mymultipart.aKXikyoq2qKnGjAciOWeD5D4dsPIcYOg.3 2024-09-12T19:29:41.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.535__multipart_mymultipart.2~RD2BwNBDUoDI9rdNqtPDpA0biFbcCrJ.4 2024-09-12T19:29:41.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7854223478536363892', time=2024-09-12T21:03:18.314740+0000, chain.objs.size()=1 2024-09-12T19:29:41.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:H.LmAzPL0hw.h.qbWylCNFkBvHtUYyQ_.O9t-Ihjihm-dcmQ6ZxDFN_492xy9XNK_0 2024-09-12T19:29:41.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2426412142583059538', time=2024-09-12T21:03:24.666686+0000, chain.objs.size()=1 2024-09-12T19:29:41.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:ZP2eTB6oUOTR2Wt6IMbGxte6JoJf.KM_.qVYwgUW_GWMYP5phl2O8lv5AZGexkoA_0 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1545212102381192570', time=2024-09-12T21:04:01.170380+0000, chain.objs.size()=1 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.576__shadow:ECHc-yNYsR6swPsPgFvg34ghQNaZG5A_.lgt-BaRdODRPH7_x6PO7QX5YEwzSZII_0 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15736941139850121511', time=2024-09-12T21:06:06.429032+0000, chain.objs.size()=1 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.583__shadow:2.sLICAwBr3yyWusFoA1eB3Zsj4pKv9_.GIiwtJDtrEYJXwRxlx2h2td-InwGgmY_0 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2531825004813126013', time=2024-09-12T21:06:19.769794+0000, chain.objs.size()=1 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.587__shadow:mKPZyS5bpGyIgxGum3zfK17Zwz5ZAHP_.-z5vrgP0FCXo_WknMNBeVxZ1MFDBQiE_0 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3119969936906646170', time=2024-09-12T21:13:31.883439+0000, chain.objs.size()=1 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.627__shadow_.S8HBTF02IiMgq8ZB9cirimoM2j6tKLQ_0 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4685755297641382226', time=2024-09-12T21:13:56.575581+0000, chain.objs.size()=1 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.638__shadow_.jL3KN5ZwpSSwYv-NSjle0Y_Tb-P6LGg_0 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17643575354420363734', time=2024-09-12T21:16:06.633603+0000, chain.objs.size()=1 2024-09-12T19:29:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.955+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.663__shadow_.AoUQ3NG3w12WPFKsTaOzsrDoH8asOr8_0 2024-09-12T19:29:41.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.959+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.959+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T19:29:41.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.959+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54670' 2024-09-12T19:29:41.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_5Q3FUs32RRtCclTVfMD3V2VFVSnD24r', time=2024-09-12T20:29:18.516458+0000, chain.objs.size()=3 2024-09-12T19:29:41.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.5bsLjIuUNLjtuMWy3YSytAWiQzUQIeR_0 2024-09-12T19:29:41.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.5bsLjIuUNLjtuMWy3YSytAWiQzUQIeR_1 2024-09-12T19:29:41.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.5bsLjIuUNLjtuMWy3YSytAWiQzUQIeR_2 2024-09-12T19:29:41.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4531587584446350831', time=2024-09-12T20:36:12.420865+0000, chain.objs.size()=1 2024-09-12T19:29:41.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.248__shadow_.yj1tNEqiQpRYG9HDa9k2_QkobDmamZ6_0 2024-09-12T19:29:41.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12524900237038610827', time=2024-09-12T20:38:22.912221+0000, chain.objs.size()=1 2024-09-12T19:29:41.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0YmbV6e3dzBXNOJBH0S1zhE6r8Zxk_B_0 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9230666829604148846', time=2024-09-12T20:38:24.095544+0000, chain.objs.size()=1 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.HF4OViLAx68E9ZKwnlDRozdbbOqR-K6_0 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1796562652904704031', time=2024-09-12T20:38:24.368164+0000, chain.objs.size()=1 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.x_tKSNOTJTuxvMJOVFUB9RGEOYPse0s_0 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17232341348593289472', time=2024-09-12T20:38:24.486913+0000, chain.objs.size()=1 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9s_kKevcrDE6Uop_g1V2pv29CYSy8NG_0 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15388122639100470632', time=2024-09-12T20:38:25.376055+0000, chain.objs.size()=1 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7FgLfMncqaVIEbltBl6r5HHRRj7nCYm_0 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3980241676800059263', time=2024-09-12T20:38:27.223583+0000, chain.objs.size()=1 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RmczLh2a8t77_muiweNPuEoulLRXPMK_0 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15542703071817579090', time=2024-09-12T20:38:28.002091+0000, chain.objs.size()=1 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EJGI1MNCxf9TmghJ144ev77r7PsuRpU_0 2024-09-12T19:29:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14535266480266758761', time=2024-09-12T20:38:28.068309+0000, chain.objs.size()=1 2024-09-12T19:29:41.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.963+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZbCbobpOWnHqBIsG_fXoIhkpMpHD9T5_0 2024-09-12T19:29:41.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14958796158853291121', time=2024-09-12T20:38:28.720700+0000, chain.objs.size()=1 2024-09-12T19:29:41.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.FVXcs4hPh4bzx26LOBxrsYIxqTE39S7_0 2024-09-12T19:29:41.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1687223040998582259', time=2024-09-12T20:38:30.671806+0000, chain.objs.size()=1 2024-09-12T19:29:41.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.is6u9F7bBFjymE19gDeTQmPIb8u0csc_0 2024-09-12T19:29:41.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12827126778412161080', time=2024-09-12T20:38:31.132002+0000, chain.objs.size()=1 2024-09-12T19:29:41.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Crwm8bwa1UuK1CNMr8xAa-qjmrr1cni_0 2024-09-12T19:29:41.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1604625307335117155', time=2024-09-12T20:38:32.844102+0000, chain.objs.size()=1 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EWKhB8tK-t9m25BSn8ZJNVhBUycStDh_0 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4353405432401664838', time=2024-09-12T20:38:34.036716+0000, chain.objs.size()=1 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MB1dKV1X0OU2BUvoiZBSOHpN1nWuHsr_0 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14342462571019342807', time=2024-09-12T20:38:35.112190+0000, chain.objs.size()=1 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.VGJgbsfRV__TXwtgTqFidnfKy9lTDhf_0 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16804464787637044189', time=2024-09-12T20:38:36.446856+0000, chain.objs.size()=1 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MAooz4nBJGpYOpgmfnRUMrzhDBX8FCl_0 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11505954576374328088', time=2024-09-12T20:38:36.677427+0000, chain.objs.size()=1 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._D6GMZiBoACS269ZbB6Ob_5wfVAcOR7_0 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11098529592100958404', time=2024-09-12T20:38:36.797697+0000, chain.objs.size()=1 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.xD2nPF66wkd4JxqoXDa3KgGLAYgmZgm_0 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14111793901569788024', time=2024-09-12T20:38:37.765165+0000, chain.objs.size()=1 2024-09-12T19:29:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WE5qY3UYjVK_9C5vv1IMqjlNHngOB2z_0 2024-09-12T19:29:41.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3219893616178455479', time=2024-09-12T20:38:38.178926+0000, chain.objs.size()=1 2024-09-12T19:29:41.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CxnMzlnhsmk_Iy2fxQXEhUzugBidXGt_0 2024-09-12T19:29:41.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15801597370522844525', time=2024-09-12T20:38:38.609385+0000, chain.objs.size()=1 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ll6iHzBnhCsnUHAyhe1e5HTAfVf3w0Y_0 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6943307123786719133', time=2024-09-12T20:38:38.633406+0000, chain.objs.size()=1 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dme7aNZ9FpDMRZQJpUy0OI-eStv8G2w_0 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15300388277628150984', time=2024-09-12T20:38:39.776032+0000, chain.objs.size()=1 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hngkGqylCs2oDZ-UZE6pLPl8AKhp4IV_0 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9745232673084677750', time=2024-09-12T20:38:40.413706+0000, chain.objs.size()=1 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.60ZTctjLSRbpS7GgljyBIUz2V5Hpcsy_0 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7229952151350018347', time=2024-09-12T20:38:40.504406+0000, chain.objs.size()=1 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.6HM4nXOxktTWYXuOfz2jgB8Jsxht4KM_0 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15925292780290594020', time=2024-09-12T20:38:43.317830+0000, chain.objs.size()=1 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fU3edwLnxk5IWNnULBLUqtWr5UPb1sP_0 2024-09-12T19:29:41.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3937221639895148844', time=2024-09-12T20:38:46.527463+0000, chain.objs.size()=1 2024-09-12T19:29:41.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CKU54Ggux-te6kt-0lXgdjRmpOVbA7C_0 2024-09-12T19:29:41.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7775757941622308495', time=2024-09-12T20:38:46.578062+0000, chain.objs.size()=1 2024-09-12T19:29:41.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QhDGzHdmYzR52hSiRX43_ivgI1dArPk_0 2024-09-12T19:29:41.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.914943886621976152', time=2024-09-12T20:38:48.290880+0000, chain.objs.size()=1 2024-09-12T19:29:41.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5ZKLTBhRFa6uP5cWs_EeB3nU2BWFb0C_0 2024-09-12T19:29:41.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17588767496400690146', time=2024-09-12T20:38:48.293007+0000, chain.objs.size()=1 2024-09-12T19:29:41.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qqCEfkcZ8YOEz1XzRqyfN4eUUgzRUbY_0 2024-09-12T19:29:41.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6380230488472707854', time=2024-09-12T20:38:48.389923+0000, chain.objs.size()=1 2024-09-12T19:29:41.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.967+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7iF_lsv8mrLTJz2LHCJLMnmYJt_-Xgm_0 2024-09-12T19:29:41.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15425882996420552801', time=2024-09-12T20:38:49.665745+0000, chain.objs.size()=1 2024-09-12T19:29:41.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.l5FuAsIFkOBZzCR2Bwep3jg-whqYWaG_0 2024-09-12T19:29:41.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13017310870251793866', time=2024-09-12T20:38:49.667905+0000, chain.objs.size()=1 2024-09-12T19:29:41.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1alLbnHswMuezQFs892hhKGwFMmpLfp_0 2024-09-12T19:29:41.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10309540942858577619', time=2024-09-12T20:38:50.389965+0000, chain.objs.size()=1 2024-09-12T19:29:41.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.J3iXxh4JtKotFvYwbh2to87jWjWr9fI_0 2024-09-12T19:29:41.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6985137303705553624', time=2024-09-12T20:39:39.682174+0000, chain.objs.size()=1 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.284__shadow_.Hid35sSTdzLHScUE3Q6ZdZmJTGnJOrj_0 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16225851141164669390', time=2024-09-12T20:39:49.225745+0000, chain.objs.size()=1 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.288__shadow_.NXH7FetN_NZ1_hG86RD_fI2ZSroCy6M_0 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9383891543137710727', time=2024-09-12T20:39:53.794666+0000, chain.objs.size()=1 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.290__shadow_.MkcKoGjTHKIn63GixYJry_U3Z7561dL_0 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1571498794280297293', time=2024-09-12T20:40:12.513469+0000, chain.objs.size()=1 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.295__shadow_.ZZLHA6a9RgyFMuJonrjnRPiQKZPv2ne_0 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11088929393190276276', time=2024-09-12T20:40:14.760283+0000, chain.objs.size()=1 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.296__shadow_.guDM4yvYvuNDj1d0aGZUxmTiead9v-F_0 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11598391918741493925', time=2024-09-12T20:40:24.376015+0000, chain.objs.size()=1 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.300__shadow_.ai3LPe4lQaWsrUVtK0_176nySDmJh0A_0 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2057938173633533726', time=2024-09-12T20:43:02.987898+0000, chain.objs.size()=1 2024-09-12T19:29:41.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.wGopaj0hriKg2OQpOSNCurlwzeUoZZw_0 2024-09-12T19:29:41.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13264116648386348907', time=2024-09-12T20:43:05.057862+0000, chain.objs.size()=1 2024-09-12T19:29:41.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KFZ1u_7TwNI9cpwSk5lftQdNDXdGj4i_0 2024-09-12T19:29:41.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.173409772525183850', time=2024-09-12T20:43:06.764899+0000, chain.objs.size()=1 2024-09-12T19:29:41.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.RM9WlyLDk07NnyfrFbGmokRipaywjDe_0 2024-09-12T19:29:41.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.852997094993441355', time=2024-09-12T20:43:07.136067+0000, chain.objs.size()=1 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fesS_41feW0D0QeWRvLH2SQV8baT_Mc_0 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6072516329668730672', time=2024-09-12T20:43:07.957275+0000, chain.objs.size()=1 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.b4-jqUiqXjZV5FbodE0ngrGK4PvVIG3_0 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2564471128459094328', time=2024-09-12T20:43:09.046711+0000, chain.objs.size()=1 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.W41J60_raoX5Re2GBsRwSBzboxcWDyt_0 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7473793882786627073', time=2024-09-12T20:43:11.816149+0000, chain.objs.size()=1 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vRbLrPNZIXzfdROsze4meBkrK5DwATH_0 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2336096232161029182', time=2024-09-12T20:43:12.267217+0000, chain.objs.size()=1 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.25qmqDiEoGl1wEA9O20bbgwDyzpkG96_0 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13418343632593883101', time=2024-09-12T20:43:15.972260+0000, chain.objs.size()=1 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fzC5gyGSGHXkiFX1UjJ6sDpBlSHRGQu_0 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8201770049127626089', time=2024-09-12T20:43:17.364607+0000, chain.objs.size()=1 2024-09-12T19:29:41.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.WU4fL0q8KNAACZxjh9BAdfroel0rtd8_0 2024-09-12T19:29:41.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10392731352287097087', time=2024-09-12T20:43:17.701414+0000, chain.objs.size()=1 2024-09-12T19:29:41.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.1wiySc85zrpgy3XgJXS_0xVXWIgasDF_0 2024-09-12T19:29:41.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5029899478037249460', time=2024-09-12T20:43:18.037374+0000, chain.objs.size()=1 2024-09-12T19:29:41.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QJxDoWFmN5xIVcIj56YL_EpBSXeIiBB_0 2024-09-12T19:29:41.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14843489036180512322', time=2024-09-12T20:43:18.842379+0000, chain.objs.size()=1 2024-09-12T19:29:41.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.971+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EHu-PDpVjFjcJFNbR0IhX9YjmQ3ltVO_0 2024-09-12T19:29:41.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4958790201777882066', time=2024-09-12T20:43:20.931556+0000, chain.objs.size()=1 2024-09-12T19:29:41.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VLxPieP5rZztxOwbOHoe311kpLFr6_E_0 2024-09-12T19:29:41.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4856416634661635026', time=2024-09-12T20:43:21.202984+0000, chain.objs.size()=1 2024-09-12T19:29:41.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ljKyjACEBCoR6C2MHmv-R6fIySr9Y9L_0 2024-09-12T19:29:41.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6591726574526765637', time=2024-09-12T20:43:21.921731+0000, chain.objs.size()=1 2024-09-12T19:29:41.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ga93MnyJmjzwVbOnhfNX644CB0cZhCh_0 2024-09-12T19:29:41.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4903684244925309836', time=2024-09-12T20:43:21.975477+0000, chain.objs.size()=1 2024-09-12T19:29:41.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3nDvGZCWaiYiKmorUcSf63G3toxD-dv_0 2024-09-12T19:29:41.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8334850055203061065', time=2024-09-12T20:43:22.254052+0000, chain.objs.size()=1 2024-09-12T19:29:41.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.lBLrnSsdPXOAA9S1o8MyAfART3x-d1I_0 2024-09-12T19:29:41.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13913604510013506627', time=2024-09-12T20:43:22.416707+0000, chain.objs.size()=1 2024-09-12T19:29:41.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.k39y00EmwNV9UB2UocqOvZcWYwYQmdv_0 2024-09-12T19:29:41.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14677344118100734983', time=2024-09-12T20:43:23.573873+0000, chain.objs.size()=1 2024-09-12T19:29:41.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Tpi9Yd-aV8PlnIWqozwJWihPFIsUGuV_0 2024-09-12T19:29:41.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3849539320948824004', time=2024-09-12T20:43:25.280194+0000, chain.objs.size()=1 2024-09-12T19:29:41.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tZel1RVxmSQwD6S9EKuR7oJa0ZHtYu5_0 2024-09-12T19:29:41.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14997708888539042103', time=2024-09-12T20:43:25.371204+0000, chain.objs.size()=1 2024-09-12T19:29:41.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.OUGfKQCI7RnyVVtn2PRp-sMgGjgXNF9_0 2024-09-12T19:29:41.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13386346998984953718', time=2024-09-12T20:43:25.958062+0000, chain.objs.size()=1 2024-09-12T19:29:41.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SeFLfnCsse6TOn99TkfLFR9hRlk0lgD_0 2024-09-12T19:29:41.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17714233041399437958', time=2024-09-12T20:43:26.100325+0000, chain.objs.size()=1 2024-09-12T19:29:41.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.OMw3tnVWsj9-y5q2KNQuu0bm0n60HhR_0 2024-09-12T19:29:41.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14719139145584654317', time=2024-09-12T20:43:26.329731+0000, chain.objs.size()=1 2024-09-12T19:29:41.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.RL8KlnXcJ-sQgr1txt27dN_CbgJSZGl_0 2024-09-12T19:29:41.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5721798957478408679', time=2024-09-12T20:43:27.111388+0000, chain.objs.size()=1 2024-09-12T19:29:41.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Z_v4Pzb6GFCLxhpBSQBkXO2MpDxamad_0 2024-09-12T19:29:41.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3270928726074576112', time=2024-09-12T20:43:27.227882+0000, chain.objs.size()=1 2024-09-12T19:29:41.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0NXaZF11gF7Jk27-DEDHCdGJf81xAKB_0 2024-09-12T19:29:41.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17648850094425868873', time=2024-09-12T20:43:27.914506+0000, chain.objs.size()=1 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.iw1DqLL9uWaLcrydw2y5mEa1Jo5D5zj_0 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11864082004105702540', time=2024-09-12T20:43:28.314288+0000, chain.objs.size()=1 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5XANlkhlgxkl__86Bf1Yu0pwBEtCXC6_0 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18072657663866020339', time=2024-09-12T20:43:28.588597+0000, chain.objs.size()=1 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.j93jreIY7eNsCdftHB5_f9Bd7_7CzN3_0 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8067203281243485217', time=2024-09-12T20:43:28.826548+0000, chain.objs.size()=1 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.khJsAMeCKmMCuHj_GRa1EUOZIH4JPJt_0 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18158494450987942485', time=2024-09-12T20:45:10.859644+0000, chain.objs.size()=1 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.B8hFKDhQlFCRrW6tWarmsJduEfbR5Ip_0 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17323298663713153215', time=2024-09-12T20:45:10.922159+0000, chain.objs.size()=1 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Bknr3o8_Y5AiNrZ-1QV3qaqRPJrses5_0 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14220155387149513756', time=2024-09-12T20:45:12.656666+0000, chain.objs.size()=1 2024-09-12T19:29:41.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.tF-h_6QNWsv914gvuxVUUzpaDN0_G7Q_0 2024-09-12T19:29:41.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10521688157492519973', time=2024-09-12T20:45:16.306813+0000, chain.objs.size()=1 2024-09-12T19:29:41.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.975+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.rcrHZ6VzO6I6LxvFK7MUBjfXT4wVXmg_0 2024-09-12T19:29:41.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7710106507699570379', time=2024-09-12T20:45:16.490312+0000, chain.objs.size()=1 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Trp46t_OPUGnsTyR_wj72EXJQOUkx8g_0 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11406743096300302570', time=2024-09-12T20:45:16.901782+0000, chain.objs.size()=1 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YDHwEdq4mW6ERQ6IGukh1pu22O3drH-_0 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12598483521867487242', time=2024-09-12T20:45:16.921347+0000, chain.objs.size()=1 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.86_Rl_lUFh2fp_WGZ5LL46isGXaAmVK_0 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9875593829768922657', time=2024-09-12T20:45:18.919993+0000, chain.objs.size()=1 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pehIf2PZ178d7vQHPC6FSgbXNPs3rUs_0 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13284122640200197924', time=2024-09-12T20:45:20.668039+0000, chain.objs.size()=1 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PVr26T3vCTSlAvghGGjLfh3ziHecemV_0 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11150535365759400902', time=2024-09-12T20:45:23.075729+0000, chain.objs.size()=1 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.yvaAkYUYTd9NKDo6qn8x3zUjrIKY67L_0 2024-09-12T19:29:41.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1906885053360688500', time=2024-09-12T20:45:23.468230+0000, chain.objs.size()=1 2024-09-12T19:29:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.AOvkq6t5fpW6aexRkkQ9ZMfxE1RV-Qa_0 2024-09-12T19:29:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11316964383116606970', time=2024-09-12T20:45:27.782540+0000, chain.objs.size()=1 2024-09-12T19:29:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.sVbzdgzF0dmPcmGL72JESP_95UbJMO0_0 2024-09-12T19:29:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4934358159990120281', time=2024-09-12T20:45:30.110013+0000, chain.objs.size()=1 2024-09-12T19:29:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.mh5IKGu21TcknSeXP4iz6hVWOcjGU9g_0 2024-09-12T19:29:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4528998139137457636', time=2024-09-12T20:45:30.112218+0000, chain.objs.size()=1 2024-09-12T19:29:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GeeanWEDtCniasDtVWX2gLuJItkHiPW_0 2024-09-12T19:29:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11760545520396579263', time=2024-09-12T20:45:31.229738+0000, chain.objs.size()=1 2024-09-12T19:29:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2tt7xJ7IIamsa931Tgcn8Mzdx9C6RtG_0 2024-09-12T19:29:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17177522452421270658', time=2024-09-12T20:45:31.762572+0000, chain.objs.size()=1 2024-09-12T19:29:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.064the6bJFg7OWaUhGg-6hU13gG3R8G_0 2024-09-12T19:29:41.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1737100895113020763', time=2024-09-12T20:45:32.756860+0000, chain.objs.size()=1 2024-09-12T19:29:41.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.bL650ujBY47ltyQH46LPhyI1ou-Lny4_0 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1964106379764634198', time=2024-09-12T20:45:34.646750+0000, chain.objs.size()=1 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GEG1gQQW3uPn3q__67kJN869Qo35CNm_0 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10272243023991060370', time=2024-09-12T20:45:34.881753+0000, chain.objs.size()=1 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.979+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FqJ9m5IdbJJo8PcTGYtraWMzHMQaAQ9_0 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15800873256992564296', time=2024-09-12T20:45:35.445336+0000, chain.objs.size()=1 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.v2l1HPFV8bj5dqVrOF2WEXMXBqWaFlC_0 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17811274871700673592', time=2024-09-12T20:45:36.483641+0000, chain.objs.size()=1 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5eHjIcfhJ0asx-yKNV5CKpPycvVd3Ff_0 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6039336601552668664', time=2024-09-12T20:45:37.409739+0000, chain.objs.size()=1 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zuK_CiidG4tlbYgDre8HEoFijefKFzm_0 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10860732520384797536', time=2024-09-12T20:45:37.779495+0000, chain.objs.size()=1 2024-09-12T19:29:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WtPnf63XKifeQCHjkJKxE6sPSHZlE4w_0 2024-09-12T19:29:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3609398196653050604', time=2024-09-12T20:45:37.952372+0000, chain.objs.size()=1 2024-09-12T19:29:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MXk1j40c7HE2bOjEDgN6mN_GmWuzce8_0 2024-09-12T19:29:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12125979760437227746', time=2024-09-12T20:45:54.153115+0000, chain.objs.size()=1 2024-09-12T19:29:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.332__shadow_.QfBPkEKbo4XGzM36VdTpOUpd8BFlkea_0 2024-09-12T19:29:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2770452802719573101', time=2024-09-12T20:45:56.170876+0000, chain.objs.size()=1 2024-09-12T19:29:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.333__shadow_.KPE3ct7nM9DIwPPf3xip4VfVqrhcbut_0 2024-09-12T19:29:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15917131398093504110', time=2024-09-12T20:47:08.883406+0000, chain.objs.size()=1 2024-09-12T19:29:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.372__shadow_.DhxpozJez5--tTMksu3GNw4QyqxmGXy_0 2024-09-12T19:29:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.835590835015655403', time=2024-09-12T20:47:18.039679+0000, chain.objs.size()=1 2024-09-12T19:29:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.376__shadow_.ZYLXlBcG_yZr_sKBFysshRTVMSmltOz_0 2024-09-12T19:29:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.983+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54670 2024-09-12T19:29:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T19:29:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2778512333265178127', time=2024-09-12T20:48:27.715992+0000, chain.objs.size()=1 2024-09-12T19:29:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.410__shadow_.Xi_6lFRtgvP-KMk7VJZHeXpe41DAXMx_0 2024-09-12T19:29:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9779950009377688141', time=2024-09-12T20:50:06.727130+0000, chain.objs.size()=1 2024-09-12T19:29:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.456__shadow_.6JeV0hBd5a76a3f4vh4P4QxYV_n0CTN_0 2024-09-12T19:29:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17957449077104026992', time=2024-09-12T20:51:23.840761+0000, chain.objs.size()=1 2024-09-12T19:29:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.490__shadow_.4leLL3dYmKvDHyCNDVFU4mxcUoQau-o_0 2024-09-12T19:29:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17957449077104026992', time=2024-09-12T20:51:24.377508+0000, chain.objs.size()=1 2024-09-12T19:29:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.490__shadow_.4leLL3dYmKvDHyCNDVFU4mxcUoQau-o_0 2024-09-12T19:29:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6648789522772285779', time=2024-09-12T20:53:16.619154+0000, chain.objs.size()=2 2024-09-12T19:29:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.517__shadow_.eqigMwj4Pc6iapBSTkwl1g1xLGyxCIx_0 2024-09-12T19:29:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.517__shadow_.eqigMwj4Pc6iapBSTkwl1g1xLGyxCIx_1 2024-09-12T19:29:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18435432965483116547', time=2024-09-12T20:59:20.411810+0000, chain.objs.size()=4 2024-09-12T19:29:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.527__multipart_mymultipart.2~0RGa-SCTCYWRdmcmY4DSc9_tuCq41FL.1 2024-09-12T19:29:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.527__multipart_mymultipart.2~0RGa-SCTCYWRdmcmY4DSc9_tuCq41FL.2 2024-09-12T19:29:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.527__multipart_mymultipart.2~0RGa-SCTCYWRdmcmY4DSc9_tuCq41FL.3 2024-09-12T19:29:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.527__multipart_mymultipart.2~0RGa-SCTCYWRdmcmY4DSc9_tuCq41FL.4 2024-09-12T19:29:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11084720446922176802', time=2024-09-12T21:03:17.171154+0000, chain.objs.size()=1 2024-09-12T19:29:41.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:mY8OYNpGVcx2tkdCov4wImvTEBmadUa_.QO7lCZ6PBTqfqKhajVatGxQqq9PHptR_0 2024-09-12T19:29:41.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5041518958739002412', time=2024-09-12T21:03:44.441315+0000, chain.objs.size()=1 2024-09-12T19:29:41.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.574__shadow_.rw_BGYG1b8oEzTbU-ea8QGlISO6Tsph_0 2024-09-12T19:29:41.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16311129477236239827', time=2024-09-12T21:04:04.379591+0000, chain.objs.size()=1 2024-09-12T19:29:41.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.576__shadow:yBv-0N-egx-U10BVR6CpuFLFQfKxIvs_.nzcb72P8iYDpVXiWjsjSaXF5UX2y5Bo_0 2024-09-12T19:29:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3359300708348930961', time=2024-09-12T21:14:52.177971+0000, chain.objs.size()=1 2024-09-12T19:29:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.652__shadow_.gmbyh9bb72QdP5huC8NEv2g22tph55q_0 2024-09-12T19:29:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11259447088200228812', time=2024-09-12T21:16:25.834207+0000, chain.objs.size()=1 2024-09-12T19:29:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.672__shadow_.eepi1HsIledtzr4upzcpDMhB6OGq23a_0 2024-09-12T19:29:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7574261695723251134', time=2024-09-12T21:19:26.415522+0000, chain.objs.size()=1 2024-09-12T19:29:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.987+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.740__shadow_.GVuFonpJAaX8W2yxb-yFSFpaLvkU3rL_0 2024-09-12T19:29:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.991+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9078107340843445027', time=2024-09-12T21:29:16.321866+0000, chain.objs.size()=1 2024-09-12T19:29:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.991+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.782__shadow_.RbR8jZFt227V0ZohNjPY4yDGnH1Wz93_0 2024-09-12T19:29:41.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.991+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:41.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T19:29:41.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:41.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:41.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47722' 2024-09-12T19:29:41.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14321169659493943168', time=2024-09-12T20:30:13.201977+0000, chain.objs.size()=2 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.164__multipart_foo.2~T3_upBz2D0EebcGun3VMZzMpBMz2W5N.1 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.164__multipart_foo.2~T3_upBz2D0EebcGun3VMZzMpBMz2W5N.2 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4857126334168891525', time=2024-09-12T20:35:32.392395+0000, chain.objs.size()=1 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.233__shadow_.LsVDM5Ir-ZPmy3kpzOCUsEIGk0_66NG_0 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11588051139267041158', time=2024-09-12T20:35:43.388162+0000, chain.objs.size()=1 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.237__shadow_.ONWwwkBet_7R3RXYOoRX9VFwSGtE2cC_0 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11726573920815927164', time=2024-09-12T20:36:07.878142+0000, chain.objs.size()=1 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.246__shadow_.q-7acVAmEyyqU-OfF22YfnWOZXUpkOb_0 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14941290287066975958', time=2024-09-12T20:38:22.521839+0000, chain.objs.size()=1 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.z6dKVhnaxDuMbccaB-sWbEf_x-DduQw_0 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12923541497778578495', time=2024-09-12T20:38:25.317786+0000, chain.objs.size()=1 2024-09-12T19:29:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9eTnsbCV_NTzuTALuYOwVngt3n4cbw7_0 2024-09-12T19:29:42.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5421113211172462255', time=2024-09-12T20:38:29.193214+0000, chain.objs.size()=1 2024-09-12T19:29:42.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rnKsxWg0f3imENAGPXizZzgpnwBJYX5_0 2024-09-12T19:29:42.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7710781746267057587', time=2024-09-12T20:38:31.151649+0000, chain.objs.size()=1 2024-09-12T19:29:42.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ngre_zwV8eR1a2MTqdHigA5yYluzpqZ_0 2024-09-12T19:29:42.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6371551895823982453', time=2024-09-12T20:38:32.655315+0000, chain.objs.size()=1 2024-09-12T19:29:42.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0DKNtOH9OKvDtP96aRymM8-rP2POoG2_0 2024-09-12T19:29:42.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2401448154195553776', time=2024-09-12T20:38:32.776740+0000, chain.objs.size()=1 2024-09-12T19:29:42.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5kgV8pmsKAWrMXMn62B5GnI8-HOodA5_0 2024-09-12T19:29:42.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11032982786547824513', time=2024-09-12T20:38:34.456054+0000, chain.objs.size()=1 2024-09-12T19:29:42.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.995+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AsDMDGqJbg6bPMDdMivTG_J8Jebn5Mh_0 2024-09-12T19:29:42.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7451513548405387163', time=2024-09-12T20:38:34.457747+0000, chain.objs.size()=1 2024-09-12T19:29:42.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.YMkfuMTPd3WswdjlYKJKmuddGLjoE-2_0 2024-09-12T19:29:42.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1166889655551078329', time=2024-09-12T20:38:35.688008+0000, chain.objs.size()=1 2024-09-12T19:29:42.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.TpkVuOvkckfU_U8IOlZ2BiCNLUp5kim_0 2024-09-12T19:29:42.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4339653206722390001', time=2024-09-12T20:38:36.590161+0000, chain.objs.size()=1 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5Sa0XrMilFuqd5WNBTcQkbsruUbNJqK_0 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9487285675484289187', time=2024-09-12T20:38:38.708292+0000, chain.objs.size()=1 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.3G43kWkA8trzzqv34gqHV60mWFJCJ78_0 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8361960141725905466', time=2024-09-12T20:38:39.290208+0000, chain.objs.size()=1 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7pyJxZWau3IiXerS2d1iECZumk0Dd7F_0 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15348365606726569564', time=2024-09-12T20:38:39.291961+0000, chain.objs.size()=1 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.x2VW_hrOiJ582qMtrZ3KrxQ0w6eWrHT_0 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9547704582817943591', time=2024-09-12T20:38:41.366715+0000, chain.objs.size()=1 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0GEo57geOrIM4ll7x9I5-sBlOo5vz2o_0 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1075553654496299860', time=2024-09-12T20:38:42.035216+0000, chain.objs.size()=1 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.m19zl-md95W3nLBuJfjv96uSnU4dzvm_0 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13421586302443102995', time=2024-09-12T20:38:42.175799+0000, chain.objs.size()=1 2024-09-12T19:29:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.xpu1chLqMAN65hrOo9dV-5clNxrCxc1_0 2024-09-12T19:29:42.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10463823083467746665', time=2024-09-12T20:38:42.842184+0000, chain.objs.size()=1 2024-09-12T19:29:42.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ofzvNPIl-ThVRBWXQNJLNSZ19lOpG2r_0 2024-09-12T19:29:42.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5536915377797200679', time=2024-09-12T20:38:43.155733+0000, chain.objs.size()=1 2024-09-12T19:29:42.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wG5GwNT3MlbTtI1-xnEOMC8Ikfl6dT-_0 2024-09-12T19:29:42.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18128155103608706722', time=2024-09-12T20:38:43.955366+0000, chain.objs.size()=1 2024-09-12T19:29:42.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ql_kdAWuDonLbNYFae-wvh2g-sfJRZs_0 2024-09-12T19:29:42.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9305944316195505951', time=2024-09-12T20:38:45.239417+0000, chain.objs.size()=1 2024-09-12T19:29:42.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fEBDZvD8fPumwatIEtftcCD4cLshmHz_0 2024-09-12T19:29:42.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1966805938159238162', time=2024-09-12T20:38:45.575377+0000, chain.objs.size()=1 2024-09-12T19:29:42.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jakpTpJIyHrIEVyxgWSvzGAvaqohldP_0 2024-09-12T19:29:42.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13787882248515572676', time=2024-09-12T20:38:45.900184+0000, chain.objs.size()=1 2024-09-12T19:29:42.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.YyEQb3kV_M-Pe4YUZB6QHu6pjPrVrdI_0 2024-09-12T19:29:42.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9182177746852729041', time=2024-09-12T20:38:46.461058+0000, chain.objs.size()=1 2024-09-12T19:29:42.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.SQrqy8URHNKmTLAm4dY82vM4zO12hg6_0 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9918788829978257151', time=2024-09-12T20:38:47.526888+0000, chain.objs.size()=1 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.v7XdNYlPDwQy3MlthjPJLqSi3M1viFr_0 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14783820209952632629', time=2024-09-12T20:38:47.578574+0000, chain.objs.size()=1 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.eCd-ituSwHweNomWe2xgkgYHszONPln_0 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7943713239091573371', time=2024-09-12T20:38:49.560154+0000, chain.objs.size()=1 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.PM03TWKXGuwSbD5ZrBsLPhFu9imZeCD_0 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9159045449649223194', time=2024-09-12T20:38:49.661476+0000, chain.objs.size()=1 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.w4sI-Rhzj6OKtKQMdkjpWS3BAthiGED_0 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6116874534236002105', time=2024-09-12T20:38:49.663723+0000, chain.objs.size()=1 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jpsSM0TuUlnqQ0Yt1t9TKYLb-3mjaMa_0 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12102382583073125112', time=2024-09-12T20:39:10.277787+0000, chain.objs.size()=1 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.271__shadow_.rauyDvo4ey88vFJvQEviF6DNaztbuQE_0 2024-09-12T19:29:42.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5350105627649579835', time=2024-09-12T20:39:46.975780+0000, chain.objs.size()=1 2024-09-12T19:29:42.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:41.999+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.287__shadow_.5CE8cRPhCspbBS_eHhZZtJGGQXsgeBp_0 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.231031180411040707', time=2024-09-12T20:40:31.139652+0000, chain.objs.size()=1 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.303__shadow_.yfnEXggQeqp08YPHq_GRlMcyGFfpLeV_0 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16669670747632445068', time=2024-09-12T20:40:38.461607+0000, chain.objs.size()=1 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.306__shadow_.Dl720cK0lb3_jH5ZiKh8GteAyaqvRP7_0 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7071791438089939800', time=2024-09-12T20:41:21.082086+0000, chain.objs.size()=1 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.322__shadow_.jU5Oz2XDseAQjXSo7k5pFm0SB6nZVWv_0 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12355602451136073501', time=2024-09-12T20:43:04.847881+0000, chain.objs.size()=1 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.E6_hb6035vFTYuV3RnSvlZtaXcHL7oH_0 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5437526769738294462', time=2024-09-12T20:43:05.030591+0000, chain.objs.size()=1 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.owZH-mZIQZyfa4ocnwcLyMIiNm62cUX_0 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8937131536099459910', time=2024-09-12T20:43:05.195553+0000, chain.objs.size()=1 2024-09-12T19:29:42.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.C_nC8I3tGHYRDA4qF3PqIW-TbxxRPWd_0 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17277196512682907800', time=2024-09-12T20:43:06.945527+0000, chain.objs.size()=1 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.FD38lc056Xtfhus0hQ-AlJes9HaBupP_0 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12393547124125052560', time=2024-09-12T20:43:09.145498+0000, chain.objs.size()=1 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xlnNUI99GKrqajBo34CLDYN_THLJsQu_0 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11736347794530761567', time=2024-09-12T20:43:11.981722+0000, chain.objs.size()=1 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zsqKq03PvrHCKGyNCiivx-6_FVdXFlX_0 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17307107440164237810', time=2024-09-12T20:43:12.181573+0000, chain.objs.size()=1 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tqsXrs0vbj8IICdbae6jnsha12c4z9X_0 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15327607291816472904', time=2024-09-12T20:43:15.230200+0000, chain.objs.size()=1 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pVyoFignHX2rVJ-PFb58fM3np4GGDzc_0 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9277121544373781889', time=2024-09-12T20:43:15.816277+0000, chain.objs.size()=1 2024-09-12T19:29:42.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.yvlE4UPY-9dRvE_ig2uMWhTlRHPXk9M_0 2024-09-12T19:29:42.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10706230868721807383', time=2024-09-12T20:43:17.782806+0000, chain.objs.size()=1 2024-09-12T19:29:42.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.003+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.rxLUZvfOYt1vxP7uFI1YdktfgW6a-ua_0 2024-09-12T19:29:42.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1083831774818014850', time=2024-09-12T20:43:18.821301+0000, chain.objs.size()=1 2024-09-12T19:29:42.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.uItB_y4WXuRIgc_1F3Xqr-LfkTGoQGn_0 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2132095395138511627', time=2024-09-12T20:43:19.608398+0000, chain.objs.size()=1 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gdDjvB-4q82qC3rw3YHOmmReptUywfV_0 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14459236301209076097', time=2024-09-12T20:43:20.890153+0000, chain.objs.size()=1 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ul4L5AVyo9DQJDL6gyrqJGJRgcSOK6M_0 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5635056017507789594', time=2024-09-12T20:43:21.166043+0000, chain.objs.size()=1 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.w8IR8VFN3id-1WEQBuG0hzI5z9lTlnL_0 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10431108924859926857', time=2024-09-12T20:43:23.281895+0000, chain.objs.size()=1 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.L51a-tfNsmF6RfkIrNJJqlsPPoSNONl_0 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7273768262377888572', time=2024-09-12T20:43:24.519017+0000, chain.objs.size()=1 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.I0kVt753X-SKUxC1zshiktgooMmWydW_0 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4143764428106541046', time=2024-09-12T20:43:25.368978+0000, chain.objs.size()=1 2024-09-12T19:29:42.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7f6MayKuPwyXq2_6QCfTkT37_5UZPaE_0 2024-09-12T19:29:42.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5174480444264436318', time=2024-09-12T20:43:25.690273+0000, chain.objs.size()=1 2024-09-12T19:29:42.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Q_SSaBJQaO1Swqny7c9XSIOmGHEDAm8_0 2024-09-12T19:29:42.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15420581137779343984', time=2024-09-12T20:43:25.802257+0000, chain.objs.size()=1 2024-09-12T19:29:42.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.irhx72x9GmzF80cPwODScrHleF-rBUq_0 2024-09-12T19:29:42.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17227770260733765184', time=2024-09-12T20:43:25.967967+0000, chain.objs.size()=1 2024-09-12T19:29:42.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QssbLsQlBLXEm7v79pDKCrBcmB-5ygF_0 2024-09-12T19:29:42.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4412603258092656694', time=2024-09-12T20:43:26.100848+0000, chain.objs.size()=1 2024-09-12T19:29:42.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.kig5PZpAEsSd7cPupY9jsj9f2_PDSdX_0 2024-09-12T19:29:42.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14143752764940750043', time=2024-09-12T20:43:26.504574+0000, chain.objs.size()=1 2024-09-12T19:29:42.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TWR9tfjph5NsOcLk2gFpEo_CMUvcWDA_0 2024-09-12T19:29:42.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11585349085476910808', time=2024-09-12T20:43:27.958355+0000, chain.objs.size()=1 2024-09-12T19:29:42.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HBMQm7tMDrcF_FDdSX3HvEhJCuH0_oJ_0 2024-09-12T19:29:42.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2098888413094200596', time=2024-09-12T20:43:28.331795+0000, chain.objs.size()=1 2024-09-12T19:29:42.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6Mz0xgfC-m-IHxWq4Kq1YxkkgVxpjU4_0 2024-09-12T19:29:42.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3141211654168729936', time=2024-09-12T20:43:28.681730+0000, chain.objs.size()=1 2024-09-12T19:29:42.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QaGx-2sd5AGeb8VpAqoIIzSi2-Rdq-X_0 2024-09-12T19:29:42.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9702559064510377544', time=2024-09-12T20:43:28.683864+0000, chain.objs.size()=1 2024-09-12T19:29:42.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.2pbTKwk9jpe7vjQnzeOYukStnLrIXyq_0 2024-09-12T19:29:42.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4359048357064852727', time=2024-09-12T20:43:28.687921+0000, chain.objs.size()=1 2024-09-12T19:29:42.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.e2OxRTlOBnn7OGDjpBNSkQwvU45ZDNM_0 2024-09-12T19:29:42.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13589074963096400530', time=2024-09-12T20:45:11.261990+0000, chain.objs.size()=1 2024-09-12T19:29:42.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.JSZKs-EkXhEUT_t_AQc15xH4YgSiJX2_0 2024-09-12T19:29:42.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13509882310446414804', time=2024-09-12T20:45:11.809998+0000, chain.objs.size()=1 2024-09-12T19:29:42.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.CJZKRgXghjQ5pAGy6_Fts3rtu7JtSEc_0 2024-09-12T19:29:42.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1224619926677415921', time=2024-09-12T20:45:12.240648+0000, chain.objs.size()=1 2024-09-12T19:29:42.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.007+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dJ1I9X0Q3EkYQQTUN1ww8Glx1GPy9mN_0 2024-09-12T19:29:42.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17801713813133247842', time=2024-09-12T20:45:12.869343+0000, chain.objs.size()=1 2024-09-12T19:29:42.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YfHDcPNEk-kylMrt07SqErtg6O96tKI_0 2024-09-12T19:29:42.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17648178122206570678', time=2024-09-12T20:45:12.871666+0000, chain.objs.size()=1 2024-09-12T19:29:42.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Ii5-oHdOx-7M3_2Hcq-CtCc3wHDttVH_0 2024-09-12T19:29:42.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9276003179825303590', time=2024-09-12T20:45:14.753657+0000, chain.objs.size()=1 2024-09-12T19:29:42.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oANzzwmoDKAasI7f75F7b6-dPVGGtqq_0 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5609124760556194966', time=2024-09-12T20:45:16.496386+0000, chain.objs.size()=1 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.mjQtX6uHULfs7yH_Iz0JEbNoOWzWzPK_0 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14383461376202754272', time=2024-09-12T20:45:18.500571+0000, chain.objs.size()=1 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WBZSh2f34Xllwr9RzGszVxD4zgb9WGn_0 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3670625558449776359', time=2024-09-12T20:45:19.088427+0000, chain.objs.size()=1 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.tNPo9zNtdNdR1lLcpdQuWcxXj6UYxEE_0 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14068543414243748916', time=2024-09-12T20:45:20.869701+0000, chain.objs.size()=1 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Jm9DUHWSDOx_C2elrJIUpZdzoehmK4l_0 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16399211308576872587', time=2024-09-12T20:45:21.124805+0000, chain.objs.size()=1 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.h-ribxWOy4aQPP8Eb2KoiI-QTZj7M3v_0 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17787418793829440925', time=2024-09-12T20:45:21.174630+0000, chain.objs.size()=1 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hFU0ypMbQBNqlX6dym-zt-xqXkql32Y_0 2024-09-12T19:29:42.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5740771275719144358', time=2024-09-12T20:45:23.013650+0000, chain.objs.size()=1 2024-09-12T19:29:42.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.7G-dJ-6MEWOVOz9egK2Yrs1ZattKE-E_0 2024-09-12T19:29:42.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17869854303161169150', time=2024-09-12T20:45:24.741309+0000, chain.objs.size()=1 2024-09-12T19:29:42.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DOjX8Q8m1bfFQnys522Vk8g0vT9GQgP_0 2024-09-12T19:29:42.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4641747509313062227', time=2024-09-12T20:45:24.851336+0000, chain.objs.size()=1 2024-09-12T19:29:42.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PAaWpx8Wf2T_VHA3e7_cbWRrxNHsFRE_0 2024-09-12T19:29:42.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13336232896198180231', time=2024-09-12T20:45:25.762632+0000, chain.objs.size()=1 2024-09-12T19:29:42.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.011+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.be1dxN8ZgvlMngne1QUINR4_KmPQz7C_0 2024-09-12T19:29:42.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1667539234382729538', time=2024-09-12T20:45:26.095589+0000, chain.objs.size()=1 2024-09-12T19:29:42.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uMZ4codfqfsxfhcK6x5yLuPkA74ecXW_0 2024-09-12T19:29:42.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.849975956995968841', time=2024-09-12T20:45:27.201422+0000, chain.objs.size()=1 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.yuAP8wNr41PzaMXCL7Iea5Q2WzQsqj9_0 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14084119458370362970', time=2024-09-12T20:45:27.625773+0000, chain.objs.size()=1 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4svJBcr3UBaiFzmgTth_oHrEZscRqCV_0 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5874935335728320052', time=2024-09-12T20:45:27.922155+0000, chain.objs.size()=1 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nKZljvLmzJMLFHxBilQ8wX_YODS70hs_0 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16303052309269431118', time=2024-09-12T20:45:28.170864+0000, chain.objs.size()=1 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PA_1E4tzCXQAf7F5JsrfdtnsNA8e7UB_0 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16083103719414356580', time=2024-09-12T20:45:29.485881+0000, chain.objs.size()=1 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6afte8E96eSJxJim6GUmQWoZLapa2aL_0 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16922568467004921668', time=2024-09-12T20:45:31.286330+0000, chain.objs.size()=1 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WF7O-Jt3SMBzOc4uVUM5YETcjfyfUd6_0 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17841522286733000072', time=2024-09-12T20:45:31.339451+0000, chain.objs.size()=1 2024-09-12T19:29:42.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.IgMqzw4QQJN-ulUHJkN2taGDwvARG86_0 2024-09-12T19:29:42.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6070703418376209048', time=2024-09-12T20:45:31.872587+0000, chain.objs.size()=1 2024-09-12T19:29:42.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.h828tiWMuf-tAQ70wZJ63e0A5IRz_eW_0 2024-09-12T19:29:42.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7222694123808535117', time=2024-09-12T20:45:31.969639+0000, chain.objs.size()=1 2024-09-12T19:29:42.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.BuWorSvrRU5kuJbNul-3nnOKazxELMe_0 2024-09-12T19:29:42.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17907217121639876512', time=2024-09-12T20:45:32.989873+0000, chain.objs.size()=1 2024-09-12T19:29:42.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.m3vkc7KRrmdUGb2c9ZMye-uhW0gULCo_0 2024-09-12T19:29:42.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5638794740634182023', time=2024-09-12T20:45:33.166146+0000, chain.objs.size()=1 2024-09-12T19:29:42.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8FzUxxLFSab7hrOTnukzzyzh3rajo4J_0 2024-09-12T19:29:42.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17995400765977002808', time=2024-09-12T20:45:33.223341+0000, chain.objs.size()=1 2024-09-12T19:29:42.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.015+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ooLLwlojSvHjaXal2bM7A82duUztXck_0 2024-09-12T19:29:42.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7495339787045410542', time=2024-09-12T20:45:33.413369+0000, chain.objs.size()=1 2024-09-12T19:29:42.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GpuwLOLe1dE_opMYZqOpDnZS-2s0eWV_0 2024-09-12T19:29:42.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11041310003024895989', time=2024-09-12T20:45:33.922746+0000, chain.objs.size()=1 2024-09-12T19:29:42.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8zn62T2vSYVlnDvcD0ZBwopLSg22zNL_0 2024-09-12T19:29:42.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12763528067157564710', time=2024-09-12T20:45:35.144133+0000, chain.objs.size()=1 2024-09-12T19:29:42.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.23n13mqDemd767yy-nNMvNAEKJIXX46_0 2024-09-12T19:29:42.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17091461249354492753', time=2024-09-12T20:45:35.146232+0000, chain.objs.size()=1 2024-09-12T19:29:42.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.26HBHPI-X0LQIswDelXACOlXalHdXeT_0 2024-09-12T19:29:42.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11696866999435147601', time=2024-09-12T20:45:36.518321+0000, chain.objs.size()=1 2024-09-12T19:29:42.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MYK5WpYM4NZFbjxNc1v0cSERCVZiCRO_0 2024-09-12T19:29:42.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8762452373908940083', time=2024-09-12T20:45:36.589956+0000, chain.objs.size()=1 2024-09-12T19:29:42.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.AZhOI9Z1V3fVYQQKq2Tga0CxLOsbtpM_0 2024-09-12T19:29:42.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4897818830625172529', time=2024-09-12T20:45:38.299142+0000, chain.objs.size()=1 2024-09-12T19:29:42.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kblTlxvIqkpAE2MSjdIU-xbzGyG9mjz_0 2024-09-12T19:29:42.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.019+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47722 2024-09-12T19:29:42.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T19:29:42.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11333453641073424233', time=2024-09-12T20:51:18.066356+0000, chain.objs.size()=1 2024-09-12T19:29:42.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.487__shadow_.bTkVCAv4Hp_dqI4YcO5i_d3U-MgO-V2_0 2024-09-12T19:29:42.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2466877976809027751', time=2024-09-12T20:51:32.625988+0000, chain.objs.size()=1 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.495__shadow_.mNpYAQK3rfgkKyQwCiQ67sWpQXdWd92_0 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8485557320527933835', time=2024-09-12T20:51:43.082833+0000, chain.objs.size()=1 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.500__shadow_.shTky98hSSLCNHGANs9dnRi2Rul-WfF_0 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF', time=2024-09-12T20:57:40.648043+0000, chain.objs.size()=2 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.1 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.1_1 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF', time=2024-09-12T20:57:40.659303+0000, chain.objs.size()=2 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.2 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.2_1 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF', time=2024-09-12T20:57:40.670687+0000, chain.objs.size()=2 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.3 2024-09-12T19:29:42.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.3_1 2024-09-12T19:29:42.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF', time=2024-09-12T20:57:40.681653+0000, chain.objs.size()=2 2024-09-12T19:29:42.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.4 2024-09-12T19:29:42.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.4_1 2024-09-12T19:29:42.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF', time=2024-09-12T20:57:40.692517+0000, chain.objs.size()=2 2024-09-12T19:29:42.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.5 2024-09-12T19:29:42.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.5_1 2024-09-12T19:29:42.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF', time=2024-09-12T20:57:40.703899+0000, chain.objs.size()=2 2024-09-12T19:29:42.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.023+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.6 2024-09-12T19:29:42.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__shadow_mymultipart.2~tCTj4EyKTzLkRTYNDwAAKRXkaLj08TF.6_1 2024-09-12T19:29:42.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14388277545403993538', time=2024-09-12T20:59:28.594163+0000, chain.objs.size()=1 2024-09-12T19:29:42.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.528__shadow_.GSwl55WK_my3Ajpu0wzIMZ76ltcQVdt_0 2024-09-12T19:29:42.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.222206089576412552', time=2024-09-12T21:02:30.367132+0000, chain.objs.size()=1 2024-09-12T19:29:42.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.558__shadow_.hT6vRIXUDayrQZwUvWrl4dWWROD_mul_0 2024-09-12T19:29:42.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13566053549931284885', time=2024-09-12T21:02:58.221001+0000, chain.objs.size()=1 2024-09-12T19:29:42.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.565__shadow_.DRoOe-Jp5GXjgb420JAS1TX9XDvKp8g_0 2024-09-12T19:29:42.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8159473009052777145', time=2024-09-12T21:03:19.843587+0000, chain.objs.size()=1 2024-09-12T19:29:42.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:qxxvDX.T2NdzPVPNV0GV-A3QHBssyp5_.4QFhgPZoL5pL5whZJrtLToZ_Ksixlo1_0 2024-09-12T19:29:42.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6692839183064438372', time=2024-09-12T21:03:31.130632+0000, chain.objs.size()=1 2024-09-12T19:29:42.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.570__shadow:y5ak3zk-kdLZ5crTFDY17FdExY.UTZP_.cW0ZAxzbp10Koy5IembYsGi5XCfZnsC_0 2024-09-12T19:29:42.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3464949720466311581', time=2024-09-12T21:03:31.780244+0000, chain.objs.size()=1 2024-09-12T19:29:42.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.570__shadow:-Ql7vH9fP8KcyDiw6L1Cmhlc9jJr8E9_.P-srIljXTSSVinDeS6aUZ3rn4NSRdA3_0 2024-09-12T19:29:42.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13014089705472127120', time=2024-09-12T21:03:59.924718+0000, chain.objs.size()=1 2024-09-12T19:29:42.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.576__shadow:lZHv8JtL4nGkZgFePlQq41MHOwg81bE_.voJYhz2IUR_yFf1LQJ-QdBKuP1SZfo4_0 2024-09-12T19:29:42.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5079882598328893118', time=2024-09-12T21:04:16.453021+0000, chain.objs.size()=1 2024-09-12T19:29:42.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:vXeSF8xV.sFu1UV1dqT4RY3k4L06a52_.B6LSiQxS5QlBewUmxX5btTBFnMYBfF9_0 2024-09-12T19:29:42.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1de88a3640 0 -- 172.21.15.97:0/2458095298 >> [v2:172.21.15.154:6816/4233979797,v1:172.21.15.154:6817/4233979797] conn(0x7f1dd4008050 msgr2=0x7f1dd4018930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:42.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5684975692046049820', time=2024-09-12T21:04:29.348305+0000, chain.objs.size()=1 2024-09-12T19:29:42.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:WsOAmhRYrvzIxj2whnlTcTNMWB-jtzX_.MHKpPxLVE87cYbo43HQP8oAanGAXyqG_0 2024-09-12T19:29:42.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16078036307692619485', time=2024-09-12T21:04:36.828782+0000, chain.objs.size()=1 2024-09-12T19:29:42.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:pbKsiWgQjs7EWUV46MhT5kLsSieOMXa_.tlKAbZWr1tA-oi-c6nsLLLR-GBTa91q_0 2024-09-12T19:29:42.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11888888561382499325', time=2024-09-12T21:11:54.256285+0000, chain.objs.size()=1 2024-09-12T19:29:42.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.618__shadow_.wE-AJ0QEVOf3Aa38CCyyrAEuStKA-Ie_0 2024-09-12T19:29:42.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12963821596837833579', time=2024-09-12T21:13:42.704124+0000, chain.objs.size()=1 2024-09-12T19:29:42.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.632__shadow_.RsAiTPLwzYaJqpwj0S-vuz2D08kuU0a_0 2024-09-12T19:29:42.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17683410723315806142', time=2024-09-12T21:16:09.708397+0000, chain.objs.size()=1 2024-09-12T19:29:42.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.664__shadow_.9XZ9fNuvCEE9SkPqdPxR1pnT7M-5lnt_0 2024-09-12T19:29:42.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6259402775647563570', time=2024-09-12T21:17:05.354756+0000, chain.objs.size()=1 2024-09-12T19:29:42.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.694__shadow:XpfYeYUXymxOhuNLVfoUf9MKd2NmVx4_.lxiV1nkg0rF8XgXkgs6yh57PFnFR8CC_0 2024-09-12T19:29:42.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17440677585300597759', time=2024-09-12T21:17:35.911747+0000, chain.objs.size()=1 2024-09-12T19:29:42.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.708__shadow:lANAsPbH5Ac-eKntfNykviF39CithAS_.c9lgyFPeAwdam4TxI1VTRopnJOrKa-A_0 2024-09-12T19:29:42.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3831797131770142556', time=2024-09-12T21:18:14.371624+0000, chain.objs.size()=1 2024-09-12T19:29:42.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.027+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.718__shadow_.wSAouqI0bdbJZ2Y1FF0mjISMtB_iAfQ_0 2024-09-12T19:29:42.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.031+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:42.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T19:29:42.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:42.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:42.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49271' 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4674535640721502879', time=2024-09-12T20:31:10.382961+0000, chain.objs.size()=1 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.189__shadow_.DdRrRthj3vTNgDXb-BV1aZE55xYY7Vb_0 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12892761171918787835', time=2024-09-12T20:35:22.789443+0000, chain.objs.size()=1 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.228__shadow_.uSYYS9HOCmECUF3zbRlp0itgqFCaDSy_0 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7163641166350618994', time=2024-09-12T20:36:24.034740+0000, chain.objs.size()=1 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.253__shadow_.0mUA_KReOPMk1H-qnG__2fDJ54V8Iyr_0 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13941799685565310092', time=2024-09-12T20:36:32.968508+0000, chain.objs.size()=1 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.257__shadow_.xHD85ygGaG19es9v4VgPGJME4LO9uCM_0 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9168894576074931623', time=2024-09-12T20:36:39.584399+0000, chain.objs.size()=1 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.260__shadow_.59eHSIjaAT9rbdVSaNIKpfooERPePxl_0 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12511115947030055441', time=2024-09-12T20:38:22.851533+0000, chain.objs.size()=1 2024-09-12T19:29:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.HDahzDrNAuwRLSTfTL088hCNKi4BLzv_0 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11882031167230560481', time=2024-09-12T20:38:22.853272+0000, chain.objs.size()=1 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lZsq5d5fv9FFc9F2gaRHPuxDIQ18v2d_0 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.37169000120322753', time=2024-09-12T20:38:23.244966+0000, chain.objs.size()=1 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fQBJE8tgESfiOP7U8uuWG80ICEI-szK_0 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8821767511107177970', time=2024-09-12T20:38:23.447106+0000, chain.objs.size()=1 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.FpEXTpUsFc4XeB_3KnoaCyiHrYAPGgF_0 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.181247672434020658', time=2024-09-12T20:38:24.195053+0000, chain.objs.size()=1 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.LTHGSxk1QsEkey0p5o3hxtQwjfBNb1A_0 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6350227214176897938', time=2024-09-12T20:38:25.045688+0000, chain.objs.size()=1 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.p00TIyuDgvUgejWyARu8fxMiXIGMZYn_0 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15002149444878514886', time=2024-09-12T20:38:26.726071+0000, chain.objs.size()=1 2024-09-12T19:29:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.035+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.VglaF2J3f3up_T7hNKeJFGrw1i5L7KE_0 2024-09-12T19:29:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1de90a4640 0 -- 172.21.15.97:0/2458095298 >> [v2:172.21.15.97:6816/3061077368,v1:172.21.15.97:6817/3061077368] conn(0x7f1ddc0cc070 msgr2=0x7f1cb40864e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5835504158630689457', time=2024-09-12T20:38:27.018642+0000, chain.objs.size()=1 2024-09-12T19:29:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.l-NaZRz4IRVvVAFHqoMcM2PGwYVt8oc_0 2024-09-12T19:29:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7476268492656279740', time=2024-09-12T20:38:27.375043+0000, chain.objs.size()=1 2024-09-12T19:29:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.NvqnDfRh5ineF5iNzC9zOw1mJTBaPU3_0 2024-09-12T19:29:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1157469844530964554', time=2024-09-12T20:38:27.663578+0000, chain.objs.size()=1 2024-09-12T19:29:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jyiTULiWdrb8VxqrbwIsdT6hYPXzRH6_0 2024-09-12T19:29:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7436346018994980005', time=2024-09-12T20:38:30.880523+0000, chain.objs.size()=1 2024-09-12T19:29:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.y6-2EwsDmXp6s7uMKPw6qkilCJx3fbo_0 2024-09-12T19:29:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3619534295711810682', time=2024-09-12T20:38:31.547859+0000, chain.objs.size()=1 2024-09-12T19:29:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.oZznhe47ZYA11Vdi4YBva7LgnIOUo32_0 2024-09-12T19:29:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1690290930080933389', time=2024-09-12T20:38:31.791259+0000, chain.objs.size()=1 2024-09-12T19:29:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jsoha6LGV5WuwDdxF-23ReQsWpy_C2s_0 2024-09-12T19:29:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1923162907077877925', time=2024-09-12T20:38:32.387679+0000, chain.objs.size()=1 2024-09-12T19:29:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.gQD-Qn5UtXOD-e8gkO65Z5j_kMrpc2I_0 2024-09-12T19:29:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3790743956170262037', time=2024-09-12T20:38:34.095737+0000, chain.objs.size()=1 2024-09-12T19:29:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.iqyBfK_l24bIoWt-9krJhMnaZ4y3Ehw_0 2024-09-12T19:29:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4058303670461473265', time=2024-09-12T20:38:34.356065+0000, chain.objs.size()=1 2024-09-12T19:29:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZPu-9nqEBZiJvqmgGNljfpSSpbEAxj5_0 2024-09-12T19:29:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4809940389052460205', time=2024-09-12T20:38:35.173901+0000, chain.objs.size()=1 2024-09-12T19:29:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.uxWRkBKiIgsPI9A2tMrxYFA4Hc0fzDB_0 2024-09-12T19:29:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10327803428447045519', time=2024-09-12T20:38:35.360960+0000, chain.objs.size()=1 2024-09-12T19:29:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4Vqq94GXxrx8TopRLCMWTLry6AbGo33_0 2024-09-12T19:29:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1de88a3640 0 -- 172.21.15.97:0/2458095298 >> [v2:172.21.15.154:6824/2114276410,v1:172.21.15.154:6825/2114276410] conn(0x55d488497500 msgr2=0x7f1cb408c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:42.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16491732068451651562', time=2024-09-12T20:38:35.959120+0000, chain.objs.size()=1 2024-09-12T19:29:42.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.g2bMt_Atj8kGHgmrxSY4a3QrRKv7MT-_0 2024-09-12T19:29:42.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16142660540608592799', time=2024-09-12T20:38:36.460070+0000, chain.objs.size()=1 2024-09-12T19:29:42.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.039+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5sAx1EaVJ6Nlg1m_lcPtb0xVbmZ11i-_0 2024-09-12T19:29:42.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15046614500478325787', time=2024-09-12T20:38:38.407722+0000, chain.objs.size()=1 2024-09-12T19:29:42.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.B6bdN6nB644rkQdZGJaf4qxl8z3bzLl_0 2024-09-12T19:29:42.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7294993413821494702', time=2024-09-12T20:38:38.628506+0000, chain.objs.size()=1 2024-09-12T19:29:42.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.NCn--7HVP36XMcWeG7R442IUGYrftRI_0 2024-09-12T19:29:42.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3461783355603204489', time=2024-09-12T20:38:39.377036+0000, chain.objs.size()=1 2024-09-12T19:29:42.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nAGEVka4agmIQ6B3ZkiD8YFbhAXyXIt_0 2024-09-12T19:29:42.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15811509530381866216', time=2024-09-12T20:38:40.033388+0000, chain.objs.size()=1 2024-09-12T19:29:42.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.uSxsepzeW3PYup2-ip0rPECLy-ru8Nw_0 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5415268765066764846', time=2024-09-12T20:38:40.084125+0000, chain.objs.size()=1 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.reH4Fg-BO7rbsioGNzCDZCQzybYD1DP_0 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6449683227980022919', time=2024-09-12T20:38:40.086230+0000, chain.objs.size()=1 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Jk7DxuwWQL_CqRvStklopQCe4Wsi0NC_0 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14385448136246964864', time=2024-09-12T20:38:41.844865+0000, chain.objs.size()=1 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Z3aeySUlvXChBxDN9slG4YmeON3zxfv_0 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10597893226839611310', time=2024-09-12T20:38:42.099888+0000, chain.objs.size()=1 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.sf0BJTUyFD6QPqMGwDDrKxeBT2mPn99_0 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5699655837638630010', time=2024-09-12T20:38:42.101270+0000, chain.objs.size()=1 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.COJaZEQDkQN-0Zhpii12Axqf_dl9MjL_0 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18305627680701162490', time=2024-09-12T20:38:43.623113+0000, chain.objs.size()=1 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.JSzMWpEH0gKsJnMI2TdC8djqhGYDWca_0 2024-09-12T19:29:42.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14088310694202226553', time=2024-09-12T20:38:44.815425+0000, chain.objs.size()=1 2024-09-12T19:29:42.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.gRLZHKT7ih_DdfOvXZWY36kebiePgXe_0 2024-09-12T19:29:42.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3189505434638918496', time=2024-09-12T20:38:45.548561+0000, chain.objs.size()=1 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Mc4z_ltgZn9dT4-PMFW4-GeSJj9T58a_0 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10978814945940674868', time=2024-09-12T20:38:46.059526+0000, chain.objs.size()=1 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.XEEVhdHc0FvpkQLsHlPhdShmhlk_ERY_0 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.457178979151680960', time=2024-09-12T20:38:46.315720+0000, chain.objs.size()=1 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.mIWW7LdDmUQhdBKaIPnyTrUX84QQ8JJ_0 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5592808466580880035', time=2024-09-12T20:38:46.329823+0000, chain.objs.size()=1 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.6kKtZOvyxsvh0qYN1ZdbyMgzzQWWGVp_0 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4092057966618769941', time=2024-09-12T20:38:48.293000+0000, chain.objs.size()=1 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.b62242wsX5Q-VsR0skjgA9VvrMZOMbj_0 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2276718314934548293', time=2024-09-12T20:38:48.691630+0000, chain.objs.size()=1 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.28z8wlWjduQRP6AlNs2ndKlWpF0ySmF_0 2024-09-12T19:29:42.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4543012550999555596', time=2024-09-12T20:38:48.713172+0000, chain.objs.size()=1 2024-09-12T19:29:42.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.221UEHTtY18PPCmRBl-JyK_l4Y3Je1u_0 2024-09-12T19:29:42.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6357991721110236212', time=2024-09-12T20:38:49.193833+0000, chain.objs.size()=1 2024-09-12T19:29:42.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.k6TI2cOj0WLipLuEyAwjf4c2v0goVZk_0 2024-09-12T19:29:42.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16024165335400625719', time=2024-09-12T20:38:49.321176+0000, chain.objs.size()=1 2024-09-12T19:29:42.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nVA2kuYLWg8K5BTHEJokVPVZjcokrXc_0 2024-09-12T19:29:42.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8513374072139877840', time=2024-09-12T20:38:49.444021+0000, chain.objs.size()=1 2024-09-12T19:29:42.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0YV19iRueOgAp4Ij8LkvXhpCsJsK4Zd_0 2024-09-12T19:29:42.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14559302660410999532', time=2024-09-12T20:38:49.847554+0000, chain.objs.size()=1 2024-09-12T19:29:42.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.043+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.UsE64YF4ERl8WZLjPkMCNStYQN_rql7_0 2024-09-12T19:29:42.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16826599259492515433', time=2024-09-12T20:38:50.018963+0000, chain.objs.size()=1 2024-09-12T19:29:42.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.v2V6gnl26cxdUbtCRombRVm2-LdbCmn_0 2024-09-12T19:29:42.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4381032830308666021', time=2024-09-12T20:38:50.440937+0000, chain.objs.size()=1 2024-09-12T19:29:42.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ByNMRdgy3kMT10QR7mTzTYaU_kRQBIl_0 2024-09-12T19:29:42.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5800344840974412618', time=2024-09-12T20:38:50.494060+0000, chain.objs.size()=1 2024-09-12T19:29:42.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._tmpuTJml0rXtUGCK6U-qluScW1j04s_0 2024-09-12T19:29:42.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18068393082303684994', time=2024-09-12T20:38:57.293993+0000, chain.objs.size()=1 2024-09-12T19:29:42.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.265__shadow_.OIhj33NiWermSH5eqt9ZZckH9EzmFJP_0 2024-09-12T19:29:42.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3560286774712835953', time=2024-09-12T20:39:05.914478+0000, chain.objs.size()=1 2024-09-12T19:29:42.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.269__shadow_.ecqm8e1vSkVGBSKi9S-NYqhEKnVaEsL_0 2024-09-12T19:29:42.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16408479460967495049', time=2024-09-12T20:39:12.484384+0000, chain.objs.size()=1 2024-09-12T19:29:42.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.272__shadow_.v_u59F02L1wmfo3d4slcrkI_nmrKFAZ_0 2024-09-12T19:29:42.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12171098401357441450', time=2024-09-12T20:39:23.587686+0000, chain.objs.size()=1 2024-09-12T19:29:42.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.277__shadow_.fCmOlwgLkgLowpFYIHqBEZzjOv67-5u_0 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16168480655821759671', time=2024-09-12T20:39:37.411366+0000, chain.objs.size()=1 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.283__shadow_.-bpRD-eZLelqSwNvWhZNVoMrLXOZJwB_0 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9117098602473261766', time=2024-09-12T20:40:19.425756+0000, chain.objs.size()=1 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.298__shadow_.X9cCBH3BiqI21dJVcXXhBTzRYf8eJLH_0 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8067372287381652670', time=2024-09-12T20:41:21.080124+0000, chain.objs.size()=1 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.322__shadow_.IGLnsEdWWmTVTz6RWog4rzeWJWgWswx_0 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9608529520209747158', time=2024-09-12T20:43:03.326039+0000, chain.objs.size()=1 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.2ge0b9ubCU4hnJa81Eo25gaX-Rp-tBt_0 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15829189353999875285', time=2024-09-12T20:43:03.449573+0000, chain.objs.size()=1 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vd2r86REFhvSOOrgRnYOraeyhIZwfyR_0 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2916870629164350245', time=2024-09-12T20:43:03.958911+0000, chain.objs.size()=1 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Fhk9PBZtW31Ph5C9fouIy2eZQzjyJMj_0 2024-09-12T19:29:42.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1059314393509751298', time=2024-09-12T20:43:04.287886+0000, chain.objs.size()=1 2024-09-12T19:29:42.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.047+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.hgCln8U_3fpsxWOFtUyg2dz1R8YnswS_0 2024-09-12T19:29:42.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7061649448437437143', time=2024-09-12T20:43:06.529484+0000, chain.objs.size()=1 2024-09-12T19:29:42.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IkG3Z1HiD99_YuPnW9YotNDgYl8KkAb_0 2024-09-12T19:29:42.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15717183278828630732', time=2024-09-12T20:43:06.867512+0000, chain.objs.size()=1 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.mzlB-FPbaXOax3GX7WHjqqltJma-Awm_0 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15606049887711523113', time=2024-09-12T20:43:07.249456+0000, chain.objs.size()=1 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.U0CiNK48VJwZxjBKeg6F-UJMzbwIC5D_0 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.905597202287287933', time=2024-09-12T20:43:07.430927+0000, chain.objs.size()=1 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0oGeGfA6BSJLIuXce44H2_0NYASEBwI_0 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5989003148774608045', time=2024-09-12T20:43:08.474106+0000, chain.objs.size()=1 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6DNS8a5b8_wGfpj2MJV-flfA2p46Q86_0 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17678883745115586474', time=2024-09-12T20:43:13.656069+0000, chain.objs.size()=1 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cstRk8W7OuVYoH8-DPteakwwR1kK-hh_0 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4190090958574134519', time=2024-09-12T20:43:13.663889+0000, chain.objs.size()=1 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pkHHN-P8UozXFfU-sYGrAeGvmd1hvoY_0 2024-09-12T19:29:42.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4465220489555115494', time=2024-09-12T20:43:14.097655+0000, chain.objs.size()=1 2024-09-12T19:29:42.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.p28g02U8-6Xz7w-iXpaK7oBgaVINUMb_0 2024-09-12T19:29:42.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9296240581992983787', time=2024-09-12T20:43:16.269598+0000, chain.objs.size()=1 2024-09-12T19:29:42.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.0EgLOHo2KTz3kbaVEIcesc5OpAyil_a_0 2024-09-12T19:29:42.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14794483836055204410', time=2024-09-12T20:43:16.359291+0000, chain.objs.size()=1 2024-09-12T19:29:42.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.bScwbPpetQ8bNGjuYLucmA2e0anY1B4_0 2024-09-12T19:29:42.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8088044536916077643', time=2024-09-12T20:43:16.406185+0000, chain.objs.size()=1 2024-09-12T19:29:42.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.lkhmavbPds1VI8fSu9ZdJX1RjAsT7mI_0 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13813116085367517865', time=2024-09-12T20:43:18.926660+0000, chain.objs.size()=1 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.dsPv2if5UzAhg3pvRM6p61LsQLBB93d_0 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2465378469585116494', time=2024-09-12T20:43:18.938464+0000, chain.objs.size()=1 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.q3tu5kql2FN8VBV_qoQt_x8LzSA8A-X_0 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9467620251472314146', time=2024-09-12T20:43:19.391217+0000, chain.objs.size()=1 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.dcGnHaIIRNloecLZNHoR3WNpX2mOsXH_0 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8859421957999919085', time=2024-09-12T20:43:19.831686+0000, chain.objs.size()=1 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.W_jnvsDRjt7jQI23nkz1BUBU2FW50MZ_0 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2804434220672296316', time=2024-09-12T20:43:22.639434+0000, chain.objs.size()=1 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.MNqdcJBmAbwE5epDs_aENwWog9YcO5Z_0 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9051780847170944402', time=2024-09-12T20:43:23.603832+0000, chain.objs.size()=1 2024-09-12T19:29:42.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fYqsmCGdq5PtXmigR9Vxcxlg_ryCbQK_0 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4379883296938612880', time=2024-09-12T20:43:24.950919+0000, chain.objs.size()=1 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.repxCaXGeFI_oel2aSaFDgu7TTLVD84_0 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.507718645660757710', time=2024-09-12T20:43:26.775014+0000, chain.objs.size()=1 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.051+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.b5BiMhDWIAHigEvlItBUqcjf9KkBaVP_0 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15043530402062572219', time=2024-09-12T20:43:27.152047+0000, chain.objs.size()=1 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AGot-IK9Pu1py6J63RbpK0R4zpff5oF_0 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.321048828790154799', time=2024-09-12T20:43:29.122716+0000, chain.objs.size()=1 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ewNPZkF9vWWrPrZfK_jLw2k4qT0lXra_0 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8953163949842375512', time=2024-09-12T20:43:29.494178+0000, chain.objs.size()=1 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IFwty6sQXDoVSF3z68zYvSV_j610wn9_0 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6390374118815556603', time=2024-09-12T20:45:11.678344+0000, chain.objs.size()=1 2024-09-12T19:29:42.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.s87ss2r-b6d7MkgYngIwu5T7jFYBEeO_0 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10544289914709095364', time=2024-09-12T20:45:12.768478+0000, chain.objs.size()=1 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.s_LeACgu5yXlrw_Vm30OjWD_tJ7mvaz_0 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16426825016168485895', time=2024-09-12T20:45:13.289770+0000, chain.objs.size()=1 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YJkXJx0ZHQj82lyIuSiDkn_FruYTP9t_0 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4379777201826216062', time=2024-09-12T20:45:13.316119+0000, chain.objs.size()=1 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.aMxTbHHzyQz3nCwoBHkysN-1ajvUBMx_0 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1711706876202286304', time=2024-09-12T20:45:15.235777+0000, chain.objs.size()=1 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cEadZL6SioZXZXhDTKmApYbZmkRBxL-_0 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13062693097525142855', time=2024-09-12T20:45:15.914806+0000, chain.objs.size()=1 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UeozS11kD47w9YUHa9eujneqV9lHroH_0 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10780673709934551543', time=2024-09-12T20:45:18.422430+0000, chain.objs.size()=1 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Jl9HV76Q-U_3l5deFjRUeWHG1nqdn2Q_0 2024-09-12T19:29:42.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3382897155562879575', time=2024-09-12T20:45:19.253270+0000, chain.objs.size()=1 2024-09-12T19:29:42.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.TxfFWWuM61j9RF_9qX2I3MfZccOcEoJ_0 2024-09-12T19:29:42.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1712778925608494752', time=2024-09-12T20:45:20.681432+0000, chain.objs.size()=1 2024-09-12T19:29:42.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.d4mpK90NfkFOAQ0ziP64eWiLB7uHTGZ_0 2024-09-12T19:29:42.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17412544895569475235', time=2024-09-12T20:45:22.088580+0000, chain.objs.size()=1 2024-09-12T19:29:42.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YtvKUuMWFrrKKff4MQJVoYGWjNMRIro_0 2024-09-12T19:29:42.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12182014240650732622', time=2024-09-12T20:45:22.194520+0000, chain.objs.size()=1 2024-09-12T19:29:42.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6yBpaoNIIu49I9WqYIzjjkV-_AhdAKJ_0 2024-09-12T19:29:42.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14072179156133418183', time=2024-09-12T20:45:22.497616+0000, chain.objs.size()=1 2024-09-12T19:29:42.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xR07vxlGdnE5ELljva3l5Kv_OCJAal0_0 2024-09-12T19:29:42.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16548314230000719546', time=2024-09-12T20:45:26.131063+0000, chain.objs.size()=1 2024-09-12T19:29:42.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.EuevRINd4EhYUeeqPEO3F5YbKHcELlM_0 2024-09-12T19:29:42.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9270895062232479880', time=2024-09-12T20:45:27.079662+0000, chain.objs.size()=1 2024-09-12T19:29:42.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.F-722QkriHd-U90cSVHR0QO7QT4sBKO_0 2024-09-12T19:29:42.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5849374625684906474', time=2024-09-12T20:45:29.191331+0000, chain.objs.size()=1 2024-09-12T19:29:42.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.amuyHqU2CcoQRk9h_CXCiaJbCxMOg30_0 2024-09-12T19:29:42.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14626111577750450989', time=2024-09-12T20:45:29.192798+0000, chain.objs.size()=1 2024-09-12T19:29:42.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.NMD-wRKcsdixe3jGmaBwhinRQ4IUIZs_0 2024-09-12T19:29:42.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2417476796927673910', time=2024-09-12T20:45:30.540318+0000, chain.objs.size()=1 2024-09-12T19:29:42.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.055+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DFsW4ivPxjdApRNcCXB06H2FQt3YYSQ_0 2024-09-12T19:29:42.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49271 2024-09-12T19:29:42.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T19:29:42.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1865950604470852539', time=2024-09-12T20:45:30.896151+0000, chain.objs.size()=1 2024-09-12T19:29:42.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.IQdYHcFHhcLbUq2HbV-FRXbOiW7bMtR_0 2024-09-12T19:29:42.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11187676871431407090', time=2024-09-12T20:45:30.897631+0000, chain.objs.size()=1 2024-09-12T19:29:42.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pKXuXKf25yZWy7CAs-nuKhzD7DT7yoW_0 2024-09-12T19:29:42.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17835782827629448927', time=2024-09-12T20:45:31.048676+0000, chain.objs.size()=1 2024-09-12T19:29:42.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._f1U-xxnpCHr-LpGrAfKOLMNZwHEQCY_0 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17750986820159639096', time=2024-09-12T20:45:33.356042+0000, chain.objs.size()=1 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fXlmb80mE0gxw4Q3DwL1WfPEKble-HG_0 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7485185728440362025', time=2024-09-12T20:45:33.458969+0000, chain.objs.size()=1 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.XOEfOY7LdWeFIvc8HBYc2Bzirt7hiVB_0 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10214954903880525013', time=2024-09-12T20:45:34.311849+0000, chain.objs.size()=1 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4s-lbcyMZmIK1HpQArWvfJen-KZR6T9_0 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1560379949621666772', time=2024-09-12T20:45:37.294854+0000, chain.objs.size()=1 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.SNPOz--Tqeud35XrYq5-Vb-cG9NjtzY_0 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1052974012239406269', time=2024-09-12T20:45:37.299045+0000, chain.objs.size()=1 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5m4yLzqXQ4c2WKVNquxG5oZerEG_t1d_0 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5804468046139442420', time=2024-09-12T20:45:38.015606+0000, chain.objs.size()=1 2024-09-12T19:29:42.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5619U2hfY4-A8ZW3mazOMBL_CHNm6CQ_0 2024-09-12T19:29:42.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17630410349854992641', time=2024-09-12T20:46:02.271155+0000, chain.objs.size()=1 2024-09-12T19:29:42.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.336__shadow_.JEVQ258p6ci3o3rSiKcAgsNsv9Yv8Vf_0 2024-09-12T19:29:42.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16104032822887996683', time=2024-09-12T20:47:06.878747+0000, chain.objs.size()=1 2024-09-12T19:29:42.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.371__shadow_.dfqwTD9xAq-PgPx2BNZAbAALKuRRAQK_0 2024-09-12T19:29:42.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12118554657360501116', time=2024-09-12T20:47:10.693510+0000, chain.objs.size()=1 2024-09-12T19:29:42.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.059+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.373__shadow_.wWhf32Fj4XjRFNE-iV-79p9__FcEUBR_0 2024-09-12T19:29:42.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15610003541273253594', time=2024-09-12T20:48:25.357921+0000, chain.objs.size()=1 2024-09-12T19:29:42.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.409__shadow_.m18jBaFRDAfSk2NSUTbbB-cXw34x-et_0 2024-09-12T19:29:42.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11705024660013952462', time=2024-09-12T20:49:30.686559+0000, chain.objs.size()=1 2024-09-12T19:29:42.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.441__shadow_.EUK5oVJX6aNWQXA8KORCaSFiXIry1zz_0 2024-09-12T19:29:42.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2818003133565402620', time=2024-09-12T20:50:29.661211+0000, chain.objs.size()=1 2024-09-12T19:29:42.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.464__shadow_.-YdE5TGhYTFhu__Z8uoJ_AcLlmQzYAr_0 2024-09-12T19:29:42.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15244291605801510422', time=2024-09-12T20:51:02.891036+0000, chain.objs.size()=1 2024-09-12T19:29:42.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.6JmqeSsojmBthQ1MoOdQ255Gh8FRZ9k_0 2024-09-12T19:29:42.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8183132322194986881', time=2024-09-12T20:51:15.866572+0000, chain.objs.size()=1 2024-09-12T19:29:42.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.486__shadow_.SEw5CruBn4w1ZiulF7TViLYK9eWK71F_0 2024-09-12T19:29:42.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6308159404742903573', time=2024-09-12T20:59:03.396672+0000, chain.objs.size()=2 2024-09-12T19:29:42.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~95taddLfZPdTIEV4VT7rSCQFFnmnprb.1 2024-09-12T19:29:42.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~95taddLfZPdTIEV4VT7rSCQFFnmnprb.2 2024-09-12T19:29:42.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~u-ouXq9XdHIPRpfkkYWR9uLdDWfwtbJ', time=2024-09-12T21:02:41.601495+0000, chain.objs.size()=1 2024-09-12T19:29:42.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.561__multipart_mymultipart.2~u-ouXq9XdHIPRpfkkYWR9uLdDWfwtbJ.1 2024-09-12T19:29:42.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.873588493283311331', time=2024-09-12T21:03:10.859169+0000, chain.objs.size()=1 2024-09-12T19:29:42.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:PzqXikspnXN1e.W1JdJLPNeh-dEGCf-_.ooCRfhfuJeZINZEpfPw8xDlOT6ZWRhN_0 2024-09-12T19:29:42.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17055264308871786315', time=2024-09-12T21:03:23.591462+0000, chain.objs.size()=1 2024-09-12T19:29:42.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:hHODQCaVgxvtGJN5RwGKmcoNEWtAOhl_.jIdkWuPlMc9FqDQjr7Q3WVh_2Hg9Tlv_0 2024-09-12T19:29:42.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1615911317724026908', time=2024-09-12T21:03:26.537391+0000, chain.objs.size()=1 2024-09-12T19:29:42.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.063+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:iZ187YiHjv5WCor41tW6eJB80XP9mwO_.Fnn622LXAWH5t4xHRfgg-paJgzCbc4E_0 2024-09-12T19:29:42.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3306962362032834618', time=2024-09-12T21:03:58.537689+0000, chain.objs.size()=1 2024-09-12T19:29:42.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.576__shadow:jRUvxQQVyz0sPEH0TNBdMBpJJE.8tLT_.6tox2hnEWpQKxugr5C1OVWyv9qfRKgp_0 2024-09-12T19:29:42.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6781338535738177910', time=2024-09-12T21:04:17.277104+0000, chain.objs.size()=1 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:8cDILdlGKEglP0aNbw4Fxtiow14u7J._.lqnnVB2RnxVsahgdmleABViotvSFnpv_0 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17244005207391903669', time=2024-09-12T21:05:54.513584+0000, chain.objs.size()=1 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.579__shadow:xdW7UUPB1zsKF4Zz6f2eaBLm66QyQ1h_.U-pT3NAY6IynCmFuG9V_afb6vUGRGQX_0 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13339608803418005604', time=2024-09-12T21:06:38.080662+0000, chain.objs.size()=1 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.596__shadow_.f2_KlDS8VQ76KSPeSN6aOHPZD9gwbiv_0 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8385550213011009123', time=2024-09-12T21:12:50.875255+0000, chain.objs.size()=12 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__multipart_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.1 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__shadow_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.1_1 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__multipart_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.2 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__shadow_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.2_1 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__multipart_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.3 2024-09-12T19:29:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__shadow_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.3_1 2024-09-12T19:29:42.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__multipart_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.4 2024-09-12T19:29:42.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__shadow_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.4_1 2024-09-12T19:29:42.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__multipart_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.5 2024-09-12T19:29:42.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.067+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__shadow_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.5_1 2024-09-12T19:29:42.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__multipart_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.6 2024-09-12T19:29:42.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.623__shadow_multipart_enc.2~jPrYiFh7sSmOYAuIMA1hRYKfERMTcix.6_1 2024-09-12T19:29:42.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14576440755564701209', time=2024-09-12T21:16:06.618234+0000, chain.objs.size()=1 2024-09-12T19:29:42.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.663__shadow_.A726wmvcyOPtUA8KF2AqytSTkPWVCoy_0 2024-09-12T19:29:42.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2824023071260618736', time=2024-09-12T21:16:09.718199+0000, chain.objs.size()=1 2024-09-12T19:29:42.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.664__shadow_.YS68sdTpB-KD4HEVkCGXuOx6973DcnA_0 2024-09-12T19:29:42.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2378789194009428630', time=2024-09-12T21:16:16.077358+0000, chain.objs.size()=1 2024-09-12T19:29:42.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.666__shadow_.TB82hLR7d5EPtyZoGhwRXG3kW171kqr_0 2024-09-12T19:29:42.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2637564349389561625', time=2024-09-12T21:18:01.654409+0000, chain.objs.size()=1 2024-09-12T19:29:42.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.716__shadow:aYg0VnSa8a4j7Ub0ROp-US3uiro9H5c_.KJizW5SoGZF2TPVItB0s63Dc1WbqhwS_0 2024-09-12T19:29:42.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9141209062510671354', time=2024-09-12T21:19:42.596716+0000, chain.objs.size()=3 2024-09-12T19:29:42.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.743__multipart_mymultipart3.2~0_q70Z4f6qZLW_OVplZg2uOy2NDt_VA.1 2024-09-12T19:29:42.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.743__multipart_mymultipart3.2~0_q70Z4f6qZLW_OVplZg2uOy2NDt_VA.2 2024-09-12T19:29:42.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.743__multipart_mymultipart3.2~0_q70Z4f6qZLW_OVplZg2uOy2NDt_VA.3 2024-09-12T19:29:42.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.071+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:42.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.075+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T19:29:42.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:42.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:42.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41300' 2024-09-12T19:29:42.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8098327769820874563', time=2024-09-12T20:36:32.949932+0000, chain.objs.size()=1 2024-09-12T19:29:42.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.257__shadow_.DCVWYdps31Hc1mo0nU-xY9Rc61rJyj8_0 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17206065808664037178', time=2024-09-12T20:38:22.430650+0000, chain.objs.size()=1 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZFhNs2qLB6IDtg36je-dFYOtUEYV-2r_0 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8868173584991550563', time=2024-09-12T20:38:24.288355+0000, chain.objs.size()=1 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RnDaa86RhsN97XfirqU_NHLEN6u5Qyi_0 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9344828484125232033', time=2024-09-12T20:38:26.987275+0000, chain.objs.size()=1 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4Cnd_fFMgwQxq_B-EODyTrT7aisw5AL_0 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7094494836502955681', time=2024-09-12T20:38:27.896963+0000, chain.objs.size()=1 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.J7koWT9kRxOQY0KD7nZPk73Wia9cEY-_0 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2292809029019745133', time=2024-09-12T20:38:27.980263+0000, chain.objs.size()=1 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.OI2oi6ubiNBefRwBlUDywsuxVhaJGJ__0 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14087705900092115910', time=2024-09-12T20:38:28.715233+0000, chain.objs.size()=1 2024-09-12T19:29:42.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4KfbBLJ0WOq5PObyteF1V7KIUo08U9B_0 2024-09-12T19:29:42.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15230683045755057638', time=2024-09-12T20:38:31.081940+0000, chain.objs.size()=1 2024-09-12T19:29:42.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.d3f5sCnCEdRXxwpcidE6lROoIvSr5kV_0 2024-09-12T19:29:42.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3277002052778571067', time=2024-09-12T20:38:31.353145+0000, chain.objs.size()=1 2024-09-12T19:29:42.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RVFNoNVUtaAAKd7cqwm1o-hjFjSvx-I_0 2024-09-12T19:29:42.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.34303558053209998', time=2024-09-12T20:38:34.062298+0000, chain.objs.size()=1 2024-09-12T19:29:42.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.O4sgBrc4HvilZZnTEVHq9bCP0I_d9aV_0 2024-09-12T19:29:42.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10569804154990189669', time=2024-09-12T20:38:36.329566+0000, chain.objs.size()=1 2024-09-12T19:29:42.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qABrft_vLX-BNqVBFQxu7uKQMIYr_-Q_0 2024-09-12T19:29:42.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16130659279423789154', time=2024-09-12T20:38:36.684857+0000, chain.objs.size()=1 2024-09-12T19:29:42.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qCe2pCU2o1Zf01ML0NbTAPe_EJ4zEHl_0 2024-09-12T19:29:42.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16912237112909957118', time=2024-09-12T20:38:40.494456+0000, chain.objs.size()=1 2024-09-12T19:29:42.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Y6WFMbMRTqlHkk9Ygu031lmUZhR-VmA_0 2024-09-12T19:29:42.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.364601151599863963', time=2024-09-12T20:38:41.627039+0000, chain.objs.size()=1 2024-09-12T19:29:42.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GZcxyX3mFKAEmE9l6G3VhocQoEIhAY8_0 2024-09-12T19:29:42.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1829045031788614743', time=2024-09-12T20:38:41.882876+0000, chain.objs.size()=1 2024-09-12T19:29:42.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.B_IWfYazhvoHIGIPx-kebKtiG3PWc8M_0 2024-09-12T19:29:42.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17601586903718126337', time=2024-09-12T20:38:42.121008+0000, chain.objs.size()=1 2024-09-12T19:29:42.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GDtauodpcUk_LROtQI9pFoYX7CxNw7W_0 2024-09-12T19:29:42.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5739823431296652877', time=2024-09-12T20:38:42.200190+0000, chain.objs.size()=1 2024-09-12T19:29:42.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lgj14SbHG83RggeGT9eWQ3MHsdzArwC_0 2024-09-12T19:29:42.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5514506661543879523', time=2024-09-12T20:38:42.807333+0000, chain.objs.size()=1 2024-09-12T19:29:42.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wScbRsoknLMC2SgzNHGwJ4UMClOOskl_0 2024-09-12T19:29:42.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16791801333950005311', time=2024-09-12T20:38:43.993620+0000, chain.objs.size()=1 2024-09-12T19:29:42.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.079+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Xvj38JlM2COTi19D8M7sjGLPoknFjkd_0 2024-09-12T19:29:42.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7536265252940851604', time=2024-09-12T20:38:44.054124+0000, chain.objs.size()=1 2024-09-12T19:29:42.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.frYFUmIes3DH5cBRNGK0uNamjYvjsVl_0 2024-09-12T19:29:42.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14762173089702498364', time=2024-09-12T20:38:44.829345+0000, chain.objs.size()=1 2024-09-12T19:29:42.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4qRnxrxLTEu6rhxX534g1CVZgKm8hxz_0 2024-09-12T19:29:42.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8279950932709119077', time=2024-09-12T20:38:45.068215+0000, chain.objs.size()=1 2024-09-12T19:29:42.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-0XJZhu5UQ6hoIy_p4mXo4VCdQByQcw_0 2024-09-12T19:29:42.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14808922546761838816', time=2024-09-12T20:38:45.119454+0000, chain.objs.size()=1 2024-09-12T19:29:42.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.N3g7EnRI7ccyGX635ITcYwoXJJczZBv_0 2024-09-12T19:29:42.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9630284689797673665', time=2024-09-12T20:38:45.273098+0000, chain.objs.size()=1 2024-09-12T19:29:42.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.xljcg6h8STDrq8CpacFFc_YEn_cyoGC_0 2024-09-12T19:29:42.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17450548337055867898', time=2024-09-12T20:38:45.465632+0000, chain.objs.size()=1 2024-09-12T19:29:42.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.G1HKqly_VjjjtSgtUp93Nrur1VbsPMk_0 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10013904217080505604', time=2024-09-12T20:38:46.695136+0000, chain.objs.size()=1 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.IfUaN-m7-we7EW6VrU4AGST4UMX_W1Y_0 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12110245866437316380', time=2024-09-12T20:38:47.031504+0000, chain.objs.size()=1 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CbIFKCopw0h-b2NJrJBOMUKFvkkA75W_0 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13930278410059272830', time=2024-09-12T20:38:47.098501+0000, chain.objs.size()=1 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5qPRCH1UKo_eiipRKLnNI3Bl03NHohy_0 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13668465641058158292', time=2024-09-12T20:38:47.100584+0000, chain.objs.size()=1 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZFAAGW5Qov2_7F8cT6b9N04eWIPvzPD_0 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13035654393917356174', time=2024-09-12T20:38:48.394334+0000, chain.objs.size()=1 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5zTsWoXr71tdrTgVGcvCZIqVJ8qC6gu_0 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17417945307301489934', time=2024-09-12T20:38:48.396450+0000, chain.objs.size()=1 2024-09-12T19:29:42.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jmfAz3_BhD1vK9-s2CASARbNevhH2ZP_0 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15930112776337640532', time=2024-09-12T20:38:48.572499+0000, chain.objs.size()=1 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9FoLjYgT3S58_SrEAin16OMolR-NdsB_0 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3976930673486424909', time=2024-09-12T20:38:50.345147+0000, chain.objs.size()=1 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.YWaBtDugIHxBOd-5QBVhRIsKSjsKibh_0 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3385690647774815018', time=2024-09-12T20:38:50.347326+0000, chain.objs.size()=1 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Ob_kfpKjG54SwSe7lvhIXqQYU0V28XY_0 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4960109132131185106', time=2024-09-12T20:38:50.367805+0000, chain.objs.size()=1 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aLFW6Id3Y47BmcfuOUXLM1ZoXXOQySz_0 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8707755945392754953', time=2024-09-12T20:39:01.632658+0000, chain.objs.size()=1 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.267__shadow_.cB2DKPdlXbIO6Q0C9JXB-Tz3LpZvVYs_0 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14108897623543653836', time=2024-09-12T20:39:46.974752+0000, chain.objs.size()=1 2024-09-12T19:29:42.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.083+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.287__shadow_.0qTfw687eMkeuRSKXSt7MVY8Q-0h6iS_0 2024-09-12T19:29:42.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1213643203598781746', time=2024-09-12T20:39:56.726625+0000, chain.objs.size()=1 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.291__shadow_.5nafZFOiHmku74719KUGw85HxN5UEH4_0 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1953616123521133560', time=2024-09-12T20:40:01.983657+0000, chain.objs.size()=1 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.Ae-z__Dnf2UNPy5F3wacjk_bEgrrVMs_0 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16104106617446063122', time=2024-09-12T20:40:02.021357+0000, chain.objs.size()=1 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.Dx81opCr08hrGeVnniy71etPik9b_aR_0 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9137719174556785747', time=2024-09-12T20:40:02.052201+0000, chain.objs.size()=1 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.16ebR-bOlnWnwiAB7RX5AquppyvzJC5_0 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11485314848586763347', time=2024-09-12T20:40:28.883080+0000, chain.objs.size()=1 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.302__shadow_.nSIJpyncGozSQyCwhCxgeqkbZYUiAD1_0 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12597208980348547712', time=2024-09-12T20:43:02.400907+0000, chain.objs.size()=1 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fVbmwP9wYsEBxKdoSsHs9oQBmp2Gnli_0 2024-09-12T19:29:42.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5687135553511791736', time=2024-09-12T20:43:02.491652+0000, chain.objs.size()=1 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fOyjvrDwq-Gl8ieUSpNgH-o3NvPR1PI_0 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1151686020215554882', time=2024-09-12T20:43:04.223170+0000, chain.objs.size()=1 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AsMf-kLYPIKN_rGtu7442qZgcOKmLFi_0 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7448721009683652852', time=2024-09-12T20:43:04.776535+0000, chain.objs.size()=1 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.C-0FL4vfnRaJu6Q-NGgMRgs9oplXjX__0 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3944465792436205241', time=2024-09-12T20:43:05.108830+0000, chain.objs.size()=1 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9cfBBBxLZIRGyV0FCX_iy-n68i3Ll-s_0 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15717065937256361553', time=2024-09-12T20:43:06.414703+0000, chain.objs.size()=1 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vDLBSdh6cVU0sUHx3V8CGJEp4SeTXOy_0 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7496249268519809631', time=2024-09-12T20:43:06.416727+0000, chain.objs.size()=1 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.BQClbQg7aJ_X6qZGyCaMpbXlwbo8A9w_0 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17798913028009774011', time=2024-09-12T20:43:07.114935+0000, chain.objs.size()=1 2024-09-12T19:29:42.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.f_9m6A8ROG04S9wO9yrWrLUd47OFsop_0 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1226433948227671746', time=2024-09-12T20:43:08.005842+0000, chain.objs.size()=1 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.irI9MzWpoR8x8EWPZSOjBJAkIeY6JME_0 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15100516343089331428', time=2024-09-12T20:43:08.824472+0000, chain.objs.size()=1 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6sZPzSYXeVNZZAVef0A6FqdZLfPnHs__0 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13601953463183818728', time=2024-09-12T20:43:08.825930+0000, chain.objs.size()=1 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VNv0VBvVECDB88VFbx9DYrch6oSu5L-_0 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17709942361264080498', time=2024-09-12T20:43:09.106002+0000, chain.objs.size()=1 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.btX2CbCJHRiwFeuoZROJwM78YYe19QN_0 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7630544197206607951', time=2024-09-12T20:43:10.099535+0000, chain.objs.size()=1 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5SG514GRcFVlxs-Loo_eeKAlFGi15FW_0 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1890308353480442789', time=2024-09-12T20:43:11.494522+0000, chain.objs.size()=1 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5E46Uho5ef86Hjt9X5523spmHhw2D4k_0 2024-09-12T19:29:42.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14562807074057949231', time=2024-09-12T20:43:11.546700+0000, chain.objs.size()=1 2024-09-12T19:29:42.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.087+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ifOEhHqf62B7Huo4hfrmWoIaTwk0GLc_0 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3042592574979700798', time=2024-09-12T20:43:11.548474+0000, chain.objs.size()=1 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.iT6D8XWd_xPzu5uldDwg2C7E-vyviRz_0 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11665843827781630342', time=2024-09-12T20:43:13.756827+0000, chain.objs.size()=1 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.z4vaH5qT0OVrfVbyHaBAP-Pr6DVf9wM_0 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9655643272803449977', time=2024-09-12T20:43:14.599557+0000, chain.objs.size()=1 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.sQRF4cA-PmnvuCz6x2qqWoqmb6pdiRF_0 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4934405072137532872', time=2024-09-12T20:43:15.648674+0000, chain.objs.size()=1 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.JA_Cf0NyZ_VJcgIaY6CUasIQcIaDq1j_0 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2923012594277823986', time=2024-09-12T20:43:18.322172+0000, chain.objs.size()=1 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Z1i2ca4QQjd0LsoOYzyvj_0DUX2u03r_0 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.665754806042045904', time=2024-09-12T20:43:20.852390+0000, chain.objs.size()=1 2024-09-12T19:29:42.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KJkBnzd86T_HQT9j3DyiFAGC0sKdY1c_0 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8392435913366418960', time=2024-09-12T20:43:20.855401+0000, chain.objs.size()=1 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TGs0jIaGT9gZVTZ9xagFsyJL5OLS9eT_0 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2488884884990073536', time=2024-09-12T20:43:21.634116+0000, chain.objs.size()=1 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.FWVTufUjGiCTEpwC7fXduT7hCZ1w5ta_0 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6513065003033841329', time=2024-09-12T20:43:22.149866+0000, chain.objs.size()=1 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HYkLE1s_2jz1xgsgtGWYOhazTy-W7mT_0 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4302199937672102732', time=2024-09-12T20:43:23.373695+0000, chain.objs.size()=1 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.wqwWUSx4HUlpcaEE1_UTHuiSod7nsPL_0 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3961744598262105643', time=2024-09-12T20:43:24.908836+0000, chain.objs.size()=1 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.kTflUD7ZNhGsTQU7stll8-Fya3a2VRD_0 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10459255558311490710', time=2024-09-12T20:43:25.320311+0000, chain.objs.size()=1 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.P9rxs_pZ9YSzQhnxlGwVZNHykWnN8vq_0 2024-09-12T19:29:42.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8822827540953350977', time=2024-09-12T20:43:26.694040+0000, chain.objs.size()=1 2024-09-12T19:29:42.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SqhGLJkFlmqEWX89-e0u9RQ7KSSAdRf_0 2024-09-12T19:29:42.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16308811156007071947', time=2024-09-12T20:43:27.051360+0000, chain.objs.size()=1 2024-09-12T19:29:42.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-ZA75jwp82IPL3n3Vc3B2TNPCdwHap4_0 2024-09-12T19:29:42.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5303667266095879581', time=2024-09-12T20:43:27.872178+0000, chain.objs.size()=1 2024-09-12T19:29:42.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4-woR8S5g7eL00TVDlZU0DhAgH1uGxz_0 2024-09-12T19:29:42.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6704586184490607723', time=2024-09-12T20:43:27.874301+0000, chain.objs.size()=1 2024-09-12T19:29:42.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5JEn6ER6q1pX521Y68WMGf0HrSbgGrc_0 2024-09-12T19:29:42.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3489040756362123784', time=2024-09-12T20:43:29.205616+0000, chain.objs.size()=1 2024-09-12T19:29:42.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HRUFDCnuWpdHJYGexwDSNViFxhDp7GB_0 2024-09-12T19:29:42.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17494522381709569908', time=2024-09-12T20:43:29.992537+0000, chain.objs.size()=1 2024-09-12T19:29:42.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.w3fxZYK0icUkyLGvG5rY_IAU1ljjt_X_0 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16546124539753685460', time=2024-09-12T20:45:10.790237+0000, chain.objs.size()=1 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Pkc9zdYeDyJa6dpi5Mso77ZpUfZ6zpl_0 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13348146423399477014', time=2024-09-12T20:45:11.599565+0000, chain.objs.size()=1 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uXH8BHBPs3nTzo1KmPKSsHd0zDzQUrO_0 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15735851998487807636', time=2024-09-12T20:45:12.032957+0000, chain.objs.size()=1 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1Ek0WUNxxAmb1M-W4v2TokzdtAnqjOq_0 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18167653864693110486', time=2024-09-12T20:45:13.290365+0000, chain.objs.size()=1 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.091+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.G8q2rUb1OF_nBHSVQghSRCGGWTMUAaa_0 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12412466173617051574', time=2024-09-12T20:45:13.365722+0000, chain.objs.size()=1 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pLXZnJvzyeYoORn6kK6gGdjYzFmVELo_0 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2559831619087637007', time=2024-09-12T20:45:13.515987+0000, chain.objs.size()=1 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4BlcpWRHLFE9GvoqieSuOcI4OAlnwtW_0 2024-09-12T19:29:42.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15078018761119747873', time=2024-09-12T20:45:15.328105+0000, chain.objs.size()=1 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.R-XBNHxreL77Ke-9LEgcCC24r3_eQzM_0 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1140900645869784366', time=2024-09-12T20:45:16.912991+0000, chain.objs.size()=1 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xO8L8yfSgiu-f09s2aIQwwp1FKOXyuw_0 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4729728105334840114', time=2024-09-12T20:45:17.377557+0000, chain.objs.size()=1 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.QD3Ij_l2x1gHMID1m98dQXl5dCgzJZc_0 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17075075591114562728', time=2024-09-12T20:45:17.404239+0000, chain.objs.size()=1 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0M6xOYZGwJjyKav5mdrWwL1dZW6ztK8_0 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1183931340819443024', time=2024-09-12T20:45:19.283240+0000, chain.objs.size()=1 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cE9Zd6Hhutqe7S3sgi4UvbDBpvCFhc0_0 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4091563197546868300', time=2024-09-12T20:45:19.492097+0000, chain.objs.size()=1 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.v3WA2CXkmQZABcQqrg8bB2SDAC6tH1S_0 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3211781982976876573', time=2024-09-12T20:45:19.952601+0000, chain.objs.size()=1 2024-09-12T19:29:42.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.h2nKscoI_DnijvCgD6KjnS59oUfgzOM_0 2024-09-12T19:29:42.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17776324149353415261', time=2024-09-12T20:45:21.073800+0000, chain.objs.size()=1 2024-09-12T19:29:42.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cJoFKO_mQg4Dn6Zc84RLLjd2hwdJ9Mc_0 2024-09-12T19:29:42.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15863158161829938484', time=2024-09-12T20:45:22.493004+0000, chain.objs.size()=1 2024-09-12T19:29:42.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.V6xspoaPlk0j3V2jOZPDeWBxiXLcoOF_0 2024-09-12T19:29:42.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5628915884212202262', time=2024-09-12T20:45:23.723768+0000, chain.objs.size()=1 2024-09-12T19:29:42.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.095+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oOaG-sKyDHLHSDuGB52rvTUGhmxLqRw_0 2024-09-12T19:29:42.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9402543808648399939', time=2024-09-12T20:45:24.157248+0000, chain.objs.size()=1 2024-09-12T19:29:42.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2RA-ig7iYNsYB26JiPCfcp6r9qOOMFw_0 2024-09-12T19:29:42.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.538814956884703243', time=2024-09-12T20:45:24.751763+0000, chain.objs.size()=1 2024-09-12T19:29:42.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pTSR0zruPZLn_KwToiKb4le1xPXBppA_0 2024-09-12T19:29:42.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17475596898306213706', time=2024-09-12T20:45:26.202247+0000, chain.objs.size()=1 2024-09-12T19:29:42.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.C1R6poIYuMx5ivKpl9FlA9YDgqwJ509_0 2024-09-12T19:29:42.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17070790713525429274', time=2024-09-12T20:45:27.068951+0000, chain.objs.size()=1 2024-09-12T19:29:42.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.o4viJk1PAMt4thJpHr635OVgr4B6tIo_0 2024-09-12T19:29:42.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9839067621631742735', time=2024-09-12T20:45:31.287433+0000, chain.objs.size()=1 2024-09-12T19:29:42.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.roP4j8wg1ljo3lsCjr6CJOrINai0sr5_0 2024-09-12T19:29:42.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3620969528247146843', time=2024-09-12T20:45:31.659813+0000, chain.objs.size()=1 2024-09-12T19:29:42.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.JzylxhV8zwU28moiyy4BVR9GGyZyIW8_0 2024-09-12T19:29:42.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16490133864254420878', time=2024-09-12T20:45:31.661864+0000, chain.objs.size()=1 2024-09-12T19:29:42.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Zg0gusgdyas98tDc2y1qAq9IMiDDsQn_0 2024-09-12T19:29:42.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5648721638788795847', time=2024-09-12T20:45:32.764040+0000, chain.objs.size()=1 2024-09-12T19:29:42.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.IvqCPEQhQlNEKE8lVEQfYpLKb6UCHXM_0 2024-09-12T19:29:42.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16897659534086529467', time=2024-09-12T20:45:32.766599+0000, chain.objs.size()=1 2024-09-12T19:29:42.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.RYOdOCuGdGo3_qSJu_I8glXqkKfdlzb_0 2024-09-12T19:29:42.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.099+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/41300 2024-09-12T19:29:42.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T19:29:42.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2419320973679307567', time=2024-09-12T20:45:34.913795+0000, chain.objs.size()=1 2024-09-12T19:29:42.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hTblJW8wWK3Lly17eMza3L4rcxmjLNs_0 2024-09-12T19:29:42.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6488216711233240942', time=2024-09-12T20:45:36.894275+0000, chain.objs.size()=1 2024-09-12T19:29:42.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.mbJOUp8KUj0LZkY5mE9h5hlYmJN-qDo_0 2024-09-12T19:29:42.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13056502916731481552', time=2024-09-12T20:45:37.090318+0000, chain.objs.size()=1 2024-09-12T19:29:42.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WubDpmyoriTQkrbmbnRYMIEbHnSPdm4_0 2024-09-12T19:29:42.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3202056363597221080', time=2024-09-12T20:49:05.464444+0000, chain.objs.size()=1 2024-09-12T19:29:42.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.429__shadow_.lhQvEPvwX2ArtvBHOxsAixIPnAew7G__0 2024-09-12T19:29:42.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17555995149120579044', time=2024-09-12T20:50:29.877750+0000, chain.objs.size()=1 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.464__shadow_.pZ8Sxny2aMMs4WccO9AaYamrIITpsED_0 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16480257127415388228', time=2024-09-12T20:51:52.329199+0000, chain.objs.size()=1 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.503__shadow:ZaN5iQFdkxMluSElq-iCxGVc.IoNdB._.0iAzXRtuwU4n61WPRJhvnPJx8SSDQ8I_0 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12046729539742598449', time=2024-09-12T20:53:16.631121+0000, chain.objs.size()=1 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.517__shadow_.EMjC1cDA-fdy5z4U5DlPeewK04orNct_0 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7874767668323775569', time=2024-09-12T20:54:33.877560+0000, chain.objs.size()=3 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.521__multipart_mymultipart.2~G31F99OmBT0WgJS2gcMPBZI7YpKCFYp.1 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.521__multipart_mymultipart.2~G31F99OmBT0WgJS2gcMPBZI7YpKCFYp.2 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.521__multipart_mymultipart.2~G31F99OmBT0WgJS2gcMPBZI7YpKCFYp.3 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~25UB1JcpE8sNWsf4FY0e3n6rQZSMhID', time=2024-09-12T20:59:53.334500+0000, chain.objs.size()=1 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.533__multipart_mymultipart.2~25UB1JcpE8sNWsf4FY0e3n6rQZSMhID.1 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9745028370629081595', time=2024-09-12T21:02:30.800233+0000, chain.objs.size()=2 2024-09-12T19:29:42.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.558__shadow_.0sHM031w3XjpDgvVQLE1dW4y7fsHw3m_0 2024-09-12T19:29:42.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.558__shadow_.0sHM031w3XjpDgvVQLE1dW4y7fsHw3m_1 2024-09-12T19:29:42.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13856667250674499669', time=2024-09-12T21:03:20.910948+0000, chain.objs.size()=1 2024-09-12T19:29:42.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:cl0XopCe4wqlE38w4LEE7aHdkDDvVog_.HsR6FbrwxruXs_oHiWqLsC6f8iYud6D_0 2024-09-12T19:29:42.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8336545066573229342', time=2024-09-12T21:03:22.853521+0000, chain.objs.size()=1 2024-09-12T19:29:42.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:nMpbEUtjqWo-WjVpfmdB4s98zeJd.gy_.8OBJG9qXbu1xrvx-00mfgm9pqSiYt7c_0 2024-09-12T19:29:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12017752661140849848', time=2024-09-12T21:04:12.007018+0000, chain.objs.size()=1 2024-09-12T19:29:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:gWj-qrXS8LVXqbrU.OhENUCIbpsxdBH_.fnM4EBdRmC7wJ4zs4ld8eUQvIj7MbKb_0 2024-09-12T19:29:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2483108896903816861', time=2024-09-12T21:04:17.981081+0000, chain.objs.size()=1 2024-09-12T19:29:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:82YSPoO5eJaNtB4R2v.JBJlFTpqWTbG_.UKGsnSz2uAEE3AfXkvPGHDS-ZVSXs4Y_0 2024-09-12T19:29:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15413767417344117801', time=2024-09-12T21:04:20.784979+0000, chain.objs.size()=1 2024-09-12T19:29:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:lZ.WeknkboQAdUWPLCpUNmrrPN4oKnH_.keCk3Qody3Sha55HJnopPKigDe0h7ti_0 2024-09-12T19:29:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6864190907120373842', time=2024-09-12T21:04:42.517141+0000, chain.objs.size()=1 2024-09-12T19:29:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.103+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:uO0J0o3gRi-kEqg4n8UenhKkcdJ9NH6_.rYIPhEtkSZM_3V9tXwYpXM17Hi0yAoH_0 2024-09-12T19:29:42.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.107+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:42.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T19:29:42.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:42.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48986' 2024-09-12T19:29:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1811451520508812650', time=2024-09-12T20:28:32.522708+0000, chain.objs.size()=3 2024-09-12T19:29:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.158__shadow_.G2TlSgJ34p1198Xzn-5SJaah7uNj3nn_0 2024-09-12T19:29:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.158__shadow_.G2TlSgJ34p1198Xzn-5SJaah7uNj3nn_1 2024-09-12T19:29:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.158__shadow_.G2TlSgJ34p1198Xzn-5SJaah7uNj3nn_2 2024-09-12T19:29:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_P7y4CQ9YG_ptl8a717eo68EGlFe3c6V', time=2024-09-12T20:29:54.010691+0000, chain.objs.size()=3 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.d4-tgJEDQNoq9QQxh5xgJIlmfSin4If_0 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.d4-tgJEDQNoq9QQxh5xgJIlmfSin4If_1 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.d4-tgJEDQNoq9QQxh5xgJIlmfSin4If_2 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14139250721368290158', time=2024-09-12T20:30:17.313188+0000, chain.objs.size()=1 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.166__shadow_.1w84fS-edQk7LgXrGe3Due0w6bxRTFr_0 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13068294208206993575', time=2024-09-12T20:30:47.709363+0000, chain.objs.size()=1 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.177__shadow_.rcUqeFbgyTutPYXy_GAH5x4YSxHg_gc_0 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4692515214600258947', time=2024-09-12T20:30:51.759741+0000, chain.objs.size()=1 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.179__shadow_.nHjwEbDWCq6T3czZ56ezJP5j-5bx8bg_0 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11319761083694236001', time=2024-09-12T20:32:03.608828+0000, chain.objs.size()=1 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.203__shadow_.O1QvkPx8gp1w31042LjiaRuTa86LjHO_0 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1418413444936150106', time=2024-09-12T20:36:03.380562+0000, chain.objs.size()=1 2024-09-12T19:29:42.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.244__shadow_.1JXcTv-PoBaaWoJPEzwW9oEE_Ao0-JB_0 2024-09-12T19:29:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4992595075865864604', time=2024-09-12T20:36:14.666964+0000, chain.objs.size()=1 2024-09-12T19:29:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.111+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.249__shadow_.iedEW3jjP_O79SahrQUnkSELBJVpPkm_0 2024-09-12T19:29:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18444956640362656473', time=2024-09-12T20:38:22.701917+0000, chain.objs.size()=1 2024-09-12T19:29:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.IF0XMhv-N2UV_ZETJVFn0rvFJGLeSXr_0 2024-09-12T19:29:42.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2130588689493081914', time=2024-09-12T20:38:22.840333+0000, chain.objs.size()=1 2024-09-12T19:29:42.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.OXvCF8W1ymoo8QgT13hEifbhgpwMKgN_0 2024-09-12T19:29:42.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12954129830655335984', time=2024-09-12T20:38:23.378107+0000, chain.objs.size()=1 2024-09-12T19:29:42.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.s8BoXbJYmuA5HjxaFQqrGfI1e5IsL0N_0 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8511814797830859140', time=2024-09-12T20:38:24.081387+0000, chain.objs.size()=1 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Q7oaDofC2rLJ_LwwpRbiCe0UGnBNY-R_0 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11261265166378840354', time=2024-09-12T20:38:27.512362+0000, chain.objs.size()=1 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QV5mHyHn0GcbTeBAgMFthRjznL-Gevf_0 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8644923030652248348', time=2024-09-12T20:38:30.377301+0000, chain.objs.size()=1 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.UaZe8dPBZ-7dYIrTnVulScVc9OyPF27_0 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10926093487691230166', time=2024-09-12T20:38:30.724870+0000, chain.objs.size()=1 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.zUxv-4z05DwEtBy-bnhmGCdZnF5jEAP_0 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16684046787833342769', time=2024-09-12T20:38:32.099389+0000, chain.objs.size()=1 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jyAhUvTkx6nPY7zSUyG413eqLuhDtmi_0 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5007545495127957109', time=2024-09-12T20:38:33.086193+0000, chain.objs.size()=1 2024-09-12T19:29:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1A3d5G53epje44eK8DiWaXusOe88HX7_0 2024-09-12T19:29:42.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13877096804740229753', time=2024-09-12T20:38:34.033994+0000, chain.objs.size()=1 2024-09-12T19:29:42.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.JubRXNWEkx3UCOgdi_Sl-07dofaXvcu_0 2024-09-12T19:29:42.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15822855125318328101', time=2024-09-12T20:38:34.759369+0000, chain.objs.size()=1 2024-09-12T19:29:42.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.115+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nGL3DoZGJI71_YzjJfgNoRU1C4XeG1m_0 2024-09-12T19:29:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5366808067976349602', time=2024-09-12T20:38:35.533796+0000, chain.objs.size()=1 2024-09-12T19:29:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.IJ5okgV13Hrcf5FGq3WwyLzJSXZUbHK_0 2024-09-12T19:29:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3190930374204600234', time=2024-09-12T20:38:35.779154+0000, chain.objs.size()=1 2024-09-12T19:29:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.U6OW8IMZuivf6XX-HhwRVhgE4CY4yf5_0 2024-09-12T19:29:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15714279059345821350', time=2024-09-12T20:38:35.896297+0000, chain.objs.size()=1 2024-09-12T19:29:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.iDfHH0eO5_TaYjIDpK4dM7Fh4hL-C9W_0 2024-09-12T19:29:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1775669215118604158', time=2024-09-12T20:38:36.078406+0000, chain.objs.size()=1 2024-09-12T19:29:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dr8VuUSrmZFYlBdewreqVQYyHF3fyzu_0 2024-09-12T19:29:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5671889313914764416', time=2024-09-12T20:38:39.219569+0000, chain.objs.size()=1 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.UpqAvluuhSWQ6JKoYM0eC_SrkquOj_S_0 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7173047357922859843', time=2024-09-12T20:38:39.291914+0000, chain.objs.size()=1 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RM7vRZq4xD4MDdcWDargfgAgKgypQsc_0 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5718727363957792930', time=2024-09-12T20:38:39.594261+0000, chain.objs.size()=1 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.C8UzVaV-q6IosJst8X7fBsdEEuIiqEY_0 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4354175511031657885', time=2024-09-12T20:38:39.658690+0000, chain.objs.size()=1 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nMbhRoPWxBNAaE818fdkhYykQOhlo_k_0 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10306556110503763523', time=2024-09-12T20:38:40.094003+0000, chain.objs.size()=1 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.euzJRGbM-29fMCz7AAhkahD3DOcprW3_0 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6208854826229222793', time=2024-09-12T20:38:42.883113+0000, chain.objs.size()=1 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0QnozF177xy5HuggHraqka31LjrwwhR_0 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4102845999570084465', time=2024-09-12T20:38:43.263027+0000, chain.objs.size()=1 2024-09-12T19:29:42.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.iGEayM7vHoiVI-lcyifI7Pw3HvE8EDF_0 2024-09-12T19:29:42.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11715329367923279382', time=2024-09-12T20:38:43.405269+0000, chain.objs.size()=1 2024-09-12T19:29:42.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QYjF3qUNE1M-qByc96MSIG_-XaNHtSj_0 2024-09-12T19:29:42.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15805487202518629105', time=2024-09-12T20:38:45.161654+0000, chain.objs.size()=1 2024-09-12T19:29:42.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MYAO8SgiHDAW_nC_VpupQ9Mj27-dVYp_0 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17646003374267688566', time=2024-09-12T20:38:46.059219+0000, chain.objs.size()=1 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kEWVMS8bcC6XjdjTl5yvMpkYoiTmW6O_0 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15584990561957913543', time=2024-09-12T20:38:47.410666+0000, chain.objs.size()=1 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wIZ9YXTAFjJkCR3tt_1a9vNMiVHpcJb_0 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9810728902854659844', time=2024-09-12T20:38:47.478933+0000, chain.objs.size()=1 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Mt4sYN_bnUFSfCpgTPuBXqQ8OF2-W2R_0 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8710024588493960390', time=2024-09-12T20:38:48.624571+0000, chain.objs.size()=1 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0tBIxAOFFCtwQkxxoQRzSG2muyoeRpc_0 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4753768284124907565', time=2024-09-12T20:38:49.771724+0000, chain.objs.size()=1 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1wRL2rolK1NKtES51IP8LHluIBGS53__0 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17684674170847388668', time=2024-09-12T20:38:50.488571+0000, chain.objs.size()=1 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Lmd4d9nFZodKOnychgC4wZjsyLVQzf-_0 2024-09-12T19:29:42.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2412938411205047906', time=2024-09-12T20:38:54.974161+0000, chain.objs.size()=1 2024-09-12T19:29:42.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.264__shadow_.mY3c9Ytgq7ayO3GZ06lcz5HqOdZtDIF_0 2024-09-12T19:29:42.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3202652249875452679', time=2024-09-12T20:39:19.045237+0000, chain.objs.size()=1 2024-09-12T19:29:42.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.119+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.275__shadow_.SerKbaOV1KpnWRyCLCom3PtZlUXaOuH_0 2024-09-12T19:29:42.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10405913238353529213', time=2024-09-12T20:39:42.060839+0000, chain.objs.size()=1 2024-09-12T19:29:42.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.285__shadow_.rCNCm93upxLToV000ifE3Bw7dFrrfBY_0 2024-09-12T19:29:42.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14444972979011955460', time=2024-09-12T20:39:44.698933+0000, chain.objs.size()=1 2024-09-12T19:29:42.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.286__shadow_.y0tbsn3zJGeg7jApdc56TY3yMMqvt6E_0 2024-09-12T19:29:42.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15205522515978576057', time=2024-09-12T20:40:01.866918+0000, chain.objs.size()=1 2024-09-12T19:29:42.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.guUJWwqB3ZtSU4Mylws-5PD3PxT_Jzi_0 2024-09-12T19:29:42.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12075256794026968375', time=2024-09-12T20:40:26.618975+0000, chain.objs.size()=1 2024-09-12T19:29:42.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.301__shadow_.aN_3Rx0kdDMRrLt288E2UexxH3Z164P_0 2024-09-12T19:29:42.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3348954321750812217', time=2024-09-12T20:40:31.140200+0000, chain.objs.size()=1 2024-09-12T19:29:42.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.303__shadow_.53GbmstoHRrU-gMpXwq__CHo5as4A1F_0 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1569109167446071195', time=2024-09-12T20:43:03.158600+0000, chain.objs.size()=1 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.65C-QEZo77eJPcvwEVPDY_kTQzH9NO__0 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17839282920505487190', time=2024-09-12T20:43:03.533446+0000, chain.objs.size()=1 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VS-aqh1_bbdexy1564hR2uYhFuGZYpH_0 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2045071910003696722', time=2024-09-12T20:43:04.412795+0000, chain.objs.size()=1 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.CM_5kfUqHa3AuQ_K5W7JLQoUeoMca-R_0 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7749148403095084758', time=2024-09-12T20:43:07.673286+0000, chain.objs.size()=1 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.20Bx1ItKkzpWmXkN8PV0NjutI4Nz0nD_0 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7405991231087487172', time=2024-09-12T20:43:07.883816+0000, chain.objs.size()=1 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.MeRv2wu-9BBepMXHcAZSRMSjBqn0PI6_0 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12363143489172255789', time=2024-09-12T20:43:11.256009+0000, chain.objs.size()=1 2024-09-12T19:29:42.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SqENbMn4xHwpvYaf91nRXebXs1qy55X_0 2024-09-12T19:29:42.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12797533603687875568', time=2024-09-12T20:43:14.092051+0000, chain.objs.size()=1 2024-09-12T19:29:42.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.GtvI_74iC2NDKnDlrX85jiGay4AKo3F_0 2024-09-12T19:29:42.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7023148025218481957', time=2024-09-12T20:43:14.834918+0000, chain.objs.size()=1 2024-09-12T19:29:42.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.h4vBrMNab4CVMSXADnl2jf2M9JTZSDG_0 2024-09-12T19:29:42.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17052754022577107959', time=2024-09-12T20:43:14.873955+0000, chain.objs.size()=1 2024-09-12T19:29:42.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EdUwnwaRTzHyJM-IYxhSy568vDOWXfr_0 2024-09-12T19:29:42.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2672710541523052922', time=2024-09-12T20:43:16.013685+0000, chain.objs.size()=1 2024-09-12T19:29:42.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.123+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Sz1GuZKJp0QCfD0ZVQjdsIWhx0k_I7e_0 2024-09-12T19:29:42.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17208059749949762602', time=2024-09-12T20:43:17.248449+0000, chain.objs.size()=1 2024-09-12T19:29:42.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EfeOE0Blsn1pjcbMOyP8M4KdM5nlWwg_0 2024-09-12T19:29:42.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8417310168447496117', time=2024-09-12T20:43:17.568782+0000, chain.objs.size()=1 2024-09-12T19:29:42.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zZ0_iGUZoXU3hwdAo2rcgsw3sB2Z0xg_0 2024-09-12T19:29:42.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4763031155811916100', time=2024-09-12T20:43:18.471699+0000, chain.objs.size()=1 2024-09-12T19:29:42.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5CJK4qF0J3Vap0T0129Vw7dVjs09fLb_0 2024-09-12T19:29:42.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1412194775401479305', time=2024-09-12T20:43:21.144675+0000, chain.objs.size()=1 2024-09-12T19:29:42.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.h-RB4r6Me8Uh0xUuTWSTbZOvMFhAmMU_0 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8039226070545176699', time=2024-09-12T20:43:22.710884+0000, chain.objs.size()=1 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.d38boe9AAwWdl9acUl7d9b1C3bg3Mgj_0 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7866813741112963624', time=2024-09-12T20:43:23.201360+0000, chain.objs.size()=1 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Wby4b2pjfAPovVd0Y3JyLahpjY5KCXq_0 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3785042329582191393', time=2024-09-12T20:43:23.602606+0000, chain.objs.size()=1 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.GPj8v7HVcInReuheVEVjWgg1SRj7lBn_0 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.593839444012606818', time=2024-09-12T20:43:24.519485+0000, chain.objs.size()=1 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jZobRqdbUicgi2HILNPwaOtlIoD7cEI_0 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7676460905130218651', time=2024-09-12T20:43:25.430623+0000, chain.objs.size()=1 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6CMpcDdVfBm-co7Roc9BZBliOS9KCWI_0 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18008004555658955987', time=2024-09-12T20:43:26.782865+0000, chain.objs.size()=1 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.joE_ppSQPRDVcbt6fYHcUKpGDUV0Lbe_0 2024-09-12T19:29:42.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3572972981167174366', time=2024-09-12T20:43:26.816170+0000, chain.objs.size()=1 2024-09-12T19:29:42.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.A6R7kkxDTFi-qNcfMtY3nlhVJPNip5q_0 2024-09-12T19:29:42.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7124225120541163431', time=2024-09-12T20:43:27.251059+0000, chain.objs.size()=1 2024-09-12T19:29:42.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pySisoH52ASoHM3f-5L2T_72cEVDfPD_0 2024-09-12T19:29:42.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8034250301257770926', time=2024-09-12T20:43:28.672959+0000, chain.objs.size()=1 2024-09-12T19:29:42.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Mh0fF3f67c8YqINRyp-EZqU8d2i1k_0_0 2024-09-12T19:29:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5719481602624444649', time=2024-09-12T20:43:29.902723+0000, chain.objs.size()=1 2024-09-12T19:29:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nX3MRzgbfkqWUutBJYRbXihMBgJaNP6_0 2024-09-12T19:29:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1de98a5640 0 -- 172.21.15.97:0/2458095298 >> [v2:172.21.15.154:6800/2443191286,v1:172.21.15.154:6801/2443191286] conn(0x55d488493300 msgr2=0x55d488495790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:29:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2969402067983694889', time=2024-09-12T20:45:10.744133+0000, chain.objs.size()=1 2024-09-12T19:29:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.127+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DlUMlVVji5TTvGtAoK1je0aXj9lZMub_0 2024-09-12T19:29:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15044597046210140466', time=2024-09-12T20:45:10.789426+0000, chain.objs.size()=1 2024-09-12T19:29:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PI1p9a0L4D1p2EmRnPt08LXDV0AJIRb_0 2024-09-12T19:29:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10803311755613764922', time=2024-09-12T20:45:13.347690+0000, chain.objs.size()=1 2024-09-12T19:29:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ReAe2qO_JqhfwqocfRcuGEVX2IRMjeW_0 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.43558602101050542', time=2024-09-12T20:45:14.761405+0000, chain.objs.size()=1 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.vzCFiuz2e7M-xLRc0OS1RH8uD4Es-g3_0 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15823827803436058074', time=2024-09-12T20:45:15.429015+0000, chain.objs.size()=1 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qNFumK6ogczXdpei0I3mHV8YpF2Kp6J_0 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9743210779933056078', time=2024-09-12T20:45:16.038568+0000, chain.objs.size()=1 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OWe9VKI6zo7K9QjLjp5fYKw8dImGL20_0 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3773886047548163723', time=2024-09-12T20:45:17.027978+0000, chain.objs.size()=1 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.b-OMb5g7s3oyB0Lki1I5c6kX7HLeP8u_0 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18045774843021132828', time=2024-09-12T20:45:17.144046+0000, chain.objs.size()=1 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.q7Tq4sZFGsNBTkq5NC9f28HK2qvhPL1_0 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14745589257973248240', time=2024-09-12T20:45:19.172869+0000, chain.objs.size()=1 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.7e2WNM4BsnQfqs6_tbrQMsNECMMBmgz_0 2024-09-12T19:29:42.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16278589573257694604', time=2024-09-12T20:45:19.604380+0000, chain.objs.size()=1 2024-09-12T19:29:42.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ugtOh03xGr_gfOC4Xz0Nb0VUhrKBCci_0 2024-09-12T19:29:42.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15158403678103800534', time=2024-09-12T20:45:19.804141+0000, chain.objs.size()=1 2024-09-12T19:29:42.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.jAE-W3yRuVpJCqskZ-vOKgDPeZ_DmvN_0 2024-09-12T19:29:42.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15564914641086813487', time=2024-09-12T20:45:22.158362+0000, chain.objs.size()=1 2024-09-12T19:29:42.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PleO9QieHba5uoIkgycwg-SSjJwtgy-_0 2024-09-12T19:29:42.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7569286480490962235', time=2024-09-12T20:45:22.395764+0000, chain.objs.size()=1 2024-09-12T19:29:42.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nepuT7XiEFIaJ6xJ-xE-K4PCdfEgaFI_0 2024-09-12T19:29:42.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11131957139621812965', time=2024-09-12T20:45:22.648689+0000, chain.objs.size()=1 2024-09-12T19:29:42.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2eMvhc2yq_hmmz3aWQyftPHrjzVMhBk_0 2024-09-12T19:29:42.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16976689788457241621', time=2024-09-12T20:45:24.810253+0000, chain.objs.size()=1 2024-09-12T19:29:42.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1ZRKE1KHHGTRdFscoTDmSBO1UrzzgHc_0 2024-09-12T19:29:42.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7439956796191866341', time=2024-09-12T20:45:25.842741+0000, chain.objs.size()=1 2024-09-12T19:29:42.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ULG16FtP0IezmxnLDvTORHyTyrZeMTF_0 2024-09-12T19:29:42.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18246752849815837711', time=2024-09-12T20:45:26.929505+0000, chain.objs.size()=1 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hhLBqEhRBNwhcuKtIyJlcrazRbRMvBz_0 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2078443624660256930', time=2024-09-12T20:45:27.229189+0000, chain.objs.size()=1 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.LEUsLzfnxqkKWI7gGTP_Js8RwC61-o1_0 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8157836366744938214', time=2024-09-12T20:45:27.653526+0000, chain.objs.size()=1 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.131+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.heFiBFqE0PvovTtlgu8mkROwVZX3O-4_0 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.631472576963351908', time=2024-09-12T20:45:29.921013+0000, chain.objs.size()=1 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.gyh5MXhq-apLSrkKlAEXojdCEC_4Vzf_0 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13015495141438677906', time=2024-09-12T20:45:30.978801+0000, chain.objs.size()=1 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hPy_rQicL8NelFzJ4E-NdLr6_KWYFPm_0 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13840501092750871680', time=2024-09-12T20:45:31.328397+0000, chain.objs.size()=1 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.z8FITiT9st_sRgzDLLxg7OKeIW0b0WR_0 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11936225591745801007', time=2024-09-12T20:45:31.463323+0000, chain.objs.size()=1 2024-09-12T19:29:42.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dRb6zzgvUbD2gW6_dEBgzMf-jrlcGFM_0 2024-09-12T19:29:42.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.814648515824227538', time=2024-09-12T20:45:32.746613+0000, chain.objs.size()=1 2024-09-12T19:29:42.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2TRG3E92z78W9az6g00kL--K_3bwxaV_0 2024-09-12T19:29:42.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4673680293438506208', time=2024-09-12T20:45:33.563366+0000, chain.objs.size()=1 2024-09-12T19:29:42.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.i0krW-683p4RVMnFxO_UDMZbUfzo1F9_0 2024-09-12T19:29:42.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15130774551458951492', time=2024-09-12T20:45:34.456945+0000, chain.objs.size()=1 2024-09-12T19:29:42.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.AZLuEJfiEPfbJFTNFDdTWbpD2M1KAQt_0 2024-09-12T19:29:42.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11755821657207328102', time=2024-09-12T20:45:35.270165+0000, chain.objs.size()=1 2024-09-12T19:29:42.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._JyTcgmmybUEUmXn7Xyy1i5hZKQe3FU_0 2024-09-12T19:29:42.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6102467675256103401', time=2024-09-12T20:45:36.249935+0000, chain.objs.size()=1 2024-09-12T19:29:42.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4DIAP9hYKBl0pqFW-bnwaPPeuOaBhy5_0 2024-09-12T19:29:42.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9039646024342950069', time=2024-09-12T20:45:36.581885+0000, chain.objs.size()=1 2024-09-12T19:29:42.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.SHwYTh_l-0xUlnB6E3xHNNZBwsP06B7_0 2024-09-12T19:29:42.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10111696497857577059', time=2024-09-12T20:45:36.661324+0000, chain.objs.size()=1 2024-09-12T19:29:42.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1CsoCBib7YXat0X9oOdHKKAPa9c_MXe_0 2024-09-12T19:29:42.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8277925848371824247', time=2024-09-12T20:45:36.925045+0000, chain.objs.size()=1 2024-09-12T19:29:42.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.135+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.-B3oQY6q_85fCG9xhOguxKqKi_YCRSE_0 2024-09-12T19:29:42.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48986 2024-09-12T19:29:42.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T19:29:42.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6897496637678015172', time=2024-09-12T20:46:13.083248+0000, chain.objs.size()=1 2024-09-12T19:29:42.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.341__shadow_.gZ5mdnWoTmSqyPz5IJ8JA5Sjjbs7LuV_0 2024-09-12T19:29:42.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10388236045423575069', time=2024-09-12T20:47:20.379256+0000, chain.objs.size()=1 2024-09-12T19:29:42.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.377__shadow_.BTqTCj_EqlDa4rkJnu53X3sjwGclQxq_0 2024-09-12T19:29:42.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.113551442267329625', time=2024-09-12T20:49:15.058146+0000, chain.objs.size()=1 2024-09-12T19:29:42.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.434__shadow_.BM-0G54ggjFA2tK0W1DQD56lgtpKK-d_0 2024-09-12T19:29:42.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5385856689055697630', time=2024-09-12T20:52:40.416622+0000, chain.objs.size()=1 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.511__multipart_mymultipart.2~Bdy_xRUdr_8Y_YQBCcILNhxcqVl5HH-.1 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18426535095858136222', time=2024-09-12T20:53:04.493023+0000, chain.objs.size()=1 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.518__multipart_mymultipart.2~6TG15qKfyKEmRkDdbPIFC_ifs6W9ARD.1 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1657847457462712872', time=2024-09-12T20:53:15.181799+0000, chain.objs.size()=1 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.518__multipart_mymultipart.2~0rUnWZ7ETKjdQjTKRmXXDeroSsnLFJ0.1 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5010792434208077567', time=2024-09-12T20:58:29.986564+0000, chain.objs.size()=2 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~n_hsjgjfYuROf4nAtPPS5rMwHSAL1He.1 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~n_hsjgjfYuROf4nAtPPS5rMwHSAL1He.2 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Tn_OrObIKl9ZlGj6ufuAfIhfj-h-WiD', time=2024-09-12T20:59:48.405933+0000, chain.objs.size()=1 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.531__multipart_mymultipart2.2~Tn_OrObIKl9ZlGj6ufuAfIhfj-h-WiD.1 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3714942758643381404', time=2024-09-12T21:01:34.446877+0000, chain.objs.size()=1 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.552__shadow_.zwNBYjmTo2e77fSgSeiwDlKDcJY5gow_0 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2886877085193092872', time=2024-09-12T21:03:21.976165+0000, chain.objs.size()=1 2024-09-12T19:29:42.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:hwGAmvPHFCjy7wD.Ma.Rvd5IdKwVKlm_.bUAx7nlqXNYNJDZY1cva7-Xjy26uf0P_0 2024-09-12T19:29:42.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1105627036091915220', time=2024-09-12T21:03:25.722735+0000, chain.objs.size()=1 2024-09-12T19:29:42.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.139+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:79vawU-ZAY5EKQlylGLBOVpR3Y3KcDy_.aQAj7hsAbsQIQXjEu25IvY0h6ejIbPK_0 2024-09-12T19:29:42.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13120463627842456032', time=2024-09-12T21:04:03.430888+0000, chain.objs.size()=1 2024-09-12T19:29:42.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.576__shadow:5qHs91ToDeewuFnQJ4-1n7hEpju.Uri_.VnUgxaLkqakzgRjH6DmOhhu2cD6_ngJ_0 2024-09-12T19:29:42.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9495274873242541204', time=2024-09-12T21:04:28.865543+0000, chain.objs.size()=1 2024-09-12T19:29:42.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:S3XgrGI9c129e3JA1etseQ36wJK7TuY_.gc9FlQ9erIswA2meisxEoQqwCheN8ev_0 2024-09-12T19:29:42.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9817768149492475987', time=2024-09-12T21:04:41.123552+0000, chain.objs.size()=1 2024-09-12T19:29:42.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:oZ6E-gN7A08aBiT8WtWugmtbNX-pcqe_.eGf7pjLCBHcZfka_7-N918JiWI9O2g3_0 2024-09-12T19:29:42.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5548781709381058687', time=2024-09-12T21:06:12.717230+0000, chain.objs.size()=1 2024-09-12T19:29:42.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.585__shadow:b2yEKr-8LKnHEdZY4FkDs-GSMV5Af4L_.JH96A2dfbsRiqs2JlOjkzKxNye-E4a__0 2024-09-12T19:29:42.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13460614436655697744', time=2024-09-12T21:13:49.659925+0000, chain.objs.size()=1 2024-09-12T19:29:42.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.635__shadow_.M670ctsZztre5Hb-rZLBHpIuWCAmZVs_0 2024-09-12T19:29:42.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3303992564328691975', time=2024-09-12T21:16:19.669222+0000, chain.objs.size()=1 2024-09-12T19:29:42.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.668__shadow_.BJMe4usAqOvfsNNUiZ-jNniu1r6v_sY_0 2024-09-12T19:29:42.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.223306943406197089', time=2024-09-12T21:17:01.705150+0000, chain.objs.size()=1 2024-09-12T19:29:42.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.692__shadow:y8l3WQogN07H6faJ0rVgtTGy-z.29EL_.GqRMB33ZKOi_QVC6HQULUieHpRoDrG__0 2024-09-12T19:29:42.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12616881508292038083', time=2024-09-12T21:17:27.375960+0000, chain.objs.size()=1 2024-09-12T19:29:42.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.704__shadow:G2R6LZ4pkjwPEoz4ChCNLSB19gtfeP3_.SYUd5BGOuu7qqocWGZN6AFMl13R-320_0 2024-09-12T19:29:42.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.143+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:42.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T19:29:42.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:42.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:42.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45252' 2024-09-12T19:29:42.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13510473719186218704', time=2024-09-12T20:28:50.991374+0000, chain.objs.size()=5 2024-09-12T19:29:42.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.159__multipart_mymultipart-FROZEN.2~C75pIa9LaTOPckt_jh32tKunZ3rqrhr.1 2024-09-12T19:29:42.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.159__shadow_mymultipart-FROZEN.2~C75pIa9LaTOPckt_jh32tKunZ3rqrhr.1_1 2024-09-12T19:29:42.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.159__multipart_mymultipart-FROZEN.2~C75pIa9LaTOPckt_jh32tKunZ3rqrhr.2 2024-09-12T19:29:42.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.159__shadow_mymultipart-FROZEN.2~C75pIa9LaTOPckt_jh32tKunZ3rqrhr.2_1 2024-09-12T19:29:42.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.159__multipart_mymultipart-FROZEN.2~C75pIa9LaTOPckt_jh32tKunZ3rqrhr.3 2024-09-12T19:29:42.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_ip_DkSZLDUWSnM_Yfcq1vwXKXAYTLzI', time=2024-09-12T20:29:28.778642+0000, chain.objs.size()=1 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.ZSwZ0PPxqKN57SaEfhWGH_N-cWDsnlb_0 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_YoOhq__CLPjjrNx0O1w2tIhY9CsRNCm', time=2024-09-12T20:30:03.592481+0000, chain.objs.size()=1 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:98539659-fdaf-41ce-847d-239ff89323af.4641.163__shadow_.2jDe0D5tEzIR-kwdPy814yrPJTEcaKE_0 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10242520108026906863', time=2024-09-12T20:31:45.767969+0000, chain.objs.size()=1 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.197__shadow_.ryUYGU6ezG2Fq8RZcjT9Ukaj4d9CLNs_0 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5265833011137692423', time=2024-09-12T20:35:34.772559+0000, chain.objs.size()=1 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.234__shadow_.3oCrI50ugnbgDgCuxLqnlq8mqHnrg_f_0 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5349962679281909084', time=2024-09-12T20:36:03.355709+0000, chain.objs.size()=1 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.244__shadow_.Y8GqkpIwARSg1CGS0eL2yuWUYDpncgb_0 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13284163788456377857', time=2024-09-12T20:36:19.336495+0000, chain.objs.size()=1 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.251__shadow_.xoc4AgiDv2Z7pbcYwImGm8DMOttK0tp_0 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5933948278810295426', time=2024-09-12T20:36:37.380059+0000, chain.objs.size()=1 2024-09-12T19:29:42.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.147+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.259__shadow_.LlPEhabwyc9eg-O_IoA7uJV2ynqVMXs_0 2024-09-12T19:29:42.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11762386057134945085', time=2024-09-12T20:36:39.605144+0000, chain.objs.size()=1 2024-09-12T19:29:42.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.260__shadow_.lkLjq33_UBHZRKLkbYuKdGUm6XD1KGG_0 2024-09-12T19:29:42.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16272444131340970650', time=2024-09-12T20:36:41.881711+0000, chain.objs.size()=1 2024-09-12T19:29:42.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.261__shadow_.jERKcfQPQ_aW2QVQoawztpZknwEidB__0 2024-09-12T19:29:42.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16396475951349700307', time=2024-09-12T20:38:22.907247+0000, chain.objs.size()=1 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.P0Tyc0vDKbJajCLX6fRb1Z6zBxdQ6XP_0 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10637075411997218820', time=2024-09-12T20:38:22.910019+0000, chain.objs.size()=1 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.UFSjPrD6bhL35nmXfQh-uwB8dU_dKoQ_0 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5205368042066838428', time=2024-09-12T20:38:26.493673+0000, chain.objs.size()=1 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.nyAluITYbNmn421ivvNxN5uBhFmJl7t_0 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17176355253712491139', time=2024-09-12T20:38:28.385152+0000, chain.objs.size()=1 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-jkQTT2ZPQGmf2JeKfI1-NZ9FbF71xZ_0 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8308507790287233608', time=2024-09-12T20:38:28.569327+0000, chain.objs.size()=1 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.yqVIRD_bTeuTBqXOqGvlbKVqvhVDPf0_0 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13562881930134569302', time=2024-09-12T20:38:28.605287+0000, chain.objs.size()=1 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.002OogfUIK8R5HVrRd5ioxeGQhyG-yU_0 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13592246836298186373', time=2024-09-12T20:38:29.047811+0000, chain.objs.size()=1 2024-09-12T19:29:42.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.mhsugNv9VzLSmEYpxSCj4Zv4e_froYT_0 2024-09-12T19:29:42.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7906325705030152432', time=2024-09-12T20:38:32.370145+0000, chain.objs.size()=1 2024-09-12T19:29:42.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ouBiAv1WNBc37l-SkffSYCcsrqD4S-F_0 2024-09-12T19:29:42.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14168603240749294325', time=2024-09-12T20:38:32.646218+0000, chain.objs.size()=1 2024-09-12T19:29:42.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.pZ05x1uCbD9zSqQvyZ7l2l6R2eJULbB_0 2024-09-12T19:29:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.151+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15537438384261711250', time=2024-09-12T20:38:36.161462+0000, chain.objs.size()=1 2024-09-12T19:29:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WfQOEz7H8SBFr0eZMLOQr51Y8iejy5b_0 2024-09-12T19:29:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11195067719728407917', time=2024-09-12T20:38:38.836112+0000, chain.objs.size()=1 2024-09-12T19:29:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.L5V-O7svKwot_EZIHkrbrFGAQpT6ZQb_0 2024-09-12T19:29:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6291939911498024876', time=2024-09-12T20:38:39.087198+0000, chain.objs.size()=1 2024-09-12T19:29:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WozVG-jxiqLx0CwsIZDrGwVUjncEoPI_0 2024-09-12T19:29:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5011022953349220752', time=2024-09-12T20:38:39.427870+0000, chain.objs.size()=1 2024-09-12T19:29:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.FzT_USUJt_m9Ql9RfTwr13EVtgipd3y_0 2024-09-12T19:29:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15677629842382693588', time=2024-09-12T20:38:39.903763+0000, chain.objs.size()=1 2024-09-12T19:29:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9EF0lrEJB35SUqd_lsxltYZcF6x0UA5_0 2024-09-12T19:29:42.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12651734420583647270', time=2024-09-12T20:38:41.436801+0000, chain.objs.size()=1 2024-09-12T19:29:42.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EETCSNoFraEflWbD41UGeqK-lU35XX5_0 2024-09-12T19:29:42.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6428542857706817582', time=2024-09-12T20:38:41.758439+0000, chain.objs.size()=1 2024-09-12T19:29:42.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.m7wv2HOHW4AC7XGygOQ03oqCpt8X1Jm_0 2024-09-12T19:29:42.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15297651685588218229', time=2024-09-12T20:38:42.342690+0000, chain.objs.size()=1 2024-09-12T19:29:42.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.YeSUeFGIQYYAeDjHp34BwaOcYipijmG_0 2024-09-12T19:29:42.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9555916858628252342', time=2024-09-12T20:38:43.567746+0000, chain.objs.size()=1 2024-09-12T19:29:42.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.veSQi7fa56wxQIfLxAMSQmMZuKgHRst_0 2024-09-12T19:29:42.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.893031094795783545', time=2024-09-12T20:38:45.066342+0000, chain.objs.size()=1 2024-09-12T19:29:42.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.VCNWi3CAH_7a55dMGaaowZxmTzN1Tgr_0 2024-09-12T19:29:42.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5468353269005325075', time=2024-09-12T20:38:45.622932+0000, chain.objs.size()=1 2024-09-12T19:29:42.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0s_JQD7UmjfW6TWlRpNtKkLaSv9bhkr_0 2024-09-12T19:29:42.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4217341727851654950', time=2024-09-12T20:38:45.734483+0000, chain.objs.size()=1 2024-09-12T19:29:42.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-hKMHSLtEkp_xlyy5I2VtDSJ_bmb06J_0 2024-09-12T19:29:42.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15393937101804843255', time=2024-09-12T20:38:45.845518+0000, chain.objs.size()=1 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kUl6MhlBjkO8MvXbCZgtemlT0PrLVe0_0 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4846660437023046072', time=2024-09-12T20:38:48.387804+0000, chain.objs.size()=1 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vikMolRDM9wWXUFGCemfooq9IfKTOmt_0 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13444708944484572154', time=2024-09-12T20:38:49.008718+0000, chain.objs.size()=1 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.t9NhE4nIxBNQnhwnssxv8U72_xCsypG_0 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7966715470782642820', time=2024-09-12T20:38:49.853080+0000, chain.objs.size()=1 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.FOXcw9jjDfXO2jMr83q9jEV1nE5yOac_0 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2005623610884937552', time=2024-09-12T20:38:49.911642+0000, chain.objs.size()=1 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.U7zkfhL-720lerMjNnU1cuOhL77ymfd_0 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15039179280526965074', time=2024-09-12T20:39:28.213758+0000, chain.objs.size()=1 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.279__shadow_.3gO0v4w6Rrm2pM24KcyTPGlN167gdXQ_0 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9338780734151632308', time=2024-09-12T20:39:35.078989+0000, chain.objs.size()=1 2024-09-12T19:29:42.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.282__shadow_.WDdBLITjTcgCiwYSWMtvCBa1UTOczYx_0 2024-09-12T19:29:42.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9811047604806904568', time=2024-09-12T20:40:01.681023+0000, chain.objs.size()=1 2024-09-12T19:29:42.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.8A6HY4MCk-iRuG6S5Ze3gkndDOtgwsF_0 2024-09-12T19:29:42.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10237946327201814513', time=2024-09-12T20:40:01.781047+0000, chain.objs.size()=1 2024-09-12T19:29:42.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.C8s7yjHPXYN99NikYcQ38HWSNO3d7B1_0 2024-09-12T19:29:42.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2935368684815009980', time=2024-09-12T20:40:02.101954+0000, chain.objs.size()=1 2024-09-12T19:29:42.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.Yt7DWvvRbRgsbwkwU8jYystEHRL7ZiE_0 2024-09-12T19:29:42.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6337954343577266600', time=2024-09-12T20:43:03.775730+0000, chain.objs.size()=1 2024-09-12T19:29:42.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.niKCGe1P1c69GnZpJybc5I2gnThZTzD_0 2024-09-12T19:29:42.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16133497205567597620', time=2024-09-12T20:43:03.968559+0000, chain.objs.size()=1 2024-09-12T19:29:42.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.155+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KUl45YupeZeJTgF7gi6W4mCFfvrP1jU_0 2024-09-12T19:29:42.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16170726292750595313', time=2024-09-12T20:43:07.539993+0000, chain.objs.size()=1 2024-09-12T19:29:42.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pbCX4WCIwDzegKgAiydaFZnzHs8651c_0 2024-09-12T19:29:42.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7139271144375939849', time=2024-09-12T20:43:08.047372+0000, chain.objs.size()=1 2024-09-12T19:29:42.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EqISRNYRVxC8wRUa5k4YQn-uj5Q7r-c_0 2024-09-12T19:29:42.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4909854941447344264', time=2024-09-12T20:43:09.094627+0000, chain.objs.size()=1 2024-09-12T19:29:42.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9KhZcwTXIvfZy3PWKn6ZyxXnELrqJdP_0 2024-09-12T19:29:42.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10324717493918387830', time=2024-09-12T20:43:10.854639+0000, chain.objs.size()=1 2024-09-12T19:29:42.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6msbrLo_yAw0S3v-R68KHVv_sVMDROP_0 2024-09-12T19:29:42.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1022396182787364403', time=2024-09-12T20:43:11.087759+0000, chain.objs.size()=1 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.MfFavhtZ-sfHAVmPTBdZMB-D6Im2Wzr_0 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5517788160348790110', time=2024-09-12T20:43:11.178371+0000, chain.objs.size()=1 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9H50RwmoWWvj7GmVGDlghUopP47kzgH_0 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15821121381630006322', time=2024-09-12T20:43:11.474722+0000, chain.objs.size()=1 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.j4SdZi6GUSgx65EMWdc1er7klZRcX7c_0 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1959189542184659651', time=2024-09-12T20:43:12.709145+0000, chain.objs.size()=1 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.aLnnv90-ZFfZgEwStVYMHyvT45Q4uwC_0 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9839796844065617457', time=2024-09-12T20:43:13.706707+0000, chain.objs.size()=1 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.sH1KGou7lsetM8Gmucb4V_k0aQbon1o_0 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3280607968034431811', time=2024-09-12T20:43:14.503910+0000, chain.objs.size()=1 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.g9IErinP7yPc7fD97YEe-4DXyMw_Gw9_0 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16299444218595611485', time=2024-09-12T20:43:14.702313+0000, chain.objs.size()=1 2024-09-12T19:29:42.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ZmRvRRX7uQIlyldplcrO6EIZcOmBuTT_0 2024-09-12T19:29:42.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7752354264786523426', time=2024-09-12T20:43:15.852304+0000, chain.objs.size()=1 2024-09-12T19:29:42.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.159+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eBIcRsChzcEZxEWF5nnehSdQVcgDkT4_0 2024-09-12T19:29:42.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11040253694797008031', time=2024-09-12T20:43:16.245386+0000, chain.objs.size()=1 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.apUt8nJ0FlIf2QQ-i-P2FCcdhC3IXAh_0 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14220610685163089257', time=2024-09-12T20:43:21.184497+0000, chain.objs.size()=1 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fH7dvVH25euJ1SEHmsYCZ5b9pA4rGKC_0 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9452113451350306624', time=2024-09-12T20:43:21.580635+0000, chain.objs.size()=1 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-yBnEd9Fu-6UgxW6mK_fmGi3Qiqr2IE_0 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.955788651597893927', time=2024-09-12T20:43:21.751615+0000, chain.objs.size()=1 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xlyfp7KmxLEkvSU12TxuB1rVRj94ZqR_0 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8153220428338453021', time=2024-09-12T20:43:22.418573+0000, chain.objs.size()=1 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Z099UTqMq76iUs4lOBUQE8KnrFusk_N_0 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12532945357856159417', time=2024-09-12T20:43:23.075280+0000, chain.objs.size()=1 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3LbvjGKLUygHP5aciHG0YXkHMKqKymL_0 2024-09-12T19:29:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12191303475053302185', time=2024-09-12T20:43:24.406540+0000, chain.objs.size()=1 2024-09-12T19:29:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.RbRq5XFmG7X9Am50vuMfaJn8uNTHD2b_0 2024-09-12T19:29:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11288371469005886569', time=2024-09-12T20:43:24.541170+0000, chain.objs.size()=1 2024-09-12T19:29:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.hfJEUfXeRR288FTl5ieE-XTy5qhfJrx_0 2024-09-12T19:29:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1867982266602034908', time=2024-09-12T20:43:24.542821+0000, chain.objs.size()=1 2024-09-12T19:29:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.veVlfwHJEKIpB7HfaTZ1MoFyPzDWiHq_0 2024-09-12T19:29:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7753282712984940217', time=2024-09-12T20:43:24.713173+0000, chain.objs.size()=1 2024-09-12T19:29:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.8PCPAp80nAIOvJKp2GutrZ1tSpziS27_0 2024-09-12T19:29:42.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15802787538896486138', time=2024-09-12T20:43:24.820694+0000, chain.objs.size()=1 2024-09-12T19:29:42.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SsiQl40Jm53AlzQ2qqBXpATwLGU0QN4_0 2024-09-12T19:29:42.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18333007559853434540', time=2024-09-12T20:43:24.925294+0000, chain.objs.size()=1 2024-09-12T19:29:42.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zK0Lv_N42sMlyD9cTBXw2KnqD3COOV-_0 2024-09-12T19:29:42.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.696716894192678031', time=2024-09-12T20:43:26.562637+0000, chain.objs.size()=1 2024-09-12T19:29:42.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.faQxQ5X3_58Dn6EhfaSj4aG-KP5q_Jb_0 2024-09-12T19:29:42.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17729069739775041848', time=2024-09-12T20:43:28.425962+0000, chain.objs.size()=1 2024-09-12T19:29:42.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zARqHrmj3bqbBmJYTapKA6pGS89NIpO_0 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15700381295413346250', time=2024-09-12T20:43:28.764463+0000, chain.objs.size()=1 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Vh0R8pudzDs4LTbkiKgHAqpEUzFXFe7_0 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3448409893168843880', time=2024-09-12T20:43:29.020064+0000, chain.objs.size()=1 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nleu81z7i18bfk2ZSdaqkQ9VKddGii3_0 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4381799659770473679', time=2024-09-12T20:45:11.698785+0000, chain.objs.size()=1 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.rsARk6lQjuhW253a7InH2Fkeo68qmtQ_0 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5730385149625142849', time=2024-09-12T20:45:12.275532+0000, chain.objs.size()=1 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lnxAUrS0MGVUCe2WsoMerU8yyD2ElyW_0 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2836282365362386208', time=2024-09-12T20:45:14.754254+0000, chain.objs.size()=1 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.QVhFga495D027120vrSfKb7wKE-cLcz_0 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11749474468360547063', time=2024-09-12T20:45:15.074896+0000, chain.objs.size()=1 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2EyjDBaNKNWPBwM9NAq6feTUxU7Ldq9_0 2024-09-12T19:29:42.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18140076771984237634', time=2024-09-12T20:45:15.347875+0000, chain.objs.size()=1 2024-09-12T19:29:42.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DNIkE-j1Gl0ntnBHq4h2cjkXKFd41UW_0 2024-09-12T19:29:42.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2250069548016549605', time=2024-09-12T20:45:16.599562+0000, chain.objs.size()=1 2024-09-12T19:29:42.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wwgZEk_0VGgJvs4Hcbzb35b7FUrc3p8_0 2024-09-12T19:29:42.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.736489485207361084', time=2024-09-12T20:45:18.516114+0000, chain.objs.size()=1 2024-09-12T19:29:42.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.163+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ELh2Y1hdlPrjQAMVffSDLzY2gnFZOwu_0 2024-09-12T19:29:42.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4162497012281689717', time=2024-09-12T20:45:19.610935+0000, chain.objs.size()=1 2024-09-12T19:29:42.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xw7Er90jrz6MEeRVPOCWcHcgzZhSVYi_0 2024-09-12T19:29:42.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10140505057521303167', time=2024-09-12T20:45:19.731264+0000, chain.objs.size()=1 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FGonukJ-B9dIWGz-y-X--RW7bgsc2W7_0 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2650895267692447851', time=2024-09-12T20:45:21.132559+0000, chain.objs.size()=1 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.n36OwkioeNbEF0-wBRPcDFIbpoaWnBH_0 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13383619291154395024', time=2024-09-12T20:45:22.709841+0000, chain.objs.size()=1 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6UW3fbZr-zJzjLoT20_3Enrny3-UTtn_0 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14168820121115060507', time=2024-09-12T20:45:23.188398+0000, chain.objs.size()=1 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.VUTPsdoB6F7DxwGcD5pbqGZN01uqT6e_0 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9757125541331633479', time=2024-09-12T20:45:23.828454+0000, chain.objs.size()=1 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.AeTfoFN3_-IiFWSwO0S_YuhXR1t-XxK_0 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8738760397284823411', time=2024-09-12T20:45:24.506063+0000, chain.objs.size()=1 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.vg1eD9HXWuajiMZwr-roS78qRq41U8j_0 2024-09-12T19:29:42.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16745839575761891577', time=2024-09-12T20:45:24.836892+0000, chain.objs.size()=1 2024-09-12T19:29:42.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.I-HhUc9iqt5CLPrl9qvgTdknLXmSEXF_0 2024-09-12T19:29:42.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16101446132822184687', time=2024-09-12T20:45:27.519617+0000, chain.objs.size()=1 2024-09-12T19:29:42.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Hy6uG1wjb4PD5gcmUDLSno-lttJTPXT_0 2024-09-12T19:29:42.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5290002770105127506', time=2024-09-12T20:45:28.411212+0000, chain.objs.size()=1 2024-09-12T19:29:42.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.gtPQb8oxd2bPiPdIrt2UlPeZSSuh4yF_0 2024-09-12T19:29:42.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17555631079073764242', time=2024-09-12T20:45:29.555529+0000, chain.objs.size()=1 2024-09-12T19:29:42.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xIg0foasAfPdZfAfjV62l4IKeiyp2nk_0 2024-09-12T19:29:42.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12082368190237503959', time=2024-09-12T20:45:30.241788+0000, chain.objs.size()=1 2024-09-12T19:29:42.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.NPQ86zO-gTbRB-tr9TkffpGesWMForj_0 2024-09-12T19:29:42.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9144028792883141551', time=2024-09-12T20:45:30.802687+0000, chain.objs.size()=1 2024-09-12T19:29:42.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kaARv2Ar6SV3uKUHwqjDZN9nLq2v-G2_0 2024-09-12T19:29:42.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12938160467525737268', time=2024-09-12T20:45:31.418915+0000, chain.objs.size()=1 2024-09-12T19:29:42.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FiPl2PWVVrYA37WofQOHMzu-Ww_miJT_0 2024-09-12T19:29:42.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17680536089946737741', time=2024-09-12T20:45:31.958327+0000, chain.objs.size()=1 2024-09-12T19:29:42.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3RlDCvd5FiTrBseChaPQo9bqXxiqxaA_0 2024-09-12T19:29:42.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10408863437968537778', time=2024-09-12T20:45:32.015259+0000, chain.objs.size()=1 2024-09-12T19:29:42.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0_VemTU-n-f34YMlA89oLMSFxPfmwTt_0 2024-09-12T19:29:42.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.64771156306999374', time=2024-09-12T20:45:33.377142+0000, chain.objs.size()=1 2024-09-12T19:29:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.tmwfAQuqu8G9R4a0tDWdpS9t1YcF_ZC_0 2024-09-12T19:29:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13338619445664240374', time=2024-09-12T20:45:33.661218+0000, chain.objs.size()=1 2024-09-12T19:29:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.g59l7rrf92hW0QSPtdb_pf26n-_3IWD_0 2024-09-12T19:29:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7868332537185926921', time=2024-09-12T20:45:34.040620+0000, chain.objs.size()=1 2024-09-12T19:29:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cpzJPlsjJ--4u2MMH1YX2QBrERepxAX_0 2024-09-12T19:29:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11994998375557116485', time=2024-09-12T20:45:34.165653+0000, chain.objs.size()=1 2024-09-12T19:29:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DuLnm0Apwp9-2IDFuC9eXKB6xVwcKS3_0 2024-09-12T19:29:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9025997870830628518', time=2024-09-12T20:45:37.223326+0000, chain.objs.size()=1 2024-09-12T19:29:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.167+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.PnUwp0YCqnVRqEv8w4m5wt2BqmDGcHI_0 2024-09-12T19:29:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.171+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2987985461007372744', time=2024-09-12T20:47:13.760931+0000, chain.objs.size()=1 2024-09-12T19:29:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.171+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.374__shadow_.KOmc3-CyMM0Kl-CUXn8X0qNup4diMLZ_0 2024-09-12T19:29:42.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.171+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45252 2024-09-12T19:29:42.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T19:29:42.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16896562670312586604', time=2024-09-12T20:49:54.684592+0000, chain.objs.size()=1 2024-09-12T19:29:42.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.451__shadow_.zo20YYf-Dm_oJoOw7xBLHeXETzoOCKX_0 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2996710426780880227', time=2024-09-12T20:50:36.264983+0000, chain.objs.size()=1 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.466__shadow_.Zln-q-MkuM5s8NstEa8gN_fBjvoLfBI_0 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14225880346330006245', time=2024-09-12T20:51:07.097311+0000, chain.objs.size()=1 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.485__shadow_.lEHSESz_o_LZVelpBt6Gf-MgPZS23ES_0 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15031622892157527936', time=2024-09-12T20:56:49.547780+0000, chain.objs.size()=6 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~hwxEizXDMAu5zYI2GqjJ0N5KdWzaxmD.1 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~hwxEizXDMAu5zYI2GqjJ0N5KdWzaxmD.2 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.kDZbMic1r8V7n8wA4f9iW5QKj_moNfZz.3 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~hwxEizXDMAu5zYI2GqjJ0N5KdWzaxmD.4 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~hwxEizXDMAu5zYI2GqjJ0N5KdWzaxmD.5 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~hwxEizXDMAu5zYI2GqjJ0N5KdWzaxmD.6 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3820813152287477694', time=2024-09-12T20:58:23.970391+0000, chain.objs.size()=3 2024-09-12T19:29:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~YfvMqlc918kaIlGKIJfxXdo3EQxQSWf.1 2024-09-12T19:29:42.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~YfvMqlc918kaIlGKIJfxXdo3EQxQSWf.2 2024-09-12T19:29:42.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~YfvMqlc918kaIlGKIJfxXdo3EQxQSWf.3 2024-09-12T19:29:42.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7262075167508107233', time=2024-09-12T21:02:05.750691+0000, chain.objs.size()=1 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.555__shadow_.XvVZhOxprMo-gB7vv2xGDOFEIANmwWB_0 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11402826242306317891', time=2024-09-12T21:03:44.728008+0000, chain.objs.size()=1 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.574__shadow_.ataBd_NO1NtWVlbbN_UncgyEdYhNghB_0 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2324735252531322005', time=2024-09-12T21:04:22.172912+0000, chain.objs.size()=1 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:lcgPjDAEU7VufBQOWIyb9dIy4G9Z6lW_.4L2ep4sEK_ynP1Fdxqt8Nu4A8-aWeto_0 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3701276450162246997', time=2024-09-12T21:06:20.909147+0000, chain.objs.size()=1 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.587__shadow:Au6ccS-aSAuLU.Lls1IVnC.0dgQrYkx_.foCAgoUIj7mYOpr39RI51H6Uwf6F_RN_0 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.621465153984235137', time=2024-09-12T21:06:53.353168+0000, chain.objs.size()=1 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.604__shadow_.N-SXfs8JqYQlBz1PyRPwgiF4j_H039e_0 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7607915198946786255', time=2024-09-12T21:13:29.851664+0000, chain.objs.size()=1 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.626__shadow_.K-5vGaqgI4O_BIyG_zTu2y00CVZWZq__0 2024-09-12T19:29:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10160023783629833325', time=2024-09-12T21:14:59.583979+0000, chain.objs.size()=2 2024-09-12T19:29:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.654__shadow_.qXa4rGKDcn-KQjhqLCQTwSIzwGMRSc3_0 2024-09-12T19:29:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.654__shadow_.qXa4rGKDcn-KQjhqLCQTwSIzwGMRSc3_1 2024-09-12T19:29:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5657358262836151463', time=2024-09-12T21:16:02.463570+0000, chain.objs.size()=6 2024-09-12T19:29:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.660__multipart_bar.2~iNdEDNN7uu0DF5jPV-WmGl3sKGHW9qR.1 2024-09-12T19:29:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.660__multipart_bar.2~iNdEDNN7uu0DF5jPV-WmGl3sKGHW9qR.2 2024-09-12T19:29:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.660__multipart_bar.2~iNdEDNN7uu0DF5jPV-WmGl3sKGHW9qR.3 2024-09-12T19:29:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.175+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.660__multipart_bar.2~iNdEDNN7uu0DF5jPV-WmGl3sKGHW9qR.4 2024-09-12T19:29:42.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.179+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.660__multipart_bar.2~iNdEDNN7uu0DF5jPV-WmGl3sKGHW9qR.5 2024-09-12T19:29:42.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.179+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.660__multipart_bar.2~iNdEDNN7uu0DF5jPV-WmGl3sKGHW9qR.6 2024-09-12T19:29:42.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.179+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7828587279557009652', time=2024-09-12T21:17:13.864030+0000, chain.objs.size()=1 2024-09-12T19:29:42.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.179+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.698__shadow:UjzEupMGD0akj7-Es9nEHQi853hRIhK_.jWWxNeuYees66KqNUcbWMTVX0_AIurO_0 2024-09-12T19:29:42.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.183+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:42.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.183+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T19:29:42.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:42.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:42.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53716' 2024-09-12T19:29:42.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9772542079862084152', time=2024-09-12T20:28:51.141969+0000, chain.objs.size()=5 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.159__multipart_mymultipart-STANDARD.2~mUMyu-SsrAzZIYeu7OglAmJu4QYs4wC.1 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.159__shadow_mymultipart-STANDARD.2~mUMyu-SsrAzZIYeu7OglAmJu4QYs4wC.1_1 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.159__multipart_mymultipart-STANDARD.2~mUMyu-SsrAzZIYeu7OglAmJu4QYs4wC.2 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.159__shadow_mymultipart-STANDARD.2~mUMyu-SsrAzZIYeu7OglAmJu4QYs4wC.2_1 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.159__multipart_mymultipart-STANDARD.2~mUMyu-SsrAzZIYeu7OglAmJu4QYs4wC.3 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Ls1KsLp84ZXKAjmUga3EtZ4bfa7DCCy', time=2024-09-12T20:29:40.604555+0000, chain.objs.size()=3 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.jrgLkb9fnVPHD_v4tAEUkjB1enADJAl_0 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.jrgLkb9fnVPHD_v4tAEUkjB1enADJAl_1 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.jrgLkb9fnVPHD_v4tAEUkjB1enADJAl_2 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6334091271584643659', time=2024-09-12T20:36:14.676723+0000, chain.objs.size()=1 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.249__shadow_._uUQkswsx8fAcxifJLJLmjyjWVyEyNe_0 2024-09-12T19:29:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5748168184262423551', time=2024-09-12T20:36:41.903710+0000, chain.objs.size()=1 2024-09-12T19:29:42.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.261__shadow_.xal8hDivrKMQa238wvLUuTMtI762tPf_0 2024-09-12T19:29:42.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16779829695386450348', time=2024-09-12T20:38:22.428456+0000, chain.objs.size()=1 2024-09-12T19:29:42.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WIssmTwj0117wTpJjaVlkA19LpYek7O_0 2024-09-12T19:29:42.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10629318238777910735', time=2024-09-12T20:38:22.520274+0000, chain.objs.size()=1 2024-09-12T19:29:42.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.187+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rYtfsq1KMpVEladIgepfV_k5zc-NahF_0 2024-09-12T19:29:42.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15891769308219504855', time=2024-09-12T20:38:26.666837+0000, chain.objs.size()=1 2024-09-12T19:29:42.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QOjwKHgRd-bBYibyI4oi3HtZdRm5xyS_0 2024-09-12T19:29:42.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11818244588341317959', time=2024-09-12T20:38:27.012056+0000, chain.objs.size()=1 2024-09-12T19:29:42.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._p8R2fuSL3T82dGP2_hypOcYMngpkej_0 2024-09-12T19:29:42.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10695751884708184542', time=2024-09-12T20:38:27.361249+0000, chain.objs.size()=1 2024-09-12T19:29:42.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QvSiw7izjoQv9iz9xUzpwXMhej0t3Ua_0 2024-09-12T19:29:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11426835424074863546', time=2024-09-12T20:38:27.363059+0000, chain.objs.size()=1 2024-09-12T19:29:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4x-tu-db89ZBSeE1G2zc7JIUlV5i9tm_0 2024-09-12T19:29:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7507668679489359291', time=2024-09-12T20:38:29.280312+0000, chain.objs.size()=1 2024-09-12T19:29:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4Bxbkz939Sy9Gjaqjg_wGr2DFHfptmO_0 2024-09-12T19:29:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3094933438166344863', time=2024-09-12T20:38:33.146613+0000, chain.objs.size()=1 2024-09-12T19:29:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.6Has3sX2O57b5x8bRCzfr0Mrwscg2bP_0 2024-09-12T19:29:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11911625563882603750', time=2024-09-12T20:38:35.957696+0000, chain.objs.size()=1 2024-09-12T19:29:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kB6FqwxFkYYjFiEe5T5nfC_HxeK-PS1_0 2024-09-12T19:29:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1038252374790573666', time=2024-09-12T20:38:36.069687+0000, chain.objs.size()=1 2024-09-12T19:29:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CuU88LTx1KBZ7WCZuiHgf03ZJrU8E4m_0 2024-09-12T19:29:42.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4488165617061622414', time=2024-09-12T20:38:36.293925+0000, chain.objs.size()=1 2024-09-12T19:29:42.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MJixc1aDzcsjajgyn4N_Ok80Gg-Ctph_0 2024-09-12T19:29:42.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1059047345385902583', time=2024-09-12T20:38:36.382480+0000, chain.objs.size()=1 2024-09-12T19:29:42.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Ehg6Jyiu3BjNtVNTfK1TEMbXhpOFYli_0 2024-09-12T19:29:42.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2753389075506558814', time=2024-09-12T20:38:36.461382+0000, chain.objs.size()=1 2024-09-12T19:29:42.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Tg2MQ5pkiFa6iJbplr8VetMOSK6wqSk_0 2024-09-12T19:29:42.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12023110919586472610', time=2024-09-12T20:38:36.463123+0000, chain.objs.size()=1 2024-09-12T19:29:42.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.XlBRlITJpWk2JPKIK_6FmRZRIJ_YDAe_0 2024-09-12T19:29:42.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4514350175986682910', time=2024-09-12T20:38:37.804297+0000, chain.objs.size()=1 2024-09-12T19:29:42.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.pzM7v3TnQXiHy_ExLUdUt9L_iE-Rtih_0 2024-09-12T19:29:42.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18295955806815361034', time=2024-09-12T20:38:39.743601+0000, chain.objs.size()=1 2024-09-12T19:29:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.phUv70Rc3K9B7YKd_GNhlk_SPY17CbV_0 2024-09-12T19:29:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15208666070091888189', time=2024-09-12T20:38:40.210935+0000, chain.objs.size()=1 2024-09-12T19:29:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.H9lQ6af8gyAIq3MHpDU3HaOTNHO3OfM_0 2024-09-12T19:29:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17451566445545697892', time=2024-09-12T20:38:41.446641+0000, chain.objs.size()=1 2024-09-12T19:29:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.LSSYw-XdacXXlksxBhFEZEGoFJD8Ny-_0 2024-09-12T19:29:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17783072976619952690', time=2024-09-12T20:38:41.709421+0000, chain.objs.size()=1 2024-09-12T19:29:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.VSGh4n1Vsw_MTN-cZOc65xoybmGG-nJ_0 2024-09-12T19:29:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.830525875739418828', time=2024-09-12T20:38:42.840736+0000, chain.objs.size()=1 2024-09-12T19:29:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.zmkRpZkWUEHuJJl0l_mqt3_Fbz2I_4v_0 2024-09-12T19:29:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5979939522179645656', time=2024-09-12T20:38:43.250761+0000, chain.objs.size()=1 2024-09-12T19:29:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Arqy6_y0bUf_8dsb1P_-sffWKnBrLWs_0 2024-09-12T19:29:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2025855116016373811', time=2024-09-12T20:38:43.331323+0000, chain.objs.size()=1 2024-09-12T19:29:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.191+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1NfQ8SveAik1w3rmFyvovhGS0wbcsGe_0 2024-09-12T19:29:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8800627733544097661', time=2024-09-12T20:38:43.763272+0000, chain.objs.size()=1 2024-09-12T19:29:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.YPN6x8CxMHWbbhmLxtTXW61pSV0V3xZ_0 2024-09-12T19:29:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17271747915335728687', time=2024-09-12T20:38:43.882447+0000, chain.objs.size()=1 2024-09-12T19:29:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.H7V9uxJgxR055BhXE0WwdsAQ0GQkAQX_0 2024-09-12T19:29:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18433025658277677706', time=2024-09-12T20:38:44.026386+0000, chain.objs.size()=1 2024-09-12T19:29:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.W5XKRKGTKQtWPMcG_Nb7bZ-bZ8xyGTI_0 2024-09-12T19:29:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9695046946862779001', time=2024-09-12T20:38:46.188493+0000, chain.objs.size()=1 2024-09-12T19:29:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8hCZZNagkRMcYCWIgI_VfbabUwVJ-nS_0 2024-09-12T19:29:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4526108653655273093', time=2024-09-12T20:38:46.886526+0000, chain.objs.size()=1 2024-09-12T19:29:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZhAOTB1e_RYnCwZ4D0Us9O9AKz_hJJN_0 2024-09-12T19:29:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12754290482288407056', time=2024-09-12T20:38:47.578562+0000, chain.objs.size()=1 2024-09-12T19:29:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kJdXTxyLDHynmKkkYquCNz-1InRxGZU_0 2024-09-12T19:29:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13301803453815915826', time=2024-09-12T20:38:48.296984+0000, chain.objs.size()=1 2024-09-12T19:29:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.-vVN0HWy38RsuLaZPxgNCQcOBjkKWnl_0 2024-09-12T19:29:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13844894859350474499', time=2024-09-12T20:38:48.683730+0000, chain.objs.size()=1 2024-09-12T19:29:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.PatQqVZw0FSewdckeSkWO-n64PskvZj_0 2024-09-12T19:29:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7291322227436848670', time=2024-09-12T20:38:49.661483+0000, chain.objs.size()=1 2024-09-12T19:29:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._qPSftcaASFV_SdpN93S_hNfd_NSVqO_0 2024-09-12T19:29:42.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17561264131677352884', time=2024-09-12T20:38:57.282717+0000, chain.objs.size()=1 2024-09-12T19:29:42.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.265__shadow_.NpUoFnhb4-HJLb_xHkhFIda4Nr7dLwW_0 2024-09-12T19:29:42.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1596566822622249546', time=2024-09-12T20:38:59.439216+0000, chain.objs.size()=1 2024-09-12T19:29:42.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.266__shadow_.1MdBKrV0x7s_I_1PAZA-Am6mBR_Li_C_0 2024-09-12T19:29:42.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3415656997947852858', time=2024-09-12T20:39:35.074768+0000, chain.objs.size()=1 2024-09-12T19:29:42.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.282__shadow_.tR5Z054kD_g8d7uqIntVTFH5_xUPPgb_0 2024-09-12T19:29:42.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12878629528006960605', time=2024-09-12T20:40:07.592203+0000, chain.objs.size()=1 2024-09-12T19:29:42.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.zdBXPuymMDT-8NV8bqmRQ9pmdYr81sS_0 2024-09-12T19:29:42.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.746433969243184525', time=2024-09-12T20:40:16.996919+0000, chain.objs.size()=1 2024-09-12T19:29:42.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.297__shadow_.U70UWOj9VWYz_0l11UGJIn6pfZXXMp6_0 2024-09-12T19:29:42.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15618421867604560854', time=2024-09-12T20:40:17.013682+0000, chain.objs.size()=1 2024-09-12T19:29:42.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.297__shadow_.Tz3C5veatOQb78TtcNxeEKXT5N33Vsg_0 2024-09-12T19:29:42.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16791707050090116799', time=2024-09-12T20:40:19.456588+0000, chain.objs.size()=1 2024-09-12T19:29:42.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.298__shadow_.b0mQuI91DWxN60HNvPtoMNq83OFpoUb_0 2024-09-12T19:29:42.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10001253470153630321', time=2024-09-12T20:43:04.196148+0000, chain.objs.size()=1 2024-09-12T19:29:42.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.aVj1iZxZVvEY5vqK6YEDK6CqSmOVh3v_0 2024-09-12T19:29:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10885530326597231540', time=2024-09-12T20:43:04.360117+0000, chain.objs.size()=1 2024-09-12T19:29:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.195+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AUdskElpPTyKgMK0ax_VMjGKQeoQXnY_0 2024-09-12T19:29:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4001734600075166769', time=2024-09-12T20:43:04.960218+0000, chain.objs.size()=1 2024-09-12T19:29:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.RmldstN4W1BLyl3LuxxMoS8sS_i0PAO_0 2024-09-12T19:29:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1084084466901335260', time=2024-09-12T20:43:05.246932+0000, chain.objs.size()=1 2024-09-12T19:29:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.k9CX4dCz0Ze1gQZkNW3CxUyJtVU4x9Y_0 2024-09-12T19:29:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16936733510991294407', time=2024-09-12T20:43:06.764059+0000, chain.objs.size()=1 2024-09-12T19:29:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tkrdmkga_MpwQOso9e3GF8NPZbPxehG_0 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10867492426606155186', time=2024-09-12T20:43:06.814862+0000, chain.objs.size()=1 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-p8L472iNK2_EMm9gN-1wPQRCOQsIep_0 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6319178654773008507', time=2024-09-12T20:43:07.851470+0000, chain.objs.size()=1 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-XTfRta5wnVloZmVkM1qRth6mHkfTRq_0 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12457509692823918885', time=2024-09-12T20:43:10.012965+0000, chain.objs.size()=1 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jzIidY_x1a-C-Gsn0slXkYomj6w-Jle_0 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3109821850500357446', time=2024-09-12T20:43:11.824848+0000, chain.objs.size()=1 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.z3tyonJfIwH4wMCAjhgWEEFJwaeUHty_0 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13266030088470093173', time=2024-09-12T20:43:13.764456+0000, chain.objs.size()=1 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.X4e5oPf28R7z0onW_sdU1gh3G4Viqji_0 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11817260513438683915', time=2024-09-12T20:43:14.089444+0000, chain.objs.size()=1 2024-09-12T19:29:42.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ETXwqmMMhxdfsjUGam0V8bcPyv0mWDV_0 2024-09-12T19:29:42.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5293526691646175451', time=2024-09-12T20:43:14.409441+0000, chain.objs.size()=1 2024-09-12T19:29:42.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.UB1MwjgYpk2s-3A0D1CEJlxuSQKL0GS_0 2024-09-12T19:29:42.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7743843941683310099', time=2024-09-12T20:43:14.916611+0000, chain.objs.size()=1 2024-09-12T19:29:42.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Z7e2VHuw_XdLovPc93TelrfvepxwxMv_0 2024-09-12T19:29:42.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16983130932596341863', time=2024-09-12T20:43:14.918795+0000, chain.objs.size()=1 2024-09-12T19:29:42.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HtTvKNzcPu_H5V7fsu7pRqpOnCvSNSQ_0 2024-09-12T19:29:42.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16293793620913305027', time=2024-09-12T20:43:16.286077+0000, chain.objs.size()=1 2024-09-12T19:29:42.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.95ikSGUwPoNXzzJuUeGmF_UzSs38UTl_0 2024-09-12T19:29:42.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9282293000344983187', time=2024-09-12T20:43:16.344408+0000, chain.objs.size()=1 2024-09-12T19:29:42.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.gCBPbs43pVS7X31OqGan-UdawqzzUjA_0 2024-09-12T19:29:42.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8851109520620965155', time=2024-09-12T20:43:17.292332+0000, chain.objs.size()=1 2024-09-12T19:29:42.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5Pe0egVkoa6qezkBxLMCcXYSO2WNG1N_0 2024-09-12T19:29:42.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5253845532610796132', time=2024-09-12T20:43:18.535650+0000, chain.objs.size()=1 2024-09-12T19:29:42.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VZmJaNXWyierM0ep_J8GXWv8omOI-sA_0 2024-09-12T19:29:42.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9607288982212997236', time=2024-09-12T20:43:18.697142+0000, chain.objs.size()=1 2024-09-12T19:29:42.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EWQefI9_LuTs-02p0eQyqvNhfgIGVu-_0 2024-09-12T19:29:42.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.642903028232730441', time=2024-09-12T20:43:19.161367+0000, chain.objs.size()=1 2024-09-12T19:29:42.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4d3fCI2U9k5KshpLnLuMp1pBox5UD9m_0 2024-09-12T19:29:42.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9685598217601565128', time=2024-09-12T20:43:19.606451+0000, chain.objs.size()=1 2024-09-12T19:29:42.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.rEDLIPKfRs36nC3-inAuX1LXYF2JKfh_0 2024-09-12T19:29:42.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11385020332494195027', time=2024-09-12T20:43:19.640200+0000, chain.objs.size()=1 2024-09-12T19:29:42.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.199+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.8QMv0-o1CTZBh6oTQ4L0uCAdk4ogHiD_0 2024-09-12T19:29:42.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17673967002025631859', time=2024-09-12T20:43:19.962324+0000, chain.objs.size()=1 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._msOFQ191DPQI8t26NnbExYvcQ-MFHx_0 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16979460478509367110', time=2024-09-12T20:43:21.789924+0000, chain.objs.size()=1 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.kz31MF8zXQZkCOv2YFxcDYx3P5A5NBz_0 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16593626592641814280', time=2024-09-12T20:43:22.339629+0000, chain.objs.size()=1 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fgmCood_T4idx6hDXkMwhHNeBY4Ojsu_0 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5503809223046675257', time=2024-09-12T20:43:23.580039+0000, chain.objs.size()=1 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ZA4qIozuIJ2TCNJ8nV8qXiZ_YxF_Kzr_0 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.891682591213742242', time=2024-09-12T20:43:24.411081+0000, chain.objs.size()=1 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.u5ILVkxyjwFh9VRiBzeNd3DSzgJXUZw_0 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3170346406266297638', time=2024-09-12T20:43:25.691240+0000, chain.objs.size()=1 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eg1k6UssfS_PB1GZFOJS8j1kA7TKFtW_0 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16479484748812410018', time=2024-09-12T20:43:25.693790+0000, chain.objs.size()=1 2024-09-12T19:29:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vdN12BK23oMX4LMjUA2fFZ2v41LoBYg_0 2024-09-12T19:29:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3671960859199032618', time=2024-09-12T20:43:28.210541+0000, chain.objs.size()=1 2024-09-12T19:29:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.buFe7Bx1QHlGWfoNeb7Unc-rOSc2u2a_0 2024-09-12T19:29:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14126698596252235253', time=2024-09-12T20:43:28.339316+0000, chain.objs.size()=1 2024-09-12T19:29:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Qu1j-sKh3bU7pVpUdhWEUF4i2yJ3LIP_0 2024-09-12T19:29:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7330843417015983566', time=2024-09-12T20:43:28.678673+0000, chain.objs.size()=1 2024-09-12T19:29:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YpTmWuBGv7HMXHOp_GAXNoUn2Wf6Dv0_0 2024-09-12T19:29:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.102501311180710551', time=2024-09-12T20:43:29.772677+0000, chain.objs.size()=1 2024-09-12T19:29:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.rzZ5W4SFY8g8F2Igrv1313bTvECo7RB_0 2024-09-12T19:29:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10687534315309259146', time=2024-09-12T20:43:29.774561+0000, chain.objs.size()=1 2024-09-12T19:29:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VDJjWW4cQdV6An1In4xmQfW9c5G8bz8_0 2024-09-12T19:29:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13741434349912360649', time=2024-09-12T20:45:10.974219+0000, chain.objs.size()=1 2024-09-12T19:29:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.XUC3us_i9hOtc5OMTpWIuKAsgXtHjdH_0 2024-09-12T19:29:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.24678394449744939', time=2024-09-12T20:45:11.039974+0000, chain.objs.size()=1 2024-09-12T19:29:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UHEZXhvGYIuS-exvDjY483AyzcPodb4_0 2024-09-12T19:29:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3670099352118743251', time=2024-09-12T20:45:12.012379+0000, chain.objs.size()=1 2024-09-12T19:29:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.08huh8UbOvDBSNUcnBte_11yWWjv05D_0 2024-09-12T19:29:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13732148761965560280', time=2024-09-12T20:45:14.748547+0000, chain.objs.size()=1 2024-09-12T19:29:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.KGBvLF9zw8DB1fE7gXGhOIxIORdANne_0 2024-09-12T19:29:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17694191562140603116', time=2024-09-12T20:45:14.969126+0000, chain.objs.size()=1 2024-09-12T19:29:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.720xUM2ga_llN6wqLM2f-ciKmyfUtoW_0 2024-09-12T19:29:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8278303632356531907', time=2024-09-12T20:45:14.983033+0000, chain.objs.size()=1 2024-09-12T19:29:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Yn_TvgGJFZceAHO47nEGREW2v0-SF3P_0 2024-09-12T19:29:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13528703373787744334', time=2024-09-12T20:45:15.603470+0000, chain.objs.size()=1 2024-09-12T19:29:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4XwOZ51in62D-Ft8RL51LkOHc_hYRVK_0 2024-09-12T19:29:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17252895824907871019', time=2024-09-12T20:45:15.941014+0000, chain.objs.size()=1 2024-09-12T19:29:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.X4MoqHR5otTWMGJl77fXyP8yEpZ5ysH_0 2024-09-12T19:29:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7410387952647713319', time=2024-09-12T20:45:16.189921+0000, chain.objs.size()=1 2024-09-12T19:29:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.mvN1kcbaKnM2T5XKN0RA6UlhVXuyvM0_0 2024-09-12T19:29:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1939788651573486056', time=2024-09-12T20:45:19.991908+0000, chain.objs.size()=1 2024-09-12T19:29:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.203+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3F_rikSpBOka-lNMu5yH0mFvsfoxdEJ_0 2024-09-12T19:29:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18064590595593842089', time=2024-09-12T20:45:20.658617+0000, chain.objs.size()=1 2024-09-12T19:29:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qko21lJ1AxYZg2mYNrMc8fAxbdCAkEL_0 2024-09-12T19:29:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10821713710619169713', time=2024-09-12T20:45:20.951245+0000, chain.objs.size()=1 2024-09-12T19:29:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2ml93VsvqjxmJi4xHeGLLWU6R2up5VW_0 2024-09-12T19:29:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7291470705618185896', time=2024-09-12T20:45:22.704576+0000, chain.objs.size()=1 2024-09-12T19:29:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.jVCaHwbfsmeq-d918KwFRm5JeIwsGxz_0 2024-09-12T19:29:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6174442207365523996', time=2024-09-12T20:45:23.219113+0000, chain.objs.size()=1 2024-09-12T19:29:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FLMr3n-UwJ6uXsvzp5pH0AeuOv41YKI_0 2024-09-12T19:29:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8956530624957753438', time=2024-09-12T20:45:24.310060+0000, chain.objs.size()=1 2024-09-12T19:29:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.t1M-bX1HxmKA6Ag1aWhp46tqJSOWwm2_0 2024-09-12T19:29:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18263121078942091188', time=2024-09-12T20:45:25.878082+0000, chain.objs.size()=1 2024-09-12T19:29:42.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.XLfLC3rCeBMqhMtAJlZQF1tKZeFhtXE_0 2024-09-12T19:29:42.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15459417850244042866', time=2024-09-12T20:45:26.175076+0000, chain.objs.size()=1 2024-09-12T19:29:42.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.207+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5618Jw65Fg_moet8m0tLnFJw0APOg1E_0 2024-09-12T19:29:42.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4128231561624051816', time=2024-09-12T20:45:26.627293+0000, chain.objs.size()=1 2024-09-12T19:29:42.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.2UmdeiOGAiZJjuv7kNs1b9d_bC5Y6ij_0 2024-09-12T19:29:42.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2085644925977274165', time=2024-09-12T20:45:26.725927+0000, chain.objs.size()=1 2024-09-12T19:29:42.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kGV8zxnqoPH0w7n8x__5yEy0NWd4rjA_0 2024-09-12T19:29:42.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10933248188248400495', time=2024-09-12T20:45:28.450613+0000, chain.objs.size()=1 2024-09-12T19:29:42.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OxAO2_CX9olHltvDWwtiiUg0pr7pcR8_0 2024-09-12T19:29:42.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6595785601640723922', time=2024-09-12T20:45:29.299516+0000, chain.objs.size()=1 2024-09-12T19:29:42.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.89QMOfVCSh1YqK1hcIxhBUyLel74_yQ_0 2024-09-12T19:29:42.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6066689561786762359', time=2024-09-12T20:45:30.123814+0000, chain.objs.size()=1 2024-09-12T19:29:42.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oXKClOV_AtcuUVYeflDDAN6Xf0GMth9_0 2024-09-12T19:29:42.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5587277534066332902', time=2024-09-12T20:45:30.440020+0000, chain.objs.size()=1 2024-09-12T19:29:42.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3U6Cpa3Jz6eDCLBF10odVJ_CII7VZVX_0 2024-09-12T19:29:42.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1762486345496964558', time=2024-09-12T20:45:33.166016+0000, chain.objs.size()=1 2024-09-12T19:29:42.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0jzsRARGqf-FbZHEcnjtgA6d-XYbgci_0 2024-09-12T19:29:42.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.211+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53716 2024-09-12T19:29:42.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T19:29:42.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4712736003704434736', time=2024-09-12T20:45:35.331775+0000, chain.objs.size()=1 2024-09-12T19:29:42.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.7IpoJl9HY3GLJrccH1FRvJFbV4nQTtc_0 2024-09-12T19:29:42.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6209458404854077038', time=2024-09-12T20:45:35.355068+0000, chain.objs.size()=1 2024-09-12T19:29:42.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3pKvhn8ijbzns2dIdqt8wytN6RclmPy_0 2024-09-12T19:29:42.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.468634429473816060', time=2024-09-12T20:45:35.396218+0000, chain.objs.size()=1 2024-09-12T19:29:42.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hcd5rrs5sD1DeQBEtVzUBs5NY_D-j0d_0 2024-09-12T19:29:42.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4924002292177501542', time=2024-09-12T20:45:35.428826+0000, chain.objs.size()=1 2024-09-12T19:29:42.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6y16jf6l1IDMpfJsEQefYzssWEqmH9u_0 2024-09-12T19:29:42.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.238167223484275372', time=2024-09-12T20:45:36.177095+0000, chain.objs.size()=1 2024-09-12T19:29:42.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DRHzgtlaTEpIhNEy9AJphT9N2D9PCw7_0 2024-09-12T19:29:42.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12257704536959202623', time=2024-09-12T20:45:37.154821+0000, chain.objs.size()=1 2024-09-12T19:29:42.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fZ0nPvaeRucWtsQEqu2a37Q2DLx-A7n_0 2024-09-12T19:29:42.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13454677278660426613', time=2024-09-12T20:45:37.297293+0000, chain.objs.size()=1 2024-09-12T19:29:42.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.QNj1RWfqxMxmviGYgbGVLZcnLV1ySuj_0 2024-09-12T19:29:42.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9489456396859821924', time=2024-09-12T20:45:37.939101+0000, chain.objs.size()=1 2024-09-12T19:29:42.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.McvwQV45XGSa2E7TF1XIkWA2-qCOKdp_0 2024-09-12T19:29:42.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2678543717546372987', time=2024-09-12T20:47:48.007730+0000, chain.objs.size()=1 2024-09-12T19:29:42.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.390__shadow_.ua_eHW0n-gD0hOJkmOPODv0vhEqoI9g_0 2024-09-12T19:29:42.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18043079107177318398', time=2024-09-12T20:50:32.508124+0000, chain.objs.size()=1 2024-09-12T19:29:42.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.465__shadow_.Y_Bm6agTFoG_Vc45DyL6ECQ_TQvMOK8_0 2024-09-12T19:29:42.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.711066782133059098', time=2024-09-12T21:02:39.250781+0000, chain.objs.size()=1 2024-09-12T19:29:42.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.560__shadow_.AySg2SMUAHwPFXM5XLrgnAPy-bdxPd7_0 2024-09-12T19:29:42.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6569519248718426368', time=2024-09-12T21:02:54.339926+0000, chain.objs.size()=3 2024-09-12T19:29:42.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.563__shadow_.gMUlX2pRIri5NEEqNutQeA8FKq91b7Y_0 2024-09-12T19:29:42.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.563__shadow_.gMUlX2pRIri5NEEqNutQeA8FKq91b7Y_1 2024-09-12T19:29:42.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.563__shadow_.gMUlX2pRIri5NEEqNutQeA8FKq91b7Y_2 2024-09-12T19:29:42.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7655845033925186287', time=2024-09-12T21:03:07.162973+0000, chain.objs.size()=1 2024-09-12T19:29:42.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:Zg-IpFE3toFqSGHCgrn3jPdZDu4zzcd_.zoFkAgF0mJX_FChabAJuK3ULZYSXvZL_0 2024-09-12T19:29:42.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12640516331339081807', time=2024-09-12T21:03:27.231379+0000, chain.objs.size()=1 2024-09-12T19:29:42.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:HsTVFRT1gwvF7c.QkFphRjZjjesmN7b_.-GAvWCV3Lzc1g-ei99xd9nadRm5J1nc_0 2024-09-12T19:29:42.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5869053561769748597', time=2024-09-12T21:03:50.947155+0000, chain.objs.size()=1 2024-09-12T19:29:42.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.574__shadow:HTpE.0amiCKkF9vuyfK.t4YArRlbssc_.wVTuBxO6svCbtN65L_cg2ItMqw9fAzU_0 2024-09-12T19:29:42.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.958123785608108344', time=2024-09-12T21:04:47.000120+0000, chain.objs.size()=1 2024-09-12T19:29:42.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:t0VnyIvFIUOB5kcHhfzQl726u.m8zhG_.I6U7oWXQs1JZEa7PGbkaV6Q3vtQmcsd_0 2024-09-12T19:29:42.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13396309296537051600', time=2024-09-12T21:04:48.514049+0000, chain.objs.size()=1 2024-09-12T19:29:42.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:hEVh5QJrZ6d7N37zUSess.RoVO0Xw.._.nmTSDZe4So1SkIQBgofmDjlo1I0qKzK_0 2024-09-12T19:29:42.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13079168574971536411', time=2024-09-12T21:05:55.098111+0000, chain.objs.size()=1 2024-09-12T19:29:42.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.579__shadow:RbFYeyPr.f8mhdSEaTOVv9iYEoOsif._.Aq4qVOH_MT1UmgEuu00VKYQCiOlqvjf_0 2024-09-12T19:29:42.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17732644449701820049', time=2024-09-12T21:06:00.488601+0000, chain.objs.size()=1 2024-09-12T19:29:42.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.580__shadow:9SWHMK07uNKho9mrs5hZW6QVRnub9M3_.5irZmJ5WJpUMkHim7JCRTUYZaxK8I4I_0 2024-09-12T19:29:42.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1866460285785899812', time=2024-09-12T21:06:01.316239+0000, chain.objs.size()=1 2024-09-12T19:29:42.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.580__shadow:4SZ6RDLu00hxrTr8cO80g6K2pTDZgZY_.0zVEa9BDmkWsauEydkIlLqwUDdmOj2S_0 2024-09-12T19:29:42.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12405562850872924419', time=2024-09-12T21:07:01.409707+0000, chain.objs.size()=1 2024-09-12T19:29:42.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.215+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.608__shadow_.nYeOdEHuZDdP_patzOkdOilWUCRn0u0_0 2024-09-12T19:29:42.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.219+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8679706767659265499', time=2024-09-12T21:13:51.722722+0000, chain.objs.size()=1 2024-09-12T19:29:42.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.636__shadow_.2dK-3JGia8IoCzZ10rY42sLm0YJ2YQo_0 2024-09-12T19:29:42.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.219+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1635129140364066806', time=2024-09-12T21:16:39.571481+0000, chain.objs.size()=1 2024-09-12T19:29:42.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.679__shadow_.Gv2b8_AUNU6XjDOxFHVKfWapxGHW-me_0 2024-09-12T19:29:42.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.219+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4942171816766343172', time=2024-09-12T21:18:16.513912+0000, chain.objs.size()=1 2024-09-12T19:29:42.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.719__shadow_.aB-ArNWBDJTSxiQkOM8H0XhI2EWdgUk_0 2024-09-12T19:29:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.219+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T19:29:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49819' 2024-09-12T19:29:42.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2766935018734803024', time=2024-09-12T20:35:37.243327+0000, chain.objs.size()=1 2024-09-12T19:29:42.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.235__shadow_.nf7Gjp6anX9dXX6YfBxdOjShf9GxQIl_0 2024-09-12T19:29:42.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9334767438059803852', time=2024-09-12T20:36:21.693503+0000, chain.objs.size()=1 2024-09-12T19:29:42.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.252__shadow_.kknZqUPEeiSx8YHTSsITUq56cZ96MCN_0 2024-09-12T19:29:42.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.837769609517886890', time=2024-09-12T20:36:24.035221+0000, chain.objs.size()=1 2024-09-12T19:29:42.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.253__shadow_.JmAOrZeWobvsM78VcETRC5ojKOI9gcm_0 2024-09-12T19:29:42.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3175762091021517267', time=2024-09-12T20:38:22.492234+0000, chain.objs.size()=1 2024-09-12T19:29:42.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AI5Yo4F06pOlp_HHQ7nU-UkIRYBvnM8_0 2024-09-12T19:29:42.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16099372749052201434', time=2024-09-12T20:38:23.483660+0000, chain.objs.size()=1 2024-09-12T19:29:42.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.l3BoFFXKXnpbokcT7v53E_GCjKlLeEd_0 2024-09-12T19:29:42.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10057557554016539788', time=2024-09-12T20:38:24.375351+0000, chain.objs.size()=1 2024-09-12T19:29:42.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9Dxecv6QahdAK80sMZ_6DwOXpmZVruX_0 2024-09-12T19:29:42.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17044276775275871738', time=2024-09-12T20:38:24.515122+0000, chain.objs.size()=1 2024-09-12T19:29:42.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.lVrjOgQW6_9S30ou6nwGWdHlAS_EREI_0 2024-09-12T19:29:42.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3280215490851624725', time=2024-09-12T20:38:24.790175+0000, chain.objs.size()=1 2024-09-12T19:29:42.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.LRxjDEpNMTpV4vMD5KkaF52pNOlBpfJ_0 2024-09-12T19:29:42.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7452881302181489158', time=2024-09-12T20:38:27.203242+0000, chain.objs.size()=1 2024-09-12T19:29:42.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.J9_mVwui9mz1tY8x9mJ3ofQ-Ih4EoCb_0 2024-09-12T19:29:42.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4555970444178721204', time=2024-09-12T20:38:27.372652+0000, chain.objs.size()=1 2024-09-12T19:29:42.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aB0BPcVBX5ImDxI9sqe433qoz_sv4k__0 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7479297715992957799', time=2024-09-12T20:38:27.463731+0000, chain.objs.size()=1 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.IXuCoYHX2bsEBtKEW2LTf7MjeBfiNMu_0 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2694843885940786341', time=2024-09-12T20:38:28.288736+0000, chain.objs.size()=1 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.223+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Wl9x4Gh00zoMbZU734y0I18G5HPX9lb_0 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10929249241754598985', time=2024-09-12T20:38:28.534358+0000, chain.objs.size()=1 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qzBaysL5jRLiR4GVhQbgRdemn0uERe3_0 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16486168049397608252', time=2024-09-12T20:38:32.356904+0000, chain.objs.size()=1 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.wugpmus2G0c58eNVOYMaYYHLOUE3jJy_0 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11638887044873641058', time=2024-09-12T20:38:32.358931+0000, chain.objs.size()=1 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aU4TBZz8R9X_j0q-LGG7eJNcZ48wuJL_0 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17807166318931251415', time=2024-09-12T20:38:33.013329+0000, chain.objs.size()=1 2024-09-12T19:29:42.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.LTuEc_8TQsAS-ERWl1z1036qrkzDYkt_0 2024-09-12T19:29:42.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15377527159629773900', time=2024-09-12T20:38:34.671191+0000, chain.objs.size()=1 2024-09-12T19:29:42.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Do5WGlj9RwWEyRJdPdGTLmD7u5die4U_0 2024-09-12T19:29:42.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3357136800992335593', time=2024-09-12T20:38:34.824072+0000, chain.objs.size()=1 2024-09-12T19:29:42.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.DXkQQsgrsHatctezRi9tkOExIf-Exj2_0 2024-09-12T19:29:42.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8916033175230116159', time=2024-09-12T20:38:35.917035+0000, chain.objs.size()=1 2024-09-12T19:29:42.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Fl4lgNO718ZpdtmSEig3xA3j0ddkM-9_0 2024-09-12T19:29:42.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9860141198198358413', time=2024-09-12T20:38:39.351807+0000, chain.objs.size()=1 2024-09-12T19:29:42.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Tneq9VROwqDuv7YQqd8FiWtBeEZpJBA_0 2024-09-12T19:29:42.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2038304762410794750', time=2024-09-12T20:38:40.336346+0000, chain.objs.size()=1 2024-09-12T19:29:42.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.cNp4tHVT_QvWUdpUz5-5pIKnoHM33Gm_0 2024-09-12T19:29:42.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17937824850740742303', time=2024-09-12T20:38:40.385221+0000, chain.objs.size()=1 2024-09-12T19:29:42.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kO34prgQYcZx7f8Jn1TEcZU5_7wxe3z_0 2024-09-12T19:29:42.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2221537756063722490', time=2024-09-12T20:38:42.558034+0000, chain.objs.size()=1 2024-09-12T19:29:42.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.uK7e0Lt3Y3X5df8vyZWGEOZWGJtkdK__0 2024-09-12T19:29:42.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9497896329193186817', time=2024-09-12T20:38:42.867442+0000, chain.objs.size()=1 2024-09-12T19:29:42.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.DHNvBMcSY1tNdSX5bngyWLZeHCXrF7G_0 2024-09-12T19:29:42.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3552951879540138041', time=2024-09-12T20:38:43.123080+0000, chain.objs.size()=1 2024-09-12T19:29:42.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.zEeI0N9ghm5OsTY-6h11JELyHnB4lkZ_0 2024-09-12T19:29:42.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14613741766832870778', time=2024-09-12T20:38:44.077291+0000, chain.objs.size()=1 2024-09-12T19:29:42.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.NWGRK5ZA1GKQsxYVL-_ACNqRmVUreYy_0 2024-09-12T19:29:42.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18285152975438424887', time=2024-09-12T20:38:44.771275+0000, chain.objs.size()=1 2024-09-12T19:29:42.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.R55SNNaHdkS3LaIuI5ApFg2DkNafQz3_0 2024-09-12T19:29:42.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9579480000257675379', time=2024-09-12T20:38:44.773159+0000, chain.objs.size()=1 2024-09-12T19:29:42.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.N5DZ2LdRi6jin0DomuyBlYPCZUnXy4h_0 2024-09-12T19:29:42.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3527282280486238292', time=2024-09-12T20:38:46.697259+0000, chain.objs.size()=1 2024-09-12T19:29:42.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.K8Vs-Xp_rPvTKBHo2RK4_uq7fBd0I8g_0 2024-09-12T19:29:42.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16449920479444221886', time=2024-09-12T20:38:47.051337+0000, chain.objs.size()=1 2024-09-12T19:29:42.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vUQqGYEaDL5LgPvbg3vz9ajEMURRvvm_0 2024-09-12T19:29:42.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4001294961634894544', time=2024-09-12T20:38:48.592442+0000, chain.objs.size()=1 2024-09-12T19:29:42.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.227+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aKVKMwrE7tNHnxiaRz6xWopN5r1aapI_0 2024-09-12T19:29:42.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5649978858569064673', time=2024-09-12T20:38:48.692327+0000, chain.objs.size()=1 2024-09-12T19:29:42.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.BAZ_pmYabj9fjqcTUgB8LvdIcmYcISU_0 2024-09-12T19:29:42.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15276257427073940161', time=2024-09-12T20:38:50.536967+0000, chain.objs.size()=1 2024-09-12T19:29:42.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.b-bx1tK6JRFC7JgQsRyy9L-fy7xUbNc_0 2024-09-12T19:29:42.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14758700416112260811', time=2024-09-12T20:39:30.459595+0000, chain.objs.size()=1 2024-09-12T19:29:42.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.280__shadow_.RiD3daSPxRpkrtJJzBJlMeQ5HIfHhgA_0 2024-09-12T19:29:42.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10300816501075180668', time=2024-09-12T20:43:02.382110+0000, chain.objs.size()=1 2024-09-12T19:29:42.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jUbxT8VPCOuF2iC2VniVzfvyynINc00_0 2024-09-12T19:29:42.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7122250036456915800', time=2024-09-12T20:43:03.088212+0000, chain.objs.size()=1 2024-09-12T19:29:42.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_._INAvyzxAzzmRyBDFQrAd_yKf6nxOky_0 2024-09-12T19:29:42.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8773475669829898469', time=2024-09-12T20:43:03.484607+0000, chain.objs.size()=1 2024-09-12T19:29:42.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nNp_Kr9Sk8TUXM9yBHcnqWwLiF_W0-q_0 2024-09-12T19:29:42.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6100347074393643231', time=2024-09-12T20:43:05.248964+0000, chain.objs.size()=1 2024-09-12T19:29:42.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.o_WIIzgcNGOHKsRu_8CkiiMrzC_IQES_0 2024-09-12T19:29:42.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18292042341577107995', time=2024-09-12T20:43:06.411699+0000, chain.objs.size()=1 2024-09-12T19:29:42.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.WVG4HnzOW3b133RSZhHOvFo49YQaCLe_0 2024-09-12T19:29:42.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16880212501665126051', time=2024-09-12T20:43:06.476217+0000, chain.objs.size()=1 2024-09-12T19:29:42.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.WXL2Fbx-jQ3ktEHaxtQnHMZQ845OJUQ_0 2024-09-12T19:29:42.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1895971657922912842', time=2024-09-12T20:43:07.463398+0000, chain.objs.size()=1 2024-09-12T19:29:42.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.CC4byQYqW625JpDUFEz4zHSnzdzbxOl_0 2024-09-12T19:29:42.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11715314837935214384', time=2024-09-12T20:43:07.859604+0000, chain.objs.size()=1 2024-09-12T19:29:42.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.kd9yfLIRTqrRlqwCuGuGk3i5m_fPpXt_0 2024-09-12T19:29:42.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3329852264417692190', time=2024-09-12T20:43:08.277212+0000, chain.objs.size()=1 2024-09-12T19:29:42.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.mfUjky-HebEB63WW5qNuVZ_czIC7EeX_0 2024-09-12T19:29:42.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4820688807062918238', time=2024-09-12T20:43:12.608114+0000, chain.objs.size()=1 2024-09-12T19:29:42.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eJx3TnlC2hYMeDiXdplnhhOF72ANMSQ_0 2024-09-12T19:29:42.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10648504587651311465', time=2024-09-12T20:43:15.431753+0000, chain.objs.size()=1 2024-09-12T19:29:42.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TFuHF6tLMSZSMjYQHkL0lpL5PsldeDM_0 2024-09-12T19:29:42.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15063065904444641213', time=2024-09-12T20:43:16.168207+0000, chain.objs.size()=1 2024-09-12T19:29:42.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.wUd4SYMnz-9EKKnlXG2dXy3AAc72lCJ_0 2024-09-12T19:29:42.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12659023492391679068', time=2024-09-12T20:43:17.704026+0000, chain.objs.size()=1 2024-09-12T19:29:42.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TAgcz6vYfCpqEj44pQSFNANjHi0bNMp_0 2024-09-12T19:29:42.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14521554642628503495', time=2024-09-12T20:43:18.138132+0000, chain.objs.size()=1 2024-09-12T19:29:42.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7jqSYR6-DTOv52sHvgYoToVliIifD_P_0 2024-09-12T19:29:42.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16634719898582676816', time=2024-09-12T20:43:18.736086+0000, chain.objs.size()=1 2024-09-12T19:29:42.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.LZBJdIc6FvYWtTv3djgeE-TmSfuAMig_0 2024-09-12T19:29:42.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10751217723981721836', time=2024-09-12T20:43:19.696959+0000, chain.objs.size()=1 2024-09-12T19:29:42.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.231+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.qY6wbz6SXzM-hixzUBuVtiXfLZOi8Vn_0 2024-09-12T19:29:42.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10618013126372488353', time=2024-09-12T20:43:19.971142+0000, chain.objs.size()=1 2024-09-12T19:29:42.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.NcMDWhJiZkqnLjULmygLqGt5GlurPw5_0 2024-09-12T19:29:42.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1422435612352333099', time=2024-09-12T20:43:20.010569+0000, chain.objs.size()=1 2024-09-12T19:29:42.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.A2P0-skXn5fhxyxnqStHYJbu6IoQsxy_0 2024-09-12T19:29:42.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16367966542794111617', time=2024-09-12T20:43:20.031347+0000, chain.objs.size()=1 2024-09-12T19:29:42.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.FOtwmgY6vhf3IkDahJXvku9WckyZlJw_0 2024-09-12T19:29:42.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4502666888751453616', time=2024-09-12T20:43:22.019326+0000, chain.objs.size()=1 2024-09-12T19:29:42.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.RwjjgVyJVQUFESpxbMJhuB1caAW6qFH_0 2024-09-12T19:29:42.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8898768622364739124', time=2024-09-12T20:43:22.346239+0000, chain.objs.size()=1 2024-09-12T19:29:42.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.7eUHkPHRNIHO1zAyTGTo-TCZ2l8PT0J_0 2024-09-12T19:29:42.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14182782769626239355', time=2024-09-12T20:43:24.939221+0000, chain.objs.size()=1 2024-09-12T19:29:42.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4Yf9877oWsq14HY8O0VePwVkwBBlAzY_0 2024-09-12T19:29:42.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12091025939246815736', time=2024-09-12T20:43:27.113619+0000, chain.objs.size()=1 2024-09-12T19:29:42.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.AqXe9i1gipmXH-2h8SsDno6PpXTtkhM_0 2024-09-12T19:29:42.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9977970137095764531', time=2024-09-12T20:43:28.277973+0000, chain.objs.size()=1 2024-09-12T19:29:42.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.EzY_zZ-jtZjap8lRwSBmdvHYKMdBW15_0 2024-09-12T19:29:42.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3003445716204545138', time=2024-09-12T20:43:29.518319+0000, chain.objs.size()=1 2024-09-12T19:29:42.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3WgAVSvxvKxQPviyA-GjtW7ujFrn1ca_0 2024-09-12T19:29:42.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14182616593893668956', time=2024-09-12T20:45:11.283136+0000, chain.objs.size()=1 2024-09-12T19:29:42.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.NS_5TA6N2ke9Gr_mRambHNGA3_ao3Gn_0 2024-09-12T19:29:42.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9522719632678499290', time=2024-09-12T20:45:11.360030+0000, chain.objs.size()=1 2024-09-12T19:29:42.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WvHmICPYWqLdKK9w1GjoDF670drvrTP_0 2024-09-12T19:29:42.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7489313829906407861', time=2024-09-12T20:45:11.673636+0000, chain.objs.size()=1 2024-09-12T19:29:42.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OAY-MJbXZLvaD575k5HCpadcM55GwlP_0 2024-09-12T19:29:42.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10794529333465637424', time=2024-09-12T20:45:12.009274+0000, chain.objs.size()=1 2024-09-12T19:29:42.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.CVpxDmYoLrNkcornBJY9obru5tb5Lpx_0 2024-09-12T19:29:42.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.213499723304345308', time=2024-09-12T20:45:12.242886+0000, chain.objs.size()=1 2024-09-12T19:29:42.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._vnjhyhcn5q_Ssu8wV1iNENNF50JnfL_0 2024-09-12T19:29:42.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5036294553996631946', time=2024-09-12T20:45:12.248020+0000, chain.objs.size()=1 2024-09-12T19:29:42.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.235+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fz8E71_9WlBp_6WodVoLM40iREgAfr5_0 2024-09-12T19:29:42.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18223015878762229783', time=2024-09-12T20:45:12.335812+0000, chain.objs.size()=1 2024-09-12T19:29:42.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OINo3jjY0bcBEbpiCXIKHx9MSd8jbxm_0 2024-09-12T19:29:42.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11011377020713913669', time=2024-09-12T20:45:13.529182+0000, chain.objs.size()=1 2024-09-12T19:29:42.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.QvkN8sRxuCTQLLAsC0Qgp9j6WFtF20d_0 2024-09-12T19:29:42.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8420945470099555713', time=2024-09-12T20:45:13.604115+0000, chain.objs.size()=1 2024-09-12T19:29:42.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wmTfzm10EYY4FD85NXE0B8_NazPfBVt_0 2024-09-12T19:29:42.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16655209153160983494', time=2024-09-12T20:45:14.672037+0000, chain.objs.size()=1 2024-09-12T19:29:42.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uc6J55tjdzscz6ESIqi0wD0wtvyj2LM_0 2024-09-12T19:29:42.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8949399145322981398', time=2024-09-12T20:45:16.330072+0000, chain.objs.size()=1 2024-09-12T19:29:42.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.JUgH0F6O2D9LG_yTafnzQCxSBy3ErWF_0 2024-09-12T19:29:42.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3455132937544942591', time=2024-09-12T20:45:16.731414+0000, chain.objs.size()=1 2024-09-12T19:29:42.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.n6qg2eg_lSjwc4wY_6YxwcmaBhmh9y8_0 2024-09-12T19:29:42.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11324408534522368516', time=2024-09-12T20:45:16.953171+0000, chain.objs.size()=1 2024-09-12T19:29:42.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8jfUZJwsvW1u5oqGgjcjLLWhUouS8VG_0 2024-09-12T19:29:42.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10482517137189767610', time=2024-09-12T20:45:19.819065+0000, chain.objs.size()=1 2024-09-12T19:29:42.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MBabjZPzEnaAGGdf4RT-UbQD2SgSNXJ_0 2024-09-12T19:29:42.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14730382856657124523', time=2024-09-12T20:45:20.292386+0000, chain.objs.size()=1 2024-09-12T19:29:42.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.x9GbtssHvEMnJcfNCh6007Su_OoQdgZ_0 2024-09-12T19:29:42.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9656998895349492975', time=2024-09-12T20:45:20.678812+0000, chain.objs.size()=1 2024-09-12T19:29:42.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.c90shTx-yAIVEsQVMcciI1ptZ637Nu3_0 2024-09-12T19:29:42.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15198688368519040938', time=2024-09-12T20:45:22.447568+0000, chain.objs.size()=1 2024-09-12T19:29:42.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.BIFG77tJ42od_AiNJTXrctF0b9Ee3ZI_0 2024-09-12T19:29:42.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13162091238338559939', time=2024-09-12T20:45:23.014584+0000, chain.objs.size()=1 2024-09-12T19:29:42.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.xLZbTLsPj-ccNXMQSQqq8lRh5__5kBQ_0 2024-09-12T19:29:42.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9142348584233612609', time=2024-09-12T20:45:24.404154+0000, chain.objs.size()=1 2024-09-12T19:29:42.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.rg4pO-0LMSA5ydr3BQox7W1AaxrGbhr_0 2024-09-12T19:29:42.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3359956778327374691', time=2024-09-12T20:45:26.555729+0000, chain.objs.size()=1 2024-09-12T19:29:42.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.fXA_M96b3zvg7XXmmC9_JF5iRwK5Axt_0 2024-09-12T19:29:42.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2598859648072709559', time=2024-09-12T20:45:26.938824+0000, chain.objs.size()=1 2024-09-12T19:29:42.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.JWMcbtEAHKyGm7ZV1oW2dQjVQ8G0z_6_0 2024-09-12T19:29:42.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6181652775146979120', time=2024-09-12T20:45:27.073109+0000, chain.objs.size()=1 2024-09-12T19:29:42.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.lsxUd7GsS3yMpqvEy5XbSKkDXeBUHDU_0 2024-09-12T19:29:42.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5742349712174705177', time=2024-09-12T20:45:27.722106+0000, chain.objs.size()=1 2024-09-12T19:29:42.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OEtpR9iyl3AU8HST_FnduA_72KtVXkI_0 2024-09-12T19:29:42.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16612808902066862917', time=2024-09-12T20:45:28.120420+0000, chain.objs.size()=1 2024-09-12T19:29:42.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5PqGoYfLwOAPKJDrufd8LqgLFpS31mO_0 2024-09-12T19:29:42.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12644955940630854817', time=2024-09-12T20:45:30.102246+0000, chain.objs.size()=1 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.q2r7aidoQdpJNdWPiRXcEkmqj8lchLs_0 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.239+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5278036657060221306', time=2024-09-12T20:45:30.219443+0000, chain.objs.size()=1 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DZvHHs3v1LZ1nFiudUdOteh7Vh8lIR0_0 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.575962950155594750', time=2024-09-12T20:45:30.921537+0000, chain.objs.size()=1 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.CyDjmeg_f2VsXGMUIkb5Fxy5ZecVjKy_0 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15337610048277088500', time=2024-09-12T20:45:31.034071+0000, chain.objs.size()=1 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4o5wIRAXYLixFn71fbv_s4ansP1h5fB_0 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7837892048977856217', time=2024-09-12T20:45:33.084115+0000, chain.objs.size()=1 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FR_jzdZy2Z3ujFndBFrjaQmiojoGzH6_0 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14485866790750719302', time=2024-09-12T20:45:33.085579+0000, chain.objs.size()=1 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ALF9MTlB4OZZ6eVTclElBTS3qdlBPtd_0 2024-09-12T19:29:42.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1767725666777481562', time=2024-09-12T20:45:33.256880+0000, chain.objs.size()=1 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.JUqrmCH9gYZd0A03Gt-s_CRcIN2ftV4_0 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17945179713372652209', time=2024-09-12T20:45:34.294902+0000, chain.objs.size()=1 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uq3VQ8kxSlsjUJeV9vH4E6xH_aPnOI9_0 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9153565808035495513', time=2024-09-12T20:45:35.228831+0000, chain.objs.size()=1 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.t6fXiB86btsuPi-wgBETk0b1gzqsQHZ_0 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15567760023352194769', time=2024-09-12T20:45:36.670400+0000, chain.objs.size()=1 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.GbSG7XSLOosGujxkhv-a0AgsNFaOz4k_0 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11345459646086728555', time=2024-09-12T20:49:26.364275+0000, chain.objs.size()=1 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.439__shadow_.gFd9gc6S5y8DpoYGezWkq6jtqS8xLEA_0 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8060371315644410346', time=2024-09-12T20:50:24.586590+0000, chain.objs.size()=1 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.462__shadow_.1oA6qU1dYVbwqxhpTCzJU2OpDFztxgi_0 2024-09-12T19:29:42.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6535461218687042378', time=2024-09-12T20:50:27.557698+0000, chain.objs.size()=1 2024-09-12T19:29:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.463__shadow_.Fr64pPNBkpuWX-KXfw-g6PLjcOmnpu9_0 2024-09-12T19:29:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2175620077469890228', time=2024-09-12T20:51:02.838173+0000, chain.objs.size()=1 2024-09-12T19:29:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.483__shadow_.z7DJBZbMQ4fKMY63aYgnAo9NY8l7jon_0 2024-09-12T19:29:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2928753200146617033', time=2024-09-12T20:51:27.346911+0000, chain.objs.size()=1 2024-09-12T19:29:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.491__shadow_.6uiThiefiTdqFC7XgjjJdnpk9HGRxVv_0 2024-09-12T19:29:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2327435607648610838', time=2024-09-12T20:51:51.051475+0000, chain.objs.size()=1 2024-09-12T19:29:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.503__shadow:ZaN5iQFdkxMluSElq-iCxGVc.IoNdB._.0iAzXRtuwU4n61WPRJhvnPJx8SSDQ8I_0 2024-09-12T19:29:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3922587279012243420', time=2024-09-12T20:52:34.730436+0000, chain.objs.size()=6 2024-09-12T19:29:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.243+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.1 2024-09-12T19:29:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.2 2024-09-12T19:29:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.3 2024-09-12T19:29:42.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.4 2024-09-12T19:29:42.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.5 2024-09-12T19:29:42.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.6 2024-09-12T19:29:42.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49819 2024-09-12T19:29:42.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T19:29:42.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8141542374561844494', time=2024-09-12T20:52:36.024561+0000, chain.objs.size()=6 2024-09-12T19:29:42.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.1 2024-09-12T19:29:42.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.2 2024-09-12T19:29:42.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.3 2024-09-12T19:29:42.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.4 2024-09-12T19:29:42.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.5 2024-09-12T19:29:42.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.6 2024-09-12T19:29:42.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15410439079406826831', time=2024-09-12T21:01:49.421475+0000, chain.objs.size()=1 2024-09-12T19:29:42.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.554__shadow_.hAbJipmyrdzg5-O_j14lef0IGBdxmhP_0 2024-09-12T19:29:42.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15886053793746004660', time=2024-09-12T21:01:50.660866+0000, chain.objs.size()=1 2024-09-12T19:29:42.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.554__shadow_.80ZQyNyDb9T_Ci6vbi7D7ILmDpnFV6K_0 2024-09-12T19:29:42.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.332797833834229993', time=2024-09-12T21:03:40.684579+0000, chain.objs.size()=1 2024-09-12T19:29:42.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.573__shadow_.6-OxMoc34XYCoY8BCB8_F9HigykjGqK_0 2024-09-12T19:29:42.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17977652735597089200', time=2024-09-12T21:03:45.672941+0000, chain.objs.size()=1 2024-09-12T19:29:42.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.574__shadow:hF6MEzEB1G70yb90Mcsh9Xividw-Ju8_.o8-611XYET5tn4i0zOD9vNK5aJY6pZ9_0 2024-09-12T19:29:42.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3310271494873574409', time=2024-09-12T21:04:06.512994+0000, chain.objs.size()=1 2024-09-12T19:29:42.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.576__shadow:Jxi.XbAABcoj3rLH-dSeHyC5CXdemO6_.GeHyKQ-TfuAQw0JGp_K9LKGDAwldCGs_0 2024-09-12T19:29:42.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6030705848771551550', time=2024-09-12T21:04:15.525645+0000, chain.objs.size()=1 2024-09-12T19:29:42.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.247+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:crozxn.So9EAnTT68DDJ6BVALRdDrpp_.4ekpXnW7WLCdvlzLbFhVG1up1wGoMnC_0 2024-09-12T19:29:42.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16257746187264652802', time=2024-09-12T21:04:18.647394+0000, chain.objs.size()=1 2024-09-12T19:29:42.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:qQDrQnDXtajSRolX4lgVF75JWfrH7OY_.2ZIUXgkDPymhbZmI01sAX6fwMviNI0i_0 2024-09-12T19:29:42.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10497433967397291548', time=2024-09-12T21:04:45.022694+0000, chain.objs.size()=1 2024-09-12T19:29:42.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:1Q4ODfWoTJZSQhJGvT341UsszIWfHn6_.vTwRuN2FkqnNO3kAc9H9lbisHfRPLaH_0 2024-09-12T19:29:42.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15357257323762752044', time=2024-09-12T21:04:49.642276+0000, chain.objs.size()=1 2024-09-12T19:29:42.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:CD7d3IsfcYkrc9Yc7iQxnRCBYSCkj9N_.DfAXWIgx51ipGWa_vAMiK-OpX8Ks6jP_0 2024-09-12T19:29:42.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5745648073153172720', time=2024-09-12T21:13:57.148139+0000, chain.objs.size()=1 2024-09-12T19:29:42.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.639__shadow_.rVGQEVzoHGlYLDQNAvwJwltqwfMsewn_0 2024-09-12T19:29:42.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2634699875845136367', time=2024-09-12T21:16:09.722361+0000, chain.objs.size()=1 2024-09-12T19:29:42.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.664__shadow_.XZ6GAqhYoFDKEvD7mUPnm757xq5bNWf_0 2024-09-12T19:29:42.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3170384337566798977', time=2024-09-12T21:17:09.351537+0000, chain.objs.size()=1 2024-09-12T19:29:42.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.696__shadow:AbUAK-uB15coXJFIr--QX2yPkblrTJW_.e5Jy18R3g57L2ywKRUHBeuy8D72BRqJ_0 2024-09-12T19:29:42.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.251+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:42.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T19:29:42.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.255+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:42.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:42.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45462' 2024-09-12T19:29:42.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2616285768134684855', time=2024-09-12T20:28:16.019887+0000, chain.objs.size()=1 2024-09-12T19:29:42.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.157__shadow:6940RCOZwPuFDzzpK.bTqrycYGIMrIS_.1-kNw11lWRcWTjrIJh5rcUBrob26DjD_0 2024-09-12T19:29:42.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17108400427983734399', time=2024-09-12T20:28:32.661479+0000, chain.objs.size()=1 2024-09-12T19:29:42.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.158__shadow_.-6r08fDnPCMySrAn7CnBnClS9K1JxCB_0 2024-09-12T19:29:42.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_DlrnFkmdPhES3FELc0U6Vio-_QgZxin', time=2024-09-12T20:29:53.939685+0000, chain.objs.size()=3 2024-09-12T19:29:42.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.tufsp5-wh18m37QH6ifBPiKJS1fnVI4_0 2024-09-12T19:29:42.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.tufsp5-wh18m37QH6ifBPiKJS1fnVI4_1 2024-09-12T19:29:42.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.tufsp5-wh18m37QH6ifBPiKJS1fnVI4_2 2024-09-12T19:29:42.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12660839315694814960', time=2024-09-12T20:30:45.665668+0000, chain.objs.size()=1 2024-09-12T19:29:42.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.176__shadow_.tLMoK2iHDoIZCbnShA8z6_obeedFfQk_0 2024-09-12T19:29:42.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5280385840018416055', time=2024-09-12T20:35:51.080348+0000, chain.objs.size()=1 2024-09-12T19:29:42.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.240__shadow_.LW8VeTxoD8n1TqdVDmssVPnYcwb_Unm_0 2024-09-12T19:29:42.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11521586893602947', time=2024-09-12T20:36:12.420846+0000, chain.objs.size()=1 2024-09-12T19:29:42.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.248__shadow_.aRiSjTYjJDzl_RFyjKRy55jKRirjITC_0 2024-09-12T19:29:42.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15067624687126569811', time=2024-09-12T20:36:16.969523+0000, chain.objs.size()=1 2024-09-12T19:29:42.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.250__shadow_.2EzhsQz5oKMK3yiGNAWc5x6MdVBvcJv_0 2024-09-12T19:29:42.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8396262181496278387', time=2024-09-12T20:38:22.502687+0000, chain.objs.size()=1 2024-09-12T19:29:42.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qVlVAiO-J9VPLq7Ot8gtVWjZMvxXSNj_0 2024-09-12T19:29:42.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.615299873458343175', time=2024-09-12T20:38:23.450403+0000, chain.objs.size()=1 2024-09-12T19:29:42.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ti5QbboEB3qr9_cw0YFT5r0H3eMm6ta_0 2024-09-12T19:29:42.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5889363736285279605', time=2024-09-12T20:38:24.368053+0000, chain.objs.size()=1 2024-09-12T19:29:42.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8jUKM4PVmqUKbhKrkmHOYQFB-5DePXV_0 2024-09-12T19:29:42.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3761863693613893906', time=2024-09-12T20:38:24.651866+0000, chain.objs.size()=1 2024-09-12T19:29:42.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.259+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.U8cky2LDtHo2yrROag7KfZmzY9CRrKV_0 2024-09-12T19:29:42.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9843884557490643722', time=2024-09-12T20:38:25.259925+0000, chain.objs.size()=1 2024-09-12T19:29:42.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QKgHW0X0wf4b3bEfXZBwCH7dU5heCqF_0 2024-09-12T19:29:42.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14184008758307420202', time=2024-09-12T20:38:27.491447+0000, chain.objs.size()=1 2024-09-12T19:29:42.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.JiXakHodaGTfbrB2bH-oDSx0GQfIy7J_0 2024-09-12T19:29:42.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.148498868201392601', time=2024-09-12T20:38:27.675137+0000, chain.objs.size()=1 2024-09-12T19:29:42.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.cy88yOteLxj79BIhEAmEASbBMtG3B73_0 2024-09-12T19:29:42.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10716198655285046327', time=2024-09-12T20:38:28.720724+0000, chain.objs.size()=1 2024-09-12T19:29:42.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GAhJKOyE7S6Fq9wcKtOjdKrOqQEvoiF_0 2024-09-12T19:29:42.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4697354117241293671', time=2024-09-12T20:38:28.893988+0000, chain.objs.size()=1 2024-09-12T19:29:42.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CSteiFUaQ97R8SxOsKc8T4jqIO91GaX_0 2024-09-12T19:29:42.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2983489512041215279', time=2024-09-12T20:38:29.132912+0000, chain.objs.size()=1 2024-09-12T19:29:42.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RwsxOP0Qg6u6eNntkufX3PUO3e47Dl9_0 2024-09-12T19:29:42.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3448685095351912636', time=2024-09-12T20:38:29.134552+0000, chain.objs.size()=1 2024-09-12T19:29:42.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.az3_F3Ew_RW2JANVc8hFCWTuqw06Lw5_0 2024-09-12T19:29:42.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5101998034740332164', time=2024-09-12T20:38:30.785046+0000, chain.objs.size()=1 2024-09-12T19:29:42.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.abr8DvUyEgKohH1wrZgyedGsnSBDYfq_0 2024-09-12T19:29:42.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4875345977123305269', time=2024-09-12T20:38:31.893968+0000, chain.objs.size()=1 2024-09-12T19:29:42.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ySeslk0mfoMaoJEBugVk6Vt58SBaTqa_0 2024-09-12T19:29:42.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15338967640081046899', time=2024-09-12T20:38:32.645960+0000, chain.objs.size()=1 2024-09-12T19:29:42.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.--0kyNeAF2pUm6_uJvw4O3OwqprTJmH_0 2024-09-12T19:29:42.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18421588605591906651', time=2024-09-12T20:38:32.940225+0000, chain.objs.size()=1 2024-09-12T19:29:42.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vhwiFxPz1VWjlHOcGlgxuR0pstSgj_z_0 2024-09-12T19:29:42.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6966529701909285906', time=2024-09-12T20:38:34.823740+0000, chain.objs.size()=1 2024-09-12T19:29:42.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.gPBU0YC3pLFHzyzHpcSqWSAXZ6GRVNW_0 2024-09-12T19:29:42.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18058539959379633532', time=2024-09-12T20:38:35.014163+0000, chain.objs.size()=1 2024-09-12T19:29:42.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.jyqceMKH8WCa6-88hNTTJfgIFJ8LsTu_0 2024-09-12T19:29:42.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14300972108492169292', time=2024-09-12T20:38:39.904042+0000, chain.objs.size()=1 2024-09-12T19:29:42.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MuICfuumPUdRCA6yd_wP4okhwiTyXUD_0 2024-09-12T19:29:42.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3532472069668806851', time=2024-09-12T20:38:41.324913+0000, chain.objs.size()=1 2024-09-12T19:29:42.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qXDfhqHph22NO98nStuSSngxpq3QrpX_0 2024-09-12T19:29:42.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3035967222546726316', time=2024-09-12T20:38:42.550586+0000, chain.objs.size()=1 2024-09-12T19:29:42.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.vHumN--vux48RRvQ7Fbb5m7wLcm0vhp_0 2024-09-12T19:29:42.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5054940733491054162', time=2024-09-12T20:38:42.999859+0000, chain.objs.size()=1 2024-09-12T19:29:42.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qXBsaCtn1RGw8MkZVBVFjOsErnYRMO__0 2024-09-12T19:29:42.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.562134176822655922', time=2024-09-12T20:38:43.452721+0000, chain.objs.size()=1 2024-09-12T19:29:42.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.SDoPCKGMmu0lH-_E0o55g3zhIIoYrvJ_0 2024-09-12T19:29:42.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8557501669518487515', time=2024-09-12T20:38:43.454474+0000, chain.objs.size()=1 2024-09-12T19:29:42.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ReRiQwYZUXjxywfH3TDmT-zCrMo8_8M_0 2024-09-12T19:29:42.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13556438146717395517', time=2024-09-12T20:38:43.785608+0000, chain.objs.size()=1 2024-09-12T19:29:42.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AmL0BDEaVbILye616C-jWOmsFdddwRy_0 2024-09-12T19:29:42.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9330632561229828801', time=2024-09-12T20:38:43.868866+0000, chain.objs.size()=1 2024-09-12T19:29:42.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.anjaMktlPxuZgEf4Qgpw_YZL_LukH8C_0 2024-09-12T19:29:42.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6477508314041225017', time=2024-09-12T20:38:44.034378+0000, chain.objs.size()=1 2024-09-12T19:29:42.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.CzS0F0Uww3G2QxwW9bczrxEkC1jj-8T_0 2024-09-12T19:29:42.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4228098433066377916', time=2024-09-12T20:38:45.261197+0000, chain.objs.size()=1 2024-09-12T19:29:42.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fBII_2oLB0eMjceVP_CYkKFX0LzwyYD_0 2024-09-12T19:29:42.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5386812212939809039', time=2024-09-12T20:38:45.944393+0000, chain.objs.size()=1 2024-09-12T19:29:42.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.2zZqaMG-wi2Uu0NzGHGCvmPsl0GqA00_0 2024-09-12T19:29:42.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16336557540471672501', time=2024-09-12T20:38:47.491817+0000, chain.objs.size()=1 2024-09-12T19:29:42.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.263+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.A_wu-vw_AbgDtDqq11isPKU_8BVt5_e_0 2024-09-12T19:29:42.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.267+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12646637040493071754', time=2024-09-12T20:38:49.095761+0000, chain.objs.size()=1 2024-09-12T19:29:42.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.267+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.QQfFSL3ykxgx1qrS9oCbxupKPqauFWN_0 2024-09-12T19:29:42.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10613511873080211978', time=2024-09-12T20:38:49.210900+0000, chain.objs.size()=1 2024-09-12T19:29:42.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8c6zvuOY_dAsTvD8cy5d4szUXsygWTZ_0 2024-09-12T19:29:42.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10663153626699829950', time=2024-09-12T20:38:49.322893+0000, chain.objs.size()=1 2024-09-12T19:29:42.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.N06z5NCfZcRDOYjDEjQbM9t9RrxA3RI_0 2024-09-12T19:29:42.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3517660076138414273', time=2024-09-12T20:38:49.327595+0000, chain.objs.size()=1 2024-09-12T19:29:42.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fZjGtAEwLoHZEUryQqLZE6sOE-JMYzG_0 2024-09-12T19:29:42.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.47351321978833203', time=2024-09-12T20:38:49.947700+0000, chain.objs.size()=1 2024-09-12T19:29:42.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ib57ZJRjIK3wXDAFbz6pK1CTOeqMWiW_0 2024-09-12T19:29:42.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11374009453420855887', time=2024-09-12T20:38:50.533097+0000, chain.objs.size()=1 2024-09-12T19:29:42.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.DxsNyj_2ejKMWUG5OW-bUfnG_pxyDhJ_0 2024-09-12T19:29:42.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5397938737060059488', time=2024-09-12T20:38:50.534982+0000, chain.objs.size()=1 2024-09-12T19:29:42.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Np6Ln76MTY9-ZKXU_xqp3faP67eNjnx_0 2024-09-12T19:29:42.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.618347256058851802', time=2024-09-12T20:39:03.803120+0000, chain.objs.size()=1 2024-09-12T19:29:42.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.268__shadow_.skeWeWrtWFyXgQc_W5DuITP4nhHFcvW_0 2024-09-12T19:29:42.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17511918329390197360', time=2024-09-12T20:39:21.348879+0000, chain.objs.size()=1 2024-09-12T19:29:42.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.276__shadow_.TPZgTHv38m_zsGKDXJssNLPJ8grRFhK_0 2024-09-12T19:29:42.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16883030496857247030', time=2024-09-12T20:39:25.887235+0000, chain.objs.size()=1 2024-09-12T19:29:42.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.278__shadow_.G9uAPpxoN1XgU5uxQhBIRiohUcRUs8F_0 2024-09-12T19:29:42.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6441059544770397081', time=2024-09-12T20:40:01.687676+0000, chain.objs.size()=1 2024-09-12T19:29:42.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.2ZYBvr7-wC1Pp1EKgnjzZRJl6MufuTP_0 2024-09-12T19:29:42.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17740231963942822969', time=2024-09-12T20:40:01.742688+0000, chain.objs.size()=1 2024-09-12T19:29:42.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.MRuOnPSAczJJokzaWaqANSQqZriL2ay_0 2024-09-12T19:29:42.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3595893713068552012', time=2024-09-12T20:40:07.503160+0000, chain.objs.size()=1 2024-09-12T19:29:42.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.FWJpqCQdP2agu8RqXYnxiByMwdRQp0k_0 2024-09-12T19:29:42.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7173745417977661082', time=2024-09-12T20:40:07.504498+0000, chain.objs.size()=1 2024-09-12T19:29:42.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.O_xGjr6U09hNfumluev4HS5UJ3Ze7XN_0 2024-09-12T19:29:42.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8394492276047828541', time=2024-09-12T20:40:10.173174+0000, chain.objs.size()=1 2024-09-12T19:29:42.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.294__shadow_.-imFNa8poJYjd_S99Ud_jAqTYd4eX-n_0 2024-09-12T19:29:42.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15457113809892887436', time=2024-09-12T20:40:12.513594+0000, chain.objs.size()=1 2024-09-12T19:29:42.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.295__shadow_.1V678LYxnCO9IQezD4J1Fq-CDq7nLHS_0 2024-09-12T19:29:42.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18190901652323495026', time=2024-09-12T20:40:28.893968+0000, chain.objs.size()=1 2024-09-12T19:29:42.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.302__shadow_.x_jiFYVlpRCiisXo7ANSBzZSD12mJDZ_0 2024-09-12T19:29:42.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6357356297201147624', time=2024-09-12T20:40:33.447514+0000, chain.objs.size()=1 2024-09-12T19:29:42.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.304__shadow_.s6CSKEJSXg6Aw-vDhGoAXXPQWOFcdgE_0 2024-09-12T19:29:42.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1751850907485338855', time=2024-09-12T20:40:35.750518+0000, chain.objs.size()=1 2024-09-12T19:29:42.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.305__shadow_.c444EWkdFtbr3L5glXoFpDvorxfTObk_0 2024-09-12T19:29:42.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6153496445730886778', time=2024-09-12T20:43:03.387522+0000, chain.objs.size()=1 2024-09-12T19:29:42.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.rcX9zAyTK4oE4HxEsQOpyYi4vas6aDg_0 2024-09-12T19:29:42.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5654062558315744281', time=2024-09-12T20:43:04.362415+0000, chain.objs.size()=1 2024-09-12T19:29:42.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.6_NeN88b5ucaDpI3kPYeYpDWESzs5rX_0 2024-09-12T19:29:42.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14398420078374110804', time=2024-09-12T20:43:04.684262+0000, chain.objs.size()=1 2024-09-12T19:29:42.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.umYB6mxpoBypKoSW80x-K8ie7BDoVxm_0 2024-09-12T19:29:42.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15214821437755689103', time=2024-09-12T20:43:04.702635+0000, chain.objs.size()=1 2024-09-12T19:29:42.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.271+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.5HZhd2G7op0kdeVea1sGeqU8CqLVL8V_0 2024-09-12T19:29:42.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8794993568535257559', time=2024-09-12T20:43:05.111487+0000, chain.objs.size()=1 2024-09-12T19:29:42.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.dPQWEI8FxOq2XYNLOJ4oHRHBSMVjH1B_0 2024-09-12T19:29:42.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.143336569172122895', time=2024-09-12T20:43:07.030796+0000, chain.objs.size()=1 2024-09-12T19:29:42.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.c7xxHbKwff7xqMMsDCFkDTnYZWW_qqg_0 2024-09-12T19:29:42.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11111516326211224608', time=2024-09-12T20:43:07.032879+0000, chain.objs.size()=1 2024-09-12T19:29:42.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.IuPV0N_YWFQ_8Tc-FSG-WrBwuUSy60h_0 2024-09-12T19:29:42.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2372394871822705147', time=2024-09-12T20:43:07.136273+0000, chain.objs.size()=1 2024-09-12T19:29:42.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KaIaV5w6DuvyXj_wSB9GXx-VzdUPulS_0 2024-09-12T19:29:42.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13304340732043787939', time=2024-09-12T20:43:07.477598+0000, chain.objs.size()=1 2024-09-12T19:29:42.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nQTUj_Cfk19RkPokrNh3jyJNJah0sRZ_0 2024-09-12T19:29:42.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15403879079707638045', time=2024-09-12T20:43:08.181413+0000, chain.objs.size()=1 2024-09-12T19:29:42.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.iKg0a5aozvPRTeeNB0gqdo16Pyry6Jm_0 2024-09-12T19:29:42.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16389473568704677168', time=2024-09-12T20:43:10.424287+0000, chain.objs.size()=1 2024-09-12T19:29:42.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.dUCKTb7MOO0xPHQwO7T-hs7jLSM21ht_0 2024-09-12T19:29:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3212871989781873007', time=2024-09-12T20:43:12.696634+0000, chain.objs.size()=1 2024-09-12T19:29:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.9j6NGYze1iSg4Oq929iIGIax9hW937l_0 2024-09-12T19:29:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16777457454715891738', time=2024-09-12T20:43:14.504214+0000, chain.objs.size()=1 2024-09-12T19:29:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QTMG8V8ZYUTpeKa0kuq0GhtJeF8oqNI_0 2024-09-12T19:29:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2510432303236676370', time=2024-09-12T20:43:14.759535+0000, chain.objs.size()=1 2024-09-12T19:29:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.II_ezSMU7uHC0dpWBvyXzZcpWDkGrcO_0 2024-09-12T19:29:42.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1847070053219474456', time=2024-09-12T20:43:15.178939+0000, chain.objs.size()=1 2024-09-12T19:29:42.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.S4FRNvKaBCg1niaz-x45Ra_eBwMLzxd_0 2024-09-12T19:29:42.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1756307464850686941', time=2024-09-12T20:43:15.493828+0000, chain.objs.size()=1 2024-09-12T19:29:42.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.275+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-BtyYbZXrMcuQKQQOL5KQgSaR_-j0J2_0 2024-09-12T19:29:42.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11573498888063956189', time=2024-09-12T20:43:17.365159+0000, chain.objs.size()=1 2024-09-12T19:29:42.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xw1yDyn79Qu-DcDDy7zPHXb76iDhpCK_0 2024-09-12T19:29:42.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8931463294553448410', time=2024-09-12T20:43:17.611093+0000, chain.objs.size()=1 2024-09-12T19:29:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ZlIzlOwfsgHrFDMiHQHWVb_DwGIdrUr_0 2024-09-12T19:29:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6344244731037065789', time=2024-09-12T20:43:18.037523+0000, chain.objs.size()=1 2024-09-12T19:29:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.-2GkZpOcEk9ZhB16ZYXt3okHqUEZpiX_0 2024-09-12T19:29:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13498157748252495656', time=2024-09-12T20:43:18.423899+0000, chain.objs.size()=1 2024-09-12T19:29:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HHEllAieiSjiA6sTrNVzN95d8tyuWkv_0 2024-09-12T19:29:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18044703611812596973', time=2024-09-12T20:43:22.254061+0000, chain.objs.size()=1 2024-09-12T19:29:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.k_5gD_FG7tW2jSEOoq-x0U9fYzgeD97_0 2024-09-12T19:29:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2778108594589978703', time=2024-09-12T20:43:22.637030+0000, chain.objs.size()=1 2024-09-12T19:29:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.89GnSlphHqtvS4VcYkaPhZ0DDwLk3oW_0 2024-09-12T19:29:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3260288456186931159', time=2024-09-12T20:43:23.660552+0000, chain.objs.size()=1 2024-09-12T19:29:42.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.TEHDipySS9pq0S-Lg9yfF4TyyE7dVZC_0 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16055734429586835079', time=2024-09-12T20:43:23.662112+0000, chain.objs.size()=1 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nh73cxtqoNxHz1aNF8UX2_cPmUQylUG_0 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8901050290056175200', time=2024-09-12T20:43:24.442203+0000, chain.objs.size()=1 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ij-Rb85BiYZvKXw0vqxRnoBueTtPK-T_0 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3841555826951775155', time=2024-09-12T20:43:26.830893+0000, chain.objs.size()=1 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.c4ZnWtzf3eJCes8uadEFYpeEqkjtTRw_0 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13607869732442183528', time=2024-09-12T20:43:26.915098+0000, chain.objs.size()=1 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.w1L8R9h7tBp6bLIdtZxG792DmTyGXJb_0 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12334222729052361790', time=2024-09-12T20:43:27.158829+0000, chain.objs.size()=1 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.tAF9VEU9JF-_4BZnDSCACyMPP9ka646_0 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16265536107718351878', time=2024-09-12T20:43:27.208189+0000, chain.objs.size()=1 2024-09-12T19:29:42.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Ay01m_Bd1dfJHsgbponNA89s5dcFB9m_0 2024-09-12T19:29:42.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6860670505332551558', time=2024-09-12T20:43:28.425799+0000, chain.objs.size()=1 2024-09-12T19:29:42.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.dKpaozodL27e-ka3aMenwIOA1Ee6ZIQ_0 2024-09-12T19:29:42.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14317667234432412947', time=2024-09-12T20:43:28.957709+0000, chain.objs.size()=1 2024-09-12T19:29:42.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.qvtK9iqpKCVAKT4EyoI0yuY64v-2gE7_0 2024-09-12T19:29:42.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.27926224742553392', time=2024-09-12T20:45:11.013370+0000, chain.objs.size()=1 2024-09-12T19:29:42.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._wmpeLW0NIn48TdTONugdZHSLw1ai1F_0 2024-09-12T19:29:42.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4940135797356741666', time=2024-09-12T20:45:11.549282+0000, chain.objs.size()=1 2024-09-12T19:29:42.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.279+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.SOCjTW6fIxiNdIKcX5VnmuX-AeQptOI_0 2024-09-12T19:29:42.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14200102599153293416', time=2024-09-12T20:45:12.422202+0000, chain.objs.size()=1 2024-09-12T19:29:42.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.QZLZ42-thl1qBu6EtUpr_jimFVpFlmx_0 2024-09-12T19:29:42.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1070731055678721118', time=2024-09-12T20:45:13.235710+0000, chain.objs.size()=1 2024-09-12T19:29:42.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.4W9PgFvTQ2JBHQ5L7vOLEYvrncfLKVf_0 2024-09-12T19:29:42.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17028915236379522848', time=2024-09-12T20:45:13.284641+0000, chain.objs.size()=1 2024-09-12T19:29:42.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.tG0yAYOydTsjfzm9104Hoa1lePYHd2I_0 2024-09-12T19:29:42.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.825048366593640976', time=2024-09-12T20:45:13.563466+0000, chain.objs.size()=1 2024-09-12T19:29:42.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OnZC30oEn70zc9JTOsIMHAVV54zE39h_0 2024-09-12T19:29:42.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9398874071826576488', time=2024-09-12T20:45:15.073589+0000, chain.objs.size()=1 2024-09-12T19:29:42.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5OmCnl9AZkGQBdBH0a52nH0zlSIaFAx_0 2024-09-12T19:29:42.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15357143970098840892', time=2024-09-12T20:45:15.227359+0000, chain.objs.size()=1 2024-09-12T19:29:42.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.bUK7Trvr8qiF39ENZj9PVw9eJiXji1E_0 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8531229926370036125', time=2024-09-12T20:45:15.713704+0000, chain.objs.size()=1 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.rb3dIdHXbM_AV_eKHb5pK4HzoEB_z0n_0 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11141268572736565189', time=2024-09-12T20:45:19.524886+0000, chain.objs.size()=1 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oZ8pgCjp773ml2ILaUSX6FiNbIbUJsv_0 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14925993353574255120', time=2024-09-12T20:45:20.748896+0000, chain.objs.size()=1 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.a9YBoYtuJ7qUweCOQHl0_7Kp_3GbHFE_0 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6103088253494543594', time=2024-09-12T20:45:23.895916+0000, chain.objs.size()=1 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WEMWDv12RCOx_VEvjyK7UENUl_vJLZZ_0 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7710939063560259361', time=2024-09-12T20:45:23.963945+0000, chain.objs.size()=1 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.283+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.yMONMxBkfdzalttdLX_IzkWW0FJkwtk_0 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.287+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2223790443236545331', time=2024-09-12T20:45:24.634806+0000, chain.objs.size()=1 2024-09-12T19:29:42.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.UXcPXEttmNnTOHeDqXbxV_UtMPUD7pC_0 2024-09-12T19:29:42.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.287+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45462 2024-09-12T19:29:42.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T19:29:42.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11721563608983734886', time=2024-09-12T20:45:24.745675+0000, chain.objs.size()=1 2024-09-12T19:29:42.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.78g54PzFH5O8H8Mutmg15fVDj0Ao1OQ_0 2024-09-12T19:29:42.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8116923294074611415', time=2024-09-12T20:45:28.104413+0000, chain.objs.size()=1 2024-09-12T19:29:42.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0_fpoWRD7xLiH4Os_R1YuvuP0mokWgp_0 2024-09-12T19:29:42.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10858896377432358552', time=2024-09-12T20:45:28.229060+0000, chain.objs.size()=1 2024-09-12T19:29:42.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.f4pK1cZIGWA8NbQW23e3jXg6Mbl6z9y_0 2024-09-12T19:29:42.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15979184770169538103', time=2024-09-12T20:45:28.411195+0000, chain.objs.size()=1 2024-09-12T19:29:42.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9EMgczs9lLRV1ROaYqyNEF7aRpthiNF_0 2024-09-12T19:29:42.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12254622994068988125', time=2024-09-12T20:45:30.928954+0000, chain.objs.size()=1 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hRhtRahZO-YAQx76qCiVu8JntC5N9FE_0 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16961441491554780327', time=2024-09-12T20:45:31.280170+0000, chain.objs.size()=1 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.LVviAqUNJKOwcZN4uuGkX9-c4rF3pnZ_0 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10283468608012206803', time=2024-09-12T20:45:31.997931+0000, chain.objs.size()=1 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.sWLgKkVVGdQPU68k80TgHnPbiI7HTyf_0 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6302700061303457648', time=2024-09-12T20:45:32.752133+0000, chain.objs.size()=1 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.s6K53RfkSjM_kciCQsKdyzq8R8X2CsO_0 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4489945300079651575', time=2024-09-12T20:45:32.863034+0000, chain.objs.size()=1 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hhRDcn54VrUEcyuSTcT-XdhKy-JMr6c_0 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3500464468775080803', time=2024-09-12T20:45:33.788775+0000, chain.objs.size()=1 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Umhb2zoNQa3YGIXErHTnVK9i0oSaI-X_0 2024-09-12T19:29:42.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10111894321304323319', time=2024-09-12T20:45:33.835594+0000, chain.objs.size()=1 2024-09-12T19:29:42.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.40MDMoOd9MjFMO2dODf20jPtWaLlMgi_0 2024-09-12T19:29:42.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17568754892432946342', time=2024-09-12T20:45:34.165655+0000, chain.objs.size()=1 2024-09-12T19:29:42.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.pa3F-WLKsuXv1o8gRfTG-RtoimfXBHQ_0 2024-09-12T19:29:42.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7122196164260551842', time=2024-09-12T20:45:36.089298+0000, chain.objs.size()=1 2024-09-12T19:29:42.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8Nw84RWo6Buc1Tr-qybrn2WcIa17cyG_0 2024-09-12T19:29:42.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9063637723310291045', time=2024-09-12T20:45:37.471771+0000, chain.objs.size()=1 2024-09-12T19:29:42.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.0nHscS6aLErrYE5RNvP7xGt1-Iq06o4_0 2024-09-12T19:29:42.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9526611938594805726', time=2024-09-12T20:45:37.623079+0000, chain.objs.size()=1 2024-09-12T19:29:42.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.yzcv0tosyvWvBqmOQt3GBD3RrqhCCpM_0 2024-09-12T19:29:42.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3226735586982140877', time=2024-09-12T20:46:18.717992+0000, chain.objs.size()=1 2024-09-12T19:29:42.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.344__shadow_._5gqX5q_4BvJC0OniutU8m36nttGNin_0 2024-09-12T19:29:42.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16709785854231896162', time=2024-09-12T20:47:28.415405+0000, chain.objs.size()=1 2024-09-12T19:29:42.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.381__shadow_.JvQmLEOtwVp79OYAyYVNeXd8Z1pffKF_0 2024-09-12T19:29:42.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14523340884112916118', time=2024-09-12T20:49:32.862331+0000, chain.objs.size()=1 2024-09-12T19:29:42.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.442__shadow_.DfeGptg0yEg1dQsFHKD6HxAx7Nb2vpn_0 2024-09-12T19:29:42.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16063454994365904067', time=2024-09-12T20:52:34.710137+0000, chain.objs.size()=6 2024-09-12T19:29:42.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.1 2024-09-12T19:29:42.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.2 2024-09-12T19:29:42.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.3 2024-09-12T19:29:42.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.4 2024-09-12T19:29:42.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.291+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.5 2024-09-12T19:29:42.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.6 2024-09-12T19:29:42.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11049228953895829923', time=2024-09-12T20:52:35.390434+0000, chain.objs.size()=6 2024-09-12T19:29:42.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.1 2024-09-12T19:29:42.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.2 2024-09-12T19:29:42.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.3 2024-09-12T19:29:42.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.4 2024-09-12T19:29:42.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.5 2024-09-12T19:29:42.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.507__multipart_srcmultipart.2~3Fo4h5A-hlG5HnsX9Q2HyOvzfL8C50D.6 2024-09-12T19:29:42.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16275108829360737871', time=2024-09-12T20:54:39.663879+0000, chain.objs.size()=1 2024-09-12T19:29:42.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.520__shadow:EfI68pNNCE-VCSnfBo4Lon2YumSl9eo_.sggYvfeaiIXTW2A68xFcjdK9gSJV6_S_0 2024-09-12T19:29:42.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.711102445673082069', time=2024-09-12T20:58:29.518143+0000, chain.objs.size()=3 2024-09-12T19:29:42.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~AjUfcybnVZBp6GXe1h7bQAgGWTbPgzA.1 2024-09-12T19:29:42.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~AjUfcybnVZBp6GXe1h7bQAgGWTbPgzA.2 2024-09-12T19:29:42.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.523__multipart_mymultipart.2~AjUfcybnVZBp6GXe1h7bQAgGWTbPgzA.3 2024-09-12T19:29:42.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4650826595763785763', time=2024-09-12T21:01:14.660033+0000, chain.objs.size()=1 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.550__shadow_.xKbyJpIkjxHLFEm7k_Hc9OWWbMO6Z8T_0 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13842462662614768582', time=2024-09-12T21:03:16.090525+0000, chain.objs.size()=1 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:as5OecbTrDcdeBc0jGkdzgGj86PoaoZ_.hIOFBQ4ZA7WKm5A1MLqpsEWDWd2KtPw_0 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5090697691933415895', time=2024-09-12T21:03:27.887975+0000, chain.objs.size()=1 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:SzznzjBdosrwhFa83WLkSDyyZBxrq3u_.TbmPKh1WG9FDdWk4MgfkcQOJlpJvHEY_0 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2159513186263780939', time=2024-09-12T21:04:43.863587+0000, chain.objs.size()=1 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:DgPmZOlK7rUpang-tnpObVDY65vKaQR_.mc4MtiAur612qhKHvlH7faRInw9_cPp_0 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.79103247911126430', time=2024-09-12T21:04:49.155963+0000, chain.objs.size()=1 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:F8keLTzqkJWuC.HG7l3Jb399ktJb.Wz_.qlwY6PaXT5OVUI7GPmirZpgnUL8VJDb_0 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8394672760575900473', time=2024-09-12T21:06:00.628885+0000, chain.objs.size()=1 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.580__shadow:vgSg4KMLp7KtXsz8K40IhU-hQfBgGp4_.W-XrT-8iI2jqeG0wwVf0_iMhy2AaZEV_0 2024-09-12T19:29:42.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9334555761087652095', time=2024-09-12T21:06:15.974929+0000, chain.objs.size()=1 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.586__shadow:M4GWR27NMoXiI6kestZHXPSZzD117AM_.bimlZI4Zn5G-gGLw6pDgmKytoUpgKml_0 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10908416606148841707', time=2024-09-12T21:14:54.213508+0000, chain.objs.size()=1 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.653__shadow_.oRDUWYlcFl3IzvkZemzpLAZMw4CY85b_0 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18349572527938705512', time=2024-09-12T21:19:13.744703+0000, chain.objs.size()=10 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.295+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.735__multipart_foo.2~4soBo2V-3p3xTnZRUr_k_Utk7ODmf6j.1 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.735__multipart_foo.2~4soBo2V-3p3xTnZRUr_k_Utk7ODmf6j.2 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.735__multipart_foo.2~4soBo2V-3p3xTnZRUr_k_Utk7ODmf6j.3 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.735__multipart_foo.2~4soBo2V-3p3xTnZRUr_k_Utk7ODmf6j.4 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.735__multipart_foo.2~4soBo2V-3p3xTnZRUr_k_Utk7ODmf6j.5 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.735__multipart_foo.2~4soBo2V-3p3xTnZRUr_k_Utk7ODmf6j.6 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.735__multipart_foo.2~4soBo2V-3p3xTnZRUr_k_Utk7ODmf6j.7 2024-09-12T19:29:42.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.735__multipart_foo.2~4soBo2V-3p3xTnZRUr_k_Utk7ODmf6j.8 2024-09-12T19:29:42.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.735__multipart_foo.2~4soBo2V-3p3xTnZRUr_k_Utk7ODmf6j.9 2024-09-12T19:29:42.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.735__multipart_foo.2~4soBo2V-3p3xTnZRUr_k_Utk7ODmf6j.10 2024-09-12T19:29:42.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.299+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:42.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T19:29:42.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:42.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.303+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:42.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52700' 2024-09-12T19:29:42.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_7h-zMh0vUWTU5iMgafMx99qC85wtebQ', time=2024-09-12T20:29:16.646780+0000, chain.objs.size()=3 2024-09-12T19:29:42.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.jS907GYmE6ovqnP1gvPbH4Hw0F8TCeM_0 2024-09-12T19:29:42.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.jS907GYmE6ovqnP1gvPbH4Hw0F8TCeM_1 2024-09-12T19:29:42.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.160__shadow_.jS907GYmE6ovqnP1gvPbH4Hw0F8TCeM_2 2024-09-12T19:29:42.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~GhMHvIDE1qwHWYCe_4pCOrJhbtWNMy_', time=2024-09-12T20:32:01.265550+0000, chain.objs.size()=1 2024-09-12T19:29:42.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.202__multipart_mymultipart.2~GhMHvIDE1qwHWYCe_4pCOrJhbtWNMy_.1 2024-09-12T19:29:42.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3392584755594515156', time=2024-09-12T20:35:37.243521+0000, chain.objs.size()=1 2024-09-12T19:29:42.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.235__shadow_.sy3m0dgXZsiS2szB41WjNrrX4nwWNwL_0 2024-09-12T19:29:42.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6051743312970549580', time=2024-09-12T20:35:59.536903+0000, chain.objs.size()=1 2024-09-12T19:29:42.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.243__shadow_.lxlpn7_X4NAlQ_vBcWllGf-yTIMjGqz_0 2024-09-12T19:29:42.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10942057389727176903', time=2024-09-12T20:36:05.634960+0000, chain.objs.size()=1 2024-09-12T19:29:42.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.245__shadow_.TgJFCe6L69eg1ZykZeWE6vg1AXqn7a1_0 2024-09-12T19:29:42.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13192804933701778562', time=2024-09-12T20:38:22.397511+0000, chain.objs.size()=1 2024-09-12T19:29:42.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.9rPS2C0--NmdChPfaJpIFV7Dtl0zxfv_0 2024-09-12T19:29:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16372319311462549407', time=2024-09-12T20:38:23.650059+0000, chain.objs.size()=1 2024-09-12T19:29:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.JQtUGPTrBnQzDCpvKU6elXY6fJ35LLz_0 2024-09-12T19:29:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4480222785985651120', time=2024-09-12T20:38:27.818933+0000, chain.objs.size()=1 2024-09-12T19:29:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Q6oZtrYGHMPviULU8MDXIljZk8nqNJw_0 2024-09-12T19:29:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8665363629312808211', time=2024-09-12T20:38:28.316369+0000, chain.objs.size()=1 2024-09-12T19:29:42.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qVSCm7lMpQE3kv-i12_vFedUXuBqC1F_0 2024-09-12T19:29:42.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13313270122680434204', time=2024-09-12T20:38:30.658883+0000, chain.objs.size()=1 2024-09-12T19:29:42.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.F3T_1LytDFx6Un9qL3v5hgl7SogMVq6_0 2024-09-12T19:29:42.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1438805821474021048', time=2024-09-12T20:38:34.461468+0000, chain.objs.size()=1 2024-09-12T19:29:42.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Cs-sks0lz9PBm2e9uvNKtPLyvi2QcxW_0 2024-09-12T19:29:42.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6270067471205344139', time=2024-09-12T20:38:34.670960+0000, chain.objs.size()=1 2024-09-12T19:29:42.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.gmOBiPvceaOYieEVirtS7VmuuC4gq7V_0 2024-09-12T19:29:42.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14288496537472279737', time=2024-09-12T20:38:34.823782+0000, chain.objs.size()=1 2024-09-12T19:29:42.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hMSsm762vsVBQzsExfnHyjQl6vjxoOO_0 2024-09-12T19:29:42.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9210848928764976286', time=2024-09-12T20:38:35.246567+0000, chain.objs.size()=1 2024-09-12T19:29:42.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.5Ci8LP2DDvi68yOWiAn50n92-obDGW6_0 2024-09-12T19:29:42.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14712990503892272199', time=2024-09-12T20:38:37.698313+0000, chain.objs.size()=1 2024-09-12T19:29:42.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.iqMpZ8_GOyee0r2RKGosGkOYmr_3nAp_0 2024-09-12T19:29:42.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2500316551744708467', time=2024-09-12T20:38:38.593529+0000, chain.objs.size()=1 2024-09-12T19:29:42.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qAgz415Y_On7_xPoETDyzPJWjbiRHEE_0 2024-09-12T19:29:42.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2095273332306406448', time=2024-09-12T20:38:39.348064+0000, chain.objs.size()=1 2024-09-12T19:29:42.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.K73ntG96B2j9s9RhFT2TjSqwvZrd447_0 2024-09-12T19:29:42.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9474399377822726146', time=2024-09-12T20:38:39.536141+0000, chain.objs.size()=1 2024-09-12T19:29:42.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.56U2BiqfpfwAFtWFQPLWLYAcWFKFUAI_0 2024-09-12T19:29:42.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12355298474594434998', time=2024-09-12T20:38:39.961853+0000, chain.objs.size()=1 2024-09-12T19:29:42.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.307+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.K8XFeCxIzSX8mcIwKhQ_xIH8C21zQ-K_0 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9064286450984685968', time=2024-09-12T20:38:40.264520+0000, chain.objs.size()=1 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aY-0MtWZ3qZ2dp9unWKBuwGPqw0znWd_0 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3562593714189602933', time=2024-09-12T20:38:42.468533+0000, chain.objs.size()=1 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Az24HOMgFwbPaxlT5IlWONagXiKiA69_0 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13633261101337358985', time=2024-09-12T20:38:43.698068+0000, chain.objs.size()=1 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.k8bfd2elX0BKiI8En3gE30k3WWwlkQ5_0 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3404200360057950443', time=2024-09-12T20:38:43.960726+0000, chain.objs.size()=1 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AqxQFORgiDeqWHeRnXcH8B15X0WrX59_0 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10860345605228146914', time=2024-09-12T20:38:44.738642+0000, chain.objs.size()=1 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.hSFQYBDypz2oeFd3aR-cM1ThCiY1gay_0 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1503407636632782301', time=2024-09-12T20:38:46.141231+0000, chain.objs.size()=1 2024-09-12T19:29:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1rVe3NrGtc9rvC9ejZMvDne7qAfOSt3_0 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5129065626524212601', time=2024-09-12T20:38:49.009873+0000, chain.objs.size()=1 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.oWoWK4A7kh7fPOFwavuAWGXNgS9WKkx_0 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16479109071525646751', time=2024-09-12T20:38:49.513326+0000, chain.objs.size()=1 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.IJxqDEEMO4uRwoJp0V_SEIgqESI1aDJ_0 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15936179078567653724', time=2024-09-12T20:38:50.337522+0000, chain.objs.size()=1 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.GcJeLZysg-Y7LrQ05bnMLozB4nIOPLi_0 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6673506591557688795', time=2024-09-12T20:39:08.113367+0000, chain.objs.size()=1 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.270__shadow_.J9B3mnCkz23i-aGkTOWVD5h3tMJHLtM_0 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9838604979166634780', time=2024-09-12T20:39:25.905528+0000, chain.objs.size()=1 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.278__shadow_.WYQ_v_MplpSmm1ySeeUwKhEFtEIlLNu_0 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2615146783286856850', time=2024-09-12T20:39:37.388154+0000, chain.objs.size()=1 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.283__shadow_._kZkyOGrcRf-htk6cJRH5Limwk72TZf_0 2024-09-12T19:29:42.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10739176021068370489', time=2024-09-12T20:39:44.698532+0000, chain.objs.size()=1 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.286__shadow_.o7duLMI-zun8vattzw081hEuh1ibck5_0 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14660230659072230122', time=2024-09-12T20:40:02.058266+0000, chain.objs.size()=1 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.DpBMXcdF5NLJ4CRgvWdnXb2A5maDb69_0 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14504267614023368556', time=2024-09-12T20:40:02.088081+0000, chain.objs.size()=1 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.311+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.5pRCv5ZBZf5rXREEgTmvIbF45_p4vgg_0 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11734637091374800025', time=2024-09-12T20:40:26.611948+0000, chain.objs.size()=1 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.301__shadow_.oMH_9CnDmmGJpYdzKGHpazv7mYqJkfv_0 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17386852842250855724', time=2024-09-12T20:41:15.212356+0000, chain.objs.size()=1 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.319__shadow:riNSnJs4OyQMTpdEH3K.LwpGgRwBSfP_.HWgkdijxMngdNcUOa5a7M3hP0XKXvXJ_0 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9353058317899261318', time=2024-09-12T20:43:06.476383+0000, chain.objs.size()=1 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.bJpfk1i4zsJ3tVfE97HlijTaYEmeZRL_0 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15262742190954673398', time=2024-09-12T20:43:07.244935+0000, chain.objs.size()=1 2024-09-12T19:29:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.LpIC-tozww2mWq4cXlBQjAN3e5O7pGq_0 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4318369263158898896', time=2024-09-12T20:43:07.987143+0000, chain.objs.size()=1 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YNXlnGAK8p5a9643CKMoRnlYlIwThnH_0 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.301281480111662666', time=2024-09-12T20:43:10.012496+0000, chain.objs.size()=1 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ZBjebycZU4wzyw_jRrQcgCnYxCzpBTX_0 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18028552432704628659', time=2024-09-12T20:43:10.100034+0000, chain.objs.size()=1 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Bo7IzekNLfInptwqTFnqTGwWbFUbVuq_0 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15903856791547513256', time=2024-09-12T20:43:10.825579+0000, chain.objs.size()=1 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.YDrTj6oMUQHIb1by-mFfgqnlQPmELyE_0 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17258138824856664012', time=2024-09-12T20:43:11.856307+0000, chain.objs.size()=1 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.84mbannZEV891miJGItsDh72hQ_f0RM_0 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1920636774377356882', time=2024-09-12T20:43:12.360609+0000, chain.objs.size()=1 2024-09-12T19:29:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.C-BySWkT9H07OZUYmwuGXAWGyVz7hP6_0 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16704787985017328566', time=2024-09-12T20:43:12.657187+0000, chain.objs.size()=1 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xE7cBDjENwKmF2Of4T8roNxlze3L6Hk_0 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14784592058122998948', time=2024-09-12T20:43:13.972857+0000, chain.objs.size()=1 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.315+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.vI00nqYbfhHZLt-uK3bVMCGhumBXd_S_0 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10467237600598233331', time=2024-09-12T20:43:14.916501+0000, chain.objs.size()=1 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.z2jc4KJxJxdW8tTUyy9BAd6MR3-Ka1h_0 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4075468695270855562', time=2024-09-12T20:43:15.431933+0000, chain.objs.size()=1 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.D45N7R4f-WK-K7W4EAuB-Wakr40wXb8_0 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7165186290779152877', time=2024-09-12T20:43:15.645589+0000, chain.objs.size()=1 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.sw1haiZNaUtXa3iPNZQZJuiVGWgk_MJ_0 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14265871033195711878', time=2024-09-12T20:43:15.647579+0000, chain.objs.size()=1 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QaDlxlP1eAg7DrRYe9Cvyp4fq0mrTcD_0 2024-09-12T19:29:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3040557672270334852', time=2024-09-12T20:43:15.650278+0000, chain.objs.size()=1 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Bzio0DK38Fw57cQsAShHamnkc9ON62t_0 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2679305841834688122', time=2024-09-12T20:43:15.750721+0000, chain.objs.size()=1 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.RY-hIj8W9lt_Hi7bZvf2aNqz_Y5v3Ei_0 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2108458416001013091', time=2024-09-12T20:43:15.855590+0000, chain.objs.size()=1 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.uSL2A1SUZbSRkoz7_1CyFa7I4QeR9X9_0 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7318818370116145687', time=2024-09-12T20:43:16.226838+0000, chain.objs.size()=1 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.OlEmxCgePXr-EIRRvWn1e8xig_z0uYY_0 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13427436059317420673', time=2024-09-12T20:43:17.294776+0000, chain.objs.size()=1 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.anzM-GDfWfrB2kcmDThW3v42v9x9T7U_0 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13780380168285091455', time=2024-09-12T20:43:17.584875+0000, chain.objs.size()=1 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.aLHrbwNhvqulG9y-OmApN7gtDrx6CNr_0 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3695179374250725509', time=2024-09-12T20:43:19.822577+0000, chain.objs.size()=1 2024-09-12T19:29:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4HxVNgMPrPxbd6SCl0QL4cFMapxRdye_0 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13728155274417927102', time=2024-09-12T20:43:19.970408+0000, chain.objs.size()=1 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.R2NC5POY0ztp4q_w_4A4YhoWsnlelZH_0 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13381215082792093056', time=2024-09-12T20:43:20.859408+0000, chain.objs.size()=1 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.HhYNX6eHGCIWDX2Bz_QrjSInt9g2Cg2_0 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5776334697125680825', time=2024-09-12T20:43:22.699032+0000, chain.objs.size()=1 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fkfL3xQF1djXCXoIdzBEv3IxLz63aRU_0 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1436640861842203710', time=2024-09-12T20:43:27.930532+0000, chain.objs.size()=1 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Ev7O-sQx4tZGUqVTziP_1kARAwSnxfF_0 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7206195051774664450', time=2024-09-12T20:43:29.021068+0000, chain.objs.size()=1 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.XnTIRVd8OH6L--FEkgM9QEkw2cyGRdE_0 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16043890764870258486', time=2024-09-12T20:43:29.518378+0000, chain.objs.size()=1 2024-09-12T19:29:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Os3XFSZxzfmcg6bBcZfv3OlIf8dtTyL_0 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11716716296730926214', time=2024-09-12T20:45:12.910828+0000, chain.objs.size()=1 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.qS76akPh584fU9Vi1_F--oVPIEFzLb7_0 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10634853693928428692', time=2024-09-12T20:45:14.859026+0000, chain.objs.size()=1 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9US8IOi1dk5GQOucEcvTwXsInT8431m_0 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16760165003672112974', time=2024-09-12T20:45:16.117519+0000, chain.objs.size()=1 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oj44arLd0eKwW9ZOLdTbdrZq4effZBf_0 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1008544718964639177', time=2024-09-12T20:45:16.807067+0000, chain.objs.size()=1 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.LDFQ9bUjay5cRYSrWlWzLNyjC2s8fAt_0 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15888889611044385086', time=2024-09-12T20:45:18.909618+0000, chain.objs.size()=1 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.LU9JEjWuW7WfhRca_TwQ4dsB5ZrQIp__0 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16349439450789810063', time=2024-09-12T20:45:19.161667+0000, chain.objs.size()=1 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.319+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.o3yXneKodygHM0BrT2_Pt6LAW0FIh7i_0 2024-09-12T19:29:42.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11716114749641500507', time=2024-09-12T20:45:19.270520+0000, chain.objs.size()=1 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.SC67ImCI2HcDv2EOaSdbHaf-le8JIKF_0 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15547257334011054123', time=2024-09-12T20:45:19.494356+0000, chain.objs.size()=1 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.WAg-OwkI5H7kSenx9CCvjU-RTY77SCT_0 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.631017167279752851', time=2024-09-12T20:45:19.816706+0000, chain.objs.size()=1 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6R3ZhtmkqKX_yjvUpQAwrQ2qAVfObh4_0 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17441990457555122886', time=2024-09-12T20:45:20.537541+0000, chain.objs.size()=1 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cC7QZQIcjkt7PEZndUAmWyg4ufsh3ak_0 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7622605785686568931', time=2024-09-12T20:45:20.676492+0000, chain.objs.size()=1 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.JwmHw1GGCh-Eyi8y4wS5-LQLAgcurKY_0 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7807490346775467146', time=2024-09-12T20:45:21.073477+0000, chain.objs.size()=1 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.L0CXGnKLBwRd8jeym0MeIO85I23zPsA_0 2024-09-12T19:29:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12780055655849967570', time=2024-09-12T20:45:21.076578+0000, chain.objs.size()=1 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zq25-eRVG2oRsCLQidxG7YCfCHp8T7h_0 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16080594635719931904', time=2024-09-12T20:45:21.145378+0000, chain.objs.size()=1 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.JGlu4h-d70EdRF1rjrCr0eIdCDyPQJI_0 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14058852483438927538', time=2024-09-12T20:45:21.159761+0000, chain.objs.size()=1 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.OKGV4kYjxDByjpVaFWMlEzW09tW3VJq_0 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2018341845161032007', time=2024-09-12T20:45:21.195002+0000, chain.objs.size()=1 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.-F3oF9amtS5enyzCAU3czkknoojpLfV_0 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7047346537069465451', time=2024-09-12T20:45:24.502969+0000, chain.objs.size()=1 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.RkmnaB7NhtsYlHADessuvjfjw277jef_0 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10227986121315174659', time=2024-09-12T20:45:24.504464+0000, chain.objs.size()=1 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.C0CSPPLtH0Nphwc8UIcG7fe1u_hlUL__0 2024-09-12T19:29:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3701410286685478863', time=2024-09-12T20:45:26.555186+0000, chain.objs.size()=1 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.O8VfBM1rnstMl_LO7FOXmPULPEbtS_x_0 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7771774798584340612', time=2024-09-12T20:45:26.890520+0000, chain.objs.size()=1 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.T8zdPkuYSXfEE0Q1gibUygd3cRIGpKd_0 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16139296165466200036', time=2024-09-12T20:45:27.602233+0000, chain.objs.size()=1 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1VQZu9yqYH0hOawcM6u8D-izgMcvFVl_0 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.533441573593406808', time=2024-09-12T20:45:27.786747+0000, chain.objs.size()=1 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.oeARvguPvNAjQywZneJ34DdAskLNBJR_0 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.474802145265238530', time=2024-09-12T20:45:28.029240+0000, chain.objs.size()=1 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.X8HFXvD16pXxPCUBnV-7u8Pbdfwhttv_0 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15897212470243037425', time=2024-09-12T20:45:31.545242+0000, chain.objs.size()=1 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.7qMNrTWj-hg4mrBy54mmG1E8Q_rjcc2_0 2024-09-12T19:29:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8970669143018547527', time=2024-09-12T20:45:31.964928+0000, chain.objs.size()=1 2024-09-12T19:29:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.uA9lCOLP04WVdiQbikUsS5trb70xttQ_0 2024-09-12T19:29:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17432688587259887871', time=2024-09-12T20:45:33.076393+0000, chain.objs.size()=1 2024-09-12T19:29:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.-srfXVeCwBk4j2x2v1KmwclusyW_Bh5_0 2024-09-12T19:29:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16981440083082068306', time=2024-09-12T20:45:34.175205+0000, chain.objs.size()=1 2024-09-12T19:29:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Zaht_jXivP6UDLyECoWN57q7rtQ1Uln_0 2024-09-12T19:29:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.323+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3456194227973864703', time=2024-09-12T20:45:35.229459+0000, chain.objs.size()=1 2024-09-12T19:29:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Zj6TuZafE83R5Rwm3JTzQvUaVbMWJaQ_0 2024-09-12T19:29:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16455133695709232222', time=2024-09-12T20:45:36.097160+0000, chain.objs.size()=1 2024-09-12T19:29:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.DOGYQUqXNGO2QRcD4IEYEvVJjENEOSp_0 2024-09-12T19:29:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7219891131054595602', time=2024-09-12T20:45:37.010629+0000, chain.objs.size()=1 2024-09-12T19:29:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5pI0kMl_ilRYj_W75G6l6m3C3en75Mf_0 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3464869337376855338', time=2024-09-12T20:45:37.738595+0000, chain.objs.size()=1 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.EMV-EntII21swCR33wbQjyH3h5uo33m_0 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7320836981887091981', time=2024-09-12T20:45:38.194110+0000, chain.objs.size()=1 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ITKOY8X7OxGcZRHHKWhfsLtfyDo8326_0 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1524148213189120375', time=2024-09-12T20:45:38.274296+0000, chain.objs.size()=1 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._R7oS3YUDNNWpaN60S4CCqYL9zfKx4i_0 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5202059158336151185', time=2024-09-12T20:45:44.101966+0000, chain.objs.size()=1 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.327__shadow_.aOgTTJo19uZwPsr-5FVY-hoThb1ERGA_0 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13595730324700705234', time=2024-09-12T20:45:47.853938+0000, chain.objs.size()=1 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.329__shadow_.Z_Be9esbUWV0xk-CmN_7x6T1q3TTftS_0 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14565998117996262199', time=2024-09-12T20:47:19.827179+0000, chain.objs.size()=1 2024-09-12T19:29:42.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.377__shadow_.-Em6f2lNDizDIk-D3TqQn0z9N7klDcl_0 2024-09-12T19:29:42.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17418945829910110311', time=2024-09-12T20:50:09.719064+0000, chain.objs.size()=1 2024-09-12T19:29:42.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.327+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.457__shadow_.WPXEuVWH_8Lit83uxAaWaNnK9DAIeWX_0 2024-09-12T19:29:42.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52700 2024-09-12T19:29:42.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T19:29:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6854440739663040106', time=2024-09-12T20:50:57.125517+0000, chain.objs.size()=1 2024-09-12T19:29:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.481__shadow_.GQR4OGJZRKRvFT3CasCKStsSJpmsfoz_0 2024-09-12T19:29:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UuCCUlq-61sd-rnqnHDg72Ea-8xQ_vX', time=2024-09-12T20:55:34.611294+0000, chain.objs.size()=1 2024-09-12T19:29:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UuCCUlq-61sd-rnqnHDg72Ea-8xQ_vX.2 2024-09-12T19:29:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11939483233968179217', time=2024-09-12T20:58:54.308443+0000, chain.objs.size()=3 2024-09-12T19:29:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~EVnqCClP0DlOuhEiR_yAI_-voqvch59.1 2024-09-12T19:29:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~EVnqCClP0DlOuhEiR_yAI_-voqvch59.2 2024-09-12T19:29:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~EVnqCClP0DlOuhEiR_yAI_-voqvch59.3 2024-09-12T19:29:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9474407299951897263', time=2024-09-12T21:03:44.284796+0000, chain.objs.size()=1 2024-09-12T19:29:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.574__shadow_.rjXsULu7iwZcnQP5hSVmlcLZlJwm7oP_0 2024-09-12T19:29:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3855186811197958165', time=2024-09-12T21:04:35.906931+0000, chain.objs.size()=1 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:UM7JccP6aqzRudzkXAdSdGZtpM5CiuT_.Xfva53YlCnMNt02GHXRf4aDl8c21mVv_0 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4793690961798767141', time=2024-09-12T21:04:39.014897+0000, chain.objs.size()=1 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:Ja9PkLhFI691OXwumhdfz8k.dUUJ8nb_.yDrlwNhdEvOc9kRVx-OfPBsEyRo0jLx_0 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12155176122175274759', time=2024-09-12T21:06:21.214515+0000, chain.objs.size()=1 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.587__shadow:.vvAIAemEEZo698BEhek3eLcI4YyLLY_.kiEtD0MIz0OIsMiXdfNlgvxTWTvXqFW_0 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4865317182219697048', time=2024-09-12T21:14:42.311308+0000, chain.objs.size()=1 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.649__shadow_.FPXe-5tDEd4KGCcDlWBOtCBI1JIyZOR_0 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5640337698234742023', time=2024-09-12T21:16:06.620411+0000, chain.objs.size()=1 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.663__shadow_.zos57KDSjRWtS-RC5uKXDZKzBBdqYWh_0 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12807980624304739151', time=2024-09-12T21:16:57.673565+0000, chain.objs.size()=1 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.690__shadow:EhTExJM8LUctDh4PQHO2Rz62N1q7tVG_.e249UQDbi_ws8Lf4u0SZpPopBhbaFMi_0 2024-09-12T19:29:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2901382080648692770', time=2024-09-12T21:17:20.466693+0000, chain.objs.size()=1 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.331+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.701__shadow:eHbAzBJ97IOMp0B8asPpG37rEWbwM39_.jaNeC3Pl1LHb0mmQ4h6LqDrwiMWYKuA_0 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.335+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.335+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48773' 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='__dvlmTnu54O-_aProUzMoaMVIXnkM1K', time=2024-09-12T20:29:52.075932+0000, chain.objs.size()=3 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.hIZBiIr4cuqMkdJUtRKSh1LmA8LllT4_0 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.hIZBiIr4cuqMkdJUtRKSh1LmA8LllT4_1 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.161__shadow_.hIZBiIr4cuqMkdJUtRKSh1LmA8LllT4_2 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.461935039815223950', time=2024-09-12T20:35:25.535720+0000, chain.objs.size()=1 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.230__shadow_.5FPe9CwmDQFjHfdljwMioEHBgI2xCBI_0 2024-09-12T19:29:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7626790426544541351', time=2024-09-12T20:36:26.325620+0000, chain.objs.size()=1 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.254__shadow_.7821DaoUFp29e4QHanzqqgKneBmb6R5_0 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9802350975301891226', time=2024-09-12T20:36:30.794207+0000, chain.objs.size()=1 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.256__shadow_.m1mBLqYhVqYGUIYOtiVh-F-8aY4VaYP_0 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4454150897819374528', time=2024-09-12T20:36:37.384342+0000, chain.objs.size()=1 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.259__shadow_.9EHg4aJ1lIT447NL2s7xYC3ku80nGQ7_0 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11244128610982963478', time=2024-09-12T20:38:23.850888+0000, chain.objs.size()=1 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.r1lEihe8FuDln_CJWpm28MPPfJyXYr1_0 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8368792968472661990', time=2024-09-12T20:38:26.665379+0000, chain.objs.size()=1 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.HUGWdQOGtlgXoz7zgCGgpekgw4Tn0qr_0 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12235033853568087744', time=2024-09-12T20:38:28.302106+0000, chain.objs.size()=1 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ZkU-akbJ3zO33MzrN37YFsl9GpSKzf3_0 2024-09-12T19:29:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17946660346215065243', time=2024-09-12T20:38:29.113922+0000, chain.objs.size()=1 2024-09-12T19:29:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.NaMjMqhTKGEKTsHeaButz6y4Qv81JAK_0 2024-09-12T19:29:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5505443745771567077', time=2024-09-12T20:38:31.678318+0000, chain.objs.size()=1 2024-09-12T19:29:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.339+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4dZcUznA8BkbzelR4W07u5VR8mQisbm_0 2024-09-12T19:29:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14929489407001941290', time=2024-09-12T20:38:31.708647+0000, chain.objs.size()=1 2024-09-12T19:29:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8dC0A5tMoJaZ01K0pIehSfkxjyyon87_0 2024-09-12T19:29:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16524420411956525857', time=2024-09-12T20:38:32.018261+0000, chain.objs.size()=1 2024-09-12T19:29:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.g3O3DAAyTunhpvNWJOcmmAEwnRI7aCM_0 2024-09-12T19:29:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16970126292627315351', time=2024-09-12T20:38:35.175989+0000, chain.objs.size()=1 2024-09-12T19:29:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.qIzeu_GzWO-1sKr1xrg9UxDocFNKJ0E_0 2024-09-12T19:29:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5942113732668244224', time=2024-09-12T20:38:35.645511+0000, chain.objs.size()=1 2024-09-12T19:29:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7Pk8AwaHpvxPS86TVW6Qi82WRoqYhSR_0 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18088893557571858597', time=2024-09-12T20:38:36.453626+0000, chain.objs.size()=1 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.kFqkPT9KH1_7Iz08Kxfr2et3kdhM1Wi_0 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17955075736913253252', time=2024-09-12T20:38:36.463737+0000, chain.objs.size()=1 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.d-XLDUl-atKh4EcLsvPvT3YLCDQ9R7n_0 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16512365306492847337', time=2024-09-12T20:38:37.691349+0000, chain.objs.size()=1 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7NUkoHI5_CTLkdbX1J_5X-s8Xy-1vly_0 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8390660802376871042', time=2024-09-12T20:38:38.407637+0000, chain.objs.size()=1 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.1P8WGlS-Rnywq6jIr73hzSZ3Im3hMgf_0 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8437792688464398993', time=2024-09-12T20:38:38.808972+0000, chain.objs.size()=1 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.Dyh1cWOo_SzYaH6nXOllTscQAkjsHaG_0 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15737224502534911667', time=2024-09-12T20:38:38.811083+0000, chain.objs.size()=1 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.aTq2qraPn6yhWgkmpneIPb2iuq6HyAa_0 2024-09-12T19:29:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2147082019110741259', time=2024-09-12T20:38:39.668556+0000, chain.objs.size()=1 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.EuWs6KzAZypSsKSplL7ylvEZRq1nQq7_0 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11347739398207777361', time=2024-09-12T20:38:40.213077+0000, chain.objs.size()=1 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.TyunSpRsl2AeYjmG1KNMjAZn_n46hOr_0 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16063262887565363693', time=2024-09-12T20:38:40.439210+0000, chain.objs.size()=1 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.VWYDyybQknO7qyVTgI4iUcSjt4sd4M5_0 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1049917665972006820', time=2024-09-12T20:38:41.746366+0000, chain.objs.size()=1 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.WkQUiRsMriMH7e_axv0DjpoCxt9_HQN_0 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13124121624279319738', time=2024-09-12T20:38:42.463562+0000, chain.objs.size()=1 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.J2fwk0Z30_JYCNvvOkPpZlxFARcJFcN_0 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3480021419816504067', time=2024-09-12T20:38:42.562465+0000, chain.objs.size()=1 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.S0ZrIT17cxigEqyDttgsAcInlQ0LetN_0 2024-09-12T19:29:42.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17573938011479107883', time=2024-09-12T20:38:42.563888+0000, chain.objs.size()=1 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.ei_4J2NelT1Tpzn4inFneamjRFxtvY8_0 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13747156566734774657', time=2024-09-12T20:38:43.623235+0000, chain.objs.size()=1 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.eadk0iuUwuNkMzS9QyeqXhIoZwSHr36_0 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9114181358400221745', time=2024-09-12T20:38:45.236340+0000, chain.objs.size()=1 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.MLIMWQ3adE8mjFro1VJm3J1J83ADYl9_0 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10065556855764423170', time=2024-09-12T20:38:45.238353+0000, chain.objs.size()=1 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.4YTnj5Q6brS5Y0QpLl1ZmPrBIdTr4lX_0 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3234944108961674590', time=2024-09-12T20:38:46.015658+0000, chain.objs.size()=1 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_._CiHfNMIqz9omzEMPi6r5n84aJwqb8U_0 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2186451281622828217', time=2024-09-12T20:38:46.619061+0000, chain.objs.size()=1 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.343+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.7G1xHszL93eN1e25XKMVQqeBTYhEgiy_0 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8658689809942109972', time=2024-09-12T20:38:46.620918+0000, chain.objs.size()=1 2024-09-12T19:29:42.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.e1RTPlUsgker_6T623T4LiU9GKCOZA7_0 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6490482206098782281', time=2024-09-12T20:38:46.967866+0000, chain.objs.size()=1 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.xjWf-yc4PY0qxMhALlLmD2Vb7fbRMOb_0 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16893408632102062926', time=2024-09-12T20:38:47.607258+0000, chain.objs.size()=1 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.8ox9-nOdjQQbUmbrFjrFHb0Go9i_5NL_0 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6804543699779554500', time=2024-09-12T20:38:48.940467+0000, chain.objs.size()=1 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.86ZjkiSoyoI4bPIs27rvv5Yj8Oj9YlT_0 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5092441082193789356', time=2024-09-12T20:38:49.266292+0000, chain.objs.size()=1 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.6H2qnEKoemVhU_JZSYbQv4DHT-bRlTv_0 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16518615761181722991', time=2024-09-12T20:38:49.938333+0000, chain.objs.size()=1 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.rhGp9ebSNyyxbv--b-VhobVXf-QZH6X_0 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11636534526847242800', time=2024-09-12T20:38:49.987327+0000, chain.objs.size()=1 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RBZ7OpDO1BBWF9oj5zA15I2momF-Q2Z_0 2024-09-12T19:29:42.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6759629801552546622', time=2024-09-12T20:38:50.530994+0000, chain.objs.size()=1 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.I7VJwHuUuQfSV_cK4ai1er3-ChQdorw_0 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9452824402850327222', time=2024-09-12T20:39:19.047610+0000, chain.objs.size()=1 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.275__shadow_.PIJ4RWDzie8WxMyHmGYyd6AbHG8LOr7_0 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4106407656989109332', time=2024-09-12T20:39:30.480562+0000, chain.objs.size()=1 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.280__shadow_.2MOQFNLMlqGqfz5qOCTZjii8VIMDalW_0 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14337467229412791586', time=2024-09-12T20:39:44.682164+0000, chain.objs.size()=1 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.286__shadow_.T1MvcDDGJF32SEdmDkyMMTo0hem68kZ_0 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4659868292084122116', time=2024-09-12T20:40:01.863161+0000, chain.objs.size()=1 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.nlSo2iPPzqTOhDnC3bIH7pqW6GtDIsn_0 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6461736712080859424', time=2024-09-12T20:40:07.602366+0000, chain.objs.size()=1 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.SYFqxDvt3NmJIgxPailQGj5QNzMN59H_0 2024-09-12T19:29:42.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5917239836219759524', time=2024-09-12T20:40:10.175733+0000, chain.objs.size()=1 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.294__shadow_.cjp-qJUQ96giM-QzRjSwTETB4cG2mt9_0 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8771929342801110906', time=2024-09-12T20:41:18.569406+0000, chain.objs.size()=1 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.321__shadow_.xBTvJuFX7MHkKkILrqfDXeWNxnTEQxP_0 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2639398782931640021', time=2024-09-12T20:43:04.300474+0000, chain.objs.size()=1 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.JUluBCrK_BCIHSURenoJ9Moy4qrWjQ__0 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4280350312424234667', time=2024-09-12T20:43:04.510133+0000, chain.objs.size()=1 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.52N92YVqioyk4Pln_SGIvYqGXtQur6E_0 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8679223691727330443', time=2024-09-12T20:43:04.632604+0000, chain.objs.size()=1 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.VV89W8AG512JXDH18ARopliW7FNKfuz_0 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8356334551686390999', time=2024-09-12T20:43:05.105099+0000, chain.objs.size()=1 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.347+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Mh4E0JFIDYbUyoi3pLzDLVgzhHreiEQ_0 2024-09-12T19:29:42.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11825555652701488930', time=2024-09-12T20:43:08.605998+0000, chain.objs.size()=1 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3X6tY5dca3We8jibbJLi9K_qaf1dXa4_0 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3198318493028525298', time=2024-09-12T20:43:10.045642+0000, chain.objs.size()=1 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.oGPz9ByC9H_-FRm7UyBRa29y9L6GFfY_0 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15706588009812978394', time=2024-09-12T20:43:10.452438+0000, chain.objs.size()=1 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Dbnk0f6IHMaOAyLa6AZJpBeezLCJo4f_0 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6832363116439577484', time=2024-09-12T20:43:10.454377+0000, chain.objs.size()=1 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.MstohonZhGjazFmDLF8OvQmE-6uffZA_0 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12102304014621551654', time=2024-09-12T20:43:10.471518+0000, chain.objs.size()=1 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.3DQ4eQl5OK6SI701BvZ8how0CX166Pb_0 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2822328480800556053', time=2024-09-12T20:43:10.706690+0000, chain.objs.size()=1 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xwX7d4ogtqWAJbWNCmMkk1D8LgniZkC_0 2024-09-12T19:29:42.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1844230980310424088', time=2024-09-12T20:43:12.335180+0000, chain.objs.size()=1 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.2D4SfD2HRQBNUw1Cu_wo_Q_kT8h3q4r_0 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13933273281978687895', time=2024-09-12T20:43:12.741973+0000, chain.objs.size()=1 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.PwU_wpS6aRrqqZuYq8uOJJPtj4DGjJI_0 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18162887575484909857', time=2024-09-12T20:43:13.712707+0000, chain.objs.size()=1 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KkKasVy8ijHEVw9cLf9003txSge8BAC_0 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10374710308027076330', time=2024-09-12T20:43:13.976930+0000, chain.objs.size()=1 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.FCnlJst5px33x8AWXPmoNA55vQFgsWe_0 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14745816143543624949', time=2024-09-12T20:43:14.645719+0000, chain.objs.size()=1 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.xi3qwpf-WehPS4I9CkJVQPQXZBx_sq-_0 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18069988546290320844', time=2024-09-12T20:43:15.211229+0000, chain.objs.size()=1 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.z0P8J4vt7sDi_tyRU1X-VxFQ8SCzkZu_0 2024-09-12T19:29:42.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10138632604631204859', time=2024-09-12T20:43:15.215119+0000, chain.objs.size()=1 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4hnTGOwW9Uqng2yoRkb5XyukntqyQ88_0 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13195020836339341966', time=2024-09-12T20:43:15.766759+0000, chain.objs.size()=1 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KSxUqPS1NKLadyRgFA9kfiCgvAyVcQ__0 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11656497817762084365', time=2024-09-12T20:43:17.397620+0000, chain.objs.size()=1 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.MzBaTq3lHM_ZUKQCm9B6HIkrIlJEYtg_0 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5498392629898747203', time=2024-09-12T20:43:17.660004+0000, chain.objs.size()=1 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.351+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.rtdruOr-0jyINwYe7_bng3yb-MKELN2_0 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16376419418112689935', time=2024-09-12T20:43:21.244714+0000, chain.objs.size()=1 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eg2dHqQFUObAd5HtXh-IFQdjKGq7CGG_0 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17601875340946486932', time=2024-09-12T20:43:21.487355+0000, chain.objs.size()=1 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.B-nk8-zjwG_EoSBwjYoynp7hrwEKHXL_0 2024-09-12T19:29:42.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17955280812469012487', time=2024-09-12T20:43:21.980451+0000, chain.objs.size()=1 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.4S1hfNiDKH3xsYmucRpHM-xsza38Xj6_0 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.620475499875424199', time=2024-09-12T20:43:22.198599+0000, chain.objs.size()=1 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.eofOeDRVOx3cGyVHOYEicAxC8lbW71k_0 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3161746113631589070', time=2024-09-12T20:43:22.704680+0000, chain.objs.size()=1 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.d81bLBpUn5DgspO32O401xrdmClXfm1_0 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10539928912523903966', time=2024-09-12T20:43:22.882441+0000, chain.objs.size()=1 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.zw-ZxFs-7GWuPII_DAs400GnmFnzimr_0 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12785574476461959783', time=2024-09-12T20:43:23.054117+0000, chain.objs.size()=1 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.OWIDdTmxKJBnYamawALtj75-ufNMJ97_0 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18289454871968631560', time=2024-09-12T20:43:23.497799+0000, chain.objs.size()=1 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.aMdE1tMuD8FqhFR5Jow2JMMa2C64eLL_0 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13267528500468756594', time=2024-09-12T20:43:24.899751+0000, chain.objs.size()=1 2024-09-12T19:29:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.p0dLMXfrxa7KdjPp1NbNl2kPMD-XPXX_0 2024-09-12T19:29:42.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5691398633971310434', time=2024-09-12T20:43:24.950873+0000, chain.objs.size()=1 2024-09-12T19:29:42.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.SYHD6kEzhgFeZgTcwnAfAotJsnGuzKt_0 2024-09-12T19:29:42.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15155562771229363304', time=2024-09-12T20:43:26.072708+0000, chain.objs.size()=1 2024-09-12T19:29:42.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.XBFY5VJzN4Y-wRcsytbaGzHYDCcKozW_0 2024-09-12T19:29:42.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3160700403318436667', time=2024-09-12T20:43:28.059521+0000, chain.objs.size()=1 2024-09-12T19:29:42.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.nkHvGpVx6i9l4BQVpeGsj9olkCorGRN_0 2024-09-12T19:29:42.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14133385442360698196', time=2024-09-12T20:43:28.414197+0000, chain.objs.size()=1 2024-09-12T19:29:42.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.355+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KI1TUxrsOuxwHIldmAW0UdOAvUzhJkp_0 2024-09-12T19:29:42.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3759528097891082094', time=2024-09-12T20:43:29.008409+0000, chain.objs.size()=1 2024-09-12T19:29:42.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.p6mOwrx8inO9yfCeC77CvmFdYQLakYz_0 2024-09-12T19:29:42.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17453470303482420872', time=2024-09-12T20:45:11.082712+0000, chain.objs.size()=1 2024-09-12T19:29:42.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.70UQe0LFiuwmRM53YabgeX9NI7kVbfV_0 2024-09-12T19:29:42.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13182907258733329162', time=2024-09-12T20:45:11.180250+0000, chain.objs.size()=1 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.F9fLtFWLRIExfM0YAp8jtrvxWaGjwPN_0 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13857549710150698659', time=2024-09-12T20:45:11.376851+0000, chain.objs.size()=1 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cUHAiUhln37TahYw3Qyv5LobiwkT66P_0 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7941771273759311906', time=2024-09-12T20:45:13.125674+0000, chain.objs.size()=1 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.nSRubOPtWaYW3BaC7Tx8Om4WqDOUOCq_0 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15140565944482464663', time=2024-09-12T20:45:15.811013+0000, chain.objs.size()=1 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.M7gw8Q3EYyqcRGda7_QmxAYjBHlDv-N_0 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16366110782425034478', time=2024-09-12T20:45:17.261235+0000, chain.objs.size()=1 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.faTO8GV5vySOF5vHxiupM5LvrCitLWd_0 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7870381164570704796', time=2024-09-12T20:45:17.322332+0000, chain.objs.size()=1 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.VOJOkf7XeeV9tJV_bAnRpl3enPmt9s4_0 2024-09-12T19:29:42.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9808080693343370757', time=2024-09-12T20:45:18.845698+0000, chain.objs.size()=1 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.KFNm9NqvXyILJRzWl4dXVGe9WNsvu1__0 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8857323199364566378', time=2024-09-12T20:45:20.781997+0000, chain.objs.size()=1 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.XxzbhLHXauPAZ2_5AaqXywUoukCGl9E_0 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5301752741524406550', time=2024-09-12T20:45:22.195759+0000, chain.objs.size()=1 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Gj23NQYLQ0Hvkz3FAcSnqFm0ThaOahr_0 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2094766326776923613', time=2024-09-12T20:45:22.396441+0000, chain.objs.size()=1 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.cf2bIbIfQdsi_HY9JaXSTs7Oax2KI1g_0 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12287747894350967784', time=2024-09-12T20:45:22.911566+0000, chain.objs.size()=1 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5rU6xa5jtqqs6w2UomoQfFb9yNBECCZ_0 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12354641232080743930', time=2024-09-12T20:45:23.395574+0000, chain.objs.size()=1 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.vkOsmS0qLTxbpSePp3AZ0Dw4cybf2lq_0 2024-09-12T19:29:42.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1838174951722578048', time=2024-09-12T20:45:23.672116+0000, chain.objs.size()=1 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.kNWFAZVJYwV9jKNwfhgq7PE72C4ZJEV_0 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6561918295419588574', time=2024-09-12T20:45:24.207231+0000, chain.objs.size()=1 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Q17J8M0WkSkLjVMWcj7vrTNfQAgJKml_0 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14666591037866793487', time=2024-09-12T20:45:25.874081+0000, chain.objs.size()=1 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.9cwBeGFqBFdik9LTv7W1l2Vm0soiot__0 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15682068498184265466', time=2024-09-12T20:45:26.144842+0000, chain.objs.size()=1 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Q3F4_n_VZ1R2GWG9U7WOC2BtJ7R32No_0 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1270818975075601149', time=2024-09-12T20:45:27.338997+0000, chain.objs.size()=1 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5IcZp5_ex7YQXKGmxsw9fVgSXgcukHD_0 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13714496260995814730', time=2024-09-12T20:45:27.425803+0000, chain.objs.size()=1 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.359+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.KYetIrdS0FdJ5Qx8PwjAmeuc6M2LZLK_0 2024-09-12T19:29:42.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48773 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10512079211812492776', time=2024-09-12T20:45:28.436645+0000, chain.objs.size()=1 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.KGtwN_O-9hqNmXkR4XSOTCL2RvpsqRG_0 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16743212684487599421', time=2024-09-12T20:45:30.560877+0000, chain.objs.size()=1 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.jgzBX-T-PfpTaGmyiOTPxyUNT9etyHW_0 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7721949392873482533', time=2024-09-12T20:45:31.143641+0000, chain.objs.size()=1 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.K4qRfmGMp-yxYaitL4vOxesZT1kVphm_0 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2469688960412152879', time=2024-09-12T20:45:31.352054+0000, chain.objs.size()=1 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wBO2zTi_q8PjbdArwoXzHlUpriMgbeL_0 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8675542740658141426', time=2024-09-12T20:45:33.124490+0000, chain.objs.size()=1 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.aXFVB7ziMc2rIsWLuK6f564hpiPB2zO_0 2024-09-12T19:29:42.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7371326336755555847', time=2024-09-12T20:45:34.236220+0000, chain.objs.size()=1 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.KejUX1j9nbzApkD6dBIub1ysE1iVeex_0 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4086102861962213089', time=2024-09-12T20:45:34.421779+0000, chain.objs.size()=1 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.X-lC9E6ht-u3PRkS3MljxUx1lFRDuNl_0 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16465267904967593660', time=2024-09-12T20:45:35.169356+0000, chain.objs.size()=1 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.va3DeQO5ufPm2i1_Z1ANmVI45AL8GuL_0 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5840039561475169438', time=2024-09-12T20:45:35.392573+0000, chain.objs.size()=1 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3ZnQSAA0FAtD_9IcsQG0d966dJlkRqQ_0 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10964682155263605736', time=2024-09-12T20:45:36.432264+0000, chain.objs.size()=1 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MwHT1khzkkhCp96t7qSmWdAmwccLmzD_0 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15363779265458912764', time=2024-09-12T20:45:37.493934+0000, chain.objs.size()=1 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.hHIlUehn50PzqmKVVXDz9BPcYlo9NrP_0 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12801556299389186805', time=2024-09-12T20:45:38.142416+0000, chain.objs.size()=1 2024-09-12T19:29:42.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.363+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ICYkrL_8G-n0f5WEvcsAS-LnZX3PpWB_0 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18222139241159758876', time=2024-09-12T20:47:28.955556+0000, chain.objs.size()=1 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.381__shadow_.DPSP9MjDxPR06MtRCYsNjJlhyWq0HFA_0 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16026054240291677654', time=2024-09-12T20:50:06.725172+0000, chain.objs.size()=1 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.456__shadow_.iPM-NQHv3AtaLDkCc5mLlQGwyKUGwQQ_0 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8507244785869078611', time=2024-09-12T20:50:32.730619+0000, chain.objs.size()=1 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.465__shadow_.69K1vrvL0LtqKXMGKUpIA4DZBv7T3Sf_0 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10899792102594026017', time=2024-09-12T20:51:26.784594+0000, chain.objs.size()=1 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.491__shadow_.6uiThiefiTdqFC7XgjjJdnpk9HGRxVv_0 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14418882347461725084', time=2024-09-12T20:51:32.627234+0000, chain.objs.size()=1 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.495__shadow_.mNpYAQK3rfgkKyQwCiQ67sWpQXdWd92_0 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8361949402076140013', time=2024-09-12T20:57:40.747551+0000, chain.objs.size()=6 2024-09-12T19:29:42.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UKaWjRZHkXHF4A37Qare7moPea_0KQZ.1 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.1hEwRRjCeyO_M-V0wlKjWQvX2nyleyPO.2 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.cmJzdk_DezCh53D0ba_SCOMcMCqZXPgu.3 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UKaWjRZHkXHF4A37Qare7moPea_0KQZ.4 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UKaWjRZHkXHF4A37Qare7moPea_0KQZ.5 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.522__multipart_mymultipart.2~UKaWjRZHkXHF4A37Qare7moPea_0KQZ.6 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4054750654584271270', time=2024-09-12T20:58:44.955141+0000, chain.objs.size()=2 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~GMgLqTIAY1Za8juYFiOHHB2-doG9BgW.1 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.367+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.525__multipart_mymultipart.2~GMgLqTIAY1Za8juYFiOHHB2-doG9BgW.2 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RD2BwNBDUoDI9rdNqtPDpA0biFbcCrJ', time=2024-09-12T21:00:07.968033+0000, chain.objs.size()=1 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.535__multipart_mymultipart.2~RD2BwNBDUoDI9rdNqtPDpA0biFbcCrJ.3 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4925118717533070782', time=2024-09-12T21:02:16.861726+0000, chain.objs.size()=1 2024-09-12T19:29:42.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.557__shadow_.--WEimTU20Slgm2PWLpKhHxjC1z_nCj_0 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7952912362227617795', time=2024-09-12T21:06:21.007965+0000, chain.objs.size()=1 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.587__shadow:vPajUsUAKsrxKbAnt0EJf8VxuXIOwK-_.-a_bQdv0gZ9zBUTz6a9k3WhnIyl_rjq_0 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15604787110200065117', time=2024-09-12T21:13:47.252072+0000, chain.objs.size()=1 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.634__shadow_.E-zQvpb6Vr4iqeeJ6xE3FRJ1p9AYqbB_0 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5715320680908975614', time=2024-09-12T21:14:50.137198+0000, chain.objs.size()=1 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.651__shadow_.UaCOf4BgJmJ_Qe6d2eu0OHun1c0MpFH_0 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11034215245647870249', time=2024-09-12T21:15:10.972837+0000, chain.objs.size()=1 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.656__shadow_._bxBP02soLj_owaErk6ueWaJLlAvse0_0 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4088284136154971868', time=2024-09-12T21:17:22.927607+0000, chain.objs.size()=1 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.702__multipart_file1.2~lF1f0lRfLyO6WcD7wXAFjeZ5Q0g70nL.1 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11891016238258952130', time=2024-09-12T21:17:27.534794+0000, chain.objs.size()=1 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.704__shadow:Oc9zmRqFYQhDZnrlL0IxtjLIpGW89lX_.3e4WwFw-ymZAgin0u_D0Lxue6vWQnLv_0 2024-09-12T19:29:42.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.371+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:42.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T19:29:42.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:29:42.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.375+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:29:42.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51077' 2024-09-12T19:29:42.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15306899853339625073', time=2024-09-12T20:28:51.070105+0000, chain.objs.size()=5 2024-09-12T19:29:42.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.159__multipart_mymultipart-LUKEWARM.2~OYB2aRJzKZysbDNn7QiTV1b4UTsfZlg.1 2024-09-12T19:29:42.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.159__shadow_mymultipart-LUKEWARM.2~OYB2aRJzKZysbDNn7QiTV1b4UTsfZlg.1_1 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.159__multipart_mymultipart-LUKEWARM.2~OYB2aRJzKZysbDNn7QiTV1b4UTsfZlg.2 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.159__shadow_mymultipart-LUKEWARM.2~OYB2aRJzKZysbDNn7QiTV1b4UTsfZlg.2_1 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:98539659-fdaf-41ce-847d-239ff89323af.4641.159__multipart_mymultipart-LUKEWARM.2~OYB2aRJzKZysbDNn7QiTV1b4UTsfZlg.3 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16260905345116239626', time=2024-09-12T20:35:32.398457+0000, chain.objs.size()=1 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.233__shadow_.Y1gOwaYRP3B0QyTvzqCmEU38vbIaXU5_0 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7814323665299827407', time=2024-09-12T20:36:07.861474+0000, chain.objs.size()=1 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.246__shadow_.1IdEZAcfsFIYvcrEPRayiIxMJzgWTpr_0 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7595356334974309836', time=2024-09-12T20:36:21.679124+0000, chain.objs.size()=1 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.252__shadow_.KQPnJdG8DJubuUaV9yFyxS9hPKb5iJ4_0 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11154078857472093842', time=2024-09-12T20:36:30.813756+0000, chain.objs.size()=1 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.256__shadow_.Nziq1OUlZQbqrjNs5K-k7lG0zrP_LCj_0 2024-09-12T19:29:42.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13028207341238499431', time=2024-09-12T20:38:23.009655+0000, chain.objs.size()=1 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.HSqX8PSi5s_Y0fCEwMBqcizVxYLx6Pl_0 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15563932926287160484', time=2024-09-12T20:38:23.011515+0000, chain.objs.size()=1 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.iBuxM9isVBnptjw3PvlxZOrAIqGItGu_0 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9490515434560785645', time=2024-09-12T20:38:23.363259+0000, chain.objs.size()=1 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.47zsBW4A3ZOKzy9C-8oD8SNYT6hviEa_0 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16629528700639811089', time=2024-09-12T20:38:24.086098+0000, chain.objs.size()=1 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.66IR64R0OufmBr3a6BHR6nIjvJ5QHnn_0 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1965094330905585907', time=2024-09-12T20:38:25.207534+0000, chain.objs.size()=1 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.p3L5_bwaBxT9Nc2_dF8s_ngtnyKo4NQ_0 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12615039326568325263', time=2024-09-12T20:38:25.211487+0000, chain.objs.size()=1 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RvqZsnhcbTi2OPAt9JRWjTW_UwhrZgO_0 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9254509511367555699', time=2024-09-12T20:38:25.374746+0000, chain.objs.size()=1 2024-09-12T19:29:42.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.cIjGHeYv06KctIHDmCwOLia-oaH-36__0 2024-09-12T19:29:42.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12600646662566420889', time=2024-09-12T20:38:26.821760+0000, chain.objs.size()=1 2024-09-12T19:29:42.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.72Mm7AYmQC1eAqutBGemi4EsNP4AMY9_0 2024-09-12T19:29:42.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15160457180314606719', time=2024-09-12T20:38:27.666333+0000, chain.objs.size()=1 2024-09-12T19:29:42.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.fiapJRI1r-CcFz5G-w3KcCtbDa33ZEP_0 2024-09-12T19:29:42.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14880838314668863519', time=2024-09-12T20:38:31.140223+0000, chain.objs.size()=1 2024-09-12T19:29:42.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.IXcu0qp1TGReUfuTMl-1ILaXmBiZzvo_0 2024-09-12T19:29:42.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5500414765717920064', time=2024-09-12T20:38:33.939869+0000, chain.objs.size()=1 2024-09-12T19:29:42.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.mUmPB35HuOgsqJaTvALM-fO1gS9SN8F_0 2024-09-12T19:29:42.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8663129543788909256', time=2024-09-12T20:38:34.726528+0000, chain.objs.size()=1 2024-09-12T19:29:42.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.0gbAkCghHKstTTfxBwukAyGQl-54pD5_0 2024-09-12T19:29:42.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8917177805856651907', time=2024-09-12T20:38:35.817088+0000, chain.objs.size()=1 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.oVFJK-P5hcOIKxMc3dutRJ9ItHjVK7p_0 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11325168010942608296', time=2024-09-12T20:38:36.061939+0000, chain.objs.size()=1 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.379+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.bn-QkiTQEVLv7xO8cITVU7lsBl3Jzjo_0 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8107405035191213955', time=2024-09-12T20:38:36.461412+0000, chain.objs.size()=1 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.In6zuWJPcp4TZ4WuA_MQS432RQkylgn_0 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7299659964518656199', time=2024-09-12T20:38:38.105299+0000, chain.objs.size()=1 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.xN3HgOWYV-h5MQ1mUOIahJnbRWYTv1f_0 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.845273319701195132', time=2024-09-12T20:38:38.509105+0000, chain.objs.size()=1 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.3l2yAv0Se9ju8GtcA5eKJVydM37kQth_0 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4303188133628106083', time=2024-09-12T20:38:39.737901+0000, chain.objs.size()=1 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.YgFpQcvlTzwlbJlQbWS5I8m5ujoxNSN_0 2024-09-12T19:29:42.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18443937846820181972', time=2024-09-12T20:38:41.849673+0000, chain.objs.size()=1 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.3OYXg8Ih9WAvSJeqUnCH_Abg6hqIzob_0 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13744797196034447682', time=2024-09-12T20:38:44.883930+0000, chain.objs.size()=1 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.RqJrgME0aJ_-xwntLIUf8Gs_4EmN5fa_0 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12018359428803893604', time=2024-09-12T20:38:45.047518+0000, chain.objs.size()=1 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.92g2VqoLYb2QSeidsFAY53DjVLrvJbL_0 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12743920479627789865', time=2024-09-12T20:38:45.737396+0000, chain.objs.size()=1 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.dKzmzEN_GpayfFENBYA6QG4u9NmJ7PC_0 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11682470207937372561', time=2024-09-12T20:38:46.692877+0000, chain.objs.size()=1 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.AByxeagh9nmi12f839lWYfxIQ3fAx6G_0 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15450563585615760706', time=2024-09-12T20:38:47.197255+0000, chain.objs.size()=1 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.262__shadow_.VXsbMla4v8IOA89se0ioBZiGGpEYLkd_0 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5331063863539178236', time=2024-09-12T20:39:01.624480+0000, chain.objs.size()=1 2024-09-12T19:29:42.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.267__shadow_.BFTnBaj8SPTmbICLVaQuTuj09AwHwIb_0 2024-09-12T19:29:42.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.57381553560261287', time=2024-09-12T20:39:14.648329+0000, chain.objs.size()=1 2024-09-12T19:29:42.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.383+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.273__shadow_.ewbHFFgvf7wi-g2j0hzLb6VYkGwc0rn_0 2024-09-12T19:29:42.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16777763875113045755', time=2024-09-12T20:39:28.196495+0000, chain.objs.size()=1 2024-09-12T19:29:42.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.279__shadow_.GtrJIFp4ot879DQpAQkb4bzFuQczMcY_0 2024-09-12T19:29:42.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14472887317339501497', time=2024-09-12T20:39:32.773163+0000, chain.objs.size()=1 2024-09-12T19:29:42.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.281__shadow_.jsNz9GCYsuitzINWqgwz1VqlwiUQFqE_0 2024-09-12T19:29:42.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5891262096620842905', time=2024-09-12T20:39:51.441354+0000, chain.objs.size()=1 2024-09-12T19:29:42.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.289__shadow_.AuGFhahejx3KeWqsIKBnIF_6cr8zOog_0 2024-09-12T19:29:42.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15416840806175112258', time=2024-09-12T20:40:01.748014+0000, chain.objs.size()=1 2024-09-12T19:29:42.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.-pm3E320YdJm6J4I_qOdhLM484BseQV_0 2024-09-12T19:29:42.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6456967019084440790', time=2024-09-12T20:40:02.134944+0000, chain.objs.size()=1 2024-09-12T19:29:42.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.292__shadow_.FJt0g44z7FLhPlL5fHjrWCLhyCCwOGg_0 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1463544489818980338', time=2024-09-12T20:40:07.788762+0000, chain.objs.size()=1 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.293__shadow_.EYEweJZ66zOOgIF72KaMFZRJIBetE8Y_0 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17246887365602559382', time=2024-09-12T20:40:12.516313+0000, chain.objs.size()=1 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.295__shadow_.Nn9dQp9kYXMhdtBontH57eqEcfXpNE3_0 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6691827875708543029', time=2024-09-12T20:40:26.600300+0000, chain.objs.size()=1 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.301__shadow_.rUY4c_NriaAsW6SE9l9ItqUJAWB60yY_0 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16309005395275562150', time=2024-09-12T20:40:33.438336+0000, chain.objs.size()=1 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.304__shadow_.USTxJDMEdR_0SGRd8RLryRTlwKq8rvh_0 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15395368464544363110', time=2024-09-12T20:43:02.382009+0000, chain.objs.size()=1 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.lfh3Z0uo6YJmh7EFzLetb0NgHJOUYgh_0 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14631520379766735559', time=2024-09-12T20:43:03.365722+0000, chain.objs.size()=1 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.387+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.L_UaChqnfXHAab6JDn_dRXUrKc3DOJ3_0 2024-09-12T19:29:42.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.914766896077124445', time=2024-09-12T20:43:06.883217+0000, chain.objs.size()=1 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.ybU64XASARWzOnvp2mRSR_h7bFCWCCy_0 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1302454577350839919', time=2024-09-12T20:43:07.440900+0000, chain.objs.size()=1 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.65kcIflVhrDwwoDtqYG1gSUTTdQr9Yp_0 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17813114506488832348', time=2024-09-12T20:43:07.539305+0000, chain.objs.size()=1 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.io_S1wwnoTqZHvrYHLwdD7yOEFlbT89_0 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10943554987823185443', time=2024-09-12T20:43:09.059900+0000, chain.objs.size()=1 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.Lgq1yFO1eAon8ENtNGiMF2bhkTnMCVj_0 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3423958601187021403', time=2024-09-12T20:43:10.753846+0000, chain.objs.size()=1 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.KxjhgLx-RIKyWoNG44ss7lHm-rRfplL_0 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18338889052489446652', time=2024-09-12T20:43:10.825454+0000, chain.objs.size()=1 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.XR4Jvf-cUq1UE2XKrm3ZYi5OQcsmizA_0 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3895850836093250101', time=2024-09-12T20:43:11.046493+0000, chain.objs.size()=1 2024-09-12T19:29:42.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.jHFe79uQnoZLxtIr_keWuNXc3C2malY_0 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16070629636612280954', time=2024-09-12T20:43:11.940773+0000, chain.objs.size()=1 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.usZupPgh3gwRxIvsl0QppOazzqq88sc_0 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11343773428730932119', time=2024-09-12T20:43:12.135065+0000, chain.objs.size()=1 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.19_eY8M5vQvQwg54f47bULkQWKtatcN_0 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16934879077777514028', time=2024-09-12T20:43:13.668576+0000, chain.objs.size()=1 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.pP2ekvm10PW2n2RHPFaGKjB2Ef-d3SR_0 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3087168566157912773', time=2024-09-12T20:43:14.920714+0000, chain.objs.size()=1 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.fSaheLInTsPtv7C9FcmwPP3cBsaBpjE_0 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17589356869310047796', time=2024-09-12T20:43:17.234735+0000, chain.objs.size()=1 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.391+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.cFaYZx_ct64wN0jSwnuKOIMMfwlXsQF_0 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16167066619115877814', time=2024-09-12T20:43:17.236204+0000, chain.objs.size()=1 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.JJrpToYVfBbWFODycUANcsvThtvbw2d_0 2024-09-12T19:29:42.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13438140629663629352', time=2024-09-12T20:43:18.138351+0000, chain.objs.size()=1 2024-09-12T19:29:42.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.chgzQkZsXTuiKeQua_Su3J4Ww7XkJRv_0 2024-09-12T19:29:42.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11062867267561059022', time=2024-09-12T20:43:18.578209+0000, chain.objs.size()=1 2024-09-12T19:29:42.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.i9ag9-XmGpjYbBunBQrYzNCemNgAcJ3_0 2024-09-12T19:29:42.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8175880176657261224', time=2024-09-12T20:43:21.587199+0000, chain.objs.size()=1 2024-09-12T19:29:42.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.QBIFG7COSBOMf7OOWBBvkw5ixF3YZ53_0 2024-09-12T19:29:42.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3382566348150581290', time=2024-09-12T20:43:22.468756+0000, chain.objs.size()=1 2024-09-12T19:29:42.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.s-lE1yMcDbzpOE7TjGXd84arzomLCuX_0 2024-09-12T19:29:42.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1396999287682674540', time=2024-09-12T20:43:22.595530+0000, chain.objs.size()=1 2024-09-12T19:29:42.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.qJ7CTf1EUU9TUIexHa-binWpZpdRHFF_0 2024-09-12T19:29:42.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15987676261841279073', time=2024-09-12T20:43:23.652154+0000, chain.objs.size()=1 2024-09-12T19:29:42.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.DIDfEzzjmvwm5ucYXUW-ts-L4gMdWAQ_0 2024-09-12T19:29:42.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.18029013964912019219', time=2024-09-12T20:43:24.495983+0000, chain.objs.size()=1 2024-09-12T19:29:42.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.q5HPwuhjc-jkIQqgeSB9Rl_X6XgRPzo_0 2024-09-12T19:29:42.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5036671122496083208', time=2024-09-12T20:43:26.330350+0000, chain.objs.size()=1 2024-09-12T19:29:42.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.o04_AdnxPv7RTU4oveALe1Gk1CnNxqG_0 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13304351067963468228', time=2024-09-12T20:43:28.272354+0000, chain.objs.size()=1 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.b5XQMD1OOojygLQq4vqSsLz2ulFxmYE_0 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6842131438865724076', time=2024-09-12T20:43:29.824811+0000, chain.objs.size()=1 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.323__shadow_.I8s0MGY3bIB9OvTnzNbGatgnUgAP0pg_0 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5544406518660374318', time=2024-09-12T20:45:12.469324+0000, chain.objs.size()=1 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.5UZxAlFruCNJLCcGXb0edDmmbVS3LK7_0 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3841821904405419114', time=2024-09-12T20:45:12.808936+0000, chain.objs.size()=1 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.zUhfx_T3JdeqE8i2I5kCT8VuRIBa2BN_0 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4022643403227007857', time=2024-09-12T20:45:13.088033+0000, chain.objs.size()=1 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.3YZ30Ju4YzLVVy-FKaw4bKUBH4vsfGC_0 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17223610030513442015', time=2024-09-12T20:45:15.325406+0000, chain.objs.size()=1 2024-09-12T19:29:42.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.A5KK5CD_uvF_mkhlQTEhkXCSm6fXdpb_0 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.851650013056699938', time=2024-09-12T20:45:15.436283+0000, chain.objs.size()=1 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.YdfEgKsrTneFzy7PabKnwYArKyHjVl4_0 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3370659789588254492', time=2024-09-12T20:45:16.497372+0000, chain.objs.size()=1 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.395+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wtCj-_pH9Z4etZ-zn0aakwEs6fQvhpd_0 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13268260845368289978', time=2024-09-12T20:45:16.641558+0000, chain.objs.size()=1 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.KgwFVIO5biSiYDtjvUcVqLjDlI1DAlS_0 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6732108677000463050', time=2024-09-12T20:45:16.727652+0000, chain.objs.size()=1 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.wAQ_cDRaMXS4dAMhB66bDPVEuvA23pB_0 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.948620286495341159', time=2024-09-12T20:45:17.030623+0000, chain.objs.size()=1 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.s8EJBlhixHB0tOrNfLlVcqab8lmVVzH_0 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2844736529181253132', time=2024-09-12T20:45:18.525534+0000, chain.objs.size()=1 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.TuY7Zy3oGnIxwB4fvjQJofvkNteEo-1_0 2024-09-12T19:29:42.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6024546448101899902', time=2024-09-12T20:45:20.023299+0000, chain.objs.size()=1 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.VorTdnKwCjHdsF92hlI37fdFcLwgOMf_0 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8411808727556670033', time=2024-09-12T20:45:22.398142+0000, chain.objs.size()=1 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.U5K3LiKR1cl4JNi_tIbEbum7EIedi72_0 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14175050054289607293', time=2024-09-12T20:45:23.958259+0000, chain.objs.size()=1 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Lg8_ZuBziLYpnpDZQ1k1Woisv-w1gjg_0 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13120583393942736648', time=2024-09-12T20:45:24.312681+0000, chain.objs.size()=1 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Shu_79wRZSiDiwDLmg1ncSb_igaf3DN_0 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8787300923409578024', time=2024-09-12T20:45:25.748250+0000, chain.objs.size()=1 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.03ZWtOQc1fnVPIqs_owWf0L0sJr6TDP_0 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11499686961009332511', time=2024-09-12T20:45:26.364809+0000, chain.objs.size()=1 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.ZjTX3-qwnL06h_IwVe0ehqHe_AovlLL_0 2024-09-12T19:29:42.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17245192414362420595', time=2024-09-12T20:45:28.343343+0000, chain.objs.size()=1 2024-09-12T19:29:42.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.MaFsKbf31umDzqb54g_xf0pPosfw0sX_0 2024-09-12T19:29:42.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.13644480225677142794', time=2024-09-12T20:45:28.414657+0000, chain.objs.size()=1 2024-09-12T19:29:42.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.T9b555Ww0t58iE1-6hNqNxadmduGHgx_0 2024-09-12T19:29:42.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11253867645797948862', time=2024-09-12T20:45:29.277325+0000, chain.objs.size()=1 2024-09-12T19:29:42.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.iJMlT44TytQWMXJr1UhzlS4yo-nC0Kp_0 2024-09-12T19:29:42.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14401764505384795650', time=2024-09-12T20:45:29.278630+0000, chain.objs.size()=1 2024-09-12T19:29:42.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.jMioW82yPxVJCZd6t5-YyRGerp2dKY-_0 2024-09-12T19:29:42.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10342231556271430735', time=2024-09-12T20:45:29.711036+0000, chain.objs.size()=1 2024-09-12T19:29:42.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_._0oigz8252j4_oXaZaqfNhc7Bo_ilve_0 2024-09-12T19:29:42.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12948546666634770985', time=2024-09-12T20:45:29.712880+0000, chain.objs.size()=1 2024-09-12T19:29:42.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.FJxn8mm-SNLJPyum4rK91fjqhP9uxFs_0 2024-09-12T19:29:42.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3770929832784386305', time=2024-09-12T20:45:29.872510+0000, chain.objs.size()=1 2024-09-12T19:29:42.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.EhpCHkoWRp6FyqSgeHu-cfUG_oFtyuY_0 2024-09-12T19:29:42.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12011542635295519178', time=2024-09-12T20:45:29.957508+0000, chain.objs.size()=1 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Uo65MysgaOoNnVBkP8ScZRxPZ35ANgf_0 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16833464294451066051', time=2024-09-12T20:45:32.862952+0000, chain.objs.size()=1 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.399+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.6Jm6jP_EyrVa7BsOf2kiY8OW7ImJbAg_0 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.7867326085328555811', time=2024-09-12T20:45:33.508982+0000, chain.objs.size()=1 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.q2F4eWn-iuHTbUEJMSwdwRMTa4HvN_O_0 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.3139727797928136949', time=2024-09-12T20:45:36.806768+0000, chain.objs.size()=1 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.dRI6aQrl0DcvRBtPDYormWf17RzVEKZ_0 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.951947939379987622', time=2024-09-12T20:45:37.830603+0000, chain.objs.size()=1 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.a7wLuucvZmDI-7m1JvyNFdB2GujVw-h_0 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10366407390517630549', time=2024-09-12T20:45:38.195072+0000, chain.objs.size()=1 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.Ye46czruliaIsoMefnpGi1JLCs_1f-P_0 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1595440342669559360', time=2024-09-12T20:45:38.200190+0000, chain.objs.size()=1 2024-09-12T19:29:42.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.1tNomVtIKwAmC6ujXMAwOyeDMl7seBk_0 2024-09-12T19:29:42.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.17190023943771627923', time=2024-09-12T20:45:38.291523+0000, chain.objs.size()=1 2024-09-12T19:29:42.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.tJl04rm1XfI-jWjPXsGFWJK6sMVw4pB_0 2024-09-12T19:29:42.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.11345790120636473431', time=2024-09-12T20:45:38.343348+0000, chain.objs.size()=1 2024-09-12T19:29:42.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.324__shadow_.8er2ILmyyLNsP_k930C2P6R7pHL9LRG_0 2024-09-12T19:29:42.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12284759561570432104', time=2024-09-12T20:45:47.654253+0000, chain.objs.size()=1 2024-09-12T19:29:42.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.329__shadow_.UOiTYQzgFF35_NcKRC266Bu2040PfrZ_0 2024-09-12T19:29:42.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2342414565044223260', time=2024-09-12T20:45:50.031334+0000, chain.objs.size()=1 2024-09-12T19:29:42.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.330__shadow_.TFroPA4Je01UDnYTumsH5ScNG3qsCW9_0 2024-09-12T19:29:42.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.4031108145633106259', time=2024-09-12T20:50:03.606199+0000, chain.objs.size()=1 2024-09-12T19:29:42.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.455__shadow_.xC6Kpi85sx8DpR6tTrHaDw3G3EFQmLM_0 2024-09-12T19:29:42.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.403+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51077 2024-09-12T19:29:42.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T19:29:42.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.2929773179109341590', time=2024-09-12T20:50:15.666061+0000, chain.objs.size()=1 2024-09-12T19:29:42.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.459__shadow_.hi3ydIXnwi4KpHkx17__pYeJc_uHy7w_0 2024-09-12T19:29:42.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.9534129461501027664', time=2024-09-12T20:50:24.577559+0000, chain.objs.size()=1 2024-09-12T19:29:42.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.462__shadow_.o6guQxUj-_GpPygmCmP6KaniuLuBd13_0 2024-09-12T19:29:42.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6284440129093045171', time=2024-09-12T20:52:49.838749+0000, chain.objs.size()=1 2024-09-12T19:29:42.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.514__shadow_.xvmUskMGPuk2kMXDZT5s36ILkSjWlgN_0 2024-09-12T19:29:42.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.6330621467054994508', time=2024-09-12T20:53:10.057447+0000, chain.objs.size()=1 2024-09-12T19:29:42.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.518__multipart_mymultipart.2~6XMDvymC19sZRxTfXW5SZPV-lbLNc0D.1 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10180958494227139405', time=2024-09-12T20:54:39.614598+0000, chain.objs.size()=1 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.520__shadow:V0wYb5.ANSDGFTlh4P.BC1UF1J.udtH_.DwXC5pv7hFYZczevhKkfVlzYN7ZLwIL_0 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.10094129903348452868', time=2024-09-12T21:03:11.666202+0000, chain.objs.size()=1 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:xpuwFLZIeHWkJcVK7duZ1esayxwqnH-_.TX92SbXwliPSM2_TSbwHfL6VEYImHie_0 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.8389748499086859905', time=2024-09-12T21:03:16.689845+0000, chain.objs.size()=1 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.569__shadow:KJQMVsaXz2LC2xknQm0tJm.cHGRd8Iu_.UBNWvWaxXB0ZxfaK0m3eOXOy4ICuDTv_0 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.12709497769659445615', time=2024-09-12T21:03:37.242678+0000, chain.objs.size()=1 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.572__shadow:SGswutdO7nBhLjs-F5LLD3sRaOZ19MW_.rHaeRwMPzRzVUeF9I0kpKME5vlpNcpf_0 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.14413236996123042111', time=2024-09-12T21:04:28.165136+0000, chain.objs.size()=1 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.577__shadow:mQofuLQu-GLKYijfvbhvcP5o1HhqNqK_.fdt-OhQD-OtC5Qn-U8vDitstr422_gj_0 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.16241819600196577393', time=2024-09-12T21:05:54.904352+0000, chain.objs.size()=1 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.579__shadow:yVgIqFrzZYkNRV0MdqGkd58H6PWockU_.Kpt_o3d_DodmgY_k9cVnCnTx6NWYra5_0 2024-09-12T19:29:42.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.15855071957181206745', time=2024-09-12T21:06:55.271329+0000, chain.objs.size()=1 2024-09-12T19:29:42.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.605__shadow_.Pbwfatdy0ODJNBwBMGivi2ETzeh5T6-_0 2024-09-12T19:29:42.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.1715043655963858017', time=2024-09-12T21:16:39.580401+0000, chain.objs.size()=1 2024-09-12T19:29:42.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.679__shadow_.GuxzQJYeqzav3IvaAtbzF5-ZYnhAEzm_0 2024-09-12T19:29:42.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 20 garbage collection: RGWGC::process iterating over entry tag='98539659-fdaf-41ce-847d-239ff89323af.4641.5903083970650306101', time=2024-09-12T21:18:16.522218+0000, chain.objs.size()=1 2024-09-12T19:29:42.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.407+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:98539659-fdaf-41ce-847d-239ff89323af.4641.719__shadow_.aB-ArNWBDJTSxiQkOM8H0XhI2EWdgUk_0 2024-09-12T19:29:42.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.411+0000 7f1deb59e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:29:42.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.411+0000 7f1c9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:29:42.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.415+0000 7f1deb59e9c0 20 remove_watcher() i=0 2024-09-12T19:29:42.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.415+0000 7f1deb59e9c0 2 removed watcher, disabling cache 2024-09-12T19:29:42.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.415+0000 7f1deb59e9c0 20 remove_watcher() i=1 2024-09-12T19:29:42.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.415+0000 7f1deb59e9c0 20 remove_watcher() i=2 2024-09-12T19:29:42.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.419+0000 7f1deb59e9c0 20 remove_watcher() i=3 2024-09-12T19:29:42.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.419+0000 7f1deb59e9c0 20 remove_watcher() i=4 2024-09-12T19:29:42.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.419+0000 7f1deb59e9c0 20 remove_watcher() i=5 2024-09-12T19:29:42.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.423+0000 7f1deb59e9c0 20 remove_watcher() i=6 2024-09-12T19:29:42.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T19:29:42.423+0000 7f1deb59e9c0 20 remove_watcher() i=7 2024-09-12T19:29:42.437 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T19:29:42.447 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T19:29:42.485 DEBUG:teuthology.orchestra.run.smithi097:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T19:29:42.532 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T19:29:42.580 DEBUG:teuthology.orchestra.run.smithi097:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T19:29:42.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-12T19:29:42.684 DEBUG:teuthology.orchestra.run.smithi097:> sudo update-ca-certificates 2024-09-12T19:29:42.741 INFO:teuthology.orchestra.run.smithi097.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T19:29:43.104 INFO:teuthology.orchestra.run.smithi097.stdout:0 added, 0 removed; done. 2024-09-12T19:29:43.105 INFO:teuthology.orchestra.run.smithi097.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T19:29:43.106 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:29:43.323 INFO:teuthology.orchestra.run.smithi097.stdout:done. 2024-09-12T19:29:43.323 INFO:teuthology.orchestra.run.smithi097.stdout:done. 2024-09-12T19:29:43.326 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T19:29:43.336 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T19:29:43.337 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:29:43.693 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:29:43.706 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-12T19:29:43.709 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":3661,"stamp":"2024-09-12T19:29:43.214498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668444752,"num_objects":4995,"num_object_clones":0,"num_object_copies":9990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4995,"num_whiteouts":0,"num_read":290634,"num_read_kb":2523158,"num_write":159492,"num_write_kb":2342719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":204,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13727,"ondisk_log_size":13727,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2728016,"kb_used_data":1365392,"kb_used_omap":12,"kb_used_meta":1362483,"kb_avail":752246704,"statfs":{"total":773094113280,"available":770300624896,"internally_reserved":0,"allocated":1398161408,"data_stored":1352728570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1395183152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008574"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.587902+0000","last_change":"2024-09-12T18:25:52.622405+0000","last_active":"2024-09-12T19:25:55.587902+0000","last_peered":"2024-09-12T19:25:55.587902+0000","last_clean":"2024-09-12T19:25:55.587902+0000","last_became_active":"2024-09-12T18:25:52.621735+0000","last_became_peered":"2024-09-12T18:25:52.621735+0000","last_unstale":"2024-09-12T19:25:55.587902+0000","last_undegraded":"2024-09-12T19:25:55.587902+0000","last_fullsized":"2024-09-12T19:25:55.587902+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:09.919704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.083326+0000","last_change":"2024-09-12T17:58:47.223973+0000","last_active":"2024-09-12T19:26:20.083326+0000","last_peered":"2024-09-12T19:26:20.083326+0000","last_clean":"2024-09-12T19:26:20.083326+0000","last_became_active":"2024-09-12T17:58:47.223202+0000","last_became_peered":"2024-09-12T17:58:47.223202+0000","last_unstale":"2024-09-12T19:26:20.083326+0000","last_undegraded":"2024-09-12T19:26:20.083326+0000","last_fullsized":"2024-09-12T19:26:20.083326+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:23.110262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.661108+0000","last_change":"2024-09-12T17:58:40.207149+0000","last_active":"2024-09-12T19:26:10.661108+0000","last_peered":"2024-09-12T19:26:10.661108+0000","last_clean":"2024-09-12T19:26:10.661108+0000","last_became_active":"2024-09-12T17:58:40.206469+0000","last_became_peered":"2024-09-12T17:58:40.206469+0000","last_unstale":"2024-09-12T19:26:10.661108+0000","last_undegraded":"2024-09-12T19:26:10.661108+0000","last_fullsized":"2024-09-12T19:26:10.661108+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:10.914751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'13","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.683354+0000","last_change":"2024-09-12T17:52:39.873196+0000","last_active":"2024-09-12T19:26:25.683354+0000","last_peered":"2024-09-12T19:26:25.683354+0000","last_clean":"2024-09-12T19:26:25.683354+0000","last_became_active":"2024-09-12T17:52:39.872356+0000","last_became_peered":"2024-09-12T17:52:39.872356+0000","last_unstale":"2024-09-12T19:26:25.683354+0000","last_undegraded":"2024-09-12T19:26:25.683354+0000","last_fullsized":"2024-09-12T19:26:25.683354+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:36.475086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.035593+0000","last_change":"2024-09-12T18:25:52.625279+0000","last_active":"2024-09-12T19:25:54.035593+0000","last_peered":"2024-09-12T19:25:54.035593+0000","last_clean":"2024-09-12T19:25:54.035593+0000","last_became_active":"2024-09-12T18:25:52.624565+0000","last_became_peered":"2024-09-12T18:25:52.624565+0000","last_unstale":"2024-09-12T19:25:54.035593+0000","last_undegraded":"2024-09-12T19:25:54.035593+0000","last_fullsized":"2024-09-12T19:25:54.035593+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:32.002014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'4","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241488+0000","last_change":"2024-09-12T17:58:47.249699+0000","last_active":"2024-09-12T19:26:20.241488+0000","last_peered":"2024-09-12T19:26:20.241488+0000","last_clean":"2024-09-12T19:26:20.241488+0000","last_became_active":"2024-09-12T17:58:47.249050+0000","last_became_peered":"2024-09-12T17:58:47.249050+0000","last_unstale":"2024-09-12T19:26:20.241488+0000","last_undegraded":"2024-09-12T19:26:20.241488+0000","last_fullsized":"2024-09-12T19:26:20.241488+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:09.406806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.248289+0000","last_change":"2024-09-12T17:58:40.210474+0000","last_active":"2024-09-12T19:26:10.248289+0000","last_peered":"2024-09-12T19:26:10.248289+0000","last_clean":"2024-09-12T19:26:10.248289+0000","last_became_active":"2024-09-12T17:58:40.209447+0000","last_became_peered":"2024-09-12T17:58:40.209447+0000","last_unstale":"2024-09-12T19:26:10.248289+0000","last_undegraded":"2024-09-12T19:26:10.248289+0000","last_fullsized":"2024-09-12T19:26:10.248289+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:51.043086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'14","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691311+0000","last_change":"2024-09-12T17:52:39.885082+0000","last_active":"2024-09-12T19:27:00.691311+0000","last_peered":"2024-09-12T19:27:00.691311+0000","last_clean":"2024-09-12T19:27:00.691311+0000","last_became_active":"2024-09-12T17:52:39.884327+0000","last_became_peered":"2024-09-12T17:52:39.884327+0000","last_unstale":"2024-09-12T19:27:00.691311+0000","last_undegraded":"2024-09-12T19:27:00.691311+0000","last_fullsized":"2024-09-12T19:27:00.691311+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:05.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.083157+0000","last_change":"2024-09-12T18:25:52.622449+0000","last_active":"2024-09-12T19:26:20.083157+0000","last_peered":"2024-09-12T19:26:20.083157+0000","last_clean":"2024-09-12T19:26:20.083157+0000","last_became_active":"2024-09-12T18:25:52.621796+0000","last_became_peered":"2024-09-12T18:25:52.621796+0000","last_unstale":"2024-09-12T19:26:20.083157+0000","last_undegraded":"2024-09-12T19:26:20.083157+0000","last_fullsized":"2024-09-12T19:26:20.083157+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:45.223769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'4","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250786+0000","last_change":"2024-09-12T17:58:47.240760+0000","last_active":"2024-09-12T19:26:20.250786+0000","last_peered":"2024-09-12T19:26:20.250786+0000","last_clean":"2024-09-12T19:26:20.250786+0000","last_became_active":"2024-09-12T17:58:47.239390+0000","last_became_peered":"2024-09-12T17:58:47.239390+0000","last_unstale":"2024-09-12T19:26:20.250786+0000","last_undegraded":"2024-09-12T19:26:20.250786+0000","last_fullsized":"2024-09-12T19:26:20.250786+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:08.068553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'2","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671750+0000","last_change":"2024-09-12T17:58:40.194349+0000","last_active":"2024-09-12T19:26:55.671750+0000","last_peered":"2024-09-12T19:26:55.671750+0000","last_clean":"2024-09-12T19:26:55.671750+0000","last_became_active":"2024-09-12T17:58:40.193462+0000","last_became_peered":"2024-09-12T17:58:40.193462+0000","last_unstale":"2024-09-12T19:26:55.671750+0000","last_undegraded":"2024-09-12T19:26:55.671750+0000","last_fullsized":"2024-09-12T19:26:55.671750+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:14.830909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1108940,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1083,"num_write":2,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'6","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026309+0000","last_change":"2024-09-12T17:52:39.872689+0000","last_active":"2024-09-12T19:25:09.026309+0000","last_peered":"2024-09-12T19:25:09.026309+0000","last_clean":"2024-09-12T19:25:09.026309+0000","last_became_active":"2024-09-12T17:52:39.871998+0000","last_became_peered":"2024-09-12T17:52:39.871998+0000","last_unstale":"2024-09-12T19:25:09.026309+0000","last_undegraded":"2024-09-12T19:25:09.026309+0000","last_fullsized":"2024-09-12T19:25:09.026309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:54.365755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255185+0000","last_change":"2024-09-12T18:25:52.613287+0000","last_active":"2024-09-12T19:26:40.255185+0000","last_peered":"2024-09-12T19:26:40.255185+0000","last_clean":"2024-09-12T19:26:40.255185+0000","last_became_active":"2024-09-12T18:25:52.612472+0000","last_became_peered":"2024-09-12T18:25:52.612472+0000","last_unstale":"2024-09-12T19:26:40.255185+0000","last_undegraded":"2024-09-12T19:26:40.255185+0000","last_fullsized":"2024-09-12T19:26:40.255185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:42.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"262'5","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263726+0000","last_change":"2024-09-12T17:58:47.248310+0000","last_active":"2024-09-12T19:27:15.263726+0000","last_peered":"2024-09-12T19:27:15.263726+0000","last_clean":"2024-09-12T19:27:15.263726+0000","last_became_active":"2024-09-12T17:58:47.247496+0000","last_became_peered":"2024-09-12T17:58:47.247496+0000","last_unstale":"2024-09-12T19:27:15.263726+0000","last_undegraded":"2024-09-12T19:27:15.263726+0000","last_fullsized":"2024-09-12T19:27:15.263726+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:24.161042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'11","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.081400+0000","last_change":"2024-09-12T17:58:40.214834+0000","last_active":"2024-09-12T19:26:10.081400+0000","last_peered":"2024-09-12T19:26:10.081400+0000","last_clean":"2024-09-12T19:26:10.081400+0000","last_became_active":"2024-09-12T17:58:40.207945+0000","last_became_peered":"2024-09-12T17:58:40.207945+0000","last_unstale":"2024-09-12T19:26:10.081400+0000","last_undegraded":"2024-09-12T19:26:10.081400+0000","last_fullsized":"2024-09-12T19:26:10.081400+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:52.444564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":21,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'37","reported_seq":169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026256+0000","last_change":"2024-09-12T17:52:39.871937+0000","last_active":"2024-09-12T19:25:09.026256+0000","last_peered":"2024-09-12T19:25:09.026256+0000","last_clean":"2024-09-12T19:25:09.026256+0000","last_became_active":"2024-09-12T17:52:39.871148+0000","last_became_peered":"2024-09-12T17:52:39.871148+0000","last_unstale":"2024-09-12T19:25:09.026256+0000","last_undegraded":"2024-09-12T19:25:09.026256+0000","last_fullsized":"2024-09-12T19:25:09.026256+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:45.467030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":131,"num_write":69,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.659086+0000","last_change":"2024-09-12T18:25:52.605404+0000","last_active":"2024-09-12T19:26:00.659086+0000","last_peered":"2024-09-12T19:26:00.659086+0000","last_clean":"2024-09-12T19:26:00.659086+0000","last_became_active":"2024-09-12T18:25:52.604589+0000","last_became_peered":"2024-09-12T18:25:52.604589+0000","last_unstale":"2024-09-12T19:26:00.659086+0000","last_undegraded":"2024-09-12T19:26:00.659086+0000","last_fullsized":"2024-09-12T19:26:00.659086+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.091248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.590632+0000","last_change":"2024-09-12T17:58:47.243839+0000","last_active":"2024-09-12T19:26:10.590632+0000","last_peered":"2024-09-12T19:26:10.590632+0000","last_clean":"2024-09-12T19:26:10.590632+0000","last_became_active":"2024-09-12T17:58:47.242756+0000","last_became_peered":"2024-09-12T17:58:47.242756+0000","last_unstale":"2024-09-12T19:26:10.590632+0000","last_undegraded":"2024-09-12T19:26:10.590632+0000","last_fullsized":"2024-09-12T19:26:10.590632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:13.909298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"262'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.241656+0000","last_change":"2024-09-12T17:58:40.211442+0000","last_active":"2024-09-12T19:25:40.241656+0000","last_peered":"2024-09-12T19:25:40.241656+0000","last_clean":"2024-09-12T19:25:40.241656+0000","last_became_active":"2024-09-12T17:58:40.202787+0000","last_became_peered":"2024-09-12T17:58:40.202787+0000","last_unstale":"2024-09-12T19:25:40.241656+0000","last_undegraded":"2024-09-12T19:25:40.241656+0000","last_fullsized":"2024-09-12T19:25:40.241656+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.258488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'30","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026173+0000","last_change":"2024-09-12T17:52:39.889339+0000","last_active":"2024-09-12T19:25:09.026173+0000","last_peered":"2024-09-12T19:25:09.026173+0000","last_clean":"2024-09-12T19:25:09.026173+0000","last_became_active":"2024-09-12T17:52:39.888092+0000","last_became_peered":"2024-09-12T17:52:39.888092+0000","last_unstale":"2024-09-12T19:25:09.026173+0000","last_undegraded":"2024-09-12T19:25:09.026173+0000","last_fullsized":"2024-09-12T19:25:09.026173+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:52.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682167+0000","last_change":"2024-09-12T18:25:52.615541+0000","last_active":"2024-09-12T19:26:20.682167+0000","last_peered":"2024-09-12T19:26:20.682167+0000","last_clean":"2024-09-12T19:26:20.682167+0000","last_became_active":"2024-09-12T18:25:52.614862+0000","last_became_peered":"2024-09-12T18:25:52.614862+0000","last_unstale":"2024-09-12T19:26:20.682167+0000","last_undegraded":"2024-09-12T19:26:20.682167+0000","last_fullsized":"2024-09-12T19:26:20.682167+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:20.974947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.346428+0000","last_change":"2024-09-12T17:58:47.251966+0000","last_active":"2024-09-12T19:25:50.346428+0000","last_peered":"2024-09-12T19:25:50.346428+0000","last_clean":"2024-09-12T19:25:50.346428+0000","last_became_active":"2024-09-12T17:58:47.246322+0000","last_became_peered":"2024-09-12T17:58:47.246322+0000","last_unstale":"2024-09-12T19:25:50.346428+0000","last_undegraded":"2024-09-12T19:25:50.346428+0000","last_fullsized":"2024-09-12T19:25:50.346428+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:04.147241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'3","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.351418+0000","last_change":"2024-09-12T17:58:40.207847+0000","last_active":"2024-09-12T19:26:10.351418+0000","last_peered":"2024-09-12T19:26:10.351418+0000","last_clean":"2024-09-12T19:26:10.351418+0000","last_became_active":"2024-09-12T17:58:40.207064+0000","last_became_peered":"2024-09-12T17:58:40.207064+0000","last_unstale":"2024-09-12T19:26:10.351418+0000","last_undegraded":"2024-09-12T19:26:10.351418+0000","last_fullsized":"2024-09-12T19:26:10.351418+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:41.646154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.225969+0000","last_change":"2024-09-12T17:52:39.884527+0000","last_active":"2024-09-12T19:25:10.225969+0000","last_peered":"2024-09-12T19:25:10.225969+0000","last_clean":"2024-09-12T19:25:10.225969+0000","last_became_active":"2024-09-12T17:52:39.883689+0000","last_became_peered":"2024-09-12T17:52:39.883689+0000","last_unstale":"2024-09-12T19:25:10.225969+0000","last_undegraded":"2024-09-12T19:25:10.225969+0000","last_fullsized":"2024-09-12T19:25:10.225969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:21.651937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.235695+0000","last_change":"2024-09-12T18:25:52.605313+0000","last_active":"2024-09-12T19:25:55.235695+0000","last_peered":"2024-09-12T19:25:55.235695+0000","last_clean":"2024-09-12T19:25:55.235695+0000","last_became_active":"2024-09-12T18:25:52.598221+0000","last_became_peered":"2024-09-12T18:25:52.598221+0000","last_unstale":"2024-09-12T19:25:55.235695+0000","last_undegraded":"2024-09-12T19:25:55.235695+0000","last_fullsized":"2024-09-12T19:25:55.235695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.818370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241434+0000","last_change":"2024-09-12T17:58:47.247385+0000","last_active":"2024-09-12T19:26:20.241434+0000","last_peered":"2024-09-12T19:26:20.241434+0000","last_clean":"2024-09-12T19:26:20.241434+0000","last_became_active":"2024-09-12T17:58:47.238781+0000","last_became_peered":"2024-09-12T17:58:47.238781+0000","last_unstale":"2024-09-12T19:26:20.241434+0000","last_undegraded":"2024-09-12T19:26:20.241434+0000","last_fullsized":"2024-09-12T19:26:20.241434+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:59.988556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.590718+0000","last_change":"2024-09-12T17:58:40.188716+0000","last_active":"2024-09-12T19:26:10.590718+0000","last_peered":"2024-09-12T19:26:10.590718+0000","last_clean":"2024-09-12T19:26:10.590718+0000","last_became_active":"2024-09-12T17:58:40.187973+0000","last_became_peered":"2024-09-12T17:58:40.187973+0000","last_unstale":"2024-09-12T19:26:10.590718+0000","last_undegraded":"2024-09-12T19:26:10.590718+0000","last_fullsized":"2024-09-12T19:26:10.590718+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:19.654518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'31","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675055+0000","last_change":"2024-09-12T17:52:39.892332+0000","last_active":"2024-09-12T19:27:10.675055+0000","last_peered":"2024-09-12T19:27:10.675055+0000","last_clean":"2024-09-12T19:27:10.675055+0000","last_became_active":"2024-09-12T17:52:39.891830+0000","last_became_peered":"2024-09-12T17:52:39.891830+0000","last_unstale":"2024-09-12T19:27:10.675055+0000","last_undegraded":"2024-09-12T19:27:10.675055+0000","last_fullsized":"2024-09-12T19:27:10.675055+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:19.516571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.588010+0000","last_change":"2024-09-12T18:25:52.607506+0000","last_active":"2024-09-12T19:25:55.588010+0000","last_peered":"2024-09-12T19:25:55.588010+0000","last_clean":"2024-09-12T19:25:55.588010+0000","last_became_active":"2024-09-12T18:25:52.606714+0000","last_became_peered":"2024-09-12T18:25:52.606714+0000","last_unstale":"2024-09-12T19:25:55.588010+0000","last_undegraded":"2024-09-12T19:25:55.588010+0000","last_fullsized":"2024-09-12T19:25:55.588010+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:29.094403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'3","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.663384+0000","last_change":"2024-09-12T17:58:47.251261+0000","last_active":"2024-09-12T19:26:20.663384+0000","last_peered":"2024-09-12T19:26:20.663384+0000","last_clean":"2024-09-12T19:26:20.663384+0000","last_became_active":"2024-09-12T17:58:47.250364+0000","last_became_peered":"2024-09-12T17:58:47.250364+0000","last_unstale":"2024-09-12T19:26:20.663384+0000","last_undegraded":"2024-09-12T19:26:20.663384+0000","last_fullsized":"2024-09-12T19:26:20.663384+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:18.815473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:09.038794+0000","last_change":"2024-09-12T17:58:40.212846+0000","last_active":"2024-09-12T19:26:09.038794+0000","last_peered":"2024-09-12T19:26:09.038794+0000","last_clean":"2024-09-12T19:26:09.038794+0000","last_became_active":"2024-09-12T17:58:40.212280+0000","last_became_peered":"2024-09-12T17:58:40.212280+0000","last_unstale":"2024-09-12T19:26:09.038794+0000","last_undegraded":"2024-09-12T19:26:09.038794+0000","last_fullsized":"2024-09-12T19:26:09.038794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:58.695339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'30","reported_seq":152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:54.048336+0000","last_change":"2024-09-12T17:52:39.871278+0000","last_active":"2024-09-12T19:26:54.048336+0000","last_peered":"2024-09-12T19:26:54.048336+0000","last_clean":"2024-09-12T19:26:54.048336+0000","last_became_active":"2024-09-12T17:52:39.870304+0000","last_became_peered":"2024-09-12T17:52:39.870304+0000","last_unstale":"2024-09-12T19:26:54.048336+0000","last_undegraded":"2024-09-12T19:26:54.048336+0000","last_fullsized":"2024-09-12T19:26:54.048336+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:38.765024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":59,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254085+0000","last_change":"2024-09-12T18:25:52.623401+0000","last_active":"2024-09-12T19:26:35.254085+0000","last_peered":"2024-09-12T19:26:35.254085+0000","last_clean":"2024-09-12T19:26:35.254085+0000","last_became_active":"2024-09-12T18:25:52.622842+0000","last_became_peered":"2024-09-12T18:25:52.622842+0000","last_unstale":"2024-09-12T19:26:35.254085+0000","last_undegraded":"2024-09-12T19:26:35.254085+0000","last_fullsized":"2024-09-12T19:26:35.254085+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:22.497623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.656697+0000","last_change":"2024-09-12T17:58:47.256168+0000","last_active":"2024-09-12T19:25:50.656697+0000","last_peered":"2024-09-12T19:25:50.656697+0000","last_clean":"2024-09-12T19:25:50.656697+0000","last_became_active":"2024-09-12T17:58:47.255379+0000","last_became_peered":"2024-09-12T17:58:47.255379+0000","last_unstale":"2024-09-12T19:25:50.656697+0000","last_undegraded":"2024-09-12T19:25:50.656697+0000","last_fullsized":"2024-09-12T19:25:50.656697+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:28.202469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.341509+0000","last_change":"2024-09-12T17:58:40.194167+0000","last_active":"2024-09-12T19:25:30.341509+0000","last_peered":"2024-09-12T19:25:30.341509+0000","last_clean":"2024-09-12T19:25:30.341509+0000","last_became_active":"2024-09-12T17:58:40.193471+0000","last_became_peered":"2024-09-12T17:58:40.193471+0000","last_unstale":"2024-09-12T19:25:30.341509+0000","last_undegraded":"2024-09-12T19:25:30.341509+0000","last_fullsized":"2024-09-12T19:25:30.341509+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:18.036549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'46","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690191+0000","last_change":"2024-09-12T17:52:39.883998+0000","last_active":"2024-09-12T19:26:55.690191+0000","last_peered":"2024-09-12T19:26:55.690191+0000","last_clean":"2024-09-12T19:26:55.690191+0000","last_became_active":"2024-09-12T17:52:39.883248+0000","last_became_peered":"2024-09-12T17:52:39.883248+0000","last_unstale":"2024-09-12T19:26:55.690191+0000","last_undegraded":"2024-09-12T19:26:55.690191+0000","last_fullsized":"2024-09-12T19:26:55.690191+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:59.309550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":156,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:34.044189+0000","last_change":"2024-09-12T18:25:52.612372+0000","last_active":"2024-09-12T19:26:34.044189+0000","last_peered":"2024-09-12T19:26:34.044189+0000","last_clean":"2024-09-12T19:26:34.044189+0000","last_became_active":"2024-09-12T18:25:52.611620+0000","last_became_peered":"2024-09-12T18:25:52.611620+0000","last_unstale":"2024-09-12T19:26:34.044189+0000","last_undegraded":"2024-09-12T19:26:34.044189+0000","last_fullsized":"2024-09-12T19:26:34.044189+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:49.193437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'6","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:35.240621+0000","last_change":"2024-09-12T17:58:47.250813+0000","last_active":"2024-09-12T19:25:35.240621+0000","last_peered":"2024-09-12T19:25:35.240621+0000","last_clean":"2024-09-12T19:25:35.240621+0000","last_became_active":"2024-09-12T17:58:47.249833+0000","last_became_peered":"2024-09-12T17:58:47.249833+0000","last_unstale":"2024-09-12T19:25:35.240621+0000","last_undegraded":"2024-09-12T19:25:35.240621+0000","last_fullsized":"2024-09-12T19:25:35.240621+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:00.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.584687+0000","last_change":"2024-09-12T17:58:40.204716+0000","last_active":"2024-09-12T19:25:40.584687+0000","last_peered":"2024-09-12T19:25:40.584687+0000","last_clean":"2024-09-12T19:25:40.584687+0000","last_became_active":"2024-09-12T17:58:40.203917+0000","last_became_peered":"2024-09-12T17:58:40.203917+0000","last_unstale":"2024-09-12T19:25:40.584687+0000","last_undegraded":"2024-09-12T19:25:40.584687+0000","last_fullsized":"2024-09-12T19:25:40.584687+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:29.039732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690138+0000","last_change":"2024-09-12T17:52:39.885011+0000","last_active":"2024-09-12T19:26:55.690138+0000","last_peered":"2024-09-12T19:26:55.690138+0000","last_clean":"2024-09-12T19:26:55.690138+0000","last_became_active":"2024-09-12T17:52:39.884285+0000","last_became_peered":"2024-09-12T17:52:39.884285+0000","last_unstale":"2024-09-12T19:26:55.690138+0000","last_undegraded":"2024-09-12T19:26:55.690138+0000","last_fullsized":"2024-09-12T19:26:55.690138+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:22.466454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.244671+0000","last_change":"2024-09-12T18:25:52.624010+0000","last_active":"2024-09-12T19:26:35.244671+0000","last_peered":"2024-09-12T19:26:35.244671+0000","last_clean":"2024-09-12T19:26:35.244671+0000","last_became_active":"2024-09-12T18:25:52.623502+0000","last_became_peered":"2024-09-12T18:25:52.623502+0000","last_unstale":"2024-09-12T19:26:35.244671+0000","last_undegraded":"2024-09-12T19:26:35.244671+0000","last_fullsized":"2024-09-12T19:26:35.244671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:54.401588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'4","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.656813+0000","last_change":"2024-09-12T17:58:47.257454+0000","last_active":"2024-09-12T19:25:50.656813+0000","last_peered":"2024-09-12T19:25:50.656813+0000","last_clean":"2024-09-12T19:25:50.656813+0000","last_became_active":"2024-09-12T17:58:47.256721+0000","last_became_peered":"2024-09-12T17:58:47.256721+0000","last_unstale":"2024-09-12T19:25:50.656813+0000","last_undegraded":"2024-09-12T19:25:50.656813+0000","last_fullsized":"2024-09-12T19:25:50.656813+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:39.335691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8428753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":16424,"num_write":9,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'1","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.654552+0000","last_change":"2024-09-12T17:58:40.199627+0000","last_active":"2024-09-12T19:25:40.654552+0000","last_peered":"2024-09-12T19:25:40.654552+0000","last_clean":"2024-09-12T19:25:40.654552+0000","last_became_active":"2024-09-12T17:58:40.198765+0000","last_became_peered":"2024-09-12T17:58:40.198765+0000","last_unstale":"2024-09-12T19:25:40.654552+0000","last_undegraded":"2024-09-12T19:25:40.654552+0000","last_fullsized":"2024-09-12T19:25:40.654552+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:37.234886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'58","reported_seq":224,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671649+0000","last_change":"2024-09-12T17:52:39.886405+0000","last_active":"2024-09-12T19:26:55.671649+0000","last_peered":"2024-09-12T19:26:55.671649+0000","last_clean":"2024-09-12T19:26:55.671649+0000","last_became_active":"2024-09-12T17:52:39.885875+0000","last_became_peered":"2024-09-12T17:52:39.885875+0000","last_unstale":"2024-09-12T19:26:55.671649+0000","last_undegraded":"2024-09-12T19:26:55.671649+0000","last_fullsized":"2024-09-12T19:26:55.671649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:42.953403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":205,"num_write":103,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.596249+0000","last_change":"2024-09-12T18:25:52.618187+0000","last_active":"2024-09-12T19:26:35.596249+0000","last_peered":"2024-09-12T19:26:35.596249+0000","last_clean":"2024-09-12T19:26:35.596249+0000","last_became_active":"2024-09-12T18:25:52.617665+0000","last_became_peered":"2024-09-12T18:25:52.617665+0000","last_unstale":"2024-09-12T19:26:35.596249+0000","last_undegraded":"2024-09-12T19:26:35.596249+0000","last_fullsized":"2024-09-12T19:26:35.596249+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:16.143458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'5","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586974+0000","last_change":"2024-09-12T17:58:47.254576+0000","last_active":"2024-09-12T19:25:50.586974+0000","last_peered":"2024-09-12T19:25:50.586974+0000","last_clean":"2024-09-12T19:25:50.586974+0000","last_became_active":"2024-09-12T17:58:47.253819+0000","last_became_peered":"2024-09-12T17:58:47.253819+0000","last_unstale":"2024-09-12T19:25:50.586974+0000","last_undegraded":"2024-09-12T19:25:50.586974+0000","last_fullsized":"2024-09-12T19:25:50.586974+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:16.422570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.241886+0000","last_change":"2024-09-12T17:58:40.208386+0000","last_active":"2024-09-12T19:25:40.241886+0000","last_peered":"2024-09-12T19:25:40.241886+0000","last_clean":"2024-09-12T19:25:40.241886+0000","last_became_active":"2024-09-12T17:58:40.202790+0000","last_became_peered":"2024-09-12T17:58:40.202790+0000","last_unstale":"2024-09-12T19:25:40.241886+0000","last_undegraded":"2024-09-12T19:25:40.241886+0000","last_fullsized":"2024-09-12T19:25:40.241886+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:41.561154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'30","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:30.356662+0000","last_change":"2024-09-12T17:52:39.872248+0000","last_active":"2024-09-12T19:26:30.356662+0000","last_peered":"2024-09-12T19:26:30.356662+0000","last_clean":"2024-09-12T19:26:30.356662+0000","last_became_active":"2024-09-12T17:52:39.871009+0000","last_became_peered":"2024-09-12T17:52:39.871009+0000","last_unstale":"2024-09-12T19:26:30.356662+0000","last_undegraded":"2024-09-12T19:26:30.356662+0000","last_fullsized":"2024-09-12T19:26:30.356662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:36.952465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250730+0000","last_change":"2024-09-12T18:25:52.620335+0000","last_active":"2024-09-12T19:26:20.250730+0000","last_peered":"2024-09-12T19:26:20.250730+0000","last_clean":"2024-09-12T19:26:20.250730+0000","last_became_active":"2024-09-12T18:25:52.617863+0000","last_became_peered":"2024-09-12T18:25:52.617863+0000","last_unstale":"2024-09-12T19:26:20.250730+0000","last_undegraded":"2024-09-12T19:26:20.250730+0000","last_fullsized":"2024-09-12T19:26:20.250730+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:38.215652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"262'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.234651+0000","last_change":"2024-09-12T17:58:47.248615+0000","last_active":"2024-09-12T19:25:10.234651+0000","last_peered":"2024-09-12T19:25:10.234651+0000","last_clean":"2024-09-12T19:25:10.234651+0000","last_became_active":"2024-09-12T17:58:47.247475+0000","last_became_peered":"2024-09-12T17:58:47.247475+0000","last_unstale":"2024-09-12T19:25:10.234651+0000","last_undegraded":"2024-09-12T19:25:10.234651+0000","last_fullsized":"2024-09-12T19:25:10.234651+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:38.703200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"265'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097114+0000","last_change":"2024-09-12T17:58:40.203206+0000","last_active":"2024-09-12T19:27:20.097114+0000","last_peered":"2024-09-12T19:27:20.097114+0000","last_clean":"2024-09-12T19:27:20.097114+0000","last_became_active":"2024-09-12T17:58:40.202141+0000","last_became_peered":"2024-09-12T17:58:40.202141+0000","last_unstale":"2024-09-12T19:27:20.097114+0000","last_undegraded":"2024-09-12T19:27:20.097114+0000","last_fullsized":"2024-09-12T19:27:20.097114+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:09.764989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'22","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.349102+0000","last_change":"2024-09-12T17:52:39.885280+0000","last_active":"2024-09-12T19:26:00.349102+0000","last_peered":"2024-09-12T19:26:00.349102+0000","last_clean":"2024-09-12T19:26:00.349102+0000","last_became_active":"2024-09-12T17:52:39.884686+0000","last_became_peered":"2024-09-12T17:52:39.884686+0000","last_unstale":"2024-09-12T19:26:00.349102+0000","last_undegraded":"2024-09-12T19:26:00.349102+0000","last_fullsized":"2024-09-12T19:26:00.349102+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:49.000832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041069+0000","last_change":"2024-09-12T18:25:52.613926+0000","last_active":"2024-09-12T19:26:19.041069+0000","last_peered":"2024-09-12T19:26:19.041069+0000","last_clean":"2024-09-12T19:26:19.041069+0000","last_became_active":"2024-09-12T18:25:52.611450+0000","last_became_peered":"2024-09-12T18:25:52.611450+0000","last_unstale":"2024-09-12T19:26:19.041069+0000","last_undegraded":"2024-09-12T19:26:19.041069+0000","last_fullsized":"2024-09-12T19:26:19.041069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:02.885475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'2","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.234527+0000","last_change":"2024-09-12T17:58:47.254616+0000","last_active":"2024-09-12T19:25:10.234527+0000","last_peered":"2024-09-12T19:25:10.234527+0000","last_clean":"2024-09-12T19:25:10.234527+0000","last_became_active":"2024-09-12T17:58:47.254061+0000","last_became_peered":"2024-09-12T17:58:47.254061+0000","last_unstale":"2024-09-12T19:25:10.234527+0000","last_undegraded":"2024-09-12T19:25:10.234527+0000","last_fullsized":"2024-09-12T19:25:10.234527+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:06.779952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'1","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.264682+0000","last_change":"2024-09-12T17:58:40.203937+0000","last_active":"2024-09-12T19:27:20.264682+0000","last_peered":"2024-09-12T19:27:20.264682+0000","last_clean":"2024-09-12T19:27:20.264682+0000","last_became_active":"2024-09-12T17:58:40.203144+0000","last_became_peered":"2024-09-12T17:58:40.203144+0000","last_unstale":"2024-09-12T19:27:20.264682+0000","last_undegraded":"2024-09-12T19:27:20.264682+0000","last_fullsized":"2024-09-12T19:27:20.264682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:57.360002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"262'16","reported_seq":117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.658972+0000","last_change":"2024-09-12T17:52:39.879536+0000","last_active":"2024-09-12T19:26:00.658972+0000","last_peered":"2024-09-12T19:26:00.658972+0000","last_clean":"2024-09-12T19:26:00.658972+0000","last_became_active":"2024-09-12T17:52:39.878797+0000","last_became_peered":"2024-09-12T17:52:39.878797+0000","last_unstale":"2024-09-12T19:26:00.658972+0000","last_undegraded":"2024-09-12T19:26:00.658972+0000","last_fullsized":"2024-09-12T19:26:00.658972+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:15.860760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.687851+0000","last_change":"2024-09-12T18:25:52.615680+0000","last_active":"2024-09-12T19:26:45.687851+0000","last_peered":"2024-09-12T19:26:45.687851+0000","last_clean":"2024-09-12T19:26:45.687851+0000","last_became_active":"2024-09-12T18:25:52.614949+0000","last_became_peered":"2024-09-12T18:25:52.614949+0000","last_unstale":"2024-09-12T19:26:45.687851+0000","last_undegraded":"2024-09-12T19:26:45.687851+0000","last_fullsized":"2024-09-12T19:26:45.687851+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:20.554312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.647849+0000","last_change":"2024-09-12T17:58:47.247578+0000","last_active":"2024-09-12T19:25:10.647849+0000","last_peered":"2024-09-12T19:25:10.647849+0000","last_clean":"2024-09-12T19:25:10.647849+0000","last_became_active":"2024-09-12T17:58:47.246916+0000","last_became_peered":"2024-09-12T17:58:47.246916+0000","last_unstale":"2024-09-12T19:25:10.647849+0000","last_undegraded":"2024-09-12T19:25:10.647849+0000","last_fullsized":"2024-09-12T19:25:10.647849+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.850549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"262'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097274+0000","last_change":"2024-09-12T17:58:40.208435+0000","last_active":"2024-09-12T19:27:20.097274+0000","last_peered":"2024-09-12T19:27:20.097274+0000","last_clean":"2024-09-12T19:27:20.097274+0000","last_became_active":"2024-09-12T17:58:40.207311+0000","last_became_peered":"2024-09-12T17:58:40.207311+0000","last_unstale":"2024-09-12T19:27:20.097274+0000","last_undegraded":"2024-09-12T19:27:20.097274+0000","last_fullsized":"2024-09-12T19:27:20.097274+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:09.258846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'29","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.236763+0000","last_change":"2024-09-12T17:52:39.867898+0000","last_active":"2024-09-12T19:26:00.236763+0000","last_peered":"2024-09-12T19:26:00.236763+0000","last_clean":"2024-09-12T19:26:00.236763+0000","last_became_active":"2024-09-12T17:52:39.867179+0000","last_became_peered":"2024-09-12T17:52:39.867179+0000","last_unstale":"2024-09-12T19:26:00.236763+0000","last_undegraded":"2024-09-12T19:26:00.236763+0000","last_fullsized":"2024-09-12T19:26:00.236763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:01.169877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":56,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041017+0000","last_change":"2024-09-12T18:25:52.612961+0000","last_active":"2024-09-12T19:26:19.041017+0000","last_peered":"2024-09-12T19:26:19.041017+0000","last_clean":"2024-09-12T19:26:19.041017+0000","last_became_active":"2024-09-12T18:25:52.610587+0000","last_became_peered":"2024-09-12T18:25:52.610587+0000","last_unstale":"2024-09-12T19:26:19.041017+0000","last_undegraded":"2024-09-12T19:26:19.041017+0000","last_fullsized":"2024-09-12T19:26:19.041017+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:48.847349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.336407+0000","last_change":"2024-09-12T17:58:47.251206+0000","last_active":"2024-09-12T19:25:10.336407+0000","last_peered":"2024-09-12T19:25:10.336407+0000","last_clean":"2024-09-12T19:25:10.336407+0000","last_became_active":"2024-09-12T17:58:47.245601+0000","last_became_peered":"2024-09-12T17:58:47.245601+0000","last_unstale":"2024-09-12T19:25:10.336407+0000","last_undegraded":"2024-09-12T19:25:10.336407+0000","last_fullsized":"2024-09-12T19:25:10.336407+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:19.101729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097320+0000","last_change":"2024-09-12T17:58:40.203425+0000","last_active":"2024-09-12T19:27:20.097320+0000","last_peered":"2024-09-12T19:27:20.097320+0000","last_clean":"2024-09-12T19:27:20.097320+0000","last_became_active":"2024-09-12T17:58:40.202408+0000","last_became_peered":"2024-09-12T17:58:40.202408+0000","last_unstale":"2024-09-12T19:27:20.097320+0000","last_undegraded":"2024-09-12T19:27:20.097320+0000","last_fullsized":"2024-09-12T19:27:20.097320+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:04.410943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":531,"num_write":4,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'108","reported_seq":441,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.658909+0000","last_change":"2024-09-12T17:52:39.881369+0000","last_active":"2024-09-12T19:26:00.658909+0000","last_peered":"2024-09-12T19:26:00.658909+0000","last_clean":"2024-09-12T19:26:00.658909+0000","last_became_active":"2024-09-12T17:52:39.880742+0000","last_became_peered":"2024-09-12T17:52:39.880742+0000","last_unstale":"2024-09-12T19:26:00.658909+0000","last_undegraded":"2024-09-12T19:26:00.658909+0000","last_fullsized":"2024-09-12T19:26:00.658909+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:12.083548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":720,"num_read_kb":486,"num_write":145,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258684+0000","last_change":"2024-09-12T18:25:52.605986+0000","last_active":"2024-09-12T19:26:55.258684+0000","last_peered":"2024-09-12T19:26:55.258684+0000","last_clean":"2024-09-12T19:26:55.258684+0000","last_became_active":"2024-09-12T18:25:52.605039+0000","last_became_peered":"2024-09-12T18:25:52.605039+0000","last_unstale":"2024-09-12T19:26:55.258684+0000","last_undegraded":"2024-09-12T19:26:55.258684+0000","last_fullsized":"2024-09-12T19:26:55.258684+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.770637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'6","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667072+0000","last_change":"2024-09-12T17:58:47.242884+0000","last_active":"2024-09-12T19:26:35.667072+0000","last_peered":"2024-09-12T19:26:35.667072+0000","last_clean":"2024-09-12T19:26:35.667072+0000","last_became_active":"2024-09-12T17:58:47.241778+0000","last_became_peered":"2024-09-12T17:58:47.241778+0000","last_unstale":"2024-09-12T19:26:35.667072+0000","last_undegraded":"2024-09-12T19:26:35.667072+0000","last_fullsized":"2024-09-12T19:26:35.667072+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:36.555666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":3074,"num_write":11,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242718+0000","last_change":"2024-09-12T17:58:40.196234+0000","last_active":"2024-09-12T19:26:25.242718+0000","last_peered":"2024-09-12T19:26:25.242718+0000","last_clean":"2024-09-12T19:26:25.242718+0000","last_became_active":"2024-09-12T17:58:40.195309+0000","last_became_peered":"2024-09-12T17:58:40.195309+0000","last_unstale":"2024-09-12T19:26:25.242718+0000","last_undegraded":"2024-09-12T19:26:25.242718+0000","last_fullsized":"2024-09-12T19:26:25.242718+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:30.098876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"262'110","reported_seq":458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:25.678784+0000","last_change":"2024-09-12T17:52:39.886824+0000","last_active":"2024-09-12T19:27:25.678784+0000","last_peered":"2024-09-12T19:27:25.678784+0000","last_clean":"2024-09-12T19:27:25.678784+0000","last_became_active":"2024-09-12T17:52:39.886185+0000","last_became_peered":"2024-09-12T17:52:39.886185+0000","last_unstale":"2024-09-12T19:27:25.678784+0000","last_undegraded":"2024-09-12T19:27:25.678784+0000","last_fullsized":"2024-09-12T19:27:25.678784+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:31.714670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":756,"num_read_kb":514,"num_write":140,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.088040+0000","last_change":"2024-09-12T18:25:52.624391+0000","last_active":"2024-09-12T19:26:40.088040+0000","last_peered":"2024-09-12T19:26:40.088040+0000","last_clean":"2024-09-12T19:26:40.088040+0000","last_became_active":"2024-09-12T18:25:52.623444+0000","last_became_peered":"2024-09-12T18:25:52.623444+0000","last_unstale":"2024-09-12T19:26:40.088040+0000","last_undegraded":"2024-09-12T19:26:40.088040+0000","last_fullsized":"2024-09-12T19:26:40.088040+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:41.418750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667006+0000","last_change":"2024-09-12T17:58:47.255347+0000","last_active":"2024-09-12T19:26:35.667006+0000","last_peered":"2024-09-12T19:26:35.667006+0000","last_clean":"2024-09-12T19:26:35.667006+0000","last_became_active":"2024-09-12T17:58:47.254273+0000","last_became_peered":"2024-09-12T17:58:47.254273+0000","last_unstale":"2024-09-12T19:26:35.667006+0000","last_undegraded":"2024-09-12T19:26:35.667006+0000","last_fullsized":"2024-09-12T19:26:35.667006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:34.502761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'1","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:24.042159+0000","last_change":"2024-09-12T17:58:40.202847+0000","last_active":"2024-09-12T19:26:24.042159+0000","last_peered":"2024-09-12T19:26:24.042159+0000","last_clean":"2024-09-12T19:26:24.042159+0000","last_became_active":"2024-09-12T17:58:40.202027+0000","last_became_peered":"2024-09-12T17:58:40.202027+0000","last_unstale":"2024-09-12T19:26:24.042159+0000","last_undegraded":"2024-09-12T19:26:24.042159+0000","last_fullsized":"2024-09-12T19:26:24.042159+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:12.912226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'31","reported_seq":153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366551+0000","last_change":"2024-09-12T17:52:39.877904+0000","last_active":"2024-09-12T19:27:10.366551+0000","last_peered":"2024-09-12T19:27:10.366551+0000","last_clean":"2024-09-12T19:27:10.366551+0000","last_became_active":"2024-09-12T17:52:39.877206+0000","last_became_peered":"2024-09-12T17:52:39.877206+0000","last_unstale":"2024-09-12T19:27:10.366551+0000","last_undegraded":"2024-09-12T19:27:10.366551+0000","last_fullsized":"2024-09-12T19:27:10.366551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.931327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":97,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.357743+0000","last_change":"2024-09-12T18:25:52.620716+0000","last_active":"2024-09-12T19:26:35.357743+0000","last_peered":"2024-09-12T19:26:35.357743+0000","last_clean":"2024-09-12T19:26:35.357743+0000","last_became_active":"2024-09-12T18:25:52.620045+0000","last_became_peered":"2024-09-12T18:25:52.620045+0000","last_unstale":"2024-09-12T19:26:35.357743+0000","last_undegraded":"2024-09-12T19:26:35.357743+0000","last_fullsized":"2024-09-12T19:26:35.357743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:58.464498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670475+0000","last_change":"2024-09-12T17:58:47.253752+0000","last_active":"2024-09-12T19:26:50.670475+0000","last_peered":"2024-09-12T19:26:50.670475+0000","last_clean":"2024-09-12T19:26:50.670475+0000","last_became_active":"2024-09-12T17:58:47.252966+0000","last_became_peered":"2024-09-12T17:58:47.252966+0000","last_unstale":"2024-09-12T19:26:50.670475+0000","last_undegraded":"2024-09-12T19:26:50.670475+0000","last_fullsized":"2024-09-12T19:26:50.670475+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:12.503210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664783+0000","last_change":"2024-09-12T17:58:40.198879+0000","last_active":"2024-09-12T19:26:25.664783+0000","last_peered":"2024-09-12T19:26:25.664783+0000","last_clean":"2024-09-12T19:26:25.664783+0000","last_became_active":"2024-09-12T17:58:40.198161+0000","last_became_peered":"2024-09-12T17:58:40.198161+0000","last_unstale":"2024-09-12T19:26:25.664783+0000","last_undegraded":"2024-09-12T19:26:25.664783+0000","last_fullsized":"2024-09-12T19:26:25.664783+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:50.706791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":11,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'31","reported_seq":154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.094779+0000","last_change":"2024-09-12T17:52:39.867437+0000","last_active":"2024-09-12T19:27:10.094779+0000","last_peered":"2024-09-12T19:27:10.094779+0000","last_clean":"2024-09-12T19:27:10.094779+0000","last_became_active":"2024-09-12T17:52:39.866342+0000","last_became_peered":"2024-09-12T17:52:39.866342+0000","last_unstale":"2024-09-12T19:27:10.094779+0000","last_undegraded":"2024-09-12T19:27:10.094779+0000","last_fullsized":"2024-09-12T19:27:10.094779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:36.550336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":107,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.086529+0000","last_change":"2024-09-12T18:25:52.601482+0000","last_active":"2024-09-12T19:26:35.086529+0000","last_peered":"2024-09-12T19:26:35.086529+0000","last_clean":"2024-09-12T19:26:35.086529+0000","last_became_active":"2024-09-12T18:25:52.599679+0000","last_became_peered":"2024-09-12T18:25:52.599679+0000","last_unstale":"2024-09-12T19:26:35.086529+0000","last_undegraded":"2024-09-12T19:26:35.086529+0000","last_fullsized":"2024-09-12T19:26:35.086529+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:02.845957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'1","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254188+0000","last_change":"2024-09-12T17:58:47.256589+0000","last_active":"2024-09-12T19:26:35.254188+0000","last_peered":"2024-09-12T19:26:35.254188+0000","last_clean":"2024-09-12T19:26:35.254188+0000","last_became_active":"2024-09-12T17:58:47.255891+0000","last_became_peered":"2024-09-12T17:58:47.255891+0000","last_unstale":"2024-09-12T19:26:35.254188+0000","last_undegraded":"2024-09-12T19:26:35.254188+0000","last_fullsized":"2024-09-12T19:26:35.254188+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:52.933367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"262'3","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668287+0000","last_change":"2024-09-12T17:58:40.212187+0000","last_active":"2024-09-12T19:26:40.668287+0000","last_peered":"2024-09-12T19:26:40.668287+0000","last_clean":"2024-09-12T19:26:40.668287+0000","last_became_active":"2024-09-12T17:58:40.211450+0000","last_became_peered":"2024-09-12T17:58:40.211450+0000","last_unstale":"2024-09-12T19:26:40.668287+0000","last_undegraded":"2024-09-12T19:26:40.668287+0000","last_fullsized":"2024-09-12T19:26:40.668287+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:21.169200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'25","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:09.052206+0000","last_change":"2024-09-12T17:52:39.866705+0000","last_active":"2024-09-12T19:27:09.052206+0000","last_peered":"2024-09-12T19:27:09.052206+0000","last_clean":"2024-09-12T19:27:09.052206+0000","last_became_active":"2024-09-12T17:52:39.865914+0000","last_became_peered":"2024-09-12T17:52:39.865914+0000","last_unstale":"2024-09-12T19:27:09.052206+0000","last_undegraded":"2024-09-12T19:27:09.052206+0000","last_fullsized":"2024-09-12T19:27:09.052206+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:43.382459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255364+0000","last_change":"2024-09-12T18:25:52.613354+0000","last_active":"2024-09-12T19:26:40.255364+0000","last_peered":"2024-09-12T19:26:40.255364+0000","last_clean":"2024-09-12T19:26:40.255364+0000","last_became_active":"2024-09-12T18:25:52.612421+0000","last_became_peered":"2024-09-12T18:25:52.612421+0000","last_unstale":"2024-09-12T19:26:40.255364+0000","last_undegraded":"2024-09-12T19:26:40.255364+0000","last_fullsized":"2024-09-12T19:26:40.255364+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:29.095745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'1","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.341378+0000","last_change":"2024-09-12T17:58:47.246522+0000","last_active":"2024-09-12T19:25:30.341378+0000","last_peered":"2024-09-12T19:25:30.341378+0000","last_clean":"2024-09-12T19:25:30.341378+0000","last_became_active":"2024-09-12T17:58:47.238172+0000","last_became_peered":"2024-09-12T17:58:47.238172+0000","last_unstale":"2024-09-12T19:25:30.341378+0000","last_undegraded":"2024-09-12T19:25:30.341378+0000","last_fullsized":"2024-09-12T19:25:30.341378+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:56.402000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.679708+0000","last_change":"2024-09-12T17:58:40.194862+0000","last_active":"2024-09-12T19:27:30.679708+0000","last_peered":"2024-09-12T19:27:30.679708+0000","last_clean":"2024-09-12T19:27:30.679708+0000","last_became_active":"2024-09-12T17:58:40.194093+0000","last_became_peered":"2024-09-12T17:58:40.194093+0000","last_unstale":"2024-09-12T19:27:30.679708+0000","last_undegraded":"2024-09-12T19:27:30.679708+0000","last_fullsized":"2024-09-12T19:27:30.679708+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:55.158370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'38","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:09.052156+0000","last_change":"2024-09-12T17:52:39.888669+0000","last_active":"2024-09-12T19:27:09.052156+0000","last_peered":"2024-09-12T19:27:09.052156+0000","last_clean":"2024-09-12T19:27:09.052156+0000","last_became_active":"2024-09-12T17:52:39.887302+0000","last_became_peered":"2024-09-12T17:52:39.887302+0000","last_unstale":"2024-09-12T19:27:09.052156+0000","last_undegraded":"2024-09-12T19:27:09.052156+0000","last_fullsized":"2024-09-12T19:27:09.052156+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:45.562829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":146,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249879+0000","last_change":"2024-09-12T18:25:52.611745+0000","last_active":"2024-09-12T19:27:00.249879+0000","last_peered":"2024-09-12T19:27:00.249879+0000","last_clean":"2024-09-12T19:27:00.249879+0000","last_became_active":"2024-09-12T18:25:52.611022+0000","last_became_peered":"2024-09-12T18:25:52.611022+0000","last_unstale":"2024-09-12T19:27:00.249879+0000","last_undegraded":"2024-09-12T19:27:00.249879+0000","last_fullsized":"2024-09-12T19:27:00.249879+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:05.067276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"262'5","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.230402+0000","last_change":"2024-09-12T17:58:47.248839+0000","last_active":"2024-09-12T19:25:30.230402+0000","last_peered":"2024-09-12T19:25:30.230402+0000","last_clean":"2024-09-12T19:25:30.230402+0000","last_became_active":"2024-09-12T17:58:47.247599+0000","last_became_peered":"2024-09-12T17:58:47.247599+0000","last_unstale":"2024-09-12T19:25:30.230402+0000","last_undegraded":"2024-09-12T19:25:30.230402+0000","last_fullsized":"2024-09-12T19:25:30.230402+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:14.680201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.267041+0000","last_change":"2024-09-12T17:58:40.203966+0000","last_active":"2024-09-12T19:27:30.267041+0000","last_peered":"2024-09-12T19:27:30.267041+0000","last_clean":"2024-09-12T19:27:30.267041+0000","last_became_active":"2024-09-12T17:58:40.203177+0000","last_became_peered":"2024-09-12T17:58:40.203177+0000","last_unstale":"2024-09-12T19:27:30.267041+0000","last_undegraded":"2024-09-12T19:27:30.267041+0000","last_fullsized":"2024-09-12T19:27:30.267041+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:05.344996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'30","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.240017+0000","last_change":"2024-09-12T17:52:39.878505+0000","last_active":"2024-09-12T19:26:15.240017+0000","last_peered":"2024-09-12T19:26:15.240017+0000","last_clean":"2024-09-12T19:26:15.240017+0000","last_became_active":"2024-09-12T17:52:39.877793+0000","last_became_peered":"2024-09-12T17:52:39.877793+0000","last_unstale":"2024-09-12T19:26:15.240017+0000","last_undegraded":"2024-09-12T19:26:15.240017+0000","last_fullsized":"2024-09-12T19:26:15.240017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:26.899906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.597487+0000","last_change":"2024-09-12T18:25:52.618530+0000","last_active":"2024-09-12T19:26:40.597487+0000","last_peered":"2024-09-12T19:26:40.597487+0000","last_clean":"2024-09-12T19:26:40.597487+0000","last_became_active":"2024-09-12T18:25:52.617815+0000","last_became_peered":"2024-09-12T18:25:52.617815+0000","last_unstale":"2024-09-12T19:26:40.597487+0000","last_undegraded":"2024-09-12T19:26:40.597487+0000","last_fullsized":"2024-09-12T19:26:40.597487+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:26.125712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:34.044128+0000","last_change":"2024-09-12T17:58:47.257576+0000","last_active":"2024-09-12T19:26:34.044128+0000","last_peered":"2024-09-12T19:26:34.044128+0000","last_clean":"2024-09-12T19:26:34.044128+0000","last_became_active":"2024-09-12T17:58:47.256924+0000","last_became_peered":"2024-09-12T17:58:47.256924+0000","last_unstale":"2024-09-12T19:26:34.044128+0000","last_undegraded":"2024-09-12T19:26:34.044128+0000","last_fullsized":"2024-09-12T19:26:34.044128+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:39.738133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:35.653357+0000","last_change":"2024-09-12T17:58:40.194527+0000","last_active":"2024-09-12T19:25:35.653357+0000","last_peered":"2024-09-12T19:25:35.653357+0000","last_clean":"2024-09-12T19:25:35.653357+0000","last_became_active":"2024-09-12T17:58:40.193786+0000","last_became_peered":"2024-09-12T17:58:40.193786+0000","last_unstale":"2024-09-12T19:25:35.653357+0000","last_undegraded":"2024-09-12T19:25:35.653357+0000","last_fullsized":"2024-09-12T19:25:35.653357+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:14.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'23","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.243911+0000","last_change":"2024-09-12T17:52:39.875927+0000","last_active":"2024-09-12T19:25:50.243911+0000","last_peered":"2024-09-12T19:25:50.243911+0000","last_clean":"2024-09-12T19:25:50.243911+0000","last_became_active":"2024-09-12T17:52:39.869627+0000","last_became_peered":"2024-09-12T17:52:39.869627+0000","last_unstale":"2024-09-12T19:25:50.243911+0000","last_undegraded":"2024-09-12T19:25:50.243911+0000","last_fullsized":"2024-09-12T19:25:50.243911+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.817489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":43,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668164+0000","last_change":"2024-09-12T18:25:52.624807+0000","last_active":"2024-09-12T19:26:40.668164+0000","last_peered":"2024-09-12T19:26:40.668164+0000","last_clean":"2024-09-12T19:26:40.668164+0000","last_became_active":"2024-09-12T18:25:52.624296+0000","last_became_peered":"2024-09-12T18:25:52.624296+0000","last_unstale":"2024-09-12T19:26:40.668164+0000","last_undegraded":"2024-09-12T19:26:40.668164+0000","last_fullsized":"2024-09-12T19:26:40.668164+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:35.580294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"265'7","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586846+0000","last_change":"2024-09-12T17:58:47.244823+0000","last_active":"2024-09-12T19:25:50.586846+0000","last_peered":"2024-09-12T19:25:50.586846+0000","last_clean":"2024-09-12T19:25:50.586846+0000","last_became_active":"2024-09-12T17:58:47.242874+0000","last_became_peered":"2024-09-12T17:58:47.242874+0000","last_unstale":"2024-09-12T19:25:50.586846+0000","last_undegraded":"2024-09-12T19:25:50.586846+0000","last_fullsized":"2024-09-12T19:25:50.586846+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:49.961011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":9787,"num_write":7,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'4","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355417+0000","last_change":"2024-09-12T17:58:40.175758+0000","last_active":"2024-09-12T19:26:25.355417+0000","last_peered":"2024-09-12T19:26:25.355417+0000","last_clean":"2024-09-12T19:26:25.355417+0000","last_became_active":"2024-09-12T17:58:40.175011+0000","last_became_peered":"2024-09-12T17:58:40.175011+0000","last_unstale":"2024-09-12T19:26:25.355417+0000","last_undegraded":"2024-09-12T19:26:25.355417+0000","last_fullsized":"2024-09-12T19:26:25.355417+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:29.337157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'56","reported_seq":233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586722+0000","last_change":"2024-09-12T17:52:39.885688+0000","last_active":"2024-09-12T19:25:50.586722+0000","last_peered":"2024-09-12T19:25:50.586722+0000","last_clean":"2024-09-12T19:25:50.586722+0000","last_became_active":"2024-09-12T17:52:39.884599+0000","last_became_peered":"2024-09-12T17:52:39.884599+0000","last_unstale":"2024-09-12T19:25:50.586722+0000","last_undegraded":"2024-09-12T19:25:50.586722+0000","last_fullsized":"2024-09-12T19:25:50.586722+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:48.524948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":231,"num_write":89,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.592964+0000","last_change":"2024-09-12T18:25:52.603197+0000","last_active":"2024-09-12T19:26:20.592964+0000","last_peered":"2024-09-12T19:26:20.592964+0000","last_clean":"2024-09-12T19:26:20.592964+0000","last_became_active":"2024-09-12T18:25:52.602495+0000","last_became_peered":"2024-09-12T18:25:52.602495+0000","last_unstale":"2024-09-12T19:26:20.592964+0000","last_undegraded":"2024-09-12T19:26:20.592964+0000","last_fullsized":"2024-09-12T19:26:20.592964+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:36.706795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'10","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.256474+0000","last_change":"2024-09-12T17:58:47.255006+0000","last_active":"2024-09-12T19:26:45.256474+0000","last_peered":"2024-09-12T19:26:45.256474+0000","last_clean":"2024-09-12T19:26:45.256474+0000","last_became_active":"2024-09-12T17:58:47.254272+0000","last_became_peered":"2024-09-12T17:58:47.254272+0000","last_unstale":"2024-09-12T19:26:45.256474+0000","last_undegraded":"2024-09-12T19:26:45.256474+0000","last_fullsized":"2024-09-12T19:26:45.256474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:11.620938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":26626,"num_write":20,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'5","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.351504+0000","last_change":"2024-09-12T17:58:40.195873+0000","last_active":"2024-09-12T19:26:10.351504+0000","last_peered":"2024-09-12T19:26:10.351504+0000","last_clean":"2024-09-12T19:26:10.351504+0000","last_became_active":"2024-09-12T17:58:40.195089+0000","last_became_peered":"2024-09-12T17:58:40.195089+0000","last_unstale":"2024-09-12T19:26:10.351504+0000","last_undegraded":"2024-09-12T19:26:10.351504+0000","last_fullsized":"2024-09-12T19:26:10.351504+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.723902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":5,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'27","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.675603+0000","last_change":"2024-09-12T17:52:39.868988+0000","last_active":"2024-09-12T19:25:50.675603+0000","last_peered":"2024-09-12T19:25:50.675603+0000","last_clean":"2024-09-12T19:25:50.675603+0000","last_became_active":"2024-09-12T17:52:39.867605+0000","last_became_peered":"2024-09-12T17:52:39.867605+0000","last_unstale":"2024-09-12T19:25:50.675603+0000","last_undegraded":"2024-09-12T19:25:50.675603+0000","last_fullsized":"2024-09-12T19:25:50.675603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:31.849687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":99,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.592985+0000","last_change":"2024-09-12T18:25:52.615107+0000","last_active":"2024-09-12T19:26:20.592985+0000","last_peered":"2024-09-12T19:26:20.592985+0000","last_clean":"2024-09-12T19:26:20.592985+0000","last_became_active":"2024-09-12T18:25:52.614383+0000","last_became_peered":"2024-09-12T18:25:52.614383+0000","last_unstale":"2024-09-12T19:26:20.592985+0000","last_undegraded":"2024-09-12T19:26:20.592985+0000","last_fullsized":"2024-09-12T19:26:20.592985+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:02.087383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"265'3","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250677+0000","last_change":"2024-09-12T17:58:47.249774+0000","last_active":"2024-09-12T19:26:20.250677+0000","last_peered":"2024-09-12T19:26:20.250677+0000","last_clean":"2024-09-12T19:26:20.250677+0000","last_became_active":"2024-09-12T17:58:47.248924+0000","last_became_peered":"2024-09-12T17:58:47.248924+0000","last_unstale":"2024-09-12T19:26:20.250677+0000","last_undegraded":"2024-09-12T19:26:20.250677+0000","last_fullsized":"2024-09-12T19:26:20.250677+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.643262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:30.684425+0000","last_change":"2024-09-12T17:58:40.188344+0000","last_active":"2024-09-12T19:26:30.684425+0000","last_peered":"2024-09-12T19:26:30.684425+0000","last_clean":"2024-09-12T19:26:30.684425+0000","last_became_active":"2024-09-12T17:58:40.187590+0000","last_became_peered":"2024-09-12T17:58:40.187590+0000","last_unstale":"2024-09-12T19:26:30.684425+0000","last_undegraded":"2024-09-12T19:26:30.684425+0000","last_fullsized":"2024-09-12T19:26:30.684425+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:15.651076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'13","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.346788+0000","last_change":"2024-09-12T17:52:39.881326+0000","last_active":"2024-09-12T19:25:50.346788+0000","last_peered":"2024-09-12T19:25:50.346788+0000","last_clean":"2024-09-12T19:25:50.346788+0000","last_became_active":"2024-09-12T17:52:39.872599+0000","last_became_peered":"2024-09-12T17:52:39.872599+0000","last_unstale":"2024-09-12T19:25:50.346788+0000","last_undegraded":"2024-09-12T19:25:50.346788+0000","last_fullsized":"2024-09-12T19:25:50.346788+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:37.156957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.249303+0000","last_change":"2024-09-12T18:25:52.612438+0000","last_active":"2024-09-12T19:26:15.249303+0000","last_peered":"2024-09-12T19:26:15.249303+0000","last_clean":"2024-09-12T19:26:15.249303+0000","last_became_active":"2024-09-12T18:25:52.611377+0000","last_became_peered":"2024-09-12T18:25:52.611377+0000","last_unstale":"2024-09-12T19:26:15.249303+0000","last_undegraded":"2024-09-12T19:26:15.249303+0000","last_fullsized":"2024-09-12T19:26:15.249303+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:57.823730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'1","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.582729+0000","last_change":"2024-09-12T17:58:47.243005+0000","last_active":"2024-09-12T19:25:30.582729+0000","last_peered":"2024-09-12T19:25:30.582729+0000","last_clean":"2024-09-12T19:25:30.582729+0000","last_became_active":"2024-09-12T17:58:47.242171+0000","last_became_peered":"2024-09-12T17:58:47.242171+0000","last_unstale":"2024-09-12T19:25:30.582729+0000","last_undegraded":"2024-09-12T19:25:30.582729+0000","last_fullsized":"2024-09-12T19:25:30.582729+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:43.801606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.256971+0000","last_change":"2024-09-12T17:58:40.211247+0000","last_active":"2024-09-12T19:27:30.256971+0000","last_peered":"2024-09-12T19:27:30.256971+0000","last_clean":"2024-09-12T19:27:30.256971+0000","last_became_active":"2024-09-12T17:58:40.210485+0000","last_became_peered":"2024-09-12T17:58:40.210485+0000","last_unstale":"2024-09-12T19:27:30.256971+0000","last_undegraded":"2024-09-12T19:27:30.256971+0000","last_fullsized":"2024-09-12T19:27:30.256971+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:45.166206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'25","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.248017+0000","last_change":"2024-09-12T17:52:39.880057+0000","last_active":"2024-09-12T19:26:50.248017+0000","last_peered":"2024-09-12T19:26:50.248017+0000","last_clean":"2024-09-12T19:26:50.248017+0000","last_became_active":"2024-09-12T17:52:39.868837+0000","last_became_peered":"2024-09-12T17:52:39.868837+0000","last_unstale":"2024-09-12T19:26:50.248017+0000","last_undegraded":"2024-09-12T19:26:50.248017+0000","last_fullsized":"2024-09-12T19:26:50.248017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.133723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.353905+0000","last_change":"2024-09-12T18:25:52.615446+0000","last_active":"2024-09-12T19:26:20.353905+0000","last_peered":"2024-09-12T19:26:20.353905+0000","last_clean":"2024-09-12T19:26:20.353905+0000","last_became_active":"2024-09-12T18:25:52.611546+0000","last_became_peered":"2024-09-12T18:25:52.611546+0000","last_unstale":"2024-09-12T19:26:20.353905+0000","last_undegraded":"2024-09-12T19:26:20.353905+0000","last_fullsized":"2024-09-12T19:26:20.353905+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:59.006168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'5","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.341672+0000","last_change":"2024-09-12T17:58:47.246295+0000","last_active":"2024-09-12T19:25:30.341672+0000","last_peered":"2024-09-12T19:25:30.341672+0000","last_clean":"2024-09-12T19:25:30.341672+0000","last_became_active":"2024-09-12T17:58:47.245441+0000","last_became_peered":"2024-09-12T17:58:47.245441+0000","last_unstale":"2024-09-12T19:25:30.341672+0000","last_undegraded":"2024-09-12T19:25:30.341672+0000","last_fullsized":"2024-09-12T19:25:30.341672+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:06.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'6","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.371312+0000","last_change":"2024-09-12T17:58:40.192872+0000","last_active":"2024-09-12T19:27:30.371312+0000","last_peered":"2024-09-12T19:27:30.371312+0000","last_clean":"2024-09-12T19:27:30.371312+0000","last_became_active":"2024-09-12T17:58:40.191999+0000","last_became_peered":"2024-09-12T17:58:40.191999+0000","last_unstale":"2024-09-12T19:27:30.371312+0000","last_undegraded":"2024-09-12T19:27:30.371312+0000","last_fullsized":"2024-09-12T19:27:30.371312+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.003714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":18434,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'36","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664694+0000","last_change":"2024-09-12T17:52:39.891322+0000","last_active":"2024-09-12T19:26:25.664694+0000","last_peered":"2024-09-12T19:26:25.664694+0000","last_clean":"2024-09-12T19:26:25.664694+0000","last_became_active":"2024-09-12T17:52:39.890678+0000","last_became_peered":"2024-09-12T17:52:39.890678+0000","last_unstale":"2024-09-12T19:26:25.664694+0000","last_undegraded":"2024-09-12T19:26:25.664694+0000","last_fullsized":"2024-09-12T19:26:25.664694+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:49.955143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667105+0000","last_change":"2024-09-12T18:25:52.612356+0000","last_active":"2024-09-12T19:26:35.667105+0000","last_peered":"2024-09-12T19:26:35.667105+0000","last_clean":"2024-09-12T19:26:35.667105+0000","last_became_active":"2024-09-12T18:25:52.611397+0000","last_became_peered":"2024-09-12T18:25:52.611397+0000","last_unstale":"2024-09-12T19:26:35.667105+0000","last_undegraded":"2024-09-12T19:26:35.667105+0000","last_fullsized":"2024-09-12T19:26:35.667105+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:59.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.681982+0000","last_change":"2024-09-12T17:58:47.241676+0000","last_active":"2024-09-12T19:26:20.681982+0000","last_peered":"2024-09-12T19:26:20.681982+0000","last_clean":"2024-09-12T19:26:20.681982+0000","last_became_active":"2024-09-12T17:58:47.240951+0000","last_became_peered":"2024-09-12T17:58:47.240951+0000","last_unstale":"2024-09-12T19:26:20.681982+0000","last_undegraded":"2024-09-12T19:26:20.681982+0000","last_fullsized":"2024-09-12T19:26:20.681982+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:38.662807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250717+0000","last_change":"2024-09-12T17:58:40.212464+0000","last_active":"2024-09-12T19:27:05.250717+0000","last_peered":"2024-09-12T19:27:05.250717+0000","last_clean":"2024-09-12T19:27:05.250717+0000","last_became_active":"2024-09-12T17:58:40.211891+0000","last_became_peered":"2024-09-12T17:58:40.211891+0000","last_unstale":"2024-09-12T19:27:05.250717+0000","last_undegraded":"2024-09-12T19:27:05.250717+0000","last_fullsized":"2024-09-12T19:27:05.250717+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:27.802674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'53","reported_seq":225,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242648+0000","last_change":"2024-09-12T17:52:39.879319+0000","last_active":"2024-09-12T19:26:25.242648+0000","last_peered":"2024-09-12T19:26:25.242648+0000","last_clean":"2024-09-12T19:26:25.242648+0000","last_became_active":"2024-09-12T17:52:39.878694+0000","last_became_peered":"2024-09-12T17:52:39.878694+0000","last_unstale":"2024-09-12T19:26:25.242648+0000","last_undegraded":"2024-09-12T19:26:25.242648+0000","last_fullsized":"2024-09-12T19:26:25.242648+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:48.298171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":199,"num_write":92,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.685676+0000","last_change":"2024-09-12T18:25:52.620080+0000","last_active":"2024-09-12T19:26:35.685676+0000","last_peered":"2024-09-12T19:26:35.685676+0000","last_clean":"2024-09-12T19:26:35.685676+0000","last_became_active":"2024-09-12T18:25:52.619540+0000","last_became_peered":"2024-09-12T18:25:52.619540+0000","last_unstale":"2024-09-12T19:26:35.685676+0000","last_undegraded":"2024-09-12T19:26:35.685676+0000","last_fullsized":"2024-09-12T19:26:35.685676+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:07.956389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368657+0000","last_change":"2024-09-12T17:58:47.245205+0000","last_active":"2024-09-12T19:27:20.368657+0000","last_peered":"2024-09-12T19:27:20.368657+0000","last_clean":"2024-09-12T19:27:20.368657+0000","last_became_active":"2024-09-12T17:58:47.238232+0000","last_became_peered":"2024-09-12T17:58:47.238232+0000","last_unstale":"2024-09-12T19:27:20.368657+0000","last_undegraded":"2024-09-12T19:27:20.368657+0000","last_fullsized":"2024-09-12T19:27:20.368657+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:59.889739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"262'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.351356+0000","last_change":"2024-09-12T17:58:40.198949+0000","last_active":"2024-09-12T19:26:10.351356+0000","last_peered":"2024-09-12T19:26:10.351356+0000","last_clean":"2024-09-12T19:26:10.351356+0000","last_became_active":"2024-09-12T17:58:40.197815+0000","last_became_peered":"2024-09-12T17:58:40.197815+0000","last_unstale":"2024-09-12T19:26:10.351356+0000","last_undegraded":"2024-09-12T19:26:10.351356+0000","last_fullsized":"2024-09-12T19:26:10.351356+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:15.963939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'72","reported_seq":273,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355384+0000","last_change":"2024-09-12T17:52:39.876517+0000","last_active":"2024-09-12T19:26:25.355384+0000","last_peered":"2024-09-12T19:26:25.355384+0000","last_clean":"2024-09-12T19:26:25.355384+0000","last_became_active":"2024-09-12T17:52:39.872148+0000","last_became_peered":"2024-09-12T17:52:39.872148+0000","last_unstale":"2024-09-12T19:26:25.355384+0000","last_undegraded":"2024-09-12T19:26:25.355384+0000","last_fullsized":"2024-09-12T19:26:25.355384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.681891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":261,"num_write":116,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250622+0000","last_change":"2024-09-12T18:25:52.624296+0000","last_active":"2024-09-12T19:26:20.250622+0000","last_peered":"2024-09-12T19:26:20.250622+0000","last_clean":"2024-09-12T19:26:20.250622+0000","last_became_active":"2024-09-12T18:25:52.623635+0000","last_became_peered":"2024-09-12T18:25:52.623635+0000","last_unstale":"2024-09-12T19:26:20.250622+0000","last_undegraded":"2024-09-12T19:26:20.250622+0000","last_fullsized":"2024-09-12T19:26:20.250622+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:13.996677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241344+0000","last_change":"2024-09-12T17:58:47.251669+0000","last_active":"2024-09-12T19:26:20.241344+0000","last_peered":"2024-09-12T19:26:20.241344+0000","last_clean":"2024-09-12T19:26:20.241344+0000","last_became_active":"2024-09-12T17:58:47.250762+0000","last_became_peered":"2024-09-12T17:58:47.250762+0000","last_unstale":"2024-09-12T19:26:20.241344+0000","last_undegraded":"2024-09-12T19:26:20.241344+0000","last_fullsized":"2024-09-12T19:26:20.241344+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:16.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9216,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:09.038722+0000","last_change":"2024-09-12T17:58:40.210753+0000","last_active":"2024-09-12T19:26:09.038722+0000","last_peered":"2024-09-12T19:26:09.038722+0000","last_clean":"2024-09-12T19:26:09.038722+0000","last_became_active":"2024-09-12T17:58:40.210072+0000","last_became_peered":"2024-09-12T17:58:40.210072+0000","last_unstale":"2024-09-12T19:26:09.038722+0000","last_undegraded":"2024-09-12T19:26:09.038722+0000","last_fullsized":"2024-09-12T19:26:09.038722+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.700767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'26","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355281+0000","last_change":"2024-09-12T17:52:39.872036+0000","last_active":"2024-09-12T19:26:25.355281+0000","last_peered":"2024-09-12T19:26:25.355281+0000","last_clean":"2024-09-12T19:26:25.355281+0000","last_became_active":"2024-09-12T17:52:39.871247+0000","last_became_peered":"2024-09-12T17:52:39.871247+0000","last_unstale":"2024-09-12T19:26:25.355281+0000","last_undegraded":"2024-09-12T19:26:25.355281+0000","last_fullsized":"2024-09-12T19:26:25.355281+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:34.468531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":46,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.359612+0000","last_change":"2024-09-12T18:25:52.622440+0000","last_active":"2024-09-12T19:26:40.359612+0000","last_peered":"2024-09-12T19:26:40.359612+0000","last_clean":"2024-09-12T19:26:40.359612+0000","last_became_active":"2024-09-12T18:25:52.621808+0000","last_became_peered":"2024-09-12T18:25:52.621808+0000","last_unstale":"2024-09-12T19:26:40.359612+0000","last_undegraded":"2024-09-12T19:26:40.359612+0000","last_fullsized":"2024-09-12T19:26:40.359612+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:05.559442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241274+0000","last_change":"2024-09-12T17:58:47.236975+0000","last_active":"2024-09-12T19:26:20.241274+0000","last_peered":"2024-09-12T19:26:20.241274+0000","last_clean":"2024-09-12T19:26:20.241274+0000","last_became_active":"2024-09-12T17:58:47.236237+0000","last_became_peered":"2024-09-12T17:58:47.236237+0000","last_unstale":"2024-09-12T19:26:20.241274+0000","last_undegraded":"2024-09-12T19:26:20.241274+0000","last_fullsized":"2024-09-12T19:26:20.241274+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:34.439221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'5","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.081308+0000","last_change":"2024-09-12T17:58:40.207822+0000","last_active":"2024-09-12T19:26:10.081308+0000","last_peered":"2024-09-12T19:26:10.081308+0000","last_clean":"2024-09-12T19:26:10.081308+0000","last_became_active":"2024-09-12T17:58:40.207179+0000","last_became_peered":"2024-09-12T17:58:40.207179+0000","last_unstale":"2024-09-12T19:26:10.081308+0000","last_undegraded":"2024-09-12T19:26:10.081308+0000","last_fullsized":"2024-09-12T19:26:10.081308+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:00.148566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":17408,"num_write":5,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'9","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250774+0000","last_change":"2024-09-12T17:52:39.884615+0000","last_active":"2024-09-12T19:27:05.250774+0000","last_peered":"2024-09-12T19:27:05.250774+0000","last_clean":"2024-09-12T19:27:05.250774+0000","last_became_active":"2024-09-12T17:52:39.883782+0000","last_became_peered":"2024-09-12T17:52:39.883782+0000","last_unstale":"2024-09-12T19:27:05.250774+0000","last_undegraded":"2024-09-12T19:27:05.250774+0000","last_fullsized":"2024-09-12T19:27:05.250774+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:22.293480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'271","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.602189+0000","last_change":"2024-09-12T17:36:34.874827+0000","last_active":"2024-09-12T19:27:00.602189+0000","last_peered":"2024-09-12T19:27:00.602189+0000","last_clean":"2024-09-12T19:27:00.602189+0000","last_became_active":"2024-09-12T17:36:34.874529+0000","last_became_peered":"2024-09-12T17:36:34.874529+0000","last_unstale":"2024-09-12T19:27:00.602189+0000","last_undegraded":"2024-09-12T19:27:00.602189+0000","last_fullsized":"2024-09-12T19:27:00.602189+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:19.340681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8048917,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":517,"num_read_kb":47675,"num_write":979,"num_write_kb":57869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'948","reported_seq":2619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.087864+0000","last_change":"2024-09-12T17:36:36.882005+0000","last_active":"2024-09-12T19:26:40.087864+0000","last_peered":"2024-09-12T19:26:40.087864+0000","last_clean":"2024-09-12T19:26:40.087864+0000","last_became_active":"2024-09-12T17:36:36.881586+0000","last_became_peered":"2024-09-12T17:36:36.881586+0000","last_unstale":"2024-09-12T19:26:40.087864+0000","last_undegraded":"2024-09-12T19:26:40.087864+0000","last_fullsized":"2024-09-12T19:26:40.087864+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:20.270667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4539,"num_read_kb":4030,"num_write":1302,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'293","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:12.742992+0000","last_change":"2024-09-12T17:36:34.886842+0000","last_active":"2024-09-12T19:29:12.742992+0000","last_peered":"2024-09-12T19:29:12.742992+0000","last_clean":"2024-09-12T19:29:12.742992+0000","last_became_active":"2024-09-12T17:36:34.886040+0000","last_became_peered":"2024-09-12T17:36:34.886040+0000","last_unstale":"2024-09-12T19:29:12.742992+0000","last_undegraded":"2024-09-12T19:29:12.742992+0000","last_fullsized":"2024-09-12T19:29:12.742992+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:53.879522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12510272,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":446,"num_read_kb":42118,"num_write":1045,"num_write_kb":49494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'796","reported_seq":2316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.047571+0000","last_change":"2024-09-12T17:36:36.875611+0000","last_active":"2024-09-12T19:29:21.047571+0000","last_peered":"2024-09-12T19:29:21.047571+0000","last_clean":"2024-09-12T19:29:21.047571+0000","last_became_active":"2024-09-12T17:36:36.875285+0000","last_became_peered":"2024-09-12T17:36:36.875285+0000","last_unstale":"2024-09-12T19:29:21.047571+0000","last_undegraded":"2024-09-12T19:29:21.047571+0000","last_fullsized":"2024-09-12T19:29:21.047571+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:54.905863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3836,"num_read_kb":3465,"num_write":1049,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'279","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.259977+0000","last_change":"2024-09-12T17:36:34.873831+0000","last_active":"2024-09-12T19:27:00.259977+0000","last_peered":"2024-09-12T19:27:00.259977+0000","last_clean":"2024-09-12T19:27:00.259977+0000","last_became_active":"2024-09-12T17:36:34.871993+0000","last_became_peered":"2024-09-12T17:36:34.871993+0000","last_unstale":"2024-09-12T19:27:00.259977+0000","last_undegraded":"2024-09-12T19:27:00.259977+0000","last_fullsized":"2024-09-12T19:27:00.259977+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:33.922670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334724,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":456,"num_read_kb":16147,"num_write":1004,"num_write_kb":33332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'911","reported_seq":2448,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:53.304327+0000","last_change":"2024-09-12T17:36:36.885378+0000","last_active":"2024-09-12T19:26:53.304327+0000","last_peered":"2024-09-12T19:26:53.304327+0000","last_clean":"2024-09-12T19:26:53.304327+0000","last_became_active":"2024-09-12T17:36:36.883008+0000","last_became_peered":"2024-09-12T17:36:36.883008+0000","last_unstale":"2024-09-12T19:26:53.304327+0000","last_undegraded":"2024-09-12T19:26:53.304327+0000","last_fullsized":"2024-09-12T19:26:53.304327+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":900,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:58.093073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4392,"num_read_kb":3928,"num_write":1272,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'279","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:13.693279+0000","last_change":"2024-09-12T17:36:34.871813+0000","last_active":"2024-09-12T19:29:13.693279+0000","last_peered":"2024-09-12T19:29:13.693279+0000","last_clean":"2024-09-12T19:29:13.693279+0000","last_became_active":"2024-09-12T17:36:34.871414+0000","last_became_peered":"2024-09-12T17:36:34.871414+0000","last_unstale":"2024-09-12T19:29:13.693279+0000","last_undegraded":"2024-09-12T19:29:13.693279+0000","last_fullsized":"2024-09-12T19:29:13.693279+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:37.103933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007944,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":426,"num_read_kb":53693,"num_write":1030,"num_write_kb":40210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'837","reported_seq":2343,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686623+0000","last_change":"2024-09-12T17:36:36.902897+0000","last_active":"2024-09-12T19:26:40.686623+0000","last_peered":"2024-09-12T19:26:40.686623+0000","last_clean":"2024-09-12T19:26:40.686623+0000","last_became_active":"2024-09-12T17:36:36.902241+0000","last_became_peered":"2024-09-12T17:36:36.902241+0000","last_unstale":"2024-09-12T19:26:40.686623+0000","last_undegraded":"2024-09-12T19:26:40.686623+0000","last_fullsized":"2024-09-12T19:26:40.686623+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:25.892315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3905,"num_read_kb":3484,"num_write":1127,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'291","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.588296+0000","last_change":"2024-09-12T17:36:34.890708+0000","last_active":"2024-09-12T19:27:00.588296+0000","last_peered":"2024-09-12T19:27:00.588296+0000","last_clean":"2024-09-12T19:27:00.588296+0000","last_became_active":"2024-09-12T17:36:34.890281+0000","last_became_peered":"2024-09-12T17:36:34.890281+0000","last_unstale":"2024-09-12T19:27:00.588296+0000","last_undegraded":"2024-09-12T19:27:00.588296+0000","last_fullsized":"2024-09-12T19:27:00.588296+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:59.249812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2458751,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":477,"num_read_kb":3791,"num_write":1103,"num_write_kb":30376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'481","reported_seq":2174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602973+0000","last_change":"2024-09-12T17:36:36.899570+0000","last_active":"2024-09-12T19:27:05.602973+0000","last_peered":"2024-09-12T19:27:05.602973+0000","last_clean":"2024-09-12T19:27:05.602973+0000","last_became_active":"2024-09-12T17:36:36.899249+0000","last_became_peered":"2024-09-12T17:36:36.899249+0000","last_unstale":"2024-09-12T19:27:05.602973+0000","last_undegraded":"2024-09-12T19:27:05.602973+0000","last_fullsized":"2024-09-12T19:27:05.602973+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:17.239845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2730,"num_read_kb":2583,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'298","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.244773+0000","last_change":"2024-09-12T17:36:34.871230+0000","last_active":"2024-09-12T19:26:35.244773+0000","last_peered":"2024-09-12T19:26:35.244773+0000","last_clean":"2024-09-12T19:26:35.244773+0000","last_became_active":"2024-09-12T17:36:34.870994+0000","last_became_peered":"2024-09-12T17:36:34.870994+0000","last_unstale":"2024-09-12T19:26:35.244773+0000","last_undegraded":"2024-09-12T19:26:35.244773+0000","last_fullsized":"2024-09-12T19:26:35.244773+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:08.263522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6412736,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":524,"num_read_kb":2338,"num_write":1131,"num_write_kb":29584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'374","reported_seq":1826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.603010+0000","last_change":"2024-09-12T17:36:36.897967+0000","last_active":"2024-09-12T19:27:05.603010+0000","last_peered":"2024-09-12T19:27:05.603010+0000","last_clean":"2024-09-12T19:27:05.603010+0000","last_became_active":"2024-09-12T17:36:36.897609+0000","last_became_peered":"2024-09-12T17:36:36.897609+0000","last_unstale":"2024-09-12T19:27:05.603010+0000","last_undegraded":"2024-09-12T19:27:05.603010+0000","last_fullsized":"2024-09-12T19:27:05.603010+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:31.958437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2010,"num_read_kb":1904,"num_write":440,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'295","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.596308+0000","last_change":"2024-09-12T17:36:34.859377+0000","last_active":"2024-09-12T19:26:35.596308+0000","last_peered":"2024-09-12T19:26:35.596308+0000","last_clean":"2024-09-12T19:26:35.596308+0000","last_became_active":"2024-09-12T17:36:34.859023+0000","last_became_peered":"2024-09-12T17:36:34.859023+0000","last_unstale":"2024-09-12T19:26:35.596308+0000","last_undegraded":"2024-09-12T19:26:35.596308+0000","last_fullsized":"2024-09-12T19:26:35.596308+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:13.591648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1176422,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":450,"num_read_kb":1894,"num_write":1162,"num_write_kb":19389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'831","reported_seq":2372,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.367029+0000","last_change":"2024-09-12T17:36:36.914649+0000","last_active":"2024-09-12T19:28:00.367029+0000","last_peered":"2024-09-12T19:28:00.367029+0000","last_clean":"2024-09-12T19:28:00.367029+0000","last_became_active":"2024-09-12T17:36:36.914366+0000","last_became_peered":"2024-09-12T17:36:36.914366+0000","last_unstale":"2024-09-12T19:28:00.367029+0000","last_undegraded":"2024-09-12T19:28:00.367029+0000","last_fullsized":"2024-09-12T19:28:00.367029+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:37.673498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4038,"num_read_kb":3626,"num_write":1143,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'278","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254008+0000","last_change":"2024-09-12T17:36:34.883337+0000","last_active":"2024-09-12T19:26:35.254008+0000","last_peered":"2024-09-12T19:26:35.254008+0000","last_clean":"2024-09-12T19:26:35.254008+0000","last_became_active":"2024-09-12T17:36:34.882704+0000","last_became_peered":"2024-09-12T17:36:34.882704+0000","last_unstale":"2024-09-12T19:26:35.254008+0000","last_undegraded":"2024-09-12T19:26:35.254008+0000","last_fullsized":"2024-09-12T19:26:35.254008+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:19.965473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15601123,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":507,"num_read_kb":63997,"num_write":1053,"num_write_kb":46422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1166","reported_seq":2735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261311+0000","last_change":"2024-09-12T17:36:36.889657+0000","last_active":"2024-09-12T19:27:05.261311+0000","last_peered":"2024-09-12T19:27:05.261311+0000","last_clean":"2024-09-12T19:27:05.261311+0000","last_became_active":"2024-09-12T17:36:36.888829+0000","last_became_peered":"2024-09-12T17:36:36.888829+0000","last_unstale":"2024-09-12T19:27:05.261311+0000","last_undegraded":"2024-09-12T19:27:05.261311+0000","last_fullsized":"2024-09-12T19:27:05.261311+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:42.143143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5211,"num_read_kb":4613,"num_write":1589,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'494","reported_seq":2221,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181954+0000","last_change":"2024-09-12T17:36:36.905062+0000","last_active":"2024-09-12T19:27:10.181954+0000","last_peered":"2024-09-12T19:27:10.181954+0000","last_clean":"2024-09-12T19:27:10.181954+0000","last_became_active":"2024-09-12T17:36:36.904820+0000","last_became_peered":"2024-09-12T17:36:36.904820+0000","last_unstale":"2024-09-12T19:27:10.181954+0000","last_undegraded":"2024-09-12T19:27:10.181954+0000","last_fullsized":"2024-09-12T19:27:10.181954+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:38.103419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2913,"num_read_kb":2753,"num_write":585,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'305","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.078294+0000","last_change":"2024-09-12T17:36:34.866831+0000","last_active":"2024-09-12T19:25:55.078294+0000","last_peered":"2024-09-12T19:25:55.078294+0000","last_clean":"2024-09-12T19:25:55.078294+0000","last_became_active":"2024-09-12T17:36:34.866283+0000","last_became_peered":"2024-09-12T17:36:34.866283+0000","last_unstale":"2024-09-12T19:25:55.078294+0000","last_undegraded":"2024-09-12T19:25:55.078294+0000","last_fullsized":"2024-09-12T19:25:55.078294+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:57.776484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2776361,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":607,"num_read_kb":73276,"num_write":1036,"num_write_kb":24135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'478","reported_seq":2093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.032911+0000","last_change":"2024-09-12T17:36:36.911581+0000","last_active":"2024-09-12T19:29:21.032911+0000","last_peered":"2024-09-12T19:29:21.032911+0000","last_clean":"2024-09-12T19:29:21.032911+0000","last_became_active":"2024-09-12T17:36:36.911310+0000","last_became_peered":"2024-09-12T17:36:36.911310+0000","last_unstale":"2024-09-12T19:29:21.032911+0000","last_undegraded":"2024-09-12T19:29:21.032911+0000","last_fullsized":"2024-09-12T19:29:21.032911+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.005619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2526,"num_read_kb":2384,"num_write":531,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'278","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:39.783005+0000","last_change":"2024-09-12T17:36:34.865767+0000","last_active":"2024-09-12T19:25:39.783005+0000","last_peered":"2024-09-12T19:25:39.783005+0000","last_clean":"2024-09-12T19:25:39.783005+0000","last_became_active":"2024-09-12T17:36:34.865119+0000","last_became_peered":"2024-09-12T17:36:34.865119+0000","last_unstale":"2024-09-12T19:25:39.783005+0000","last_undegraded":"2024-09-12T19:25:39.783005+0000","last_fullsized":"2024-09-12T19:25:39.783005+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:35.180554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4594780,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":504,"num_read_kb":7316,"num_write":986,"num_write_kb":28671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'738","reported_seq":2229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.121403+0000","last_change":"2024-09-12T17:36:36.886366+0000","last_active":"2024-09-12T19:28:32.121403+0000","last_peered":"2024-09-12T19:28:32.121403+0000","last_clean":"2024-09-12T19:28:32.121403+0000","last_became_active":"2024-09-12T17:36:36.885876+0000","last_became_peered":"2024-09-12T17:36:36.885876+0000","last_unstale":"2024-09-12T19:28:32.121403+0000","last_undegraded":"2024-09-12T19:28:32.121403+0000","last_fullsized":"2024-09-12T19:28:32.121403+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:38.338908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3432,"num_read_kb":3117,"num_write":958,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'306","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:20.580623+0000","last_change":"2024-09-12T17:36:34.873997+0000","last_active":"2024-09-12T19:25:20.580623+0000","last_peered":"2024-09-12T19:25:20.580623+0000","last_clean":"2024-09-12T19:25:20.580623+0000","last_became_active":"2024-09-12T17:36:34.873456+0000","last_became_peered":"2024-09-12T17:36:34.873456+0000","last_unstale":"2024-09-12T19:25:20.580623+0000","last_undegraded":"2024-09-12T19:25:20.580623+0000","last_fullsized":"2024-09-12T19:25:20.580623+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:57.720538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6375100,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":477,"num_read_kb":11967,"num_write":1163,"num_write_kb":23205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'620","reported_seq":2306,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.394693+0000","last_change":"2024-09-12T17:36:36.900540+0000","last_active":"2024-09-12T19:25:54.394693+0000","last_peered":"2024-09-12T19:25:54.394693+0000","last_clean":"2024-09-12T19:25:54.394693+0000","last_became_active":"2024-09-12T17:36:36.899850+0000","last_became_peered":"2024-09-12T17:36:36.899850+0000","last_unstale":"2024-09-12T19:25:54.394693+0000","last_undegraded":"2024-09-12T19:25:54.394693+0000","last_fullsized":"2024-09-12T19:25:54.394693+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:39.690377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3224,"num_read_kb":2959,"num_write":847,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'269","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:18.628539+0000","last_change":"2024-09-12T17:36:34.864903+0000","last_active":"2024-09-12T19:26:18.628539+0000","last_peered":"2024-09-12T19:26:18.628539+0000","last_clean":"2024-09-12T19:26:18.628539+0000","last_became_active":"2024-09-12T17:36:34.864547+0000","last_became_peered":"2024-09-12T17:36:34.864547+0000","last_unstale":"2024-09-12T19:26:18.628539+0000","last_undegraded":"2024-09-12T19:26:18.628539+0000","last_fullsized":"2024-09-12T19:26:18.628539+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:37.836961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9759704,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":488,"num_read_kb":20887,"num_write":983,"num_write_kb":32386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'297","reported_seq":1673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.565486+0000","last_change":"2024-09-12T17:36:36.875932+0000","last_active":"2024-09-12T19:28:02.565486+0000","last_peered":"2024-09-12T19:28:02.565486+0000","last_clean":"2024-09-12T19:28:02.565486+0000","last_became_active":"2024-09-12T17:36:36.873937+0000","last_became_peered":"2024-09-12T17:36:36.873937+0000","last_unstale":"2024-09-12T19:28:02.565486+0000","last_undegraded":"2024-09-12T19:28:02.565486+0000","last_fullsized":"2024-09-12T19:28:02.565486+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:57.251507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1689,"num_read_kb":1636,"num_write":323,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'302","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:21.300970+0000","last_change":"2024-09-12T17:36:34.881828+0000","last_active":"2024-09-12T19:25:21.300970+0000","last_peered":"2024-09-12T19:25:21.300970+0000","last_clean":"2024-09-12T19:25:21.300970+0000","last_became_active":"2024-09-12T17:36:34.880986+0000","last_became_peered":"2024-09-12T17:36:34.880986+0000","last_unstale":"2024-09-12T19:25:21.300970+0000","last_undegraded":"2024-09-12T19:25:21.300970+0000","last_fullsized":"2024-09-12T19:25:21.300970+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:28.093624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7370410,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":804,"num_read_kb":10562,"num_write":991,"num_write_kb":33432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'404","reported_seq":1892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.398707+0000","last_change":"2024-09-12T17:36:36.881697+0000","last_active":"2024-09-12T19:25:54.398707+0000","last_peered":"2024-09-12T19:25:54.398707+0000","last_clean":"2024-09-12T19:25:54.398707+0000","last_became_active":"2024-09-12T17:36:36.881228+0000","last_became_peered":"2024-09-12T17:36:36.881228+0000","last_unstale":"2024-09-12T19:25:54.398707+0000","last_undegraded":"2024-09-12T19:25:54.398707+0000","last_fullsized":"2024-09-12T19:25:54.398707+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:17.469345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2076,"num_read_kb":1970,"num_write":455,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'354","reported_seq":1115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:39.045210+0000","last_change":"2024-09-12T17:36:34.879064+0000","last_active":"2024-09-12T19:26:39.045210+0000","last_peered":"2024-09-12T19:26:39.045210+0000","last_clean":"2024-09-12T19:26:39.045210+0000","last_became_active":"2024-09-12T17:36:34.878377+0000","last_became_peered":"2024-09-12T17:36:34.878377+0000","last_unstale":"2024-09-12T19:26:39.045210+0000","last_undegraded":"2024-09-12T19:26:39.045210+0000","last_fullsized":"2024-09-12T19:26:39.045210+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:13.927187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8422151,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":816,"num_read_kb":13594,"num_write":1279,"num_write_kb":22678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'109","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.849979+0000","last_change":"2024-09-12T17:36:44.936393+0000","last_active":"2024-09-12T19:28:02.849979+0000","last_peered":"2024-09-12T19:28:02.849979+0000","last_clean":"2024-09-12T19:28:02.849979+0000","last_became_active":"2024-09-12T17:36:44.934662+0000","last_became_peered":"2024-09-12T17:36:44.934662+0000","last_unstale":"2024-09-12T19:28:02.849979+0000","last_undegraded":"2024-09-12T19:28:02.849979+0000","last_fullsized":"2024-09-12T19:28:02.849979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:30.459321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'640","reported_seq":2289,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:44.046417+0000","last_change":"2024-09-12T17:36:36.914077+0000","last_active":"2024-09-12T19:26:44.046417+0000","last_peered":"2024-09-12T19:26:44.046417+0000","last_clean":"2024-09-12T19:26:44.046417+0000","last_became_active":"2024-09-12T17:36:36.913372+0000","last_became_peered":"2024-09-12T17:36:36.913372+0000","last_unstale":"2024-09-12T19:26:44.046417+0000","last_undegraded":"2024-09-12T19:26:44.046417+0000","last_fullsized":"2024-09-12T19:26:44.046417+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:28.282227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3256,"num_read_kb":2969,"num_write":868,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'330","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.604663+0000","last_change":"2024-09-12T17:36:34.866247+0000","last_active":"2024-09-12T19:27:38.604663+0000","last_peered":"2024-09-12T19:27:38.604663+0000","last_clean":"2024-09-12T19:27:38.604663+0000","last_became_active":"2024-09-12T17:36:34.865894+0000","last_became_peered":"2024-09-12T17:36:34.865894+0000","last_unstale":"2024-09-12T19:27:38.604663+0000","last_undegraded":"2024-09-12T19:27:38.604663+0000","last_fullsized":"2024-09-12T19:27:38.604663+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:18.929221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9572804,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":511,"num_read_kb":35668,"num_write":1281,"num_write_kb":51737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.340265+0000","last_change":"2024-09-12T17:36:38.881794+0000","last_active":"2024-09-12T19:25:25.340265+0000","last_peered":"2024-09-12T19:25:25.340265+0000","last_clean":"2024-09-12T19:25:25.340265+0000","last_became_active":"2024-09-12T17:36:38.881044+0000","last_became_peered":"2024-09-12T17:36:38.881044+0000","last_unstale":"2024-09-12T19:25:25.340265+0000","last_undegraded":"2024-09-12T19:25:25.340265+0000","last_fullsized":"2024-09-12T19:25:25.340265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:18.605129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'381","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:50.702361+0000","last_change":"2024-09-12T17:36:40.907618+0000","last_active":"2024-09-12T19:27:50.702361+0000","last_peered":"2024-09-12T19:27:50.702361+0000","last_clean":"2024-09-12T19:27:50.702361+0000","last_became_active":"2024-09-12T17:36:40.906825+0000","last_became_peered":"2024-09-12T17:36:40.906825+0000","last_unstale":"2024-09-12T19:27:50.702361+0000","last_undegraded":"2024-09-12T19:27:50.702361+0000","last_fullsized":"2024-09-12T19:27:50.702361+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:34.227775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64193,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":613,"num_read_kb":1137,"num_write":486,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.073133+0000","last_change":"2024-09-12T17:36:42.929571+0000","last_active":"2024-09-12T19:25:30.073133+0000","last_peered":"2024-09-12T19:25:30.073133+0000","last_clean":"2024-09-12T19:25:30.073133+0000","last_became_active":"2024-09-12T17:36:42.928794+0000","last_became_peered":"2024-09-12T17:36:42.928794+0000","last_unstale":"2024-09-12T19:25:30.073133+0000","last_undegraded":"2024-09-12T19:25:30.073133+0000","last_fullsized":"2024-09-12T19:25:30.073133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:22.503558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'168","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.748607+0000","last_change":"2024-09-12T17:36:44.941028+0000","last_active":"2024-09-12T19:29:20.748607+0000","last_peered":"2024-09-12T19:29:20.748607+0000","last_clean":"2024-09-12T19:29:20.748607+0000","last_became_active":"2024-09-12T17:36:44.939447+0000","last_became_peered":"2024-09-12T17:36:44.939447+0000","last_unstale":"2024-09-12T19:29:20.748607+0000","last_undegraded":"2024-09-12T19:29:20.748607+0000","last_fullsized":"2024-09-12T19:29:20.748607+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:17.779839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":297,"num_read_kb":283,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'450","reported_seq":1944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.054779+0000","last_change":"2024-09-12T17:36:36.876325+0000","last_active":"2024-09-12T19:29:21.054779+0000","last_peered":"2024-09-12T19:29:21.054779+0000","last_clean":"2024-09-12T19:29:21.054779+0000","last_became_active":"2024-09-12T17:36:36.875459+0000","last_became_peered":"2024-09-12T17:36:36.875459+0000","last_unstale":"2024-09-12T19:29:21.054779+0000","last_undegraded":"2024-09-12T19:29:21.054779+0000","last_fullsized":"2024-09-12T19:29:21.054779+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.726119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2269,"num_read_kb":2126,"num_write":529,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'255","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:14.039820+0000","last_change":"2024-09-12T17:36:34.881380+0000","last_active":"2024-09-12T19:26:14.039820+0000","last_peered":"2024-09-12T19:26:14.039820+0000","last_clean":"2024-09-12T19:26:14.039820+0000","last_became_active":"2024-09-12T17:36:34.880644+0000","last_became_peered":"2024-09-12T17:36:34.880644+0000","last_unstale":"2024-09-12T19:26:14.039820+0000","last_undegraded":"2024-09-12T19:26:14.039820+0000","last_fullsized":"2024-09-12T19:26:14.039820+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.644365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8672890,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":349,"num_read_kb":12213,"num_write":946,"num_write_kb":18682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686717+0000","last_change":"2024-09-12T17:36:38.901489+0000","last_active":"2024-09-12T19:26:40.686717+0000","last_peered":"2024-09-12T19:26:40.686717+0000","last_clean":"2024-09-12T19:26:40.686717+0000","last_became_active":"2024-09-12T17:36:38.900684+0000","last_became_peered":"2024-09-12T17:36:38.900684+0000","last_unstale":"2024-09-12T19:26:40.686717+0000","last_undegraded":"2024-09-12T19:26:40.686717+0000","last_fullsized":"2024-09-12T19:26:40.686717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:05.502369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'126","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:31.644856+0000","last_change":"2024-09-12T17:36:40.900116+0000","last_active":"2024-09-12T19:27:31.644856+0000","last_peered":"2024-09-12T19:27:31.644856+0000","last_clean":"2024-09-12T19:27:31.644856+0000","last_became_active":"2024-09-12T17:36:40.899340+0000","last_became_peered":"2024-09-12T17:36:40.899340+0000","last_unstale":"2024-09-12T19:27:31.644856+0000","last_undegraded":"2024-09-12T19:27:31.644856+0000","last_fullsized":"2024-09-12T19:27:31.644856+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:14.476334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.073064+0000","last_change":"2024-09-12T17:36:42.932966+0000","last_active":"2024-09-12T19:25:30.073064+0000","last_peered":"2024-09-12T19:25:30.073064+0000","last_clean":"2024-09-12T19:25:30.073064+0000","last_became_active":"2024-09-12T17:36:42.932100+0000","last_became_peered":"2024-09-12T17:36:42.932100+0000","last_unstale":"2024-09-12T19:25:30.073064+0000","last_undegraded":"2024-09-12T19:25:30.073064+0000","last_fullsized":"2024-09-12T19:25:30.073064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:17.207909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'122","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:58.466580+0000","last_change":"2024-09-12T17:36:44.966580+0000","last_active":"2024-09-12T19:27:58.466580+0000","last_peered":"2024-09-12T19:27:58.466580+0000","last_clean":"2024-09-12T19:27:58.466580+0000","last_became_active":"2024-09-12T17:36:44.965913+0000","last_became_peered":"2024-09-12T17:36:44.965913+0000","last_unstale":"2024-09-12T19:27:58.466580+0000","last_undegraded":"2024-09-12T19:27:58.466580+0000","last_fullsized":"2024-09-12T19:27:58.466580+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:05.954565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":210,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'399","reported_seq":1900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.293238+0000","last_change":"2024-09-12T17:36:36.905410+0000","last_active":"2024-09-12T19:28:00.293238+0000","last_peered":"2024-09-12T19:28:00.293238+0000","last_clean":"2024-09-12T19:28:00.293238+0000","last_became_active":"2024-09-12T17:36:36.904639+0000","last_became_peered":"2024-09-12T17:36:36.904639+0000","last_unstale":"2024-09-12T19:28:00.293238+0000","last_undegraded":"2024-09-12T19:28:00.293238+0000","last_fullsized":"2024-09-12T19:28:00.293238+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:07.140445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2242,"num_read_kb":2124,"num_write":448,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'250","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.352565+0000","last_change":"2024-09-12T17:36:34.879554+0000","last_active":"2024-09-12T19:26:15.352565+0000","last_peered":"2024-09-12T19:26:15.352565+0000","last_clean":"2024-09-12T19:26:15.352565+0000","last_became_active":"2024-09-12T17:36:34.879098+0000","last_became_peered":"2024-09-12T17:36:34.879098+0000","last_unstale":"2024-09-12T19:26:15.352565+0000","last_undegraded":"2024-09-12T19:26:15.352565+0000","last_fullsized":"2024-09-12T19:26:15.352565+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:31.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7103716,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":326,"num_read_kb":4507,"num_write":937,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.670087+0000","last_change":"2024-09-12T17:36:38.884358+0000","last_active":"2024-09-12T19:25:25.670087+0000","last_peered":"2024-09-12T19:25:25.670087+0000","last_clean":"2024-09-12T19:25:25.670087+0000","last_became_active":"2024-09-12T17:36:38.883758+0000","last_became_peered":"2024-09-12T17:36:38.883758+0000","last_unstale":"2024-09-12T19:25:25.670087+0000","last_undegraded":"2024-09-12T19:25:25.670087+0000","last_fullsized":"2024-09-12T19:25:25.670087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:23.851056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'185","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:33.286596+0000","last_change":"2024-09-12T17:36:40.908353+0000","last_active":"2024-09-12T19:27:33.286596+0000","last_peered":"2024-09-12T19:27:33.286596+0000","last_clean":"2024-09-12T19:27:33.286596+0000","last_became_active":"2024-09-12T17:36:40.907410+0000","last_became_peered":"2024-09-12T17:36:40.907410+0000","last_unstale":"2024-09-12T19:27:33.286596+0000","last_undegraded":"2024-09-12T19:27:33.286596+0000","last_fullsized":"2024-09-12T19:27:33.286596+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:48.613522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'799","reported_seq":7114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.082506+0000","last_change":"2024-09-12T17:36:42.918180+0000","last_active":"2024-09-12T19:29:25.082506+0000","last_peered":"2024-09-12T19:29:25.082506+0000","last_clean":"2024-09-12T19:29:25.082506+0000","last_became_active":"2024-09-12T17:36:42.916847+0000","last_became_peered":"2024-09-12T17:36:42.916847+0000","last_unstale":"2024-09-12T19:29:25.082506+0000","last_undegraded":"2024-09-12T19:29:25.082506+0000","last_fullsized":"2024-09-12T19:29:25.082506+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:45.795888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'223","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.042171+0000","last_change":"2024-09-12T17:36:44.958620+0000","last_active":"2024-09-12T19:28:03.042171+0000","last_peered":"2024-09-12T19:28:03.042171+0000","last_clean":"2024-09-12T19:28:03.042171+0000","last_became_active":"2024-09-12T17:36:44.954183+0000","last_became_peered":"2024-09-12T17:36:44.954183+0000","last_unstale":"2024-09-12T19:28:03.042171+0000","last_undegraded":"2024-09-12T19:28:03.042171+0000","last_fullsized":"2024-09-12T19:28:03.042171+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:52.168028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":505,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'457","reported_seq":2139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.060710+0000","last_change":"2024-09-12T17:36:36.878129+0000","last_active":"2024-09-12T19:29:21.060710+0000","last_peered":"2024-09-12T19:29:21.060710+0000","last_clean":"2024-09-12T19:29:21.060710+0000","last_became_active":"2024-09-12T17:36:36.877420+0000","last_became_peered":"2024-09-12T17:36:36.877420+0000","last_unstale":"2024-09-12T19:29:21.060710+0000","last_undegraded":"2024-09-12T19:29:21.060710+0000","last_fullsized":"2024-09-12T19:29:21.060710+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:44.309313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2635,"num_read_kb":2492,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'281","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.082154+0000","last_change":"2024-09-12T17:36:34.883169+0000","last_active":"2024-09-12T19:26:15.082154+0000","last_peered":"2024-09-12T19:26:15.082154+0000","last_clean":"2024-09-12T19:26:15.082154+0000","last_became_active":"2024-09-12T17:36:34.882902+0000","last_became_peered":"2024-09-12T17:36:34.882902+0000","last_unstale":"2024-09-12T19:26:15.082154+0000","last_undegraded":"2024-09-12T19:26:15.082154+0000","last_fullsized":"2024-09-12T19:26:15.082154+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:36.819998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12938782,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":509,"num_read_kb":75125,"num_write":968,"num_write_kb":28457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.340316+0000","last_change":"2024-09-12T17:36:38.899727+0000","last_active":"2024-09-12T19:25:25.340316+0000","last_peered":"2024-09-12T19:25:25.340316+0000","last_clean":"2024-09-12T19:25:25.340316+0000","last_became_active":"2024-09-12T17:36:38.899405+0000","last_became_peered":"2024-09-12T17:36:38.899405+0000","last_unstale":"2024-09-12T19:25:25.340316+0000","last_undegraded":"2024-09-12T19:25:25.340316+0000","last_fullsized":"2024-09-12T19:25:25.340316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:16.514700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'333","reported_seq":950,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.642972+0000","last_change":"2024-09-12T17:36:40.911431+0000","last_active":"2024-09-12T19:28:02.642972+0000","last_peered":"2024-09-12T19:28:02.642972+0000","last_clean":"2024-09-12T19:28:02.642972+0000","last_became_active":"2024-09-12T17:36:40.910700+0000","last_became_peered":"2024-09-12T17:36:40.910700+0000","last_unstale":"2024-09-12T19:28:02.642972+0000","last_undegraded":"2024-09-12T19:28:02.642972+0000","last_fullsized":"2024-09-12T19:28:02.642972+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:03.951315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71427,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":523,"num_read_kb":1019,"num_write":432,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'795","reported_seq":3152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.067739+0000","last_change":"2024-09-12T17:36:42.940750+0000","last_active":"2024-09-12T19:29:25.067739+0000","last_peered":"2024-09-12T19:29:25.067739+0000","last_clean":"2024-09-12T19:29:25.067739+0000","last_became_active":"2024-09-12T17:36:42.939966+0000","last_became_peered":"2024-09-12T17:36:42.939966+0000","last_unstale":"2024-09-12T19:29:25.067739+0000","last_undegraded":"2024-09-12T19:29:25.067739+0000","last_fullsized":"2024-09-12T19:29:25.067739+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:48.117866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'1125","reported_seq":2730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.116710+0000","last_change":"2024-09-12T17:36:36.886873+0000","last_active":"2024-09-12T19:28:32.116710+0000","last_peered":"2024-09-12T19:28:32.116710+0000","last_clean":"2024-09-12T19:28:32.116710+0000","last_became_active":"2024-09-12T17:36:36.886244+0000","last_became_peered":"2024-09-12T17:36:36.886244+0000","last_unstale":"2024-09-12T19:28:32.116710+0000","last_undegraded":"2024-09-12T19:28:32.116710+0000","last_fullsized":"2024-09-12T19:28:32.116710+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:16.947822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5270,"num_read_kb":4695,"num_write":1548,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'236","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.605155+0000","last_change":"2024-09-12T17:36:34.865757+0000","last_active":"2024-09-12T19:27:15.605155+0000","last_peered":"2024-09-12T19:27:15.605155+0000","last_clean":"2024-09-12T19:27:15.605155+0000","last_became_active":"2024-09-12T17:36:34.865417+0000","last_became_peered":"2024-09-12T17:36:34.865417+0000","last_unstale":"2024-09-12T19:27:15.605155+0000","last_undegraded":"2024-09-12T19:27:15.605155+0000","last_fullsized":"2024-09-12T19:27:15.605155+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:22.490874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658193,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":459,"num_read_kb":1839,"num_write":912,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.094709+0000","last_change":"2024-09-12T17:36:38.888368+0000","last_active":"2024-09-12T19:27:10.094709+0000","last_peered":"2024-09-12T19:27:10.094709+0000","last_clean":"2024-09-12T19:27:10.094709+0000","last_became_active":"2024-09-12T17:36:38.887444+0000","last_became_peered":"2024-09-12T17:36:38.887444+0000","last_unstale":"2024-09-12T19:27:10.094709+0000","last_undegraded":"2024-09-12T19:27:10.094709+0000","last_fullsized":"2024-09-12T19:27:10.094709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:57.724697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'443","reported_seq":1137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:36.440756+0000","last_change":"2024-09-12T17:36:40.914188+0000","last_active":"2024-09-12T19:27:36.440756+0000","last_peered":"2024-09-12T19:27:36.440756+0000","last_clean":"2024-09-12T19:27:36.440756+0000","last_became_active":"2024-09-12T17:36:40.911095+0000","last_became_peered":"2024-09-12T17:36:40.911095+0000","last_unstale":"2024-09-12T19:27:36.440756+0000","last_undegraded":"2024-09-12T19:27:36.440756+0000","last_fullsized":"2024-09-12T19:27:36.440756+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:16.975199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62664,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":725,"num_read_kb":1226,"num_write":550,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.049545+0000","last_change":"2024-09-12T17:36:42.928393+0000","last_active":"2024-09-12T19:26:59.049545+0000","last_peered":"2024-09-12T19:26:59.049545+0000","last_clean":"2024-09-12T19:26:59.049545+0000","last_became_active":"2024-09-12T17:36:42.927582+0000","last_became_peered":"2024-09-12T17:36:42.927582+0000","last_unstale":"2024-09-12T19:26:59.049545+0000","last_undegraded":"2024-09-12T19:26:59.049545+0000","last_fullsized":"2024-09-12T19:26:59.049545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:38.031907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'554","reported_seq":1399,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.053521+0000","last_change":"2024-09-12T17:36:44.958491+0000","last_active":"2024-09-12T19:29:22.053521+0000","last_peered":"2024-09-12T19:29:22.053521+0000","last_clean":"2024-09-12T19:29:22.053521+0000","last_became_active":"2024-09-12T17:36:44.953926+0000","last_became_peered":"2024-09-12T17:36:44.953926+0000","last_unstale":"2024-09-12T19:29:22.053521+0000","last_undegraded":"2024-09-12T19:29:22.053521+0000","last_fullsized":"2024-09-12T19:29:22.053521+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:32.984877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":1310,"num_write":1167,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'838","reported_seq":2541,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.040399+0000","last_change":"2024-09-12T17:36:36.886760+0000","last_active":"2024-09-12T19:29:21.040399+0000","last_peered":"2024-09-12T19:29:21.040399+0000","last_clean":"2024-09-12T19:29:21.040399+0000","last_became_active":"2024-09-12T17:36:36.886395+0000","last_became_peered":"2024-09-12T17:36:36.886395+0000","last_unstale":"2024-09-12T19:29:21.040399+0000","last_undegraded":"2024-09-12T19:29:21.040399+0000","last_fullsized":"2024-09-12T19:29:21.040399+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:47.591431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4184,"num_read_kb":3783,"num_write":1092,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'305","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:15.326474+0000","last_change":"2024-09-12T17:36:34.869074+0000","last_active":"2024-09-12T19:29:15.326474+0000","last_peered":"2024-09-12T19:29:15.326474+0000","last_clean":"2024-09-12T19:29:15.326474+0000","last_became_active":"2024-09-12T17:36:34.868465+0000","last_became_peered":"2024-09-12T17:36:34.868465+0000","last_unstale":"2024-09-12T19:29:15.326474+0000","last_undegraded":"2024-09-12T19:29:15.326474+0000","last_fullsized":"2024-09-12T19:29:15.326474+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:49.416583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3283434,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":499,"num_read_kb":2937,"num_write":1099,"num_write_kb":21558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"36'3","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.906583+0000","last_change":"2024-09-12T17:36:38.907718+0000","last_active":"2024-09-12T19:29:21.906583+0000","last_peered":"2024-09-12T19:29:21.906583+0000","last_clean":"2024-09-12T19:29:21.906583+0000","last_became_active":"2024-09-12T17:36:38.907007+0000","last_became_peered":"2024-09-12T17:36:38.907007+0000","last_unstale":"2024-09-12T19:29:21.906583+0000","last_undegraded":"2024-09-12T19:29:21.906583+0000","last_fullsized":"2024-09-12T19:29:21.906583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:31.556098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'323","reported_seq":942,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.720307+0000","last_change":"2024-09-12T17:36:40.912235+0000","last_active":"2024-09-12T19:29:10.720307+0000","last_peered":"2024-09-12T19:29:10.720307+0000","last_clean":"2024-09-12T19:29:10.720307+0000","last_became_active":"2024-09-12T17:36:40.911092+0000","last_became_peered":"2024-09-12T17:36:40.911092+0000","last_unstale":"2024-09-12T19:29:10.720307+0000","last_undegraded":"2024-09-12T19:29:10.720307+0000","last_fullsized":"2024-09-12T19:29:10.720307+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:38.796270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":1040,"num_write":430,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.669939+0000","last_change":"2024-09-12T17:36:42.937336+0000","last_active":"2024-09-12T19:25:25.669939+0000","last_peered":"2024-09-12T19:25:25.669939+0000","last_clean":"2024-09-12T19:25:25.669939+0000","last_became_active":"2024-09-12T17:36:42.933808+0000","last_became_peered":"2024-09-12T17:36:42.933808+0000","last_unstale":"2024-09-12T19:25:25.669939+0000","last_undegraded":"2024-09-12T19:25:25.669939+0000","last_fullsized":"2024-09-12T19:25:25.669939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:36.847620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'2432","reported_seq":4293,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.133108+0000","last_change":"2024-09-12T17:36:44.963412+0000","last_active":"2024-09-12T19:28:32.133108+0000","last_peered":"2024-09-12T19:28:32.133108+0000","last_clean":"2024-09-12T19:28:32.133108+0000","last_became_active":"2024-09-12T17:36:44.962630+0000","last_became_peered":"2024-09-12T17:36:44.962630+0000","last_unstale":"2024-09-12T19:28:32.133108+0000","last_undegraded":"2024-09-12T19:28:32.133108+0000","last_fullsized":"2024-09-12T19:28:32.133108+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:56.907799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6095,"num_read_kb":6091,"num_write":4930,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'434","reported_seq":2059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.318071+0000","last_change":"2024-09-12T17:36:36.880733+0000","last_active":"2024-09-12T19:28:00.318071+0000","last_peered":"2024-09-12T19:28:00.318071+0000","last_clean":"2024-09-12T19:28:00.318071+0000","last_became_active":"2024-09-12T17:36:36.880296+0000","last_became_peered":"2024-09-12T17:36:36.880296+0000","last_unstale":"2024-09-12T19:28:00.318071+0000","last_undegraded":"2024-09-12T19:28:00.318071+0000","last_fullsized":"2024-09-12T19:28:00.318071+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:06.645113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2387,"num_read_kb":2259,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'297","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.362024+0000","last_change":"2024-09-12T17:36:34.868949+0000","last_active":"2024-09-12T19:26:50.362024+0000","last_peered":"2024-09-12T19:26:50.362024+0000","last_clean":"2024-09-12T19:26:50.362024+0000","last_became_active":"2024-09-12T17:36:34.868243+0000","last_became_peered":"2024-09-12T17:36:34.868243+0000","last_unstale":"2024-09-12T19:26:50.362024+0000","last_undegraded":"2024-09-12T19:26:50.362024+0000","last_fullsized":"2024-09-12T19:26:50.362024+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:16.699361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2483814,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":502,"num_read_kb":48255,"num_write":1140,"num_write_kb":33494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258752+0000","last_change":"2024-09-12T17:36:38.893533+0000","last_active":"2024-09-12T19:26:55.258752+0000","last_peered":"2024-09-12T19:26:55.258752+0000","last_clean":"2024-09-12T19:26:55.258752+0000","last_became_active":"2024-09-12T17:36:38.892804+0000","last_became_peered":"2024-09-12T17:36:38.892804+0000","last_unstale":"2024-09-12T19:26:55.258752+0000","last_undegraded":"2024-09-12T19:26:55.258752+0000","last_fullsized":"2024-09-12T19:26:55.258752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:56.818407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'394","reported_seq":1044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.396367+0000","last_change":"2024-09-12T17:36:40.889733+0000","last_active":"2024-09-12T19:29:20.396367+0000","last_peered":"2024-09-12T19:29:20.396367+0000","last_clean":"2024-09-12T19:29:20.396367+0000","last_became_active":"2024-09-12T17:36:40.888974+0000","last_became_peered":"2024-09-12T17:36:40.888974+0000","last_unstale":"2024-09-12T19:29:20.396367+0000","last_undegraded":"2024-09-12T19:29:20.396367+0000","last_fullsized":"2024-09-12T19:29:20.396367+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:41.043970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61753,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":631,"num_read_kb":1144,"num_write":502,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'794","reported_seq":3040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.295685+0000","last_change":"2024-09-12T17:36:42.936433+0000","last_active":"2024-09-12T19:29:25.295685+0000","last_peered":"2024-09-12T19:29:25.295685+0000","last_clean":"2024-09-12T19:29:25.295685+0000","last_became_active":"2024-09-12T17:36:42.935529+0000","last_became_peered":"2024-09-12T17:36:42.935529+0000","last_unstale":"2024-09-12T19:29:25.295685+0000","last_undegraded":"2024-09-12T19:29:25.295685+0000","last_fullsized":"2024-09-12T19:29:25.295685+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:25.923124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'112","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.068420+0000","last_change":"2024-09-12T17:36:44.966442+0000","last_active":"2024-09-12T19:29:21.068420+0000","last_peered":"2024-09-12T19:29:21.068420+0000","last_clean":"2024-09-12T19:29:21.068420+0000","last_became_active":"2024-09-12T17:36:44.965763+0000","last_became_peered":"2024-09-12T17:36:44.965763+0000","last_unstale":"2024-09-12T19:29:21.068420+0000","last_undegraded":"2024-09-12T19:29:21.068420+0000","last_fullsized":"2024-09-12T19:29:21.068420+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:31.130717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":137,"num_write":264,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'411","reported_seq":1895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.034719+0000","last_change":"2024-09-12T17:36:36.907634+0000","last_active":"2024-09-12T19:29:21.034719+0000","last_peered":"2024-09-12T19:29:21.034719+0000","last_clean":"2024-09-12T19:29:21.034719+0000","last_became_active":"2024-09-12T17:36:36.905958+0000","last_became_peered":"2024-09-12T17:36:36.905958+0000","last_unstale":"2024-09-12T19:29:21.034719+0000","last_undegraded":"2024-09-12T19:29:21.034719+0000","last_fullsized":"2024-09-12T19:29:21.034719+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:58.834393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'290","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.599727+0000","last_change":"2024-09-12T17:36:34.861236+0000","last_active":"2024-09-12T19:26:50.599727+0000","last_peered":"2024-09-12T19:26:50.599727+0000","last_clean":"2024-09-12T19:26:50.599727+0000","last_became_active":"2024-09-12T17:36:34.860828+0000","last_became_peered":"2024-09-12T17:36:34.860828+0000","last_unstale":"2024-09-12T19:26:50.599727+0000","last_undegraded":"2024-09-12T19:26:50.599727+0000","last_fullsized":"2024-09-12T19:26:50.599727+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:17.732122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6713830,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":402,"num_read_kb":18690,"num_write":1023,"num_write_kb":31228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:24.029382+0000","last_change":"2024-09-12T17:36:38.897935+0000","last_active":"2024-09-12T19:25:24.029382+0000","last_peered":"2024-09-12T19:25:24.029382+0000","last_clean":"2024-09-12T19:25:24.029382+0000","last_became_active":"2024-09-12T17:36:38.897189+0000","last_became_peered":"2024-09-12T17:36:38.897189+0000","last_unstale":"2024-09-12T19:25:24.029382+0000","last_undegraded":"2024-09-12T19:25:24.029382+0000","last_fullsized":"2024-09-12T19:25:24.029382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:35.954626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'500","reported_seq":1178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.982850+0000","last_change":"2024-09-12T17:36:40.907633+0000","last_active":"2024-09-12T19:29:21.982850+0000","last_peered":"2024-09-12T19:29:21.982850+0000","last_clean":"2024-09-12T19:29:21.982850+0000","last_became_active":"2024-09-12T17:36:40.906903+0000","last_became_peered":"2024-09-12T17:36:40.906903+0000","last_unstale":"2024-09-12T19:29:21.982850+0000","last_undegraded":"2024-09-12T19:29:21.982850+0000","last_fullsized":"2024-09-12T19:29:21.982850+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:36.733767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112810,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":875,"num_read_kb":1839,"num_write":714,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263489+0000","last_change":"2024-09-12T17:36:42.933877+0000","last_active":"2024-09-12T19:27:15.263489+0000","last_peered":"2024-09-12T19:27:15.263489+0000","last_clean":"2024-09-12T19:27:15.263489+0000","last_became_active":"2024-09-12T17:36:42.933168+0000","last_became_peered":"2024-09-12T17:36:42.933168+0000","last_unstale":"2024-09-12T19:27:15.263489+0000","last_undegraded":"2024-09-12T19:27:15.263489+0000","last_fullsized":"2024-09-12T19:27:15.263489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:13.861626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'159","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.676473+0000","last_change":"2024-09-12T17:36:44.961695+0000","last_active":"2024-09-12T19:27:15.676473+0000","last_peered":"2024-09-12T19:27:15.676473+0000","last_clean":"2024-09-12T19:27:15.676473+0000","last_became_active":"2024-09-12T17:36:44.960935+0000","last_became_peered":"2024-09-12T17:36:44.960935+0000","last_unstale":"2024-09-12T19:27:15.676473+0000","last_undegraded":"2024-09-12T19:27:15.676473+0000","last_fullsized":"2024-09-12T19:27:15.676473+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:20.892764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1322,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":195,"num_write":366,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1240","reported_seq":2921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.119750+0000","last_change":"2024-09-12T17:36:36.914970+0000","last_active":"2024-09-12T19:28:32.119750+0000","last_peered":"2024-09-12T19:28:32.119750+0000","last_clean":"2024-09-12T19:28:32.119750+0000","last_became_active":"2024-09-12T17:36:36.914518+0000","last_became_peered":"2024-09-12T17:36:36.914518+0000","last_unstale":"2024-09-12T19:28:32.119750+0000","last_undegraded":"2024-09-12T19:28:32.119750+0000","last_fullsized":"2024-09-12T19:28:32.119750+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.726119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5692,"num_read_kb":5056,"num_write":1732,"num_write_kb":743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'269","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670302+0000","last_change":"2024-09-12T17:36:34.879597+0000","last_active":"2024-09-12T19:26:50.670302+0000","last_peered":"2024-09-12T19:26:50.670302+0000","last_clean":"2024-09-12T19:26:50.670302+0000","last_became_active":"2024-09-12T17:36:34.878896+0000","last_became_peered":"2024-09-12T17:36:34.878896+0000","last_unstale":"2024-09-12T19:26:50.670302+0000","last_undegraded":"2024-09-12T19:26:50.670302+0000","last_fullsized":"2024-09-12T19:26:50.670302+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:49.691790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325324,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":465,"num_read_kb":17715,"num_write":989,"num_write_kb":23877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671691+0000","last_change":"2024-09-12T17:36:38.908401+0000","last_active":"2024-09-12T19:26:55.671691+0000","last_peered":"2024-09-12T19:26:55.671691+0000","last_clean":"2024-09-12T19:26:55.671691+0000","last_became_active":"2024-09-12T17:36:38.907609+0000","last_became_peered":"2024-09-12T17:36:38.907609+0000","last_unstale":"2024-09-12T19:26:55.671691+0000","last_undegraded":"2024-09-12T19:26:55.671691+0000","last_fullsized":"2024-09-12T19:26:55.671691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:46.413534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'356","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.119357+0000","last_change":"2024-09-12T17:36:40.895469+0000","last_active":"2024-09-12T19:29:10.119357+0000","last_peered":"2024-09-12T19:29:10.119357+0000","last_clean":"2024-09-12T19:29:10.119357+0000","last_became_active":"2024-09-12T17:36:40.893702+0000","last_became_peered":"2024-09-12T17:36:40.893702+0000","last_unstale":"2024-09-12T19:29:10.119357+0000","last_undegraded":"2024-09-12T19:29:10.119357+0000","last_fullsized":"2024-09-12T19:29:10.119357+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:52.727654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57866,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":1119,"num_write":524,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.677558+0000","last_change":"2024-09-12T17:36:42.939282+0000","last_active":"2024-09-12T19:27:20.677558+0000","last_peered":"2024-09-12T19:27:20.677558+0000","last_clean":"2024-09-12T19:27:20.677558+0000","last_became_active":"2024-09-12T17:36:42.938437+0000","last_became_peered":"2024-09-12T17:36:42.938437+0000","last_unstale":"2024-09-12T19:27:20.677558+0000","last_undegraded":"2024-09-12T19:27:20.677558+0000","last_fullsized":"2024-09-12T19:27:20.677558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:17.930519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'144","reported_seq":718,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:09.868344+0000","last_change":"2024-09-12T17:36:44.959709+0000","last_active":"2024-09-12T19:29:09.868344+0000","last_peered":"2024-09-12T19:29:09.868344+0000","last_clean":"2024-09-12T19:29:09.868344+0000","last_became_active":"2024-09-12T17:36:44.956645+0000","last_became_peered":"2024-09-12T17:36:44.956645+0000","last_unstale":"2024-09-12T19:29:09.868344+0000","last_undegraded":"2024-09-12T19:29:09.868344+0000","last_fullsized":"2024-09-12T19:29:09.868344+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.650537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":356,"num_read_kb":303,"num_write":346,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'499","reported_seq":2115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.117569+0000","last_change":"2024-09-12T17:36:36.882735+0000","last_active":"2024-09-12T19:28:32.117569+0000","last_peered":"2024-09-12T19:28:32.117569+0000","last_clean":"2024-09-12T19:28:32.117569+0000","last_became_active":"2024-09-12T17:36:36.881882+0000","last_became_peered":"2024-09-12T17:36:36.881882+0000","last_unstale":"2024-09-12T19:28:32.117569+0000","last_undegraded":"2024-09-12T19:28:32.117569+0000","last_fullsized":"2024-09-12T19:28:32.117569+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.005619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2445,"num_write":630,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'283","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:51.821156+0000","last_change":"2024-09-12T17:36:34.870444+0000","last_active":"2024-09-12T19:26:51.821156+0000","last_peered":"2024-09-12T19:26:51.821156+0000","last_clean":"2024-09-12T19:26:51.821156+0000","last_became_active":"2024-09-12T17:36:34.870021+0000","last_became_peered":"2024-09-12T17:36:34.870021+0000","last_unstale":"2024-09-12T19:26:51.821156+0000","last_undegraded":"2024-09-12T19:26:51.821156+0000","last_fullsized":"2024-09-12T19:26:51.821156+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:32.502673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1583636,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":452,"num_read_kb":14188,"num_write":1118,"num_write_kb":25082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258787+0000","last_change":"2024-09-12T17:36:38.893625+0000","last_active":"2024-09-12T19:26:55.258787+0000","last_peered":"2024-09-12T19:26:55.258787+0000","last_clean":"2024-09-12T19:26:55.258787+0000","last_became_active":"2024-09-12T17:36:38.892885+0000","last_became_peered":"2024-09-12T17:36:38.892885+0000","last_unstale":"2024-09-12T19:26:55.258787+0000","last_undegraded":"2024-09-12T19:26:55.258787+0000","last_fullsized":"2024-09-12T19:26:55.258787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:23.133743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'374","reported_seq":1027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.049303+0000","last_change":"2024-09-12T17:36:40.898503+0000","last_active":"2024-09-12T19:29:22.049303+0000","last_peered":"2024-09-12T19:29:22.049303+0000","last_clean":"2024-09-12T19:29:22.049303+0000","last_became_active":"2024-09-12T17:36:40.896733+0000","last_became_peered":"2024-09-12T17:36:40.896733+0000","last_unstale":"2024-09-12T19:29:22.049303+0000","last_undegraded":"2024-09-12T19:29:22.049303+0000","last_fullsized":"2024-09-12T19:29:22.049303+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:00.019536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70333,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":1100,"num_write":464,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'767","reported_seq":3233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.079596+0000","last_change":"2024-09-12T17:36:42.935306+0000","last_active":"2024-09-12T19:29:25.079596+0000","last_peered":"2024-09-12T19:29:25.079596+0000","last_clean":"2024-09-12T19:29:25.079596+0000","last_became_active":"2024-09-12T17:36:42.934582+0000","last_became_peered":"2024-09-12T17:36:42.934582+0000","last_unstale":"2024-09-12T19:29:25.079596+0000","last_undegraded":"2024-09-12T19:29:25.079596+0000","last_fullsized":"2024-09-12T19:29:25.079596+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.168171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'100","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.913618+0000","last_change":"2024-09-12T17:36:44.938502+0000","last_active":"2024-09-12T19:28:02.913618+0000","last_peered":"2024-09-12T19:28:02.913618+0000","last_clean":"2024-09-12T19:28:02.913618+0000","last_became_active":"2024-09-12T17:36:44.937368+0000","last_became_peered":"2024-09-12T17:36:44.937368+0000","last_unstale":"2024-09-12T19:28:02.913618+0000","last_undegraded":"2024-09-12T19:28:02.913618+0000","last_fullsized":"2024-09-12T19:28:02.913618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:33.490996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":224,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'653","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.248765+0000","last_change":"2024-09-12T17:36:36.883321+0000","last_active":"2024-09-12T19:26:55.248765+0000","last_peered":"2024-09-12T19:26:55.248765+0000","last_clean":"2024-09-12T19:26:55.248765+0000","last_became_active":"2024-09-12T17:36:36.883043+0000","last_became_peered":"2024-09-12T17:36:36.883043+0000","last_unstale":"2024-09-12T19:26:55.248765+0000","last_undegraded":"2024-09-12T19:26:55.248765+0000","last_fullsized":"2024-09-12T19:26:55.248765+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:50.911594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3181,"num_read_kb":2856,"num_write":918,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'320","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.631187+0000","last_change":"2024-09-12T17:36:34.874846+0000","last_active":"2024-09-12T19:27:38.631187+0000","last_peered":"2024-09-12T19:27:38.631187+0000","last_clean":"2024-09-12T19:27:38.631187+0000","last_became_active":"2024-09-12T17:36:34.873263+0000","last_became_peered":"2024-09-12T17:36:34.873263+0000","last_unstale":"2024-09-12T19:27:38.631187+0000","last_undegraded":"2024-09-12T19:27:38.631187+0000","last_fullsized":"2024-09-12T19:27:38.631187+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:42.358689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11461331,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":517,"num_read_kb":21339,"num_write":1007,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1479,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.922275+0000","last_change":"2024-09-12T17:36:38.889880+0000","last_active":"2024-09-12T19:29:21.922275+0000","last_peered":"2024-09-12T19:29:21.922275+0000","last_clean":"2024-09-12T19:29:21.922275+0000","last_became_active":"2024-09-12T17:36:38.888795+0000","last_became_peered":"2024-09-12T17:36:38.888795+0000","last_unstale":"2024-09-12T19:29:21.922275+0000","last_undegraded":"2024-09-12T19:29:21.922275+0000","last_fullsized":"2024-09-12T19:29:21.922275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:53.568736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'150","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.261761+0000","last_change":"2024-09-12T17:36:40.893833+0000","last_active":"2024-09-12T19:27:30.261761+0000","last_peered":"2024-09-12T19:27:30.261761+0000","last_clean":"2024-09-12T19:27:30.261761+0000","last_became_active":"2024-09-12T17:36:40.893090+0000","last_became_peered":"2024-09-12T17:36:40.893090+0000","last_unstale":"2024-09-12T19:27:30.261761+0000","last_undegraded":"2024-09-12T19:27:30.261761+0000","last_fullsized":"2024-09-12T19:27:30.261761+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:17.912186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'802","reported_seq":3152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.080128+0000","last_change":"2024-09-12T17:36:42.937918+0000","last_active":"2024-09-12T19:29:25.080128+0000","last_peered":"2024-09-12T19:29:25.080128+0000","last_clean":"2024-09-12T19:29:25.080128+0000","last_became_active":"2024-09-12T17:36:42.937195+0000","last_became_peered":"2024-09-12T17:36:42.937195+0000","last_unstale":"2024-09-12T19:29:25.080128+0000","last_undegraded":"2024-09-12T19:29:25.080128+0000","last_fullsized":"2024-09-12T19:29:25.080128+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:27.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'109","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.251823+0000","last_change":"2024-09-12T17:36:44.960800+0000","last_active":"2024-09-12T19:27:10.251823+0000","last_peered":"2024-09-12T19:27:10.251823+0000","last_clean":"2024-09-12T19:27:10.251823+0000","last_became_active":"2024-09-12T17:36:44.960042+0000","last_became_peered":"2024-09-12T17:36:44.960042+0000","last_unstale":"2024-09-12T19:27:10.251823+0000","last_undegraded":"2024-09-12T19:27:10.251823+0000","last_fullsized":"2024-09-12T19:27:10.251823+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:54.849029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'983","reported_seq":2639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.365058+0000","last_change":"2024-09-12T17:36:36.914243+0000","last_active":"2024-09-12T19:28:00.365058+0000","last_peered":"2024-09-12T19:28:00.365058+0000","last_clean":"2024-09-12T19:28:00.365058+0000","last_became_active":"2024-09-12T17:36:36.913566+0000","last_became_peered":"2024-09-12T17:36:36.913566+0000","last_unstale":"2024-09-12T19:28:00.365058+0000","last_undegraded":"2024-09-12T19:28:00.365058+0000","last_fullsized":"2024-09-12T19:28:00.365058+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":900,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:32.358617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4811,"num_read_kb":4293,"num_write":1402,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'239","reported_seq":870,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.692302+0000","last_change":"2024-09-12T17:36:34.863609+0000","last_active":"2024-09-12T19:27:05.692302+0000","last_peered":"2024-09-12T19:27:05.692302+0000","last_clean":"2024-09-12T19:27:05.692302+0000","last_became_active":"2024-09-12T17:36:34.862534+0000","last_became_peered":"2024-09-12T17:36:34.862534+0000","last_unstale":"2024-09-12T19:27:05.692302+0000","last_undegraded":"2024-09-12T19:27:05.692302+0000","last_fullsized":"2024-09-12T19:27:05.692302+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:22.424632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9477394,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":328,"num_read_kb":22960,"num_write":880,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.363062+0000","last_change":"2024-09-12T17:36:38.886369+0000","last_active":"2024-09-12T19:26:55.363062+0000","last_peered":"2024-09-12T19:26:55.363062+0000","last_clean":"2024-09-12T19:26:55.363062+0000","last_became_active":"2024-09-12T17:36:38.885678+0000","last_became_peered":"2024-09-12T17:36:38.885678+0000","last_unstale":"2024-09-12T19:26:55.363062+0000","last_undegraded":"2024-09-12T19:26:55.363062+0000","last_fullsized":"2024-09-12T19:26:55.363062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:06.010071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'409","reported_seq":1088,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.119332+0000","last_change":"2024-09-12T17:36:40.900876+0000","last_active":"2024-09-12T19:29:10.119332+0000","last_peered":"2024-09-12T19:29:10.119332+0000","last_clean":"2024-09-12T19:29:10.119332+0000","last_became_active":"2024-09-12T17:36:40.900295+0000","last_became_peered":"2024-09-12T17:36:40.900295+0000","last_unstale":"2024-09-12T19:29:10.119332+0000","last_undegraded":"2024-09-12T19:29:10.119332+0000","last_fullsized":"2024-09-12T19:29:10.119332+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:17.899103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47862,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":651,"num_read_kb":1074,"num_write":490,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249747+0000","last_change":"2024-09-12T17:36:42.928327+0000","last_active":"2024-09-12T19:27:00.249747+0000","last_peered":"2024-09-12T19:27:00.249747+0000","last_clean":"2024-09-12T19:27:00.249747+0000","last_became_active":"2024-09-12T17:36:42.927716+0000","last_became_peered":"2024-09-12T17:36:42.927716+0000","last_unstale":"2024-09-12T19:27:00.249747+0000","last_undegraded":"2024-09-12T19:27:00.249747+0000","last_fullsized":"2024-09-12T19:27:00.249747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.478941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'114","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:58.451214+0000","last_change":"2024-09-12T17:36:44.943385+0000","last_active":"2024-09-12T19:27:58.451214+0000","last_peered":"2024-09-12T19:27:58.451214+0000","last_clean":"2024-09-12T19:27:58.451214+0000","last_became_active":"2024-09-12T17:36:44.942505+0000","last_became_peered":"2024-09-12T17:36:44.942505+0000","last_unstale":"2024-09-12T19:27:58.451214+0000","last_undegraded":"2024-09-12T19:27:58.451214+0000","last_fullsized":"2024-09-12T19:27:58.451214+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:16.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":134,"num_write":256,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'733","reported_seq":2201,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.626150+0000","last_change":"2024-09-12T17:36:36.882337+0000","last_active":"2024-09-12T19:28:02.626150+0000","last_peered":"2024-09-12T19:28:02.626150+0000","last_clean":"2024-09-12T19:28:02.626150+0000","last_became_active":"2024-09-12T17:36:36.881456+0000","last_became_peered":"2024-09-12T17:36:36.881456+0000","last_unstale":"2024-09-12T19:28:02.626150+0000","last_undegraded":"2024-09-12T19:28:02.626150+0000","last_fullsized":"2024-09-12T19:28:02.626150+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:26.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3432,"num_read_kb":3120,"num_write":969,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.091239+0000","last_change":"2024-09-12T17:36:16.723179+0000","last_active":"2024-09-12T19:26:55.091239+0000","last_peered":"2024-09-12T19:26:55.091239+0000","last_clean":"2024-09-12T19:26:55.091239+0000","last_became_active":"2024-09-12T17:36:16.722334+0000","last_became_peered":"2024-09-12T17:36:16.722334+0000","last_unstale":"2024-09-12T19:26:55.091239+0000","last_undegraded":"2024-09-12T19:26:55.091239+0000","last_fullsized":"2024-09-12T19:26:55.091239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_clean_scrub_stamp":"2024-09-12T17:36:15.696738+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:31.267846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.361940+0000","last_change":"2024-09-12T17:36:23.787411+0000","last_active":"2024-09-12T19:26:50.361940+0000","last_peered":"2024-09-12T19:26:50.361940+0000","last_clean":"2024-09-12T19:26:50.361940+0000","last_became_active":"2024-09-12T17:36:21.777852+0000","last_became_peered":"2024-09-12T17:36:21.777852+0000","last_unstale":"2024-09-12T19:26:50.361940+0000","last_undegraded":"2024-09-12T19:26:50.361940+0000","last_fullsized":"2024-09-12T19:26:50.361940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:45.393945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019340550000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'318","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691212+0000","last_change":"2024-09-12T17:36:34.870746+0000","last_active":"2024-09-12T19:27:00.691212+0000","last_peered":"2024-09-12T19:27:00.691212+0000","last_clean":"2024-09-12T19:27:00.691212+0000","last_became_active":"2024-09-12T17:36:34.865550+0000","last_became_peered":"2024-09-12T17:36:34.865550+0000","last_unstale":"2024-09-12T19:27:00.691212+0000","last_undegraded":"2024-09-12T19:27:00.691212+0000","last_fullsized":"2024-09-12T19:27:00.691212+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:37.982105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5645323,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":608,"num_read_kb":15438,"num_write":1409,"num_write_kb":31533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602989+0000","last_change":"2024-09-12T17:36:38.892479+0000","last_active":"2024-09-12T19:27:05.602989+0000","last_peered":"2024-09-12T19:27:05.602989+0000","last_clean":"2024-09-12T19:27:05.602989+0000","last_became_active":"2024-09-12T17:36:38.891774+0000","last_became_peered":"2024-09-12T17:36:38.891774+0000","last_unstale":"2024-09-12T19:27:05.602989+0000","last_undegraded":"2024-09-12T19:27:05.602989+0000","last_fullsized":"2024-09-12T19:27:05.602989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:04.757971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'732","reported_seq":1464,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.019633+0000","last_change":"2024-09-12T17:36:40.886469+0000","last_active":"2024-09-12T19:29:22.019633+0000","last_peered":"2024-09-12T19:29:22.019633+0000","last_clean":"2024-09-12T19:29:22.019633+0000","last_became_active":"2024-09-12T17:36:40.885684+0000","last_became_peered":"2024-09-12T17:36:40.885684+0000","last_unstale":"2024-09-12T19:29:22.019633+0000","last_undegraded":"2024-09-12T19:29:22.019633+0000","last_fullsized":"2024-09-12T19:29:22.019633+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:17.424179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165348,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1405,"num_read_kb":2814,"num_write":1352,"num_write_kb":1180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263697+0000","last_change":"2024-09-12T17:36:42.919971+0000","last_active":"2024-09-12T19:27:15.263697+0000","last_peered":"2024-09-12T19:27:15.263697+0000","last_clean":"2024-09-12T19:27:15.263697+0000","last_became_active":"2024-09-12T17:36:42.919204+0000","last_became_peered":"2024-09-12T17:36:42.919204+0000","last_unstale":"2024-09-12T19:27:15.263697+0000","last_undegraded":"2024-09-12T19:27:15.263697+0000","last_fullsized":"2024-09-12T19:27:15.263697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:28.580042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'184","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.702184+0000","last_change":"2024-09-12T17:36:44.954972+0000","last_active":"2024-09-12T19:28:02.702184+0000","last_peered":"2024-09-12T19:28:02.702184+0000","last_clean":"2024-09-12T19:28:02.702184+0000","last_became_active":"2024-09-12T17:36:44.954321+0000","last_became_peered":"2024-09-12T17:36:44.954321+0000","last_unstale":"2024-09-12T19:28:02.702184+0000","last_undegraded":"2024-09-12T19:28:02.702184+0000","last_fullsized":"2024-09-12T19:28:02.702184+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:09.226720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":488,"num_write":378,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'504","reported_seq":2085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.262524+0000","last_change":"2024-09-12T17:36:36.907852+0000","last_active":"2024-09-12T19:27:10.262524+0000","last_peered":"2024-09-12T19:27:10.262524+0000","last_clean":"2024-09-12T19:27:10.262524+0000","last_became_active":"2024-09-12T17:36:36.906789+0000","last_became_peered":"2024-09-12T17:36:36.906789+0000","last_unstale":"2024-09-12T19:27:10.262524+0000","last_undegraded":"2024-09-12T19:27:10.262524+0000","last_fullsized":"2024-09-12T19:27:10.262524+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:22.056362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2691,"num_read_kb":2505,"num_write":636,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.362890+0000","last_change":"2024-09-12T17:36:23.786635+0000","last_active":"2024-09-12T19:26:55.362890+0000","last_peered":"2024-09-12T19:26:55.362890+0000","last_clean":"2024-09-12T19:26:55.362890+0000","last_became_active":"2024-09-12T17:36:21.785026+0000","last_became_peered":"2024-09-12T17:36:21.785026+0000","last_unstale":"2024-09-12T19:26:55.362890+0000","last_undegraded":"2024-09-12T19:26:55.362890+0000","last_fullsized":"2024-09-12T19:26:55.362890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:07.883744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184601,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'320","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.049444+0000","last_change":"2024-09-12T17:36:34.885024+0000","last_active":"2024-09-12T19:26:59.049444+0000","last_peered":"2024-09-12T19:26:59.049444+0000","last_clean":"2024-09-12T19:26:59.049444+0000","last_became_active":"2024-09-12T17:36:34.882818+0000","last_became_peered":"2024-09-12T17:36:34.882818+0000","last_unstale":"2024-09-12T19:26:59.049444+0000","last_undegraded":"2024-09-12T19:26:59.049444+0000","last_fullsized":"2024-09-12T19:26:59.049444+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:00.872257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4458353,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":553,"num_read_kb":22197,"num_write":1262,"num_write_kb":15503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366617+0000","last_change":"2024-09-12T17:36:38.895923+0000","last_active":"2024-09-12T19:27:10.366617+0000","last_peered":"2024-09-12T19:27:10.366617+0000","last_clean":"2024-09-12T19:27:10.366617+0000","last_became_active":"2024-09-12T17:36:38.895378+0000","last_became_peered":"2024-09-12T17:36:38.895378+0000","last_unstale":"2024-09-12T19:27:10.366617+0000","last_undegraded":"2024-09-12T19:27:10.366617+0000","last_fullsized":"2024-09-12T19:27:10.366617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:49.295916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1435","reported_seq":3773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.079442+0000","last_change":"2024-09-12T17:36:40.909473+0000","last_active":"2024-09-12T19:29:25.079442+0000","last_peered":"2024-09-12T19:29:25.079442+0000","last_clean":"2024-09-12T19:29:25.079442+0000","last_became_active":"2024-09-12T17:36:40.908721+0000","last_became_peered":"2024-09-12T17:36:40.908721+0000","last_unstale":"2024-09-12T19:29:25.079442+0000","last_undegraded":"2024-09-12T19:29:25.079442+0000","last_fullsized":"2024-09-12T19:29:25.079442+0000","mapping_epoch":30,"log_start":"265'1400","ondisk_log_start":"265'1400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:39.239469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179443,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2228,"num_read_kb":3772,"num_write":1364,"num_write_kb":1128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:35.342807+0000","last_change":"2024-09-12T17:36:42.918278+0000","last_active":"2024-09-12T19:25:35.342807+0000","last_peered":"2024-09-12T19:25:35.342807+0000","last_clean":"2024-09-12T19:25:35.342807+0000","last_became_active":"2024-09-12T17:36:42.917432+0000","last_became_peered":"2024-09-12T17:36:42.917432+0000","last_unstale":"2024-09-12T19:25:35.342807+0000","last_undegraded":"2024-09-12T19:25:35.342807+0000","last_fullsized":"2024-09-12T19:25:35.342807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:35.437908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'252","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:59.716094+0000","last_change":"2024-09-12T17:36:44.959827+0000","last_active":"2024-09-12T19:27:59.716094+0000","last_peered":"2024-09-12T19:27:59.716094+0000","last_clean":"2024-09-12T19:27:59.716094+0000","last_became_active":"2024-09-12T17:36:44.956687+0000","last_became_peered":"2024-09-12T17:36:44.956687+0000","last_unstale":"2024-09-12T19:27:59.716094+0000","last_undegraded":"2024-09-12T19:27:59.716094+0000","last_fullsized":"2024-09-12T19:27:59.716094+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:45.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":419,"num_write":569,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'457","reported_seq":1909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.363563+0000","last_change":"2024-09-12T17:36:36.877140+0000","last_active":"2024-09-12T19:28:00.363563+0000","last_peered":"2024-09-12T19:28:00.363563+0000","last_clean":"2024-09-12T19:28:00.363563+0000","last_became_active":"2024-09-12T17:36:36.876424+0000","last_became_peered":"2024-09-12T17:36:36.876424+0000","last_unstale":"2024-09-12T19:28:00.363563+0000","last_undegraded":"2024-09-12T19:28:00.363563+0000","last_fullsized":"2024-09-12T19:28:00.363563+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:09.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2313,"num_read_kb":2138,"num_write":582,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670217+0000","last_change":"2024-09-12T17:36:23.789501+0000","last_active":"2024-09-12T19:26:50.670217+0000","last_peered":"2024-09-12T19:26:50.670217+0000","last_clean":"2024-09-12T19:26:50.670217+0000","last_became_active":"2024-09-12T17:36:21.786793+0000","last_became_peered":"2024-09-12T17:36:21.786793+0000","last_unstale":"2024-09-12T19:26:50.670217+0000","last_undegraded":"2024-09-12T19:26:50.670217+0000","last_fullsized":"2024-09-12T19:26:50.670217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:31.878088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011925740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'269","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261041+0000","last_change":"2024-09-12T17:36:34.879706+0000","last_active":"2024-09-12T19:27:05.261041+0000","last_peered":"2024-09-12T19:27:05.261041+0000","last_clean":"2024-09-12T19:27:05.261041+0000","last_became_active":"2024-09-12T17:36:34.878944+0000","last_became_peered":"2024-09-12T17:36:34.878944+0000","last_unstale":"2024-09-12T19:27:05.261041+0000","last_undegraded":"2024-09-12T19:27:05.261041+0000","last_fullsized":"2024-09-12T19:27:05.261041+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:35.362609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10044398,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":464,"num_read_kb":44432,"num_write":1056,"num_write_kb":34964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675306+0000","last_change":"2024-09-12T17:36:38.908387+0000","last_active":"2024-09-12T19:27:10.675306+0000","last_peered":"2024-09-12T19:27:10.675306+0000","last_clean":"2024-09-12T19:27:10.675306+0000","last_became_active":"2024-09-12T17:36:38.907685+0000","last_became_peered":"2024-09-12T17:36:38.907685+0000","last_unstale":"2024-09-12T19:27:10.675306+0000","last_undegraded":"2024-09-12T19:27:10.675306+0000","last_fullsized":"2024-09-12T19:27:10.675306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:58.506591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'385","reported_seq":2346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.224631+0000","last_change":"2024-09-12T17:36:40.907875+0000","last_active":"2024-09-12T19:29:22.224631+0000","last_peered":"2024-09-12T19:29:22.224631+0000","last_clean":"2024-09-12T19:29:22.224631+0000","last_became_active":"2024-09-12T17:36:40.907340+0000","last_became_peered":"2024-09-12T17:36:40.907340+0000","last_unstale":"2024-09-12T19:29:22.224631+0000","last_undegraded":"2024-09-12T19:29:22.224631+0000","last_fullsized":"2024-09-12T19:29:22.224631+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:01.365979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":374,"num_read_kb":364,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.693668+0000","last_change":"2024-09-12T17:36:42.932731+0000","last_active":"2024-09-12T19:27:10.693668+0000","last_peered":"2024-09-12T19:27:10.693668+0000","last_clean":"2024-09-12T19:27:10.693668+0000","last_became_active":"2024-09-12T17:36:42.931884+0000","last_became_peered":"2024-09-12T17:36:42.931884+0000","last_unstale":"2024-09-12T19:27:10.693668+0000","last_undegraded":"2024-09-12T19:27:10.693668+0000","last_fullsized":"2024-09-12T19:27:10.693668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:21.823146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'257","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.184602+0000","last_change":"2024-09-12T17:36:44.940743+0000","last_active":"2024-09-12T19:28:03.184602+0000","last_peered":"2024-09-12T19:28:03.184602+0000","last_clean":"2024-09-12T19:28:03.184602+0000","last_became_active":"2024-09-12T17:36:44.940041+0000","last_became_peered":"2024-09-12T17:36:44.940041+0000","last_unstale":"2024-09-12T19:28:03.184602+0000","last_undegraded":"2024-09-12T19:28:03.184602+0000","last_fullsized":"2024-09-12T19:28:03.184602+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:45.197303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":565,"num_write":575,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'749","reported_seq":2219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181845+0000","last_change":"2024-09-12T17:36:36.897102+0000","last_active":"2024-09-12T19:27:10.181845+0000","last_peered":"2024-09-12T19:27:10.181845+0000","last_clean":"2024-09-12T19:27:10.181845+0000","last_became_active":"2024-09-12T17:36:36.896152+0000","last_became_peered":"2024-09-12T17:36:36.896152+0000","last_unstale":"2024-09-12T19:27:10.181845+0000","last_undegraded":"2024-09-12T19:27:10.181845+0000","last_fullsized":"2024-09-12T19:27:10.181845+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:23.827520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3496,"num_read_kb":3152,"num_write":986,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":552,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.361888+0000","last_change":"2024-09-12T17:36:23.787252+0000","last_active":"2024-09-12T19:26:50.361888+0000","last_peered":"2024-09-12T19:26:50.361888+0000","last_clean":"2024-09-12T19:26:50.361888+0000","last_became_active":"2024-09-12T17:36:21.777173+0000","last_became_peered":"2024-09-12T17:36:21.777173+0000","last_unstale":"2024-09-12T19:26:50.361888+0000","last_undegraded":"2024-09-12T19:26:50.361888+0000","last_fullsized":"2024-09-12T19:26:50.361888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:26.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001776889,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'295","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.138619+0000","last_change":"2024-09-12T17:37:07.868392+0000","last_active":"2024-09-12T19:29:20.138619+0000","last_peered":"2024-09-12T19:29:20.138619+0000","last_clean":"2024-09-12T19:29:20.138619+0000","last_became_active":"2024-09-12T17:37:07.867652+0000","last_became_peered":"2024-09-12T17:37:07.867652+0000","last_unstale":"2024-09-12T19:29:20.138619+0000","last_undegraded":"2024-09-12T19:29:20.138619+0000","last_fullsized":"2024-09-12T19:29:20.138619+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:35.602532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663260,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":580,"num_read_kb":7398,"num_write":1078,"num_write_kb":18590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:25.678699+0000","last_change":"2024-09-12T17:36:38.912854+0000","last_active":"2024-09-12T19:27:25.678699+0000","last_peered":"2024-09-12T19:27:25.678699+0000","last_clean":"2024-09-12T19:27:25.678699+0000","last_became_active":"2024-09-12T17:36:38.912059+0000","last_became_peered":"2024-09-12T17:36:38.912059+0000","last_unstale":"2024-09-12T19:27:25.678699+0000","last_undegraded":"2024-09-12T19:27:25.678699+0000","last_fullsized":"2024-09-12T19:27:25.678699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:05.736408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'216","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.294596+0000","last_change":"2024-09-12T17:36:40.885516+0000","last_active":"2024-09-12T19:29:20.294596+0000","last_peered":"2024-09-12T19:29:20.294596+0000","last_clean":"2024-09-12T19:29:20.294596+0000","last_became_active":"2024-09-12T17:36:40.884794+0000","last_became_peered":"2024-09-12T17:36:40.884794+0000","last_unstale":"2024-09-12T19:29:20.294596+0000","last_undegraded":"2024-09-12T19:29:20.294596+0000","last_fullsized":"2024-09-12T19:29:20.294596+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:21.742525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":278,"num_read_kb":269,"num_write":202,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.367743+0000","last_change":"2024-09-12T17:36:42.921806+0000","last_active":"2024-09-12T19:27:15.367743+0000","last_peered":"2024-09-12T19:27:15.367743+0000","last_clean":"2024-09-12T19:27:15.367743+0000","last_became_active":"2024-09-12T17:36:42.920887+0000","last_became_peered":"2024-09-12T17:36:42.920887+0000","last_unstale":"2024-09-12T19:27:15.367743+0000","last_undegraded":"2024-09-12T19:27:15.367743+0000","last_fullsized":"2024-09-12T19:27:15.367743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:38.116745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'126","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.095950+0000","last_change":"2024-09-12T17:36:44.938503+0000","last_active":"2024-09-12T19:27:15.095950+0000","last_peered":"2024-09-12T19:27:15.095950+0000","last_clean":"2024-09-12T19:27:15.095950+0000","last_became_active":"2024-09-12T17:36:44.937666+0000","last_became_peered":"2024-09-12T17:36:44.937666+0000","last_unstale":"2024-09-12T19:27:15.095950+0000","last_undegraded":"2024-09-12T19:27:15.095950+0000","last_fullsized":"2024-09-12T19:27:15.095950+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:23.897144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":289,"num_read_kb":276,"num_write":312,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'528","reported_seq":2139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.120710+0000","last_change":"2024-09-12T17:36:36.881070+0000","last_active":"2024-09-12T19:28:32.120710+0000","last_peered":"2024-09-12T19:28:32.120710+0000","last_clean":"2024-09-12T19:28:32.120710+0000","last_became_active":"2024-09-12T17:36:36.880335+0000","last_became_peered":"2024-09-12T17:36:36.880335+0000","last_unstale":"2024-09-12T19:28:32.120710+0000","last_undegraded":"2024-09-12T19:28:32.120710+0000","last_fullsized":"2024-09-12T19:28:32.120710+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:22.571992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2654,"num_read_kb":2484,"num_write":644,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'304","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.631813+0000","last_change":"2024-09-12T17:36:34.878244+0000","last_active":"2024-09-12T19:27:38.631813+0000","last_peered":"2024-09-12T19:27:38.631813+0000","last_clean":"2024-09-12T19:27:38.631813+0000","last_became_active":"2024-09-12T17:36:34.877412+0000","last_became_peered":"2024-09-12T17:36:34.877412+0000","last_unstale":"2024-09-12T19:27:38.631813+0000","last_undegraded":"2024-09-12T19:27:38.631813+0000","last_fullsized":"2024-09-12T19:27:38.631813+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:42.929889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20396436,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":459,"num_read_kb":26718,"num_write":1098,"num_write_kb":36792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":555,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.257613+0000","last_change":"2024-09-12T17:36:23.789441+0000","last_active":"2024-09-12T19:26:50.257613+0000","last_peered":"2024-09-12T19:26:50.257613+0000","last_clean":"2024-09-12T19:26:50.257613+0000","last_became_active":"2024-09-12T17:36:21.786429+0000","last_became_peered":"2024-09-12T17:36:21.786429+0000","last_unstale":"2024-09-12T19:26:50.257613+0000","last_undegraded":"2024-09-12T19:26:50.257613+0000","last_fullsized":"2024-09-12T19:26:50.257613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:14.667779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011387680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"36'5","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.905407+0000","last_change":"2024-09-12T17:36:38.903117+0000","last_active":"2024-09-12T19:29:21.905407+0000","last_peered":"2024-09-12T19:29:21.905407+0000","last_clean":"2024-09-12T19:29:21.905407+0000","last_became_active":"2024-09-12T17:36:38.902432+0000","last_became_peered":"2024-09-12T17:36:38.902432+0000","last_unstale":"2024-09-12T19:29:21.905407+0000","last_undegraded":"2024-09-12T19:29:21.905407+0000","last_fullsized":"2024-09-12T19:29:21.905407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:28.729642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'744","reported_seq":1472,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.999995+0000","last_change":"2024-09-12T17:36:40.903273+0000","last_active":"2024-09-12T19:29:21.999995+0000","last_peered":"2024-09-12T19:29:21.999995+0000","last_clean":"2024-09-12T19:29:21.999995+0000","last_became_active":"2024-09-12T17:36:40.902488+0000","last_became_peered":"2024-09-12T17:36:40.902488+0000","last_unstale":"2024-09-12T19:29:21.999995+0000","last_undegraded":"2024-09-12T19:29:21.999995+0000","last_fullsized":"2024-09-12T19:29:21.999995+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:44.794951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114766,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1929,"num_read_kb":2923,"num_write":2602,"num_write_kb":2363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.251784+0000","last_change":"2024-09-12T17:36:42.932443+0000","last_active":"2024-09-12T19:27:10.251784+0000","last_peered":"2024-09-12T19:27:10.251784+0000","last_clean":"2024-09-12T19:27:10.251784+0000","last_became_active":"2024-09-12T17:36:42.931746+0000","last_became_peered":"2024-09-12T17:36:42.931746+0000","last_unstale":"2024-09-12T19:27:10.251784+0000","last_undegraded":"2024-09-12T19:27:10.251784+0000","last_fullsized":"2024-09-12T19:27:10.251784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:17.226964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'136","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.427148+0000","last_change":"2024-09-12T17:36:44.959931+0000","last_active":"2024-09-12T19:27:55.427148+0000","last_peered":"2024-09-12T19:27:55.427148+0000","last_clean":"2024-09-12T19:27:55.427148+0000","last_became_active":"2024-09-12T17:36:44.959109+0000","last_became_peered":"2024-09-12T17:36:44.959109+0000","last_unstale":"2024-09-12T19:27:55.427148+0000","last_undegraded":"2024-09-12T19:27:55.427148+0000","last_fullsized":"2024-09-12T19:27:55.427148+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:21.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'606","reported_seq":2146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.022973+0000","last_change":"2024-09-12T17:36:36.884101+0000","last_active":"2024-09-12T19:29:21.022973+0000","last_peered":"2024-09-12T19:29:21.022973+0000","last_clean":"2024-09-12T19:29:21.022973+0000","last_became_active":"2024-09-12T17:36:36.883397+0000","last_became_peered":"2024-09-12T17:36:36.883397+0000","last_unstale":"2024-09-12T19:29:21.022973+0000","last_undegraded":"2024-09-12T19:29:21.022973+0000","last_fullsized":"2024-09-12T19:29:21.022973+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:32.872711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3050,"num_read_kb":2738,"num_write":793,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'298","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.049575+0000","last_change":"2024-09-12T17:36:34.892972+0000","last_active":"2024-09-12T19:26:59.049575+0000","last_peered":"2024-09-12T19:26:59.049575+0000","last_clean":"2024-09-12T19:26:59.049575+0000","last_became_active":"2024-09-12T17:36:34.892255+0000","last_became_peered":"2024-09-12T17:36:34.892255+0000","last_unstale":"2024-09-12T19:26:59.049575+0000","last_undegraded":"2024-09-12T19:26:59.049575+0000","last_fullsized":"2024-09-12T19:26:59.049575+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:18.707321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15391900,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":556,"num_read_kb":68904,"num_write":987,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368858+0000","last_change":"2024-09-12T17:36:23.786560+0000","last_active":"2024-09-12T19:27:20.368858+0000","last_peered":"2024-09-12T19:27:20.368858+0000","last_clean":"2024-09-12T19:27:20.368858+0000","last_became_active":"2024-09-12T17:36:21.783069+0000","last_became_peered":"2024-09-12T17:36:21.783069+0000","last_unstale":"2024-09-12T19:27:20.368858+0000","last_undegraded":"2024-09-12T19:27:20.368858+0000","last_fullsized":"2024-09-12T19:27:20.368858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:06.261529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135285,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602908+0000","last_change":"2024-09-12T17:36:38.901020+0000","last_active":"2024-09-12T19:27:05.602908+0000","last_peered":"2024-09-12T19:27:05.602908+0000","last_clean":"2024-09-12T19:27:05.602908+0000","last_became_active":"2024-09-12T17:36:38.900433+0000","last_became_peered":"2024-09-12T17:36:38.900433+0000","last_unstale":"2024-09-12T19:27:05.602908+0000","last_undegraded":"2024-09-12T19:27:05.602908+0000","last_fullsized":"2024-09-12T19:27:05.602908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:42.477669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'247","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:34.719450+0000","last_change":"2024-09-12T17:36:40.887225+0000","last_active":"2024-09-12T19:27:34.719450+0000","last_peered":"2024-09-12T19:27:34.719450+0000","last_clean":"2024-09-12T19:27:34.719450+0000","last_became_active":"2024-09-12T17:36:40.886345+0000","last_became_peered":"2024-09-12T17:36:40.886345+0000","last_unstale":"2024-09-12T19:27:34.719450+0000","last_undegraded":"2024-09-12T19:27:34.719450+0000","last_fullsized":"2024-09-12T19:27:34.719450+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:50.264902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'801","reported_seq":3497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.080315+0000","last_change":"2024-09-12T17:36:42.932438+0000","last_active":"2024-09-12T19:29:25.080315+0000","last_peered":"2024-09-12T19:29:25.080315+0000","last_clean":"2024-09-12T19:29:25.080315+0000","last_became_active":"2024-09-12T17:36:42.931598+0000","last_became_peered":"2024-09-12T17:36:42.931598+0000","last_unstale":"2024-09-12T19:29:25.080315+0000","last_undegraded":"2024-09-12T19:29:25.080315+0000","last_fullsized":"2024-09-12T19:29:25.080315+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:00.606220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'133","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.059775+0000","last_change":"2024-09-12T17:36:44.952618+0000","last_active":"2024-09-12T19:29:22.059775+0000","last_peered":"2024-09-12T19:29:22.059775+0000","last_clean":"2024-09-12T19:29:22.059775+0000","last_became_active":"2024-09-12T17:36:44.951849+0000","last_became_peered":"2024-09-12T17:36:44.951849+0000","last_unstale":"2024-09-12T19:29:22.059775+0000","last_undegraded":"2024-09-12T19:29:22.059775+0000","last_fullsized":"2024-09-12T19:29:22.059775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:49.786200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'742","reported_seq":2375,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691100+0000","last_change":"2024-09-12T17:36:36.893671+0000","last_active":"2024-09-12T19:27:00.691100+0000","last_peered":"2024-09-12T19:27:00.691100+0000","last_clean":"2024-09-12T19:27:00.691100+0000","last_became_active":"2024-09-12T17:36:36.892861+0000","last_became_peered":"2024-09-12T17:36:36.892861+0000","last_unstale":"2024-09-12T19:27:00.691100+0000","last_undegraded":"2024-09-12T19:27:00.691100+0000","last_fullsized":"2024-09-12T19:27:00.691100+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:54.133834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3560,"num_read_kb":3257,"num_write":956,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'294","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.692527+0000","last_change":"2024-09-12T17:36:34.883910+0000","last_active":"2024-09-12T19:27:05.692527+0000","last_peered":"2024-09-12T19:27:05.692527+0000","last_clean":"2024-09-12T19:27:05.692527+0000","last_became_active":"2024-09-12T17:36:34.883331+0000","last_became_peered":"2024-09-12T17:36:34.883331+0000","last_unstale":"2024-09-12T19:27:05.692527+0000","last_undegraded":"2024-09-12T19:27:05.692527+0000","last_fullsized":"2024-09-12T19:27:05.692527+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:14.534598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243609,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":458,"num_read_kb":26130,"num_write":1124,"num_write_kb":40752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":555,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690113+0000","last_change":"2024-09-12T17:36:24.506296+0000","last_active":"2024-09-12T19:26:55.690113+0000","last_peered":"2024-09-12T19:26:55.690113+0000","last_clean":"2024-09-12T19:26:55.690113+0000","last_became_active":"2024-09-12T17:36:22.059379+0000","last_became_peered":"2024-09-12T17:36:22.059379+0000","last_unstale":"2024-09-12T19:26:55.690113+0000","last_undegraded":"2024-09-12T19:26:55.690113+0000","last_fullsized":"2024-09-12T19:26:55.690113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:24.672143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012087210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.365102+0000","last_change":"2024-09-12T17:36:38.892129+0000","last_active":"2024-09-12T19:27:05.365102+0000","last_peered":"2024-09-12T19:27:05.365102+0000","last_clean":"2024-09-12T19:27:05.365102+0000","last_became_active":"2024-09-12T17:36:38.891807+0000","last_became_peered":"2024-09-12T17:36:38.891807+0000","last_unstale":"2024-09-12T19:27:05.365102+0000","last_undegraded":"2024-09-12T19:27:05.365102+0000","last_fullsized":"2024-09-12T19:27:05.365102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:48.578150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'173","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:33.637507+0000","last_change":"2024-09-12T17:36:40.898576+0000","last_active":"2024-09-12T19:27:33.637507+0000","last_peered":"2024-09-12T19:27:33.637507+0000","last_clean":"2024-09-12T19:27:33.637507+0000","last_became_active":"2024-09-12T17:36:40.897763+0000","last_became_peered":"2024-09-12T17:36:40.897763+0000","last_unstale":"2024-09-12T19:27:33.637507+0000","last_undegraded":"2024-09-12T19:27:33.637507+0000","last_fullsized":"2024-09-12T19:27:33.637507+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:41.559054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'797","reported_seq":3144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.067722+0000","last_change":"2024-09-12T17:36:42.930005+0000","last_active":"2024-09-12T19:29:25.067722+0000","last_peered":"2024-09-12T19:29:25.067722+0000","last_clean":"2024-09-12T19:29:25.067722+0000","last_became_active":"2024-09-12T17:36:42.928978+0000","last_became_peered":"2024-09-12T17:36:42.928978+0000","last_unstale":"2024-09-12T19:29:25.067722+0000","last_undegraded":"2024-09-12T19:29:25.067722+0000","last_fullsized":"2024-09-12T19:29:25.067722+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:50.493434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'235","reported_seq":781,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.583893+0000","last_change":"2024-09-12T17:36:44.960384+0000","last_active":"2024-09-12T19:28:02.583893+0000","last_peered":"2024-09-12T19:28:02.583893+0000","last_clean":"2024-09-12T19:28:02.583893+0000","last_became_active":"2024-09-12T17:36:44.956784+0000","last_became_peered":"2024-09-12T17:36:44.956784+0000","last_unstale":"2024-09-12T19:28:02.583893+0000","last_undegraded":"2024-09-12T19:28:02.583893+0000","last_fullsized":"2024-09-12T19:28:02.583893+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:30.401098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":233,"num_read_kb":216,"num_write":428,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'373","reported_seq":2039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250850+0000","last_change":"2024-09-12T17:36:36.884169+0000","last_active":"2024-09-12T19:27:05.250850+0000","last_peered":"2024-09-12T19:27:05.250850+0000","last_clean":"2024-09-12T19:27:05.250850+0000","last_became_active":"2024-09-12T17:36:36.883862+0000","last_became_peered":"2024-09-12T17:36:36.883862+0000","last_unstale":"2024-09-12T19:27:05.250850+0000","last_undegraded":"2024-09-12T19:27:05.250850+0000","last_fullsized":"2024-09-12T19:27:05.250850+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:01.097363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2422,"num_read_kb":2340,"num_write":416,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'287","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.692494+0000","last_change":"2024-09-12T17:36:34.869612+0000","last_active":"2024-09-12T19:27:05.692494+0000","last_peered":"2024-09-12T19:27:05.692494+0000","last_clean":"2024-09-12T19:27:05.692494+0000","last_became_active":"2024-09-12T17:36:34.868641+0000","last_became_peered":"2024-09-12T17:36:34.868641+0000","last_unstale":"2024-09-12T19:27:05.692494+0000","last_undegraded":"2024-09-12T19:27:05.692494+0000","last_fullsized":"2024-09-12T19:27:05.692494+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:13.423256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8059094,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":485,"num_read_kb":35743,"num_write":1119,"num_write_kb":32710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":548,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.363084+0000","last_change":"2024-09-12T17:36:23.787880+0000","last_active":"2024-09-12T19:26:55.363084+0000","last_peered":"2024-09-12T19:26:55.363084+0000","last_clean":"2024-09-12T19:26:55.363084+0000","last_became_active":"2024-09-12T17:36:22.058794+0000","last_became_peered":"2024-09-12T17:36:22.058794+0000","last_unstale":"2024-09-12T19:26:55.363084+0000","last_undegraded":"2024-09-12T19:26:55.363084+0000","last_fullsized":"2024-09-12T19:26:55.363084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:04.896637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691146+0000","last_change":"2024-09-12T17:36:38.902092+0000","last_active":"2024-09-12T19:27:00.691146+0000","last_peered":"2024-09-12T19:27:00.691146+0000","last_clean":"2024-09-12T19:27:00.691146+0000","last_became_active":"2024-09-12T17:36:38.901418+0000","last_became_peered":"2024-09-12T17:36:38.901418+0000","last_unstale":"2024-09-12T19:27:00.691146+0000","last_undegraded":"2024-09-12T19:27:00.691146+0000","last_fullsized":"2024-09-12T19:27:00.691146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:20.898210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'796","reported_seq":1570,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.995362+0000","last_change":"2024-09-12T17:36:40.908672+0000","last_active":"2024-09-12T19:29:21.995362+0000","last_peered":"2024-09-12T19:29:21.995362+0000","last_clean":"2024-09-12T19:29:21.995362+0000","last_became_active":"2024-09-12T17:36:40.908231+0000","last_became_peered":"2024-09-12T17:36:40.908231+0000","last_unstale":"2024-09-12T19:29:21.995362+0000","last_undegraded":"2024-09-12T19:29:21.995362+0000","last_fullsized":"2024-09-12T19:29:21.995362+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:35.140601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1393,"num_read_kb":2880,"num_write":1134,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.693604+0000","last_change":"2024-09-12T17:36:42.933142+0000","last_active":"2024-09-12T19:27:10.693604+0000","last_peered":"2024-09-12T19:27:10.693604+0000","last_clean":"2024-09-12T19:27:10.693604+0000","last_became_active":"2024-09-12T17:36:42.932086+0000","last_became_peered":"2024-09-12T17:36:42.932086+0000","last_unstale":"2024-09-12T19:27:10.693604+0000","last_undegraded":"2024-09-12T19:27:10.693604+0000","last_fullsized":"2024-09-12T19:27:10.693604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:49.913999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'126","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249809+0000","last_change":"2024-09-12T17:36:44.961527+0000","last_active":"2024-09-12T19:27:00.249809+0000","last_peered":"2024-09-12T19:27:00.249809+0000","last_clean":"2024-09-12T19:27:00.249809+0000","last_became_active":"2024-09-12T17:36:44.960744+0000","last_became_peered":"2024-09-12T17:36:44.960744+0000","last_unstale":"2024-09-12T19:27:00.249809+0000","last_undegraded":"2024-09-12T19:27:00.249809+0000","last_fullsized":"2024-09-12T19:27:00.249809+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:42.564425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":186,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'135","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.080882+0000","last_change":"2024-09-12T17:36:44.940544+0000","last_active":"2024-09-12T19:28:03.080882+0000","last_peered":"2024-09-12T19:28:03.080882+0000","last_clean":"2024-09-12T19:28:03.080882+0000","last_became_active":"2024-09-12T17:36:44.939820+0000","last_became_peered":"2024-09-12T17:36:44.939820+0000","last_unstale":"2024-09-12T19:28:03.080882+0000","last_undegraded":"2024-09-12T19:28:03.080882+0000","last_fullsized":"2024-09-12T19:28:03.080882+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:23.567209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":235,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'799","reported_seq":2458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.117512+0000","last_change":"2024-09-12T17:36:36.883861+0000","last_active":"2024-09-12T19:28:32.117512+0000","last_peered":"2024-09-12T19:28:32.117512+0000","last_clean":"2024-09-12T19:28:32.117512+0000","last_became_active":"2024-09-12T17:36:36.883481+0000","last_became_peered":"2024-09-12T17:36:36.883481+0000","last_unstale":"2024-09-12T19:28:32.117512+0000","last_undegraded":"2024-09-12T19:28:32.117512+0000","last_fullsized":"2024-09-12T19:28:32.117512+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:44.086651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3831,"num_read_kb":3485,"num_write":1040,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'255","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360876+0000","last_change":"2024-09-12T17:36:34.862214+0000","last_active":"2024-09-12T19:26:45.360876+0000","last_peered":"2024-09-12T19:26:45.360876+0000","last_clean":"2024-09-12T19:26:45.360876+0000","last_became_active":"2024-09-12T17:36:34.861702+0000","last_became_peered":"2024-09-12T17:36:34.861702+0000","last_unstale":"2024-09-12T19:26:45.360876+0000","last_undegraded":"2024-09-12T19:26:45.360876+0000","last_fullsized":"2024-09-12T19:26:45.360876+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:53.824355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8653012,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":408,"num_read_kb":26224,"num_write":989,"num_write_kb":25793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.040900+0000","last_change":"2024-09-12T17:36:38.895498+0000","last_active":"2024-09-12T19:26:19.040900+0000","last_peered":"2024-09-12T19:26:19.040900+0000","last_clean":"2024-09-12T19:26:19.040900+0000","last_became_active":"2024-09-12T17:36:38.894742+0000","last_became_peered":"2024-09-12T17:36:38.894742+0000","last_unstale":"2024-09-12T19:26:19.040900+0000","last_undegraded":"2024-09-12T19:26:19.040900+0000","last_fullsized":"2024-09-12T19:26:19.040900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:33.054267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'322","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:44.072532+0000","last_change":"2024-09-12T17:36:40.893532+0000","last_active":"2024-09-12T19:28:44.072532+0000","last_peered":"2024-09-12T19:28:44.072532+0000","last_clean":"2024-09-12T19:28:44.072532+0000","last_became_active":"2024-09-12T17:36:40.892710+0000","last_became_peered":"2024-09-12T17:36:40.892710+0000","last_unstale":"2024-09-12T19:28:44.072532+0000","last_undegraded":"2024-09-12T19:28:44.072532+0000","last_fullsized":"2024-09-12T19:28:44.072532+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:12.985322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55952,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":978,"num_write":412,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664522+0000","last_change":"2024-09-12T17:36:42.939570+0000","last_active":"2024-09-12T19:26:25.664522+0000","last_peered":"2024-09-12T19:26:25.664522+0000","last_clean":"2024-09-12T19:26:25.664522+0000","last_became_active":"2024-09-12T17:36:42.938834+0000","last_became_peered":"2024-09-12T17:36:42.938834+0000","last_unstale":"2024-09-12T19:26:25.664522+0000","last_undegraded":"2024-09-12T19:26:25.664522+0000","last_fullsized":"2024-09-12T19:26:25.664522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:13.130674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'139","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.674057+0000","last_change":"2024-09-12T17:36:44.953890+0000","last_active":"2024-09-12T19:27:05.674057+0000","last_peered":"2024-09-12T19:27:05.674057+0000","last_clean":"2024-09-12T19:27:05.674057+0000","last_became_active":"2024-09-12T17:36:44.953117+0000","last_became_peered":"2024-09-12T17:36:44.953117+0000","last_unstale":"2024-09-12T19:27:05.674057+0000","last_undegraded":"2024-09-12T19:27:05.674057+0000","last_fullsized":"2024-09-12T19:27:05.674057+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:53.223197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":202,"num_write":357,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'468","reported_seq":2073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682046+0000","last_change":"2024-09-12T17:36:36.901726+0000","last_active":"2024-09-12T19:26:20.682046+0000","last_peered":"2024-09-12T19:26:20.682046+0000","last_clean":"2024-09-12T19:26:20.682046+0000","last_became_active":"2024-09-12T17:36:36.900955+0000","last_became_peered":"2024-09-12T17:36:36.900955+0000","last_unstale":"2024-09-12T19:26:20.682046+0000","last_undegraded":"2024-09-12T19:26:20.682046+0000","last_fullsized":"2024-09-12T19:26:20.682046+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:39.022567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2490,"num_read_kb":2331,"num_write":571,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'264","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:47.673872+0000","last_change":"2024-09-12T17:36:34.878783+0000","last_active":"2024-09-12T19:26:47.673872+0000","last_peered":"2024-09-12T19:26:47.673872+0000","last_clean":"2024-09-12T19:26:47.673872+0000","last_became_active":"2024-09-12T17:36:34.878069+0000","last_became_peered":"2024-09-12T17:36:34.878069+0000","last_unstale":"2024-09-12T19:26:47.673872+0000","last_undegraded":"2024-09-12T19:26:47.673872+0000","last_fullsized":"2024-09-12T19:26:47.673872+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:53.462388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7783745,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":705,"num_read_kb":26278,"num_write":894,"num_write_kb":31119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682090+0000","last_change":"2024-09-12T17:36:38.895965+0000","last_active":"2024-09-12T19:26:20.682090+0000","last_peered":"2024-09-12T19:26:20.682090+0000","last_clean":"2024-09-12T19:26:20.682090+0000","last_became_active":"2024-09-12T17:36:38.894800+0000","last_became_peered":"2024-09-12T17:36:38.894800+0000","last_unstale":"2024-09-12T19:26:20.682090+0000","last_undegraded":"2024-09-12T19:26:20.682090+0000","last_fullsized":"2024-09-12T19:26:20.682090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:45.719885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'81","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:22.977940+0000","last_change":"2024-09-12T17:36:40.910425+0000","last_active":"2024-09-12T19:27:22.977940+0000","last_peered":"2024-09-12T19:27:22.977940+0000","last_clean":"2024-09-12T19:27:22.977940+0000","last_became_active":"2024-09-12T17:36:40.909470+0000","last_became_peered":"2024-09-12T17:36:40.909470+0000","last_unstale":"2024-09-12T19:27:22.977940+0000","last_undegraded":"2024-09-12T19:27:22.977940+0000","last_fullsized":"2024-09-12T19:27:22.977940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:59.636810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242569+0000","last_change":"2024-09-12T17:36:42.923023+0000","last_active":"2024-09-12T19:26:25.242569+0000","last_peered":"2024-09-12T19:26:25.242569+0000","last_clean":"2024-09-12T19:26:25.242569+0000","last_became_active":"2024-09-12T17:36:42.922352+0000","last_became_peered":"2024-09-12T17:36:42.922352+0000","last_unstale":"2024-09-12T19:26:25.242569+0000","last_undegraded":"2024-09-12T19:26:25.242569+0000","last_fullsized":"2024-09-12T19:26:25.242569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:06.521341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'237","reported_seq":778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.928944+0000","last_change":"2024-09-12T17:36:44.946524+0000","last_active":"2024-09-12T19:28:02.928944+0000","last_peered":"2024-09-12T19:28:02.928944+0000","last_clean":"2024-09-12T19:28:02.928944+0000","last_became_active":"2024-09-12T17:36:44.945429+0000","last_became_peered":"2024-09-12T17:36:44.945429+0000","last_unstale":"2024-09-12T19:28:02.928944+0000","last_undegraded":"2024-09-12T19:28:02.928944+0000","last_fullsized":"2024-09-12T19:28:02.928944+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:03.136753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":307,"num_read_kb":303,"num_write":509,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'826","reported_seq":2357,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.322547+0000","last_change":"2024-09-12T17:36:36.901899+0000","last_active":"2024-09-12T19:26:59.322547+0000","last_peered":"2024-09-12T19:26:59.322547+0000","last_clean":"2024-09-12T19:26:59.322547+0000","last_became_active":"2024-09-12T17:36:36.901053+0000","last_became_peered":"2024-09-12T17:36:36.901053+0000","last_unstale":"2024-09-12T19:26:59.322547+0000","last_undegraded":"2024-09-12T19:26:59.322547+0000","last_fullsized":"2024-09-12T19:26:59.322547+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:22.502956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3878,"num_read_kb":3474,"num_write":1082,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'289","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:20.228268+0000","last_change":"2024-09-12T17:36:34.878025+0000","last_active":"2024-09-12T19:25:20.228268+0000","last_peered":"2024-09-12T19:25:20.228268+0000","last_clean":"2024-09-12T19:25:20.228268+0000","last_became_active":"2024-09-12T17:36:34.877620+0000","last_became_peered":"2024-09-12T17:36:34.877620+0000","last_unstale":"2024-09-12T19:25:20.228268+0000","last_undegraded":"2024-09-12T19:25:20.228268+0000","last_fullsized":"2024-09-12T19:25:20.228268+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:44.559070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14748865,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":448,"num_read_kb":51731,"num_write":1016,"num_write_kb":38676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241189+0000","last_change":"2024-09-12T17:36:38.903616+0000","last_active":"2024-09-12T19:26:20.241189+0000","last_peered":"2024-09-12T19:26:20.241189+0000","last_clean":"2024-09-12T19:26:20.241189+0000","last_became_active":"2024-09-12T17:36:38.902188+0000","last_became_peered":"2024-09-12T17:36:38.902188+0000","last_unstale":"2024-09-12T19:26:20.241189+0000","last_undegraded":"2024-09-12T19:26:20.241189+0000","last_fullsized":"2024-09-12T19:26:20.241189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.927110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'372","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.695530+0000","last_change":"2024-09-12T17:36:40.899887+0000","last_active":"2024-09-12T19:28:40.695530+0000","last_peered":"2024-09-12T19:28:40.695530+0000","last_clean":"2024-09-12T19:28:40.695530+0000","last_became_active":"2024-09-12T17:36:40.899201+0000","last_became_peered":"2024-09-12T17:36:40.899201+0000","last_unstale":"2024-09-12T19:28:40.695530+0000","last_undegraded":"2024-09-12T19:28:40.695530+0000","last_fullsized":"2024-09-12T19:28:40.695530+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:19.009661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66074,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":1145,"num_write":480,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.084454+0000","last_change":"2024-09-12T17:36:42.930518+0000","last_active":"2024-09-12T19:26:25.084454+0000","last_peered":"2024-09-12T19:26:25.084454+0000","last_clean":"2024-09-12T19:26:25.084454+0000","last_became_active":"2024-09-12T17:36:42.928596+0000","last_became_peered":"2024-09-12T17:36:42.928596+0000","last_unstale":"2024-09-12T19:26:25.084454+0000","last_undegraded":"2024-09-12T19:26:25.084454+0000","last_fullsized":"2024-09-12T19:26:25.084454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:38.476152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'143","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360848+0000","last_change":"2024-09-12T17:36:44.963106+0000","last_active":"2024-09-12T19:26:45.360848+0000","last_peered":"2024-09-12T19:26:45.360848+0000","last_clean":"2024-09-12T19:26:45.360848+0000","last_became_active":"2024-09-12T17:36:44.962445+0000","last_became_peered":"2024-09-12T17:36:44.962445+0000","last_unstale":"2024-09-12T19:26:45.360848+0000","last_undegraded":"2024-09-12T19:26:45.360848+0000","last_fullsized":"2024-09-12T19:26:45.360848+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:03.293578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":234,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'601","reported_seq":2246,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.663326+0000","last_change":"2024-09-12T17:36:36.904547+0000","last_active":"2024-09-12T19:26:20.663326+0000","last_peered":"2024-09-12T19:26:20.663326+0000","last_clean":"2024-09-12T19:26:20.663326+0000","last_became_active":"2024-09-12T17:36:36.903813+0000","last_became_peered":"2024-09-12T17:36:36.903813+0000","last_unstale":"2024-09-12T19:26:20.663326+0000","last_undegraded":"2024-09-12T19:26:20.663326+0000","last_fullsized":"2024-09-12T19:26:20.663326+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:28.273003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3115,"num_read_kb":2836,"num_write":758,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'244","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.910712+0000","last_change":"2024-09-12T17:36:34.887548+0000","last_active":"2024-09-12T19:27:38.910712+0000","last_peered":"2024-09-12T19:27:38.910712+0000","last_clean":"2024-09-12T19:27:38.910712+0000","last_became_active":"2024-09-12T17:36:34.886741+0000","last_became_peered":"2024-09-12T17:36:34.886741+0000","last_unstale":"2024-09-12T19:27:38.910712+0000","last_undegraded":"2024-09-12T19:27:38.910712+0000","last_fullsized":"2024-09-12T19:27:38.910712+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:29.979024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4139249,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":404,"num_read_kb":24643,"num_write":953,"num_write_kb":38417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.353955+0000","last_change":"2024-09-12T17:36:38.903818+0000","last_active":"2024-09-12T19:26:20.353955+0000","last_peered":"2024-09-12T19:26:20.353955+0000","last_clean":"2024-09-12T19:26:20.353955+0000","last_became_active":"2024-09-12T17:36:38.903210+0000","last_became_peered":"2024-09-12T17:36:38.903210+0000","last_unstale":"2024-09-12T19:26:20.353955+0000","last_undegraded":"2024-09-12T19:26:20.353955+0000","last_fullsized":"2024-09-12T19:26:20.353955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:00.851761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'303","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.622156+0000","last_change":"2024-09-12T17:36:40.913086+0000","last_active":"2024-09-12T19:28:40.622156+0000","last_peered":"2024-09-12T19:28:40.622156+0000","last_clean":"2024-09-12T19:28:40.622156+0000","last_became_active":"2024-09-12T17:36:40.912283+0000","last_became_peered":"2024-09-12T17:36:40.912283+0000","last_unstale":"2024-09-12T19:28:40.622156+0000","last_undegraded":"2024-09-12T19:28:40.622156+0000","last_fullsized":"2024-09-12T19:28:40.622156+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:05.161253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58005,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":495,"num_read_kb":989,"num_write":398,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664637+0000","last_change":"2024-09-12T17:36:42.928432+0000","last_active":"2024-09-12T19:26:25.664637+0000","last_peered":"2024-09-12T19:26:25.664637+0000","last_clean":"2024-09-12T19:26:25.664637+0000","last_became_active":"2024-09-12T17:36:42.927724+0000","last_became_peered":"2024-09-12T17:36:42.927724+0000","last_unstale":"2024-09-12T19:26:25.664637+0000","last_undegraded":"2024-09-12T19:26:25.664637+0000","last_fullsized":"2024-09-12T19:26:25.664637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:30.771719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'721","reported_seq":2248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.028622+0000","last_change":"2024-09-12T17:36:36.886104+0000","last_active":"2024-09-12T19:29:21.028622+0000","last_peered":"2024-09-12T19:29:21.028622+0000","last_clean":"2024-09-12T19:29:21.028622+0000","last_became_active":"2024-09-12T17:36:36.885820+0000","last_became_peered":"2024-09-12T17:36:36.885820+0000","last_unstale":"2024-09-12T19:29:21.028622+0000","last_undegraded":"2024-09-12T19:29:21.028622+0000","last_fullsized":"2024-09-12T19:29:21.028622+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.701415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3501,"num_read_kb":3197,"num_write":936,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'277","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.631236+0000","last_change":"2024-09-12T17:36:34.888051+0000","last_active":"2024-09-12T19:27:38.631236+0000","last_peered":"2024-09-12T19:27:38.631236+0000","last_clean":"2024-09-12T19:27:38.631236+0000","last_became_active":"2024-09-12T17:36:34.887018+0000","last_became_peered":"2024-09-12T17:36:34.887018+0000","last_unstale":"2024-09-12T19:27:38.631236+0000","last_undegraded":"2024-09-12T19:27:38.631236+0000","last_fullsized":"2024-09-12T19:27:38.631236+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:00.894469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9444109,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":476,"num_read_kb":38391,"num_write":1011,"num_write_kb":34235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:04.050979+0000","last_change":"2024-09-12T17:36:38.895303+0000","last_active":"2024-09-12T19:27:04.050979+0000","last_peered":"2024-09-12T19:27:04.050979+0000","last_clean":"2024-09-12T19:27:04.050979+0000","last_became_active":"2024-09-12T17:36:38.894452+0000","last_became_peered":"2024-09-12T17:36:38.894452+0000","last_unstale":"2024-09-12T19:27:04.050979+0000","last_undegraded":"2024-09-12T19:27:04.050979+0000","last_fullsized":"2024-09-12T19:27:04.050979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:40.122335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'504","reported_seq":1167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.987702+0000","last_change":"2024-09-12T17:36:40.910273+0000","last_active":"2024-09-12T19:29:21.987702+0000","last_peered":"2024-09-12T19:29:21.987702+0000","last_clean":"2024-09-12T19:29:21.987702+0000","last_became_active":"2024-09-12T17:36:40.909552+0000","last_became_peered":"2024-09-12T17:36:40.909552+0000","last_unstale":"2024-09-12T19:29:21.987702+0000","last_undegraded":"2024-09-12T19:29:21.987702+0000","last_fullsized":"2024-09-12T19:29:21.987702+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:32.101093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120151,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":878,"num_read_kb":1821,"num_write":754,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.247037+0000","last_change":"2024-09-12T17:36:42.943311+0000","last_active":"2024-09-12T19:26:45.247037+0000","last_peered":"2024-09-12T19:26:45.247037+0000","last_clean":"2024-09-12T19:26:45.247037+0000","last_became_active":"2024-09-12T17:36:42.942627+0000","last_became_peered":"2024-09-12T17:36:42.942627+0000","last_unstale":"2024-09-12T19:26:45.247037+0000","last_undegraded":"2024-09-12T19:26:45.247037+0000","last_fullsized":"2024-09-12T19:26:45.247037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:28.862834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'167","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:57.461795+0000","last_change":"2024-09-12T17:36:44.959491+0000","last_active":"2024-09-12T19:27:57.461795+0000","last_peered":"2024-09-12T19:27:57.461795+0000","last_clean":"2024-09-12T19:27:57.461795+0000","last_became_active":"2024-09-12T17:36:44.956655+0000","last_became_peered":"2024-09-12T17:36:44.956655+0000","last_unstale":"2024-09-12T19:27:57.461795+0000","last_undegraded":"2024-09-12T19:27:57.461795+0000","last_fullsized":"2024-09-12T19:27:57.461795+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:59.575861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":241,"num_write":385,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'357","reported_seq":1938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691336+0000","last_change":"2024-09-12T17:36:36.912708+0000","last_active":"2024-09-12T19:27:00.691336+0000","last_peered":"2024-09-12T19:27:00.691336+0000","last_clean":"2024-09-12T19:27:00.691336+0000","last_became_active":"2024-09-12T17:36:36.911889+0000","last_became_peered":"2024-09-12T17:36:36.911889+0000","last_unstale":"2024-09-12T19:27:00.691336+0000","last_undegraded":"2024-09-12T19:27:00.691336+0000","last_fullsized":"2024-09-12T19:27:00.691336+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:52.030740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2021,"num_read_kb":1969,"num_write":390,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'285","reported_seq":1058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.673216+0000","last_change":"2024-09-12T17:36:34.852681+0000","last_active":"2024-09-12T19:25:40.673216+0000","last_peered":"2024-09-12T19:25:40.673216+0000","last_clean":"2024-09-12T19:25:40.673216+0000","last_became_active":"2024-09-12T17:36:34.851161+0000","last_became_peered":"2024-09-12T17:36:34.851161+0000","last_unstale":"2024-09-12T19:25:40.673216+0000","last_undegraded":"2024-09-12T19:25:40.673216+0000","last_fullsized":"2024-09-12T19:25:40.673216+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:27.435874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14503381,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":662,"num_read_kb":47360,"num_write":1031,"num_write_kb":33375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.251083+0000","last_change":"2024-09-12T17:36:38.905238+0000","last_active":"2024-09-12T19:27:05.251083+0000","last_peered":"2024-09-12T19:27:05.251083+0000","last_clean":"2024-09-12T19:27:05.251083+0000","last_became_active":"2024-09-12T17:36:38.904409+0000","last_became_peered":"2024-09-12T17:36:38.904409+0000","last_unstale":"2024-09-12T19:27:05.251083+0000","last_undegraded":"2024-09-12T19:27:05.251083+0000","last_fullsized":"2024-09-12T19:27:05.251083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:40.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'399","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.393502+0000","last_change":"2024-09-12T17:36:40.903223+0000","last_active":"2024-09-12T19:29:10.393502+0000","last_peered":"2024-09-12T19:29:10.393502+0000","last_clean":"2024-09-12T19:29:10.393502+0000","last_became_active":"2024-09-12T17:36:40.902718+0000","last_became_peered":"2024-09-12T17:36:40.902718+0000","last_unstale":"2024-09-12T19:29:10.393502+0000","last_undegraded":"2024-09-12T19:29:10.393502+0000","last_fullsized":"2024-09-12T19:29:10.393502+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.363639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66972,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":666,"num_read_kb":1223,"num_write":558,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.256436+0000","last_change":"2024-09-12T17:36:42.921077+0000","last_active":"2024-09-12T19:26:45.256436+0000","last_peered":"2024-09-12T19:26:45.256436+0000","last_clean":"2024-09-12T19:26:45.256436+0000","last_became_active":"2024-09-12T17:36:42.920352+0000","last_became_peered":"2024-09-12T17:36:42.920352+0000","last_unstale":"2024-09-12T19:26:45.256436+0000","last_undegraded":"2024-09-12T19:26:45.256436+0000","last_fullsized":"2024-09-12T19:26:45.256436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:47.099873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'181","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355355+0000","last_change":"2024-09-12T17:36:44.946661+0000","last_active":"2024-09-12T19:26:25.355355+0000","last_peered":"2024-09-12T19:26:25.355355+0000","last_clean":"2024-09-12T19:26:25.355355+0000","last_became_active":"2024-09-12T17:36:44.945753+0000","last_became_peered":"2024-09-12T17:36:44.945753+0000","last_unstale":"2024-09-12T19:26:25.355355+0000","last_undegraded":"2024-09-12T19:26:25.355355+0000","last_fullsized":"2024-09-12T19:26:25.355355+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:51.605529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":278,"num_read_kb":268,"num_write":526,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'523","reported_seq":2253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.623056+0000","last_change":"2024-09-12T17:36:36.910292+0000","last_active":"2024-09-12T19:28:02.623056+0000","last_peered":"2024-09-12T19:28:02.623056+0000","last_clean":"2024-09-12T19:28:02.623056+0000","last_became_active":"2024-09-12T17:36:36.909488+0000","last_became_peered":"2024-09-12T17:36:36.909488+0000","last_unstale":"2024-09-12T19:28:02.623056+0000","last_undegraded":"2024-09-12T19:28:02.623056+0000","last_fullsized":"2024-09-12T19:28:02.623056+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:27.498312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2968,"num_read_kb":2777,"num_write":639,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'320","reported_seq":1005,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:05.118153+0000","last_change":"2024-09-12T17:36:34.857968+0000","last_active":"2024-09-12T19:29:05.118153+0000","last_peered":"2024-09-12T19:29:05.118153+0000","last_clean":"2024-09-12T19:29:05.118153+0000","last_became_active":"2024-09-12T17:36:34.857645+0000","last_became_peered":"2024-09-12T17:36:34.857645+0000","last_unstale":"2024-09-12T19:29:05.118153+0000","last_undegraded":"2024-09-12T19:29:05.118153+0000","last_fullsized":"2024-09-12T19:29:05.118153+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:06.150098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7980169,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":539,"num_read_kb":13472,"num_write":1233,"num_write_kb":33813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.245950+0000","last_change":"2024-09-12T17:36:38.905353+0000","last_active":"2024-09-12T19:26:40.245950+0000","last_peered":"2024-09-12T19:26:40.245950+0000","last_clean":"2024-09-12T19:26:40.245950+0000","last_became_active":"2024-09-12T17:36:38.904619+0000","last_became_peered":"2024-09-12T17:36:38.904619+0000","last_unstale":"2024-09-12T19:26:40.245950+0000","last_undegraded":"2024-09-12T19:26:40.245950+0000","last_fullsized":"2024-09-12T19:26:40.245950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:01.832724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'311","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:14.079656+0000","last_change":"2024-09-12T17:36:40.909967+0000","last_active":"2024-09-12T19:29:14.079656+0000","last_peered":"2024-09-12T19:29:14.079656+0000","last_clean":"2024-09-12T19:29:14.079656+0000","last_became_active":"2024-09-12T17:36:40.909189+0000","last_became_peered":"2024-09-12T17:36:40.909189+0000","last_unstale":"2024-09-12T19:29:14.079656+0000","last_undegraded":"2024-09-12T19:29:14.079656+0000","last_fullsized":"2024-09-12T19:29:14.079656+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:32.736700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55815,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":964,"num_write":398,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.674082+0000","last_change":"2024-09-12T17:36:42.939553+0000","last_active":"2024-09-12T19:27:05.674082+0000","last_peered":"2024-09-12T19:27:05.674082+0000","last_clean":"2024-09-12T19:27:05.674082+0000","last_became_active":"2024-09-12T17:36:42.938451+0000","last_became_peered":"2024-09-12T17:36:42.938451+0000","last_unstale":"2024-09-12T19:27:05.674082+0000","last_undegraded":"2024-09-12T19:27:05.674082+0000","last_fullsized":"2024-09-12T19:27:05.674082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:33.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'109","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.052785+0000","last_change":"2024-09-12T17:36:44.950080+0000","last_active":"2024-09-12T19:29:22.052785+0000","last_peered":"2024-09-12T19:29:22.052785+0000","last_clean":"2024-09-12T19:29:22.052785+0000","last_became_active":"2024-09-12T17:36:44.949351+0000","last_became_peered":"2024-09-12T17:36:44.949351+0000","last_unstale":"2024-09-12T19:29:22.052785+0000","last_undegraded":"2024-09-12T19:29:22.052785+0000","last_fullsized":"2024-09-12T19:29:22.052785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:39.166790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":161,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'473","reported_seq":2149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181763+0000","last_change":"2024-09-12T17:36:36.903747+0000","last_active":"2024-09-12T19:27:10.181763+0000","last_peered":"2024-09-12T19:27:10.181763+0000","last_clean":"2024-09-12T19:27:10.181763+0000","last_became_active":"2024-09-12T17:36:36.902998+0000","last_became_peered":"2024-09-12T17:36:36.902998+0000","last_unstale":"2024-09-12T19:27:10.181763+0000","last_undegraded":"2024-09-12T19:27:10.181763+0000","last_fullsized":"2024-09-12T19:27:10.181763+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:30.836602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2683,"num_read_kb":2531,"num_write":585,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'327","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:39.252794+0000","last_change":"2024-09-12T17:36:34.869269+0000","last_active":"2024-09-12T19:26:39.252794+0000","last_peered":"2024-09-12T19:26:39.252794+0000","last_clean":"2024-09-12T19:26:39.252794+0000","last_became_active":"2024-09-12T17:36:34.867987+0000","last_became_peered":"2024-09-12T17:36:34.867987+0000","last_unstale":"2024-09-12T19:26:39.252794+0000","last_undegraded":"2024-09-12T19:26:39.252794+0000","last_fullsized":"2024-09-12T19:26:39.252794+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:07.281605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14033056,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":541,"num_read_kb":94353,"num_write":1195,"num_write_kb":45131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686764+0000","last_change":"2024-09-12T17:36:38.901399+0000","last_active":"2024-09-12T19:26:40.686764+0000","last_peered":"2024-09-12T19:26:40.686764+0000","last_clean":"2024-09-12T19:26:40.686764+0000","last_became_active":"2024-09-12T17:36:38.900687+0000","last_became_peered":"2024-09-12T17:36:38.900687+0000","last_unstale":"2024-09-12T19:26:40.686764+0000","last_undegraded":"2024-09-12T19:26:40.686764+0000","last_fullsized":"2024-09-12T19:26:40.686764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:39.929327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'157","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:34.443859+0000","last_change":"2024-09-12T17:36:40.905441+0000","last_active":"2024-09-12T19:27:34.443859+0000","last_peered":"2024-09-12T19:27:34.443859+0000","last_clean":"2024-09-12T19:27:34.443859+0000","last_became_active":"2024-09-12T17:36:40.904671+0000","last_became_peered":"2024-09-12T17:36:40.904671+0000","last_unstale":"2024-09-12T19:27:34.443859+0000","last_undegraded":"2024-09-12T19:27:34.443859+0000","last_fullsized":"2024-09-12T19:27:34.443859+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:48.997983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":202,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'767","reported_seq":3474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.060059+0000","last_change":"2024-09-12T17:36:42.930179+0000","last_active":"2024-09-12T19:29:25.060059+0000","last_peered":"2024-09-12T19:29:25.060059+0000","last_clean":"2024-09-12T19:29:25.060059+0000","last_became_active":"2024-09-12T17:36:42.929232+0000","last_became_peered":"2024-09-12T17:36:42.929232+0000","last_unstale":"2024-09-12T19:29:25.060059+0000","last_undegraded":"2024-09-12T19:29:25.060059+0000","last_fullsized":"2024-09-12T19:29:25.060059+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:00.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'132","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.338006+0000","last_change":"2024-09-12T17:36:44.946960+0000","last_active":"2024-09-12T19:26:59.338006+0000","last_peered":"2024-09-12T19:26:59.338006+0000","last_clean":"2024-09-12T19:26:59.338006+0000","last_became_active":"2024-09-12T17:36:44.945777+0000","last_became_peered":"2024-09-12T17:36:44.945777+0000","last_unstale":"2024-09-12T19:26:59.338006+0000","last_undegraded":"2024-09-12T19:26:59.338006+0000","last_fullsized":"2024-09-12T19:26:59.338006+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:22.225543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":212,"num_write":329,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'428","reported_seq":1981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.044099+0000","last_change":"2024-09-12T17:36:36.897272+0000","last_active":"2024-09-12T19:29:21.044099+0000","last_peered":"2024-09-12T19:29:21.044099+0000","last_clean":"2024-09-12T19:29:21.044099+0000","last_became_active":"2024-09-12T17:36:36.896871+0000","last_became_peered":"2024-09-12T17:36:36.896871+0000","last_unstale":"2024-09-12T19:29:21.044099+0000","last_undegraded":"2024-09-12T19:29:21.044099+0000","last_fullsized":"2024-09-12T19:29:21.044099+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:55.322767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2316,"num_read_kb":2187,"num_write":500,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'327","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.086645+0000","last_change":"2024-09-12T17:36:34.869011+0000","last_active":"2024-09-12T19:26:35.086645+0000","last_peered":"2024-09-12T19:26:35.086645+0000","last_clean":"2024-09-12T19:26:35.086645+0000","last_became_active":"2024-09-12T17:36:34.868685+0000","last_became_peered":"2024-09-12T17:36:34.868685+0000","last_unstale":"2024-09-12T19:26:35.086645+0000","last_undegraded":"2024-09-12T19:26:35.086645+0000","last_fullsized":"2024-09-12T19:26:35.086645+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:45.839499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4354196,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":512,"num_read_kb":59980,"num_write":1179,"num_write_kb":34100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.087989+0000","last_change":"2024-09-12T17:36:38.885901+0000","last_active":"2024-09-12T19:26:40.087989+0000","last_peered":"2024-09-12T19:26:40.087989+0000","last_clean":"2024-09-12T19:26:40.087989+0000","last_became_active":"2024-09-12T17:36:38.885092+0000","last_became_peered":"2024-09-12T17:36:38.885092+0000","last_unstale":"2024-09-12T19:26:40.087989+0000","last_undegraded":"2024-09-12T19:26:40.087989+0000","last_fullsized":"2024-09-12T19:26:40.087989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:14.638797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'404","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.617612+0000","last_change":"2024-09-12T17:36:40.902995+0000","last_active":"2024-09-12T19:28:15.617612+0000","last_peered":"2024-09-12T19:28:15.617612+0000","last_clean":"2024-09-12T19:28:15.617612+0000","last_became_active":"2024-09-12T17:36:40.902484+0000","last_became_peered":"2024-09-12T17:36:40.902484+0000","last_unstale":"2024-09-12T19:28:15.617612+0000","last_undegraded":"2024-09-12T19:28:15.617612+0000","last_fullsized":"2024-09-12T19:28:15.617612+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:00.010334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59659,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":629,"num_read_kb":1134,"num_write":500,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.671027+0000","last_change":"2024-09-12T17:36:42.937350+0000","last_active":"2024-09-12T19:25:30.671027+0000","last_peered":"2024-09-12T19:25:30.671027+0000","last_clean":"2024-09-12T19:25:30.671027+0000","last_became_active":"2024-09-12T17:36:42.932462+0000","last_became_peered":"2024-09-12T17:36:42.932462+0000","last_unstale":"2024-09-12T19:25:30.671027+0000","last_undegraded":"2024-09-12T19:25:30.671027+0000","last_fullsized":"2024-09-12T19:25:30.671027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:45.961114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'125","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:59.522990+0000","last_change":"2024-09-12T17:36:44.944698+0000","last_active":"2024-09-12T19:27:59.522990+0000","last_peered":"2024-09-12T19:27:59.522990+0000","last_clean":"2024-09-12T19:27:59.522990+0000","last_became_active":"2024-09-12T17:36:44.943948+0000","last_became_peered":"2024-09-12T17:36:44.943948+0000","last_unstale":"2024-09-12T19:27:59.522990+0000","last_undegraded":"2024-09-12T19:27:59.522990+0000","last_fullsized":"2024-09-12T19:27:59.522990+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:55.649115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":170,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'823","reported_seq":2518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.620849+0000","last_change":"2024-09-12T17:36:36.888995+0000","last_active":"2024-09-12T19:28:02.620849+0000","last_peered":"2024-09-12T19:28:02.620849+0000","last_clean":"2024-09-12T19:28:02.620849+0000","last_became_active":"2024-09-12T17:36:36.888747+0000","last_became_peered":"2024-09-12T17:36:36.888747+0000","last_unstale":"2024-09-12T19:28:02.620849+0000","last_undegraded":"2024-09-12T19:28:02.620849+0000","last_fullsized":"2024-09-12T19:28:02.620849+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:00.206667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3583,"num_write":1069,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'411","reported_seq":1100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.357959+0000","last_change":"2024-09-12T17:36:34.877161+0000","last_active":"2024-09-12T19:26:35.357959+0000","last_peered":"2024-09-12T19:26:35.357959+0000","last_clean":"2024-09-12T19:26:35.357959+0000","last_became_active":"2024-09-12T17:36:34.876487+0000","last_became_peered":"2024-09-12T17:36:34.876487+0000","last_unstale":"2024-09-12T19:26:35.357959+0000","last_undegraded":"2024-09-12T19:26:35.357959+0000","last_fullsized":"2024-09-12T19:26:35.357959+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:54.874115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5389541,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":764,"num_read_kb":5903,"num_write":1319,"num_write_kb":31714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.245910+0000","last_change":"2024-09-12T17:36:38.902372+0000","last_active":"2024-09-12T19:26:40.245910+0000","last_peered":"2024-09-12T19:26:40.245910+0000","last_clean":"2024-09-12T19:26:40.245910+0000","last_became_active":"2024-09-12T17:36:38.901575+0000","last_became_peered":"2024-09-12T17:36:38.901575+0000","last_unstale":"2024-09-12T19:26:40.245910+0000","last_undegraded":"2024-09-12T19:26:40.245910+0000","last_fullsized":"2024-09-12T19:26:40.245910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:49.517366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'321","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.129535+0000","last_change":"2024-09-12T17:36:40.901766+0000","last_active":"2024-09-12T19:29:21.129535+0000","last_peered":"2024-09-12T19:29:21.129535+0000","last_clean":"2024-09-12T19:29:21.129535+0000","last_became_active":"2024-09-12T17:36:40.900739+0000","last_became_peered":"2024-09-12T17:36:40.900739+0000","last_unstale":"2024-09-12T19:29:21.129535+0000","last_undegraded":"2024-09-12T19:29:21.129535+0000","last_fullsized":"2024-09-12T19:29:21.129535+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:19.813863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69459,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":540,"num_read_kb":1109,"num_write":442,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.348981+0000","last_change":"2024-09-12T17:36:42.921850+0000","last_active":"2024-09-12T19:26:00.348981+0000","last_peered":"2024-09-12T19:26:00.348981+0000","last_clean":"2024-09-12T19:26:00.348981+0000","last_became_active":"2024-09-12T17:36:42.920767+0000","last_became_peered":"2024-09-12T17:36:42.920767+0000","last_unstale":"2024-09-12T19:26:00.348981+0000","last_undegraded":"2024-09-12T19:26:00.348981+0000","last_fullsized":"2024-09-12T19:26:00.348981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:22.058824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'123","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.194923+0000","last_change":"2024-09-12T17:36:44.961031+0000","last_active":"2024-09-12T19:27:10.194923+0000","last_peered":"2024-09-12T19:27:10.194923+0000","last_clean":"2024-09-12T19:27:10.194923+0000","last_became_active":"2024-09-12T17:36:44.959535+0000","last_became_peered":"2024-09-12T17:36:44.959535+0000","last_unstale":"2024-09-12T19:27:10.194923+0000","last_undegraded":"2024-09-12T19:27:10.194923+0000","last_fullsized":"2024-09-12T19:27:10.194923+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:18.916773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":231,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'446","reported_seq":1831,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.364011+0000","last_change":"2024-09-12T17:36:36.895868+0000","last_active":"2024-09-12T19:28:00.364011+0000","last_peered":"2024-09-12T19:28:00.364011+0000","last_clean":"2024-09-12T19:28:00.364011+0000","last_became_active":"2024-09-12T17:36:36.895126+0000","last_became_peered":"2024-09-12T17:36:36.895126+0000","last_unstale":"2024-09-12T19:28:00.364011+0000","last_undegraded":"2024-09-12T19:28:00.364011+0000","last_fullsized":"2024-09-12T19:28:00.364011+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:38.358463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2194,"num_read_kb":2018,"num_write":546,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'285","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261243+0000","last_change":"2024-09-12T17:36:34.879150+0000","last_active":"2024-09-12T19:27:05.261243+0000","last_peered":"2024-09-12T19:27:05.261243+0000","last_clean":"2024-09-12T19:27:05.261243+0000","last_became_active":"2024-09-12T17:36:34.878381+0000","last_became_peered":"2024-09-12T17:36:34.878381+0000","last_unstale":"2024-09-12T19:27:05.261243+0000","last_undegraded":"2024-09-12T19:27:05.261243+0000","last_fullsized":"2024-09-12T19:27:05.261243+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:53.395319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4200358,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":497,"num_read_kb":62026,"num_write":1000,"num_write_kb":23225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.071542+0000","last_change":"2024-09-12T17:36:38.888449+0000","last_active":"2024-09-12T19:25:25.071542+0000","last_peered":"2024-09-12T19:25:25.071542+0000","last_clean":"2024-09-12T19:25:25.071542+0000","last_became_active":"2024-09-12T17:36:38.887476+0000","last_became_peered":"2024-09-12T17:36:38.887476+0000","last_unstale":"2024-09-12T19:25:25.071542+0000","last_undegraded":"2024-09-12T19:25:25.071542+0000","last_fullsized":"2024-09-12T19:25:25.071542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:59.359839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'241","reported_seq":823,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:14.079459+0000","last_change":"2024-09-12T17:36:40.904837+0000","last_active":"2024-09-12T19:29:14.079459+0000","last_peered":"2024-09-12T19:29:14.079459+0000","last_clean":"2024-09-12T19:29:14.079459+0000","last_became_active":"2024-09-12T17:36:40.904126+0000","last_became_peered":"2024-09-12T17:36:40.904126+0000","last_unstale":"2024-09-12T19:29:14.079459+0000","last_undegraded":"2024-09-12T19:29:14.079459+0000","last_fullsized":"2024-09-12T19:29:14.079459+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:14.815589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57238,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":853,"num_write":320,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360790+0000","last_change":"2024-09-12T17:36:42.935140+0000","last_active":"2024-09-12T19:26:45.360790+0000","last_peered":"2024-09-12T19:26:45.360790+0000","last_clean":"2024-09-12T19:26:45.360790+0000","last_became_active":"2024-09-12T17:36:42.934140+0000","last_became_peered":"2024-09-12T17:36:42.934140+0000","last_unstale":"2024-09-12T19:26:45.360790+0000","last_undegraded":"2024-09-12T19:26:45.360790+0000","last_fullsized":"2024-09-12T19:26:45.360790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:50.636896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'159","reported_seq":1650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.254322+0000","last_change":"2024-09-12T17:36:44.966081+0000","last_active":"2024-09-12T19:27:55.254322+0000","last_peered":"2024-09-12T19:27:55.254322+0000","last_clean":"2024-09-12T19:27:55.254322+0000","last_became_active":"2024-09-12T17:36:44.965427+0000","last_became_peered":"2024-09-12T17:36:44.965427+0000","last_unstale":"2024-09-12T19:27:55.254322+0000","last_undegraded":"2024-09-12T19:27:55.254322+0000","last_fullsized":"2024-09-12T19:27:55.254322+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:20.397523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1232,"num_read_kb":1221,"num_write":362,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'993","reported_seq":2719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.539915+0000","last_change":"2024-09-12T17:36:36.914615+0000","last_active":"2024-09-12T19:28:02.539915+0000","last_peered":"2024-09-12T19:28:02.539915+0000","last_clean":"2024-09-12T19:28:02.539915+0000","last_became_active":"2024-09-12T17:36:36.914315+0000","last_became_peered":"2024-09-12T17:36:36.914315+0000","last_unstale":"2024-09-12T19:28:02.539915+0000","last_undegraded":"2024-09-12T19:28:02.539915+0000","last_fullsized":"2024-09-12T19:28:02.539915+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":900,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:24.570940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4811,"num_read_kb":4330,"num_write":1385,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'279","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.260089+0000","last_change":"2024-09-12T17:36:34.873212+0000","last_active":"2024-09-12T19:27:00.260089+0000","last_peered":"2024-09-12T19:27:00.260089+0000","last_clean":"2024-09-12T19:27:00.260089+0000","last_became_active":"2024-09-12T17:36:34.871889+0000","last_became_peered":"2024-09-12T17:36:34.871889+0000","last_unstale":"2024-09-12T19:27:00.260089+0000","last_undegraded":"2024-09-12T19:27:00.260089+0000","last_fullsized":"2024-09-12T19:27:00.260089+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:28.254769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5234730,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":414,"num_read_kb":13875,"num_write":1077,"num_write_kb":46739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:45.674374+0000","last_change":"2024-09-12T17:36:38.882816+0000","last_active":"2024-09-12T19:25:45.674374+0000","last_peered":"2024-09-12T19:25:45.674374+0000","last_clean":"2024-09-12T19:25:45.674374+0000","last_became_active":"2024-09-12T17:36:38.882018+0000","last_became_peered":"2024-09-12T17:36:38.882018+0000","last_unstale":"2024-09-12T19:25:45.674374+0000","last_undegraded":"2024-09-12T19:25:45.674374+0000","last_fullsized":"2024-09-12T19:25:45.674374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:50.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'322","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.393445+0000","last_change":"2024-09-12T17:36:40.909328+0000","last_active":"2024-09-12T19:29:10.393445+0000","last_peered":"2024-09-12T19:29:10.393445+0000","last_clean":"2024-09-12T19:29:10.393445+0000","last_became_active":"2024-09-12T17:36:40.908611+0000","last_became_peered":"2024-09-12T17:36:40.908611+0000","last_unstale":"2024-09-12T19:29:10.393445+0000","last_undegraded":"2024-09-12T19:29:10.393445+0000","last_fullsized":"2024-09-12T19:29:10.393445+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:15.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67068,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":547,"num_read_kb":1063,"num_write":434,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.687795+0000","last_change":"2024-09-12T17:36:42.936919+0000","last_active":"2024-09-12T19:26:45.687795+0000","last_peered":"2024-09-12T19:26:45.687795+0000","last_clean":"2024-09-12T19:26:45.687795+0000","last_became_active":"2024-09-12T17:36:42.933510+0000","last_became_peered":"2024-09-12T17:36:42.933510+0000","last_unstale":"2024-09-12T19:26:45.687795+0000","last_undegraded":"2024-09-12T19:26:45.687795+0000","last_fullsized":"2024-09-12T19:26:45.687795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:11.996658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'126","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.020550+0000","last_change":"2024-09-12T17:36:44.961303+0000","last_active":"2024-09-12T19:29:21.020550+0000","last_peered":"2024-09-12T19:29:21.020550+0000","last_clean":"2024-09-12T19:29:21.020550+0000","last_became_active":"2024-09-12T17:36:44.960641+0000","last_became_peered":"2024-09-12T17:36:44.960641+0000","last_unstale":"2024-09-12T19:29:21.020550+0000","last_undegraded":"2024-09-12T19:29:21.020550+0000","last_fullsized":"2024-09-12T19:29:21.020550+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:20.007631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":181,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'930","reported_seq":2728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.366097+0000","last_change":"2024-09-12T17:36:36.901682+0000","last_active":"2024-09-12T19:28:00.366097+0000","last_peered":"2024-09-12T19:28:00.366097+0000","last_clean":"2024-09-12T19:28:00.366097+0000","last_became_active":"2024-09-12T17:36:36.901046+0000","last_became_peered":"2024-09-12T17:36:36.901046+0000","last_unstale":"2024-09-12T19:28:00.366097+0000","last_undegraded":"2024-09-12T19:28:00.366097+0000","last_fullsized":"2024-09-12T19:28:00.366097+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:29.856231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4712,"num_read_kb":4247,"num_write":1250,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'348","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.632279+0000","last_change":"2024-09-12T17:36:34.884343+0000","last_active":"2024-09-12T19:27:38.632279+0000","last_peered":"2024-09-12T19:27:38.632279+0000","last_clean":"2024-09-12T19:27:38.632279+0000","last_became_active":"2024-09-12T17:36:34.884112+0000","last_became_peered":"2024-09-12T17:36:34.884112+0000","last_unstale":"2024-09-12T19:27:38.632279+0000","last_undegraded":"2024-09-12T19:27:38.632279+0000","last_fullsized":"2024-09-12T19:27:38.632279+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:05.952592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4519802,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":613,"num_read_kb":11450,"num_write":1219,"num_write_kb":27380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'653","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675264+0000","last_change":"2024-09-12T17:36:36.917185+0000","last_active":"2024-09-12T19:27:10.675264+0000","last_peered":"2024-09-12T19:27:10.675264+0000","last_clean":"2024-09-12T19:27:10.675264+0000","last_became_active":"2024-09-12T17:36:36.916477+0000","last_became_peered":"2024-09-12T17:36:36.916477+0000","last_unstale":"2024-09-12T19:27:10.675264+0000","last_undegraded":"2024-09-12T19:27:10.675264+0000","last_fullsized":"2024-09-12T19:27:10.675264+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.646760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3261,"num_read_kb":2946,"num_write":856,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'297","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.672783+0000","last_change":"2024-09-12T17:36:34.862778+0000","last_active":"2024-09-12T19:27:00.672783+0000","last_peered":"2024-09-12T19:27:00.672783+0000","last_clean":"2024-09-12T19:27:00.672783+0000","last_became_active":"2024-09-12T17:36:34.862008+0000","last_became_peered":"2024-09-12T17:36:34.862008+0000","last_unstale":"2024-09-12T19:27:00.672783+0000","last_undegraded":"2024-09-12T19:27:00.672783+0000","last_fullsized":"2024-09-12T19:27:00.672783+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:34.713584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13207013,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":447,"num_read_kb":45708,"num_write":1085,"num_write_kb":41141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'442","reported_seq":2006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366473+0000","last_change":"2024-09-12T17:36:36.876715+0000","last_active":"2024-09-12T19:27:10.366473+0000","last_peered":"2024-09-12T19:27:10.366473+0000","last_clean":"2024-09-12T19:27:10.366473+0000","last_became_active":"2024-09-12T17:36:36.875947+0000","last_became_peered":"2024-09-12T17:36:36.875947+0000","last_unstale":"2024-09-12T19:27:10.366473+0000","last_undegraded":"2024-09-12T19:27:10.366473+0000","last_fullsized":"2024-09-12T19:27:10.366473+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:53.224464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2143,"num_write":507,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'281","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.363957+0000","last_change":"2024-09-12T17:36:34.892965+0000","last_active":"2024-09-12T19:27:00.363957+0000","last_peered":"2024-09-12T19:27:00.363957+0000","last_clean":"2024-09-12T19:27:00.363957+0000","last_became_active":"2024-09-12T17:36:34.892664+0000","last_became_peered":"2024-09-12T17:36:34.892664+0000","last_unstale":"2024-09-12T19:27:00.363957+0000","last_undegraded":"2024-09-12T19:27:00.363957+0000","last_fullsized":"2024-09-12T19:27:00.363957+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:17.794367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16579603,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":461,"num_read_kb":15114,"num_write":1027,"num_write_kb":33687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'449","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.620587+0000","last_change":"2024-09-12T17:36:36.887427+0000","last_active":"2024-09-12T19:28:02.620587+0000","last_peered":"2024-09-12T19:28:02.620587+0000","last_clean":"2024-09-12T19:28:02.620587+0000","last_became_active":"2024-09-12T17:36:36.886646+0000","last_became_peered":"2024-09-12T17:36:36.886646+0000","last_unstale":"2024-09-12T19:28:02.620587+0000","last_undegraded":"2024-09-12T19:28:02.620587+0000","last_fullsized":"2024-09-12T19:28:02.620587+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:16.527812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2431,"num_read_kb":2290,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'254","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.267092+0000","last_change":"2024-09-12T17:36:34.878872+0000","last_active":"2024-09-12T19:27:30.267092+0000","last_peered":"2024-09-12T19:27:30.267092+0000","last_clean":"2024-09-12T19:27:30.267092+0000","last_became_active":"2024-09-12T17:36:34.875514+0000","last_became_peered":"2024-09-12T17:36:34.875514+0000","last_unstale":"2024-09-12T19:27:30.267092+0000","last_undegraded":"2024-09-12T19:27:30.267092+0000","last_fullsized":"2024-09-12T19:27:30.267092+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:00.883687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3684293,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":355,"num_read_kb":12722,"num_write":873,"num_write_kb":21079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'472","reported_seq":2079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:35.268283+0000","last_change":"2024-09-12T17:36:36.896549+0000","last_active":"2024-09-12T19:27:35.268283+0000","last_peered":"2024-09-12T19:27:35.268283+0000","last_clean":"2024-09-12T19:27:35.268283+0000","last_became_active":"2024-09-12T17:36:36.895580+0000","last_became_peered":"2024-09-12T17:36:36.895580+0000","last_unstale":"2024-09-12T19:27:35.268283+0000","last_undegraded":"2024-09-12T19:27:35.268283+0000","last_fullsized":"2024-09-12T19:27:35.268283+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:38.232699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2410,"num_read_kb":2268,"num_write":522,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'311","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:04.050868+0000","last_change":"2024-09-12T17:36:34.876065+0000","last_active":"2024-09-12T19:27:04.050868+0000","last_peered":"2024-09-12T19:27:04.050868+0000","last_clean":"2024-09-12T19:27:04.050868+0000","last_became_active":"2024-09-12T17:36:34.875282+0000","last_became_peered":"2024-09-12T17:36:34.875282+0000","last_unstale":"2024-09-12T19:27:04.050868+0000","last_undegraded":"2024-09-12T19:27:04.050868+0000","last_fullsized":"2024-09-12T19:27:04.050868+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:40.356381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3778182,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":460,"num_read_kb":16782,"num_write":1005,"num_write_kb":43648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'867","reported_seq":2674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.119778+0000","last_change":"2024-09-12T17:36:36.880245+0000","last_active":"2024-09-12T19:28:32.119778+0000","last_peered":"2024-09-12T19:28:32.119778+0000","last_clean":"2024-09-12T19:28:32.119778+0000","last_became_active":"2024-09-12T17:36:36.879875+0000","last_became_peered":"2024-09-12T17:36:36.879875+0000","last_unstale":"2024-09-12T19:28:32.119778+0000","last_undegraded":"2024-09-12T19:28:32.119778+0000","last_fullsized":"2024-09-12T19:28:32.119778+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:34.212835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4378,"num_read_kb":3985,"num_write":1124,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'257","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.794574+0000","last_change":"2024-09-12T17:36:34.882320+0000","last_active":"2024-09-12T19:29:10.794574+0000","last_peered":"2024-09-12T19:29:10.794574+0000","last_clean":"2024-09-12T19:29:10.794574+0000","last_became_active":"2024-09-12T17:36:34.880893+0000","last_became_peered":"2024-09-12T17:36:34.880893+0000","last_unstale":"2024-09-12T19:29:10.794574+0000","last_undegraded":"2024-09-12T19:29:10.794574+0000","last_fullsized":"2024-09-12T19:29:10.794574+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:46.683258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20722098,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":395,"num_read_kb":34770,"num_write":991,"num_write_kb":43573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'1177","reported_seq":2763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:04.050596+0000","last_change":"2024-09-12T17:36:36.898718+0000","last_active":"2024-09-12T19:27:04.050596+0000","last_peered":"2024-09-12T19:27:04.050596+0000","last_clean":"2024-09-12T19:27:04.050596+0000","last_became_active":"2024-09-12T17:36:36.897985+0000","last_became_peered":"2024-09-12T17:36:36.897985+0000","last_unstale":"2024-09-12T19:27:04.050596+0000","last_undegraded":"2024-09-12T19:27:04.050596+0000","last_fullsized":"2024-09-12T19:27:04.050596+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:33.241292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5405,"num_read_kb":4772,"num_write":1628,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'320","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:16.332232+0000","last_change":"2024-09-12T17:36:34.877091+0000","last_active":"2024-09-12T19:29:16.332232+0000","last_peered":"2024-09-12T19:29:16.332232+0000","last_clean":"2024-09-12T19:29:16.332232+0000","last_became_active":"2024-09-12T17:36:34.876834+0000","last_became_peered":"2024-09-12T17:36:34.876834+0000","last_unstale":"2024-09-12T19:29:16.332232+0000","last_undegraded":"2024-09-12T19:29:16.332232+0000","last_fullsized":"2024-09-12T19:29:16.332232+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:36.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8440145,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":522,"num_read_kb":4635,"num_write":1163,"num_write_kb":22932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'773","reported_seq":2362,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.058729+0000","last_change":"2024-09-12T17:36:36.901626+0000","last_active":"2024-09-12T19:29:21.058729+0000","last_peered":"2024-09-12T19:29:21.058729+0000","last_clean":"2024-09-12T19:29:21.058729+0000","last_became_active":"2024-09-12T17:36:36.901293+0000","last_became_peered":"2024-09-12T17:36:36.901293+0000","last_unstale":"2024-09-12T19:29:21.058729+0000","last_undegraded":"2024-09-12T19:29:21.058729+0000","last_fullsized":"2024-09-12T19:29:21.058729+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:48.170779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3323,"num_write":979,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'281","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261280+0000","last_change":"2024-09-12T17:36:34.875326+0000","last_active":"2024-09-12T19:27:05.261280+0000","last_peered":"2024-09-12T19:27:05.261280+0000","last_clean":"2024-09-12T19:27:05.261280+0000","last_became_active":"2024-09-12T17:36:34.872999+0000","last_became_peered":"2024-09-12T17:36:34.872999+0000","last_unstale":"2024-09-12T19:27:05.261280+0000","last_undegraded":"2024-09-12T19:27:05.261280+0000","last_fullsized":"2024-09-12T19:27:05.261280+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:47.461128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4879593,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":608,"num_read_kb":7832,"num_write":1068,"num_write_kb":31819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'779","reported_seq":2247,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.049150+0000","last_change":"2024-09-12T17:36:36.904735+0000","last_active":"2024-09-12T19:29:21.049150+0000","last_peered":"2024-09-12T19:29:21.049150+0000","last_clean":"2024-09-12T19:29:21.049150+0000","last_became_active":"2024-09-12T17:36:36.903948+0000","last_became_peered":"2024-09-12T17:36:36.903948+0000","last_unstale":"2024-09-12T19:29:21.049150+0000","last_undegraded":"2024-09-12T19:29:21.049150+0000","last_fullsized":"2024-09-12T19:29:21.049150+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:06.384871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3650,"num_read_kb":3275,"num_write":1024,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'345","reported_seq":1104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:07.685342+0000","last_change":"2024-09-12T17:36:34.891921+0000","last_active":"2024-09-12T19:26:07.685342+0000","last_peered":"2024-09-12T19:26:07.685342+0000","last_clean":"2024-09-12T19:26:07.685342+0000","last_became_active":"2024-09-12T17:36:34.891638+0000","last_became_peered":"2024-09-12T17:36:34.891638+0000","last_unstale":"2024-09-12T19:26:07.685342+0000","last_undegraded":"2024-09-12T19:26:07.685342+0000","last_fullsized":"2024-09-12T19:26:07.685342+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:27.837483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765041,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":763,"num_read_kb":23553,"num_write":1256,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'1230","reported_seq":2980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.593064+0000","last_change":"2024-09-12T17:36:36.906715+0000","last_active":"2024-09-12T19:26:20.593064+0000","last_peered":"2024-09-12T19:26:20.593064+0000","last_clean":"2024-09-12T19:26:20.593064+0000","last_became_active":"2024-09-12T17:36:36.906463+0000","last_became_peered":"2024-09-12T17:36:36.906463+0000","last_unstale":"2024-09-12T19:26:20.593064+0000","last_undegraded":"2024-09-12T19:26:20.593064+0000","last_fullsized":"2024-09-12T19:26:20.593064+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:50.870597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5684,"num_read_kb":5045,"num_write":1688,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'262","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.257503+0000","last_change":"2024-09-12T17:36:34.874816+0000","last_active":"2024-09-12T19:26:50.257503+0000","last_peered":"2024-09-12T19:26:50.257503+0000","last_clean":"2024-09-12T19:26:50.257503+0000","last_became_active":"2024-09-12T17:36:34.873189+0000","last_became_peered":"2024-09-12T17:36:34.873189+0000","last_unstale":"2024-09-12T19:26:50.257503+0000","last_undegraded":"2024-09-12T19:26:50.257503+0000","last_fullsized":"2024-09-12T19:26:50.257503+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:16.748289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11129714,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":374,"num_read_kb":39048,"num_write":883,"num_write_kb":38605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'997","reported_seq":2702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.116025+0000","last_change":"2024-09-12T17:36:36.876501+0000","last_active":"2024-09-12T19:28:32.116025+0000","last_peered":"2024-09-12T19:28:32.116025+0000","last_clean":"2024-09-12T19:28:32.116025+0000","last_became_active":"2024-09-12T17:36:36.875791+0000","last_became_peered":"2024-09-12T17:36:36.875791+0000","last_unstale":"2024-09-12T19:28:32.116025+0000","last_undegraded":"2024-09-12T19:28:32.116025+0000","last_fullsized":"2024-09-12T19:28:32.116025+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:20.751412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4962,"num_read_kb":4419,"num_write":1465,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'194","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.090313+0000","last_change":"2024-09-12T17:36:34.867040+0000","last_active":"2024-09-12T19:26:50.090313+0000","last_peered":"2024-09-12T19:26:50.090313+0000","last_clean":"2024-09-12T19:26:50.090313+0000","last_became_active":"2024-09-12T17:36:34.866719+0000","last_became_peered":"2024-09-12T17:36:34.866719+0000","last_unstale":"2024-09-12T19:26:50.090313+0000","last_undegraded":"2024-09-12T19:26:50.090313+0000","last_fullsized":"2024-09-12T19:26:50.090313+0000","mapping_epoch":24,"log_start":"265'100","ondisk_log_start":"265'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:38.881915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5352417,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":331,"num_read_kb":13747,"num_write":730,"num_write_kb":14866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'511","reported_seq":2129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.091439+0000","last_change":"2024-09-12T17:36:36.914630+0000","last_active":"2024-09-12T19:26:55.091439+0000","last_peered":"2024-09-12T19:26:55.091439+0000","last_clean":"2024-09-12T19:26:55.091439+0000","last_became_active":"2024-09-12T17:36:36.914327+0000","last_became_peered":"2024-09-12T17:36:36.914327+0000","last_unstale":"2024-09-12T19:26:55.091439+0000","last_undegraded":"2024-09-12T19:26:55.091439+0000","last_fullsized":"2024-09-12T19:26:55.091439+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:59.445859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2629,"num_read_kb":2439,"num_write":603,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'238","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.688932+0000","last_change":"2024-09-12T17:36:34.865386+0000","last_active":"2024-09-12T19:26:50.688932+0000","last_peered":"2024-09-12T19:26:50.688932+0000","last_clean":"2024-09-12T19:26:50.688932+0000","last_became_active":"2024-09-12T17:36:34.864682+0000","last_became_peered":"2024-09-12T17:36:34.864682+0000","last_unstale":"2024-09-12T19:26:50.688932+0000","last_undegraded":"2024-09-12T19:26:50.688932+0000","last_fullsized":"2024-09-12T19:26:50.688932+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:44.124063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4211819,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":324,"num_read_kb":10447,"num_write":844,"num_write_kb":22906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'843","reported_seq":2465,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.325029+0000","last_change":"2024-09-12T17:36:36.886698+0000","last_active":"2024-09-12T19:26:59.325029+0000","last_peered":"2024-09-12T19:26:59.325029+0000","last_clean":"2024-09-12T19:26:59.325029+0000","last_became_active":"2024-09-12T17:36:36.885956+0000","last_became_peered":"2024-09-12T17:36:36.885956+0000","last_unstale":"2024-09-12T19:26:59.325029+0000","last_undegraded":"2024-09-12T19:26:59.325029+0000","last_fullsized":"2024-09-12T19:26:59.325029+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:14.336258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3814,"num_read_kb":3459,"num_write":1078,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'289","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.599808+0000","last_change":"2024-09-12T17:36:34.867183+0000","last_active":"2024-09-12T19:26:50.599808+0000","last_peered":"2024-09-12T19:26:50.599808+0000","last_clean":"2024-09-12T19:26:50.599808+0000","last_became_active":"2024-09-12T17:36:34.865344+0000","last_became_peered":"2024-09-12T17:36:34.865344+0000","last_unstale":"2024-09-12T19:26:50.599808+0000","last_undegraded":"2024-09-12T19:26:50.599808+0000","last_fullsized":"2024-09-12T19:26:50.599808+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:57.377914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13665091,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":485,"num_read_kb":55805,"num_write":1120,"num_write_kb":26331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'722","reported_seq":2134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671563+0000","last_change":"2024-09-12T17:36:36.916852+0000","last_active":"2024-09-12T19:26:55.671563+0000","last_peered":"2024-09-12T19:26:55.671563+0000","last_clean":"2024-09-12T19:26:55.671563+0000","last_became_active":"2024-09-12T17:36:36.916289+0000","last_became_peered":"2024-09-12T17:36:36.916289+0000","last_unstale":"2024-09-12T19:26:55.671563+0000","last_undegraded":"2024-09-12T19:26:55.671563+0000","last_fullsized":"2024-09-12T19:26:55.671563+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:24.873023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3361,"num_read_kb":3032,"num_write":954,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'296","reported_seq":1182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368897+0000","last_change":"2024-09-12T17:36:34.876882+0000","last_active":"2024-09-12T19:27:20.368897+0000","last_peered":"2024-09-12T19:27:20.368897+0000","last_clean":"2024-09-12T19:27:20.368897+0000","last_became_active":"2024-09-12T17:36:34.875748+0000","last_became_peered":"2024-09-12T17:36:34.875748+0000","last_unstale":"2024-09-12T19:27:20.368897+0000","last_undegraded":"2024-09-12T19:27:20.368897+0000","last_fullsized":"2024-09-12T19:27:20.368897+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:38.898125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14247268,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":869,"num_read_kb":75770,"num_write":949,"num_write_kb":38932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'575","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.115291+0000","last_change":"2024-09-12T17:36:36.904688+0000","last_active":"2024-09-12T19:28:32.115291+0000","last_peered":"2024-09-12T19:28:32.115291+0000","last_clean":"2024-09-12T19:28:32.115291+0000","last_became_active":"2024-09-12T17:36:36.902941+0000","last_became_peered":"2024-09-12T17:36:36.902941+0000","last_unstale":"2024-09-12T19:28:32.115291+0000","last_undegraded":"2024-09-12T19:28:32.115291+0000","last_fullsized":"2024-09-12T19:28:32.115291+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:02.556913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2851,"num_read_kb":2607,"num_write":694,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'309","reported_seq":987,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.925526+0000","last_change":"2024-09-12T17:36:34.873753+0000","last_active":"2024-09-12T19:26:55.925526+0000","last_peered":"2024-09-12T19:26:55.925526+0000","last_clean":"2024-09-12T19:26:55.925526+0000","last_became_active":"2024-09-12T17:36:34.868083+0000","last_became_peered":"2024-09-12T17:36:34.868083+0000","last_unstale":"2024-09-12T19:26:55.925526+0000","last_undegraded":"2024-09-12T19:26:55.925526+0000","last_fullsized":"2024-09-12T19:26:55.925526+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:12.169519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13117121,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":486,"num_read_kb":53045,"num_write":1152,"num_write_kb":26068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'576","reported_seq":2515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:53.296831+0000","last_change":"2024-09-12T17:36:36.891765+0000","last_active":"2024-09-12T19:26:53.296831+0000","last_peered":"2024-09-12T19:26:53.296831+0000","last_clean":"2024-09-12T19:26:53.296831+0000","last_became_active":"2024-09-12T17:36:36.891412+0000","last_became_peered":"2024-09-12T17:36:36.891412+0000","last_unstale":"2024-09-12T19:26:53.296831+0000","last_undegraded":"2024-09-12T19:26:53.296831+0000","last_fullsized":"2024-09-12T19:26:53.296831+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:43.215780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3296,"num_read_kb":3095,"num_write":679,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'325","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.352773+0000","last_change":"2024-09-12T17:36:34.872524+0000","last_active":"2024-09-12T19:26:15.352773+0000","last_peered":"2024-09-12T19:26:15.352773+0000","last_clean":"2024-09-12T19:26:15.352773+0000","last_became_active":"2024-09-12T17:36:34.872242+0000","last_became_peered":"2024-09-12T17:36:34.872242+0000","last_unstale":"2024-09-12T19:26:15.352773+0000","last_undegraded":"2024-09-12T19:26:15.352773+0000","last_fullsized":"2024-09-12T19:26:15.352773+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:13.591648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7342728,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":466,"num_read_kb":8809,"num_write":1123,"num_write_kb":19313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'298","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.352448+0000","last_change":"2024-09-12T17:36:34.862643+0000","last_active":"2024-09-12T19:26:15.352448+0000","last_peered":"2024-09-12T19:26:15.352448+0000","last_clean":"2024-09-12T19:26:15.352448+0000","last_became_active":"2024-09-12T17:36:34.861821+0000","last_became_peered":"2024-09-12T17:36:34.861821+0000","last_unstale":"2024-09-12T19:26:15.352448+0000","last_undegraded":"2024-09-12T19:26:15.352448+0000","last_fullsized":"2024-09-12T19:26:15.352448+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.821144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11196651,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":490,"num_read_kb":100665,"num_write":1010,"num_write_kb":41422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'568","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.624055+0000","last_change":"2024-09-12T17:36:36.912672+0000","last_active":"2024-09-12T19:28:02.624055+0000","last_peered":"2024-09-12T19:28:02.624055+0000","last_clean":"2024-09-12T19:28:02.624055+0000","last_became_active":"2024-09-12T17:36:36.911855+0000","last_became_peered":"2024-09-12T17:36:36.911855+0000","last_unstale":"2024-09-12T19:28:02.624055+0000","last_undegraded":"2024-09-12T19:28:02.624055+0000","last_fullsized":"2024-09-12T19:28:02.624055+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:51.023621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2849,"num_read_kb":2620,"num_write":728,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'271","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.249382+0000","last_change":"2024-09-12T17:36:34.881995+0000","last_active":"2024-09-12T19:26:15.249382+0000","last_peered":"2024-09-12T19:26:15.249382+0000","last_clean":"2024-09-12T19:26:15.249382+0000","last_became_active":"2024-09-12T17:36:34.881262+0000","last_became_peered":"2024-09-12T17:36:34.881262+0000","last_unstale":"2024-09-12T19:26:15.249382+0000","last_undegraded":"2024-09-12T19:26:15.249382+0000","last_fullsized":"2024-09-12T19:26:15.249382+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:56.865811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11520182,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":413,"num_read_kb":5153,"num_write":968,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'505","reported_seq":2109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:49.753418+0000","last_change":"2024-09-12T17:36:36.902225+0000","last_active":"2024-09-12T19:25:49.753418+0000","last_peered":"2024-09-12T19:25:49.753418+0000","last_clean":"2024-09-12T19:25:49.753418+0000","last_became_active":"2024-09-12T17:36:36.901857+0000","last_became_peered":"2024-09-12T17:36:36.901857+0000","last_unstale":"2024-09-12T19:25:49.753418+0000","last_undegraded":"2024-09-12T19:25:49.753418+0000","last_fullsized":"2024-09-12T19:25:49.753418+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:17.433881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2642,"num_read_kb":2459,"num_write":621,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5957,"num_read_kb":4161,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16299,"num_read_kb":15966,"num_write":16741,"num_write_kb":4895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1571,"ondisk_log_size":1571,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":722,"ondisk_log_size":722,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1913607,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":20557,"num_read_kb":36393,"num_write":17323,"num_write_kb":12410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":2788680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1939,"ondisk_log_size":1939,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194467,"num_write":55293,"num_write_kb":18855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3723,"ondisk_log_size":3723,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":519850088,"num_objects":4468,"num_object_clones":0,"num_object_copies":8936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4468,"num_whiteouts":0,"num_read":32213,"num_read_kb":1890942,"num_write":67741,"num_write_kb":2051812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1072496640,"data_stored":1039700176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4377,"ondisk_log_size":4377,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":73036616,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":143,"num_read_kb":193786,"num_write":158,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73036616,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":139,"num_read_kb":184511,"num_write":158,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510808,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370948,"kb_used_data":151028,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94000892,"statfs":{"total":96636764160,"available":96256913408,"internally_reserved":0,"allocated":154652672,"data_stored":150487234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510805,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446784,"kb_used_data":221232,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93925056,"statfs":{"total":96636764160,"available":96179257344,"internally_reserved":0,"allocated":226541568,"data_stored":220467625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510809,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310544,"kb_used_data":139200,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94061296,"statfs":{"total":96636764160,"available":96318767104,"internally_reserved":0,"allocated":142540800,"data_stored":137549121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510805,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397560,"kb_used_data":191464,"kb_used_omap":1,"kb_used_meta":206078,"kb_avail":93974280,"statfs":{"total":96636764160,"available":96229662720,"internally_reserved":0,"allocated":196059136,"data_stored":189525965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":211024327},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510808,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279000,"kb_used_data":179784,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94092840,"statfs":{"total":96636764160,"available":96351068160,"internally_reserved":0,"allocated":184098816,"data_stored":177830188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510805,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":386308,"kb_used_data":124660,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93985532,"statfs":{"total":96636764160,"available":96241184768,"internally_reserved":0,"allocated":127651840,"data_stored":122482092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510806,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274572,"kb_used_data":180988,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94097268,"statfs":{"total":96636764160,"available":96355602432,"internally_reserved":0,"allocated":185331712,"data_stored":178220707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543510,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262300,"kb_used_data":177036,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94109540,"statfs":{"total":96636764160,"available":96368168960,"internally_reserved":0,"allocated":181284864,"data_stored":176165638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":154353664,"data_stored":148832606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102948864,"data_stored":99377080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":153522176,"data_stored":148783469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159535104,"data_stored":154580672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":113229824,"data_stored":109814101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":158314496,"data_stored":153836991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":132567040,"data_stored":129039281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98025472,"data_stored":95435976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":475982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":480024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":134977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":265497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":392629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":386072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":346573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":306926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11071488,"data_stored":11070123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15265792,"data_stored":15264427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29462528,"data_stored":29460637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10022912,"data_stored":10021547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12644352,"data_stored":12643276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":48275456,"data_stored":48274641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":19460096,"data_stored":19458731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23171072,"data_stored":23169181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:29:43.726 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:29:44.060 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:29:44.077 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-12T19:29:44.085 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":3661,"stamp":"2024-09-12T19:29:43.214498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668444752,"num_objects":4995,"num_object_clones":0,"num_object_copies":9990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4995,"num_whiteouts":0,"num_read":290634,"num_read_kb":2523158,"num_write":159492,"num_write_kb":2342719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":204,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13727,"ondisk_log_size":13727,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2728016,"kb_used_data":1365392,"kb_used_omap":12,"kb_used_meta":1362483,"kb_avail":752246704,"statfs":{"total":773094113280,"available":770300624896,"internally_reserved":0,"allocated":1398161408,"data_stored":1352728570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1395183152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008574"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.587902+0000","last_change":"2024-09-12T18:25:52.622405+0000","last_active":"2024-09-12T19:25:55.587902+0000","last_peered":"2024-09-12T19:25:55.587902+0000","last_clean":"2024-09-12T19:25:55.587902+0000","last_became_active":"2024-09-12T18:25:52.621735+0000","last_became_peered":"2024-09-12T18:25:52.621735+0000","last_unstale":"2024-09-12T19:25:55.587902+0000","last_undegraded":"2024-09-12T19:25:55.587902+0000","last_fullsized":"2024-09-12T19:25:55.587902+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:09.919704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.083326+0000","last_change":"2024-09-12T17:58:47.223973+0000","last_active":"2024-09-12T19:26:20.083326+0000","last_peered":"2024-09-12T19:26:20.083326+0000","last_clean":"2024-09-12T19:26:20.083326+0000","last_became_active":"2024-09-12T17:58:47.223202+0000","last_became_peered":"2024-09-12T17:58:47.223202+0000","last_unstale":"2024-09-12T19:26:20.083326+0000","last_undegraded":"2024-09-12T19:26:20.083326+0000","last_fullsized":"2024-09-12T19:26:20.083326+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:23.110262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.661108+0000","last_change":"2024-09-12T17:58:40.207149+0000","last_active":"2024-09-12T19:26:10.661108+0000","last_peered":"2024-09-12T19:26:10.661108+0000","last_clean":"2024-09-12T19:26:10.661108+0000","last_became_active":"2024-09-12T17:58:40.206469+0000","last_became_peered":"2024-09-12T17:58:40.206469+0000","last_unstale":"2024-09-12T19:26:10.661108+0000","last_undegraded":"2024-09-12T19:26:10.661108+0000","last_fullsized":"2024-09-12T19:26:10.661108+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:10.914751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'13","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.683354+0000","last_change":"2024-09-12T17:52:39.873196+0000","last_active":"2024-09-12T19:26:25.683354+0000","last_peered":"2024-09-12T19:26:25.683354+0000","last_clean":"2024-09-12T19:26:25.683354+0000","last_became_active":"2024-09-12T17:52:39.872356+0000","last_became_peered":"2024-09-12T17:52:39.872356+0000","last_unstale":"2024-09-12T19:26:25.683354+0000","last_undegraded":"2024-09-12T19:26:25.683354+0000","last_fullsized":"2024-09-12T19:26:25.683354+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:36.475086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.035593+0000","last_change":"2024-09-12T18:25:52.625279+0000","last_active":"2024-09-12T19:25:54.035593+0000","last_peered":"2024-09-12T19:25:54.035593+0000","last_clean":"2024-09-12T19:25:54.035593+0000","last_became_active":"2024-09-12T18:25:52.624565+0000","last_became_peered":"2024-09-12T18:25:52.624565+0000","last_unstale":"2024-09-12T19:25:54.035593+0000","last_undegraded":"2024-09-12T19:25:54.035593+0000","last_fullsized":"2024-09-12T19:25:54.035593+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:32.002014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'4","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241488+0000","last_change":"2024-09-12T17:58:47.249699+0000","last_active":"2024-09-12T19:26:20.241488+0000","last_peered":"2024-09-12T19:26:20.241488+0000","last_clean":"2024-09-12T19:26:20.241488+0000","last_became_active":"2024-09-12T17:58:47.249050+0000","last_became_peered":"2024-09-12T17:58:47.249050+0000","last_unstale":"2024-09-12T19:26:20.241488+0000","last_undegraded":"2024-09-12T19:26:20.241488+0000","last_fullsized":"2024-09-12T19:26:20.241488+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:09.406806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.248289+0000","last_change":"2024-09-12T17:58:40.210474+0000","last_active":"2024-09-12T19:26:10.248289+0000","last_peered":"2024-09-12T19:26:10.248289+0000","last_clean":"2024-09-12T19:26:10.248289+0000","last_became_active":"2024-09-12T17:58:40.209447+0000","last_became_peered":"2024-09-12T17:58:40.209447+0000","last_unstale":"2024-09-12T19:26:10.248289+0000","last_undegraded":"2024-09-12T19:26:10.248289+0000","last_fullsized":"2024-09-12T19:26:10.248289+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:51.043086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'14","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691311+0000","last_change":"2024-09-12T17:52:39.885082+0000","last_active":"2024-09-12T19:27:00.691311+0000","last_peered":"2024-09-12T19:27:00.691311+0000","last_clean":"2024-09-12T19:27:00.691311+0000","last_became_active":"2024-09-12T17:52:39.884327+0000","last_became_peered":"2024-09-12T17:52:39.884327+0000","last_unstale":"2024-09-12T19:27:00.691311+0000","last_undegraded":"2024-09-12T19:27:00.691311+0000","last_fullsized":"2024-09-12T19:27:00.691311+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:05.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.083157+0000","last_change":"2024-09-12T18:25:52.622449+0000","last_active":"2024-09-12T19:26:20.083157+0000","last_peered":"2024-09-12T19:26:20.083157+0000","last_clean":"2024-09-12T19:26:20.083157+0000","last_became_active":"2024-09-12T18:25:52.621796+0000","last_became_peered":"2024-09-12T18:25:52.621796+0000","last_unstale":"2024-09-12T19:26:20.083157+0000","last_undegraded":"2024-09-12T19:26:20.083157+0000","last_fullsized":"2024-09-12T19:26:20.083157+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:45.223769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'4","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250786+0000","last_change":"2024-09-12T17:58:47.240760+0000","last_active":"2024-09-12T19:26:20.250786+0000","last_peered":"2024-09-12T19:26:20.250786+0000","last_clean":"2024-09-12T19:26:20.250786+0000","last_became_active":"2024-09-12T17:58:47.239390+0000","last_became_peered":"2024-09-12T17:58:47.239390+0000","last_unstale":"2024-09-12T19:26:20.250786+0000","last_undegraded":"2024-09-12T19:26:20.250786+0000","last_fullsized":"2024-09-12T19:26:20.250786+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:08.068553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'2","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671750+0000","last_change":"2024-09-12T17:58:40.194349+0000","last_active":"2024-09-12T19:26:55.671750+0000","last_peered":"2024-09-12T19:26:55.671750+0000","last_clean":"2024-09-12T19:26:55.671750+0000","last_became_active":"2024-09-12T17:58:40.193462+0000","last_became_peered":"2024-09-12T17:58:40.193462+0000","last_unstale":"2024-09-12T19:26:55.671750+0000","last_undegraded":"2024-09-12T19:26:55.671750+0000","last_fullsized":"2024-09-12T19:26:55.671750+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:14.830909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1108940,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1083,"num_write":2,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'6","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026309+0000","last_change":"2024-09-12T17:52:39.872689+0000","last_active":"2024-09-12T19:25:09.026309+0000","last_peered":"2024-09-12T19:25:09.026309+0000","last_clean":"2024-09-12T19:25:09.026309+0000","last_became_active":"2024-09-12T17:52:39.871998+0000","last_became_peered":"2024-09-12T17:52:39.871998+0000","last_unstale":"2024-09-12T19:25:09.026309+0000","last_undegraded":"2024-09-12T19:25:09.026309+0000","last_fullsized":"2024-09-12T19:25:09.026309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:54.365755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255185+0000","last_change":"2024-09-12T18:25:52.613287+0000","last_active":"2024-09-12T19:26:40.255185+0000","last_peered":"2024-09-12T19:26:40.255185+0000","last_clean":"2024-09-12T19:26:40.255185+0000","last_became_active":"2024-09-12T18:25:52.612472+0000","last_became_peered":"2024-09-12T18:25:52.612472+0000","last_unstale":"2024-09-12T19:26:40.255185+0000","last_undegraded":"2024-09-12T19:26:40.255185+0000","last_fullsized":"2024-09-12T19:26:40.255185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:42.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"262'5","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263726+0000","last_change":"2024-09-12T17:58:47.248310+0000","last_active":"2024-09-12T19:27:15.263726+0000","last_peered":"2024-09-12T19:27:15.263726+0000","last_clean":"2024-09-12T19:27:15.263726+0000","last_became_active":"2024-09-12T17:58:47.247496+0000","last_became_peered":"2024-09-12T17:58:47.247496+0000","last_unstale":"2024-09-12T19:27:15.263726+0000","last_undegraded":"2024-09-12T19:27:15.263726+0000","last_fullsized":"2024-09-12T19:27:15.263726+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:24.161042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'11","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.081400+0000","last_change":"2024-09-12T17:58:40.214834+0000","last_active":"2024-09-12T19:26:10.081400+0000","last_peered":"2024-09-12T19:26:10.081400+0000","last_clean":"2024-09-12T19:26:10.081400+0000","last_became_active":"2024-09-12T17:58:40.207945+0000","last_became_peered":"2024-09-12T17:58:40.207945+0000","last_unstale":"2024-09-12T19:26:10.081400+0000","last_undegraded":"2024-09-12T19:26:10.081400+0000","last_fullsized":"2024-09-12T19:26:10.081400+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:52.444564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":21,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'37","reported_seq":169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026256+0000","last_change":"2024-09-12T17:52:39.871937+0000","last_active":"2024-09-12T19:25:09.026256+0000","last_peered":"2024-09-12T19:25:09.026256+0000","last_clean":"2024-09-12T19:25:09.026256+0000","last_became_active":"2024-09-12T17:52:39.871148+0000","last_became_peered":"2024-09-12T17:52:39.871148+0000","last_unstale":"2024-09-12T19:25:09.026256+0000","last_undegraded":"2024-09-12T19:25:09.026256+0000","last_fullsized":"2024-09-12T19:25:09.026256+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:45.467030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":131,"num_write":69,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.659086+0000","last_change":"2024-09-12T18:25:52.605404+0000","last_active":"2024-09-12T19:26:00.659086+0000","last_peered":"2024-09-12T19:26:00.659086+0000","last_clean":"2024-09-12T19:26:00.659086+0000","last_became_active":"2024-09-12T18:25:52.604589+0000","last_became_peered":"2024-09-12T18:25:52.604589+0000","last_unstale":"2024-09-12T19:26:00.659086+0000","last_undegraded":"2024-09-12T19:26:00.659086+0000","last_fullsized":"2024-09-12T19:26:00.659086+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.091248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.590632+0000","last_change":"2024-09-12T17:58:47.243839+0000","last_active":"2024-09-12T19:26:10.590632+0000","last_peered":"2024-09-12T19:26:10.590632+0000","last_clean":"2024-09-12T19:26:10.590632+0000","last_became_active":"2024-09-12T17:58:47.242756+0000","last_became_peered":"2024-09-12T17:58:47.242756+0000","last_unstale":"2024-09-12T19:26:10.590632+0000","last_undegraded":"2024-09-12T19:26:10.590632+0000","last_fullsized":"2024-09-12T19:26:10.590632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:13.909298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"262'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.241656+0000","last_change":"2024-09-12T17:58:40.211442+0000","last_active":"2024-09-12T19:25:40.241656+0000","last_peered":"2024-09-12T19:25:40.241656+0000","last_clean":"2024-09-12T19:25:40.241656+0000","last_became_active":"2024-09-12T17:58:40.202787+0000","last_became_peered":"2024-09-12T17:58:40.202787+0000","last_unstale":"2024-09-12T19:25:40.241656+0000","last_undegraded":"2024-09-12T19:25:40.241656+0000","last_fullsized":"2024-09-12T19:25:40.241656+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.258488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'30","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026173+0000","last_change":"2024-09-12T17:52:39.889339+0000","last_active":"2024-09-12T19:25:09.026173+0000","last_peered":"2024-09-12T19:25:09.026173+0000","last_clean":"2024-09-12T19:25:09.026173+0000","last_became_active":"2024-09-12T17:52:39.888092+0000","last_became_peered":"2024-09-12T17:52:39.888092+0000","last_unstale":"2024-09-12T19:25:09.026173+0000","last_undegraded":"2024-09-12T19:25:09.026173+0000","last_fullsized":"2024-09-12T19:25:09.026173+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:52.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682167+0000","last_change":"2024-09-12T18:25:52.615541+0000","last_active":"2024-09-12T19:26:20.682167+0000","last_peered":"2024-09-12T19:26:20.682167+0000","last_clean":"2024-09-12T19:26:20.682167+0000","last_became_active":"2024-09-12T18:25:52.614862+0000","last_became_peered":"2024-09-12T18:25:52.614862+0000","last_unstale":"2024-09-12T19:26:20.682167+0000","last_undegraded":"2024-09-12T19:26:20.682167+0000","last_fullsized":"2024-09-12T19:26:20.682167+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:20.974947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.346428+0000","last_change":"2024-09-12T17:58:47.251966+0000","last_active":"2024-09-12T19:25:50.346428+0000","last_peered":"2024-09-12T19:25:50.346428+0000","last_clean":"2024-09-12T19:25:50.346428+0000","last_became_active":"2024-09-12T17:58:47.246322+0000","last_became_peered":"2024-09-12T17:58:47.246322+0000","last_unstale":"2024-09-12T19:25:50.346428+0000","last_undegraded":"2024-09-12T19:25:50.346428+0000","last_fullsized":"2024-09-12T19:25:50.346428+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:04.147241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'3","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.351418+0000","last_change":"2024-09-12T17:58:40.207847+0000","last_active":"2024-09-12T19:26:10.351418+0000","last_peered":"2024-09-12T19:26:10.351418+0000","last_clean":"2024-09-12T19:26:10.351418+0000","last_became_active":"2024-09-12T17:58:40.207064+0000","last_became_peered":"2024-09-12T17:58:40.207064+0000","last_unstale":"2024-09-12T19:26:10.351418+0000","last_undegraded":"2024-09-12T19:26:10.351418+0000","last_fullsized":"2024-09-12T19:26:10.351418+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:41.646154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.225969+0000","last_change":"2024-09-12T17:52:39.884527+0000","last_active":"2024-09-12T19:25:10.225969+0000","last_peered":"2024-09-12T19:25:10.225969+0000","last_clean":"2024-09-12T19:25:10.225969+0000","last_became_active":"2024-09-12T17:52:39.883689+0000","last_became_peered":"2024-09-12T17:52:39.883689+0000","last_unstale":"2024-09-12T19:25:10.225969+0000","last_undegraded":"2024-09-12T19:25:10.225969+0000","last_fullsized":"2024-09-12T19:25:10.225969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:21.651937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.235695+0000","last_change":"2024-09-12T18:25:52.605313+0000","last_active":"2024-09-12T19:25:55.235695+0000","last_peered":"2024-09-12T19:25:55.235695+0000","last_clean":"2024-09-12T19:25:55.235695+0000","last_became_active":"2024-09-12T18:25:52.598221+0000","last_became_peered":"2024-09-12T18:25:52.598221+0000","last_unstale":"2024-09-12T19:25:55.235695+0000","last_undegraded":"2024-09-12T19:25:55.235695+0000","last_fullsized":"2024-09-12T19:25:55.235695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.818370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241434+0000","last_change":"2024-09-12T17:58:47.247385+0000","last_active":"2024-09-12T19:26:20.241434+0000","last_peered":"2024-09-12T19:26:20.241434+0000","last_clean":"2024-09-12T19:26:20.241434+0000","last_became_active":"2024-09-12T17:58:47.238781+0000","last_became_peered":"2024-09-12T17:58:47.238781+0000","last_unstale":"2024-09-12T19:26:20.241434+0000","last_undegraded":"2024-09-12T19:26:20.241434+0000","last_fullsized":"2024-09-12T19:26:20.241434+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:59.988556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.590718+0000","last_change":"2024-09-12T17:58:40.188716+0000","last_active":"2024-09-12T19:26:10.590718+0000","last_peered":"2024-09-12T19:26:10.590718+0000","last_clean":"2024-09-12T19:26:10.590718+0000","last_became_active":"2024-09-12T17:58:40.187973+0000","last_became_peered":"2024-09-12T17:58:40.187973+0000","last_unstale":"2024-09-12T19:26:10.590718+0000","last_undegraded":"2024-09-12T19:26:10.590718+0000","last_fullsized":"2024-09-12T19:26:10.590718+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:19.654518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'31","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675055+0000","last_change":"2024-09-12T17:52:39.892332+0000","last_active":"2024-09-12T19:27:10.675055+0000","last_peered":"2024-09-12T19:27:10.675055+0000","last_clean":"2024-09-12T19:27:10.675055+0000","last_became_active":"2024-09-12T17:52:39.891830+0000","last_became_peered":"2024-09-12T17:52:39.891830+0000","last_unstale":"2024-09-12T19:27:10.675055+0000","last_undegraded":"2024-09-12T19:27:10.675055+0000","last_fullsized":"2024-09-12T19:27:10.675055+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:19.516571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.588010+0000","last_change":"2024-09-12T18:25:52.607506+0000","last_active":"2024-09-12T19:25:55.588010+0000","last_peered":"2024-09-12T19:25:55.588010+0000","last_clean":"2024-09-12T19:25:55.588010+0000","last_became_active":"2024-09-12T18:25:52.606714+0000","last_became_peered":"2024-09-12T18:25:52.606714+0000","last_unstale":"2024-09-12T19:25:55.588010+0000","last_undegraded":"2024-09-12T19:25:55.588010+0000","last_fullsized":"2024-09-12T19:25:55.588010+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:29.094403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'3","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.663384+0000","last_change":"2024-09-12T17:58:47.251261+0000","last_active":"2024-09-12T19:26:20.663384+0000","last_peered":"2024-09-12T19:26:20.663384+0000","last_clean":"2024-09-12T19:26:20.663384+0000","last_became_active":"2024-09-12T17:58:47.250364+0000","last_became_peered":"2024-09-12T17:58:47.250364+0000","last_unstale":"2024-09-12T19:26:20.663384+0000","last_undegraded":"2024-09-12T19:26:20.663384+0000","last_fullsized":"2024-09-12T19:26:20.663384+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:18.815473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:09.038794+0000","last_change":"2024-09-12T17:58:40.212846+0000","last_active":"2024-09-12T19:26:09.038794+0000","last_peered":"2024-09-12T19:26:09.038794+0000","last_clean":"2024-09-12T19:26:09.038794+0000","last_became_active":"2024-09-12T17:58:40.212280+0000","last_became_peered":"2024-09-12T17:58:40.212280+0000","last_unstale":"2024-09-12T19:26:09.038794+0000","last_undegraded":"2024-09-12T19:26:09.038794+0000","last_fullsized":"2024-09-12T19:26:09.038794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:58.695339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'30","reported_seq":152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:54.048336+0000","last_change":"2024-09-12T17:52:39.871278+0000","last_active":"2024-09-12T19:26:54.048336+0000","last_peered":"2024-09-12T19:26:54.048336+0000","last_clean":"2024-09-12T19:26:54.048336+0000","last_became_active":"2024-09-12T17:52:39.870304+0000","last_became_peered":"2024-09-12T17:52:39.870304+0000","last_unstale":"2024-09-12T19:26:54.048336+0000","last_undegraded":"2024-09-12T19:26:54.048336+0000","last_fullsized":"2024-09-12T19:26:54.048336+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:38.765024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":59,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254085+0000","last_change":"2024-09-12T18:25:52.623401+0000","last_active":"2024-09-12T19:26:35.254085+0000","last_peered":"2024-09-12T19:26:35.254085+0000","last_clean":"2024-09-12T19:26:35.254085+0000","last_became_active":"2024-09-12T18:25:52.622842+0000","last_became_peered":"2024-09-12T18:25:52.622842+0000","last_unstale":"2024-09-12T19:26:35.254085+0000","last_undegraded":"2024-09-12T19:26:35.254085+0000","last_fullsized":"2024-09-12T19:26:35.254085+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:22.497623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.656697+0000","last_change":"2024-09-12T17:58:47.256168+0000","last_active":"2024-09-12T19:25:50.656697+0000","last_peered":"2024-09-12T19:25:50.656697+0000","last_clean":"2024-09-12T19:25:50.656697+0000","last_became_active":"2024-09-12T17:58:47.255379+0000","last_became_peered":"2024-09-12T17:58:47.255379+0000","last_unstale":"2024-09-12T19:25:50.656697+0000","last_undegraded":"2024-09-12T19:25:50.656697+0000","last_fullsized":"2024-09-12T19:25:50.656697+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:28.202469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.341509+0000","last_change":"2024-09-12T17:58:40.194167+0000","last_active":"2024-09-12T19:25:30.341509+0000","last_peered":"2024-09-12T19:25:30.341509+0000","last_clean":"2024-09-12T19:25:30.341509+0000","last_became_active":"2024-09-12T17:58:40.193471+0000","last_became_peered":"2024-09-12T17:58:40.193471+0000","last_unstale":"2024-09-12T19:25:30.341509+0000","last_undegraded":"2024-09-12T19:25:30.341509+0000","last_fullsized":"2024-09-12T19:25:30.341509+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:18.036549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'46","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690191+0000","last_change":"2024-09-12T17:52:39.883998+0000","last_active":"2024-09-12T19:26:55.690191+0000","last_peered":"2024-09-12T19:26:55.690191+0000","last_clean":"2024-09-12T19:26:55.690191+0000","last_became_active":"2024-09-12T17:52:39.883248+0000","last_became_peered":"2024-09-12T17:52:39.883248+0000","last_unstale":"2024-09-12T19:26:55.690191+0000","last_undegraded":"2024-09-12T19:26:55.690191+0000","last_fullsized":"2024-09-12T19:26:55.690191+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:59.309550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":156,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:34.044189+0000","last_change":"2024-09-12T18:25:52.612372+0000","last_active":"2024-09-12T19:26:34.044189+0000","last_peered":"2024-09-12T19:26:34.044189+0000","last_clean":"2024-09-12T19:26:34.044189+0000","last_became_active":"2024-09-12T18:25:52.611620+0000","last_became_peered":"2024-09-12T18:25:52.611620+0000","last_unstale":"2024-09-12T19:26:34.044189+0000","last_undegraded":"2024-09-12T19:26:34.044189+0000","last_fullsized":"2024-09-12T19:26:34.044189+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:49.193437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'6","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:35.240621+0000","last_change":"2024-09-12T17:58:47.250813+0000","last_active":"2024-09-12T19:25:35.240621+0000","last_peered":"2024-09-12T19:25:35.240621+0000","last_clean":"2024-09-12T19:25:35.240621+0000","last_became_active":"2024-09-12T17:58:47.249833+0000","last_became_peered":"2024-09-12T17:58:47.249833+0000","last_unstale":"2024-09-12T19:25:35.240621+0000","last_undegraded":"2024-09-12T19:25:35.240621+0000","last_fullsized":"2024-09-12T19:25:35.240621+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:00.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.584687+0000","last_change":"2024-09-12T17:58:40.204716+0000","last_active":"2024-09-12T19:25:40.584687+0000","last_peered":"2024-09-12T19:25:40.584687+0000","last_clean":"2024-09-12T19:25:40.584687+0000","last_became_active":"2024-09-12T17:58:40.203917+0000","last_became_peered":"2024-09-12T17:58:40.203917+0000","last_unstale":"2024-09-12T19:25:40.584687+0000","last_undegraded":"2024-09-12T19:25:40.584687+0000","last_fullsized":"2024-09-12T19:25:40.584687+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:29.039732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690138+0000","last_change":"2024-09-12T17:52:39.885011+0000","last_active":"2024-09-12T19:26:55.690138+0000","last_peered":"2024-09-12T19:26:55.690138+0000","last_clean":"2024-09-12T19:26:55.690138+0000","last_became_active":"2024-09-12T17:52:39.884285+0000","last_became_peered":"2024-09-12T17:52:39.884285+0000","last_unstale":"2024-09-12T19:26:55.690138+0000","last_undegraded":"2024-09-12T19:26:55.690138+0000","last_fullsized":"2024-09-12T19:26:55.690138+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:22.466454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.244671+0000","last_change":"2024-09-12T18:25:52.624010+0000","last_active":"2024-09-12T19:26:35.244671+0000","last_peered":"2024-09-12T19:26:35.244671+0000","last_clean":"2024-09-12T19:26:35.244671+0000","last_became_active":"2024-09-12T18:25:52.623502+0000","last_became_peered":"2024-09-12T18:25:52.623502+0000","last_unstale":"2024-09-12T19:26:35.244671+0000","last_undegraded":"2024-09-12T19:26:35.244671+0000","last_fullsized":"2024-09-12T19:26:35.244671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:54.401588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'4","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.656813+0000","last_change":"2024-09-12T17:58:47.257454+0000","last_active":"2024-09-12T19:25:50.656813+0000","last_peered":"2024-09-12T19:25:50.656813+0000","last_clean":"2024-09-12T19:25:50.656813+0000","last_became_active":"2024-09-12T17:58:47.256721+0000","last_became_peered":"2024-09-12T17:58:47.256721+0000","last_unstale":"2024-09-12T19:25:50.656813+0000","last_undegraded":"2024-09-12T19:25:50.656813+0000","last_fullsized":"2024-09-12T19:25:50.656813+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:39.335691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8428753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":16424,"num_write":9,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'1","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.654552+0000","last_change":"2024-09-12T17:58:40.199627+0000","last_active":"2024-09-12T19:25:40.654552+0000","last_peered":"2024-09-12T19:25:40.654552+0000","last_clean":"2024-09-12T19:25:40.654552+0000","last_became_active":"2024-09-12T17:58:40.198765+0000","last_became_peered":"2024-09-12T17:58:40.198765+0000","last_unstale":"2024-09-12T19:25:40.654552+0000","last_undegraded":"2024-09-12T19:25:40.654552+0000","last_fullsized":"2024-09-12T19:25:40.654552+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:37.234886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'58","reported_seq":224,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671649+0000","last_change":"2024-09-12T17:52:39.886405+0000","last_active":"2024-09-12T19:26:55.671649+0000","last_peered":"2024-09-12T19:26:55.671649+0000","last_clean":"2024-09-12T19:26:55.671649+0000","last_became_active":"2024-09-12T17:52:39.885875+0000","last_became_peered":"2024-09-12T17:52:39.885875+0000","last_unstale":"2024-09-12T19:26:55.671649+0000","last_undegraded":"2024-09-12T19:26:55.671649+0000","last_fullsized":"2024-09-12T19:26:55.671649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:42.953403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":205,"num_write":103,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.596249+0000","last_change":"2024-09-12T18:25:52.618187+0000","last_active":"2024-09-12T19:26:35.596249+0000","last_peered":"2024-09-12T19:26:35.596249+0000","last_clean":"2024-09-12T19:26:35.596249+0000","last_became_active":"2024-09-12T18:25:52.617665+0000","last_became_peered":"2024-09-12T18:25:52.617665+0000","last_unstale":"2024-09-12T19:26:35.596249+0000","last_undegraded":"2024-09-12T19:26:35.596249+0000","last_fullsized":"2024-09-12T19:26:35.596249+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:16.143458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'5","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586974+0000","last_change":"2024-09-12T17:58:47.254576+0000","last_active":"2024-09-12T19:25:50.586974+0000","last_peered":"2024-09-12T19:25:50.586974+0000","last_clean":"2024-09-12T19:25:50.586974+0000","last_became_active":"2024-09-12T17:58:47.253819+0000","last_became_peered":"2024-09-12T17:58:47.253819+0000","last_unstale":"2024-09-12T19:25:50.586974+0000","last_undegraded":"2024-09-12T19:25:50.586974+0000","last_fullsized":"2024-09-12T19:25:50.586974+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:16.422570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.241886+0000","last_change":"2024-09-12T17:58:40.208386+0000","last_active":"2024-09-12T19:25:40.241886+0000","last_peered":"2024-09-12T19:25:40.241886+0000","last_clean":"2024-09-12T19:25:40.241886+0000","last_became_active":"2024-09-12T17:58:40.202790+0000","last_became_peered":"2024-09-12T17:58:40.202790+0000","last_unstale":"2024-09-12T19:25:40.241886+0000","last_undegraded":"2024-09-12T19:25:40.241886+0000","last_fullsized":"2024-09-12T19:25:40.241886+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:41.561154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'30","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:30.356662+0000","last_change":"2024-09-12T17:52:39.872248+0000","last_active":"2024-09-12T19:26:30.356662+0000","last_peered":"2024-09-12T19:26:30.356662+0000","last_clean":"2024-09-12T19:26:30.356662+0000","last_became_active":"2024-09-12T17:52:39.871009+0000","last_became_peered":"2024-09-12T17:52:39.871009+0000","last_unstale":"2024-09-12T19:26:30.356662+0000","last_undegraded":"2024-09-12T19:26:30.356662+0000","last_fullsized":"2024-09-12T19:26:30.356662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:36.952465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250730+0000","last_change":"2024-09-12T18:25:52.620335+0000","last_active":"2024-09-12T19:26:20.250730+0000","last_peered":"2024-09-12T19:26:20.250730+0000","last_clean":"2024-09-12T19:26:20.250730+0000","last_became_active":"2024-09-12T18:25:52.617863+0000","last_became_peered":"2024-09-12T18:25:52.617863+0000","last_unstale":"2024-09-12T19:26:20.250730+0000","last_undegraded":"2024-09-12T19:26:20.250730+0000","last_fullsized":"2024-09-12T19:26:20.250730+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:38.215652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"262'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.234651+0000","last_change":"2024-09-12T17:58:47.248615+0000","last_active":"2024-09-12T19:25:10.234651+0000","last_peered":"2024-09-12T19:25:10.234651+0000","last_clean":"2024-09-12T19:25:10.234651+0000","last_became_active":"2024-09-12T17:58:47.247475+0000","last_became_peered":"2024-09-12T17:58:47.247475+0000","last_unstale":"2024-09-12T19:25:10.234651+0000","last_undegraded":"2024-09-12T19:25:10.234651+0000","last_fullsized":"2024-09-12T19:25:10.234651+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:38.703200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"265'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097114+0000","last_change":"2024-09-12T17:58:40.203206+0000","last_active":"2024-09-12T19:27:20.097114+0000","last_peered":"2024-09-12T19:27:20.097114+0000","last_clean":"2024-09-12T19:27:20.097114+0000","last_became_active":"2024-09-12T17:58:40.202141+0000","last_became_peered":"2024-09-12T17:58:40.202141+0000","last_unstale":"2024-09-12T19:27:20.097114+0000","last_undegraded":"2024-09-12T19:27:20.097114+0000","last_fullsized":"2024-09-12T19:27:20.097114+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:09.764989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'22","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.349102+0000","last_change":"2024-09-12T17:52:39.885280+0000","last_active":"2024-09-12T19:26:00.349102+0000","last_peered":"2024-09-12T19:26:00.349102+0000","last_clean":"2024-09-12T19:26:00.349102+0000","last_became_active":"2024-09-12T17:52:39.884686+0000","last_became_peered":"2024-09-12T17:52:39.884686+0000","last_unstale":"2024-09-12T19:26:00.349102+0000","last_undegraded":"2024-09-12T19:26:00.349102+0000","last_fullsized":"2024-09-12T19:26:00.349102+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:49.000832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041069+0000","last_change":"2024-09-12T18:25:52.613926+0000","last_active":"2024-09-12T19:26:19.041069+0000","last_peered":"2024-09-12T19:26:19.041069+0000","last_clean":"2024-09-12T19:26:19.041069+0000","last_became_active":"2024-09-12T18:25:52.611450+0000","last_became_peered":"2024-09-12T18:25:52.611450+0000","last_unstale":"2024-09-12T19:26:19.041069+0000","last_undegraded":"2024-09-12T19:26:19.041069+0000","last_fullsized":"2024-09-12T19:26:19.041069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:02.885475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'2","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.234527+0000","last_change":"2024-09-12T17:58:47.254616+0000","last_active":"2024-09-12T19:25:10.234527+0000","last_peered":"2024-09-12T19:25:10.234527+0000","last_clean":"2024-09-12T19:25:10.234527+0000","last_became_active":"2024-09-12T17:58:47.254061+0000","last_became_peered":"2024-09-12T17:58:47.254061+0000","last_unstale":"2024-09-12T19:25:10.234527+0000","last_undegraded":"2024-09-12T19:25:10.234527+0000","last_fullsized":"2024-09-12T19:25:10.234527+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:06.779952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'1","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.264682+0000","last_change":"2024-09-12T17:58:40.203937+0000","last_active":"2024-09-12T19:27:20.264682+0000","last_peered":"2024-09-12T19:27:20.264682+0000","last_clean":"2024-09-12T19:27:20.264682+0000","last_became_active":"2024-09-12T17:58:40.203144+0000","last_became_peered":"2024-09-12T17:58:40.203144+0000","last_unstale":"2024-09-12T19:27:20.264682+0000","last_undegraded":"2024-09-12T19:27:20.264682+0000","last_fullsized":"2024-09-12T19:27:20.264682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:57.360002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"262'16","reported_seq":117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.658972+0000","last_change":"2024-09-12T17:52:39.879536+0000","last_active":"2024-09-12T19:26:00.658972+0000","last_peered":"2024-09-12T19:26:00.658972+0000","last_clean":"2024-09-12T19:26:00.658972+0000","last_became_active":"2024-09-12T17:52:39.878797+0000","last_became_peered":"2024-09-12T17:52:39.878797+0000","last_unstale":"2024-09-12T19:26:00.658972+0000","last_undegraded":"2024-09-12T19:26:00.658972+0000","last_fullsized":"2024-09-12T19:26:00.658972+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:15.860760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.687851+0000","last_change":"2024-09-12T18:25:52.615680+0000","last_active":"2024-09-12T19:26:45.687851+0000","last_peered":"2024-09-12T19:26:45.687851+0000","last_clean":"2024-09-12T19:26:45.687851+0000","last_became_active":"2024-09-12T18:25:52.614949+0000","last_became_peered":"2024-09-12T18:25:52.614949+0000","last_unstale":"2024-09-12T19:26:45.687851+0000","last_undegraded":"2024-09-12T19:26:45.687851+0000","last_fullsized":"2024-09-12T19:26:45.687851+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:20.554312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.647849+0000","last_change":"2024-09-12T17:58:47.247578+0000","last_active":"2024-09-12T19:25:10.647849+0000","last_peered":"2024-09-12T19:25:10.647849+0000","last_clean":"2024-09-12T19:25:10.647849+0000","last_became_active":"2024-09-12T17:58:47.246916+0000","last_became_peered":"2024-09-12T17:58:47.246916+0000","last_unstale":"2024-09-12T19:25:10.647849+0000","last_undegraded":"2024-09-12T19:25:10.647849+0000","last_fullsized":"2024-09-12T19:25:10.647849+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.850549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"262'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097274+0000","last_change":"2024-09-12T17:58:40.208435+0000","last_active":"2024-09-12T19:27:20.097274+0000","last_peered":"2024-09-12T19:27:20.097274+0000","last_clean":"2024-09-12T19:27:20.097274+0000","last_became_active":"2024-09-12T17:58:40.207311+0000","last_became_peered":"2024-09-12T17:58:40.207311+0000","last_unstale":"2024-09-12T19:27:20.097274+0000","last_undegraded":"2024-09-12T19:27:20.097274+0000","last_fullsized":"2024-09-12T19:27:20.097274+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:09.258846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'29","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.236763+0000","last_change":"2024-09-12T17:52:39.867898+0000","last_active":"2024-09-12T19:26:00.236763+0000","last_peered":"2024-09-12T19:26:00.236763+0000","last_clean":"2024-09-12T19:26:00.236763+0000","last_became_active":"2024-09-12T17:52:39.867179+0000","last_became_peered":"2024-09-12T17:52:39.867179+0000","last_unstale":"2024-09-12T19:26:00.236763+0000","last_undegraded":"2024-09-12T19:26:00.236763+0000","last_fullsized":"2024-09-12T19:26:00.236763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:01.169877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":56,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041017+0000","last_change":"2024-09-12T18:25:52.612961+0000","last_active":"2024-09-12T19:26:19.041017+0000","last_peered":"2024-09-12T19:26:19.041017+0000","last_clean":"2024-09-12T19:26:19.041017+0000","last_became_active":"2024-09-12T18:25:52.610587+0000","last_became_peered":"2024-09-12T18:25:52.610587+0000","last_unstale":"2024-09-12T19:26:19.041017+0000","last_undegraded":"2024-09-12T19:26:19.041017+0000","last_fullsized":"2024-09-12T19:26:19.041017+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:48.847349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.336407+0000","last_change":"2024-09-12T17:58:47.251206+0000","last_active":"2024-09-12T19:25:10.336407+0000","last_peered":"2024-09-12T19:25:10.336407+0000","last_clean":"2024-09-12T19:25:10.336407+0000","last_became_active":"2024-09-12T17:58:47.245601+0000","last_became_peered":"2024-09-12T17:58:47.245601+0000","last_unstale":"2024-09-12T19:25:10.336407+0000","last_undegraded":"2024-09-12T19:25:10.336407+0000","last_fullsized":"2024-09-12T19:25:10.336407+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:19.101729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097320+0000","last_change":"2024-09-12T17:58:40.203425+0000","last_active":"2024-09-12T19:27:20.097320+0000","last_peered":"2024-09-12T19:27:20.097320+0000","last_clean":"2024-09-12T19:27:20.097320+0000","last_became_active":"2024-09-12T17:58:40.202408+0000","last_became_peered":"2024-09-12T17:58:40.202408+0000","last_unstale":"2024-09-12T19:27:20.097320+0000","last_undegraded":"2024-09-12T19:27:20.097320+0000","last_fullsized":"2024-09-12T19:27:20.097320+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:04.410943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":531,"num_write":4,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'108","reported_seq":441,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.658909+0000","last_change":"2024-09-12T17:52:39.881369+0000","last_active":"2024-09-12T19:26:00.658909+0000","last_peered":"2024-09-12T19:26:00.658909+0000","last_clean":"2024-09-12T19:26:00.658909+0000","last_became_active":"2024-09-12T17:52:39.880742+0000","last_became_peered":"2024-09-12T17:52:39.880742+0000","last_unstale":"2024-09-12T19:26:00.658909+0000","last_undegraded":"2024-09-12T19:26:00.658909+0000","last_fullsized":"2024-09-12T19:26:00.658909+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:12.083548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":720,"num_read_kb":486,"num_write":145,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258684+0000","last_change":"2024-09-12T18:25:52.605986+0000","last_active":"2024-09-12T19:26:55.258684+0000","last_peered":"2024-09-12T19:26:55.258684+0000","last_clean":"2024-09-12T19:26:55.258684+0000","last_became_active":"2024-09-12T18:25:52.605039+0000","last_became_peered":"2024-09-12T18:25:52.605039+0000","last_unstale":"2024-09-12T19:26:55.258684+0000","last_undegraded":"2024-09-12T19:26:55.258684+0000","last_fullsized":"2024-09-12T19:26:55.258684+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.770637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'6","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667072+0000","last_change":"2024-09-12T17:58:47.242884+0000","last_active":"2024-09-12T19:26:35.667072+0000","last_peered":"2024-09-12T19:26:35.667072+0000","last_clean":"2024-09-12T19:26:35.667072+0000","last_became_active":"2024-09-12T17:58:47.241778+0000","last_became_peered":"2024-09-12T17:58:47.241778+0000","last_unstale":"2024-09-12T19:26:35.667072+0000","last_undegraded":"2024-09-12T19:26:35.667072+0000","last_fullsized":"2024-09-12T19:26:35.667072+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:36.555666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":3074,"num_write":11,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242718+0000","last_change":"2024-09-12T17:58:40.196234+0000","last_active":"2024-09-12T19:26:25.242718+0000","last_peered":"2024-09-12T19:26:25.242718+0000","last_clean":"2024-09-12T19:26:25.242718+0000","last_became_active":"2024-09-12T17:58:40.195309+0000","last_became_peered":"2024-09-12T17:58:40.195309+0000","last_unstale":"2024-09-12T19:26:25.242718+0000","last_undegraded":"2024-09-12T19:26:25.242718+0000","last_fullsized":"2024-09-12T19:26:25.242718+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:30.098876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"262'110","reported_seq":458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:25.678784+0000","last_change":"2024-09-12T17:52:39.886824+0000","last_active":"2024-09-12T19:27:25.678784+0000","last_peered":"2024-09-12T19:27:25.678784+0000","last_clean":"2024-09-12T19:27:25.678784+0000","last_became_active":"2024-09-12T17:52:39.886185+0000","last_became_peered":"2024-09-12T17:52:39.886185+0000","last_unstale":"2024-09-12T19:27:25.678784+0000","last_undegraded":"2024-09-12T19:27:25.678784+0000","last_fullsized":"2024-09-12T19:27:25.678784+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:31.714670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":756,"num_read_kb":514,"num_write":140,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.088040+0000","last_change":"2024-09-12T18:25:52.624391+0000","last_active":"2024-09-12T19:26:40.088040+0000","last_peered":"2024-09-12T19:26:40.088040+0000","last_clean":"2024-09-12T19:26:40.088040+0000","last_became_active":"2024-09-12T18:25:52.623444+0000","last_became_peered":"2024-09-12T18:25:52.623444+0000","last_unstale":"2024-09-12T19:26:40.088040+0000","last_undegraded":"2024-09-12T19:26:40.088040+0000","last_fullsized":"2024-09-12T19:26:40.088040+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:41.418750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667006+0000","last_change":"2024-09-12T17:58:47.255347+0000","last_active":"2024-09-12T19:26:35.667006+0000","last_peered":"2024-09-12T19:26:35.667006+0000","last_clean":"2024-09-12T19:26:35.667006+0000","last_became_active":"2024-09-12T17:58:47.254273+0000","last_became_peered":"2024-09-12T17:58:47.254273+0000","last_unstale":"2024-09-12T19:26:35.667006+0000","last_undegraded":"2024-09-12T19:26:35.667006+0000","last_fullsized":"2024-09-12T19:26:35.667006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:34.502761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'1","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:24.042159+0000","last_change":"2024-09-12T17:58:40.202847+0000","last_active":"2024-09-12T19:26:24.042159+0000","last_peered":"2024-09-12T19:26:24.042159+0000","last_clean":"2024-09-12T19:26:24.042159+0000","last_became_active":"2024-09-12T17:58:40.202027+0000","last_became_peered":"2024-09-12T17:58:40.202027+0000","last_unstale":"2024-09-12T19:26:24.042159+0000","last_undegraded":"2024-09-12T19:26:24.042159+0000","last_fullsized":"2024-09-12T19:26:24.042159+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:12.912226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'31","reported_seq":153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366551+0000","last_change":"2024-09-12T17:52:39.877904+0000","last_active":"2024-09-12T19:27:10.366551+0000","last_peered":"2024-09-12T19:27:10.366551+0000","last_clean":"2024-09-12T19:27:10.366551+0000","last_became_active":"2024-09-12T17:52:39.877206+0000","last_became_peered":"2024-09-12T17:52:39.877206+0000","last_unstale":"2024-09-12T19:27:10.366551+0000","last_undegraded":"2024-09-12T19:27:10.366551+0000","last_fullsized":"2024-09-12T19:27:10.366551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.931327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":97,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.357743+0000","last_change":"2024-09-12T18:25:52.620716+0000","last_active":"2024-09-12T19:26:35.357743+0000","last_peered":"2024-09-12T19:26:35.357743+0000","last_clean":"2024-09-12T19:26:35.357743+0000","last_became_active":"2024-09-12T18:25:52.620045+0000","last_became_peered":"2024-09-12T18:25:52.620045+0000","last_unstale":"2024-09-12T19:26:35.357743+0000","last_undegraded":"2024-09-12T19:26:35.357743+0000","last_fullsized":"2024-09-12T19:26:35.357743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:58.464498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670475+0000","last_change":"2024-09-12T17:58:47.253752+0000","last_active":"2024-09-12T19:26:50.670475+0000","last_peered":"2024-09-12T19:26:50.670475+0000","last_clean":"2024-09-12T19:26:50.670475+0000","last_became_active":"2024-09-12T17:58:47.252966+0000","last_became_peered":"2024-09-12T17:58:47.252966+0000","last_unstale":"2024-09-12T19:26:50.670475+0000","last_undegraded":"2024-09-12T19:26:50.670475+0000","last_fullsized":"2024-09-12T19:26:50.670475+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:12.503210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664783+0000","last_change":"2024-09-12T17:58:40.198879+0000","last_active":"2024-09-12T19:26:25.664783+0000","last_peered":"2024-09-12T19:26:25.664783+0000","last_clean":"2024-09-12T19:26:25.664783+0000","last_became_active":"2024-09-12T17:58:40.198161+0000","last_became_peered":"2024-09-12T17:58:40.198161+0000","last_unstale":"2024-09-12T19:26:25.664783+0000","last_undegraded":"2024-09-12T19:26:25.664783+0000","last_fullsized":"2024-09-12T19:26:25.664783+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:50.706791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":11,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'31","reported_seq":154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.094779+0000","last_change":"2024-09-12T17:52:39.867437+0000","last_active":"2024-09-12T19:27:10.094779+0000","last_peered":"2024-09-12T19:27:10.094779+0000","last_clean":"2024-09-12T19:27:10.094779+0000","last_became_active":"2024-09-12T17:52:39.866342+0000","last_became_peered":"2024-09-12T17:52:39.866342+0000","last_unstale":"2024-09-12T19:27:10.094779+0000","last_undegraded":"2024-09-12T19:27:10.094779+0000","last_fullsized":"2024-09-12T19:27:10.094779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:36.550336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":107,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.086529+0000","last_change":"2024-09-12T18:25:52.601482+0000","last_active":"2024-09-12T19:26:35.086529+0000","last_peered":"2024-09-12T19:26:35.086529+0000","last_clean":"2024-09-12T19:26:35.086529+0000","last_became_active":"2024-09-12T18:25:52.599679+0000","last_became_peered":"2024-09-12T18:25:52.599679+0000","last_unstale":"2024-09-12T19:26:35.086529+0000","last_undegraded":"2024-09-12T19:26:35.086529+0000","last_fullsized":"2024-09-12T19:26:35.086529+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:02.845957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'1","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254188+0000","last_change":"2024-09-12T17:58:47.256589+0000","last_active":"2024-09-12T19:26:35.254188+0000","last_peered":"2024-09-12T19:26:35.254188+0000","last_clean":"2024-09-12T19:26:35.254188+0000","last_became_active":"2024-09-12T17:58:47.255891+0000","last_became_peered":"2024-09-12T17:58:47.255891+0000","last_unstale":"2024-09-12T19:26:35.254188+0000","last_undegraded":"2024-09-12T19:26:35.254188+0000","last_fullsized":"2024-09-12T19:26:35.254188+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:52.933367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"262'3","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668287+0000","last_change":"2024-09-12T17:58:40.212187+0000","last_active":"2024-09-12T19:26:40.668287+0000","last_peered":"2024-09-12T19:26:40.668287+0000","last_clean":"2024-09-12T19:26:40.668287+0000","last_became_active":"2024-09-12T17:58:40.211450+0000","last_became_peered":"2024-09-12T17:58:40.211450+0000","last_unstale":"2024-09-12T19:26:40.668287+0000","last_undegraded":"2024-09-12T19:26:40.668287+0000","last_fullsized":"2024-09-12T19:26:40.668287+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:21.169200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'25","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:09.052206+0000","last_change":"2024-09-12T17:52:39.866705+0000","last_active":"2024-09-12T19:27:09.052206+0000","last_peered":"2024-09-12T19:27:09.052206+0000","last_clean":"2024-09-12T19:27:09.052206+0000","last_became_active":"2024-09-12T17:52:39.865914+0000","last_became_peered":"2024-09-12T17:52:39.865914+0000","last_unstale":"2024-09-12T19:27:09.052206+0000","last_undegraded":"2024-09-12T19:27:09.052206+0000","last_fullsized":"2024-09-12T19:27:09.052206+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:43.382459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255364+0000","last_change":"2024-09-12T18:25:52.613354+0000","last_active":"2024-09-12T19:26:40.255364+0000","last_peered":"2024-09-12T19:26:40.255364+0000","last_clean":"2024-09-12T19:26:40.255364+0000","last_became_active":"2024-09-12T18:25:52.612421+0000","last_became_peered":"2024-09-12T18:25:52.612421+0000","last_unstale":"2024-09-12T19:26:40.255364+0000","last_undegraded":"2024-09-12T19:26:40.255364+0000","last_fullsized":"2024-09-12T19:26:40.255364+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:29.095745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'1","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.341378+0000","last_change":"2024-09-12T17:58:47.246522+0000","last_active":"2024-09-12T19:25:30.341378+0000","last_peered":"2024-09-12T19:25:30.341378+0000","last_clean":"2024-09-12T19:25:30.341378+0000","last_became_active":"2024-09-12T17:58:47.238172+0000","last_became_peered":"2024-09-12T17:58:47.238172+0000","last_unstale":"2024-09-12T19:25:30.341378+0000","last_undegraded":"2024-09-12T19:25:30.341378+0000","last_fullsized":"2024-09-12T19:25:30.341378+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:56.402000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.679708+0000","last_change":"2024-09-12T17:58:40.194862+0000","last_active":"2024-09-12T19:27:30.679708+0000","last_peered":"2024-09-12T19:27:30.679708+0000","last_clean":"2024-09-12T19:27:30.679708+0000","last_became_active":"2024-09-12T17:58:40.194093+0000","last_became_peered":"2024-09-12T17:58:40.194093+0000","last_unstale":"2024-09-12T19:27:30.679708+0000","last_undegraded":"2024-09-12T19:27:30.679708+0000","last_fullsized":"2024-09-12T19:27:30.679708+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:55.158370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'38","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:09.052156+0000","last_change":"2024-09-12T17:52:39.888669+0000","last_active":"2024-09-12T19:27:09.052156+0000","last_peered":"2024-09-12T19:27:09.052156+0000","last_clean":"2024-09-12T19:27:09.052156+0000","last_became_active":"2024-09-12T17:52:39.887302+0000","last_became_peered":"2024-09-12T17:52:39.887302+0000","last_unstale":"2024-09-12T19:27:09.052156+0000","last_undegraded":"2024-09-12T19:27:09.052156+0000","last_fullsized":"2024-09-12T19:27:09.052156+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:45.562829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":146,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249879+0000","last_change":"2024-09-12T18:25:52.611745+0000","last_active":"2024-09-12T19:27:00.249879+0000","last_peered":"2024-09-12T19:27:00.249879+0000","last_clean":"2024-09-12T19:27:00.249879+0000","last_became_active":"2024-09-12T18:25:52.611022+0000","last_became_peered":"2024-09-12T18:25:52.611022+0000","last_unstale":"2024-09-12T19:27:00.249879+0000","last_undegraded":"2024-09-12T19:27:00.249879+0000","last_fullsized":"2024-09-12T19:27:00.249879+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:05.067276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"262'5","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.230402+0000","last_change":"2024-09-12T17:58:47.248839+0000","last_active":"2024-09-12T19:25:30.230402+0000","last_peered":"2024-09-12T19:25:30.230402+0000","last_clean":"2024-09-12T19:25:30.230402+0000","last_became_active":"2024-09-12T17:58:47.247599+0000","last_became_peered":"2024-09-12T17:58:47.247599+0000","last_unstale":"2024-09-12T19:25:30.230402+0000","last_undegraded":"2024-09-12T19:25:30.230402+0000","last_fullsized":"2024-09-12T19:25:30.230402+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:14.680201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.267041+0000","last_change":"2024-09-12T17:58:40.203966+0000","last_active":"2024-09-12T19:27:30.267041+0000","last_peered":"2024-09-12T19:27:30.267041+0000","last_clean":"2024-09-12T19:27:30.267041+0000","last_became_active":"2024-09-12T17:58:40.203177+0000","last_became_peered":"2024-09-12T17:58:40.203177+0000","last_unstale":"2024-09-12T19:27:30.267041+0000","last_undegraded":"2024-09-12T19:27:30.267041+0000","last_fullsized":"2024-09-12T19:27:30.267041+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:05.344996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'30","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.240017+0000","last_change":"2024-09-12T17:52:39.878505+0000","last_active":"2024-09-12T19:26:15.240017+0000","last_peered":"2024-09-12T19:26:15.240017+0000","last_clean":"2024-09-12T19:26:15.240017+0000","last_became_active":"2024-09-12T17:52:39.877793+0000","last_became_peered":"2024-09-12T17:52:39.877793+0000","last_unstale":"2024-09-12T19:26:15.240017+0000","last_undegraded":"2024-09-12T19:26:15.240017+0000","last_fullsized":"2024-09-12T19:26:15.240017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:26.899906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.597487+0000","last_change":"2024-09-12T18:25:52.618530+0000","last_active":"2024-09-12T19:26:40.597487+0000","last_peered":"2024-09-12T19:26:40.597487+0000","last_clean":"2024-09-12T19:26:40.597487+0000","last_became_active":"2024-09-12T18:25:52.617815+0000","last_became_peered":"2024-09-12T18:25:52.617815+0000","last_unstale":"2024-09-12T19:26:40.597487+0000","last_undegraded":"2024-09-12T19:26:40.597487+0000","last_fullsized":"2024-09-12T19:26:40.597487+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:26.125712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:34.044128+0000","last_change":"2024-09-12T17:58:47.257576+0000","last_active":"2024-09-12T19:26:34.044128+0000","last_peered":"2024-09-12T19:26:34.044128+0000","last_clean":"2024-09-12T19:26:34.044128+0000","last_became_active":"2024-09-12T17:58:47.256924+0000","last_became_peered":"2024-09-12T17:58:47.256924+0000","last_unstale":"2024-09-12T19:26:34.044128+0000","last_undegraded":"2024-09-12T19:26:34.044128+0000","last_fullsized":"2024-09-12T19:26:34.044128+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:39.738133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:35.653357+0000","last_change":"2024-09-12T17:58:40.194527+0000","last_active":"2024-09-12T19:25:35.653357+0000","last_peered":"2024-09-12T19:25:35.653357+0000","last_clean":"2024-09-12T19:25:35.653357+0000","last_became_active":"2024-09-12T17:58:40.193786+0000","last_became_peered":"2024-09-12T17:58:40.193786+0000","last_unstale":"2024-09-12T19:25:35.653357+0000","last_undegraded":"2024-09-12T19:25:35.653357+0000","last_fullsized":"2024-09-12T19:25:35.653357+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:14.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'23","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.243911+0000","last_change":"2024-09-12T17:52:39.875927+0000","last_active":"2024-09-12T19:25:50.243911+0000","last_peered":"2024-09-12T19:25:50.243911+0000","last_clean":"2024-09-12T19:25:50.243911+0000","last_became_active":"2024-09-12T17:52:39.869627+0000","last_became_peered":"2024-09-12T17:52:39.869627+0000","last_unstale":"2024-09-12T19:25:50.243911+0000","last_undegraded":"2024-09-12T19:25:50.243911+0000","last_fullsized":"2024-09-12T19:25:50.243911+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.817489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":43,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668164+0000","last_change":"2024-09-12T18:25:52.624807+0000","last_active":"2024-09-12T19:26:40.668164+0000","last_peered":"2024-09-12T19:26:40.668164+0000","last_clean":"2024-09-12T19:26:40.668164+0000","last_became_active":"2024-09-12T18:25:52.624296+0000","last_became_peered":"2024-09-12T18:25:52.624296+0000","last_unstale":"2024-09-12T19:26:40.668164+0000","last_undegraded":"2024-09-12T19:26:40.668164+0000","last_fullsized":"2024-09-12T19:26:40.668164+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:35.580294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"265'7","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586846+0000","last_change":"2024-09-12T17:58:47.244823+0000","last_active":"2024-09-12T19:25:50.586846+0000","last_peered":"2024-09-12T19:25:50.586846+0000","last_clean":"2024-09-12T19:25:50.586846+0000","last_became_active":"2024-09-12T17:58:47.242874+0000","last_became_peered":"2024-09-12T17:58:47.242874+0000","last_unstale":"2024-09-12T19:25:50.586846+0000","last_undegraded":"2024-09-12T19:25:50.586846+0000","last_fullsized":"2024-09-12T19:25:50.586846+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:49.961011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":9787,"num_write":7,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'4","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355417+0000","last_change":"2024-09-12T17:58:40.175758+0000","last_active":"2024-09-12T19:26:25.355417+0000","last_peered":"2024-09-12T19:26:25.355417+0000","last_clean":"2024-09-12T19:26:25.355417+0000","last_became_active":"2024-09-12T17:58:40.175011+0000","last_became_peered":"2024-09-12T17:58:40.175011+0000","last_unstale":"2024-09-12T19:26:25.355417+0000","last_undegraded":"2024-09-12T19:26:25.355417+0000","last_fullsized":"2024-09-12T19:26:25.355417+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:29.337157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'56","reported_seq":233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586722+0000","last_change":"2024-09-12T17:52:39.885688+0000","last_active":"2024-09-12T19:25:50.586722+0000","last_peered":"2024-09-12T19:25:50.586722+0000","last_clean":"2024-09-12T19:25:50.586722+0000","last_became_active":"2024-09-12T17:52:39.884599+0000","last_became_peered":"2024-09-12T17:52:39.884599+0000","last_unstale":"2024-09-12T19:25:50.586722+0000","last_undegraded":"2024-09-12T19:25:50.586722+0000","last_fullsized":"2024-09-12T19:25:50.586722+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:48.524948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":231,"num_write":89,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.592964+0000","last_change":"2024-09-12T18:25:52.603197+0000","last_active":"2024-09-12T19:26:20.592964+0000","last_peered":"2024-09-12T19:26:20.592964+0000","last_clean":"2024-09-12T19:26:20.592964+0000","last_became_active":"2024-09-12T18:25:52.602495+0000","last_became_peered":"2024-09-12T18:25:52.602495+0000","last_unstale":"2024-09-12T19:26:20.592964+0000","last_undegraded":"2024-09-12T19:26:20.592964+0000","last_fullsized":"2024-09-12T19:26:20.592964+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:36.706795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'10","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.256474+0000","last_change":"2024-09-12T17:58:47.255006+0000","last_active":"2024-09-12T19:26:45.256474+0000","last_peered":"2024-09-12T19:26:45.256474+0000","last_clean":"2024-09-12T19:26:45.256474+0000","last_became_active":"2024-09-12T17:58:47.254272+0000","last_became_peered":"2024-09-12T17:58:47.254272+0000","last_unstale":"2024-09-12T19:26:45.256474+0000","last_undegraded":"2024-09-12T19:26:45.256474+0000","last_fullsized":"2024-09-12T19:26:45.256474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:11.620938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":26626,"num_write":20,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'5","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.351504+0000","last_change":"2024-09-12T17:58:40.195873+0000","last_active":"2024-09-12T19:26:10.351504+0000","last_peered":"2024-09-12T19:26:10.351504+0000","last_clean":"2024-09-12T19:26:10.351504+0000","last_became_active":"2024-09-12T17:58:40.195089+0000","last_became_peered":"2024-09-12T17:58:40.195089+0000","last_unstale":"2024-09-12T19:26:10.351504+0000","last_undegraded":"2024-09-12T19:26:10.351504+0000","last_fullsized":"2024-09-12T19:26:10.351504+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.723902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":5,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'27","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.675603+0000","last_change":"2024-09-12T17:52:39.868988+0000","last_active":"2024-09-12T19:25:50.675603+0000","last_peered":"2024-09-12T19:25:50.675603+0000","last_clean":"2024-09-12T19:25:50.675603+0000","last_became_active":"2024-09-12T17:52:39.867605+0000","last_became_peered":"2024-09-12T17:52:39.867605+0000","last_unstale":"2024-09-12T19:25:50.675603+0000","last_undegraded":"2024-09-12T19:25:50.675603+0000","last_fullsized":"2024-09-12T19:25:50.675603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:31.849687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":99,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.592985+0000","last_change":"2024-09-12T18:25:52.615107+0000","last_active":"2024-09-12T19:26:20.592985+0000","last_peered":"2024-09-12T19:26:20.592985+0000","last_clean":"2024-09-12T19:26:20.592985+0000","last_became_active":"2024-09-12T18:25:52.614383+0000","last_became_peered":"2024-09-12T18:25:52.614383+0000","last_unstale":"2024-09-12T19:26:20.592985+0000","last_undegraded":"2024-09-12T19:26:20.592985+0000","last_fullsized":"2024-09-12T19:26:20.592985+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:02.087383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"265'3","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250677+0000","last_change":"2024-09-12T17:58:47.249774+0000","last_active":"2024-09-12T19:26:20.250677+0000","last_peered":"2024-09-12T19:26:20.250677+0000","last_clean":"2024-09-12T19:26:20.250677+0000","last_became_active":"2024-09-12T17:58:47.248924+0000","last_became_peered":"2024-09-12T17:58:47.248924+0000","last_unstale":"2024-09-12T19:26:20.250677+0000","last_undegraded":"2024-09-12T19:26:20.250677+0000","last_fullsized":"2024-09-12T19:26:20.250677+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.643262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:30.684425+0000","last_change":"2024-09-12T17:58:40.188344+0000","last_active":"2024-09-12T19:26:30.684425+0000","last_peered":"2024-09-12T19:26:30.684425+0000","last_clean":"2024-09-12T19:26:30.684425+0000","last_became_active":"2024-09-12T17:58:40.187590+0000","last_became_peered":"2024-09-12T17:58:40.187590+0000","last_unstale":"2024-09-12T19:26:30.684425+0000","last_undegraded":"2024-09-12T19:26:30.684425+0000","last_fullsized":"2024-09-12T19:26:30.684425+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:15.651076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'13","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.346788+0000","last_change":"2024-09-12T17:52:39.881326+0000","last_active":"2024-09-12T19:25:50.346788+0000","last_peered":"2024-09-12T19:25:50.346788+0000","last_clean":"2024-09-12T19:25:50.346788+0000","last_became_active":"2024-09-12T17:52:39.872599+0000","last_became_peered":"2024-09-12T17:52:39.872599+0000","last_unstale":"2024-09-12T19:25:50.346788+0000","last_undegraded":"2024-09-12T19:25:50.346788+0000","last_fullsized":"2024-09-12T19:25:50.346788+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:37.156957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.249303+0000","last_change":"2024-09-12T18:25:52.612438+0000","last_active":"2024-09-12T19:26:15.249303+0000","last_peered":"2024-09-12T19:26:15.249303+0000","last_clean":"2024-09-12T19:26:15.249303+0000","last_became_active":"2024-09-12T18:25:52.611377+0000","last_became_peered":"2024-09-12T18:25:52.611377+0000","last_unstale":"2024-09-12T19:26:15.249303+0000","last_undegraded":"2024-09-12T19:26:15.249303+0000","last_fullsized":"2024-09-12T19:26:15.249303+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:57.823730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'1","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.582729+0000","last_change":"2024-09-12T17:58:47.243005+0000","last_active":"2024-09-12T19:25:30.582729+0000","last_peered":"2024-09-12T19:25:30.582729+0000","last_clean":"2024-09-12T19:25:30.582729+0000","last_became_active":"2024-09-12T17:58:47.242171+0000","last_became_peered":"2024-09-12T17:58:47.242171+0000","last_unstale":"2024-09-12T19:25:30.582729+0000","last_undegraded":"2024-09-12T19:25:30.582729+0000","last_fullsized":"2024-09-12T19:25:30.582729+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:43.801606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.256971+0000","last_change":"2024-09-12T17:58:40.211247+0000","last_active":"2024-09-12T19:27:30.256971+0000","last_peered":"2024-09-12T19:27:30.256971+0000","last_clean":"2024-09-12T19:27:30.256971+0000","last_became_active":"2024-09-12T17:58:40.210485+0000","last_became_peered":"2024-09-12T17:58:40.210485+0000","last_unstale":"2024-09-12T19:27:30.256971+0000","last_undegraded":"2024-09-12T19:27:30.256971+0000","last_fullsized":"2024-09-12T19:27:30.256971+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:45.166206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'25","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.248017+0000","last_change":"2024-09-12T17:52:39.880057+0000","last_active":"2024-09-12T19:26:50.248017+0000","last_peered":"2024-09-12T19:26:50.248017+0000","last_clean":"2024-09-12T19:26:50.248017+0000","last_became_active":"2024-09-12T17:52:39.868837+0000","last_became_peered":"2024-09-12T17:52:39.868837+0000","last_unstale":"2024-09-12T19:26:50.248017+0000","last_undegraded":"2024-09-12T19:26:50.248017+0000","last_fullsized":"2024-09-12T19:26:50.248017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.133723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.353905+0000","last_change":"2024-09-12T18:25:52.615446+0000","last_active":"2024-09-12T19:26:20.353905+0000","last_peered":"2024-09-12T19:26:20.353905+0000","last_clean":"2024-09-12T19:26:20.353905+0000","last_became_active":"2024-09-12T18:25:52.611546+0000","last_became_peered":"2024-09-12T18:25:52.611546+0000","last_unstale":"2024-09-12T19:26:20.353905+0000","last_undegraded":"2024-09-12T19:26:20.353905+0000","last_fullsized":"2024-09-12T19:26:20.353905+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:59.006168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'5","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.341672+0000","last_change":"2024-09-12T17:58:47.246295+0000","last_active":"2024-09-12T19:25:30.341672+0000","last_peered":"2024-09-12T19:25:30.341672+0000","last_clean":"2024-09-12T19:25:30.341672+0000","last_became_active":"2024-09-12T17:58:47.245441+0000","last_became_peered":"2024-09-12T17:58:47.245441+0000","last_unstale":"2024-09-12T19:25:30.341672+0000","last_undegraded":"2024-09-12T19:25:30.341672+0000","last_fullsized":"2024-09-12T19:25:30.341672+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:06.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'6","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.371312+0000","last_change":"2024-09-12T17:58:40.192872+0000","last_active":"2024-09-12T19:27:30.371312+0000","last_peered":"2024-09-12T19:27:30.371312+0000","last_clean":"2024-09-12T19:27:30.371312+0000","last_became_active":"2024-09-12T17:58:40.191999+0000","last_became_peered":"2024-09-12T17:58:40.191999+0000","last_unstale":"2024-09-12T19:27:30.371312+0000","last_undegraded":"2024-09-12T19:27:30.371312+0000","last_fullsized":"2024-09-12T19:27:30.371312+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.003714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":18434,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'36","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664694+0000","last_change":"2024-09-12T17:52:39.891322+0000","last_active":"2024-09-12T19:26:25.664694+0000","last_peered":"2024-09-12T19:26:25.664694+0000","last_clean":"2024-09-12T19:26:25.664694+0000","last_became_active":"2024-09-12T17:52:39.890678+0000","last_became_peered":"2024-09-12T17:52:39.890678+0000","last_unstale":"2024-09-12T19:26:25.664694+0000","last_undegraded":"2024-09-12T19:26:25.664694+0000","last_fullsized":"2024-09-12T19:26:25.664694+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:49.955143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667105+0000","last_change":"2024-09-12T18:25:52.612356+0000","last_active":"2024-09-12T19:26:35.667105+0000","last_peered":"2024-09-12T19:26:35.667105+0000","last_clean":"2024-09-12T19:26:35.667105+0000","last_became_active":"2024-09-12T18:25:52.611397+0000","last_became_peered":"2024-09-12T18:25:52.611397+0000","last_unstale":"2024-09-12T19:26:35.667105+0000","last_undegraded":"2024-09-12T19:26:35.667105+0000","last_fullsized":"2024-09-12T19:26:35.667105+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:59.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.681982+0000","last_change":"2024-09-12T17:58:47.241676+0000","last_active":"2024-09-12T19:26:20.681982+0000","last_peered":"2024-09-12T19:26:20.681982+0000","last_clean":"2024-09-12T19:26:20.681982+0000","last_became_active":"2024-09-12T17:58:47.240951+0000","last_became_peered":"2024-09-12T17:58:47.240951+0000","last_unstale":"2024-09-12T19:26:20.681982+0000","last_undegraded":"2024-09-12T19:26:20.681982+0000","last_fullsized":"2024-09-12T19:26:20.681982+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:38.662807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250717+0000","last_change":"2024-09-12T17:58:40.212464+0000","last_active":"2024-09-12T19:27:05.250717+0000","last_peered":"2024-09-12T19:27:05.250717+0000","last_clean":"2024-09-12T19:27:05.250717+0000","last_became_active":"2024-09-12T17:58:40.211891+0000","last_became_peered":"2024-09-12T17:58:40.211891+0000","last_unstale":"2024-09-12T19:27:05.250717+0000","last_undegraded":"2024-09-12T19:27:05.250717+0000","last_fullsized":"2024-09-12T19:27:05.250717+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:27.802674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'53","reported_seq":225,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242648+0000","last_change":"2024-09-12T17:52:39.879319+0000","last_active":"2024-09-12T19:26:25.242648+0000","last_peered":"2024-09-12T19:26:25.242648+0000","last_clean":"2024-09-12T19:26:25.242648+0000","last_became_active":"2024-09-12T17:52:39.878694+0000","last_became_peered":"2024-09-12T17:52:39.878694+0000","last_unstale":"2024-09-12T19:26:25.242648+0000","last_undegraded":"2024-09-12T19:26:25.242648+0000","last_fullsized":"2024-09-12T19:26:25.242648+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:48.298171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":199,"num_write":92,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.685676+0000","last_change":"2024-09-12T18:25:52.620080+0000","last_active":"2024-09-12T19:26:35.685676+0000","last_peered":"2024-09-12T19:26:35.685676+0000","last_clean":"2024-09-12T19:26:35.685676+0000","last_became_active":"2024-09-12T18:25:52.619540+0000","last_became_peered":"2024-09-12T18:25:52.619540+0000","last_unstale":"2024-09-12T19:26:35.685676+0000","last_undegraded":"2024-09-12T19:26:35.685676+0000","last_fullsized":"2024-09-12T19:26:35.685676+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:07.956389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368657+0000","last_change":"2024-09-12T17:58:47.245205+0000","last_active":"2024-09-12T19:27:20.368657+0000","last_peered":"2024-09-12T19:27:20.368657+0000","last_clean":"2024-09-12T19:27:20.368657+0000","last_became_active":"2024-09-12T17:58:47.238232+0000","last_became_peered":"2024-09-12T17:58:47.238232+0000","last_unstale":"2024-09-12T19:27:20.368657+0000","last_undegraded":"2024-09-12T19:27:20.368657+0000","last_fullsized":"2024-09-12T19:27:20.368657+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:59.889739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"262'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.351356+0000","last_change":"2024-09-12T17:58:40.198949+0000","last_active":"2024-09-12T19:26:10.351356+0000","last_peered":"2024-09-12T19:26:10.351356+0000","last_clean":"2024-09-12T19:26:10.351356+0000","last_became_active":"2024-09-12T17:58:40.197815+0000","last_became_peered":"2024-09-12T17:58:40.197815+0000","last_unstale":"2024-09-12T19:26:10.351356+0000","last_undegraded":"2024-09-12T19:26:10.351356+0000","last_fullsized":"2024-09-12T19:26:10.351356+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:15.963939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'72","reported_seq":273,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355384+0000","last_change":"2024-09-12T17:52:39.876517+0000","last_active":"2024-09-12T19:26:25.355384+0000","last_peered":"2024-09-12T19:26:25.355384+0000","last_clean":"2024-09-12T19:26:25.355384+0000","last_became_active":"2024-09-12T17:52:39.872148+0000","last_became_peered":"2024-09-12T17:52:39.872148+0000","last_unstale":"2024-09-12T19:26:25.355384+0000","last_undegraded":"2024-09-12T19:26:25.355384+0000","last_fullsized":"2024-09-12T19:26:25.355384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.681891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":261,"num_write":116,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250622+0000","last_change":"2024-09-12T18:25:52.624296+0000","last_active":"2024-09-12T19:26:20.250622+0000","last_peered":"2024-09-12T19:26:20.250622+0000","last_clean":"2024-09-12T19:26:20.250622+0000","last_became_active":"2024-09-12T18:25:52.623635+0000","last_became_peered":"2024-09-12T18:25:52.623635+0000","last_unstale":"2024-09-12T19:26:20.250622+0000","last_undegraded":"2024-09-12T19:26:20.250622+0000","last_fullsized":"2024-09-12T19:26:20.250622+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:13.996677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241344+0000","last_change":"2024-09-12T17:58:47.251669+0000","last_active":"2024-09-12T19:26:20.241344+0000","last_peered":"2024-09-12T19:26:20.241344+0000","last_clean":"2024-09-12T19:26:20.241344+0000","last_became_active":"2024-09-12T17:58:47.250762+0000","last_became_peered":"2024-09-12T17:58:47.250762+0000","last_unstale":"2024-09-12T19:26:20.241344+0000","last_undegraded":"2024-09-12T19:26:20.241344+0000","last_fullsized":"2024-09-12T19:26:20.241344+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:16.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9216,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:09.038722+0000","last_change":"2024-09-12T17:58:40.210753+0000","last_active":"2024-09-12T19:26:09.038722+0000","last_peered":"2024-09-12T19:26:09.038722+0000","last_clean":"2024-09-12T19:26:09.038722+0000","last_became_active":"2024-09-12T17:58:40.210072+0000","last_became_peered":"2024-09-12T17:58:40.210072+0000","last_unstale":"2024-09-12T19:26:09.038722+0000","last_undegraded":"2024-09-12T19:26:09.038722+0000","last_fullsized":"2024-09-12T19:26:09.038722+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.700767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'26","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355281+0000","last_change":"2024-09-12T17:52:39.872036+0000","last_active":"2024-09-12T19:26:25.355281+0000","last_peered":"2024-09-12T19:26:25.355281+0000","last_clean":"2024-09-12T19:26:25.355281+0000","last_became_active":"2024-09-12T17:52:39.871247+0000","last_became_peered":"2024-09-12T17:52:39.871247+0000","last_unstale":"2024-09-12T19:26:25.355281+0000","last_undegraded":"2024-09-12T19:26:25.355281+0000","last_fullsized":"2024-09-12T19:26:25.355281+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:34.468531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":46,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.359612+0000","last_change":"2024-09-12T18:25:52.622440+0000","last_active":"2024-09-12T19:26:40.359612+0000","last_peered":"2024-09-12T19:26:40.359612+0000","last_clean":"2024-09-12T19:26:40.359612+0000","last_became_active":"2024-09-12T18:25:52.621808+0000","last_became_peered":"2024-09-12T18:25:52.621808+0000","last_unstale":"2024-09-12T19:26:40.359612+0000","last_undegraded":"2024-09-12T19:26:40.359612+0000","last_fullsized":"2024-09-12T19:26:40.359612+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:05.559442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241274+0000","last_change":"2024-09-12T17:58:47.236975+0000","last_active":"2024-09-12T19:26:20.241274+0000","last_peered":"2024-09-12T19:26:20.241274+0000","last_clean":"2024-09-12T19:26:20.241274+0000","last_became_active":"2024-09-12T17:58:47.236237+0000","last_became_peered":"2024-09-12T17:58:47.236237+0000","last_unstale":"2024-09-12T19:26:20.241274+0000","last_undegraded":"2024-09-12T19:26:20.241274+0000","last_fullsized":"2024-09-12T19:26:20.241274+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:34.439221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'5","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.081308+0000","last_change":"2024-09-12T17:58:40.207822+0000","last_active":"2024-09-12T19:26:10.081308+0000","last_peered":"2024-09-12T19:26:10.081308+0000","last_clean":"2024-09-12T19:26:10.081308+0000","last_became_active":"2024-09-12T17:58:40.207179+0000","last_became_peered":"2024-09-12T17:58:40.207179+0000","last_unstale":"2024-09-12T19:26:10.081308+0000","last_undegraded":"2024-09-12T19:26:10.081308+0000","last_fullsized":"2024-09-12T19:26:10.081308+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:00.148566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":17408,"num_write":5,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'9","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250774+0000","last_change":"2024-09-12T17:52:39.884615+0000","last_active":"2024-09-12T19:27:05.250774+0000","last_peered":"2024-09-12T19:27:05.250774+0000","last_clean":"2024-09-12T19:27:05.250774+0000","last_became_active":"2024-09-12T17:52:39.883782+0000","last_became_peered":"2024-09-12T17:52:39.883782+0000","last_unstale":"2024-09-12T19:27:05.250774+0000","last_undegraded":"2024-09-12T19:27:05.250774+0000","last_fullsized":"2024-09-12T19:27:05.250774+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:22.293480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'271","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.602189+0000","last_change":"2024-09-12T17:36:34.874827+0000","last_active":"2024-09-12T19:27:00.602189+0000","last_peered":"2024-09-12T19:27:00.602189+0000","last_clean":"2024-09-12T19:27:00.602189+0000","last_became_active":"2024-09-12T17:36:34.874529+0000","last_became_peered":"2024-09-12T17:36:34.874529+0000","last_unstale":"2024-09-12T19:27:00.602189+0000","last_undegraded":"2024-09-12T19:27:00.602189+0000","last_fullsized":"2024-09-12T19:27:00.602189+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:19.340681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8048917,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":517,"num_read_kb":47675,"num_write":979,"num_write_kb":57869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'948","reported_seq":2619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.087864+0000","last_change":"2024-09-12T17:36:36.882005+0000","last_active":"2024-09-12T19:26:40.087864+0000","last_peered":"2024-09-12T19:26:40.087864+0000","last_clean":"2024-09-12T19:26:40.087864+0000","last_became_active":"2024-09-12T17:36:36.881586+0000","last_became_peered":"2024-09-12T17:36:36.881586+0000","last_unstale":"2024-09-12T19:26:40.087864+0000","last_undegraded":"2024-09-12T19:26:40.087864+0000","last_fullsized":"2024-09-12T19:26:40.087864+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:20.270667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4539,"num_read_kb":4030,"num_write":1302,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'293","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:12.742992+0000","last_change":"2024-09-12T17:36:34.886842+0000","last_active":"2024-09-12T19:29:12.742992+0000","last_peered":"2024-09-12T19:29:12.742992+0000","last_clean":"2024-09-12T19:29:12.742992+0000","last_became_active":"2024-09-12T17:36:34.886040+0000","last_became_peered":"2024-09-12T17:36:34.886040+0000","last_unstale":"2024-09-12T19:29:12.742992+0000","last_undegraded":"2024-09-12T19:29:12.742992+0000","last_fullsized":"2024-09-12T19:29:12.742992+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:53.879522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12510272,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":446,"num_read_kb":42118,"num_write":1045,"num_write_kb":49494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'796","reported_seq":2316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.047571+0000","last_change":"2024-09-12T17:36:36.875611+0000","last_active":"2024-09-12T19:29:21.047571+0000","last_peered":"2024-09-12T19:29:21.047571+0000","last_clean":"2024-09-12T19:29:21.047571+0000","last_became_active":"2024-09-12T17:36:36.875285+0000","last_became_peered":"2024-09-12T17:36:36.875285+0000","last_unstale":"2024-09-12T19:29:21.047571+0000","last_undegraded":"2024-09-12T19:29:21.047571+0000","last_fullsized":"2024-09-12T19:29:21.047571+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:54.905863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3836,"num_read_kb":3465,"num_write":1049,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'279","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.259977+0000","last_change":"2024-09-12T17:36:34.873831+0000","last_active":"2024-09-12T19:27:00.259977+0000","last_peered":"2024-09-12T19:27:00.259977+0000","last_clean":"2024-09-12T19:27:00.259977+0000","last_became_active":"2024-09-12T17:36:34.871993+0000","last_became_peered":"2024-09-12T17:36:34.871993+0000","last_unstale":"2024-09-12T19:27:00.259977+0000","last_undegraded":"2024-09-12T19:27:00.259977+0000","last_fullsized":"2024-09-12T19:27:00.259977+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:33.922670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334724,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":456,"num_read_kb":16147,"num_write":1004,"num_write_kb":33332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'911","reported_seq":2448,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:53.304327+0000","last_change":"2024-09-12T17:36:36.885378+0000","last_active":"2024-09-12T19:26:53.304327+0000","last_peered":"2024-09-12T19:26:53.304327+0000","last_clean":"2024-09-12T19:26:53.304327+0000","last_became_active":"2024-09-12T17:36:36.883008+0000","last_became_peered":"2024-09-12T17:36:36.883008+0000","last_unstale":"2024-09-12T19:26:53.304327+0000","last_undegraded":"2024-09-12T19:26:53.304327+0000","last_fullsized":"2024-09-12T19:26:53.304327+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":900,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:58.093073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4392,"num_read_kb":3928,"num_write":1272,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'279","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:13.693279+0000","last_change":"2024-09-12T17:36:34.871813+0000","last_active":"2024-09-12T19:29:13.693279+0000","last_peered":"2024-09-12T19:29:13.693279+0000","last_clean":"2024-09-12T19:29:13.693279+0000","last_became_active":"2024-09-12T17:36:34.871414+0000","last_became_peered":"2024-09-12T17:36:34.871414+0000","last_unstale":"2024-09-12T19:29:13.693279+0000","last_undegraded":"2024-09-12T19:29:13.693279+0000","last_fullsized":"2024-09-12T19:29:13.693279+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:37.103933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007944,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":426,"num_read_kb":53693,"num_write":1030,"num_write_kb":40210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'837","reported_seq":2343,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686623+0000","last_change":"2024-09-12T17:36:36.902897+0000","last_active":"2024-09-12T19:26:40.686623+0000","last_peered":"2024-09-12T19:26:40.686623+0000","last_clean":"2024-09-12T19:26:40.686623+0000","last_became_active":"2024-09-12T17:36:36.902241+0000","last_became_peered":"2024-09-12T17:36:36.902241+0000","last_unstale":"2024-09-12T19:26:40.686623+0000","last_undegraded":"2024-09-12T19:26:40.686623+0000","last_fullsized":"2024-09-12T19:26:40.686623+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:25.892315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3905,"num_read_kb":3484,"num_write":1127,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'291","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.588296+0000","last_change":"2024-09-12T17:36:34.890708+0000","last_active":"2024-09-12T19:27:00.588296+0000","last_peered":"2024-09-12T19:27:00.588296+0000","last_clean":"2024-09-12T19:27:00.588296+0000","last_became_active":"2024-09-12T17:36:34.890281+0000","last_became_peered":"2024-09-12T17:36:34.890281+0000","last_unstale":"2024-09-12T19:27:00.588296+0000","last_undegraded":"2024-09-12T19:27:00.588296+0000","last_fullsized":"2024-09-12T19:27:00.588296+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:59.249812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2458751,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":477,"num_read_kb":3791,"num_write":1103,"num_write_kb":30376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'481","reported_seq":2174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602973+0000","last_change":"2024-09-12T17:36:36.899570+0000","last_active":"2024-09-12T19:27:05.602973+0000","last_peered":"2024-09-12T19:27:05.602973+0000","last_clean":"2024-09-12T19:27:05.602973+0000","last_became_active":"2024-09-12T17:36:36.899249+0000","last_became_peered":"2024-09-12T17:36:36.899249+0000","last_unstale":"2024-09-12T19:27:05.602973+0000","last_undegraded":"2024-09-12T19:27:05.602973+0000","last_fullsized":"2024-09-12T19:27:05.602973+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:17.239845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2730,"num_read_kb":2583,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'298","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.244773+0000","last_change":"2024-09-12T17:36:34.871230+0000","last_active":"2024-09-12T19:26:35.244773+0000","last_peered":"2024-09-12T19:26:35.244773+0000","last_clean":"2024-09-12T19:26:35.244773+0000","last_became_active":"2024-09-12T17:36:34.870994+0000","last_became_peered":"2024-09-12T17:36:34.870994+0000","last_unstale":"2024-09-12T19:26:35.244773+0000","last_undegraded":"2024-09-12T19:26:35.244773+0000","last_fullsized":"2024-09-12T19:26:35.244773+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:08.263522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6412736,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":524,"num_read_kb":2338,"num_write":1131,"num_write_kb":29584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'374","reported_seq":1826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.603010+0000","last_change":"2024-09-12T17:36:36.897967+0000","last_active":"2024-09-12T19:27:05.603010+0000","last_peered":"2024-09-12T19:27:05.603010+0000","last_clean":"2024-09-12T19:27:05.603010+0000","last_became_active":"2024-09-12T17:36:36.897609+0000","last_became_peered":"2024-09-12T17:36:36.897609+0000","last_unstale":"2024-09-12T19:27:05.603010+0000","last_undegraded":"2024-09-12T19:27:05.603010+0000","last_fullsized":"2024-09-12T19:27:05.603010+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:31.958437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2010,"num_read_kb":1904,"num_write":440,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'295","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.596308+0000","last_change":"2024-09-12T17:36:34.859377+0000","last_active":"2024-09-12T19:26:35.596308+0000","last_peered":"2024-09-12T19:26:35.596308+0000","last_clean":"2024-09-12T19:26:35.596308+0000","last_became_active":"2024-09-12T17:36:34.859023+0000","last_became_peered":"2024-09-12T17:36:34.859023+0000","last_unstale":"2024-09-12T19:26:35.596308+0000","last_undegraded":"2024-09-12T19:26:35.596308+0000","last_fullsized":"2024-09-12T19:26:35.596308+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:13.591648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1176422,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":450,"num_read_kb":1894,"num_write":1162,"num_write_kb":19389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'831","reported_seq":2372,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.367029+0000","last_change":"2024-09-12T17:36:36.914649+0000","last_active":"2024-09-12T19:28:00.367029+0000","last_peered":"2024-09-12T19:28:00.367029+0000","last_clean":"2024-09-12T19:28:00.367029+0000","last_became_active":"2024-09-12T17:36:36.914366+0000","last_became_peered":"2024-09-12T17:36:36.914366+0000","last_unstale":"2024-09-12T19:28:00.367029+0000","last_undegraded":"2024-09-12T19:28:00.367029+0000","last_fullsized":"2024-09-12T19:28:00.367029+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:37.673498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4038,"num_read_kb":3626,"num_write":1143,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'278","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254008+0000","last_change":"2024-09-12T17:36:34.883337+0000","last_active":"2024-09-12T19:26:35.254008+0000","last_peered":"2024-09-12T19:26:35.254008+0000","last_clean":"2024-09-12T19:26:35.254008+0000","last_became_active":"2024-09-12T17:36:34.882704+0000","last_became_peered":"2024-09-12T17:36:34.882704+0000","last_unstale":"2024-09-12T19:26:35.254008+0000","last_undegraded":"2024-09-12T19:26:35.254008+0000","last_fullsized":"2024-09-12T19:26:35.254008+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:19.965473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15601123,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":507,"num_read_kb":63997,"num_write":1053,"num_write_kb":46422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1166","reported_seq":2735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261311+0000","last_change":"2024-09-12T17:36:36.889657+0000","last_active":"2024-09-12T19:27:05.261311+0000","last_peered":"2024-09-12T19:27:05.261311+0000","last_clean":"2024-09-12T19:27:05.261311+0000","last_became_active":"2024-09-12T17:36:36.888829+0000","last_became_peered":"2024-09-12T17:36:36.888829+0000","last_unstale":"2024-09-12T19:27:05.261311+0000","last_undegraded":"2024-09-12T19:27:05.261311+0000","last_fullsized":"2024-09-12T19:27:05.261311+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:42.143143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5211,"num_read_kb":4613,"num_write":1589,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'494","reported_seq":2221,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181954+0000","last_change":"2024-09-12T17:36:36.905062+0000","last_active":"2024-09-12T19:27:10.181954+0000","last_peered":"2024-09-12T19:27:10.181954+0000","last_clean":"2024-09-12T19:27:10.181954+0000","last_became_active":"2024-09-12T17:36:36.904820+0000","last_became_peered":"2024-09-12T17:36:36.904820+0000","last_unstale":"2024-09-12T19:27:10.181954+0000","last_undegraded":"2024-09-12T19:27:10.181954+0000","last_fullsized":"2024-09-12T19:27:10.181954+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:38.103419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2913,"num_read_kb":2753,"num_write":585,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'305","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.078294+0000","last_change":"2024-09-12T17:36:34.866831+0000","last_active":"2024-09-12T19:25:55.078294+0000","last_peered":"2024-09-12T19:25:55.078294+0000","last_clean":"2024-09-12T19:25:55.078294+0000","last_became_active":"2024-09-12T17:36:34.866283+0000","last_became_peered":"2024-09-12T17:36:34.866283+0000","last_unstale":"2024-09-12T19:25:55.078294+0000","last_undegraded":"2024-09-12T19:25:55.078294+0000","last_fullsized":"2024-09-12T19:25:55.078294+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:57.776484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2776361,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":607,"num_read_kb":73276,"num_write":1036,"num_write_kb":24135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'478","reported_seq":2093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.032911+0000","last_change":"2024-09-12T17:36:36.911581+0000","last_active":"2024-09-12T19:29:21.032911+0000","last_peered":"2024-09-12T19:29:21.032911+0000","last_clean":"2024-09-12T19:29:21.032911+0000","last_became_active":"2024-09-12T17:36:36.911310+0000","last_became_peered":"2024-09-12T17:36:36.911310+0000","last_unstale":"2024-09-12T19:29:21.032911+0000","last_undegraded":"2024-09-12T19:29:21.032911+0000","last_fullsized":"2024-09-12T19:29:21.032911+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.005619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2526,"num_read_kb":2384,"num_write":531,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'278","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:39.783005+0000","last_change":"2024-09-12T17:36:34.865767+0000","last_active":"2024-09-12T19:25:39.783005+0000","last_peered":"2024-09-12T19:25:39.783005+0000","last_clean":"2024-09-12T19:25:39.783005+0000","last_became_active":"2024-09-12T17:36:34.865119+0000","last_became_peered":"2024-09-12T17:36:34.865119+0000","last_unstale":"2024-09-12T19:25:39.783005+0000","last_undegraded":"2024-09-12T19:25:39.783005+0000","last_fullsized":"2024-09-12T19:25:39.783005+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:35.180554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4594780,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":504,"num_read_kb":7316,"num_write":986,"num_write_kb":28671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'738","reported_seq":2229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.121403+0000","last_change":"2024-09-12T17:36:36.886366+0000","last_active":"2024-09-12T19:28:32.121403+0000","last_peered":"2024-09-12T19:28:32.121403+0000","last_clean":"2024-09-12T19:28:32.121403+0000","last_became_active":"2024-09-12T17:36:36.885876+0000","last_became_peered":"2024-09-12T17:36:36.885876+0000","last_unstale":"2024-09-12T19:28:32.121403+0000","last_undegraded":"2024-09-12T19:28:32.121403+0000","last_fullsized":"2024-09-12T19:28:32.121403+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:38.338908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3432,"num_read_kb":3117,"num_write":958,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'306","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:20.580623+0000","last_change":"2024-09-12T17:36:34.873997+0000","last_active":"2024-09-12T19:25:20.580623+0000","last_peered":"2024-09-12T19:25:20.580623+0000","last_clean":"2024-09-12T19:25:20.580623+0000","last_became_active":"2024-09-12T17:36:34.873456+0000","last_became_peered":"2024-09-12T17:36:34.873456+0000","last_unstale":"2024-09-12T19:25:20.580623+0000","last_undegraded":"2024-09-12T19:25:20.580623+0000","last_fullsized":"2024-09-12T19:25:20.580623+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:57.720538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6375100,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":477,"num_read_kb":11967,"num_write":1163,"num_write_kb":23205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'620","reported_seq":2306,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.394693+0000","last_change":"2024-09-12T17:36:36.900540+0000","last_active":"2024-09-12T19:25:54.394693+0000","last_peered":"2024-09-12T19:25:54.394693+0000","last_clean":"2024-09-12T19:25:54.394693+0000","last_became_active":"2024-09-12T17:36:36.899850+0000","last_became_peered":"2024-09-12T17:36:36.899850+0000","last_unstale":"2024-09-12T19:25:54.394693+0000","last_undegraded":"2024-09-12T19:25:54.394693+0000","last_fullsized":"2024-09-12T19:25:54.394693+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:39.690377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3224,"num_read_kb":2959,"num_write":847,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'269","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:18.628539+0000","last_change":"2024-09-12T17:36:34.864903+0000","last_active":"2024-09-12T19:26:18.628539+0000","last_peered":"2024-09-12T19:26:18.628539+0000","last_clean":"2024-09-12T19:26:18.628539+0000","last_became_active":"2024-09-12T17:36:34.864547+0000","last_became_peered":"2024-09-12T17:36:34.864547+0000","last_unstale":"2024-09-12T19:26:18.628539+0000","last_undegraded":"2024-09-12T19:26:18.628539+0000","last_fullsized":"2024-09-12T19:26:18.628539+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:37.836961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9759704,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":488,"num_read_kb":20887,"num_write":983,"num_write_kb":32386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'297","reported_seq":1673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.565486+0000","last_change":"2024-09-12T17:36:36.875932+0000","last_active":"2024-09-12T19:28:02.565486+0000","last_peered":"2024-09-12T19:28:02.565486+0000","last_clean":"2024-09-12T19:28:02.565486+0000","last_became_active":"2024-09-12T17:36:36.873937+0000","last_became_peered":"2024-09-12T17:36:36.873937+0000","last_unstale":"2024-09-12T19:28:02.565486+0000","last_undegraded":"2024-09-12T19:28:02.565486+0000","last_fullsized":"2024-09-12T19:28:02.565486+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:57.251507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1689,"num_read_kb":1636,"num_write":323,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'302","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:21.300970+0000","last_change":"2024-09-12T17:36:34.881828+0000","last_active":"2024-09-12T19:25:21.300970+0000","last_peered":"2024-09-12T19:25:21.300970+0000","last_clean":"2024-09-12T19:25:21.300970+0000","last_became_active":"2024-09-12T17:36:34.880986+0000","last_became_peered":"2024-09-12T17:36:34.880986+0000","last_unstale":"2024-09-12T19:25:21.300970+0000","last_undegraded":"2024-09-12T19:25:21.300970+0000","last_fullsized":"2024-09-12T19:25:21.300970+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:28.093624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7370410,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":804,"num_read_kb":10562,"num_write":991,"num_write_kb":33432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'404","reported_seq":1892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.398707+0000","last_change":"2024-09-12T17:36:36.881697+0000","last_active":"2024-09-12T19:25:54.398707+0000","last_peered":"2024-09-12T19:25:54.398707+0000","last_clean":"2024-09-12T19:25:54.398707+0000","last_became_active":"2024-09-12T17:36:36.881228+0000","last_became_peered":"2024-09-12T17:36:36.881228+0000","last_unstale":"2024-09-12T19:25:54.398707+0000","last_undegraded":"2024-09-12T19:25:54.398707+0000","last_fullsized":"2024-09-12T19:25:54.398707+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:17.469345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2076,"num_read_kb":1970,"num_write":455,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'354","reported_seq":1115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:39.045210+0000","last_change":"2024-09-12T17:36:34.879064+0000","last_active":"2024-09-12T19:26:39.045210+0000","last_peered":"2024-09-12T19:26:39.045210+0000","last_clean":"2024-09-12T19:26:39.045210+0000","last_became_active":"2024-09-12T17:36:34.878377+0000","last_became_peered":"2024-09-12T17:36:34.878377+0000","last_unstale":"2024-09-12T19:26:39.045210+0000","last_undegraded":"2024-09-12T19:26:39.045210+0000","last_fullsized":"2024-09-12T19:26:39.045210+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:13.927187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8422151,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":816,"num_read_kb":13594,"num_write":1279,"num_write_kb":22678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'109","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.849979+0000","last_change":"2024-09-12T17:36:44.936393+0000","last_active":"2024-09-12T19:28:02.849979+0000","last_peered":"2024-09-12T19:28:02.849979+0000","last_clean":"2024-09-12T19:28:02.849979+0000","last_became_active":"2024-09-12T17:36:44.934662+0000","last_became_peered":"2024-09-12T17:36:44.934662+0000","last_unstale":"2024-09-12T19:28:02.849979+0000","last_undegraded":"2024-09-12T19:28:02.849979+0000","last_fullsized":"2024-09-12T19:28:02.849979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:30.459321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'640","reported_seq":2289,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:44.046417+0000","last_change":"2024-09-12T17:36:36.914077+0000","last_active":"2024-09-12T19:26:44.046417+0000","last_peered":"2024-09-12T19:26:44.046417+0000","last_clean":"2024-09-12T19:26:44.046417+0000","last_became_active":"2024-09-12T17:36:36.913372+0000","last_became_peered":"2024-09-12T17:36:36.913372+0000","last_unstale":"2024-09-12T19:26:44.046417+0000","last_undegraded":"2024-09-12T19:26:44.046417+0000","last_fullsized":"2024-09-12T19:26:44.046417+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:28.282227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3256,"num_read_kb":2969,"num_write":868,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'330","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.604663+0000","last_change":"2024-09-12T17:36:34.866247+0000","last_active":"2024-09-12T19:27:38.604663+0000","last_peered":"2024-09-12T19:27:38.604663+0000","last_clean":"2024-09-12T19:27:38.604663+0000","last_became_active":"2024-09-12T17:36:34.865894+0000","last_became_peered":"2024-09-12T17:36:34.865894+0000","last_unstale":"2024-09-12T19:27:38.604663+0000","last_undegraded":"2024-09-12T19:27:38.604663+0000","last_fullsized":"2024-09-12T19:27:38.604663+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:18.929221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9572804,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":511,"num_read_kb":35668,"num_write":1281,"num_write_kb":51737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.340265+0000","last_change":"2024-09-12T17:36:38.881794+0000","last_active":"2024-09-12T19:25:25.340265+0000","last_peered":"2024-09-12T19:25:25.340265+0000","last_clean":"2024-09-12T19:25:25.340265+0000","last_became_active":"2024-09-12T17:36:38.881044+0000","last_became_peered":"2024-09-12T17:36:38.881044+0000","last_unstale":"2024-09-12T19:25:25.340265+0000","last_undegraded":"2024-09-12T19:25:25.340265+0000","last_fullsized":"2024-09-12T19:25:25.340265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:18.605129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'381","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:50.702361+0000","last_change":"2024-09-12T17:36:40.907618+0000","last_active":"2024-09-12T19:27:50.702361+0000","last_peered":"2024-09-12T19:27:50.702361+0000","last_clean":"2024-09-12T19:27:50.702361+0000","last_became_active":"2024-09-12T17:36:40.906825+0000","last_became_peered":"2024-09-12T17:36:40.906825+0000","last_unstale":"2024-09-12T19:27:50.702361+0000","last_undegraded":"2024-09-12T19:27:50.702361+0000","last_fullsized":"2024-09-12T19:27:50.702361+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:34.227775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64193,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":613,"num_read_kb":1137,"num_write":486,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.073133+0000","last_change":"2024-09-12T17:36:42.929571+0000","last_active":"2024-09-12T19:25:30.073133+0000","last_peered":"2024-09-12T19:25:30.073133+0000","last_clean":"2024-09-12T19:25:30.073133+0000","last_became_active":"2024-09-12T17:36:42.928794+0000","last_became_peered":"2024-09-12T17:36:42.928794+0000","last_unstale":"2024-09-12T19:25:30.073133+0000","last_undegraded":"2024-09-12T19:25:30.073133+0000","last_fullsized":"2024-09-12T19:25:30.073133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:22.503558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'168","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.748607+0000","last_change":"2024-09-12T17:36:44.941028+0000","last_active":"2024-09-12T19:29:20.748607+0000","last_peered":"2024-09-12T19:29:20.748607+0000","last_clean":"2024-09-12T19:29:20.748607+0000","last_became_active":"2024-09-12T17:36:44.939447+0000","last_became_peered":"2024-09-12T17:36:44.939447+0000","last_unstale":"2024-09-12T19:29:20.748607+0000","last_undegraded":"2024-09-12T19:29:20.748607+0000","last_fullsized":"2024-09-12T19:29:20.748607+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:17.779839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":297,"num_read_kb":283,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'450","reported_seq":1944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.054779+0000","last_change":"2024-09-12T17:36:36.876325+0000","last_active":"2024-09-12T19:29:21.054779+0000","last_peered":"2024-09-12T19:29:21.054779+0000","last_clean":"2024-09-12T19:29:21.054779+0000","last_became_active":"2024-09-12T17:36:36.875459+0000","last_became_peered":"2024-09-12T17:36:36.875459+0000","last_unstale":"2024-09-12T19:29:21.054779+0000","last_undegraded":"2024-09-12T19:29:21.054779+0000","last_fullsized":"2024-09-12T19:29:21.054779+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.726119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2269,"num_read_kb":2126,"num_write":529,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'255","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:14.039820+0000","last_change":"2024-09-12T17:36:34.881380+0000","last_active":"2024-09-12T19:26:14.039820+0000","last_peered":"2024-09-12T19:26:14.039820+0000","last_clean":"2024-09-12T19:26:14.039820+0000","last_became_active":"2024-09-12T17:36:34.880644+0000","last_became_peered":"2024-09-12T17:36:34.880644+0000","last_unstale":"2024-09-12T19:26:14.039820+0000","last_undegraded":"2024-09-12T19:26:14.039820+0000","last_fullsized":"2024-09-12T19:26:14.039820+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.644365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8672890,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":349,"num_read_kb":12213,"num_write":946,"num_write_kb":18682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686717+0000","last_change":"2024-09-12T17:36:38.901489+0000","last_active":"2024-09-12T19:26:40.686717+0000","last_peered":"2024-09-12T19:26:40.686717+0000","last_clean":"2024-09-12T19:26:40.686717+0000","last_became_active":"2024-09-12T17:36:38.900684+0000","last_became_peered":"2024-09-12T17:36:38.900684+0000","last_unstale":"2024-09-12T19:26:40.686717+0000","last_undegraded":"2024-09-12T19:26:40.686717+0000","last_fullsized":"2024-09-12T19:26:40.686717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:05.502369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'126","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:31.644856+0000","last_change":"2024-09-12T17:36:40.900116+0000","last_active":"2024-09-12T19:27:31.644856+0000","last_peered":"2024-09-12T19:27:31.644856+0000","last_clean":"2024-09-12T19:27:31.644856+0000","last_became_active":"2024-09-12T17:36:40.899340+0000","last_became_peered":"2024-09-12T17:36:40.899340+0000","last_unstale":"2024-09-12T19:27:31.644856+0000","last_undegraded":"2024-09-12T19:27:31.644856+0000","last_fullsized":"2024-09-12T19:27:31.644856+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:14.476334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.073064+0000","last_change":"2024-09-12T17:36:42.932966+0000","last_active":"2024-09-12T19:25:30.073064+0000","last_peered":"2024-09-12T19:25:30.073064+0000","last_clean":"2024-09-12T19:25:30.073064+0000","last_became_active":"2024-09-12T17:36:42.932100+0000","last_became_peered":"2024-09-12T17:36:42.932100+0000","last_unstale":"2024-09-12T19:25:30.073064+0000","last_undegraded":"2024-09-12T19:25:30.073064+0000","last_fullsized":"2024-09-12T19:25:30.073064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:17.207909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'122","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:58.466580+0000","last_change":"2024-09-12T17:36:44.966580+0000","last_active":"2024-09-12T19:27:58.466580+0000","last_peered":"2024-09-12T19:27:58.466580+0000","last_clean":"2024-09-12T19:27:58.466580+0000","last_became_active":"2024-09-12T17:36:44.965913+0000","last_became_peered":"2024-09-12T17:36:44.965913+0000","last_unstale":"2024-09-12T19:27:58.466580+0000","last_undegraded":"2024-09-12T19:27:58.466580+0000","last_fullsized":"2024-09-12T19:27:58.466580+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:05.954565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":210,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'399","reported_seq":1900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.293238+0000","last_change":"2024-09-12T17:36:36.905410+0000","last_active":"2024-09-12T19:28:00.293238+0000","last_peered":"2024-09-12T19:28:00.293238+0000","last_clean":"2024-09-12T19:28:00.293238+0000","last_became_active":"2024-09-12T17:36:36.904639+0000","last_became_peered":"2024-09-12T17:36:36.904639+0000","last_unstale":"2024-09-12T19:28:00.293238+0000","last_undegraded":"2024-09-12T19:28:00.293238+0000","last_fullsized":"2024-09-12T19:28:00.293238+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:07.140445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2242,"num_read_kb":2124,"num_write":448,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'250","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.352565+0000","last_change":"2024-09-12T17:36:34.879554+0000","last_active":"2024-09-12T19:26:15.352565+0000","last_peered":"2024-09-12T19:26:15.352565+0000","last_clean":"2024-09-12T19:26:15.352565+0000","last_became_active":"2024-09-12T17:36:34.879098+0000","last_became_peered":"2024-09-12T17:36:34.879098+0000","last_unstale":"2024-09-12T19:26:15.352565+0000","last_undegraded":"2024-09-12T19:26:15.352565+0000","last_fullsized":"2024-09-12T19:26:15.352565+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:31.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7103716,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":326,"num_read_kb":4507,"num_write":937,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.670087+0000","last_change":"2024-09-12T17:36:38.884358+0000","last_active":"2024-09-12T19:25:25.670087+0000","last_peered":"2024-09-12T19:25:25.670087+0000","last_clean":"2024-09-12T19:25:25.670087+0000","last_became_active":"2024-09-12T17:36:38.883758+0000","last_became_peered":"2024-09-12T17:36:38.883758+0000","last_unstale":"2024-09-12T19:25:25.670087+0000","last_undegraded":"2024-09-12T19:25:25.670087+0000","last_fullsized":"2024-09-12T19:25:25.670087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:23.851056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'185","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:33.286596+0000","last_change":"2024-09-12T17:36:40.908353+0000","last_active":"2024-09-12T19:27:33.286596+0000","last_peered":"2024-09-12T19:27:33.286596+0000","last_clean":"2024-09-12T19:27:33.286596+0000","last_became_active":"2024-09-12T17:36:40.907410+0000","last_became_peered":"2024-09-12T17:36:40.907410+0000","last_unstale":"2024-09-12T19:27:33.286596+0000","last_undegraded":"2024-09-12T19:27:33.286596+0000","last_fullsized":"2024-09-12T19:27:33.286596+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:48.613522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'799","reported_seq":7114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.082506+0000","last_change":"2024-09-12T17:36:42.918180+0000","last_active":"2024-09-12T19:29:25.082506+0000","last_peered":"2024-09-12T19:29:25.082506+0000","last_clean":"2024-09-12T19:29:25.082506+0000","last_became_active":"2024-09-12T17:36:42.916847+0000","last_became_peered":"2024-09-12T17:36:42.916847+0000","last_unstale":"2024-09-12T19:29:25.082506+0000","last_undegraded":"2024-09-12T19:29:25.082506+0000","last_fullsized":"2024-09-12T19:29:25.082506+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:45.795888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'223","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.042171+0000","last_change":"2024-09-12T17:36:44.958620+0000","last_active":"2024-09-12T19:28:03.042171+0000","last_peered":"2024-09-12T19:28:03.042171+0000","last_clean":"2024-09-12T19:28:03.042171+0000","last_became_active":"2024-09-12T17:36:44.954183+0000","last_became_peered":"2024-09-12T17:36:44.954183+0000","last_unstale":"2024-09-12T19:28:03.042171+0000","last_undegraded":"2024-09-12T19:28:03.042171+0000","last_fullsized":"2024-09-12T19:28:03.042171+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:52.168028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":505,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'457","reported_seq":2139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.060710+0000","last_change":"2024-09-12T17:36:36.878129+0000","last_active":"2024-09-12T19:29:21.060710+0000","last_peered":"2024-09-12T19:29:21.060710+0000","last_clean":"2024-09-12T19:29:21.060710+0000","last_became_active":"2024-09-12T17:36:36.877420+0000","last_became_peered":"2024-09-12T17:36:36.877420+0000","last_unstale":"2024-09-12T19:29:21.060710+0000","last_undegraded":"2024-09-12T19:29:21.060710+0000","last_fullsized":"2024-09-12T19:29:21.060710+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:44.309313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2635,"num_read_kb":2492,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'281","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.082154+0000","last_change":"2024-09-12T17:36:34.883169+0000","last_active":"2024-09-12T19:26:15.082154+0000","last_peered":"2024-09-12T19:26:15.082154+0000","last_clean":"2024-09-12T19:26:15.082154+0000","last_became_active":"2024-09-12T17:36:34.882902+0000","last_became_peered":"2024-09-12T17:36:34.882902+0000","last_unstale":"2024-09-12T19:26:15.082154+0000","last_undegraded":"2024-09-12T19:26:15.082154+0000","last_fullsized":"2024-09-12T19:26:15.082154+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:36.819998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12938782,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":509,"num_read_kb":75125,"num_write":968,"num_write_kb":28457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.340316+0000","last_change":"2024-09-12T17:36:38.899727+0000","last_active":"2024-09-12T19:25:25.340316+0000","last_peered":"2024-09-12T19:25:25.340316+0000","last_clean":"2024-09-12T19:25:25.340316+0000","last_became_active":"2024-09-12T17:36:38.899405+0000","last_became_peered":"2024-09-12T17:36:38.899405+0000","last_unstale":"2024-09-12T19:25:25.340316+0000","last_undegraded":"2024-09-12T19:25:25.340316+0000","last_fullsized":"2024-09-12T19:25:25.340316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:16.514700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'333","reported_seq":950,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.642972+0000","last_change":"2024-09-12T17:36:40.911431+0000","last_active":"2024-09-12T19:28:02.642972+0000","last_peered":"2024-09-12T19:28:02.642972+0000","last_clean":"2024-09-12T19:28:02.642972+0000","last_became_active":"2024-09-12T17:36:40.910700+0000","last_became_peered":"2024-09-12T17:36:40.910700+0000","last_unstale":"2024-09-12T19:28:02.642972+0000","last_undegraded":"2024-09-12T19:28:02.642972+0000","last_fullsized":"2024-09-12T19:28:02.642972+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:03.951315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71427,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":523,"num_read_kb":1019,"num_write":432,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'795","reported_seq":3152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.067739+0000","last_change":"2024-09-12T17:36:42.940750+0000","last_active":"2024-09-12T19:29:25.067739+0000","last_peered":"2024-09-12T19:29:25.067739+0000","last_clean":"2024-09-12T19:29:25.067739+0000","last_became_active":"2024-09-12T17:36:42.939966+0000","last_became_peered":"2024-09-12T17:36:42.939966+0000","last_unstale":"2024-09-12T19:29:25.067739+0000","last_undegraded":"2024-09-12T19:29:25.067739+0000","last_fullsized":"2024-09-12T19:29:25.067739+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:48.117866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'1125","reported_seq":2730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.116710+0000","last_change":"2024-09-12T17:36:36.886873+0000","last_active":"2024-09-12T19:28:32.116710+0000","last_peered":"2024-09-12T19:28:32.116710+0000","last_clean":"2024-09-12T19:28:32.116710+0000","last_became_active":"2024-09-12T17:36:36.886244+0000","last_became_peered":"2024-09-12T17:36:36.886244+0000","last_unstale":"2024-09-12T19:28:32.116710+0000","last_undegraded":"2024-09-12T19:28:32.116710+0000","last_fullsized":"2024-09-12T19:28:32.116710+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:16.947822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5270,"num_read_kb":4695,"num_write":1548,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'236","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.605155+0000","last_change":"2024-09-12T17:36:34.865757+0000","last_active":"2024-09-12T19:27:15.605155+0000","last_peered":"2024-09-12T19:27:15.605155+0000","last_clean":"2024-09-12T19:27:15.605155+0000","last_became_active":"2024-09-12T17:36:34.865417+0000","last_became_peered":"2024-09-12T17:36:34.865417+0000","last_unstale":"2024-09-12T19:27:15.605155+0000","last_undegraded":"2024-09-12T19:27:15.605155+0000","last_fullsized":"2024-09-12T19:27:15.605155+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:22.490874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658193,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":459,"num_read_kb":1839,"num_write":912,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.094709+0000","last_change":"2024-09-12T17:36:38.888368+0000","last_active":"2024-09-12T19:27:10.094709+0000","last_peered":"2024-09-12T19:27:10.094709+0000","last_clean":"2024-09-12T19:27:10.094709+0000","last_became_active":"2024-09-12T17:36:38.887444+0000","last_became_peered":"2024-09-12T17:36:38.887444+0000","last_unstale":"2024-09-12T19:27:10.094709+0000","last_undegraded":"2024-09-12T19:27:10.094709+0000","last_fullsized":"2024-09-12T19:27:10.094709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:57.724697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'443","reported_seq":1137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:36.440756+0000","last_change":"2024-09-12T17:36:40.914188+0000","last_active":"2024-09-12T19:27:36.440756+0000","last_peered":"2024-09-12T19:27:36.440756+0000","last_clean":"2024-09-12T19:27:36.440756+0000","last_became_active":"2024-09-12T17:36:40.911095+0000","last_became_peered":"2024-09-12T17:36:40.911095+0000","last_unstale":"2024-09-12T19:27:36.440756+0000","last_undegraded":"2024-09-12T19:27:36.440756+0000","last_fullsized":"2024-09-12T19:27:36.440756+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:16.975199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62664,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":725,"num_read_kb":1226,"num_write":550,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.049545+0000","last_change":"2024-09-12T17:36:42.928393+0000","last_active":"2024-09-12T19:26:59.049545+0000","last_peered":"2024-09-12T19:26:59.049545+0000","last_clean":"2024-09-12T19:26:59.049545+0000","last_became_active":"2024-09-12T17:36:42.927582+0000","last_became_peered":"2024-09-12T17:36:42.927582+0000","last_unstale":"2024-09-12T19:26:59.049545+0000","last_undegraded":"2024-09-12T19:26:59.049545+0000","last_fullsized":"2024-09-12T19:26:59.049545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:38.031907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'554","reported_seq":1399,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.053521+0000","last_change":"2024-09-12T17:36:44.958491+0000","last_active":"2024-09-12T19:29:22.053521+0000","last_peered":"2024-09-12T19:29:22.053521+0000","last_clean":"2024-09-12T19:29:22.053521+0000","last_became_active":"2024-09-12T17:36:44.953926+0000","last_became_peered":"2024-09-12T17:36:44.953926+0000","last_unstale":"2024-09-12T19:29:22.053521+0000","last_undegraded":"2024-09-12T19:29:22.053521+0000","last_fullsized":"2024-09-12T19:29:22.053521+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:32.984877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":1310,"num_write":1167,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'838","reported_seq":2541,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.040399+0000","last_change":"2024-09-12T17:36:36.886760+0000","last_active":"2024-09-12T19:29:21.040399+0000","last_peered":"2024-09-12T19:29:21.040399+0000","last_clean":"2024-09-12T19:29:21.040399+0000","last_became_active":"2024-09-12T17:36:36.886395+0000","last_became_peered":"2024-09-12T17:36:36.886395+0000","last_unstale":"2024-09-12T19:29:21.040399+0000","last_undegraded":"2024-09-12T19:29:21.040399+0000","last_fullsized":"2024-09-12T19:29:21.040399+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:47.591431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4184,"num_read_kb":3783,"num_write":1092,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'305","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:15.326474+0000","last_change":"2024-09-12T17:36:34.869074+0000","last_active":"2024-09-12T19:29:15.326474+0000","last_peered":"2024-09-12T19:29:15.326474+0000","last_clean":"2024-09-12T19:29:15.326474+0000","last_became_active":"2024-09-12T17:36:34.868465+0000","last_became_peered":"2024-09-12T17:36:34.868465+0000","last_unstale":"2024-09-12T19:29:15.326474+0000","last_undegraded":"2024-09-12T19:29:15.326474+0000","last_fullsized":"2024-09-12T19:29:15.326474+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:49.416583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3283434,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":499,"num_read_kb":2937,"num_write":1099,"num_write_kb":21558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"36'3","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.906583+0000","last_change":"2024-09-12T17:36:38.907718+0000","last_active":"2024-09-12T19:29:21.906583+0000","last_peered":"2024-09-12T19:29:21.906583+0000","last_clean":"2024-09-12T19:29:21.906583+0000","last_became_active":"2024-09-12T17:36:38.907007+0000","last_became_peered":"2024-09-12T17:36:38.907007+0000","last_unstale":"2024-09-12T19:29:21.906583+0000","last_undegraded":"2024-09-12T19:29:21.906583+0000","last_fullsized":"2024-09-12T19:29:21.906583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:31.556098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'323","reported_seq":942,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.720307+0000","last_change":"2024-09-12T17:36:40.912235+0000","last_active":"2024-09-12T19:29:10.720307+0000","last_peered":"2024-09-12T19:29:10.720307+0000","last_clean":"2024-09-12T19:29:10.720307+0000","last_became_active":"2024-09-12T17:36:40.911092+0000","last_became_peered":"2024-09-12T17:36:40.911092+0000","last_unstale":"2024-09-12T19:29:10.720307+0000","last_undegraded":"2024-09-12T19:29:10.720307+0000","last_fullsized":"2024-09-12T19:29:10.720307+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:38.796270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":1040,"num_write":430,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.669939+0000","last_change":"2024-09-12T17:36:42.937336+0000","last_active":"2024-09-12T19:25:25.669939+0000","last_peered":"2024-09-12T19:25:25.669939+0000","last_clean":"2024-09-12T19:25:25.669939+0000","last_became_active":"2024-09-12T17:36:42.933808+0000","last_became_peered":"2024-09-12T17:36:42.933808+0000","last_unstale":"2024-09-12T19:25:25.669939+0000","last_undegraded":"2024-09-12T19:25:25.669939+0000","last_fullsized":"2024-09-12T19:25:25.669939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:36.847620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'2432","reported_seq":4293,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.133108+0000","last_change":"2024-09-12T17:36:44.963412+0000","last_active":"2024-09-12T19:28:32.133108+0000","last_peered":"2024-09-12T19:28:32.133108+0000","last_clean":"2024-09-12T19:28:32.133108+0000","last_became_active":"2024-09-12T17:36:44.962630+0000","last_became_peered":"2024-09-12T17:36:44.962630+0000","last_unstale":"2024-09-12T19:28:32.133108+0000","last_undegraded":"2024-09-12T19:28:32.133108+0000","last_fullsized":"2024-09-12T19:28:32.133108+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:56.907799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6095,"num_read_kb":6091,"num_write":4930,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'434","reported_seq":2059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.318071+0000","last_change":"2024-09-12T17:36:36.880733+0000","last_active":"2024-09-12T19:28:00.318071+0000","last_peered":"2024-09-12T19:28:00.318071+0000","last_clean":"2024-09-12T19:28:00.318071+0000","last_became_active":"2024-09-12T17:36:36.880296+0000","last_became_peered":"2024-09-12T17:36:36.880296+0000","last_unstale":"2024-09-12T19:28:00.318071+0000","last_undegraded":"2024-09-12T19:28:00.318071+0000","last_fullsized":"2024-09-12T19:28:00.318071+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:06.645113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2387,"num_read_kb":2259,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'297","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.362024+0000","last_change":"2024-09-12T17:36:34.868949+0000","last_active":"2024-09-12T19:26:50.362024+0000","last_peered":"2024-09-12T19:26:50.362024+0000","last_clean":"2024-09-12T19:26:50.362024+0000","last_became_active":"2024-09-12T17:36:34.868243+0000","last_became_peered":"2024-09-12T17:36:34.868243+0000","last_unstale":"2024-09-12T19:26:50.362024+0000","last_undegraded":"2024-09-12T19:26:50.362024+0000","last_fullsized":"2024-09-12T19:26:50.362024+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:16.699361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2483814,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":502,"num_read_kb":48255,"num_write":1140,"num_write_kb":33494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258752+0000","last_change":"2024-09-12T17:36:38.893533+0000","last_active":"2024-09-12T19:26:55.258752+0000","last_peered":"2024-09-12T19:26:55.258752+0000","last_clean":"2024-09-12T19:26:55.258752+0000","last_became_active":"2024-09-12T17:36:38.892804+0000","last_became_peered":"2024-09-12T17:36:38.892804+0000","last_unstale":"2024-09-12T19:26:55.258752+0000","last_undegraded":"2024-09-12T19:26:55.258752+0000","last_fullsized":"2024-09-12T19:26:55.258752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:56.818407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'394","reported_seq":1044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.396367+0000","last_change":"2024-09-12T17:36:40.889733+0000","last_active":"2024-09-12T19:29:20.396367+0000","last_peered":"2024-09-12T19:29:20.396367+0000","last_clean":"2024-09-12T19:29:20.396367+0000","last_became_active":"2024-09-12T17:36:40.888974+0000","last_became_peered":"2024-09-12T17:36:40.888974+0000","last_unstale":"2024-09-12T19:29:20.396367+0000","last_undegraded":"2024-09-12T19:29:20.396367+0000","last_fullsized":"2024-09-12T19:29:20.396367+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:41.043970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61753,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":631,"num_read_kb":1144,"num_write":502,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'794","reported_seq":3040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.295685+0000","last_change":"2024-09-12T17:36:42.936433+0000","last_active":"2024-09-12T19:29:25.295685+0000","last_peered":"2024-09-12T19:29:25.295685+0000","last_clean":"2024-09-12T19:29:25.295685+0000","last_became_active":"2024-09-12T17:36:42.935529+0000","last_became_peered":"2024-09-12T17:36:42.935529+0000","last_unstale":"2024-09-12T19:29:25.295685+0000","last_undegraded":"2024-09-12T19:29:25.295685+0000","last_fullsized":"2024-09-12T19:29:25.295685+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:25.923124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'112","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.068420+0000","last_change":"2024-09-12T17:36:44.966442+0000","last_active":"2024-09-12T19:29:21.068420+0000","last_peered":"2024-09-12T19:29:21.068420+0000","last_clean":"2024-09-12T19:29:21.068420+0000","last_became_active":"2024-09-12T17:36:44.965763+0000","last_became_peered":"2024-09-12T17:36:44.965763+0000","last_unstale":"2024-09-12T19:29:21.068420+0000","last_undegraded":"2024-09-12T19:29:21.068420+0000","last_fullsized":"2024-09-12T19:29:21.068420+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:31.130717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":137,"num_write":264,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'411","reported_seq":1895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.034719+0000","last_change":"2024-09-12T17:36:36.907634+0000","last_active":"2024-09-12T19:29:21.034719+0000","last_peered":"2024-09-12T19:29:21.034719+0000","last_clean":"2024-09-12T19:29:21.034719+0000","last_became_active":"2024-09-12T17:36:36.905958+0000","last_became_peered":"2024-09-12T17:36:36.905958+0000","last_unstale":"2024-09-12T19:29:21.034719+0000","last_undegraded":"2024-09-12T19:29:21.034719+0000","last_fullsized":"2024-09-12T19:29:21.034719+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:58.834393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'290","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.599727+0000","last_change":"2024-09-12T17:36:34.861236+0000","last_active":"2024-09-12T19:26:50.599727+0000","last_peered":"2024-09-12T19:26:50.599727+0000","last_clean":"2024-09-12T19:26:50.599727+0000","last_became_active":"2024-09-12T17:36:34.860828+0000","last_became_peered":"2024-09-12T17:36:34.860828+0000","last_unstale":"2024-09-12T19:26:50.599727+0000","last_undegraded":"2024-09-12T19:26:50.599727+0000","last_fullsized":"2024-09-12T19:26:50.599727+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:17.732122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6713830,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":402,"num_read_kb":18690,"num_write":1023,"num_write_kb":31228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:24.029382+0000","last_change":"2024-09-12T17:36:38.897935+0000","last_active":"2024-09-12T19:25:24.029382+0000","last_peered":"2024-09-12T19:25:24.029382+0000","last_clean":"2024-09-12T19:25:24.029382+0000","last_became_active":"2024-09-12T17:36:38.897189+0000","last_became_peered":"2024-09-12T17:36:38.897189+0000","last_unstale":"2024-09-12T19:25:24.029382+0000","last_undegraded":"2024-09-12T19:25:24.029382+0000","last_fullsized":"2024-09-12T19:25:24.029382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:35.954626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'500","reported_seq":1178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.982850+0000","last_change":"2024-09-12T17:36:40.907633+0000","last_active":"2024-09-12T19:29:21.982850+0000","last_peered":"2024-09-12T19:29:21.982850+0000","last_clean":"2024-09-12T19:29:21.982850+0000","last_became_active":"2024-09-12T17:36:40.906903+0000","last_became_peered":"2024-09-12T17:36:40.906903+0000","last_unstale":"2024-09-12T19:29:21.982850+0000","last_undegraded":"2024-09-12T19:29:21.982850+0000","last_fullsized":"2024-09-12T19:29:21.982850+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:36.733767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112810,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":875,"num_read_kb":1839,"num_write":714,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263489+0000","last_change":"2024-09-12T17:36:42.933877+0000","last_active":"2024-09-12T19:27:15.263489+0000","last_peered":"2024-09-12T19:27:15.263489+0000","last_clean":"2024-09-12T19:27:15.263489+0000","last_became_active":"2024-09-12T17:36:42.933168+0000","last_became_peered":"2024-09-12T17:36:42.933168+0000","last_unstale":"2024-09-12T19:27:15.263489+0000","last_undegraded":"2024-09-12T19:27:15.263489+0000","last_fullsized":"2024-09-12T19:27:15.263489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:13.861626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'159","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.676473+0000","last_change":"2024-09-12T17:36:44.961695+0000","last_active":"2024-09-12T19:27:15.676473+0000","last_peered":"2024-09-12T19:27:15.676473+0000","last_clean":"2024-09-12T19:27:15.676473+0000","last_became_active":"2024-09-12T17:36:44.960935+0000","last_became_peered":"2024-09-12T17:36:44.960935+0000","last_unstale":"2024-09-12T19:27:15.676473+0000","last_undegraded":"2024-09-12T19:27:15.676473+0000","last_fullsized":"2024-09-12T19:27:15.676473+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:20.892764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1322,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":195,"num_write":366,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1240","reported_seq":2921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.119750+0000","last_change":"2024-09-12T17:36:36.914970+0000","last_active":"2024-09-12T19:28:32.119750+0000","last_peered":"2024-09-12T19:28:32.119750+0000","last_clean":"2024-09-12T19:28:32.119750+0000","last_became_active":"2024-09-12T17:36:36.914518+0000","last_became_peered":"2024-09-12T17:36:36.914518+0000","last_unstale":"2024-09-12T19:28:32.119750+0000","last_undegraded":"2024-09-12T19:28:32.119750+0000","last_fullsized":"2024-09-12T19:28:32.119750+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.726119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5692,"num_read_kb":5056,"num_write":1732,"num_write_kb":743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'269","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670302+0000","last_change":"2024-09-12T17:36:34.879597+0000","last_active":"2024-09-12T19:26:50.670302+0000","last_peered":"2024-09-12T19:26:50.670302+0000","last_clean":"2024-09-12T19:26:50.670302+0000","last_became_active":"2024-09-12T17:36:34.878896+0000","last_became_peered":"2024-09-12T17:36:34.878896+0000","last_unstale":"2024-09-12T19:26:50.670302+0000","last_undegraded":"2024-09-12T19:26:50.670302+0000","last_fullsized":"2024-09-12T19:26:50.670302+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:49.691790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325324,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":465,"num_read_kb":17715,"num_write":989,"num_write_kb":23877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671691+0000","last_change":"2024-09-12T17:36:38.908401+0000","last_active":"2024-09-12T19:26:55.671691+0000","last_peered":"2024-09-12T19:26:55.671691+0000","last_clean":"2024-09-12T19:26:55.671691+0000","last_became_active":"2024-09-12T17:36:38.907609+0000","last_became_peered":"2024-09-12T17:36:38.907609+0000","last_unstale":"2024-09-12T19:26:55.671691+0000","last_undegraded":"2024-09-12T19:26:55.671691+0000","last_fullsized":"2024-09-12T19:26:55.671691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:46.413534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'356","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.119357+0000","last_change":"2024-09-12T17:36:40.895469+0000","last_active":"2024-09-12T19:29:10.119357+0000","last_peered":"2024-09-12T19:29:10.119357+0000","last_clean":"2024-09-12T19:29:10.119357+0000","last_became_active":"2024-09-12T17:36:40.893702+0000","last_became_peered":"2024-09-12T17:36:40.893702+0000","last_unstale":"2024-09-12T19:29:10.119357+0000","last_undegraded":"2024-09-12T19:29:10.119357+0000","last_fullsized":"2024-09-12T19:29:10.119357+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:52.727654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57866,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":1119,"num_write":524,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.677558+0000","last_change":"2024-09-12T17:36:42.939282+0000","last_active":"2024-09-12T19:27:20.677558+0000","last_peered":"2024-09-12T19:27:20.677558+0000","last_clean":"2024-09-12T19:27:20.677558+0000","last_became_active":"2024-09-12T17:36:42.938437+0000","last_became_peered":"2024-09-12T17:36:42.938437+0000","last_unstale":"2024-09-12T19:27:20.677558+0000","last_undegraded":"2024-09-12T19:27:20.677558+0000","last_fullsized":"2024-09-12T19:27:20.677558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:17.930519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'144","reported_seq":718,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:09.868344+0000","last_change":"2024-09-12T17:36:44.959709+0000","last_active":"2024-09-12T19:29:09.868344+0000","last_peered":"2024-09-12T19:29:09.868344+0000","last_clean":"2024-09-12T19:29:09.868344+0000","last_became_active":"2024-09-12T17:36:44.956645+0000","last_became_peered":"2024-09-12T17:36:44.956645+0000","last_unstale":"2024-09-12T19:29:09.868344+0000","last_undegraded":"2024-09-12T19:29:09.868344+0000","last_fullsized":"2024-09-12T19:29:09.868344+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.650537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":356,"num_read_kb":303,"num_write":346,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'499","reported_seq":2115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.117569+0000","last_change":"2024-09-12T17:36:36.882735+0000","last_active":"2024-09-12T19:28:32.117569+0000","last_peered":"2024-09-12T19:28:32.117569+0000","last_clean":"2024-09-12T19:28:32.117569+0000","last_became_active":"2024-09-12T17:36:36.881882+0000","last_became_peered":"2024-09-12T17:36:36.881882+0000","last_unstale":"2024-09-12T19:28:32.117569+0000","last_undegraded":"2024-09-12T19:28:32.117569+0000","last_fullsized":"2024-09-12T19:28:32.117569+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.005619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2445,"num_write":630,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'283","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:51.821156+0000","last_change":"2024-09-12T17:36:34.870444+0000","last_active":"2024-09-12T19:26:51.821156+0000","last_peered":"2024-09-12T19:26:51.821156+0000","last_clean":"2024-09-12T19:26:51.821156+0000","last_became_active":"2024-09-12T17:36:34.870021+0000","last_became_peered":"2024-09-12T17:36:34.870021+0000","last_unstale":"2024-09-12T19:26:51.821156+0000","last_undegraded":"2024-09-12T19:26:51.821156+0000","last_fullsized":"2024-09-12T19:26:51.821156+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:32.502673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1583636,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":452,"num_read_kb":14188,"num_write":1118,"num_write_kb":25082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258787+0000","last_change":"2024-09-12T17:36:38.893625+0000","last_active":"2024-09-12T19:26:55.258787+0000","last_peered":"2024-09-12T19:26:55.258787+0000","last_clean":"2024-09-12T19:26:55.258787+0000","last_became_active":"2024-09-12T17:36:38.892885+0000","last_became_peered":"2024-09-12T17:36:38.892885+0000","last_unstale":"2024-09-12T19:26:55.258787+0000","last_undegraded":"2024-09-12T19:26:55.258787+0000","last_fullsized":"2024-09-12T19:26:55.258787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:23.133743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'374","reported_seq":1027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.049303+0000","last_change":"2024-09-12T17:36:40.898503+0000","last_active":"2024-09-12T19:29:22.049303+0000","last_peered":"2024-09-12T19:29:22.049303+0000","last_clean":"2024-09-12T19:29:22.049303+0000","last_became_active":"2024-09-12T17:36:40.896733+0000","last_became_peered":"2024-09-12T17:36:40.896733+0000","last_unstale":"2024-09-12T19:29:22.049303+0000","last_undegraded":"2024-09-12T19:29:22.049303+0000","last_fullsized":"2024-09-12T19:29:22.049303+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:00.019536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70333,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":1100,"num_write":464,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'767","reported_seq":3233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.079596+0000","last_change":"2024-09-12T17:36:42.935306+0000","last_active":"2024-09-12T19:29:25.079596+0000","last_peered":"2024-09-12T19:29:25.079596+0000","last_clean":"2024-09-12T19:29:25.079596+0000","last_became_active":"2024-09-12T17:36:42.934582+0000","last_became_peered":"2024-09-12T17:36:42.934582+0000","last_unstale":"2024-09-12T19:29:25.079596+0000","last_undegraded":"2024-09-12T19:29:25.079596+0000","last_fullsized":"2024-09-12T19:29:25.079596+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.168171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'100","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.913618+0000","last_change":"2024-09-12T17:36:44.938502+0000","last_active":"2024-09-12T19:28:02.913618+0000","last_peered":"2024-09-12T19:28:02.913618+0000","last_clean":"2024-09-12T19:28:02.913618+0000","last_became_active":"2024-09-12T17:36:44.937368+0000","last_became_peered":"2024-09-12T17:36:44.937368+0000","last_unstale":"2024-09-12T19:28:02.913618+0000","last_undegraded":"2024-09-12T19:28:02.913618+0000","last_fullsized":"2024-09-12T19:28:02.913618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:33.490996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":224,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'653","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.248765+0000","last_change":"2024-09-12T17:36:36.883321+0000","last_active":"2024-09-12T19:26:55.248765+0000","last_peered":"2024-09-12T19:26:55.248765+0000","last_clean":"2024-09-12T19:26:55.248765+0000","last_became_active":"2024-09-12T17:36:36.883043+0000","last_became_peered":"2024-09-12T17:36:36.883043+0000","last_unstale":"2024-09-12T19:26:55.248765+0000","last_undegraded":"2024-09-12T19:26:55.248765+0000","last_fullsized":"2024-09-12T19:26:55.248765+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:50.911594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3181,"num_read_kb":2856,"num_write":918,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'320","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.631187+0000","last_change":"2024-09-12T17:36:34.874846+0000","last_active":"2024-09-12T19:27:38.631187+0000","last_peered":"2024-09-12T19:27:38.631187+0000","last_clean":"2024-09-12T19:27:38.631187+0000","last_became_active":"2024-09-12T17:36:34.873263+0000","last_became_peered":"2024-09-12T17:36:34.873263+0000","last_unstale":"2024-09-12T19:27:38.631187+0000","last_undegraded":"2024-09-12T19:27:38.631187+0000","last_fullsized":"2024-09-12T19:27:38.631187+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:42.358689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11461331,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":517,"num_read_kb":21339,"num_write":1007,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1479,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.922275+0000","last_change":"2024-09-12T17:36:38.889880+0000","last_active":"2024-09-12T19:29:21.922275+0000","last_peered":"2024-09-12T19:29:21.922275+0000","last_clean":"2024-09-12T19:29:21.922275+0000","last_became_active":"2024-09-12T17:36:38.888795+0000","last_became_peered":"2024-09-12T17:36:38.888795+0000","last_unstale":"2024-09-12T19:29:21.922275+0000","last_undegraded":"2024-09-12T19:29:21.922275+0000","last_fullsized":"2024-09-12T19:29:21.922275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:53.568736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'150","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.261761+0000","last_change":"2024-09-12T17:36:40.893833+0000","last_active":"2024-09-12T19:27:30.261761+0000","last_peered":"2024-09-12T19:27:30.261761+0000","last_clean":"2024-09-12T19:27:30.261761+0000","last_became_active":"2024-09-12T17:36:40.893090+0000","last_became_peered":"2024-09-12T17:36:40.893090+0000","last_unstale":"2024-09-12T19:27:30.261761+0000","last_undegraded":"2024-09-12T19:27:30.261761+0000","last_fullsized":"2024-09-12T19:27:30.261761+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:17.912186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'802","reported_seq":3152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.080128+0000","last_change":"2024-09-12T17:36:42.937918+0000","last_active":"2024-09-12T19:29:25.080128+0000","last_peered":"2024-09-12T19:29:25.080128+0000","last_clean":"2024-09-12T19:29:25.080128+0000","last_became_active":"2024-09-12T17:36:42.937195+0000","last_became_peered":"2024-09-12T17:36:42.937195+0000","last_unstale":"2024-09-12T19:29:25.080128+0000","last_undegraded":"2024-09-12T19:29:25.080128+0000","last_fullsized":"2024-09-12T19:29:25.080128+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:27.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'109","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.251823+0000","last_change":"2024-09-12T17:36:44.960800+0000","last_active":"2024-09-12T19:27:10.251823+0000","last_peered":"2024-09-12T19:27:10.251823+0000","last_clean":"2024-09-12T19:27:10.251823+0000","last_became_active":"2024-09-12T17:36:44.960042+0000","last_became_peered":"2024-09-12T17:36:44.960042+0000","last_unstale":"2024-09-12T19:27:10.251823+0000","last_undegraded":"2024-09-12T19:27:10.251823+0000","last_fullsized":"2024-09-12T19:27:10.251823+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:54.849029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'983","reported_seq":2639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.365058+0000","last_change":"2024-09-12T17:36:36.914243+0000","last_active":"2024-09-12T19:28:00.365058+0000","last_peered":"2024-09-12T19:28:00.365058+0000","last_clean":"2024-09-12T19:28:00.365058+0000","last_became_active":"2024-09-12T17:36:36.913566+0000","last_became_peered":"2024-09-12T17:36:36.913566+0000","last_unstale":"2024-09-12T19:28:00.365058+0000","last_undegraded":"2024-09-12T19:28:00.365058+0000","last_fullsized":"2024-09-12T19:28:00.365058+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":900,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:32.358617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4811,"num_read_kb":4293,"num_write":1402,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'239","reported_seq":870,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.692302+0000","last_change":"2024-09-12T17:36:34.863609+0000","last_active":"2024-09-12T19:27:05.692302+0000","last_peered":"2024-09-12T19:27:05.692302+0000","last_clean":"2024-09-12T19:27:05.692302+0000","last_became_active":"2024-09-12T17:36:34.862534+0000","last_became_peered":"2024-09-12T17:36:34.862534+0000","last_unstale":"2024-09-12T19:27:05.692302+0000","last_undegraded":"2024-09-12T19:27:05.692302+0000","last_fullsized":"2024-09-12T19:27:05.692302+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:22.424632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9477394,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":328,"num_read_kb":22960,"num_write":880,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.363062+0000","last_change":"2024-09-12T17:36:38.886369+0000","last_active":"2024-09-12T19:26:55.363062+0000","last_peered":"2024-09-12T19:26:55.363062+0000","last_clean":"2024-09-12T19:26:55.363062+0000","last_became_active":"2024-09-12T17:36:38.885678+0000","last_became_peered":"2024-09-12T17:36:38.885678+0000","last_unstale":"2024-09-12T19:26:55.363062+0000","last_undegraded":"2024-09-12T19:26:55.363062+0000","last_fullsized":"2024-09-12T19:26:55.363062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:06.010071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'409","reported_seq":1088,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.119332+0000","last_change":"2024-09-12T17:36:40.900876+0000","last_active":"2024-09-12T19:29:10.119332+0000","last_peered":"2024-09-12T19:29:10.119332+0000","last_clean":"2024-09-12T19:29:10.119332+0000","last_became_active":"2024-09-12T17:36:40.900295+0000","last_became_peered":"2024-09-12T17:36:40.900295+0000","last_unstale":"2024-09-12T19:29:10.119332+0000","last_undegraded":"2024-09-12T19:29:10.119332+0000","last_fullsized":"2024-09-12T19:29:10.119332+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:17.899103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47862,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":651,"num_read_kb":1074,"num_write":490,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249747+0000","last_change":"2024-09-12T17:36:42.928327+0000","last_active":"2024-09-12T19:27:00.249747+0000","last_peered":"2024-09-12T19:27:00.249747+0000","last_clean":"2024-09-12T19:27:00.249747+0000","last_became_active":"2024-09-12T17:36:42.927716+0000","last_became_peered":"2024-09-12T17:36:42.927716+0000","last_unstale":"2024-09-12T19:27:00.249747+0000","last_undegraded":"2024-09-12T19:27:00.249747+0000","last_fullsized":"2024-09-12T19:27:00.249747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.478941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'114","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:58.451214+0000","last_change":"2024-09-12T17:36:44.943385+0000","last_active":"2024-09-12T19:27:58.451214+0000","last_peered":"2024-09-12T19:27:58.451214+0000","last_clean":"2024-09-12T19:27:58.451214+0000","last_became_active":"2024-09-12T17:36:44.942505+0000","last_became_peered":"2024-09-12T17:36:44.942505+0000","last_unstale":"2024-09-12T19:27:58.451214+0000","last_undegraded":"2024-09-12T19:27:58.451214+0000","last_fullsized":"2024-09-12T19:27:58.451214+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:16.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":134,"num_write":256,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'733","reported_seq":2201,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.626150+0000","last_change":"2024-09-12T17:36:36.882337+0000","last_active":"2024-09-12T19:28:02.626150+0000","last_peered":"2024-09-12T19:28:02.626150+0000","last_clean":"2024-09-12T19:28:02.626150+0000","last_became_active":"2024-09-12T17:36:36.881456+0000","last_became_peered":"2024-09-12T17:36:36.881456+0000","last_unstale":"2024-09-12T19:28:02.626150+0000","last_undegraded":"2024-09-12T19:28:02.626150+0000","last_fullsized":"2024-09-12T19:28:02.626150+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:26.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3432,"num_read_kb":3120,"num_write":969,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.091239+0000","last_change":"2024-09-12T17:36:16.723179+0000","last_active":"2024-09-12T19:26:55.091239+0000","last_peered":"2024-09-12T19:26:55.091239+0000","last_clean":"2024-09-12T19:26:55.091239+0000","last_became_active":"2024-09-12T17:36:16.722334+0000","last_became_peered":"2024-09-12T17:36:16.722334+0000","last_unstale":"2024-09-12T19:26:55.091239+0000","last_undegraded":"2024-09-12T19:26:55.091239+0000","last_fullsized":"2024-09-12T19:26:55.091239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_clean_scrub_stamp":"2024-09-12T17:36:15.696738+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:31.267846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.361940+0000","last_change":"2024-09-12T17:36:23.787411+0000","last_active":"2024-09-12T19:26:50.361940+0000","last_peered":"2024-09-12T19:26:50.361940+0000","last_clean":"2024-09-12T19:26:50.361940+0000","last_became_active":"2024-09-12T17:36:21.777852+0000","last_became_peered":"2024-09-12T17:36:21.777852+0000","last_unstale":"2024-09-12T19:26:50.361940+0000","last_undegraded":"2024-09-12T19:26:50.361940+0000","last_fullsized":"2024-09-12T19:26:50.361940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:45.393945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019340550000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'318","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691212+0000","last_change":"2024-09-12T17:36:34.870746+0000","last_active":"2024-09-12T19:27:00.691212+0000","last_peered":"2024-09-12T19:27:00.691212+0000","last_clean":"2024-09-12T19:27:00.691212+0000","last_became_active":"2024-09-12T17:36:34.865550+0000","last_became_peered":"2024-09-12T17:36:34.865550+0000","last_unstale":"2024-09-12T19:27:00.691212+0000","last_undegraded":"2024-09-12T19:27:00.691212+0000","last_fullsized":"2024-09-12T19:27:00.691212+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:37.982105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5645323,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":608,"num_read_kb":15438,"num_write":1409,"num_write_kb":31533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602989+0000","last_change":"2024-09-12T17:36:38.892479+0000","last_active":"2024-09-12T19:27:05.602989+0000","last_peered":"2024-09-12T19:27:05.602989+0000","last_clean":"2024-09-12T19:27:05.602989+0000","last_became_active":"2024-09-12T17:36:38.891774+0000","last_became_peered":"2024-09-12T17:36:38.891774+0000","last_unstale":"2024-09-12T19:27:05.602989+0000","last_undegraded":"2024-09-12T19:27:05.602989+0000","last_fullsized":"2024-09-12T19:27:05.602989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:04.757971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'732","reported_seq":1464,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.019633+0000","last_change":"2024-09-12T17:36:40.886469+0000","last_active":"2024-09-12T19:29:22.019633+0000","last_peered":"2024-09-12T19:29:22.019633+0000","last_clean":"2024-09-12T19:29:22.019633+0000","last_became_active":"2024-09-12T17:36:40.885684+0000","last_became_peered":"2024-09-12T17:36:40.885684+0000","last_unstale":"2024-09-12T19:29:22.019633+0000","last_undegraded":"2024-09-12T19:29:22.019633+0000","last_fullsized":"2024-09-12T19:29:22.019633+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:17.424179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165348,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1405,"num_read_kb":2814,"num_write":1352,"num_write_kb":1180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263697+0000","last_change":"2024-09-12T17:36:42.919971+0000","last_active":"2024-09-12T19:27:15.263697+0000","last_peered":"2024-09-12T19:27:15.263697+0000","last_clean":"2024-09-12T19:27:15.263697+0000","last_became_active":"2024-09-12T17:36:42.919204+0000","last_became_peered":"2024-09-12T17:36:42.919204+0000","last_unstale":"2024-09-12T19:27:15.263697+0000","last_undegraded":"2024-09-12T19:27:15.263697+0000","last_fullsized":"2024-09-12T19:27:15.263697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:28.580042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'184","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.702184+0000","last_change":"2024-09-12T17:36:44.954972+0000","last_active":"2024-09-12T19:28:02.702184+0000","last_peered":"2024-09-12T19:28:02.702184+0000","last_clean":"2024-09-12T19:28:02.702184+0000","last_became_active":"2024-09-12T17:36:44.954321+0000","last_became_peered":"2024-09-12T17:36:44.954321+0000","last_unstale":"2024-09-12T19:28:02.702184+0000","last_undegraded":"2024-09-12T19:28:02.702184+0000","last_fullsized":"2024-09-12T19:28:02.702184+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:09.226720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":488,"num_write":378,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'504","reported_seq":2085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.262524+0000","last_change":"2024-09-12T17:36:36.907852+0000","last_active":"2024-09-12T19:27:10.262524+0000","last_peered":"2024-09-12T19:27:10.262524+0000","last_clean":"2024-09-12T19:27:10.262524+0000","last_became_active":"2024-09-12T17:36:36.906789+0000","last_became_peered":"2024-09-12T17:36:36.906789+0000","last_unstale":"2024-09-12T19:27:10.262524+0000","last_undegraded":"2024-09-12T19:27:10.262524+0000","last_fullsized":"2024-09-12T19:27:10.262524+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:22.056362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2691,"num_read_kb":2505,"num_write":636,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.362890+0000","last_change":"2024-09-12T17:36:23.786635+0000","last_active":"2024-09-12T19:26:55.362890+0000","last_peered":"2024-09-12T19:26:55.362890+0000","last_clean":"2024-09-12T19:26:55.362890+0000","last_became_active":"2024-09-12T17:36:21.785026+0000","last_became_peered":"2024-09-12T17:36:21.785026+0000","last_unstale":"2024-09-12T19:26:55.362890+0000","last_undegraded":"2024-09-12T19:26:55.362890+0000","last_fullsized":"2024-09-12T19:26:55.362890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:07.883744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184601,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'320","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.049444+0000","last_change":"2024-09-12T17:36:34.885024+0000","last_active":"2024-09-12T19:26:59.049444+0000","last_peered":"2024-09-12T19:26:59.049444+0000","last_clean":"2024-09-12T19:26:59.049444+0000","last_became_active":"2024-09-12T17:36:34.882818+0000","last_became_peered":"2024-09-12T17:36:34.882818+0000","last_unstale":"2024-09-12T19:26:59.049444+0000","last_undegraded":"2024-09-12T19:26:59.049444+0000","last_fullsized":"2024-09-12T19:26:59.049444+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:00.872257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4458353,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":553,"num_read_kb":22197,"num_write":1262,"num_write_kb":15503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366617+0000","last_change":"2024-09-12T17:36:38.895923+0000","last_active":"2024-09-12T19:27:10.366617+0000","last_peered":"2024-09-12T19:27:10.366617+0000","last_clean":"2024-09-12T19:27:10.366617+0000","last_became_active":"2024-09-12T17:36:38.895378+0000","last_became_peered":"2024-09-12T17:36:38.895378+0000","last_unstale":"2024-09-12T19:27:10.366617+0000","last_undegraded":"2024-09-12T19:27:10.366617+0000","last_fullsized":"2024-09-12T19:27:10.366617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:49.295916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1435","reported_seq":3773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.079442+0000","last_change":"2024-09-12T17:36:40.909473+0000","last_active":"2024-09-12T19:29:25.079442+0000","last_peered":"2024-09-12T19:29:25.079442+0000","last_clean":"2024-09-12T19:29:25.079442+0000","last_became_active":"2024-09-12T17:36:40.908721+0000","last_became_peered":"2024-09-12T17:36:40.908721+0000","last_unstale":"2024-09-12T19:29:25.079442+0000","last_undegraded":"2024-09-12T19:29:25.079442+0000","last_fullsized":"2024-09-12T19:29:25.079442+0000","mapping_epoch":30,"log_start":"265'1400","ondisk_log_start":"265'1400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:39.239469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179443,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2228,"num_read_kb":3772,"num_write":1364,"num_write_kb":1128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:35.342807+0000","last_change":"2024-09-12T17:36:42.918278+0000","last_active":"2024-09-12T19:25:35.342807+0000","last_peered":"2024-09-12T19:25:35.342807+0000","last_clean":"2024-09-12T19:25:35.342807+0000","last_became_active":"2024-09-12T17:36:42.917432+0000","last_became_peered":"2024-09-12T17:36:42.917432+0000","last_unstale":"2024-09-12T19:25:35.342807+0000","last_undegraded":"2024-09-12T19:25:35.342807+0000","last_fullsized":"2024-09-12T19:25:35.342807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:35.437908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'252","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:59.716094+0000","last_change":"2024-09-12T17:36:44.959827+0000","last_active":"2024-09-12T19:27:59.716094+0000","last_peered":"2024-09-12T19:27:59.716094+0000","last_clean":"2024-09-12T19:27:59.716094+0000","last_became_active":"2024-09-12T17:36:44.956687+0000","last_became_peered":"2024-09-12T17:36:44.956687+0000","last_unstale":"2024-09-12T19:27:59.716094+0000","last_undegraded":"2024-09-12T19:27:59.716094+0000","last_fullsized":"2024-09-12T19:27:59.716094+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:45.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":419,"num_write":569,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'457","reported_seq":1909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.363563+0000","last_change":"2024-09-12T17:36:36.877140+0000","last_active":"2024-09-12T19:28:00.363563+0000","last_peered":"2024-09-12T19:28:00.363563+0000","last_clean":"2024-09-12T19:28:00.363563+0000","last_became_active":"2024-09-12T17:36:36.876424+0000","last_became_peered":"2024-09-12T17:36:36.876424+0000","last_unstale":"2024-09-12T19:28:00.363563+0000","last_undegraded":"2024-09-12T19:28:00.363563+0000","last_fullsized":"2024-09-12T19:28:00.363563+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:09.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2313,"num_read_kb":2138,"num_write":582,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670217+0000","last_change":"2024-09-12T17:36:23.789501+0000","last_active":"2024-09-12T19:26:50.670217+0000","last_peered":"2024-09-12T19:26:50.670217+0000","last_clean":"2024-09-12T19:26:50.670217+0000","last_became_active":"2024-09-12T17:36:21.786793+0000","last_became_peered":"2024-09-12T17:36:21.786793+0000","last_unstale":"2024-09-12T19:26:50.670217+0000","last_undegraded":"2024-09-12T19:26:50.670217+0000","last_fullsized":"2024-09-12T19:26:50.670217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:31.878088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011925740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'269","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261041+0000","last_change":"2024-09-12T17:36:34.879706+0000","last_active":"2024-09-12T19:27:05.261041+0000","last_peered":"2024-09-12T19:27:05.261041+0000","last_clean":"2024-09-12T19:27:05.261041+0000","last_became_active":"2024-09-12T17:36:34.878944+0000","last_became_peered":"2024-09-12T17:36:34.878944+0000","last_unstale":"2024-09-12T19:27:05.261041+0000","last_undegraded":"2024-09-12T19:27:05.261041+0000","last_fullsized":"2024-09-12T19:27:05.261041+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:35.362609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10044398,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":464,"num_read_kb":44432,"num_write":1056,"num_write_kb":34964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675306+0000","last_change":"2024-09-12T17:36:38.908387+0000","last_active":"2024-09-12T19:27:10.675306+0000","last_peered":"2024-09-12T19:27:10.675306+0000","last_clean":"2024-09-12T19:27:10.675306+0000","last_became_active":"2024-09-12T17:36:38.907685+0000","last_became_peered":"2024-09-12T17:36:38.907685+0000","last_unstale":"2024-09-12T19:27:10.675306+0000","last_undegraded":"2024-09-12T19:27:10.675306+0000","last_fullsized":"2024-09-12T19:27:10.675306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:58.506591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'385","reported_seq":2346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.224631+0000","last_change":"2024-09-12T17:36:40.907875+0000","last_active":"2024-09-12T19:29:22.224631+0000","last_peered":"2024-09-12T19:29:22.224631+0000","last_clean":"2024-09-12T19:29:22.224631+0000","last_became_active":"2024-09-12T17:36:40.907340+0000","last_became_peered":"2024-09-12T17:36:40.907340+0000","last_unstale":"2024-09-12T19:29:22.224631+0000","last_undegraded":"2024-09-12T19:29:22.224631+0000","last_fullsized":"2024-09-12T19:29:22.224631+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:01.365979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":374,"num_read_kb":364,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.693668+0000","last_change":"2024-09-12T17:36:42.932731+0000","last_active":"2024-09-12T19:27:10.693668+0000","last_peered":"2024-09-12T19:27:10.693668+0000","last_clean":"2024-09-12T19:27:10.693668+0000","last_became_active":"2024-09-12T17:36:42.931884+0000","last_became_peered":"2024-09-12T17:36:42.931884+0000","last_unstale":"2024-09-12T19:27:10.693668+0000","last_undegraded":"2024-09-12T19:27:10.693668+0000","last_fullsized":"2024-09-12T19:27:10.693668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:21.823146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'257","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.184602+0000","last_change":"2024-09-12T17:36:44.940743+0000","last_active":"2024-09-12T19:28:03.184602+0000","last_peered":"2024-09-12T19:28:03.184602+0000","last_clean":"2024-09-12T19:28:03.184602+0000","last_became_active":"2024-09-12T17:36:44.940041+0000","last_became_peered":"2024-09-12T17:36:44.940041+0000","last_unstale":"2024-09-12T19:28:03.184602+0000","last_undegraded":"2024-09-12T19:28:03.184602+0000","last_fullsized":"2024-09-12T19:28:03.184602+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:45.197303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":565,"num_write":575,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'749","reported_seq":2219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181845+0000","last_change":"2024-09-12T17:36:36.897102+0000","last_active":"2024-09-12T19:27:10.181845+0000","last_peered":"2024-09-12T19:27:10.181845+0000","last_clean":"2024-09-12T19:27:10.181845+0000","last_became_active":"2024-09-12T17:36:36.896152+0000","last_became_peered":"2024-09-12T17:36:36.896152+0000","last_unstale":"2024-09-12T19:27:10.181845+0000","last_undegraded":"2024-09-12T19:27:10.181845+0000","last_fullsized":"2024-09-12T19:27:10.181845+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:23.827520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3496,"num_read_kb":3152,"num_write":986,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":552,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.361888+0000","last_change":"2024-09-12T17:36:23.787252+0000","last_active":"2024-09-12T19:26:50.361888+0000","last_peered":"2024-09-12T19:26:50.361888+0000","last_clean":"2024-09-12T19:26:50.361888+0000","last_became_active":"2024-09-12T17:36:21.777173+0000","last_became_peered":"2024-09-12T17:36:21.777173+0000","last_unstale":"2024-09-12T19:26:50.361888+0000","last_undegraded":"2024-09-12T19:26:50.361888+0000","last_fullsized":"2024-09-12T19:26:50.361888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:26.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001776889,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'295","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.138619+0000","last_change":"2024-09-12T17:37:07.868392+0000","last_active":"2024-09-12T19:29:20.138619+0000","last_peered":"2024-09-12T19:29:20.138619+0000","last_clean":"2024-09-12T19:29:20.138619+0000","last_became_active":"2024-09-12T17:37:07.867652+0000","last_became_peered":"2024-09-12T17:37:07.867652+0000","last_unstale":"2024-09-12T19:29:20.138619+0000","last_undegraded":"2024-09-12T19:29:20.138619+0000","last_fullsized":"2024-09-12T19:29:20.138619+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:35.602532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663260,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":580,"num_read_kb":7398,"num_write":1078,"num_write_kb":18590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:25.678699+0000","last_change":"2024-09-12T17:36:38.912854+0000","last_active":"2024-09-12T19:27:25.678699+0000","last_peered":"2024-09-12T19:27:25.678699+0000","last_clean":"2024-09-12T19:27:25.678699+0000","last_became_active":"2024-09-12T17:36:38.912059+0000","last_became_peered":"2024-09-12T17:36:38.912059+0000","last_unstale":"2024-09-12T19:27:25.678699+0000","last_undegraded":"2024-09-12T19:27:25.678699+0000","last_fullsized":"2024-09-12T19:27:25.678699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:05.736408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'216","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.294596+0000","last_change":"2024-09-12T17:36:40.885516+0000","last_active":"2024-09-12T19:29:20.294596+0000","last_peered":"2024-09-12T19:29:20.294596+0000","last_clean":"2024-09-12T19:29:20.294596+0000","last_became_active":"2024-09-12T17:36:40.884794+0000","last_became_peered":"2024-09-12T17:36:40.884794+0000","last_unstale":"2024-09-12T19:29:20.294596+0000","last_undegraded":"2024-09-12T19:29:20.294596+0000","last_fullsized":"2024-09-12T19:29:20.294596+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:21.742525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":278,"num_read_kb":269,"num_write":202,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.367743+0000","last_change":"2024-09-12T17:36:42.921806+0000","last_active":"2024-09-12T19:27:15.367743+0000","last_peered":"2024-09-12T19:27:15.367743+0000","last_clean":"2024-09-12T19:27:15.367743+0000","last_became_active":"2024-09-12T17:36:42.920887+0000","last_became_peered":"2024-09-12T17:36:42.920887+0000","last_unstale":"2024-09-12T19:27:15.367743+0000","last_undegraded":"2024-09-12T19:27:15.367743+0000","last_fullsized":"2024-09-12T19:27:15.367743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:38.116745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'126","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.095950+0000","last_change":"2024-09-12T17:36:44.938503+0000","last_active":"2024-09-12T19:27:15.095950+0000","last_peered":"2024-09-12T19:27:15.095950+0000","last_clean":"2024-09-12T19:27:15.095950+0000","last_became_active":"2024-09-12T17:36:44.937666+0000","last_became_peered":"2024-09-12T17:36:44.937666+0000","last_unstale":"2024-09-12T19:27:15.095950+0000","last_undegraded":"2024-09-12T19:27:15.095950+0000","last_fullsized":"2024-09-12T19:27:15.095950+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:23.897144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":289,"num_read_kb":276,"num_write":312,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'528","reported_seq":2139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.120710+0000","last_change":"2024-09-12T17:36:36.881070+0000","last_active":"2024-09-12T19:28:32.120710+0000","last_peered":"2024-09-12T19:28:32.120710+0000","last_clean":"2024-09-12T19:28:32.120710+0000","last_became_active":"2024-09-12T17:36:36.880335+0000","last_became_peered":"2024-09-12T17:36:36.880335+0000","last_unstale":"2024-09-12T19:28:32.120710+0000","last_undegraded":"2024-09-12T19:28:32.120710+0000","last_fullsized":"2024-09-12T19:28:32.120710+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:22.571992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2654,"num_read_kb":2484,"num_write":644,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'304","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.631813+0000","last_change":"2024-09-12T17:36:34.878244+0000","last_active":"2024-09-12T19:27:38.631813+0000","last_peered":"2024-09-12T19:27:38.631813+0000","last_clean":"2024-09-12T19:27:38.631813+0000","last_became_active":"2024-09-12T17:36:34.877412+0000","last_became_peered":"2024-09-12T17:36:34.877412+0000","last_unstale":"2024-09-12T19:27:38.631813+0000","last_undegraded":"2024-09-12T19:27:38.631813+0000","last_fullsized":"2024-09-12T19:27:38.631813+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:42.929889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20396436,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":459,"num_read_kb":26718,"num_write":1098,"num_write_kb":36792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":555,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.257613+0000","last_change":"2024-09-12T17:36:23.789441+0000","last_active":"2024-09-12T19:26:50.257613+0000","last_peered":"2024-09-12T19:26:50.257613+0000","last_clean":"2024-09-12T19:26:50.257613+0000","last_became_active":"2024-09-12T17:36:21.786429+0000","last_became_peered":"2024-09-12T17:36:21.786429+0000","last_unstale":"2024-09-12T19:26:50.257613+0000","last_undegraded":"2024-09-12T19:26:50.257613+0000","last_fullsized":"2024-09-12T19:26:50.257613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:14.667779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011387680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"36'5","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.905407+0000","last_change":"2024-09-12T17:36:38.903117+0000","last_active":"2024-09-12T19:29:21.905407+0000","last_peered":"2024-09-12T19:29:21.905407+0000","last_clean":"2024-09-12T19:29:21.905407+0000","last_became_active":"2024-09-12T17:36:38.902432+0000","last_became_peered":"2024-09-12T17:36:38.902432+0000","last_unstale":"2024-09-12T19:29:21.905407+0000","last_undegraded":"2024-09-12T19:29:21.905407+0000","last_fullsized":"2024-09-12T19:29:21.905407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:28.729642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'744","reported_seq":1472,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.999995+0000","last_change":"2024-09-12T17:36:40.903273+0000","last_active":"2024-09-12T19:29:21.999995+0000","last_peered":"2024-09-12T19:29:21.999995+0000","last_clean":"2024-09-12T19:29:21.999995+0000","last_became_active":"2024-09-12T17:36:40.902488+0000","last_became_peered":"2024-09-12T17:36:40.902488+0000","last_unstale":"2024-09-12T19:29:21.999995+0000","last_undegraded":"2024-09-12T19:29:21.999995+0000","last_fullsized":"2024-09-12T19:29:21.999995+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:44.794951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114766,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1929,"num_read_kb":2923,"num_write":2602,"num_write_kb":2363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.251784+0000","last_change":"2024-09-12T17:36:42.932443+0000","last_active":"2024-09-12T19:27:10.251784+0000","last_peered":"2024-09-12T19:27:10.251784+0000","last_clean":"2024-09-12T19:27:10.251784+0000","last_became_active":"2024-09-12T17:36:42.931746+0000","last_became_peered":"2024-09-12T17:36:42.931746+0000","last_unstale":"2024-09-12T19:27:10.251784+0000","last_undegraded":"2024-09-12T19:27:10.251784+0000","last_fullsized":"2024-09-12T19:27:10.251784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:17.226964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'136","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.427148+0000","last_change":"2024-09-12T17:36:44.959931+0000","last_active":"2024-09-12T19:27:55.427148+0000","last_peered":"2024-09-12T19:27:55.427148+0000","last_clean":"2024-09-12T19:27:55.427148+0000","last_became_active":"2024-09-12T17:36:44.959109+0000","last_became_peered":"2024-09-12T17:36:44.959109+0000","last_unstale":"2024-09-12T19:27:55.427148+0000","last_undegraded":"2024-09-12T19:27:55.427148+0000","last_fullsized":"2024-09-12T19:27:55.427148+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:21.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'606","reported_seq":2146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.022973+0000","last_change":"2024-09-12T17:36:36.884101+0000","last_active":"2024-09-12T19:29:21.022973+0000","last_peered":"2024-09-12T19:29:21.022973+0000","last_clean":"2024-09-12T19:29:21.022973+0000","last_became_active":"2024-09-12T17:36:36.883397+0000","last_became_peered":"2024-09-12T17:36:36.883397+0000","last_unstale":"2024-09-12T19:29:21.022973+0000","last_undegraded":"2024-09-12T19:29:21.022973+0000","last_fullsized":"2024-09-12T19:29:21.022973+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:32.872711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3050,"num_read_kb":2738,"num_write":793,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'298","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.049575+0000","last_change":"2024-09-12T17:36:34.892972+0000","last_active":"2024-09-12T19:26:59.049575+0000","last_peered":"2024-09-12T19:26:59.049575+0000","last_clean":"2024-09-12T19:26:59.049575+0000","last_became_active":"2024-09-12T17:36:34.892255+0000","last_became_peered":"2024-09-12T17:36:34.892255+0000","last_unstale":"2024-09-12T19:26:59.049575+0000","last_undegraded":"2024-09-12T19:26:59.049575+0000","last_fullsized":"2024-09-12T19:26:59.049575+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:18.707321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15391900,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":556,"num_read_kb":68904,"num_write":987,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368858+0000","last_change":"2024-09-12T17:36:23.786560+0000","last_active":"2024-09-12T19:27:20.368858+0000","last_peered":"2024-09-12T19:27:20.368858+0000","last_clean":"2024-09-12T19:27:20.368858+0000","last_became_active":"2024-09-12T17:36:21.783069+0000","last_became_peered":"2024-09-12T17:36:21.783069+0000","last_unstale":"2024-09-12T19:27:20.368858+0000","last_undegraded":"2024-09-12T19:27:20.368858+0000","last_fullsized":"2024-09-12T19:27:20.368858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:06.261529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135285,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602908+0000","last_change":"2024-09-12T17:36:38.901020+0000","last_active":"2024-09-12T19:27:05.602908+0000","last_peered":"2024-09-12T19:27:05.602908+0000","last_clean":"2024-09-12T19:27:05.602908+0000","last_became_active":"2024-09-12T17:36:38.900433+0000","last_became_peered":"2024-09-12T17:36:38.900433+0000","last_unstale":"2024-09-12T19:27:05.602908+0000","last_undegraded":"2024-09-12T19:27:05.602908+0000","last_fullsized":"2024-09-12T19:27:05.602908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:42.477669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'247","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:34.719450+0000","last_change":"2024-09-12T17:36:40.887225+0000","last_active":"2024-09-12T19:27:34.719450+0000","last_peered":"2024-09-12T19:27:34.719450+0000","last_clean":"2024-09-12T19:27:34.719450+0000","last_became_active":"2024-09-12T17:36:40.886345+0000","last_became_peered":"2024-09-12T17:36:40.886345+0000","last_unstale":"2024-09-12T19:27:34.719450+0000","last_undegraded":"2024-09-12T19:27:34.719450+0000","last_fullsized":"2024-09-12T19:27:34.719450+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:50.264902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'801","reported_seq":3497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.080315+0000","last_change":"2024-09-12T17:36:42.932438+0000","last_active":"2024-09-12T19:29:25.080315+0000","last_peered":"2024-09-12T19:29:25.080315+0000","last_clean":"2024-09-12T19:29:25.080315+0000","last_became_active":"2024-09-12T17:36:42.931598+0000","last_became_peered":"2024-09-12T17:36:42.931598+0000","last_unstale":"2024-09-12T19:29:25.080315+0000","last_undegraded":"2024-09-12T19:29:25.080315+0000","last_fullsized":"2024-09-12T19:29:25.080315+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:00.606220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'133","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.059775+0000","last_change":"2024-09-12T17:36:44.952618+0000","last_active":"2024-09-12T19:29:22.059775+0000","last_peered":"2024-09-12T19:29:22.059775+0000","last_clean":"2024-09-12T19:29:22.059775+0000","last_became_active":"2024-09-12T17:36:44.951849+0000","last_became_peered":"2024-09-12T17:36:44.951849+0000","last_unstale":"2024-09-12T19:29:22.059775+0000","last_undegraded":"2024-09-12T19:29:22.059775+0000","last_fullsized":"2024-09-12T19:29:22.059775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:49.786200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'742","reported_seq":2375,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691100+0000","last_change":"2024-09-12T17:36:36.893671+0000","last_active":"2024-09-12T19:27:00.691100+0000","last_peered":"2024-09-12T19:27:00.691100+0000","last_clean":"2024-09-12T19:27:00.691100+0000","last_became_active":"2024-09-12T17:36:36.892861+0000","last_became_peered":"2024-09-12T17:36:36.892861+0000","last_unstale":"2024-09-12T19:27:00.691100+0000","last_undegraded":"2024-09-12T19:27:00.691100+0000","last_fullsized":"2024-09-12T19:27:00.691100+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:54.133834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3560,"num_read_kb":3257,"num_write":956,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'294","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.692527+0000","last_change":"2024-09-12T17:36:34.883910+0000","last_active":"2024-09-12T19:27:05.692527+0000","last_peered":"2024-09-12T19:27:05.692527+0000","last_clean":"2024-09-12T19:27:05.692527+0000","last_became_active":"2024-09-12T17:36:34.883331+0000","last_became_peered":"2024-09-12T17:36:34.883331+0000","last_unstale":"2024-09-12T19:27:05.692527+0000","last_undegraded":"2024-09-12T19:27:05.692527+0000","last_fullsized":"2024-09-12T19:27:05.692527+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:14.534598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243609,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":458,"num_read_kb":26130,"num_write":1124,"num_write_kb":40752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":555,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690113+0000","last_change":"2024-09-12T17:36:24.506296+0000","last_active":"2024-09-12T19:26:55.690113+0000","last_peered":"2024-09-12T19:26:55.690113+0000","last_clean":"2024-09-12T19:26:55.690113+0000","last_became_active":"2024-09-12T17:36:22.059379+0000","last_became_peered":"2024-09-12T17:36:22.059379+0000","last_unstale":"2024-09-12T19:26:55.690113+0000","last_undegraded":"2024-09-12T19:26:55.690113+0000","last_fullsized":"2024-09-12T19:26:55.690113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:24.672143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012087210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.365102+0000","last_change":"2024-09-12T17:36:38.892129+0000","last_active":"2024-09-12T19:27:05.365102+0000","last_peered":"2024-09-12T19:27:05.365102+0000","last_clean":"2024-09-12T19:27:05.365102+0000","last_became_active":"2024-09-12T17:36:38.891807+0000","last_became_peered":"2024-09-12T17:36:38.891807+0000","last_unstale":"2024-09-12T19:27:05.365102+0000","last_undegraded":"2024-09-12T19:27:05.365102+0000","last_fullsized":"2024-09-12T19:27:05.365102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:48.578150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'173","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:33.637507+0000","last_change":"2024-09-12T17:36:40.898576+0000","last_active":"2024-09-12T19:27:33.637507+0000","last_peered":"2024-09-12T19:27:33.637507+0000","last_clean":"2024-09-12T19:27:33.637507+0000","last_became_active":"2024-09-12T17:36:40.897763+0000","last_became_peered":"2024-09-12T17:36:40.897763+0000","last_unstale":"2024-09-12T19:27:33.637507+0000","last_undegraded":"2024-09-12T19:27:33.637507+0000","last_fullsized":"2024-09-12T19:27:33.637507+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:41.559054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'797","reported_seq":3144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.067722+0000","last_change":"2024-09-12T17:36:42.930005+0000","last_active":"2024-09-12T19:29:25.067722+0000","last_peered":"2024-09-12T19:29:25.067722+0000","last_clean":"2024-09-12T19:29:25.067722+0000","last_became_active":"2024-09-12T17:36:42.928978+0000","last_became_peered":"2024-09-12T17:36:42.928978+0000","last_unstale":"2024-09-12T19:29:25.067722+0000","last_undegraded":"2024-09-12T19:29:25.067722+0000","last_fullsized":"2024-09-12T19:29:25.067722+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:50.493434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'235","reported_seq":781,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.583893+0000","last_change":"2024-09-12T17:36:44.960384+0000","last_active":"2024-09-12T19:28:02.583893+0000","last_peered":"2024-09-12T19:28:02.583893+0000","last_clean":"2024-09-12T19:28:02.583893+0000","last_became_active":"2024-09-12T17:36:44.956784+0000","last_became_peered":"2024-09-12T17:36:44.956784+0000","last_unstale":"2024-09-12T19:28:02.583893+0000","last_undegraded":"2024-09-12T19:28:02.583893+0000","last_fullsized":"2024-09-12T19:28:02.583893+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:30.401098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":233,"num_read_kb":216,"num_write":428,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'373","reported_seq":2039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250850+0000","last_change":"2024-09-12T17:36:36.884169+0000","last_active":"2024-09-12T19:27:05.250850+0000","last_peered":"2024-09-12T19:27:05.250850+0000","last_clean":"2024-09-12T19:27:05.250850+0000","last_became_active":"2024-09-12T17:36:36.883862+0000","last_became_peered":"2024-09-12T17:36:36.883862+0000","last_unstale":"2024-09-12T19:27:05.250850+0000","last_undegraded":"2024-09-12T19:27:05.250850+0000","last_fullsized":"2024-09-12T19:27:05.250850+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:01.097363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2422,"num_read_kb":2340,"num_write":416,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'287","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.692494+0000","last_change":"2024-09-12T17:36:34.869612+0000","last_active":"2024-09-12T19:27:05.692494+0000","last_peered":"2024-09-12T19:27:05.692494+0000","last_clean":"2024-09-12T19:27:05.692494+0000","last_became_active":"2024-09-12T17:36:34.868641+0000","last_became_peered":"2024-09-12T17:36:34.868641+0000","last_unstale":"2024-09-12T19:27:05.692494+0000","last_undegraded":"2024-09-12T19:27:05.692494+0000","last_fullsized":"2024-09-12T19:27:05.692494+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:13.423256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8059094,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":485,"num_read_kb":35743,"num_write":1119,"num_write_kb":32710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":548,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.363084+0000","last_change":"2024-09-12T17:36:23.787880+0000","last_active":"2024-09-12T19:26:55.363084+0000","last_peered":"2024-09-12T19:26:55.363084+0000","last_clean":"2024-09-12T19:26:55.363084+0000","last_became_active":"2024-09-12T17:36:22.058794+0000","last_became_peered":"2024-09-12T17:36:22.058794+0000","last_unstale":"2024-09-12T19:26:55.363084+0000","last_undegraded":"2024-09-12T19:26:55.363084+0000","last_fullsized":"2024-09-12T19:26:55.363084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:04.896637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691146+0000","last_change":"2024-09-12T17:36:38.902092+0000","last_active":"2024-09-12T19:27:00.691146+0000","last_peered":"2024-09-12T19:27:00.691146+0000","last_clean":"2024-09-12T19:27:00.691146+0000","last_became_active":"2024-09-12T17:36:38.901418+0000","last_became_peered":"2024-09-12T17:36:38.901418+0000","last_unstale":"2024-09-12T19:27:00.691146+0000","last_undegraded":"2024-09-12T19:27:00.691146+0000","last_fullsized":"2024-09-12T19:27:00.691146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:20.898210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'796","reported_seq":1570,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.995362+0000","last_change":"2024-09-12T17:36:40.908672+0000","last_active":"2024-09-12T19:29:21.995362+0000","last_peered":"2024-09-12T19:29:21.995362+0000","last_clean":"2024-09-12T19:29:21.995362+0000","last_became_active":"2024-09-12T17:36:40.908231+0000","last_became_peered":"2024-09-12T17:36:40.908231+0000","last_unstale":"2024-09-12T19:29:21.995362+0000","last_undegraded":"2024-09-12T19:29:21.995362+0000","last_fullsized":"2024-09-12T19:29:21.995362+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:35.140601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1393,"num_read_kb":2880,"num_write":1134,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.693604+0000","last_change":"2024-09-12T17:36:42.933142+0000","last_active":"2024-09-12T19:27:10.693604+0000","last_peered":"2024-09-12T19:27:10.693604+0000","last_clean":"2024-09-12T19:27:10.693604+0000","last_became_active":"2024-09-12T17:36:42.932086+0000","last_became_peered":"2024-09-12T17:36:42.932086+0000","last_unstale":"2024-09-12T19:27:10.693604+0000","last_undegraded":"2024-09-12T19:27:10.693604+0000","last_fullsized":"2024-09-12T19:27:10.693604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:49.913999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'126","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249809+0000","last_change":"2024-09-12T17:36:44.961527+0000","last_active":"2024-09-12T19:27:00.249809+0000","last_peered":"2024-09-12T19:27:00.249809+0000","last_clean":"2024-09-12T19:27:00.249809+0000","last_became_active":"2024-09-12T17:36:44.960744+0000","last_became_peered":"2024-09-12T17:36:44.960744+0000","last_unstale":"2024-09-12T19:27:00.249809+0000","last_undegraded":"2024-09-12T19:27:00.249809+0000","last_fullsized":"2024-09-12T19:27:00.249809+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:42.564425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":186,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'135","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.080882+0000","last_change":"2024-09-12T17:36:44.940544+0000","last_active":"2024-09-12T19:28:03.080882+0000","last_peered":"2024-09-12T19:28:03.080882+0000","last_clean":"2024-09-12T19:28:03.080882+0000","last_became_active":"2024-09-12T17:36:44.939820+0000","last_became_peered":"2024-09-12T17:36:44.939820+0000","last_unstale":"2024-09-12T19:28:03.080882+0000","last_undegraded":"2024-09-12T19:28:03.080882+0000","last_fullsized":"2024-09-12T19:28:03.080882+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:23.567209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":235,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'799","reported_seq":2458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.117512+0000","last_change":"2024-09-12T17:36:36.883861+0000","last_active":"2024-09-12T19:28:32.117512+0000","last_peered":"2024-09-12T19:28:32.117512+0000","last_clean":"2024-09-12T19:28:32.117512+0000","last_became_active":"2024-09-12T17:36:36.883481+0000","last_became_peered":"2024-09-12T17:36:36.883481+0000","last_unstale":"2024-09-12T19:28:32.117512+0000","last_undegraded":"2024-09-12T19:28:32.117512+0000","last_fullsized":"2024-09-12T19:28:32.117512+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:44.086651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3831,"num_read_kb":3485,"num_write":1040,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'255","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360876+0000","last_change":"2024-09-12T17:36:34.862214+0000","last_active":"2024-09-12T19:26:45.360876+0000","last_peered":"2024-09-12T19:26:45.360876+0000","last_clean":"2024-09-12T19:26:45.360876+0000","last_became_active":"2024-09-12T17:36:34.861702+0000","last_became_peered":"2024-09-12T17:36:34.861702+0000","last_unstale":"2024-09-12T19:26:45.360876+0000","last_undegraded":"2024-09-12T19:26:45.360876+0000","last_fullsized":"2024-09-12T19:26:45.360876+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:53.824355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8653012,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":408,"num_read_kb":26224,"num_write":989,"num_write_kb":25793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.040900+0000","last_change":"2024-09-12T17:36:38.895498+0000","last_active":"2024-09-12T19:26:19.040900+0000","last_peered":"2024-09-12T19:26:19.040900+0000","last_clean":"2024-09-12T19:26:19.040900+0000","last_became_active":"2024-09-12T17:36:38.894742+0000","last_became_peered":"2024-09-12T17:36:38.894742+0000","last_unstale":"2024-09-12T19:26:19.040900+0000","last_undegraded":"2024-09-12T19:26:19.040900+0000","last_fullsized":"2024-09-12T19:26:19.040900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:33.054267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'322","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:44.072532+0000","last_change":"2024-09-12T17:36:40.893532+0000","last_active":"2024-09-12T19:28:44.072532+0000","last_peered":"2024-09-12T19:28:44.072532+0000","last_clean":"2024-09-12T19:28:44.072532+0000","last_became_active":"2024-09-12T17:36:40.892710+0000","last_became_peered":"2024-09-12T17:36:40.892710+0000","last_unstale":"2024-09-12T19:28:44.072532+0000","last_undegraded":"2024-09-12T19:28:44.072532+0000","last_fullsized":"2024-09-12T19:28:44.072532+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:12.985322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55952,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":978,"num_write":412,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664522+0000","last_change":"2024-09-12T17:36:42.939570+0000","last_active":"2024-09-12T19:26:25.664522+0000","last_peered":"2024-09-12T19:26:25.664522+0000","last_clean":"2024-09-12T19:26:25.664522+0000","last_became_active":"2024-09-12T17:36:42.938834+0000","last_became_peered":"2024-09-12T17:36:42.938834+0000","last_unstale":"2024-09-12T19:26:25.664522+0000","last_undegraded":"2024-09-12T19:26:25.664522+0000","last_fullsized":"2024-09-12T19:26:25.664522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:13.130674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'139","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.674057+0000","last_change":"2024-09-12T17:36:44.953890+0000","last_active":"2024-09-12T19:27:05.674057+0000","last_peered":"2024-09-12T19:27:05.674057+0000","last_clean":"2024-09-12T19:27:05.674057+0000","last_became_active":"2024-09-12T17:36:44.953117+0000","last_became_peered":"2024-09-12T17:36:44.953117+0000","last_unstale":"2024-09-12T19:27:05.674057+0000","last_undegraded":"2024-09-12T19:27:05.674057+0000","last_fullsized":"2024-09-12T19:27:05.674057+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:53.223197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":202,"num_write":357,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'468","reported_seq":2073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682046+0000","last_change":"2024-09-12T17:36:36.901726+0000","last_active":"2024-09-12T19:26:20.682046+0000","last_peered":"2024-09-12T19:26:20.682046+0000","last_clean":"2024-09-12T19:26:20.682046+0000","last_became_active":"2024-09-12T17:36:36.900955+0000","last_became_peered":"2024-09-12T17:36:36.900955+0000","last_unstale":"2024-09-12T19:26:20.682046+0000","last_undegraded":"2024-09-12T19:26:20.682046+0000","last_fullsized":"2024-09-12T19:26:20.682046+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:39.022567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2490,"num_read_kb":2331,"num_write":571,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'264","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:47.673872+0000","last_change":"2024-09-12T17:36:34.878783+0000","last_active":"2024-09-12T19:26:47.673872+0000","last_peered":"2024-09-12T19:26:47.673872+0000","last_clean":"2024-09-12T19:26:47.673872+0000","last_became_active":"2024-09-12T17:36:34.878069+0000","last_became_peered":"2024-09-12T17:36:34.878069+0000","last_unstale":"2024-09-12T19:26:47.673872+0000","last_undegraded":"2024-09-12T19:26:47.673872+0000","last_fullsized":"2024-09-12T19:26:47.673872+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:53.462388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7783745,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":705,"num_read_kb":26278,"num_write":894,"num_write_kb":31119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682090+0000","last_change":"2024-09-12T17:36:38.895965+0000","last_active":"2024-09-12T19:26:20.682090+0000","last_peered":"2024-09-12T19:26:20.682090+0000","last_clean":"2024-09-12T19:26:20.682090+0000","last_became_active":"2024-09-12T17:36:38.894800+0000","last_became_peered":"2024-09-12T17:36:38.894800+0000","last_unstale":"2024-09-12T19:26:20.682090+0000","last_undegraded":"2024-09-12T19:26:20.682090+0000","last_fullsized":"2024-09-12T19:26:20.682090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:45.719885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'81","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:22.977940+0000","last_change":"2024-09-12T17:36:40.910425+0000","last_active":"2024-09-12T19:27:22.977940+0000","last_peered":"2024-09-12T19:27:22.977940+0000","last_clean":"2024-09-12T19:27:22.977940+0000","last_became_active":"2024-09-12T17:36:40.909470+0000","last_became_peered":"2024-09-12T17:36:40.909470+0000","last_unstale":"2024-09-12T19:27:22.977940+0000","last_undegraded":"2024-09-12T19:27:22.977940+0000","last_fullsized":"2024-09-12T19:27:22.977940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:59.636810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242569+0000","last_change":"2024-09-12T17:36:42.923023+0000","last_active":"2024-09-12T19:26:25.242569+0000","last_peered":"2024-09-12T19:26:25.242569+0000","last_clean":"2024-09-12T19:26:25.242569+0000","last_became_active":"2024-09-12T17:36:42.922352+0000","last_became_peered":"2024-09-12T17:36:42.922352+0000","last_unstale":"2024-09-12T19:26:25.242569+0000","last_undegraded":"2024-09-12T19:26:25.242569+0000","last_fullsized":"2024-09-12T19:26:25.242569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:06.521341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'237","reported_seq":778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.928944+0000","last_change":"2024-09-12T17:36:44.946524+0000","last_active":"2024-09-12T19:28:02.928944+0000","last_peered":"2024-09-12T19:28:02.928944+0000","last_clean":"2024-09-12T19:28:02.928944+0000","last_became_active":"2024-09-12T17:36:44.945429+0000","last_became_peered":"2024-09-12T17:36:44.945429+0000","last_unstale":"2024-09-12T19:28:02.928944+0000","last_undegraded":"2024-09-12T19:28:02.928944+0000","last_fullsized":"2024-09-12T19:28:02.928944+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:03.136753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":307,"num_read_kb":303,"num_write":509,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'826","reported_seq":2357,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.322547+0000","last_change":"2024-09-12T17:36:36.901899+0000","last_active":"2024-09-12T19:26:59.322547+0000","last_peered":"2024-09-12T19:26:59.322547+0000","last_clean":"2024-09-12T19:26:59.322547+0000","last_became_active":"2024-09-12T17:36:36.901053+0000","last_became_peered":"2024-09-12T17:36:36.901053+0000","last_unstale":"2024-09-12T19:26:59.322547+0000","last_undegraded":"2024-09-12T19:26:59.322547+0000","last_fullsized":"2024-09-12T19:26:59.322547+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:22.502956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3878,"num_read_kb":3474,"num_write":1082,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'289","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:20.228268+0000","last_change":"2024-09-12T17:36:34.878025+0000","last_active":"2024-09-12T19:25:20.228268+0000","last_peered":"2024-09-12T19:25:20.228268+0000","last_clean":"2024-09-12T19:25:20.228268+0000","last_became_active":"2024-09-12T17:36:34.877620+0000","last_became_peered":"2024-09-12T17:36:34.877620+0000","last_unstale":"2024-09-12T19:25:20.228268+0000","last_undegraded":"2024-09-12T19:25:20.228268+0000","last_fullsized":"2024-09-12T19:25:20.228268+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:44.559070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14748865,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":448,"num_read_kb":51731,"num_write":1016,"num_write_kb":38676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241189+0000","last_change":"2024-09-12T17:36:38.903616+0000","last_active":"2024-09-12T19:26:20.241189+0000","last_peered":"2024-09-12T19:26:20.241189+0000","last_clean":"2024-09-12T19:26:20.241189+0000","last_became_active":"2024-09-12T17:36:38.902188+0000","last_became_peered":"2024-09-12T17:36:38.902188+0000","last_unstale":"2024-09-12T19:26:20.241189+0000","last_undegraded":"2024-09-12T19:26:20.241189+0000","last_fullsized":"2024-09-12T19:26:20.241189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.927110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'372","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.695530+0000","last_change":"2024-09-12T17:36:40.899887+0000","last_active":"2024-09-12T19:28:40.695530+0000","last_peered":"2024-09-12T19:28:40.695530+0000","last_clean":"2024-09-12T19:28:40.695530+0000","last_became_active":"2024-09-12T17:36:40.899201+0000","last_became_peered":"2024-09-12T17:36:40.899201+0000","last_unstale":"2024-09-12T19:28:40.695530+0000","last_undegraded":"2024-09-12T19:28:40.695530+0000","last_fullsized":"2024-09-12T19:28:40.695530+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:19.009661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66074,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":1145,"num_write":480,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.084454+0000","last_change":"2024-09-12T17:36:42.930518+0000","last_active":"2024-09-12T19:26:25.084454+0000","last_peered":"2024-09-12T19:26:25.084454+0000","last_clean":"2024-09-12T19:26:25.084454+0000","last_became_active":"2024-09-12T17:36:42.928596+0000","last_became_peered":"2024-09-12T17:36:42.928596+0000","last_unstale":"2024-09-12T19:26:25.084454+0000","last_undegraded":"2024-09-12T19:26:25.084454+0000","last_fullsized":"2024-09-12T19:26:25.084454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:38.476152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'143","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360848+0000","last_change":"2024-09-12T17:36:44.963106+0000","last_active":"2024-09-12T19:26:45.360848+0000","last_peered":"2024-09-12T19:26:45.360848+0000","last_clean":"2024-09-12T19:26:45.360848+0000","last_became_active":"2024-09-12T17:36:44.962445+0000","last_became_peered":"2024-09-12T17:36:44.962445+0000","last_unstale":"2024-09-12T19:26:45.360848+0000","last_undegraded":"2024-09-12T19:26:45.360848+0000","last_fullsized":"2024-09-12T19:26:45.360848+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:03.293578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":234,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'601","reported_seq":2246,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.663326+0000","last_change":"2024-09-12T17:36:36.904547+0000","last_active":"2024-09-12T19:26:20.663326+0000","last_peered":"2024-09-12T19:26:20.663326+0000","last_clean":"2024-09-12T19:26:20.663326+0000","last_became_active":"2024-09-12T17:36:36.903813+0000","last_became_peered":"2024-09-12T17:36:36.903813+0000","last_unstale":"2024-09-12T19:26:20.663326+0000","last_undegraded":"2024-09-12T19:26:20.663326+0000","last_fullsized":"2024-09-12T19:26:20.663326+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:28.273003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3115,"num_read_kb":2836,"num_write":758,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'244","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.910712+0000","last_change":"2024-09-12T17:36:34.887548+0000","last_active":"2024-09-12T19:27:38.910712+0000","last_peered":"2024-09-12T19:27:38.910712+0000","last_clean":"2024-09-12T19:27:38.910712+0000","last_became_active":"2024-09-12T17:36:34.886741+0000","last_became_peered":"2024-09-12T17:36:34.886741+0000","last_unstale":"2024-09-12T19:27:38.910712+0000","last_undegraded":"2024-09-12T19:27:38.910712+0000","last_fullsized":"2024-09-12T19:27:38.910712+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:29.979024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4139249,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":404,"num_read_kb":24643,"num_write":953,"num_write_kb":38417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.353955+0000","last_change":"2024-09-12T17:36:38.903818+0000","last_active":"2024-09-12T19:26:20.353955+0000","last_peered":"2024-09-12T19:26:20.353955+0000","last_clean":"2024-09-12T19:26:20.353955+0000","last_became_active":"2024-09-12T17:36:38.903210+0000","last_became_peered":"2024-09-12T17:36:38.903210+0000","last_unstale":"2024-09-12T19:26:20.353955+0000","last_undegraded":"2024-09-12T19:26:20.353955+0000","last_fullsized":"2024-09-12T19:26:20.353955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:00.851761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'303","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.622156+0000","last_change":"2024-09-12T17:36:40.913086+0000","last_active":"2024-09-12T19:28:40.622156+0000","last_peered":"2024-09-12T19:28:40.622156+0000","last_clean":"2024-09-12T19:28:40.622156+0000","last_became_active":"2024-09-12T17:36:40.912283+0000","last_became_peered":"2024-09-12T17:36:40.912283+0000","last_unstale":"2024-09-12T19:28:40.622156+0000","last_undegraded":"2024-09-12T19:28:40.622156+0000","last_fullsized":"2024-09-12T19:28:40.622156+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:05.161253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58005,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":495,"num_read_kb":989,"num_write":398,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664637+0000","last_change":"2024-09-12T17:36:42.928432+0000","last_active":"2024-09-12T19:26:25.664637+0000","last_peered":"2024-09-12T19:26:25.664637+0000","last_clean":"2024-09-12T19:26:25.664637+0000","last_became_active":"2024-09-12T17:36:42.927724+0000","last_became_peered":"2024-09-12T17:36:42.927724+0000","last_unstale":"2024-09-12T19:26:25.664637+0000","last_undegraded":"2024-09-12T19:26:25.664637+0000","last_fullsized":"2024-09-12T19:26:25.664637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:30.771719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'721","reported_seq":2248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.028622+0000","last_change":"2024-09-12T17:36:36.886104+0000","last_active":"2024-09-12T19:29:21.028622+0000","last_peered":"2024-09-12T19:29:21.028622+0000","last_clean":"2024-09-12T19:29:21.028622+0000","last_became_active":"2024-09-12T17:36:36.885820+0000","last_became_peered":"2024-09-12T17:36:36.885820+0000","last_unstale":"2024-09-12T19:29:21.028622+0000","last_undegraded":"2024-09-12T19:29:21.028622+0000","last_fullsized":"2024-09-12T19:29:21.028622+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.701415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3501,"num_read_kb":3197,"num_write":936,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'277","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.631236+0000","last_change":"2024-09-12T17:36:34.888051+0000","last_active":"2024-09-12T19:27:38.631236+0000","last_peered":"2024-09-12T19:27:38.631236+0000","last_clean":"2024-09-12T19:27:38.631236+0000","last_became_active":"2024-09-12T17:36:34.887018+0000","last_became_peered":"2024-09-12T17:36:34.887018+0000","last_unstale":"2024-09-12T19:27:38.631236+0000","last_undegraded":"2024-09-12T19:27:38.631236+0000","last_fullsized":"2024-09-12T19:27:38.631236+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:00.894469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9444109,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":476,"num_read_kb":38391,"num_write":1011,"num_write_kb":34235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:04.050979+0000","last_change":"2024-09-12T17:36:38.895303+0000","last_active":"2024-09-12T19:27:04.050979+0000","last_peered":"2024-09-12T19:27:04.050979+0000","last_clean":"2024-09-12T19:27:04.050979+0000","last_became_active":"2024-09-12T17:36:38.894452+0000","last_became_peered":"2024-09-12T17:36:38.894452+0000","last_unstale":"2024-09-12T19:27:04.050979+0000","last_undegraded":"2024-09-12T19:27:04.050979+0000","last_fullsized":"2024-09-12T19:27:04.050979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:40.122335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'504","reported_seq":1167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.987702+0000","last_change":"2024-09-12T17:36:40.910273+0000","last_active":"2024-09-12T19:29:21.987702+0000","last_peered":"2024-09-12T19:29:21.987702+0000","last_clean":"2024-09-12T19:29:21.987702+0000","last_became_active":"2024-09-12T17:36:40.909552+0000","last_became_peered":"2024-09-12T17:36:40.909552+0000","last_unstale":"2024-09-12T19:29:21.987702+0000","last_undegraded":"2024-09-12T19:29:21.987702+0000","last_fullsized":"2024-09-12T19:29:21.987702+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:32.101093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120151,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":878,"num_read_kb":1821,"num_write":754,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.247037+0000","last_change":"2024-09-12T17:36:42.943311+0000","last_active":"2024-09-12T19:26:45.247037+0000","last_peered":"2024-09-12T19:26:45.247037+0000","last_clean":"2024-09-12T19:26:45.247037+0000","last_became_active":"2024-09-12T17:36:42.942627+0000","last_became_peered":"2024-09-12T17:36:42.942627+0000","last_unstale":"2024-09-12T19:26:45.247037+0000","last_undegraded":"2024-09-12T19:26:45.247037+0000","last_fullsized":"2024-09-12T19:26:45.247037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:28.862834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'167","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:57.461795+0000","last_change":"2024-09-12T17:36:44.959491+0000","last_active":"2024-09-12T19:27:57.461795+0000","last_peered":"2024-09-12T19:27:57.461795+0000","last_clean":"2024-09-12T19:27:57.461795+0000","last_became_active":"2024-09-12T17:36:44.956655+0000","last_became_peered":"2024-09-12T17:36:44.956655+0000","last_unstale":"2024-09-12T19:27:57.461795+0000","last_undegraded":"2024-09-12T19:27:57.461795+0000","last_fullsized":"2024-09-12T19:27:57.461795+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:59.575861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":241,"num_write":385,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'357","reported_seq":1938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691336+0000","last_change":"2024-09-12T17:36:36.912708+0000","last_active":"2024-09-12T19:27:00.691336+0000","last_peered":"2024-09-12T19:27:00.691336+0000","last_clean":"2024-09-12T19:27:00.691336+0000","last_became_active":"2024-09-12T17:36:36.911889+0000","last_became_peered":"2024-09-12T17:36:36.911889+0000","last_unstale":"2024-09-12T19:27:00.691336+0000","last_undegraded":"2024-09-12T19:27:00.691336+0000","last_fullsized":"2024-09-12T19:27:00.691336+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:52.030740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2021,"num_read_kb":1969,"num_write":390,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'285","reported_seq":1058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.673216+0000","last_change":"2024-09-12T17:36:34.852681+0000","last_active":"2024-09-12T19:25:40.673216+0000","last_peered":"2024-09-12T19:25:40.673216+0000","last_clean":"2024-09-12T19:25:40.673216+0000","last_became_active":"2024-09-12T17:36:34.851161+0000","last_became_peered":"2024-09-12T17:36:34.851161+0000","last_unstale":"2024-09-12T19:25:40.673216+0000","last_undegraded":"2024-09-12T19:25:40.673216+0000","last_fullsized":"2024-09-12T19:25:40.673216+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:27.435874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14503381,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":662,"num_read_kb":47360,"num_write":1031,"num_write_kb":33375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.251083+0000","last_change":"2024-09-12T17:36:38.905238+0000","last_active":"2024-09-12T19:27:05.251083+0000","last_peered":"2024-09-12T19:27:05.251083+0000","last_clean":"2024-09-12T19:27:05.251083+0000","last_became_active":"2024-09-12T17:36:38.904409+0000","last_became_peered":"2024-09-12T17:36:38.904409+0000","last_unstale":"2024-09-12T19:27:05.251083+0000","last_undegraded":"2024-09-12T19:27:05.251083+0000","last_fullsized":"2024-09-12T19:27:05.251083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:40.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'399","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.393502+0000","last_change":"2024-09-12T17:36:40.903223+0000","last_active":"2024-09-12T19:29:10.393502+0000","last_peered":"2024-09-12T19:29:10.393502+0000","last_clean":"2024-09-12T19:29:10.393502+0000","last_became_active":"2024-09-12T17:36:40.902718+0000","last_became_peered":"2024-09-12T17:36:40.902718+0000","last_unstale":"2024-09-12T19:29:10.393502+0000","last_undegraded":"2024-09-12T19:29:10.393502+0000","last_fullsized":"2024-09-12T19:29:10.393502+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.363639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66972,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":666,"num_read_kb":1223,"num_write":558,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.256436+0000","last_change":"2024-09-12T17:36:42.921077+0000","last_active":"2024-09-12T19:26:45.256436+0000","last_peered":"2024-09-12T19:26:45.256436+0000","last_clean":"2024-09-12T19:26:45.256436+0000","last_became_active":"2024-09-12T17:36:42.920352+0000","last_became_peered":"2024-09-12T17:36:42.920352+0000","last_unstale":"2024-09-12T19:26:45.256436+0000","last_undegraded":"2024-09-12T19:26:45.256436+0000","last_fullsized":"2024-09-12T19:26:45.256436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:47.099873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'181","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355355+0000","last_change":"2024-09-12T17:36:44.946661+0000","last_active":"2024-09-12T19:26:25.355355+0000","last_peered":"2024-09-12T19:26:25.355355+0000","last_clean":"2024-09-12T19:26:25.355355+0000","last_became_active":"2024-09-12T17:36:44.945753+0000","last_became_peered":"2024-09-12T17:36:44.945753+0000","last_unstale":"2024-09-12T19:26:25.355355+0000","last_undegraded":"2024-09-12T19:26:25.355355+0000","last_fullsized":"2024-09-12T19:26:25.355355+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:51.605529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":278,"num_read_kb":268,"num_write":526,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'523","reported_seq":2253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.623056+0000","last_change":"2024-09-12T17:36:36.910292+0000","last_active":"2024-09-12T19:28:02.623056+0000","last_peered":"2024-09-12T19:28:02.623056+0000","last_clean":"2024-09-12T19:28:02.623056+0000","last_became_active":"2024-09-12T17:36:36.909488+0000","last_became_peered":"2024-09-12T17:36:36.909488+0000","last_unstale":"2024-09-12T19:28:02.623056+0000","last_undegraded":"2024-09-12T19:28:02.623056+0000","last_fullsized":"2024-09-12T19:28:02.623056+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:27.498312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2968,"num_read_kb":2777,"num_write":639,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'320","reported_seq":1005,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:05.118153+0000","last_change":"2024-09-12T17:36:34.857968+0000","last_active":"2024-09-12T19:29:05.118153+0000","last_peered":"2024-09-12T19:29:05.118153+0000","last_clean":"2024-09-12T19:29:05.118153+0000","last_became_active":"2024-09-12T17:36:34.857645+0000","last_became_peered":"2024-09-12T17:36:34.857645+0000","last_unstale":"2024-09-12T19:29:05.118153+0000","last_undegraded":"2024-09-12T19:29:05.118153+0000","last_fullsized":"2024-09-12T19:29:05.118153+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:06.150098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7980169,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":539,"num_read_kb":13472,"num_write":1233,"num_write_kb":33813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.245950+0000","last_change":"2024-09-12T17:36:38.905353+0000","last_active":"2024-09-12T19:26:40.245950+0000","last_peered":"2024-09-12T19:26:40.245950+0000","last_clean":"2024-09-12T19:26:40.245950+0000","last_became_active":"2024-09-12T17:36:38.904619+0000","last_became_peered":"2024-09-12T17:36:38.904619+0000","last_unstale":"2024-09-12T19:26:40.245950+0000","last_undegraded":"2024-09-12T19:26:40.245950+0000","last_fullsized":"2024-09-12T19:26:40.245950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:01.832724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'311","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:14.079656+0000","last_change":"2024-09-12T17:36:40.909967+0000","last_active":"2024-09-12T19:29:14.079656+0000","last_peered":"2024-09-12T19:29:14.079656+0000","last_clean":"2024-09-12T19:29:14.079656+0000","last_became_active":"2024-09-12T17:36:40.909189+0000","last_became_peered":"2024-09-12T17:36:40.909189+0000","last_unstale":"2024-09-12T19:29:14.079656+0000","last_undegraded":"2024-09-12T19:29:14.079656+0000","last_fullsized":"2024-09-12T19:29:14.079656+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:32.736700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55815,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":964,"num_write":398,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.674082+0000","last_change":"2024-09-12T17:36:42.939553+0000","last_active":"2024-09-12T19:27:05.674082+0000","last_peered":"2024-09-12T19:27:05.674082+0000","last_clean":"2024-09-12T19:27:05.674082+0000","last_became_active":"2024-09-12T17:36:42.938451+0000","last_became_peered":"2024-09-12T17:36:42.938451+0000","last_unstale":"2024-09-12T19:27:05.674082+0000","last_undegraded":"2024-09-12T19:27:05.674082+0000","last_fullsized":"2024-09-12T19:27:05.674082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:33.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'109","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.052785+0000","last_change":"2024-09-12T17:36:44.950080+0000","last_active":"2024-09-12T19:29:22.052785+0000","last_peered":"2024-09-12T19:29:22.052785+0000","last_clean":"2024-09-12T19:29:22.052785+0000","last_became_active":"2024-09-12T17:36:44.949351+0000","last_became_peered":"2024-09-12T17:36:44.949351+0000","last_unstale":"2024-09-12T19:29:22.052785+0000","last_undegraded":"2024-09-12T19:29:22.052785+0000","last_fullsized":"2024-09-12T19:29:22.052785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:39.166790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":161,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'473","reported_seq":2149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181763+0000","last_change":"2024-09-12T17:36:36.903747+0000","last_active":"2024-09-12T19:27:10.181763+0000","last_peered":"2024-09-12T19:27:10.181763+0000","last_clean":"2024-09-12T19:27:10.181763+0000","last_became_active":"2024-09-12T17:36:36.902998+0000","last_became_peered":"2024-09-12T17:36:36.902998+0000","last_unstale":"2024-09-12T19:27:10.181763+0000","last_undegraded":"2024-09-12T19:27:10.181763+0000","last_fullsized":"2024-09-12T19:27:10.181763+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:30.836602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2683,"num_read_kb":2531,"num_write":585,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'327","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:39.252794+0000","last_change":"2024-09-12T17:36:34.869269+0000","last_active":"2024-09-12T19:26:39.252794+0000","last_peered":"2024-09-12T19:26:39.252794+0000","last_clean":"2024-09-12T19:26:39.252794+0000","last_became_active":"2024-09-12T17:36:34.867987+0000","last_became_peered":"2024-09-12T17:36:34.867987+0000","last_unstale":"2024-09-12T19:26:39.252794+0000","last_undegraded":"2024-09-12T19:26:39.252794+0000","last_fullsized":"2024-09-12T19:26:39.252794+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:07.281605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14033056,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":541,"num_read_kb":94353,"num_write":1195,"num_write_kb":45131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686764+0000","last_change":"2024-09-12T17:36:38.901399+0000","last_active":"2024-09-12T19:26:40.686764+0000","last_peered":"2024-09-12T19:26:40.686764+0000","last_clean":"2024-09-12T19:26:40.686764+0000","last_became_active":"2024-09-12T17:36:38.900687+0000","last_became_peered":"2024-09-12T17:36:38.900687+0000","last_unstale":"2024-09-12T19:26:40.686764+0000","last_undegraded":"2024-09-12T19:26:40.686764+0000","last_fullsized":"2024-09-12T19:26:40.686764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:39.929327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'157","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:34.443859+0000","last_change":"2024-09-12T17:36:40.905441+0000","last_active":"2024-09-12T19:27:34.443859+0000","last_peered":"2024-09-12T19:27:34.443859+0000","last_clean":"2024-09-12T19:27:34.443859+0000","last_became_active":"2024-09-12T17:36:40.904671+0000","last_became_peered":"2024-09-12T17:36:40.904671+0000","last_unstale":"2024-09-12T19:27:34.443859+0000","last_undegraded":"2024-09-12T19:27:34.443859+0000","last_fullsized":"2024-09-12T19:27:34.443859+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:48.997983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":202,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'767","reported_seq":3474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.060059+0000","last_change":"2024-09-12T17:36:42.930179+0000","last_active":"2024-09-12T19:29:25.060059+0000","last_peered":"2024-09-12T19:29:25.060059+0000","last_clean":"2024-09-12T19:29:25.060059+0000","last_became_active":"2024-09-12T17:36:42.929232+0000","last_became_peered":"2024-09-12T17:36:42.929232+0000","last_unstale":"2024-09-12T19:29:25.060059+0000","last_undegraded":"2024-09-12T19:29:25.060059+0000","last_fullsized":"2024-09-12T19:29:25.060059+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:00.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'132","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.338006+0000","last_change":"2024-09-12T17:36:44.946960+0000","last_active":"2024-09-12T19:26:59.338006+0000","last_peered":"2024-09-12T19:26:59.338006+0000","last_clean":"2024-09-12T19:26:59.338006+0000","last_became_active":"2024-09-12T17:36:44.945777+0000","last_became_peered":"2024-09-12T17:36:44.945777+0000","last_unstale":"2024-09-12T19:26:59.338006+0000","last_undegraded":"2024-09-12T19:26:59.338006+0000","last_fullsized":"2024-09-12T19:26:59.338006+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:22.225543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":212,"num_write":329,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'428","reported_seq":1981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.044099+0000","last_change":"2024-09-12T17:36:36.897272+0000","last_active":"2024-09-12T19:29:21.044099+0000","last_peered":"2024-09-12T19:29:21.044099+0000","last_clean":"2024-09-12T19:29:21.044099+0000","last_became_active":"2024-09-12T17:36:36.896871+0000","last_became_peered":"2024-09-12T17:36:36.896871+0000","last_unstale":"2024-09-12T19:29:21.044099+0000","last_undegraded":"2024-09-12T19:29:21.044099+0000","last_fullsized":"2024-09-12T19:29:21.044099+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:55.322767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2316,"num_read_kb":2187,"num_write":500,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'327","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.086645+0000","last_change":"2024-09-12T17:36:34.869011+0000","last_active":"2024-09-12T19:26:35.086645+0000","last_peered":"2024-09-12T19:26:35.086645+0000","last_clean":"2024-09-12T19:26:35.086645+0000","last_became_active":"2024-09-12T17:36:34.868685+0000","last_became_peered":"2024-09-12T17:36:34.868685+0000","last_unstale":"2024-09-12T19:26:35.086645+0000","last_undegraded":"2024-09-12T19:26:35.086645+0000","last_fullsized":"2024-09-12T19:26:35.086645+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:45.839499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4354196,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":512,"num_read_kb":59980,"num_write":1179,"num_write_kb":34100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.087989+0000","last_change":"2024-09-12T17:36:38.885901+0000","last_active":"2024-09-12T19:26:40.087989+0000","last_peered":"2024-09-12T19:26:40.087989+0000","last_clean":"2024-09-12T19:26:40.087989+0000","last_became_active":"2024-09-12T17:36:38.885092+0000","last_became_peered":"2024-09-12T17:36:38.885092+0000","last_unstale":"2024-09-12T19:26:40.087989+0000","last_undegraded":"2024-09-12T19:26:40.087989+0000","last_fullsized":"2024-09-12T19:26:40.087989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:14.638797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'404","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.617612+0000","last_change":"2024-09-12T17:36:40.902995+0000","last_active":"2024-09-12T19:28:15.617612+0000","last_peered":"2024-09-12T19:28:15.617612+0000","last_clean":"2024-09-12T19:28:15.617612+0000","last_became_active":"2024-09-12T17:36:40.902484+0000","last_became_peered":"2024-09-12T17:36:40.902484+0000","last_unstale":"2024-09-12T19:28:15.617612+0000","last_undegraded":"2024-09-12T19:28:15.617612+0000","last_fullsized":"2024-09-12T19:28:15.617612+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:00.010334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59659,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":629,"num_read_kb":1134,"num_write":500,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.671027+0000","last_change":"2024-09-12T17:36:42.937350+0000","last_active":"2024-09-12T19:25:30.671027+0000","last_peered":"2024-09-12T19:25:30.671027+0000","last_clean":"2024-09-12T19:25:30.671027+0000","last_became_active":"2024-09-12T17:36:42.932462+0000","last_became_peered":"2024-09-12T17:36:42.932462+0000","last_unstale":"2024-09-12T19:25:30.671027+0000","last_undegraded":"2024-09-12T19:25:30.671027+0000","last_fullsized":"2024-09-12T19:25:30.671027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:45.961114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'125","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:59.522990+0000","last_change":"2024-09-12T17:36:44.944698+0000","last_active":"2024-09-12T19:27:59.522990+0000","last_peered":"2024-09-12T19:27:59.522990+0000","last_clean":"2024-09-12T19:27:59.522990+0000","last_became_active":"2024-09-12T17:36:44.943948+0000","last_became_peered":"2024-09-12T17:36:44.943948+0000","last_unstale":"2024-09-12T19:27:59.522990+0000","last_undegraded":"2024-09-12T19:27:59.522990+0000","last_fullsized":"2024-09-12T19:27:59.522990+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:55.649115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":170,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'823","reported_seq":2518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.620849+0000","last_change":"2024-09-12T17:36:36.888995+0000","last_active":"2024-09-12T19:28:02.620849+0000","last_peered":"2024-09-12T19:28:02.620849+0000","last_clean":"2024-09-12T19:28:02.620849+0000","last_became_active":"2024-09-12T17:36:36.888747+0000","last_became_peered":"2024-09-12T17:36:36.888747+0000","last_unstale":"2024-09-12T19:28:02.620849+0000","last_undegraded":"2024-09-12T19:28:02.620849+0000","last_fullsized":"2024-09-12T19:28:02.620849+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:00.206667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3583,"num_write":1069,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'411","reported_seq":1100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.357959+0000","last_change":"2024-09-12T17:36:34.877161+0000","last_active":"2024-09-12T19:26:35.357959+0000","last_peered":"2024-09-12T19:26:35.357959+0000","last_clean":"2024-09-12T19:26:35.357959+0000","last_became_active":"2024-09-12T17:36:34.876487+0000","last_became_peered":"2024-09-12T17:36:34.876487+0000","last_unstale":"2024-09-12T19:26:35.357959+0000","last_undegraded":"2024-09-12T19:26:35.357959+0000","last_fullsized":"2024-09-12T19:26:35.357959+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:54.874115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5389541,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":764,"num_read_kb":5903,"num_write":1319,"num_write_kb":31714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.245910+0000","last_change":"2024-09-12T17:36:38.902372+0000","last_active":"2024-09-12T19:26:40.245910+0000","last_peered":"2024-09-12T19:26:40.245910+0000","last_clean":"2024-09-12T19:26:40.245910+0000","last_became_active":"2024-09-12T17:36:38.901575+0000","last_became_peered":"2024-09-12T17:36:38.901575+0000","last_unstale":"2024-09-12T19:26:40.245910+0000","last_undegraded":"2024-09-12T19:26:40.245910+0000","last_fullsized":"2024-09-12T19:26:40.245910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:49.517366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'321","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.129535+0000","last_change":"2024-09-12T17:36:40.901766+0000","last_active":"2024-09-12T19:29:21.129535+0000","last_peered":"2024-09-12T19:29:21.129535+0000","last_clean":"2024-09-12T19:29:21.129535+0000","last_became_active":"2024-09-12T17:36:40.900739+0000","last_became_peered":"2024-09-12T17:36:40.900739+0000","last_unstale":"2024-09-12T19:29:21.129535+0000","last_undegraded":"2024-09-12T19:29:21.129535+0000","last_fullsized":"2024-09-12T19:29:21.129535+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:19.813863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69459,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":540,"num_read_kb":1109,"num_write":442,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.348981+0000","last_change":"2024-09-12T17:36:42.921850+0000","last_active":"2024-09-12T19:26:00.348981+0000","last_peered":"2024-09-12T19:26:00.348981+0000","last_clean":"2024-09-12T19:26:00.348981+0000","last_became_active":"2024-09-12T17:36:42.920767+0000","last_became_peered":"2024-09-12T17:36:42.920767+0000","last_unstale":"2024-09-12T19:26:00.348981+0000","last_undegraded":"2024-09-12T19:26:00.348981+0000","last_fullsized":"2024-09-12T19:26:00.348981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:22.058824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'123","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.194923+0000","last_change":"2024-09-12T17:36:44.961031+0000","last_active":"2024-09-12T19:27:10.194923+0000","last_peered":"2024-09-12T19:27:10.194923+0000","last_clean":"2024-09-12T19:27:10.194923+0000","last_became_active":"2024-09-12T17:36:44.959535+0000","last_became_peered":"2024-09-12T17:36:44.959535+0000","last_unstale":"2024-09-12T19:27:10.194923+0000","last_undegraded":"2024-09-12T19:27:10.194923+0000","last_fullsized":"2024-09-12T19:27:10.194923+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:18.916773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":231,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'446","reported_seq":1831,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.364011+0000","last_change":"2024-09-12T17:36:36.895868+0000","last_active":"2024-09-12T19:28:00.364011+0000","last_peered":"2024-09-12T19:28:00.364011+0000","last_clean":"2024-09-12T19:28:00.364011+0000","last_became_active":"2024-09-12T17:36:36.895126+0000","last_became_peered":"2024-09-12T17:36:36.895126+0000","last_unstale":"2024-09-12T19:28:00.364011+0000","last_undegraded":"2024-09-12T19:28:00.364011+0000","last_fullsized":"2024-09-12T19:28:00.364011+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:38.358463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2194,"num_read_kb":2018,"num_write":546,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'285","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261243+0000","last_change":"2024-09-12T17:36:34.879150+0000","last_active":"2024-09-12T19:27:05.261243+0000","last_peered":"2024-09-12T19:27:05.261243+0000","last_clean":"2024-09-12T19:27:05.261243+0000","last_became_active":"2024-09-12T17:36:34.878381+0000","last_became_peered":"2024-09-12T17:36:34.878381+0000","last_unstale":"2024-09-12T19:27:05.261243+0000","last_undegraded":"2024-09-12T19:27:05.261243+0000","last_fullsized":"2024-09-12T19:27:05.261243+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:53.395319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4200358,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":497,"num_read_kb":62026,"num_write":1000,"num_write_kb":23225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.071542+0000","last_change":"2024-09-12T17:36:38.888449+0000","last_active":"2024-09-12T19:25:25.071542+0000","last_peered":"2024-09-12T19:25:25.071542+0000","last_clean":"2024-09-12T19:25:25.071542+0000","last_became_active":"2024-09-12T17:36:38.887476+0000","last_became_peered":"2024-09-12T17:36:38.887476+0000","last_unstale":"2024-09-12T19:25:25.071542+0000","last_undegraded":"2024-09-12T19:25:25.071542+0000","last_fullsized":"2024-09-12T19:25:25.071542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:59.359839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'241","reported_seq":823,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:14.079459+0000","last_change":"2024-09-12T17:36:40.904837+0000","last_active":"2024-09-12T19:29:14.079459+0000","last_peered":"2024-09-12T19:29:14.079459+0000","last_clean":"2024-09-12T19:29:14.079459+0000","last_became_active":"2024-09-12T17:36:40.904126+0000","last_became_peered":"2024-09-12T17:36:40.904126+0000","last_unstale":"2024-09-12T19:29:14.079459+0000","last_undegraded":"2024-09-12T19:29:14.079459+0000","last_fullsized":"2024-09-12T19:29:14.079459+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:14.815589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57238,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":853,"num_write":320,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360790+0000","last_change":"2024-09-12T17:36:42.935140+0000","last_active":"2024-09-12T19:26:45.360790+0000","last_peered":"2024-09-12T19:26:45.360790+0000","last_clean":"2024-09-12T19:26:45.360790+0000","last_became_active":"2024-09-12T17:36:42.934140+0000","last_became_peered":"2024-09-12T17:36:42.934140+0000","last_unstale":"2024-09-12T19:26:45.360790+0000","last_undegraded":"2024-09-12T19:26:45.360790+0000","last_fullsized":"2024-09-12T19:26:45.360790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:50.636896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'159","reported_seq":1650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.254322+0000","last_change":"2024-09-12T17:36:44.966081+0000","last_active":"2024-09-12T19:27:55.254322+0000","last_peered":"2024-09-12T19:27:55.254322+0000","last_clean":"2024-09-12T19:27:55.254322+0000","last_became_active":"2024-09-12T17:36:44.965427+0000","last_became_peered":"2024-09-12T17:36:44.965427+0000","last_unstale":"2024-09-12T19:27:55.254322+0000","last_undegraded":"2024-09-12T19:27:55.254322+0000","last_fullsized":"2024-09-12T19:27:55.254322+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:20.397523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1232,"num_read_kb":1221,"num_write":362,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'993","reported_seq":2719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.539915+0000","last_change":"2024-09-12T17:36:36.914615+0000","last_active":"2024-09-12T19:28:02.539915+0000","last_peered":"2024-09-12T19:28:02.539915+0000","last_clean":"2024-09-12T19:28:02.539915+0000","last_became_active":"2024-09-12T17:36:36.914315+0000","last_became_peered":"2024-09-12T17:36:36.914315+0000","last_unstale":"2024-09-12T19:28:02.539915+0000","last_undegraded":"2024-09-12T19:28:02.539915+0000","last_fullsized":"2024-09-12T19:28:02.539915+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":900,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:24.570940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4811,"num_read_kb":4330,"num_write":1385,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'279","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.260089+0000","last_change":"2024-09-12T17:36:34.873212+0000","last_active":"2024-09-12T19:27:00.260089+0000","last_peered":"2024-09-12T19:27:00.260089+0000","last_clean":"2024-09-12T19:27:00.260089+0000","last_became_active":"2024-09-12T17:36:34.871889+0000","last_became_peered":"2024-09-12T17:36:34.871889+0000","last_unstale":"2024-09-12T19:27:00.260089+0000","last_undegraded":"2024-09-12T19:27:00.260089+0000","last_fullsized":"2024-09-12T19:27:00.260089+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:28.254769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5234730,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":414,"num_read_kb":13875,"num_write":1077,"num_write_kb":46739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:45.674374+0000","last_change":"2024-09-12T17:36:38.882816+0000","last_active":"2024-09-12T19:25:45.674374+0000","last_peered":"2024-09-12T19:25:45.674374+0000","last_clean":"2024-09-12T19:25:45.674374+0000","last_became_active":"2024-09-12T17:36:38.882018+0000","last_became_peered":"2024-09-12T17:36:38.882018+0000","last_unstale":"2024-09-12T19:25:45.674374+0000","last_undegraded":"2024-09-12T19:25:45.674374+0000","last_fullsized":"2024-09-12T19:25:45.674374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:50.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'322","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.393445+0000","last_change":"2024-09-12T17:36:40.909328+0000","last_active":"2024-09-12T19:29:10.393445+0000","last_peered":"2024-09-12T19:29:10.393445+0000","last_clean":"2024-09-12T19:29:10.393445+0000","last_became_active":"2024-09-12T17:36:40.908611+0000","last_became_peered":"2024-09-12T17:36:40.908611+0000","last_unstale":"2024-09-12T19:29:10.393445+0000","last_undegraded":"2024-09-12T19:29:10.393445+0000","last_fullsized":"2024-09-12T19:29:10.393445+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:15.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67068,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":547,"num_read_kb":1063,"num_write":434,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.687795+0000","last_change":"2024-09-12T17:36:42.936919+0000","last_active":"2024-09-12T19:26:45.687795+0000","last_peered":"2024-09-12T19:26:45.687795+0000","last_clean":"2024-09-12T19:26:45.687795+0000","last_became_active":"2024-09-12T17:36:42.933510+0000","last_became_peered":"2024-09-12T17:36:42.933510+0000","last_unstale":"2024-09-12T19:26:45.687795+0000","last_undegraded":"2024-09-12T19:26:45.687795+0000","last_fullsized":"2024-09-12T19:26:45.687795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:11.996658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'126","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.020550+0000","last_change":"2024-09-12T17:36:44.961303+0000","last_active":"2024-09-12T19:29:21.020550+0000","last_peered":"2024-09-12T19:29:21.020550+0000","last_clean":"2024-09-12T19:29:21.020550+0000","last_became_active":"2024-09-12T17:36:44.960641+0000","last_became_peered":"2024-09-12T17:36:44.960641+0000","last_unstale":"2024-09-12T19:29:21.020550+0000","last_undegraded":"2024-09-12T19:29:21.020550+0000","last_fullsized":"2024-09-12T19:29:21.020550+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:20.007631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":181,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'930","reported_seq":2728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.366097+0000","last_change":"2024-09-12T17:36:36.901682+0000","last_active":"2024-09-12T19:28:00.366097+0000","last_peered":"2024-09-12T19:28:00.366097+0000","last_clean":"2024-09-12T19:28:00.366097+0000","last_became_active":"2024-09-12T17:36:36.901046+0000","last_became_peered":"2024-09-12T17:36:36.901046+0000","last_unstale":"2024-09-12T19:28:00.366097+0000","last_undegraded":"2024-09-12T19:28:00.366097+0000","last_fullsized":"2024-09-12T19:28:00.366097+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:29.856231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4712,"num_read_kb":4247,"num_write":1250,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'348","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.632279+0000","last_change":"2024-09-12T17:36:34.884343+0000","last_active":"2024-09-12T19:27:38.632279+0000","last_peered":"2024-09-12T19:27:38.632279+0000","last_clean":"2024-09-12T19:27:38.632279+0000","last_became_active":"2024-09-12T17:36:34.884112+0000","last_became_peered":"2024-09-12T17:36:34.884112+0000","last_unstale":"2024-09-12T19:27:38.632279+0000","last_undegraded":"2024-09-12T19:27:38.632279+0000","last_fullsized":"2024-09-12T19:27:38.632279+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:05.952592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4519802,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":613,"num_read_kb":11450,"num_write":1219,"num_write_kb":27380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'653","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675264+0000","last_change":"2024-09-12T17:36:36.917185+0000","last_active":"2024-09-12T19:27:10.675264+0000","last_peered":"2024-09-12T19:27:10.675264+0000","last_clean":"2024-09-12T19:27:10.675264+0000","last_became_active":"2024-09-12T17:36:36.916477+0000","last_became_peered":"2024-09-12T17:36:36.916477+0000","last_unstale":"2024-09-12T19:27:10.675264+0000","last_undegraded":"2024-09-12T19:27:10.675264+0000","last_fullsized":"2024-09-12T19:27:10.675264+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.646760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3261,"num_read_kb":2946,"num_write":856,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'297","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.672783+0000","last_change":"2024-09-12T17:36:34.862778+0000","last_active":"2024-09-12T19:27:00.672783+0000","last_peered":"2024-09-12T19:27:00.672783+0000","last_clean":"2024-09-12T19:27:00.672783+0000","last_became_active":"2024-09-12T17:36:34.862008+0000","last_became_peered":"2024-09-12T17:36:34.862008+0000","last_unstale":"2024-09-12T19:27:00.672783+0000","last_undegraded":"2024-09-12T19:27:00.672783+0000","last_fullsized":"2024-09-12T19:27:00.672783+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:34.713584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13207013,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":447,"num_read_kb":45708,"num_write":1085,"num_write_kb":41141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'442","reported_seq":2006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366473+0000","last_change":"2024-09-12T17:36:36.876715+0000","last_active":"2024-09-12T19:27:10.366473+0000","last_peered":"2024-09-12T19:27:10.366473+0000","last_clean":"2024-09-12T19:27:10.366473+0000","last_became_active":"2024-09-12T17:36:36.875947+0000","last_became_peered":"2024-09-12T17:36:36.875947+0000","last_unstale":"2024-09-12T19:27:10.366473+0000","last_undegraded":"2024-09-12T19:27:10.366473+0000","last_fullsized":"2024-09-12T19:27:10.366473+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:53.224464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2143,"num_write":507,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'281","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.363957+0000","last_change":"2024-09-12T17:36:34.892965+0000","last_active":"2024-09-12T19:27:00.363957+0000","last_peered":"2024-09-12T19:27:00.363957+0000","last_clean":"2024-09-12T19:27:00.363957+0000","last_became_active":"2024-09-12T17:36:34.892664+0000","last_became_peered":"2024-09-12T17:36:34.892664+0000","last_unstale":"2024-09-12T19:27:00.363957+0000","last_undegraded":"2024-09-12T19:27:00.363957+0000","last_fullsized":"2024-09-12T19:27:00.363957+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:17.794367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16579603,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":461,"num_read_kb":15114,"num_write":1027,"num_write_kb":33687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'449","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.620587+0000","last_change":"2024-09-12T17:36:36.887427+0000","last_active":"2024-09-12T19:28:02.620587+0000","last_peered":"2024-09-12T19:28:02.620587+0000","last_clean":"2024-09-12T19:28:02.620587+0000","last_became_active":"2024-09-12T17:36:36.886646+0000","last_became_peered":"2024-09-12T17:36:36.886646+0000","last_unstale":"2024-09-12T19:28:02.620587+0000","last_undegraded":"2024-09-12T19:28:02.620587+0000","last_fullsized":"2024-09-12T19:28:02.620587+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:16.527812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2431,"num_read_kb":2290,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'254","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.267092+0000","last_change":"2024-09-12T17:36:34.878872+0000","last_active":"2024-09-12T19:27:30.267092+0000","last_peered":"2024-09-12T19:27:30.267092+0000","last_clean":"2024-09-12T19:27:30.267092+0000","last_became_active":"2024-09-12T17:36:34.875514+0000","last_became_peered":"2024-09-12T17:36:34.875514+0000","last_unstale":"2024-09-12T19:27:30.267092+0000","last_undegraded":"2024-09-12T19:27:30.267092+0000","last_fullsized":"2024-09-12T19:27:30.267092+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:00.883687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3684293,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":355,"num_read_kb":12722,"num_write":873,"num_write_kb":21079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'472","reported_seq":2079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:35.268283+0000","last_change":"2024-09-12T17:36:36.896549+0000","last_active":"2024-09-12T19:27:35.268283+0000","last_peered":"2024-09-12T19:27:35.268283+0000","last_clean":"2024-09-12T19:27:35.268283+0000","last_became_active":"2024-09-12T17:36:36.895580+0000","last_became_peered":"2024-09-12T17:36:36.895580+0000","last_unstale":"2024-09-12T19:27:35.268283+0000","last_undegraded":"2024-09-12T19:27:35.268283+0000","last_fullsized":"2024-09-12T19:27:35.268283+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:38.232699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2410,"num_read_kb":2268,"num_write":522,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'311","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:04.050868+0000","last_change":"2024-09-12T17:36:34.876065+0000","last_active":"2024-09-12T19:27:04.050868+0000","last_peered":"2024-09-12T19:27:04.050868+0000","last_clean":"2024-09-12T19:27:04.050868+0000","last_became_active":"2024-09-12T17:36:34.875282+0000","last_became_peered":"2024-09-12T17:36:34.875282+0000","last_unstale":"2024-09-12T19:27:04.050868+0000","last_undegraded":"2024-09-12T19:27:04.050868+0000","last_fullsized":"2024-09-12T19:27:04.050868+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:40.356381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3778182,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":460,"num_read_kb":16782,"num_write":1005,"num_write_kb":43648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'867","reported_seq":2674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.119778+0000","last_change":"2024-09-12T17:36:36.880245+0000","last_active":"2024-09-12T19:28:32.119778+0000","last_peered":"2024-09-12T19:28:32.119778+0000","last_clean":"2024-09-12T19:28:32.119778+0000","last_became_active":"2024-09-12T17:36:36.879875+0000","last_became_peered":"2024-09-12T17:36:36.879875+0000","last_unstale":"2024-09-12T19:28:32.119778+0000","last_undegraded":"2024-09-12T19:28:32.119778+0000","last_fullsized":"2024-09-12T19:28:32.119778+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:34.212835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4378,"num_read_kb":3985,"num_write":1124,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'257","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.794574+0000","last_change":"2024-09-12T17:36:34.882320+0000","last_active":"2024-09-12T19:29:10.794574+0000","last_peered":"2024-09-12T19:29:10.794574+0000","last_clean":"2024-09-12T19:29:10.794574+0000","last_became_active":"2024-09-12T17:36:34.880893+0000","last_became_peered":"2024-09-12T17:36:34.880893+0000","last_unstale":"2024-09-12T19:29:10.794574+0000","last_undegraded":"2024-09-12T19:29:10.794574+0000","last_fullsized":"2024-09-12T19:29:10.794574+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:46.683258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20722098,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":395,"num_read_kb":34770,"num_write":991,"num_write_kb":43573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'1177","reported_seq":2763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:04.050596+0000","last_change":"2024-09-12T17:36:36.898718+0000","last_active":"2024-09-12T19:27:04.050596+0000","last_peered":"2024-09-12T19:27:04.050596+0000","last_clean":"2024-09-12T19:27:04.050596+0000","last_became_active":"2024-09-12T17:36:36.897985+0000","last_became_peered":"2024-09-12T17:36:36.897985+0000","last_unstale":"2024-09-12T19:27:04.050596+0000","last_undegraded":"2024-09-12T19:27:04.050596+0000","last_fullsized":"2024-09-12T19:27:04.050596+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:33.241292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5405,"num_read_kb":4772,"num_write":1628,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'320","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:16.332232+0000","last_change":"2024-09-12T17:36:34.877091+0000","last_active":"2024-09-12T19:29:16.332232+0000","last_peered":"2024-09-12T19:29:16.332232+0000","last_clean":"2024-09-12T19:29:16.332232+0000","last_became_active":"2024-09-12T17:36:34.876834+0000","last_became_peered":"2024-09-12T17:36:34.876834+0000","last_unstale":"2024-09-12T19:29:16.332232+0000","last_undegraded":"2024-09-12T19:29:16.332232+0000","last_fullsized":"2024-09-12T19:29:16.332232+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:36.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8440145,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":522,"num_read_kb":4635,"num_write":1163,"num_write_kb":22932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'773","reported_seq":2362,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.058729+0000","last_change":"2024-09-12T17:36:36.901626+0000","last_active":"2024-09-12T19:29:21.058729+0000","last_peered":"2024-09-12T19:29:21.058729+0000","last_clean":"2024-09-12T19:29:21.058729+0000","last_became_active":"2024-09-12T17:36:36.901293+0000","last_became_peered":"2024-09-12T17:36:36.901293+0000","last_unstale":"2024-09-12T19:29:21.058729+0000","last_undegraded":"2024-09-12T19:29:21.058729+0000","last_fullsized":"2024-09-12T19:29:21.058729+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:48.170779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3323,"num_write":979,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'281","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261280+0000","last_change":"2024-09-12T17:36:34.875326+0000","last_active":"2024-09-12T19:27:05.261280+0000","last_peered":"2024-09-12T19:27:05.261280+0000","last_clean":"2024-09-12T19:27:05.261280+0000","last_became_active":"2024-09-12T17:36:34.872999+0000","last_became_peered":"2024-09-12T17:36:34.872999+0000","last_unstale":"2024-09-12T19:27:05.261280+0000","last_undegraded":"2024-09-12T19:27:05.261280+0000","last_fullsized":"2024-09-12T19:27:05.261280+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:47.461128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4879593,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":608,"num_read_kb":7832,"num_write":1068,"num_write_kb":31819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'779","reported_seq":2247,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.049150+0000","last_change":"2024-09-12T17:36:36.904735+0000","last_active":"2024-09-12T19:29:21.049150+0000","last_peered":"2024-09-12T19:29:21.049150+0000","last_clean":"2024-09-12T19:29:21.049150+0000","last_became_active":"2024-09-12T17:36:36.903948+0000","last_became_peered":"2024-09-12T17:36:36.903948+0000","last_unstale":"2024-09-12T19:29:21.049150+0000","last_undegraded":"2024-09-12T19:29:21.049150+0000","last_fullsized":"2024-09-12T19:29:21.049150+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:06.384871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3650,"num_read_kb":3275,"num_write":1024,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'345","reported_seq":1104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:07.685342+0000","last_change":"2024-09-12T17:36:34.891921+0000","last_active":"2024-09-12T19:26:07.685342+0000","last_peered":"2024-09-12T19:26:07.685342+0000","last_clean":"2024-09-12T19:26:07.685342+0000","last_became_active":"2024-09-12T17:36:34.891638+0000","last_became_peered":"2024-09-12T17:36:34.891638+0000","last_unstale":"2024-09-12T19:26:07.685342+0000","last_undegraded":"2024-09-12T19:26:07.685342+0000","last_fullsized":"2024-09-12T19:26:07.685342+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:27.837483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765041,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":763,"num_read_kb":23553,"num_write":1256,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'1230","reported_seq":2980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.593064+0000","last_change":"2024-09-12T17:36:36.906715+0000","last_active":"2024-09-12T19:26:20.593064+0000","last_peered":"2024-09-12T19:26:20.593064+0000","last_clean":"2024-09-12T19:26:20.593064+0000","last_became_active":"2024-09-12T17:36:36.906463+0000","last_became_peered":"2024-09-12T17:36:36.906463+0000","last_unstale":"2024-09-12T19:26:20.593064+0000","last_undegraded":"2024-09-12T19:26:20.593064+0000","last_fullsized":"2024-09-12T19:26:20.593064+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:50.870597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5684,"num_read_kb":5045,"num_write":1688,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'262","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.257503+0000","last_change":"2024-09-12T17:36:34.874816+0000","last_active":"2024-09-12T19:26:50.257503+0000","last_peered":"2024-09-12T19:26:50.257503+0000","last_clean":"2024-09-12T19:26:50.257503+0000","last_became_active":"2024-09-12T17:36:34.873189+0000","last_became_peered":"2024-09-12T17:36:34.873189+0000","last_unstale":"2024-09-12T19:26:50.257503+0000","last_undegraded":"2024-09-12T19:26:50.257503+0000","last_fullsized":"2024-09-12T19:26:50.257503+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:16.748289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11129714,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":374,"num_read_kb":39048,"num_write":883,"num_write_kb":38605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'997","reported_seq":2702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.116025+0000","last_change":"2024-09-12T17:36:36.876501+0000","last_active":"2024-09-12T19:28:32.116025+0000","last_peered":"2024-09-12T19:28:32.116025+0000","last_clean":"2024-09-12T19:28:32.116025+0000","last_became_active":"2024-09-12T17:36:36.875791+0000","last_became_peered":"2024-09-12T17:36:36.875791+0000","last_unstale":"2024-09-12T19:28:32.116025+0000","last_undegraded":"2024-09-12T19:28:32.116025+0000","last_fullsized":"2024-09-12T19:28:32.116025+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:20.751412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4962,"num_read_kb":4419,"num_write":1465,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'194","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.090313+0000","last_change":"2024-09-12T17:36:34.867040+0000","last_active":"2024-09-12T19:26:50.090313+0000","last_peered":"2024-09-12T19:26:50.090313+0000","last_clean":"2024-09-12T19:26:50.090313+0000","last_became_active":"2024-09-12T17:36:34.866719+0000","last_became_peered":"2024-09-12T17:36:34.866719+0000","last_unstale":"2024-09-12T19:26:50.090313+0000","last_undegraded":"2024-09-12T19:26:50.090313+0000","last_fullsized":"2024-09-12T19:26:50.090313+0000","mapping_epoch":24,"log_start":"265'100","ondisk_log_start":"265'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:38.881915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5352417,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":331,"num_read_kb":13747,"num_write":730,"num_write_kb":14866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'511","reported_seq":2129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.091439+0000","last_change":"2024-09-12T17:36:36.914630+0000","last_active":"2024-09-12T19:26:55.091439+0000","last_peered":"2024-09-12T19:26:55.091439+0000","last_clean":"2024-09-12T19:26:55.091439+0000","last_became_active":"2024-09-12T17:36:36.914327+0000","last_became_peered":"2024-09-12T17:36:36.914327+0000","last_unstale":"2024-09-12T19:26:55.091439+0000","last_undegraded":"2024-09-12T19:26:55.091439+0000","last_fullsized":"2024-09-12T19:26:55.091439+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:59.445859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2629,"num_read_kb":2439,"num_write":603,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'238","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.688932+0000","last_change":"2024-09-12T17:36:34.865386+0000","last_active":"2024-09-12T19:26:50.688932+0000","last_peered":"2024-09-12T19:26:50.688932+0000","last_clean":"2024-09-12T19:26:50.688932+0000","last_became_active":"2024-09-12T17:36:34.864682+0000","last_became_peered":"2024-09-12T17:36:34.864682+0000","last_unstale":"2024-09-12T19:26:50.688932+0000","last_undegraded":"2024-09-12T19:26:50.688932+0000","last_fullsized":"2024-09-12T19:26:50.688932+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:44.124063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4211819,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":324,"num_read_kb":10447,"num_write":844,"num_write_kb":22906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'843","reported_seq":2465,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.325029+0000","last_change":"2024-09-12T17:36:36.886698+0000","last_active":"2024-09-12T19:26:59.325029+0000","last_peered":"2024-09-12T19:26:59.325029+0000","last_clean":"2024-09-12T19:26:59.325029+0000","last_became_active":"2024-09-12T17:36:36.885956+0000","last_became_peered":"2024-09-12T17:36:36.885956+0000","last_unstale":"2024-09-12T19:26:59.325029+0000","last_undegraded":"2024-09-12T19:26:59.325029+0000","last_fullsized":"2024-09-12T19:26:59.325029+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:14.336258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3814,"num_read_kb":3459,"num_write":1078,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'289","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.599808+0000","last_change":"2024-09-12T17:36:34.867183+0000","last_active":"2024-09-12T19:26:50.599808+0000","last_peered":"2024-09-12T19:26:50.599808+0000","last_clean":"2024-09-12T19:26:50.599808+0000","last_became_active":"2024-09-12T17:36:34.865344+0000","last_became_peered":"2024-09-12T17:36:34.865344+0000","last_unstale":"2024-09-12T19:26:50.599808+0000","last_undegraded":"2024-09-12T19:26:50.599808+0000","last_fullsized":"2024-09-12T19:26:50.599808+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:57.377914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13665091,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":485,"num_read_kb":55805,"num_write":1120,"num_write_kb":26331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'722","reported_seq":2134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671563+0000","last_change":"2024-09-12T17:36:36.916852+0000","last_active":"2024-09-12T19:26:55.671563+0000","last_peered":"2024-09-12T19:26:55.671563+0000","last_clean":"2024-09-12T19:26:55.671563+0000","last_became_active":"2024-09-12T17:36:36.916289+0000","last_became_peered":"2024-09-12T17:36:36.916289+0000","last_unstale":"2024-09-12T19:26:55.671563+0000","last_undegraded":"2024-09-12T19:26:55.671563+0000","last_fullsized":"2024-09-12T19:26:55.671563+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:24.873023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3361,"num_read_kb":3032,"num_write":954,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'296","reported_seq":1182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368897+0000","last_change":"2024-09-12T17:36:34.876882+0000","last_active":"2024-09-12T19:27:20.368897+0000","last_peered":"2024-09-12T19:27:20.368897+0000","last_clean":"2024-09-12T19:27:20.368897+0000","last_became_active":"2024-09-12T17:36:34.875748+0000","last_became_peered":"2024-09-12T17:36:34.875748+0000","last_unstale":"2024-09-12T19:27:20.368897+0000","last_undegraded":"2024-09-12T19:27:20.368897+0000","last_fullsized":"2024-09-12T19:27:20.368897+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:38.898125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14247268,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":869,"num_read_kb":75770,"num_write":949,"num_write_kb":38932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'575","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.115291+0000","last_change":"2024-09-12T17:36:36.904688+0000","last_active":"2024-09-12T19:28:32.115291+0000","last_peered":"2024-09-12T19:28:32.115291+0000","last_clean":"2024-09-12T19:28:32.115291+0000","last_became_active":"2024-09-12T17:36:36.902941+0000","last_became_peered":"2024-09-12T17:36:36.902941+0000","last_unstale":"2024-09-12T19:28:32.115291+0000","last_undegraded":"2024-09-12T19:28:32.115291+0000","last_fullsized":"2024-09-12T19:28:32.115291+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:02.556913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2851,"num_read_kb":2607,"num_write":694,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'309","reported_seq":987,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.925526+0000","last_change":"2024-09-12T17:36:34.873753+0000","last_active":"2024-09-12T19:26:55.925526+0000","last_peered":"2024-09-12T19:26:55.925526+0000","last_clean":"2024-09-12T19:26:55.925526+0000","last_became_active":"2024-09-12T17:36:34.868083+0000","last_became_peered":"2024-09-12T17:36:34.868083+0000","last_unstale":"2024-09-12T19:26:55.925526+0000","last_undegraded":"2024-09-12T19:26:55.925526+0000","last_fullsized":"2024-09-12T19:26:55.925526+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:12.169519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13117121,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":486,"num_read_kb":53045,"num_write":1152,"num_write_kb":26068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'576","reported_seq":2515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:53.296831+0000","last_change":"2024-09-12T17:36:36.891765+0000","last_active":"2024-09-12T19:26:53.296831+0000","last_peered":"2024-09-12T19:26:53.296831+0000","last_clean":"2024-09-12T19:26:53.296831+0000","last_became_active":"2024-09-12T17:36:36.891412+0000","last_became_peered":"2024-09-12T17:36:36.891412+0000","last_unstale":"2024-09-12T19:26:53.296831+0000","last_undegraded":"2024-09-12T19:26:53.296831+0000","last_fullsized":"2024-09-12T19:26:53.296831+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:43.215780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3296,"num_read_kb":3095,"num_write":679,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'325","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.352773+0000","last_change":"2024-09-12T17:36:34.872524+0000","last_active":"2024-09-12T19:26:15.352773+0000","last_peered":"2024-09-12T19:26:15.352773+0000","last_clean":"2024-09-12T19:26:15.352773+0000","last_became_active":"2024-09-12T17:36:34.872242+0000","last_became_peered":"2024-09-12T17:36:34.872242+0000","last_unstale":"2024-09-12T19:26:15.352773+0000","last_undegraded":"2024-09-12T19:26:15.352773+0000","last_fullsized":"2024-09-12T19:26:15.352773+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:13.591648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7342728,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":466,"num_read_kb":8809,"num_write":1123,"num_write_kb":19313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'298","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.352448+0000","last_change":"2024-09-12T17:36:34.862643+0000","last_active":"2024-09-12T19:26:15.352448+0000","last_peered":"2024-09-12T19:26:15.352448+0000","last_clean":"2024-09-12T19:26:15.352448+0000","last_became_active":"2024-09-12T17:36:34.861821+0000","last_became_peered":"2024-09-12T17:36:34.861821+0000","last_unstale":"2024-09-12T19:26:15.352448+0000","last_undegraded":"2024-09-12T19:26:15.352448+0000","last_fullsized":"2024-09-12T19:26:15.352448+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.821144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11196651,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":490,"num_read_kb":100665,"num_write":1010,"num_write_kb":41422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'568","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.624055+0000","last_change":"2024-09-12T17:36:36.912672+0000","last_active":"2024-09-12T19:28:02.624055+0000","last_peered":"2024-09-12T19:28:02.624055+0000","last_clean":"2024-09-12T19:28:02.624055+0000","last_became_active":"2024-09-12T17:36:36.911855+0000","last_became_peered":"2024-09-12T17:36:36.911855+0000","last_unstale":"2024-09-12T19:28:02.624055+0000","last_undegraded":"2024-09-12T19:28:02.624055+0000","last_fullsized":"2024-09-12T19:28:02.624055+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:51.023621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2849,"num_read_kb":2620,"num_write":728,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'271","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.249382+0000","last_change":"2024-09-12T17:36:34.881995+0000","last_active":"2024-09-12T19:26:15.249382+0000","last_peered":"2024-09-12T19:26:15.249382+0000","last_clean":"2024-09-12T19:26:15.249382+0000","last_became_active":"2024-09-12T17:36:34.881262+0000","last_became_peered":"2024-09-12T17:36:34.881262+0000","last_unstale":"2024-09-12T19:26:15.249382+0000","last_undegraded":"2024-09-12T19:26:15.249382+0000","last_fullsized":"2024-09-12T19:26:15.249382+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:56.865811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11520182,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":413,"num_read_kb":5153,"num_write":968,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'505","reported_seq":2109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:49.753418+0000","last_change":"2024-09-12T17:36:36.902225+0000","last_active":"2024-09-12T19:25:49.753418+0000","last_peered":"2024-09-12T19:25:49.753418+0000","last_clean":"2024-09-12T19:25:49.753418+0000","last_became_active":"2024-09-12T17:36:36.901857+0000","last_became_peered":"2024-09-12T17:36:36.901857+0000","last_unstale":"2024-09-12T19:25:49.753418+0000","last_undegraded":"2024-09-12T19:25:49.753418+0000","last_fullsized":"2024-09-12T19:25:49.753418+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:17.433881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2642,"num_read_kb":2459,"num_write":621,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5957,"num_read_kb":4161,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16299,"num_read_kb":15966,"num_write":16741,"num_write_kb":4895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1571,"ondisk_log_size":1571,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":722,"ondisk_log_size":722,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1913607,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":20557,"num_read_kb":36393,"num_write":17323,"num_write_kb":12410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":2788680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1939,"ondisk_log_size":1939,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194467,"num_write":55293,"num_write_kb":18855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3723,"ondisk_log_size":3723,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":519850088,"num_objects":4468,"num_object_clones":0,"num_object_copies":8936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4468,"num_whiteouts":0,"num_read":32213,"num_read_kb":1890942,"num_write":67741,"num_write_kb":2051812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1072496640,"data_stored":1039700176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4377,"ondisk_log_size":4377,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":73036616,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":143,"num_read_kb":193786,"num_write":158,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73036616,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":139,"num_read_kb":184511,"num_write":158,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510808,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370948,"kb_used_data":151028,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94000892,"statfs":{"total":96636764160,"available":96256913408,"internally_reserved":0,"allocated":154652672,"data_stored":150487234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510805,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446784,"kb_used_data":221232,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93925056,"statfs":{"total":96636764160,"available":96179257344,"internally_reserved":0,"allocated":226541568,"data_stored":220467625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510809,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310544,"kb_used_data":139200,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94061296,"statfs":{"total":96636764160,"available":96318767104,"internally_reserved":0,"allocated":142540800,"data_stored":137549121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510805,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397560,"kb_used_data":191464,"kb_used_omap":1,"kb_used_meta":206078,"kb_avail":93974280,"statfs":{"total":96636764160,"available":96229662720,"internally_reserved":0,"allocated":196059136,"data_stored":189525965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":211024327},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510808,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279000,"kb_used_data":179784,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94092840,"statfs":{"total":96636764160,"available":96351068160,"internally_reserved":0,"allocated":184098816,"data_stored":177830188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510805,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":386308,"kb_used_data":124660,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93985532,"statfs":{"total":96636764160,"available":96241184768,"internally_reserved":0,"allocated":127651840,"data_stored":122482092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510806,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274572,"kb_used_data":180988,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94097268,"statfs":{"total":96636764160,"available":96355602432,"internally_reserved":0,"allocated":185331712,"data_stored":178220707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543510,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262300,"kb_used_data":177036,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94109540,"statfs":{"total":96636764160,"available":96368168960,"internally_reserved":0,"allocated":181284864,"data_stored":176165638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":154353664,"data_stored":148832606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102948864,"data_stored":99377080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":153522176,"data_stored":148783469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159535104,"data_stored":154580672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":113229824,"data_stored":109814101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":158314496,"data_stored":153836991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":132567040,"data_stored":129039281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98025472,"data_stored":95435976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":475982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":480024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":134977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":265497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":392629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":386072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":346573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":306926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11071488,"data_stored":11070123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15265792,"data_stored":15264427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29462528,"data_stored":29460637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10022912,"data_stored":10021547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12644352,"data_stored":12643276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":48275456,"data_stored":48274641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":19460096,"data_stored":19458731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23171072,"data_stored":23169181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:29:44.098 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T19:29:44.099 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:29:44.431 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:29:44.446 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-12T19:29:44.457 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":3661,"stamp":"2024-09-12T19:29:43.214498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668444752,"num_objects":4995,"num_object_clones":0,"num_object_copies":9990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4995,"num_whiteouts":0,"num_read":290634,"num_read_kb":2523158,"num_write":159492,"num_write_kb":2342719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":204,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13727,"ondisk_log_size":13727,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2728016,"kb_used_data":1365392,"kb_used_omap":12,"kb_used_meta":1362483,"kb_avail":752246704,"statfs":{"total":773094113280,"available":770300624896,"internally_reserved":0,"allocated":1398161408,"data_stored":1352728570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1395183152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008574"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.587902+0000","last_change":"2024-09-12T18:25:52.622405+0000","last_active":"2024-09-12T19:25:55.587902+0000","last_peered":"2024-09-12T19:25:55.587902+0000","last_clean":"2024-09-12T19:25:55.587902+0000","last_became_active":"2024-09-12T18:25:52.621735+0000","last_became_peered":"2024-09-12T18:25:52.621735+0000","last_unstale":"2024-09-12T19:25:55.587902+0000","last_undegraded":"2024-09-12T19:25:55.587902+0000","last_fullsized":"2024-09-12T19:25:55.587902+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:09.919704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.083326+0000","last_change":"2024-09-12T17:58:47.223973+0000","last_active":"2024-09-12T19:26:20.083326+0000","last_peered":"2024-09-12T19:26:20.083326+0000","last_clean":"2024-09-12T19:26:20.083326+0000","last_became_active":"2024-09-12T17:58:47.223202+0000","last_became_peered":"2024-09-12T17:58:47.223202+0000","last_unstale":"2024-09-12T19:26:20.083326+0000","last_undegraded":"2024-09-12T19:26:20.083326+0000","last_fullsized":"2024-09-12T19:26:20.083326+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:23.110262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.661108+0000","last_change":"2024-09-12T17:58:40.207149+0000","last_active":"2024-09-12T19:26:10.661108+0000","last_peered":"2024-09-12T19:26:10.661108+0000","last_clean":"2024-09-12T19:26:10.661108+0000","last_became_active":"2024-09-12T17:58:40.206469+0000","last_became_peered":"2024-09-12T17:58:40.206469+0000","last_unstale":"2024-09-12T19:26:10.661108+0000","last_undegraded":"2024-09-12T19:26:10.661108+0000","last_fullsized":"2024-09-12T19:26:10.661108+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:10.914751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'13","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.683354+0000","last_change":"2024-09-12T17:52:39.873196+0000","last_active":"2024-09-12T19:26:25.683354+0000","last_peered":"2024-09-12T19:26:25.683354+0000","last_clean":"2024-09-12T19:26:25.683354+0000","last_became_active":"2024-09-12T17:52:39.872356+0000","last_became_peered":"2024-09-12T17:52:39.872356+0000","last_unstale":"2024-09-12T19:26:25.683354+0000","last_undegraded":"2024-09-12T19:26:25.683354+0000","last_fullsized":"2024-09-12T19:26:25.683354+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:36.475086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.035593+0000","last_change":"2024-09-12T18:25:52.625279+0000","last_active":"2024-09-12T19:25:54.035593+0000","last_peered":"2024-09-12T19:25:54.035593+0000","last_clean":"2024-09-12T19:25:54.035593+0000","last_became_active":"2024-09-12T18:25:52.624565+0000","last_became_peered":"2024-09-12T18:25:52.624565+0000","last_unstale":"2024-09-12T19:25:54.035593+0000","last_undegraded":"2024-09-12T19:25:54.035593+0000","last_fullsized":"2024-09-12T19:25:54.035593+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:32.002014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'4","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241488+0000","last_change":"2024-09-12T17:58:47.249699+0000","last_active":"2024-09-12T19:26:20.241488+0000","last_peered":"2024-09-12T19:26:20.241488+0000","last_clean":"2024-09-12T19:26:20.241488+0000","last_became_active":"2024-09-12T17:58:47.249050+0000","last_became_peered":"2024-09-12T17:58:47.249050+0000","last_unstale":"2024-09-12T19:26:20.241488+0000","last_undegraded":"2024-09-12T19:26:20.241488+0000","last_fullsized":"2024-09-12T19:26:20.241488+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:09.406806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.248289+0000","last_change":"2024-09-12T17:58:40.210474+0000","last_active":"2024-09-12T19:26:10.248289+0000","last_peered":"2024-09-12T19:26:10.248289+0000","last_clean":"2024-09-12T19:26:10.248289+0000","last_became_active":"2024-09-12T17:58:40.209447+0000","last_became_peered":"2024-09-12T17:58:40.209447+0000","last_unstale":"2024-09-12T19:26:10.248289+0000","last_undegraded":"2024-09-12T19:26:10.248289+0000","last_fullsized":"2024-09-12T19:26:10.248289+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:51.043086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'14","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691311+0000","last_change":"2024-09-12T17:52:39.885082+0000","last_active":"2024-09-12T19:27:00.691311+0000","last_peered":"2024-09-12T19:27:00.691311+0000","last_clean":"2024-09-12T19:27:00.691311+0000","last_became_active":"2024-09-12T17:52:39.884327+0000","last_became_peered":"2024-09-12T17:52:39.884327+0000","last_unstale":"2024-09-12T19:27:00.691311+0000","last_undegraded":"2024-09-12T19:27:00.691311+0000","last_fullsized":"2024-09-12T19:27:00.691311+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:05.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.083157+0000","last_change":"2024-09-12T18:25:52.622449+0000","last_active":"2024-09-12T19:26:20.083157+0000","last_peered":"2024-09-12T19:26:20.083157+0000","last_clean":"2024-09-12T19:26:20.083157+0000","last_became_active":"2024-09-12T18:25:52.621796+0000","last_became_peered":"2024-09-12T18:25:52.621796+0000","last_unstale":"2024-09-12T19:26:20.083157+0000","last_undegraded":"2024-09-12T19:26:20.083157+0000","last_fullsized":"2024-09-12T19:26:20.083157+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:45.223769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'4","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250786+0000","last_change":"2024-09-12T17:58:47.240760+0000","last_active":"2024-09-12T19:26:20.250786+0000","last_peered":"2024-09-12T19:26:20.250786+0000","last_clean":"2024-09-12T19:26:20.250786+0000","last_became_active":"2024-09-12T17:58:47.239390+0000","last_became_peered":"2024-09-12T17:58:47.239390+0000","last_unstale":"2024-09-12T19:26:20.250786+0000","last_undegraded":"2024-09-12T19:26:20.250786+0000","last_fullsized":"2024-09-12T19:26:20.250786+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:08.068553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'2","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671750+0000","last_change":"2024-09-12T17:58:40.194349+0000","last_active":"2024-09-12T19:26:55.671750+0000","last_peered":"2024-09-12T19:26:55.671750+0000","last_clean":"2024-09-12T19:26:55.671750+0000","last_became_active":"2024-09-12T17:58:40.193462+0000","last_became_peered":"2024-09-12T17:58:40.193462+0000","last_unstale":"2024-09-12T19:26:55.671750+0000","last_undegraded":"2024-09-12T19:26:55.671750+0000","last_fullsized":"2024-09-12T19:26:55.671750+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:14.830909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1108940,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1083,"num_write":2,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'6","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026309+0000","last_change":"2024-09-12T17:52:39.872689+0000","last_active":"2024-09-12T19:25:09.026309+0000","last_peered":"2024-09-12T19:25:09.026309+0000","last_clean":"2024-09-12T19:25:09.026309+0000","last_became_active":"2024-09-12T17:52:39.871998+0000","last_became_peered":"2024-09-12T17:52:39.871998+0000","last_unstale":"2024-09-12T19:25:09.026309+0000","last_undegraded":"2024-09-12T19:25:09.026309+0000","last_fullsized":"2024-09-12T19:25:09.026309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:54.365755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255185+0000","last_change":"2024-09-12T18:25:52.613287+0000","last_active":"2024-09-12T19:26:40.255185+0000","last_peered":"2024-09-12T19:26:40.255185+0000","last_clean":"2024-09-12T19:26:40.255185+0000","last_became_active":"2024-09-12T18:25:52.612472+0000","last_became_peered":"2024-09-12T18:25:52.612472+0000","last_unstale":"2024-09-12T19:26:40.255185+0000","last_undegraded":"2024-09-12T19:26:40.255185+0000","last_fullsized":"2024-09-12T19:26:40.255185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:42.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"262'5","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263726+0000","last_change":"2024-09-12T17:58:47.248310+0000","last_active":"2024-09-12T19:27:15.263726+0000","last_peered":"2024-09-12T19:27:15.263726+0000","last_clean":"2024-09-12T19:27:15.263726+0000","last_became_active":"2024-09-12T17:58:47.247496+0000","last_became_peered":"2024-09-12T17:58:47.247496+0000","last_unstale":"2024-09-12T19:27:15.263726+0000","last_undegraded":"2024-09-12T19:27:15.263726+0000","last_fullsized":"2024-09-12T19:27:15.263726+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:24.161042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'11","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.081400+0000","last_change":"2024-09-12T17:58:40.214834+0000","last_active":"2024-09-12T19:26:10.081400+0000","last_peered":"2024-09-12T19:26:10.081400+0000","last_clean":"2024-09-12T19:26:10.081400+0000","last_became_active":"2024-09-12T17:58:40.207945+0000","last_became_peered":"2024-09-12T17:58:40.207945+0000","last_unstale":"2024-09-12T19:26:10.081400+0000","last_undegraded":"2024-09-12T19:26:10.081400+0000","last_fullsized":"2024-09-12T19:26:10.081400+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:52.444564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":21,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'37","reported_seq":169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026256+0000","last_change":"2024-09-12T17:52:39.871937+0000","last_active":"2024-09-12T19:25:09.026256+0000","last_peered":"2024-09-12T19:25:09.026256+0000","last_clean":"2024-09-12T19:25:09.026256+0000","last_became_active":"2024-09-12T17:52:39.871148+0000","last_became_peered":"2024-09-12T17:52:39.871148+0000","last_unstale":"2024-09-12T19:25:09.026256+0000","last_undegraded":"2024-09-12T19:25:09.026256+0000","last_fullsized":"2024-09-12T19:25:09.026256+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:45.467030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":131,"num_write":69,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.659086+0000","last_change":"2024-09-12T18:25:52.605404+0000","last_active":"2024-09-12T19:26:00.659086+0000","last_peered":"2024-09-12T19:26:00.659086+0000","last_clean":"2024-09-12T19:26:00.659086+0000","last_became_active":"2024-09-12T18:25:52.604589+0000","last_became_peered":"2024-09-12T18:25:52.604589+0000","last_unstale":"2024-09-12T19:26:00.659086+0000","last_undegraded":"2024-09-12T19:26:00.659086+0000","last_fullsized":"2024-09-12T19:26:00.659086+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.091248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.590632+0000","last_change":"2024-09-12T17:58:47.243839+0000","last_active":"2024-09-12T19:26:10.590632+0000","last_peered":"2024-09-12T19:26:10.590632+0000","last_clean":"2024-09-12T19:26:10.590632+0000","last_became_active":"2024-09-12T17:58:47.242756+0000","last_became_peered":"2024-09-12T17:58:47.242756+0000","last_unstale":"2024-09-12T19:26:10.590632+0000","last_undegraded":"2024-09-12T19:26:10.590632+0000","last_fullsized":"2024-09-12T19:26:10.590632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:13.909298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"262'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.241656+0000","last_change":"2024-09-12T17:58:40.211442+0000","last_active":"2024-09-12T19:25:40.241656+0000","last_peered":"2024-09-12T19:25:40.241656+0000","last_clean":"2024-09-12T19:25:40.241656+0000","last_became_active":"2024-09-12T17:58:40.202787+0000","last_became_peered":"2024-09-12T17:58:40.202787+0000","last_unstale":"2024-09-12T19:25:40.241656+0000","last_undegraded":"2024-09-12T19:25:40.241656+0000","last_fullsized":"2024-09-12T19:25:40.241656+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.258488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'30","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026173+0000","last_change":"2024-09-12T17:52:39.889339+0000","last_active":"2024-09-12T19:25:09.026173+0000","last_peered":"2024-09-12T19:25:09.026173+0000","last_clean":"2024-09-12T19:25:09.026173+0000","last_became_active":"2024-09-12T17:52:39.888092+0000","last_became_peered":"2024-09-12T17:52:39.888092+0000","last_unstale":"2024-09-12T19:25:09.026173+0000","last_undegraded":"2024-09-12T19:25:09.026173+0000","last_fullsized":"2024-09-12T19:25:09.026173+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:52.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682167+0000","last_change":"2024-09-12T18:25:52.615541+0000","last_active":"2024-09-12T19:26:20.682167+0000","last_peered":"2024-09-12T19:26:20.682167+0000","last_clean":"2024-09-12T19:26:20.682167+0000","last_became_active":"2024-09-12T18:25:52.614862+0000","last_became_peered":"2024-09-12T18:25:52.614862+0000","last_unstale":"2024-09-12T19:26:20.682167+0000","last_undegraded":"2024-09-12T19:26:20.682167+0000","last_fullsized":"2024-09-12T19:26:20.682167+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:20.974947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.346428+0000","last_change":"2024-09-12T17:58:47.251966+0000","last_active":"2024-09-12T19:25:50.346428+0000","last_peered":"2024-09-12T19:25:50.346428+0000","last_clean":"2024-09-12T19:25:50.346428+0000","last_became_active":"2024-09-12T17:58:47.246322+0000","last_became_peered":"2024-09-12T17:58:47.246322+0000","last_unstale":"2024-09-12T19:25:50.346428+0000","last_undegraded":"2024-09-12T19:25:50.346428+0000","last_fullsized":"2024-09-12T19:25:50.346428+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:04.147241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'3","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.351418+0000","last_change":"2024-09-12T17:58:40.207847+0000","last_active":"2024-09-12T19:26:10.351418+0000","last_peered":"2024-09-12T19:26:10.351418+0000","last_clean":"2024-09-12T19:26:10.351418+0000","last_became_active":"2024-09-12T17:58:40.207064+0000","last_became_peered":"2024-09-12T17:58:40.207064+0000","last_unstale":"2024-09-12T19:26:10.351418+0000","last_undegraded":"2024-09-12T19:26:10.351418+0000","last_fullsized":"2024-09-12T19:26:10.351418+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:41.646154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.225969+0000","last_change":"2024-09-12T17:52:39.884527+0000","last_active":"2024-09-12T19:25:10.225969+0000","last_peered":"2024-09-12T19:25:10.225969+0000","last_clean":"2024-09-12T19:25:10.225969+0000","last_became_active":"2024-09-12T17:52:39.883689+0000","last_became_peered":"2024-09-12T17:52:39.883689+0000","last_unstale":"2024-09-12T19:25:10.225969+0000","last_undegraded":"2024-09-12T19:25:10.225969+0000","last_fullsized":"2024-09-12T19:25:10.225969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:21.651937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.235695+0000","last_change":"2024-09-12T18:25:52.605313+0000","last_active":"2024-09-12T19:25:55.235695+0000","last_peered":"2024-09-12T19:25:55.235695+0000","last_clean":"2024-09-12T19:25:55.235695+0000","last_became_active":"2024-09-12T18:25:52.598221+0000","last_became_peered":"2024-09-12T18:25:52.598221+0000","last_unstale":"2024-09-12T19:25:55.235695+0000","last_undegraded":"2024-09-12T19:25:55.235695+0000","last_fullsized":"2024-09-12T19:25:55.235695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.818370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241434+0000","last_change":"2024-09-12T17:58:47.247385+0000","last_active":"2024-09-12T19:26:20.241434+0000","last_peered":"2024-09-12T19:26:20.241434+0000","last_clean":"2024-09-12T19:26:20.241434+0000","last_became_active":"2024-09-12T17:58:47.238781+0000","last_became_peered":"2024-09-12T17:58:47.238781+0000","last_unstale":"2024-09-12T19:26:20.241434+0000","last_undegraded":"2024-09-12T19:26:20.241434+0000","last_fullsized":"2024-09-12T19:26:20.241434+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:59.988556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.590718+0000","last_change":"2024-09-12T17:58:40.188716+0000","last_active":"2024-09-12T19:26:10.590718+0000","last_peered":"2024-09-12T19:26:10.590718+0000","last_clean":"2024-09-12T19:26:10.590718+0000","last_became_active":"2024-09-12T17:58:40.187973+0000","last_became_peered":"2024-09-12T17:58:40.187973+0000","last_unstale":"2024-09-12T19:26:10.590718+0000","last_undegraded":"2024-09-12T19:26:10.590718+0000","last_fullsized":"2024-09-12T19:26:10.590718+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:19.654518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'31","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675055+0000","last_change":"2024-09-12T17:52:39.892332+0000","last_active":"2024-09-12T19:27:10.675055+0000","last_peered":"2024-09-12T19:27:10.675055+0000","last_clean":"2024-09-12T19:27:10.675055+0000","last_became_active":"2024-09-12T17:52:39.891830+0000","last_became_peered":"2024-09-12T17:52:39.891830+0000","last_unstale":"2024-09-12T19:27:10.675055+0000","last_undegraded":"2024-09-12T19:27:10.675055+0000","last_fullsized":"2024-09-12T19:27:10.675055+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:19.516571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.588010+0000","last_change":"2024-09-12T18:25:52.607506+0000","last_active":"2024-09-12T19:25:55.588010+0000","last_peered":"2024-09-12T19:25:55.588010+0000","last_clean":"2024-09-12T19:25:55.588010+0000","last_became_active":"2024-09-12T18:25:52.606714+0000","last_became_peered":"2024-09-12T18:25:52.606714+0000","last_unstale":"2024-09-12T19:25:55.588010+0000","last_undegraded":"2024-09-12T19:25:55.588010+0000","last_fullsized":"2024-09-12T19:25:55.588010+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:29.094403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'3","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.663384+0000","last_change":"2024-09-12T17:58:47.251261+0000","last_active":"2024-09-12T19:26:20.663384+0000","last_peered":"2024-09-12T19:26:20.663384+0000","last_clean":"2024-09-12T19:26:20.663384+0000","last_became_active":"2024-09-12T17:58:47.250364+0000","last_became_peered":"2024-09-12T17:58:47.250364+0000","last_unstale":"2024-09-12T19:26:20.663384+0000","last_undegraded":"2024-09-12T19:26:20.663384+0000","last_fullsized":"2024-09-12T19:26:20.663384+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:18.815473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:09.038794+0000","last_change":"2024-09-12T17:58:40.212846+0000","last_active":"2024-09-12T19:26:09.038794+0000","last_peered":"2024-09-12T19:26:09.038794+0000","last_clean":"2024-09-12T19:26:09.038794+0000","last_became_active":"2024-09-12T17:58:40.212280+0000","last_became_peered":"2024-09-12T17:58:40.212280+0000","last_unstale":"2024-09-12T19:26:09.038794+0000","last_undegraded":"2024-09-12T19:26:09.038794+0000","last_fullsized":"2024-09-12T19:26:09.038794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:58.695339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'30","reported_seq":152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:54.048336+0000","last_change":"2024-09-12T17:52:39.871278+0000","last_active":"2024-09-12T19:26:54.048336+0000","last_peered":"2024-09-12T19:26:54.048336+0000","last_clean":"2024-09-12T19:26:54.048336+0000","last_became_active":"2024-09-12T17:52:39.870304+0000","last_became_peered":"2024-09-12T17:52:39.870304+0000","last_unstale":"2024-09-12T19:26:54.048336+0000","last_undegraded":"2024-09-12T19:26:54.048336+0000","last_fullsized":"2024-09-12T19:26:54.048336+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:38.765024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":59,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254085+0000","last_change":"2024-09-12T18:25:52.623401+0000","last_active":"2024-09-12T19:26:35.254085+0000","last_peered":"2024-09-12T19:26:35.254085+0000","last_clean":"2024-09-12T19:26:35.254085+0000","last_became_active":"2024-09-12T18:25:52.622842+0000","last_became_peered":"2024-09-12T18:25:52.622842+0000","last_unstale":"2024-09-12T19:26:35.254085+0000","last_undegraded":"2024-09-12T19:26:35.254085+0000","last_fullsized":"2024-09-12T19:26:35.254085+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:22.497623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.656697+0000","last_change":"2024-09-12T17:58:47.256168+0000","last_active":"2024-09-12T19:25:50.656697+0000","last_peered":"2024-09-12T19:25:50.656697+0000","last_clean":"2024-09-12T19:25:50.656697+0000","last_became_active":"2024-09-12T17:58:47.255379+0000","last_became_peered":"2024-09-12T17:58:47.255379+0000","last_unstale":"2024-09-12T19:25:50.656697+0000","last_undegraded":"2024-09-12T19:25:50.656697+0000","last_fullsized":"2024-09-12T19:25:50.656697+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:28.202469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.341509+0000","last_change":"2024-09-12T17:58:40.194167+0000","last_active":"2024-09-12T19:25:30.341509+0000","last_peered":"2024-09-12T19:25:30.341509+0000","last_clean":"2024-09-12T19:25:30.341509+0000","last_became_active":"2024-09-12T17:58:40.193471+0000","last_became_peered":"2024-09-12T17:58:40.193471+0000","last_unstale":"2024-09-12T19:25:30.341509+0000","last_undegraded":"2024-09-12T19:25:30.341509+0000","last_fullsized":"2024-09-12T19:25:30.341509+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:18.036549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'46","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690191+0000","last_change":"2024-09-12T17:52:39.883998+0000","last_active":"2024-09-12T19:26:55.690191+0000","last_peered":"2024-09-12T19:26:55.690191+0000","last_clean":"2024-09-12T19:26:55.690191+0000","last_became_active":"2024-09-12T17:52:39.883248+0000","last_became_peered":"2024-09-12T17:52:39.883248+0000","last_unstale":"2024-09-12T19:26:55.690191+0000","last_undegraded":"2024-09-12T19:26:55.690191+0000","last_fullsized":"2024-09-12T19:26:55.690191+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:59.309550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":156,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:34.044189+0000","last_change":"2024-09-12T18:25:52.612372+0000","last_active":"2024-09-12T19:26:34.044189+0000","last_peered":"2024-09-12T19:26:34.044189+0000","last_clean":"2024-09-12T19:26:34.044189+0000","last_became_active":"2024-09-12T18:25:52.611620+0000","last_became_peered":"2024-09-12T18:25:52.611620+0000","last_unstale":"2024-09-12T19:26:34.044189+0000","last_undegraded":"2024-09-12T19:26:34.044189+0000","last_fullsized":"2024-09-12T19:26:34.044189+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:49.193437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'6","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:35.240621+0000","last_change":"2024-09-12T17:58:47.250813+0000","last_active":"2024-09-12T19:25:35.240621+0000","last_peered":"2024-09-12T19:25:35.240621+0000","last_clean":"2024-09-12T19:25:35.240621+0000","last_became_active":"2024-09-12T17:58:47.249833+0000","last_became_peered":"2024-09-12T17:58:47.249833+0000","last_unstale":"2024-09-12T19:25:35.240621+0000","last_undegraded":"2024-09-12T19:25:35.240621+0000","last_fullsized":"2024-09-12T19:25:35.240621+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:00.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.584687+0000","last_change":"2024-09-12T17:58:40.204716+0000","last_active":"2024-09-12T19:25:40.584687+0000","last_peered":"2024-09-12T19:25:40.584687+0000","last_clean":"2024-09-12T19:25:40.584687+0000","last_became_active":"2024-09-12T17:58:40.203917+0000","last_became_peered":"2024-09-12T17:58:40.203917+0000","last_unstale":"2024-09-12T19:25:40.584687+0000","last_undegraded":"2024-09-12T19:25:40.584687+0000","last_fullsized":"2024-09-12T19:25:40.584687+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:29.039732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690138+0000","last_change":"2024-09-12T17:52:39.885011+0000","last_active":"2024-09-12T19:26:55.690138+0000","last_peered":"2024-09-12T19:26:55.690138+0000","last_clean":"2024-09-12T19:26:55.690138+0000","last_became_active":"2024-09-12T17:52:39.884285+0000","last_became_peered":"2024-09-12T17:52:39.884285+0000","last_unstale":"2024-09-12T19:26:55.690138+0000","last_undegraded":"2024-09-12T19:26:55.690138+0000","last_fullsized":"2024-09-12T19:26:55.690138+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:22.466454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.244671+0000","last_change":"2024-09-12T18:25:52.624010+0000","last_active":"2024-09-12T19:26:35.244671+0000","last_peered":"2024-09-12T19:26:35.244671+0000","last_clean":"2024-09-12T19:26:35.244671+0000","last_became_active":"2024-09-12T18:25:52.623502+0000","last_became_peered":"2024-09-12T18:25:52.623502+0000","last_unstale":"2024-09-12T19:26:35.244671+0000","last_undegraded":"2024-09-12T19:26:35.244671+0000","last_fullsized":"2024-09-12T19:26:35.244671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:54.401588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'4","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.656813+0000","last_change":"2024-09-12T17:58:47.257454+0000","last_active":"2024-09-12T19:25:50.656813+0000","last_peered":"2024-09-12T19:25:50.656813+0000","last_clean":"2024-09-12T19:25:50.656813+0000","last_became_active":"2024-09-12T17:58:47.256721+0000","last_became_peered":"2024-09-12T17:58:47.256721+0000","last_unstale":"2024-09-12T19:25:50.656813+0000","last_undegraded":"2024-09-12T19:25:50.656813+0000","last_fullsized":"2024-09-12T19:25:50.656813+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:39.335691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8428753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":16424,"num_write":9,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'1","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.654552+0000","last_change":"2024-09-12T17:58:40.199627+0000","last_active":"2024-09-12T19:25:40.654552+0000","last_peered":"2024-09-12T19:25:40.654552+0000","last_clean":"2024-09-12T19:25:40.654552+0000","last_became_active":"2024-09-12T17:58:40.198765+0000","last_became_peered":"2024-09-12T17:58:40.198765+0000","last_unstale":"2024-09-12T19:25:40.654552+0000","last_undegraded":"2024-09-12T19:25:40.654552+0000","last_fullsized":"2024-09-12T19:25:40.654552+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:37.234886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'58","reported_seq":224,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671649+0000","last_change":"2024-09-12T17:52:39.886405+0000","last_active":"2024-09-12T19:26:55.671649+0000","last_peered":"2024-09-12T19:26:55.671649+0000","last_clean":"2024-09-12T19:26:55.671649+0000","last_became_active":"2024-09-12T17:52:39.885875+0000","last_became_peered":"2024-09-12T17:52:39.885875+0000","last_unstale":"2024-09-12T19:26:55.671649+0000","last_undegraded":"2024-09-12T19:26:55.671649+0000","last_fullsized":"2024-09-12T19:26:55.671649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:42.953403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":205,"num_write":103,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.596249+0000","last_change":"2024-09-12T18:25:52.618187+0000","last_active":"2024-09-12T19:26:35.596249+0000","last_peered":"2024-09-12T19:26:35.596249+0000","last_clean":"2024-09-12T19:26:35.596249+0000","last_became_active":"2024-09-12T18:25:52.617665+0000","last_became_peered":"2024-09-12T18:25:52.617665+0000","last_unstale":"2024-09-12T19:26:35.596249+0000","last_undegraded":"2024-09-12T19:26:35.596249+0000","last_fullsized":"2024-09-12T19:26:35.596249+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:16.143458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'5","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586974+0000","last_change":"2024-09-12T17:58:47.254576+0000","last_active":"2024-09-12T19:25:50.586974+0000","last_peered":"2024-09-12T19:25:50.586974+0000","last_clean":"2024-09-12T19:25:50.586974+0000","last_became_active":"2024-09-12T17:58:47.253819+0000","last_became_peered":"2024-09-12T17:58:47.253819+0000","last_unstale":"2024-09-12T19:25:50.586974+0000","last_undegraded":"2024-09-12T19:25:50.586974+0000","last_fullsized":"2024-09-12T19:25:50.586974+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:16.422570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.241886+0000","last_change":"2024-09-12T17:58:40.208386+0000","last_active":"2024-09-12T19:25:40.241886+0000","last_peered":"2024-09-12T19:25:40.241886+0000","last_clean":"2024-09-12T19:25:40.241886+0000","last_became_active":"2024-09-12T17:58:40.202790+0000","last_became_peered":"2024-09-12T17:58:40.202790+0000","last_unstale":"2024-09-12T19:25:40.241886+0000","last_undegraded":"2024-09-12T19:25:40.241886+0000","last_fullsized":"2024-09-12T19:25:40.241886+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:41.561154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'30","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:30.356662+0000","last_change":"2024-09-12T17:52:39.872248+0000","last_active":"2024-09-12T19:26:30.356662+0000","last_peered":"2024-09-12T19:26:30.356662+0000","last_clean":"2024-09-12T19:26:30.356662+0000","last_became_active":"2024-09-12T17:52:39.871009+0000","last_became_peered":"2024-09-12T17:52:39.871009+0000","last_unstale":"2024-09-12T19:26:30.356662+0000","last_undegraded":"2024-09-12T19:26:30.356662+0000","last_fullsized":"2024-09-12T19:26:30.356662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:36.952465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250730+0000","last_change":"2024-09-12T18:25:52.620335+0000","last_active":"2024-09-12T19:26:20.250730+0000","last_peered":"2024-09-12T19:26:20.250730+0000","last_clean":"2024-09-12T19:26:20.250730+0000","last_became_active":"2024-09-12T18:25:52.617863+0000","last_became_peered":"2024-09-12T18:25:52.617863+0000","last_unstale":"2024-09-12T19:26:20.250730+0000","last_undegraded":"2024-09-12T19:26:20.250730+0000","last_fullsized":"2024-09-12T19:26:20.250730+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:38.215652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"262'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.234651+0000","last_change":"2024-09-12T17:58:47.248615+0000","last_active":"2024-09-12T19:25:10.234651+0000","last_peered":"2024-09-12T19:25:10.234651+0000","last_clean":"2024-09-12T19:25:10.234651+0000","last_became_active":"2024-09-12T17:58:47.247475+0000","last_became_peered":"2024-09-12T17:58:47.247475+0000","last_unstale":"2024-09-12T19:25:10.234651+0000","last_undegraded":"2024-09-12T19:25:10.234651+0000","last_fullsized":"2024-09-12T19:25:10.234651+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:38.703200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"265'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097114+0000","last_change":"2024-09-12T17:58:40.203206+0000","last_active":"2024-09-12T19:27:20.097114+0000","last_peered":"2024-09-12T19:27:20.097114+0000","last_clean":"2024-09-12T19:27:20.097114+0000","last_became_active":"2024-09-12T17:58:40.202141+0000","last_became_peered":"2024-09-12T17:58:40.202141+0000","last_unstale":"2024-09-12T19:27:20.097114+0000","last_undegraded":"2024-09-12T19:27:20.097114+0000","last_fullsized":"2024-09-12T19:27:20.097114+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:09.764989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'22","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.349102+0000","last_change":"2024-09-12T17:52:39.885280+0000","last_active":"2024-09-12T19:26:00.349102+0000","last_peered":"2024-09-12T19:26:00.349102+0000","last_clean":"2024-09-12T19:26:00.349102+0000","last_became_active":"2024-09-12T17:52:39.884686+0000","last_became_peered":"2024-09-12T17:52:39.884686+0000","last_unstale":"2024-09-12T19:26:00.349102+0000","last_undegraded":"2024-09-12T19:26:00.349102+0000","last_fullsized":"2024-09-12T19:26:00.349102+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:49.000832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041069+0000","last_change":"2024-09-12T18:25:52.613926+0000","last_active":"2024-09-12T19:26:19.041069+0000","last_peered":"2024-09-12T19:26:19.041069+0000","last_clean":"2024-09-12T19:26:19.041069+0000","last_became_active":"2024-09-12T18:25:52.611450+0000","last_became_peered":"2024-09-12T18:25:52.611450+0000","last_unstale":"2024-09-12T19:26:19.041069+0000","last_undegraded":"2024-09-12T19:26:19.041069+0000","last_fullsized":"2024-09-12T19:26:19.041069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:02.885475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'2","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.234527+0000","last_change":"2024-09-12T17:58:47.254616+0000","last_active":"2024-09-12T19:25:10.234527+0000","last_peered":"2024-09-12T19:25:10.234527+0000","last_clean":"2024-09-12T19:25:10.234527+0000","last_became_active":"2024-09-12T17:58:47.254061+0000","last_became_peered":"2024-09-12T17:58:47.254061+0000","last_unstale":"2024-09-12T19:25:10.234527+0000","last_undegraded":"2024-09-12T19:25:10.234527+0000","last_fullsized":"2024-09-12T19:25:10.234527+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:06.779952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'1","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.264682+0000","last_change":"2024-09-12T17:58:40.203937+0000","last_active":"2024-09-12T19:27:20.264682+0000","last_peered":"2024-09-12T19:27:20.264682+0000","last_clean":"2024-09-12T19:27:20.264682+0000","last_became_active":"2024-09-12T17:58:40.203144+0000","last_became_peered":"2024-09-12T17:58:40.203144+0000","last_unstale":"2024-09-12T19:27:20.264682+0000","last_undegraded":"2024-09-12T19:27:20.264682+0000","last_fullsized":"2024-09-12T19:27:20.264682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:57.360002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"262'16","reported_seq":117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.658972+0000","last_change":"2024-09-12T17:52:39.879536+0000","last_active":"2024-09-12T19:26:00.658972+0000","last_peered":"2024-09-12T19:26:00.658972+0000","last_clean":"2024-09-12T19:26:00.658972+0000","last_became_active":"2024-09-12T17:52:39.878797+0000","last_became_peered":"2024-09-12T17:52:39.878797+0000","last_unstale":"2024-09-12T19:26:00.658972+0000","last_undegraded":"2024-09-12T19:26:00.658972+0000","last_fullsized":"2024-09-12T19:26:00.658972+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:15.860760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.687851+0000","last_change":"2024-09-12T18:25:52.615680+0000","last_active":"2024-09-12T19:26:45.687851+0000","last_peered":"2024-09-12T19:26:45.687851+0000","last_clean":"2024-09-12T19:26:45.687851+0000","last_became_active":"2024-09-12T18:25:52.614949+0000","last_became_peered":"2024-09-12T18:25:52.614949+0000","last_unstale":"2024-09-12T19:26:45.687851+0000","last_undegraded":"2024-09-12T19:26:45.687851+0000","last_fullsized":"2024-09-12T19:26:45.687851+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:20.554312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.647849+0000","last_change":"2024-09-12T17:58:47.247578+0000","last_active":"2024-09-12T19:25:10.647849+0000","last_peered":"2024-09-12T19:25:10.647849+0000","last_clean":"2024-09-12T19:25:10.647849+0000","last_became_active":"2024-09-12T17:58:47.246916+0000","last_became_peered":"2024-09-12T17:58:47.246916+0000","last_unstale":"2024-09-12T19:25:10.647849+0000","last_undegraded":"2024-09-12T19:25:10.647849+0000","last_fullsized":"2024-09-12T19:25:10.647849+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.850549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"262'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097274+0000","last_change":"2024-09-12T17:58:40.208435+0000","last_active":"2024-09-12T19:27:20.097274+0000","last_peered":"2024-09-12T19:27:20.097274+0000","last_clean":"2024-09-12T19:27:20.097274+0000","last_became_active":"2024-09-12T17:58:40.207311+0000","last_became_peered":"2024-09-12T17:58:40.207311+0000","last_unstale":"2024-09-12T19:27:20.097274+0000","last_undegraded":"2024-09-12T19:27:20.097274+0000","last_fullsized":"2024-09-12T19:27:20.097274+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:09.258846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'29","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.236763+0000","last_change":"2024-09-12T17:52:39.867898+0000","last_active":"2024-09-12T19:26:00.236763+0000","last_peered":"2024-09-12T19:26:00.236763+0000","last_clean":"2024-09-12T19:26:00.236763+0000","last_became_active":"2024-09-12T17:52:39.867179+0000","last_became_peered":"2024-09-12T17:52:39.867179+0000","last_unstale":"2024-09-12T19:26:00.236763+0000","last_undegraded":"2024-09-12T19:26:00.236763+0000","last_fullsized":"2024-09-12T19:26:00.236763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:01.169877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":56,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041017+0000","last_change":"2024-09-12T18:25:52.612961+0000","last_active":"2024-09-12T19:26:19.041017+0000","last_peered":"2024-09-12T19:26:19.041017+0000","last_clean":"2024-09-12T19:26:19.041017+0000","last_became_active":"2024-09-12T18:25:52.610587+0000","last_became_peered":"2024-09-12T18:25:52.610587+0000","last_unstale":"2024-09-12T19:26:19.041017+0000","last_undegraded":"2024-09-12T19:26:19.041017+0000","last_fullsized":"2024-09-12T19:26:19.041017+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:48.847349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.336407+0000","last_change":"2024-09-12T17:58:47.251206+0000","last_active":"2024-09-12T19:25:10.336407+0000","last_peered":"2024-09-12T19:25:10.336407+0000","last_clean":"2024-09-12T19:25:10.336407+0000","last_became_active":"2024-09-12T17:58:47.245601+0000","last_became_peered":"2024-09-12T17:58:47.245601+0000","last_unstale":"2024-09-12T19:25:10.336407+0000","last_undegraded":"2024-09-12T19:25:10.336407+0000","last_fullsized":"2024-09-12T19:25:10.336407+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:19.101729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097320+0000","last_change":"2024-09-12T17:58:40.203425+0000","last_active":"2024-09-12T19:27:20.097320+0000","last_peered":"2024-09-12T19:27:20.097320+0000","last_clean":"2024-09-12T19:27:20.097320+0000","last_became_active":"2024-09-12T17:58:40.202408+0000","last_became_peered":"2024-09-12T17:58:40.202408+0000","last_unstale":"2024-09-12T19:27:20.097320+0000","last_undegraded":"2024-09-12T19:27:20.097320+0000","last_fullsized":"2024-09-12T19:27:20.097320+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:04.410943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":531,"num_write":4,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'108","reported_seq":441,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.658909+0000","last_change":"2024-09-12T17:52:39.881369+0000","last_active":"2024-09-12T19:26:00.658909+0000","last_peered":"2024-09-12T19:26:00.658909+0000","last_clean":"2024-09-12T19:26:00.658909+0000","last_became_active":"2024-09-12T17:52:39.880742+0000","last_became_peered":"2024-09-12T17:52:39.880742+0000","last_unstale":"2024-09-12T19:26:00.658909+0000","last_undegraded":"2024-09-12T19:26:00.658909+0000","last_fullsized":"2024-09-12T19:26:00.658909+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:12.083548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":720,"num_read_kb":486,"num_write":145,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258684+0000","last_change":"2024-09-12T18:25:52.605986+0000","last_active":"2024-09-12T19:26:55.258684+0000","last_peered":"2024-09-12T19:26:55.258684+0000","last_clean":"2024-09-12T19:26:55.258684+0000","last_became_active":"2024-09-12T18:25:52.605039+0000","last_became_peered":"2024-09-12T18:25:52.605039+0000","last_unstale":"2024-09-12T19:26:55.258684+0000","last_undegraded":"2024-09-12T19:26:55.258684+0000","last_fullsized":"2024-09-12T19:26:55.258684+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.770637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'6","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667072+0000","last_change":"2024-09-12T17:58:47.242884+0000","last_active":"2024-09-12T19:26:35.667072+0000","last_peered":"2024-09-12T19:26:35.667072+0000","last_clean":"2024-09-12T19:26:35.667072+0000","last_became_active":"2024-09-12T17:58:47.241778+0000","last_became_peered":"2024-09-12T17:58:47.241778+0000","last_unstale":"2024-09-12T19:26:35.667072+0000","last_undegraded":"2024-09-12T19:26:35.667072+0000","last_fullsized":"2024-09-12T19:26:35.667072+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:36.555666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":3074,"num_write":11,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242718+0000","last_change":"2024-09-12T17:58:40.196234+0000","last_active":"2024-09-12T19:26:25.242718+0000","last_peered":"2024-09-12T19:26:25.242718+0000","last_clean":"2024-09-12T19:26:25.242718+0000","last_became_active":"2024-09-12T17:58:40.195309+0000","last_became_peered":"2024-09-12T17:58:40.195309+0000","last_unstale":"2024-09-12T19:26:25.242718+0000","last_undegraded":"2024-09-12T19:26:25.242718+0000","last_fullsized":"2024-09-12T19:26:25.242718+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:30.098876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"262'110","reported_seq":458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:25.678784+0000","last_change":"2024-09-12T17:52:39.886824+0000","last_active":"2024-09-12T19:27:25.678784+0000","last_peered":"2024-09-12T19:27:25.678784+0000","last_clean":"2024-09-12T19:27:25.678784+0000","last_became_active":"2024-09-12T17:52:39.886185+0000","last_became_peered":"2024-09-12T17:52:39.886185+0000","last_unstale":"2024-09-12T19:27:25.678784+0000","last_undegraded":"2024-09-12T19:27:25.678784+0000","last_fullsized":"2024-09-12T19:27:25.678784+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:31.714670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":756,"num_read_kb":514,"num_write":140,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.088040+0000","last_change":"2024-09-12T18:25:52.624391+0000","last_active":"2024-09-12T19:26:40.088040+0000","last_peered":"2024-09-12T19:26:40.088040+0000","last_clean":"2024-09-12T19:26:40.088040+0000","last_became_active":"2024-09-12T18:25:52.623444+0000","last_became_peered":"2024-09-12T18:25:52.623444+0000","last_unstale":"2024-09-12T19:26:40.088040+0000","last_undegraded":"2024-09-12T19:26:40.088040+0000","last_fullsized":"2024-09-12T19:26:40.088040+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:41.418750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667006+0000","last_change":"2024-09-12T17:58:47.255347+0000","last_active":"2024-09-12T19:26:35.667006+0000","last_peered":"2024-09-12T19:26:35.667006+0000","last_clean":"2024-09-12T19:26:35.667006+0000","last_became_active":"2024-09-12T17:58:47.254273+0000","last_became_peered":"2024-09-12T17:58:47.254273+0000","last_unstale":"2024-09-12T19:26:35.667006+0000","last_undegraded":"2024-09-12T19:26:35.667006+0000","last_fullsized":"2024-09-12T19:26:35.667006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:34.502761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'1","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:24.042159+0000","last_change":"2024-09-12T17:58:40.202847+0000","last_active":"2024-09-12T19:26:24.042159+0000","last_peered":"2024-09-12T19:26:24.042159+0000","last_clean":"2024-09-12T19:26:24.042159+0000","last_became_active":"2024-09-12T17:58:40.202027+0000","last_became_peered":"2024-09-12T17:58:40.202027+0000","last_unstale":"2024-09-12T19:26:24.042159+0000","last_undegraded":"2024-09-12T19:26:24.042159+0000","last_fullsized":"2024-09-12T19:26:24.042159+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:12.912226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'31","reported_seq":153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366551+0000","last_change":"2024-09-12T17:52:39.877904+0000","last_active":"2024-09-12T19:27:10.366551+0000","last_peered":"2024-09-12T19:27:10.366551+0000","last_clean":"2024-09-12T19:27:10.366551+0000","last_became_active":"2024-09-12T17:52:39.877206+0000","last_became_peered":"2024-09-12T17:52:39.877206+0000","last_unstale":"2024-09-12T19:27:10.366551+0000","last_undegraded":"2024-09-12T19:27:10.366551+0000","last_fullsized":"2024-09-12T19:27:10.366551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.931327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":97,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.357743+0000","last_change":"2024-09-12T18:25:52.620716+0000","last_active":"2024-09-12T19:26:35.357743+0000","last_peered":"2024-09-12T19:26:35.357743+0000","last_clean":"2024-09-12T19:26:35.357743+0000","last_became_active":"2024-09-12T18:25:52.620045+0000","last_became_peered":"2024-09-12T18:25:52.620045+0000","last_unstale":"2024-09-12T19:26:35.357743+0000","last_undegraded":"2024-09-12T19:26:35.357743+0000","last_fullsized":"2024-09-12T19:26:35.357743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:58.464498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670475+0000","last_change":"2024-09-12T17:58:47.253752+0000","last_active":"2024-09-12T19:26:50.670475+0000","last_peered":"2024-09-12T19:26:50.670475+0000","last_clean":"2024-09-12T19:26:50.670475+0000","last_became_active":"2024-09-12T17:58:47.252966+0000","last_became_peered":"2024-09-12T17:58:47.252966+0000","last_unstale":"2024-09-12T19:26:50.670475+0000","last_undegraded":"2024-09-12T19:26:50.670475+0000","last_fullsized":"2024-09-12T19:26:50.670475+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:12.503210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664783+0000","last_change":"2024-09-12T17:58:40.198879+0000","last_active":"2024-09-12T19:26:25.664783+0000","last_peered":"2024-09-12T19:26:25.664783+0000","last_clean":"2024-09-12T19:26:25.664783+0000","last_became_active":"2024-09-12T17:58:40.198161+0000","last_became_peered":"2024-09-12T17:58:40.198161+0000","last_unstale":"2024-09-12T19:26:25.664783+0000","last_undegraded":"2024-09-12T19:26:25.664783+0000","last_fullsized":"2024-09-12T19:26:25.664783+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:50.706791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":11,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'31","reported_seq":154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.094779+0000","last_change":"2024-09-12T17:52:39.867437+0000","last_active":"2024-09-12T19:27:10.094779+0000","last_peered":"2024-09-12T19:27:10.094779+0000","last_clean":"2024-09-12T19:27:10.094779+0000","last_became_active":"2024-09-12T17:52:39.866342+0000","last_became_peered":"2024-09-12T17:52:39.866342+0000","last_unstale":"2024-09-12T19:27:10.094779+0000","last_undegraded":"2024-09-12T19:27:10.094779+0000","last_fullsized":"2024-09-12T19:27:10.094779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:36.550336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":107,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.086529+0000","last_change":"2024-09-12T18:25:52.601482+0000","last_active":"2024-09-12T19:26:35.086529+0000","last_peered":"2024-09-12T19:26:35.086529+0000","last_clean":"2024-09-12T19:26:35.086529+0000","last_became_active":"2024-09-12T18:25:52.599679+0000","last_became_peered":"2024-09-12T18:25:52.599679+0000","last_unstale":"2024-09-12T19:26:35.086529+0000","last_undegraded":"2024-09-12T19:26:35.086529+0000","last_fullsized":"2024-09-12T19:26:35.086529+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:02.845957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'1","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254188+0000","last_change":"2024-09-12T17:58:47.256589+0000","last_active":"2024-09-12T19:26:35.254188+0000","last_peered":"2024-09-12T19:26:35.254188+0000","last_clean":"2024-09-12T19:26:35.254188+0000","last_became_active":"2024-09-12T17:58:47.255891+0000","last_became_peered":"2024-09-12T17:58:47.255891+0000","last_unstale":"2024-09-12T19:26:35.254188+0000","last_undegraded":"2024-09-12T19:26:35.254188+0000","last_fullsized":"2024-09-12T19:26:35.254188+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:52.933367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"262'3","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668287+0000","last_change":"2024-09-12T17:58:40.212187+0000","last_active":"2024-09-12T19:26:40.668287+0000","last_peered":"2024-09-12T19:26:40.668287+0000","last_clean":"2024-09-12T19:26:40.668287+0000","last_became_active":"2024-09-12T17:58:40.211450+0000","last_became_peered":"2024-09-12T17:58:40.211450+0000","last_unstale":"2024-09-12T19:26:40.668287+0000","last_undegraded":"2024-09-12T19:26:40.668287+0000","last_fullsized":"2024-09-12T19:26:40.668287+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:21.169200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'25","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:09.052206+0000","last_change":"2024-09-12T17:52:39.866705+0000","last_active":"2024-09-12T19:27:09.052206+0000","last_peered":"2024-09-12T19:27:09.052206+0000","last_clean":"2024-09-12T19:27:09.052206+0000","last_became_active":"2024-09-12T17:52:39.865914+0000","last_became_peered":"2024-09-12T17:52:39.865914+0000","last_unstale":"2024-09-12T19:27:09.052206+0000","last_undegraded":"2024-09-12T19:27:09.052206+0000","last_fullsized":"2024-09-12T19:27:09.052206+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:43.382459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255364+0000","last_change":"2024-09-12T18:25:52.613354+0000","last_active":"2024-09-12T19:26:40.255364+0000","last_peered":"2024-09-12T19:26:40.255364+0000","last_clean":"2024-09-12T19:26:40.255364+0000","last_became_active":"2024-09-12T18:25:52.612421+0000","last_became_peered":"2024-09-12T18:25:52.612421+0000","last_unstale":"2024-09-12T19:26:40.255364+0000","last_undegraded":"2024-09-12T19:26:40.255364+0000","last_fullsized":"2024-09-12T19:26:40.255364+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:29.095745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'1","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.341378+0000","last_change":"2024-09-12T17:58:47.246522+0000","last_active":"2024-09-12T19:25:30.341378+0000","last_peered":"2024-09-12T19:25:30.341378+0000","last_clean":"2024-09-12T19:25:30.341378+0000","last_became_active":"2024-09-12T17:58:47.238172+0000","last_became_peered":"2024-09-12T17:58:47.238172+0000","last_unstale":"2024-09-12T19:25:30.341378+0000","last_undegraded":"2024-09-12T19:25:30.341378+0000","last_fullsized":"2024-09-12T19:25:30.341378+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:56.402000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.679708+0000","last_change":"2024-09-12T17:58:40.194862+0000","last_active":"2024-09-12T19:27:30.679708+0000","last_peered":"2024-09-12T19:27:30.679708+0000","last_clean":"2024-09-12T19:27:30.679708+0000","last_became_active":"2024-09-12T17:58:40.194093+0000","last_became_peered":"2024-09-12T17:58:40.194093+0000","last_unstale":"2024-09-12T19:27:30.679708+0000","last_undegraded":"2024-09-12T19:27:30.679708+0000","last_fullsized":"2024-09-12T19:27:30.679708+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:55.158370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'38","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:09.052156+0000","last_change":"2024-09-12T17:52:39.888669+0000","last_active":"2024-09-12T19:27:09.052156+0000","last_peered":"2024-09-12T19:27:09.052156+0000","last_clean":"2024-09-12T19:27:09.052156+0000","last_became_active":"2024-09-12T17:52:39.887302+0000","last_became_peered":"2024-09-12T17:52:39.887302+0000","last_unstale":"2024-09-12T19:27:09.052156+0000","last_undegraded":"2024-09-12T19:27:09.052156+0000","last_fullsized":"2024-09-12T19:27:09.052156+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:45.562829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":146,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249879+0000","last_change":"2024-09-12T18:25:52.611745+0000","last_active":"2024-09-12T19:27:00.249879+0000","last_peered":"2024-09-12T19:27:00.249879+0000","last_clean":"2024-09-12T19:27:00.249879+0000","last_became_active":"2024-09-12T18:25:52.611022+0000","last_became_peered":"2024-09-12T18:25:52.611022+0000","last_unstale":"2024-09-12T19:27:00.249879+0000","last_undegraded":"2024-09-12T19:27:00.249879+0000","last_fullsized":"2024-09-12T19:27:00.249879+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:05.067276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"262'5","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.230402+0000","last_change":"2024-09-12T17:58:47.248839+0000","last_active":"2024-09-12T19:25:30.230402+0000","last_peered":"2024-09-12T19:25:30.230402+0000","last_clean":"2024-09-12T19:25:30.230402+0000","last_became_active":"2024-09-12T17:58:47.247599+0000","last_became_peered":"2024-09-12T17:58:47.247599+0000","last_unstale":"2024-09-12T19:25:30.230402+0000","last_undegraded":"2024-09-12T19:25:30.230402+0000","last_fullsized":"2024-09-12T19:25:30.230402+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:14.680201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.267041+0000","last_change":"2024-09-12T17:58:40.203966+0000","last_active":"2024-09-12T19:27:30.267041+0000","last_peered":"2024-09-12T19:27:30.267041+0000","last_clean":"2024-09-12T19:27:30.267041+0000","last_became_active":"2024-09-12T17:58:40.203177+0000","last_became_peered":"2024-09-12T17:58:40.203177+0000","last_unstale":"2024-09-12T19:27:30.267041+0000","last_undegraded":"2024-09-12T19:27:30.267041+0000","last_fullsized":"2024-09-12T19:27:30.267041+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:05.344996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'30","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.240017+0000","last_change":"2024-09-12T17:52:39.878505+0000","last_active":"2024-09-12T19:26:15.240017+0000","last_peered":"2024-09-12T19:26:15.240017+0000","last_clean":"2024-09-12T19:26:15.240017+0000","last_became_active":"2024-09-12T17:52:39.877793+0000","last_became_peered":"2024-09-12T17:52:39.877793+0000","last_unstale":"2024-09-12T19:26:15.240017+0000","last_undegraded":"2024-09-12T19:26:15.240017+0000","last_fullsized":"2024-09-12T19:26:15.240017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:26.899906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.597487+0000","last_change":"2024-09-12T18:25:52.618530+0000","last_active":"2024-09-12T19:26:40.597487+0000","last_peered":"2024-09-12T19:26:40.597487+0000","last_clean":"2024-09-12T19:26:40.597487+0000","last_became_active":"2024-09-12T18:25:52.617815+0000","last_became_peered":"2024-09-12T18:25:52.617815+0000","last_unstale":"2024-09-12T19:26:40.597487+0000","last_undegraded":"2024-09-12T19:26:40.597487+0000","last_fullsized":"2024-09-12T19:26:40.597487+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:26.125712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:34.044128+0000","last_change":"2024-09-12T17:58:47.257576+0000","last_active":"2024-09-12T19:26:34.044128+0000","last_peered":"2024-09-12T19:26:34.044128+0000","last_clean":"2024-09-12T19:26:34.044128+0000","last_became_active":"2024-09-12T17:58:47.256924+0000","last_became_peered":"2024-09-12T17:58:47.256924+0000","last_unstale":"2024-09-12T19:26:34.044128+0000","last_undegraded":"2024-09-12T19:26:34.044128+0000","last_fullsized":"2024-09-12T19:26:34.044128+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:39.738133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:35.653357+0000","last_change":"2024-09-12T17:58:40.194527+0000","last_active":"2024-09-12T19:25:35.653357+0000","last_peered":"2024-09-12T19:25:35.653357+0000","last_clean":"2024-09-12T19:25:35.653357+0000","last_became_active":"2024-09-12T17:58:40.193786+0000","last_became_peered":"2024-09-12T17:58:40.193786+0000","last_unstale":"2024-09-12T19:25:35.653357+0000","last_undegraded":"2024-09-12T19:25:35.653357+0000","last_fullsized":"2024-09-12T19:25:35.653357+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:14.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'23","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.243911+0000","last_change":"2024-09-12T17:52:39.875927+0000","last_active":"2024-09-12T19:25:50.243911+0000","last_peered":"2024-09-12T19:25:50.243911+0000","last_clean":"2024-09-12T19:25:50.243911+0000","last_became_active":"2024-09-12T17:52:39.869627+0000","last_became_peered":"2024-09-12T17:52:39.869627+0000","last_unstale":"2024-09-12T19:25:50.243911+0000","last_undegraded":"2024-09-12T19:25:50.243911+0000","last_fullsized":"2024-09-12T19:25:50.243911+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.817489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":43,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668164+0000","last_change":"2024-09-12T18:25:52.624807+0000","last_active":"2024-09-12T19:26:40.668164+0000","last_peered":"2024-09-12T19:26:40.668164+0000","last_clean":"2024-09-12T19:26:40.668164+0000","last_became_active":"2024-09-12T18:25:52.624296+0000","last_became_peered":"2024-09-12T18:25:52.624296+0000","last_unstale":"2024-09-12T19:26:40.668164+0000","last_undegraded":"2024-09-12T19:26:40.668164+0000","last_fullsized":"2024-09-12T19:26:40.668164+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:35.580294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"265'7","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586846+0000","last_change":"2024-09-12T17:58:47.244823+0000","last_active":"2024-09-12T19:25:50.586846+0000","last_peered":"2024-09-12T19:25:50.586846+0000","last_clean":"2024-09-12T19:25:50.586846+0000","last_became_active":"2024-09-12T17:58:47.242874+0000","last_became_peered":"2024-09-12T17:58:47.242874+0000","last_unstale":"2024-09-12T19:25:50.586846+0000","last_undegraded":"2024-09-12T19:25:50.586846+0000","last_fullsized":"2024-09-12T19:25:50.586846+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:49.961011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":9787,"num_write":7,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'4","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355417+0000","last_change":"2024-09-12T17:58:40.175758+0000","last_active":"2024-09-12T19:26:25.355417+0000","last_peered":"2024-09-12T19:26:25.355417+0000","last_clean":"2024-09-12T19:26:25.355417+0000","last_became_active":"2024-09-12T17:58:40.175011+0000","last_became_peered":"2024-09-12T17:58:40.175011+0000","last_unstale":"2024-09-12T19:26:25.355417+0000","last_undegraded":"2024-09-12T19:26:25.355417+0000","last_fullsized":"2024-09-12T19:26:25.355417+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:29.337157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'56","reported_seq":233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586722+0000","last_change":"2024-09-12T17:52:39.885688+0000","last_active":"2024-09-12T19:25:50.586722+0000","last_peered":"2024-09-12T19:25:50.586722+0000","last_clean":"2024-09-12T19:25:50.586722+0000","last_became_active":"2024-09-12T17:52:39.884599+0000","last_became_peered":"2024-09-12T17:52:39.884599+0000","last_unstale":"2024-09-12T19:25:50.586722+0000","last_undegraded":"2024-09-12T19:25:50.586722+0000","last_fullsized":"2024-09-12T19:25:50.586722+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:48.524948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":231,"num_write":89,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.592964+0000","last_change":"2024-09-12T18:25:52.603197+0000","last_active":"2024-09-12T19:26:20.592964+0000","last_peered":"2024-09-12T19:26:20.592964+0000","last_clean":"2024-09-12T19:26:20.592964+0000","last_became_active":"2024-09-12T18:25:52.602495+0000","last_became_peered":"2024-09-12T18:25:52.602495+0000","last_unstale":"2024-09-12T19:26:20.592964+0000","last_undegraded":"2024-09-12T19:26:20.592964+0000","last_fullsized":"2024-09-12T19:26:20.592964+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:36.706795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'10","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.256474+0000","last_change":"2024-09-12T17:58:47.255006+0000","last_active":"2024-09-12T19:26:45.256474+0000","last_peered":"2024-09-12T19:26:45.256474+0000","last_clean":"2024-09-12T19:26:45.256474+0000","last_became_active":"2024-09-12T17:58:47.254272+0000","last_became_peered":"2024-09-12T17:58:47.254272+0000","last_unstale":"2024-09-12T19:26:45.256474+0000","last_undegraded":"2024-09-12T19:26:45.256474+0000","last_fullsized":"2024-09-12T19:26:45.256474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:11.620938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":26626,"num_write":20,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'5","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.351504+0000","last_change":"2024-09-12T17:58:40.195873+0000","last_active":"2024-09-12T19:26:10.351504+0000","last_peered":"2024-09-12T19:26:10.351504+0000","last_clean":"2024-09-12T19:26:10.351504+0000","last_became_active":"2024-09-12T17:58:40.195089+0000","last_became_peered":"2024-09-12T17:58:40.195089+0000","last_unstale":"2024-09-12T19:26:10.351504+0000","last_undegraded":"2024-09-12T19:26:10.351504+0000","last_fullsized":"2024-09-12T19:26:10.351504+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.723902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":5,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'27","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.675603+0000","last_change":"2024-09-12T17:52:39.868988+0000","last_active":"2024-09-12T19:25:50.675603+0000","last_peered":"2024-09-12T19:25:50.675603+0000","last_clean":"2024-09-12T19:25:50.675603+0000","last_became_active":"2024-09-12T17:52:39.867605+0000","last_became_peered":"2024-09-12T17:52:39.867605+0000","last_unstale":"2024-09-12T19:25:50.675603+0000","last_undegraded":"2024-09-12T19:25:50.675603+0000","last_fullsized":"2024-09-12T19:25:50.675603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:31.849687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":99,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.592985+0000","last_change":"2024-09-12T18:25:52.615107+0000","last_active":"2024-09-12T19:26:20.592985+0000","last_peered":"2024-09-12T19:26:20.592985+0000","last_clean":"2024-09-12T19:26:20.592985+0000","last_became_active":"2024-09-12T18:25:52.614383+0000","last_became_peered":"2024-09-12T18:25:52.614383+0000","last_unstale":"2024-09-12T19:26:20.592985+0000","last_undegraded":"2024-09-12T19:26:20.592985+0000","last_fullsized":"2024-09-12T19:26:20.592985+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:02.087383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"265'3","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250677+0000","last_change":"2024-09-12T17:58:47.249774+0000","last_active":"2024-09-12T19:26:20.250677+0000","last_peered":"2024-09-12T19:26:20.250677+0000","last_clean":"2024-09-12T19:26:20.250677+0000","last_became_active":"2024-09-12T17:58:47.248924+0000","last_became_peered":"2024-09-12T17:58:47.248924+0000","last_unstale":"2024-09-12T19:26:20.250677+0000","last_undegraded":"2024-09-12T19:26:20.250677+0000","last_fullsized":"2024-09-12T19:26:20.250677+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.643262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:30.684425+0000","last_change":"2024-09-12T17:58:40.188344+0000","last_active":"2024-09-12T19:26:30.684425+0000","last_peered":"2024-09-12T19:26:30.684425+0000","last_clean":"2024-09-12T19:26:30.684425+0000","last_became_active":"2024-09-12T17:58:40.187590+0000","last_became_peered":"2024-09-12T17:58:40.187590+0000","last_unstale":"2024-09-12T19:26:30.684425+0000","last_undegraded":"2024-09-12T19:26:30.684425+0000","last_fullsized":"2024-09-12T19:26:30.684425+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:15.651076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'13","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.346788+0000","last_change":"2024-09-12T17:52:39.881326+0000","last_active":"2024-09-12T19:25:50.346788+0000","last_peered":"2024-09-12T19:25:50.346788+0000","last_clean":"2024-09-12T19:25:50.346788+0000","last_became_active":"2024-09-12T17:52:39.872599+0000","last_became_peered":"2024-09-12T17:52:39.872599+0000","last_unstale":"2024-09-12T19:25:50.346788+0000","last_undegraded":"2024-09-12T19:25:50.346788+0000","last_fullsized":"2024-09-12T19:25:50.346788+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:37.156957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.249303+0000","last_change":"2024-09-12T18:25:52.612438+0000","last_active":"2024-09-12T19:26:15.249303+0000","last_peered":"2024-09-12T19:26:15.249303+0000","last_clean":"2024-09-12T19:26:15.249303+0000","last_became_active":"2024-09-12T18:25:52.611377+0000","last_became_peered":"2024-09-12T18:25:52.611377+0000","last_unstale":"2024-09-12T19:26:15.249303+0000","last_undegraded":"2024-09-12T19:26:15.249303+0000","last_fullsized":"2024-09-12T19:26:15.249303+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:57.823730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'1","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.582729+0000","last_change":"2024-09-12T17:58:47.243005+0000","last_active":"2024-09-12T19:25:30.582729+0000","last_peered":"2024-09-12T19:25:30.582729+0000","last_clean":"2024-09-12T19:25:30.582729+0000","last_became_active":"2024-09-12T17:58:47.242171+0000","last_became_peered":"2024-09-12T17:58:47.242171+0000","last_unstale":"2024-09-12T19:25:30.582729+0000","last_undegraded":"2024-09-12T19:25:30.582729+0000","last_fullsized":"2024-09-12T19:25:30.582729+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:43.801606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.256971+0000","last_change":"2024-09-12T17:58:40.211247+0000","last_active":"2024-09-12T19:27:30.256971+0000","last_peered":"2024-09-12T19:27:30.256971+0000","last_clean":"2024-09-12T19:27:30.256971+0000","last_became_active":"2024-09-12T17:58:40.210485+0000","last_became_peered":"2024-09-12T17:58:40.210485+0000","last_unstale":"2024-09-12T19:27:30.256971+0000","last_undegraded":"2024-09-12T19:27:30.256971+0000","last_fullsized":"2024-09-12T19:27:30.256971+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:45.166206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'25","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.248017+0000","last_change":"2024-09-12T17:52:39.880057+0000","last_active":"2024-09-12T19:26:50.248017+0000","last_peered":"2024-09-12T19:26:50.248017+0000","last_clean":"2024-09-12T19:26:50.248017+0000","last_became_active":"2024-09-12T17:52:39.868837+0000","last_became_peered":"2024-09-12T17:52:39.868837+0000","last_unstale":"2024-09-12T19:26:50.248017+0000","last_undegraded":"2024-09-12T19:26:50.248017+0000","last_fullsized":"2024-09-12T19:26:50.248017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.133723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.353905+0000","last_change":"2024-09-12T18:25:52.615446+0000","last_active":"2024-09-12T19:26:20.353905+0000","last_peered":"2024-09-12T19:26:20.353905+0000","last_clean":"2024-09-12T19:26:20.353905+0000","last_became_active":"2024-09-12T18:25:52.611546+0000","last_became_peered":"2024-09-12T18:25:52.611546+0000","last_unstale":"2024-09-12T19:26:20.353905+0000","last_undegraded":"2024-09-12T19:26:20.353905+0000","last_fullsized":"2024-09-12T19:26:20.353905+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:59.006168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'5","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.341672+0000","last_change":"2024-09-12T17:58:47.246295+0000","last_active":"2024-09-12T19:25:30.341672+0000","last_peered":"2024-09-12T19:25:30.341672+0000","last_clean":"2024-09-12T19:25:30.341672+0000","last_became_active":"2024-09-12T17:58:47.245441+0000","last_became_peered":"2024-09-12T17:58:47.245441+0000","last_unstale":"2024-09-12T19:25:30.341672+0000","last_undegraded":"2024-09-12T19:25:30.341672+0000","last_fullsized":"2024-09-12T19:25:30.341672+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:06.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'6","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.371312+0000","last_change":"2024-09-12T17:58:40.192872+0000","last_active":"2024-09-12T19:27:30.371312+0000","last_peered":"2024-09-12T19:27:30.371312+0000","last_clean":"2024-09-12T19:27:30.371312+0000","last_became_active":"2024-09-12T17:58:40.191999+0000","last_became_peered":"2024-09-12T17:58:40.191999+0000","last_unstale":"2024-09-12T19:27:30.371312+0000","last_undegraded":"2024-09-12T19:27:30.371312+0000","last_fullsized":"2024-09-12T19:27:30.371312+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.003714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":18434,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'36","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664694+0000","last_change":"2024-09-12T17:52:39.891322+0000","last_active":"2024-09-12T19:26:25.664694+0000","last_peered":"2024-09-12T19:26:25.664694+0000","last_clean":"2024-09-12T19:26:25.664694+0000","last_became_active":"2024-09-12T17:52:39.890678+0000","last_became_peered":"2024-09-12T17:52:39.890678+0000","last_unstale":"2024-09-12T19:26:25.664694+0000","last_undegraded":"2024-09-12T19:26:25.664694+0000","last_fullsized":"2024-09-12T19:26:25.664694+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:49.955143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667105+0000","last_change":"2024-09-12T18:25:52.612356+0000","last_active":"2024-09-12T19:26:35.667105+0000","last_peered":"2024-09-12T19:26:35.667105+0000","last_clean":"2024-09-12T19:26:35.667105+0000","last_became_active":"2024-09-12T18:25:52.611397+0000","last_became_peered":"2024-09-12T18:25:52.611397+0000","last_unstale":"2024-09-12T19:26:35.667105+0000","last_undegraded":"2024-09-12T19:26:35.667105+0000","last_fullsized":"2024-09-12T19:26:35.667105+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:59.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.681982+0000","last_change":"2024-09-12T17:58:47.241676+0000","last_active":"2024-09-12T19:26:20.681982+0000","last_peered":"2024-09-12T19:26:20.681982+0000","last_clean":"2024-09-12T19:26:20.681982+0000","last_became_active":"2024-09-12T17:58:47.240951+0000","last_became_peered":"2024-09-12T17:58:47.240951+0000","last_unstale":"2024-09-12T19:26:20.681982+0000","last_undegraded":"2024-09-12T19:26:20.681982+0000","last_fullsized":"2024-09-12T19:26:20.681982+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:38.662807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250717+0000","last_change":"2024-09-12T17:58:40.212464+0000","last_active":"2024-09-12T19:27:05.250717+0000","last_peered":"2024-09-12T19:27:05.250717+0000","last_clean":"2024-09-12T19:27:05.250717+0000","last_became_active":"2024-09-12T17:58:40.211891+0000","last_became_peered":"2024-09-12T17:58:40.211891+0000","last_unstale":"2024-09-12T19:27:05.250717+0000","last_undegraded":"2024-09-12T19:27:05.250717+0000","last_fullsized":"2024-09-12T19:27:05.250717+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:27.802674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'53","reported_seq":225,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242648+0000","last_change":"2024-09-12T17:52:39.879319+0000","last_active":"2024-09-12T19:26:25.242648+0000","last_peered":"2024-09-12T19:26:25.242648+0000","last_clean":"2024-09-12T19:26:25.242648+0000","last_became_active":"2024-09-12T17:52:39.878694+0000","last_became_peered":"2024-09-12T17:52:39.878694+0000","last_unstale":"2024-09-12T19:26:25.242648+0000","last_undegraded":"2024-09-12T19:26:25.242648+0000","last_fullsized":"2024-09-12T19:26:25.242648+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:48.298171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":199,"num_write":92,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.685676+0000","last_change":"2024-09-12T18:25:52.620080+0000","last_active":"2024-09-12T19:26:35.685676+0000","last_peered":"2024-09-12T19:26:35.685676+0000","last_clean":"2024-09-12T19:26:35.685676+0000","last_became_active":"2024-09-12T18:25:52.619540+0000","last_became_peered":"2024-09-12T18:25:52.619540+0000","last_unstale":"2024-09-12T19:26:35.685676+0000","last_undegraded":"2024-09-12T19:26:35.685676+0000","last_fullsized":"2024-09-12T19:26:35.685676+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:07.956389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368657+0000","last_change":"2024-09-12T17:58:47.245205+0000","last_active":"2024-09-12T19:27:20.368657+0000","last_peered":"2024-09-12T19:27:20.368657+0000","last_clean":"2024-09-12T19:27:20.368657+0000","last_became_active":"2024-09-12T17:58:47.238232+0000","last_became_peered":"2024-09-12T17:58:47.238232+0000","last_unstale":"2024-09-12T19:27:20.368657+0000","last_undegraded":"2024-09-12T19:27:20.368657+0000","last_fullsized":"2024-09-12T19:27:20.368657+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:59.889739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"262'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.351356+0000","last_change":"2024-09-12T17:58:40.198949+0000","last_active":"2024-09-12T19:26:10.351356+0000","last_peered":"2024-09-12T19:26:10.351356+0000","last_clean":"2024-09-12T19:26:10.351356+0000","last_became_active":"2024-09-12T17:58:40.197815+0000","last_became_peered":"2024-09-12T17:58:40.197815+0000","last_unstale":"2024-09-12T19:26:10.351356+0000","last_undegraded":"2024-09-12T19:26:10.351356+0000","last_fullsized":"2024-09-12T19:26:10.351356+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:15.963939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'72","reported_seq":273,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355384+0000","last_change":"2024-09-12T17:52:39.876517+0000","last_active":"2024-09-12T19:26:25.355384+0000","last_peered":"2024-09-12T19:26:25.355384+0000","last_clean":"2024-09-12T19:26:25.355384+0000","last_became_active":"2024-09-12T17:52:39.872148+0000","last_became_peered":"2024-09-12T17:52:39.872148+0000","last_unstale":"2024-09-12T19:26:25.355384+0000","last_undegraded":"2024-09-12T19:26:25.355384+0000","last_fullsized":"2024-09-12T19:26:25.355384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.681891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":261,"num_write":116,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250622+0000","last_change":"2024-09-12T18:25:52.624296+0000","last_active":"2024-09-12T19:26:20.250622+0000","last_peered":"2024-09-12T19:26:20.250622+0000","last_clean":"2024-09-12T19:26:20.250622+0000","last_became_active":"2024-09-12T18:25:52.623635+0000","last_became_peered":"2024-09-12T18:25:52.623635+0000","last_unstale":"2024-09-12T19:26:20.250622+0000","last_undegraded":"2024-09-12T19:26:20.250622+0000","last_fullsized":"2024-09-12T19:26:20.250622+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:13.996677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241344+0000","last_change":"2024-09-12T17:58:47.251669+0000","last_active":"2024-09-12T19:26:20.241344+0000","last_peered":"2024-09-12T19:26:20.241344+0000","last_clean":"2024-09-12T19:26:20.241344+0000","last_became_active":"2024-09-12T17:58:47.250762+0000","last_became_peered":"2024-09-12T17:58:47.250762+0000","last_unstale":"2024-09-12T19:26:20.241344+0000","last_undegraded":"2024-09-12T19:26:20.241344+0000","last_fullsized":"2024-09-12T19:26:20.241344+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:16.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9216,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:09.038722+0000","last_change":"2024-09-12T17:58:40.210753+0000","last_active":"2024-09-12T19:26:09.038722+0000","last_peered":"2024-09-12T19:26:09.038722+0000","last_clean":"2024-09-12T19:26:09.038722+0000","last_became_active":"2024-09-12T17:58:40.210072+0000","last_became_peered":"2024-09-12T17:58:40.210072+0000","last_unstale":"2024-09-12T19:26:09.038722+0000","last_undegraded":"2024-09-12T19:26:09.038722+0000","last_fullsized":"2024-09-12T19:26:09.038722+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.700767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'26","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355281+0000","last_change":"2024-09-12T17:52:39.872036+0000","last_active":"2024-09-12T19:26:25.355281+0000","last_peered":"2024-09-12T19:26:25.355281+0000","last_clean":"2024-09-12T19:26:25.355281+0000","last_became_active":"2024-09-12T17:52:39.871247+0000","last_became_peered":"2024-09-12T17:52:39.871247+0000","last_unstale":"2024-09-12T19:26:25.355281+0000","last_undegraded":"2024-09-12T19:26:25.355281+0000","last_fullsized":"2024-09-12T19:26:25.355281+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:34.468531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":46,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.359612+0000","last_change":"2024-09-12T18:25:52.622440+0000","last_active":"2024-09-12T19:26:40.359612+0000","last_peered":"2024-09-12T19:26:40.359612+0000","last_clean":"2024-09-12T19:26:40.359612+0000","last_became_active":"2024-09-12T18:25:52.621808+0000","last_became_peered":"2024-09-12T18:25:52.621808+0000","last_unstale":"2024-09-12T19:26:40.359612+0000","last_undegraded":"2024-09-12T19:26:40.359612+0000","last_fullsized":"2024-09-12T19:26:40.359612+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:05.559442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'1","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241274+0000","last_change":"2024-09-12T17:58:47.236975+0000","last_active":"2024-09-12T19:26:20.241274+0000","last_peered":"2024-09-12T19:26:20.241274+0000","last_clean":"2024-09-12T19:26:20.241274+0000","last_became_active":"2024-09-12T17:58:47.236237+0000","last_became_peered":"2024-09-12T17:58:47.236237+0000","last_unstale":"2024-09-12T19:26:20.241274+0000","last_undegraded":"2024-09-12T19:26:20.241274+0000","last_fullsized":"2024-09-12T19:26:20.241274+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:34.439221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'5","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.081308+0000","last_change":"2024-09-12T17:58:40.207822+0000","last_active":"2024-09-12T19:26:10.081308+0000","last_peered":"2024-09-12T19:26:10.081308+0000","last_clean":"2024-09-12T19:26:10.081308+0000","last_became_active":"2024-09-12T17:58:40.207179+0000","last_became_peered":"2024-09-12T17:58:40.207179+0000","last_unstale":"2024-09-12T19:26:10.081308+0000","last_undegraded":"2024-09-12T19:26:10.081308+0000","last_fullsized":"2024-09-12T19:26:10.081308+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:00.148566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":17408,"num_write":5,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'9","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250774+0000","last_change":"2024-09-12T17:52:39.884615+0000","last_active":"2024-09-12T19:27:05.250774+0000","last_peered":"2024-09-12T19:27:05.250774+0000","last_clean":"2024-09-12T19:27:05.250774+0000","last_became_active":"2024-09-12T17:52:39.883782+0000","last_became_peered":"2024-09-12T17:52:39.883782+0000","last_unstale":"2024-09-12T19:27:05.250774+0000","last_undegraded":"2024-09-12T19:27:05.250774+0000","last_fullsized":"2024-09-12T19:27:05.250774+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:22.293480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'271","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.602189+0000","last_change":"2024-09-12T17:36:34.874827+0000","last_active":"2024-09-12T19:27:00.602189+0000","last_peered":"2024-09-12T19:27:00.602189+0000","last_clean":"2024-09-12T19:27:00.602189+0000","last_became_active":"2024-09-12T17:36:34.874529+0000","last_became_peered":"2024-09-12T17:36:34.874529+0000","last_unstale":"2024-09-12T19:27:00.602189+0000","last_undegraded":"2024-09-12T19:27:00.602189+0000","last_fullsized":"2024-09-12T19:27:00.602189+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:19.340681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8048917,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":517,"num_read_kb":47675,"num_write":979,"num_write_kb":57869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'948","reported_seq":2619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.087864+0000","last_change":"2024-09-12T17:36:36.882005+0000","last_active":"2024-09-12T19:26:40.087864+0000","last_peered":"2024-09-12T19:26:40.087864+0000","last_clean":"2024-09-12T19:26:40.087864+0000","last_became_active":"2024-09-12T17:36:36.881586+0000","last_became_peered":"2024-09-12T17:36:36.881586+0000","last_unstale":"2024-09-12T19:26:40.087864+0000","last_undegraded":"2024-09-12T19:26:40.087864+0000","last_fullsized":"2024-09-12T19:26:40.087864+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:20.270667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4539,"num_read_kb":4030,"num_write":1302,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'293","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:12.742992+0000","last_change":"2024-09-12T17:36:34.886842+0000","last_active":"2024-09-12T19:29:12.742992+0000","last_peered":"2024-09-12T19:29:12.742992+0000","last_clean":"2024-09-12T19:29:12.742992+0000","last_became_active":"2024-09-12T17:36:34.886040+0000","last_became_peered":"2024-09-12T17:36:34.886040+0000","last_unstale":"2024-09-12T19:29:12.742992+0000","last_undegraded":"2024-09-12T19:29:12.742992+0000","last_fullsized":"2024-09-12T19:29:12.742992+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:53.879522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12510272,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":446,"num_read_kb":42118,"num_write":1045,"num_write_kb":49494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'796","reported_seq":2316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.047571+0000","last_change":"2024-09-12T17:36:36.875611+0000","last_active":"2024-09-12T19:29:21.047571+0000","last_peered":"2024-09-12T19:29:21.047571+0000","last_clean":"2024-09-12T19:29:21.047571+0000","last_became_active":"2024-09-12T17:36:36.875285+0000","last_became_peered":"2024-09-12T17:36:36.875285+0000","last_unstale":"2024-09-12T19:29:21.047571+0000","last_undegraded":"2024-09-12T19:29:21.047571+0000","last_fullsized":"2024-09-12T19:29:21.047571+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:54.905863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3836,"num_read_kb":3465,"num_write":1049,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'279","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.259977+0000","last_change":"2024-09-12T17:36:34.873831+0000","last_active":"2024-09-12T19:27:00.259977+0000","last_peered":"2024-09-12T19:27:00.259977+0000","last_clean":"2024-09-12T19:27:00.259977+0000","last_became_active":"2024-09-12T17:36:34.871993+0000","last_became_peered":"2024-09-12T17:36:34.871993+0000","last_unstale":"2024-09-12T19:27:00.259977+0000","last_undegraded":"2024-09-12T19:27:00.259977+0000","last_fullsized":"2024-09-12T19:27:00.259977+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:33.922670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334724,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":456,"num_read_kb":16147,"num_write":1004,"num_write_kb":33332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'911","reported_seq":2448,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:53.304327+0000","last_change":"2024-09-12T17:36:36.885378+0000","last_active":"2024-09-12T19:26:53.304327+0000","last_peered":"2024-09-12T19:26:53.304327+0000","last_clean":"2024-09-12T19:26:53.304327+0000","last_became_active":"2024-09-12T17:36:36.883008+0000","last_became_peered":"2024-09-12T17:36:36.883008+0000","last_unstale":"2024-09-12T19:26:53.304327+0000","last_undegraded":"2024-09-12T19:26:53.304327+0000","last_fullsized":"2024-09-12T19:26:53.304327+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":900,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:58.093073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4392,"num_read_kb":3928,"num_write":1272,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'279","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:13.693279+0000","last_change":"2024-09-12T17:36:34.871813+0000","last_active":"2024-09-12T19:29:13.693279+0000","last_peered":"2024-09-12T19:29:13.693279+0000","last_clean":"2024-09-12T19:29:13.693279+0000","last_became_active":"2024-09-12T17:36:34.871414+0000","last_became_peered":"2024-09-12T17:36:34.871414+0000","last_unstale":"2024-09-12T19:29:13.693279+0000","last_undegraded":"2024-09-12T19:29:13.693279+0000","last_fullsized":"2024-09-12T19:29:13.693279+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:37.103933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007944,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":426,"num_read_kb":53693,"num_write":1030,"num_write_kb":40210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'837","reported_seq":2343,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686623+0000","last_change":"2024-09-12T17:36:36.902897+0000","last_active":"2024-09-12T19:26:40.686623+0000","last_peered":"2024-09-12T19:26:40.686623+0000","last_clean":"2024-09-12T19:26:40.686623+0000","last_became_active":"2024-09-12T17:36:36.902241+0000","last_became_peered":"2024-09-12T17:36:36.902241+0000","last_unstale":"2024-09-12T19:26:40.686623+0000","last_undegraded":"2024-09-12T19:26:40.686623+0000","last_fullsized":"2024-09-12T19:26:40.686623+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:25.892315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3905,"num_read_kb":3484,"num_write":1127,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'291","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.588296+0000","last_change":"2024-09-12T17:36:34.890708+0000","last_active":"2024-09-12T19:27:00.588296+0000","last_peered":"2024-09-12T19:27:00.588296+0000","last_clean":"2024-09-12T19:27:00.588296+0000","last_became_active":"2024-09-12T17:36:34.890281+0000","last_became_peered":"2024-09-12T17:36:34.890281+0000","last_unstale":"2024-09-12T19:27:00.588296+0000","last_undegraded":"2024-09-12T19:27:00.588296+0000","last_fullsized":"2024-09-12T19:27:00.588296+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:59.249812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2458751,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":477,"num_read_kb":3791,"num_write":1103,"num_write_kb":30376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'481","reported_seq":2174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602973+0000","last_change":"2024-09-12T17:36:36.899570+0000","last_active":"2024-09-12T19:27:05.602973+0000","last_peered":"2024-09-12T19:27:05.602973+0000","last_clean":"2024-09-12T19:27:05.602973+0000","last_became_active":"2024-09-12T17:36:36.899249+0000","last_became_peered":"2024-09-12T17:36:36.899249+0000","last_unstale":"2024-09-12T19:27:05.602973+0000","last_undegraded":"2024-09-12T19:27:05.602973+0000","last_fullsized":"2024-09-12T19:27:05.602973+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:17.239845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2730,"num_read_kb":2583,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'298","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.244773+0000","last_change":"2024-09-12T17:36:34.871230+0000","last_active":"2024-09-12T19:26:35.244773+0000","last_peered":"2024-09-12T19:26:35.244773+0000","last_clean":"2024-09-12T19:26:35.244773+0000","last_became_active":"2024-09-12T17:36:34.870994+0000","last_became_peered":"2024-09-12T17:36:34.870994+0000","last_unstale":"2024-09-12T19:26:35.244773+0000","last_undegraded":"2024-09-12T19:26:35.244773+0000","last_fullsized":"2024-09-12T19:26:35.244773+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:08.263522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6412736,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":524,"num_read_kb":2338,"num_write":1131,"num_write_kb":29584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'374","reported_seq":1826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.603010+0000","last_change":"2024-09-12T17:36:36.897967+0000","last_active":"2024-09-12T19:27:05.603010+0000","last_peered":"2024-09-12T19:27:05.603010+0000","last_clean":"2024-09-12T19:27:05.603010+0000","last_became_active":"2024-09-12T17:36:36.897609+0000","last_became_peered":"2024-09-12T17:36:36.897609+0000","last_unstale":"2024-09-12T19:27:05.603010+0000","last_undegraded":"2024-09-12T19:27:05.603010+0000","last_fullsized":"2024-09-12T19:27:05.603010+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:31.958437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2010,"num_read_kb":1904,"num_write":440,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'295","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.596308+0000","last_change":"2024-09-12T17:36:34.859377+0000","last_active":"2024-09-12T19:26:35.596308+0000","last_peered":"2024-09-12T19:26:35.596308+0000","last_clean":"2024-09-12T19:26:35.596308+0000","last_became_active":"2024-09-12T17:36:34.859023+0000","last_became_peered":"2024-09-12T17:36:34.859023+0000","last_unstale":"2024-09-12T19:26:35.596308+0000","last_undegraded":"2024-09-12T19:26:35.596308+0000","last_fullsized":"2024-09-12T19:26:35.596308+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:13.591648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1176422,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":450,"num_read_kb":1894,"num_write":1162,"num_write_kb":19389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'831","reported_seq":2372,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.367029+0000","last_change":"2024-09-12T17:36:36.914649+0000","last_active":"2024-09-12T19:28:00.367029+0000","last_peered":"2024-09-12T19:28:00.367029+0000","last_clean":"2024-09-12T19:28:00.367029+0000","last_became_active":"2024-09-12T17:36:36.914366+0000","last_became_peered":"2024-09-12T17:36:36.914366+0000","last_unstale":"2024-09-12T19:28:00.367029+0000","last_undegraded":"2024-09-12T19:28:00.367029+0000","last_fullsized":"2024-09-12T19:28:00.367029+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:37.673498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4038,"num_read_kb":3626,"num_write":1143,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'278","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254008+0000","last_change":"2024-09-12T17:36:34.883337+0000","last_active":"2024-09-12T19:26:35.254008+0000","last_peered":"2024-09-12T19:26:35.254008+0000","last_clean":"2024-09-12T19:26:35.254008+0000","last_became_active":"2024-09-12T17:36:34.882704+0000","last_became_peered":"2024-09-12T17:36:34.882704+0000","last_unstale":"2024-09-12T19:26:35.254008+0000","last_undegraded":"2024-09-12T19:26:35.254008+0000","last_fullsized":"2024-09-12T19:26:35.254008+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:19.965473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15601123,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":507,"num_read_kb":63997,"num_write":1053,"num_write_kb":46422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1166","reported_seq":2735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261311+0000","last_change":"2024-09-12T17:36:36.889657+0000","last_active":"2024-09-12T19:27:05.261311+0000","last_peered":"2024-09-12T19:27:05.261311+0000","last_clean":"2024-09-12T19:27:05.261311+0000","last_became_active":"2024-09-12T17:36:36.888829+0000","last_became_peered":"2024-09-12T17:36:36.888829+0000","last_unstale":"2024-09-12T19:27:05.261311+0000","last_undegraded":"2024-09-12T19:27:05.261311+0000","last_fullsized":"2024-09-12T19:27:05.261311+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:42.143143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5211,"num_read_kb":4613,"num_write":1589,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'494","reported_seq":2221,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181954+0000","last_change":"2024-09-12T17:36:36.905062+0000","last_active":"2024-09-12T19:27:10.181954+0000","last_peered":"2024-09-12T19:27:10.181954+0000","last_clean":"2024-09-12T19:27:10.181954+0000","last_became_active":"2024-09-12T17:36:36.904820+0000","last_became_peered":"2024-09-12T17:36:36.904820+0000","last_unstale":"2024-09-12T19:27:10.181954+0000","last_undegraded":"2024-09-12T19:27:10.181954+0000","last_fullsized":"2024-09-12T19:27:10.181954+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:38.103419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2913,"num_read_kb":2753,"num_write":585,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'305","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.078294+0000","last_change":"2024-09-12T17:36:34.866831+0000","last_active":"2024-09-12T19:25:55.078294+0000","last_peered":"2024-09-12T19:25:55.078294+0000","last_clean":"2024-09-12T19:25:55.078294+0000","last_became_active":"2024-09-12T17:36:34.866283+0000","last_became_peered":"2024-09-12T17:36:34.866283+0000","last_unstale":"2024-09-12T19:25:55.078294+0000","last_undegraded":"2024-09-12T19:25:55.078294+0000","last_fullsized":"2024-09-12T19:25:55.078294+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:57.776484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2776361,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":607,"num_read_kb":73276,"num_write":1036,"num_write_kb":24135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'478","reported_seq":2093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.032911+0000","last_change":"2024-09-12T17:36:36.911581+0000","last_active":"2024-09-12T19:29:21.032911+0000","last_peered":"2024-09-12T19:29:21.032911+0000","last_clean":"2024-09-12T19:29:21.032911+0000","last_became_active":"2024-09-12T17:36:36.911310+0000","last_became_peered":"2024-09-12T17:36:36.911310+0000","last_unstale":"2024-09-12T19:29:21.032911+0000","last_undegraded":"2024-09-12T19:29:21.032911+0000","last_fullsized":"2024-09-12T19:29:21.032911+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.005619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2526,"num_read_kb":2384,"num_write":531,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'278","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:39.783005+0000","last_change":"2024-09-12T17:36:34.865767+0000","last_active":"2024-09-12T19:25:39.783005+0000","last_peered":"2024-09-12T19:25:39.783005+0000","last_clean":"2024-09-12T19:25:39.783005+0000","last_became_active":"2024-09-12T17:36:34.865119+0000","last_became_peered":"2024-09-12T17:36:34.865119+0000","last_unstale":"2024-09-12T19:25:39.783005+0000","last_undegraded":"2024-09-12T19:25:39.783005+0000","last_fullsized":"2024-09-12T19:25:39.783005+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:35.180554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4594780,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":504,"num_read_kb":7316,"num_write":986,"num_write_kb":28671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'738","reported_seq":2229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.121403+0000","last_change":"2024-09-12T17:36:36.886366+0000","last_active":"2024-09-12T19:28:32.121403+0000","last_peered":"2024-09-12T19:28:32.121403+0000","last_clean":"2024-09-12T19:28:32.121403+0000","last_became_active":"2024-09-12T17:36:36.885876+0000","last_became_peered":"2024-09-12T17:36:36.885876+0000","last_unstale":"2024-09-12T19:28:32.121403+0000","last_undegraded":"2024-09-12T19:28:32.121403+0000","last_fullsized":"2024-09-12T19:28:32.121403+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:38.338908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3432,"num_read_kb":3117,"num_write":958,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'306","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:20.580623+0000","last_change":"2024-09-12T17:36:34.873997+0000","last_active":"2024-09-12T19:25:20.580623+0000","last_peered":"2024-09-12T19:25:20.580623+0000","last_clean":"2024-09-12T19:25:20.580623+0000","last_became_active":"2024-09-12T17:36:34.873456+0000","last_became_peered":"2024-09-12T17:36:34.873456+0000","last_unstale":"2024-09-12T19:25:20.580623+0000","last_undegraded":"2024-09-12T19:25:20.580623+0000","last_fullsized":"2024-09-12T19:25:20.580623+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:57.720538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6375100,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":477,"num_read_kb":11967,"num_write":1163,"num_write_kb":23205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'620","reported_seq":2306,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.394693+0000","last_change":"2024-09-12T17:36:36.900540+0000","last_active":"2024-09-12T19:25:54.394693+0000","last_peered":"2024-09-12T19:25:54.394693+0000","last_clean":"2024-09-12T19:25:54.394693+0000","last_became_active":"2024-09-12T17:36:36.899850+0000","last_became_peered":"2024-09-12T17:36:36.899850+0000","last_unstale":"2024-09-12T19:25:54.394693+0000","last_undegraded":"2024-09-12T19:25:54.394693+0000","last_fullsized":"2024-09-12T19:25:54.394693+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:39.690377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3224,"num_read_kb":2959,"num_write":847,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'269","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:18.628539+0000","last_change":"2024-09-12T17:36:34.864903+0000","last_active":"2024-09-12T19:26:18.628539+0000","last_peered":"2024-09-12T19:26:18.628539+0000","last_clean":"2024-09-12T19:26:18.628539+0000","last_became_active":"2024-09-12T17:36:34.864547+0000","last_became_peered":"2024-09-12T17:36:34.864547+0000","last_unstale":"2024-09-12T19:26:18.628539+0000","last_undegraded":"2024-09-12T19:26:18.628539+0000","last_fullsized":"2024-09-12T19:26:18.628539+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:37.836961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9759704,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":488,"num_read_kb":20887,"num_write":983,"num_write_kb":32386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'297","reported_seq":1673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.565486+0000","last_change":"2024-09-12T17:36:36.875932+0000","last_active":"2024-09-12T19:28:02.565486+0000","last_peered":"2024-09-12T19:28:02.565486+0000","last_clean":"2024-09-12T19:28:02.565486+0000","last_became_active":"2024-09-12T17:36:36.873937+0000","last_became_peered":"2024-09-12T17:36:36.873937+0000","last_unstale":"2024-09-12T19:28:02.565486+0000","last_undegraded":"2024-09-12T19:28:02.565486+0000","last_fullsized":"2024-09-12T19:28:02.565486+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:57.251507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1689,"num_read_kb":1636,"num_write":323,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'302","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:21.300970+0000","last_change":"2024-09-12T17:36:34.881828+0000","last_active":"2024-09-12T19:25:21.300970+0000","last_peered":"2024-09-12T19:25:21.300970+0000","last_clean":"2024-09-12T19:25:21.300970+0000","last_became_active":"2024-09-12T17:36:34.880986+0000","last_became_peered":"2024-09-12T17:36:34.880986+0000","last_unstale":"2024-09-12T19:25:21.300970+0000","last_undegraded":"2024-09-12T19:25:21.300970+0000","last_fullsized":"2024-09-12T19:25:21.300970+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:28.093624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7370410,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":804,"num_read_kb":10562,"num_write":991,"num_write_kb":33432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'404","reported_seq":1892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.398707+0000","last_change":"2024-09-12T17:36:36.881697+0000","last_active":"2024-09-12T19:25:54.398707+0000","last_peered":"2024-09-12T19:25:54.398707+0000","last_clean":"2024-09-12T19:25:54.398707+0000","last_became_active":"2024-09-12T17:36:36.881228+0000","last_became_peered":"2024-09-12T17:36:36.881228+0000","last_unstale":"2024-09-12T19:25:54.398707+0000","last_undegraded":"2024-09-12T19:25:54.398707+0000","last_fullsized":"2024-09-12T19:25:54.398707+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:17.469345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2076,"num_read_kb":1970,"num_write":455,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'354","reported_seq":1115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:39.045210+0000","last_change":"2024-09-12T17:36:34.879064+0000","last_active":"2024-09-12T19:26:39.045210+0000","last_peered":"2024-09-12T19:26:39.045210+0000","last_clean":"2024-09-12T19:26:39.045210+0000","last_became_active":"2024-09-12T17:36:34.878377+0000","last_became_peered":"2024-09-12T17:36:34.878377+0000","last_unstale":"2024-09-12T19:26:39.045210+0000","last_undegraded":"2024-09-12T19:26:39.045210+0000","last_fullsized":"2024-09-12T19:26:39.045210+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:13.927187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8422151,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":816,"num_read_kb":13594,"num_write":1279,"num_write_kb":22678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'109","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.849979+0000","last_change":"2024-09-12T17:36:44.936393+0000","last_active":"2024-09-12T19:28:02.849979+0000","last_peered":"2024-09-12T19:28:02.849979+0000","last_clean":"2024-09-12T19:28:02.849979+0000","last_became_active":"2024-09-12T17:36:44.934662+0000","last_became_peered":"2024-09-12T17:36:44.934662+0000","last_unstale":"2024-09-12T19:28:02.849979+0000","last_undegraded":"2024-09-12T19:28:02.849979+0000","last_fullsized":"2024-09-12T19:28:02.849979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:30.459321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'640","reported_seq":2289,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:44.046417+0000","last_change":"2024-09-12T17:36:36.914077+0000","last_active":"2024-09-12T19:26:44.046417+0000","last_peered":"2024-09-12T19:26:44.046417+0000","last_clean":"2024-09-12T19:26:44.046417+0000","last_became_active":"2024-09-12T17:36:36.913372+0000","last_became_peered":"2024-09-12T17:36:36.913372+0000","last_unstale":"2024-09-12T19:26:44.046417+0000","last_undegraded":"2024-09-12T19:26:44.046417+0000","last_fullsized":"2024-09-12T19:26:44.046417+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:28.282227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3256,"num_read_kb":2969,"num_write":868,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'330","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.604663+0000","last_change":"2024-09-12T17:36:34.866247+0000","last_active":"2024-09-12T19:27:38.604663+0000","last_peered":"2024-09-12T19:27:38.604663+0000","last_clean":"2024-09-12T19:27:38.604663+0000","last_became_active":"2024-09-12T17:36:34.865894+0000","last_became_peered":"2024-09-12T17:36:34.865894+0000","last_unstale":"2024-09-12T19:27:38.604663+0000","last_undegraded":"2024-09-12T19:27:38.604663+0000","last_fullsized":"2024-09-12T19:27:38.604663+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:18.929221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9572804,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":511,"num_read_kb":35668,"num_write":1281,"num_write_kb":51737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.340265+0000","last_change":"2024-09-12T17:36:38.881794+0000","last_active":"2024-09-12T19:25:25.340265+0000","last_peered":"2024-09-12T19:25:25.340265+0000","last_clean":"2024-09-12T19:25:25.340265+0000","last_became_active":"2024-09-12T17:36:38.881044+0000","last_became_peered":"2024-09-12T17:36:38.881044+0000","last_unstale":"2024-09-12T19:25:25.340265+0000","last_undegraded":"2024-09-12T19:25:25.340265+0000","last_fullsized":"2024-09-12T19:25:25.340265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:18.605129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'381","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:50.702361+0000","last_change":"2024-09-12T17:36:40.907618+0000","last_active":"2024-09-12T19:27:50.702361+0000","last_peered":"2024-09-12T19:27:50.702361+0000","last_clean":"2024-09-12T19:27:50.702361+0000","last_became_active":"2024-09-12T17:36:40.906825+0000","last_became_peered":"2024-09-12T17:36:40.906825+0000","last_unstale":"2024-09-12T19:27:50.702361+0000","last_undegraded":"2024-09-12T19:27:50.702361+0000","last_fullsized":"2024-09-12T19:27:50.702361+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:34.227775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64193,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":613,"num_read_kb":1137,"num_write":486,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.073133+0000","last_change":"2024-09-12T17:36:42.929571+0000","last_active":"2024-09-12T19:25:30.073133+0000","last_peered":"2024-09-12T19:25:30.073133+0000","last_clean":"2024-09-12T19:25:30.073133+0000","last_became_active":"2024-09-12T17:36:42.928794+0000","last_became_peered":"2024-09-12T17:36:42.928794+0000","last_unstale":"2024-09-12T19:25:30.073133+0000","last_undegraded":"2024-09-12T19:25:30.073133+0000","last_fullsized":"2024-09-12T19:25:30.073133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:22.503558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'168","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.748607+0000","last_change":"2024-09-12T17:36:44.941028+0000","last_active":"2024-09-12T19:29:20.748607+0000","last_peered":"2024-09-12T19:29:20.748607+0000","last_clean":"2024-09-12T19:29:20.748607+0000","last_became_active":"2024-09-12T17:36:44.939447+0000","last_became_peered":"2024-09-12T17:36:44.939447+0000","last_unstale":"2024-09-12T19:29:20.748607+0000","last_undegraded":"2024-09-12T19:29:20.748607+0000","last_fullsized":"2024-09-12T19:29:20.748607+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:17.779839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":297,"num_read_kb":283,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'450","reported_seq":1944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.054779+0000","last_change":"2024-09-12T17:36:36.876325+0000","last_active":"2024-09-12T19:29:21.054779+0000","last_peered":"2024-09-12T19:29:21.054779+0000","last_clean":"2024-09-12T19:29:21.054779+0000","last_became_active":"2024-09-12T17:36:36.875459+0000","last_became_peered":"2024-09-12T17:36:36.875459+0000","last_unstale":"2024-09-12T19:29:21.054779+0000","last_undegraded":"2024-09-12T19:29:21.054779+0000","last_fullsized":"2024-09-12T19:29:21.054779+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.726119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2269,"num_read_kb":2126,"num_write":529,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'255","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:14.039820+0000","last_change":"2024-09-12T17:36:34.881380+0000","last_active":"2024-09-12T19:26:14.039820+0000","last_peered":"2024-09-12T19:26:14.039820+0000","last_clean":"2024-09-12T19:26:14.039820+0000","last_became_active":"2024-09-12T17:36:34.880644+0000","last_became_peered":"2024-09-12T17:36:34.880644+0000","last_unstale":"2024-09-12T19:26:14.039820+0000","last_undegraded":"2024-09-12T19:26:14.039820+0000","last_fullsized":"2024-09-12T19:26:14.039820+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.644365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8672890,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":349,"num_read_kb":12213,"num_write":946,"num_write_kb":18682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686717+0000","last_change":"2024-09-12T17:36:38.901489+0000","last_active":"2024-09-12T19:26:40.686717+0000","last_peered":"2024-09-12T19:26:40.686717+0000","last_clean":"2024-09-12T19:26:40.686717+0000","last_became_active":"2024-09-12T17:36:38.900684+0000","last_became_peered":"2024-09-12T17:36:38.900684+0000","last_unstale":"2024-09-12T19:26:40.686717+0000","last_undegraded":"2024-09-12T19:26:40.686717+0000","last_fullsized":"2024-09-12T19:26:40.686717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:05.502369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'126","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:31.644856+0000","last_change":"2024-09-12T17:36:40.900116+0000","last_active":"2024-09-12T19:27:31.644856+0000","last_peered":"2024-09-12T19:27:31.644856+0000","last_clean":"2024-09-12T19:27:31.644856+0000","last_became_active":"2024-09-12T17:36:40.899340+0000","last_became_peered":"2024-09-12T17:36:40.899340+0000","last_unstale":"2024-09-12T19:27:31.644856+0000","last_undegraded":"2024-09-12T19:27:31.644856+0000","last_fullsized":"2024-09-12T19:27:31.644856+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:14.476334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.073064+0000","last_change":"2024-09-12T17:36:42.932966+0000","last_active":"2024-09-12T19:25:30.073064+0000","last_peered":"2024-09-12T19:25:30.073064+0000","last_clean":"2024-09-12T19:25:30.073064+0000","last_became_active":"2024-09-12T17:36:42.932100+0000","last_became_peered":"2024-09-12T17:36:42.932100+0000","last_unstale":"2024-09-12T19:25:30.073064+0000","last_undegraded":"2024-09-12T19:25:30.073064+0000","last_fullsized":"2024-09-12T19:25:30.073064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:17.207909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'122","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:58.466580+0000","last_change":"2024-09-12T17:36:44.966580+0000","last_active":"2024-09-12T19:27:58.466580+0000","last_peered":"2024-09-12T19:27:58.466580+0000","last_clean":"2024-09-12T19:27:58.466580+0000","last_became_active":"2024-09-12T17:36:44.965913+0000","last_became_peered":"2024-09-12T17:36:44.965913+0000","last_unstale":"2024-09-12T19:27:58.466580+0000","last_undegraded":"2024-09-12T19:27:58.466580+0000","last_fullsized":"2024-09-12T19:27:58.466580+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:05.954565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":210,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'399","reported_seq":1900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.293238+0000","last_change":"2024-09-12T17:36:36.905410+0000","last_active":"2024-09-12T19:28:00.293238+0000","last_peered":"2024-09-12T19:28:00.293238+0000","last_clean":"2024-09-12T19:28:00.293238+0000","last_became_active":"2024-09-12T17:36:36.904639+0000","last_became_peered":"2024-09-12T17:36:36.904639+0000","last_unstale":"2024-09-12T19:28:00.293238+0000","last_undegraded":"2024-09-12T19:28:00.293238+0000","last_fullsized":"2024-09-12T19:28:00.293238+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:07.140445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2242,"num_read_kb":2124,"num_write":448,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'250","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.352565+0000","last_change":"2024-09-12T17:36:34.879554+0000","last_active":"2024-09-12T19:26:15.352565+0000","last_peered":"2024-09-12T19:26:15.352565+0000","last_clean":"2024-09-12T19:26:15.352565+0000","last_became_active":"2024-09-12T17:36:34.879098+0000","last_became_peered":"2024-09-12T17:36:34.879098+0000","last_unstale":"2024-09-12T19:26:15.352565+0000","last_undegraded":"2024-09-12T19:26:15.352565+0000","last_fullsized":"2024-09-12T19:26:15.352565+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:31.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7103716,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":326,"num_read_kb":4507,"num_write":937,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.670087+0000","last_change":"2024-09-12T17:36:38.884358+0000","last_active":"2024-09-12T19:25:25.670087+0000","last_peered":"2024-09-12T19:25:25.670087+0000","last_clean":"2024-09-12T19:25:25.670087+0000","last_became_active":"2024-09-12T17:36:38.883758+0000","last_became_peered":"2024-09-12T17:36:38.883758+0000","last_unstale":"2024-09-12T19:25:25.670087+0000","last_undegraded":"2024-09-12T19:25:25.670087+0000","last_fullsized":"2024-09-12T19:25:25.670087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:23.851056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'185","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:33.286596+0000","last_change":"2024-09-12T17:36:40.908353+0000","last_active":"2024-09-12T19:27:33.286596+0000","last_peered":"2024-09-12T19:27:33.286596+0000","last_clean":"2024-09-12T19:27:33.286596+0000","last_became_active":"2024-09-12T17:36:40.907410+0000","last_became_peered":"2024-09-12T17:36:40.907410+0000","last_unstale":"2024-09-12T19:27:33.286596+0000","last_undegraded":"2024-09-12T19:27:33.286596+0000","last_fullsized":"2024-09-12T19:27:33.286596+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:48.613522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'799","reported_seq":7114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.082506+0000","last_change":"2024-09-12T17:36:42.918180+0000","last_active":"2024-09-12T19:29:25.082506+0000","last_peered":"2024-09-12T19:29:25.082506+0000","last_clean":"2024-09-12T19:29:25.082506+0000","last_became_active":"2024-09-12T17:36:42.916847+0000","last_became_peered":"2024-09-12T17:36:42.916847+0000","last_unstale":"2024-09-12T19:29:25.082506+0000","last_undegraded":"2024-09-12T19:29:25.082506+0000","last_fullsized":"2024-09-12T19:29:25.082506+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:45.795888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'223","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.042171+0000","last_change":"2024-09-12T17:36:44.958620+0000","last_active":"2024-09-12T19:28:03.042171+0000","last_peered":"2024-09-12T19:28:03.042171+0000","last_clean":"2024-09-12T19:28:03.042171+0000","last_became_active":"2024-09-12T17:36:44.954183+0000","last_became_peered":"2024-09-12T17:36:44.954183+0000","last_unstale":"2024-09-12T19:28:03.042171+0000","last_undegraded":"2024-09-12T19:28:03.042171+0000","last_fullsized":"2024-09-12T19:28:03.042171+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:52.168028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":505,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'457","reported_seq":2139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.060710+0000","last_change":"2024-09-12T17:36:36.878129+0000","last_active":"2024-09-12T19:29:21.060710+0000","last_peered":"2024-09-12T19:29:21.060710+0000","last_clean":"2024-09-12T19:29:21.060710+0000","last_became_active":"2024-09-12T17:36:36.877420+0000","last_became_peered":"2024-09-12T17:36:36.877420+0000","last_unstale":"2024-09-12T19:29:21.060710+0000","last_undegraded":"2024-09-12T19:29:21.060710+0000","last_fullsized":"2024-09-12T19:29:21.060710+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:44.309313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2635,"num_read_kb":2492,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'281","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.082154+0000","last_change":"2024-09-12T17:36:34.883169+0000","last_active":"2024-09-12T19:26:15.082154+0000","last_peered":"2024-09-12T19:26:15.082154+0000","last_clean":"2024-09-12T19:26:15.082154+0000","last_became_active":"2024-09-12T17:36:34.882902+0000","last_became_peered":"2024-09-12T17:36:34.882902+0000","last_unstale":"2024-09-12T19:26:15.082154+0000","last_undegraded":"2024-09-12T19:26:15.082154+0000","last_fullsized":"2024-09-12T19:26:15.082154+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:36.819998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12938782,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":509,"num_read_kb":75125,"num_write":968,"num_write_kb":28457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.340316+0000","last_change":"2024-09-12T17:36:38.899727+0000","last_active":"2024-09-12T19:25:25.340316+0000","last_peered":"2024-09-12T19:25:25.340316+0000","last_clean":"2024-09-12T19:25:25.340316+0000","last_became_active":"2024-09-12T17:36:38.899405+0000","last_became_peered":"2024-09-12T17:36:38.899405+0000","last_unstale":"2024-09-12T19:25:25.340316+0000","last_undegraded":"2024-09-12T19:25:25.340316+0000","last_fullsized":"2024-09-12T19:25:25.340316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:16.514700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'333","reported_seq":950,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.642972+0000","last_change":"2024-09-12T17:36:40.911431+0000","last_active":"2024-09-12T19:28:02.642972+0000","last_peered":"2024-09-12T19:28:02.642972+0000","last_clean":"2024-09-12T19:28:02.642972+0000","last_became_active":"2024-09-12T17:36:40.910700+0000","last_became_peered":"2024-09-12T17:36:40.910700+0000","last_unstale":"2024-09-12T19:28:02.642972+0000","last_undegraded":"2024-09-12T19:28:02.642972+0000","last_fullsized":"2024-09-12T19:28:02.642972+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:03.951315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71427,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":523,"num_read_kb":1019,"num_write":432,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'795","reported_seq":3152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.067739+0000","last_change":"2024-09-12T17:36:42.940750+0000","last_active":"2024-09-12T19:29:25.067739+0000","last_peered":"2024-09-12T19:29:25.067739+0000","last_clean":"2024-09-12T19:29:25.067739+0000","last_became_active":"2024-09-12T17:36:42.939966+0000","last_became_peered":"2024-09-12T17:36:42.939966+0000","last_unstale":"2024-09-12T19:29:25.067739+0000","last_undegraded":"2024-09-12T19:29:25.067739+0000","last_fullsized":"2024-09-12T19:29:25.067739+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:48.117866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'1125","reported_seq":2730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.116710+0000","last_change":"2024-09-12T17:36:36.886873+0000","last_active":"2024-09-12T19:28:32.116710+0000","last_peered":"2024-09-12T19:28:32.116710+0000","last_clean":"2024-09-12T19:28:32.116710+0000","last_became_active":"2024-09-12T17:36:36.886244+0000","last_became_peered":"2024-09-12T17:36:36.886244+0000","last_unstale":"2024-09-12T19:28:32.116710+0000","last_undegraded":"2024-09-12T19:28:32.116710+0000","last_fullsized":"2024-09-12T19:28:32.116710+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:16.947822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5270,"num_read_kb":4695,"num_write":1548,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'236","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.605155+0000","last_change":"2024-09-12T17:36:34.865757+0000","last_active":"2024-09-12T19:27:15.605155+0000","last_peered":"2024-09-12T19:27:15.605155+0000","last_clean":"2024-09-12T19:27:15.605155+0000","last_became_active":"2024-09-12T17:36:34.865417+0000","last_became_peered":"2024-09-12T17:36:34.865417+0000","last_unstale":"2024-09-12T19:27:15.605155+0000","last_undegraded":"2024-09-12T19:27:15.605155+0000","last_fullsized":"2024-09-12T19:27:15.605155+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:22.490874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658193,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":459,"num_read_kb":1839,"num_write":912,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.094709+0000","last_change":"2024-09-12T17:36:38.888368+0000","last_active":"2024-09-12T19:27:10.094709+0000","last_peered":"2024-09-12T19:27:10.094709+0000","last_clean":"2024-09-12T19:27:10.094709+0000","last_became_active":"2024-09-12T17:36:38.887444+0000","last_became_peered":"2024-09-12T17:36:38.887444+0000","last_unstale":"2024-09-12T19:27:10.094709+0000","last_undegraded":"2024-09-12T19:27:10.094709+0000","last_fullsized":"2024-09-12T19:27:10.094709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:57.724697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'443","reported_seq":1137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:36.440756+0000","last_change":"2024-09-12T17:36:40.914188+0000","last_active":"2024-09-12T19:27:36.440756+0000","last_peered":"2024-09-12T19:27:36.440756+0000","last_clean":"2024-09-12T19:27:36.440756+0000","last_became_active":"2024-09-12T17:36:40.911095+0000","last_became_peered":"2024-09-12T17:36:40.911095+0000","last_unstale":"2024-09-12T19:27:36.440756+0000","last_undegraded":"2024-09-12T19:27:36.440756+0000","last_fullsized":"2024-09-12T19:27:36.440756+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:16.975199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62664,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":725,"num_read_kb":1226,"num_write":550,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.049545+0000","last_change":"2024-09-12T17:36:42.928393+0000","last_active":"2024-09-12T19:26:59.049545+0000","last_peered":"2024-09-12T19:26:59.049545+0000","last_clean":"2024-09-12T19:26:59.049545+0000","last_became_active":"2024-09-12T17:36:42.927582+0000","last_became_peered":"2024-09-12T17:36:42.927582+0000","last_unstale":"2024-09-12T19:26:59.049545+0000","last_undegraded":"2024-09-12T19:26:59.049545+0000","last_fullsized":"2024-09-12T19:26:59.049545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:38.031907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'554","reported_seq":1399,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.053521+0000","last_change":"2024-09-12T17:36:44.958491+0000","last_active":"2024-09-12T19:29:22.053521+0000","last_peered":"2024-09-12T19:29:22.053521+0000","last_clean":"2024-09-12T19:29:22.053521+0000","last_became_active":"2024-09-12T17:36:44.953926+0000","last_became_peered":"2024-09-12T17:36:44.953926+0000","last_unstale":"2024-09-12T19:29:22.053521+0000","last_undegraded":"2024-09-12T19:29:22.053521+0000","last_fullsized":"2024-09-12T19:29:22.053521+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:32.984877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":1310,"num_write":1167,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'838","reported_seq":2541,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.040399+0000","last_change":"2024-09-12T17:36:36.886760+0000","last_active":"2024-09-12T19:29:21.040399+0000","last_peered":"2024-09-12T19:29:21.040399+0000","last_clean":"2024-09-12T19:29:21.040399+0000","last_became_active":"2024-09-12T17:36:36.886395+0000","last_became_peered":"2024-09-12T17:36:36.886395+0000","last_unstale":"2024-09-12T19:29:21.040399+0000","last_undegraded":"2024-09-12T19:29:21.040399+0000","last_fullsized":"2024-09-12T19:29:21.040399+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:47.591431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4184,"num_read_kb":3783,"num_write":1092,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'305","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:15.326474+0000","last_change":"2024-09-12T17:36:34.869074+0000","last_active":"2024-09-12T19:29:15.326474+0000","last_peered":"2024-09-12T19:29:15.326474+0000","last_clean":"2024-09-12T19:29:15.326474+0000","last_became_active":"2024-09-12T17:36:34.868465+0000","last_became_peered":"2024-09-12T17:36:34.868465+0000","last_unstale":"2024-09-12T19:29:15.326474+0000","last_undegraded":"2024-09-12T19:29:15.326474+0000","last_fullsized":"2024-09-12T19:29:15.326474+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:49.416583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3283434,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":499,"num_read_kb":2937,"num_write":1099,"num_write_kb":21558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"36'3","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.906583+0000","last_change":"2024-09-12T17:36:38.907718+0000","last_active":"2024-09-12T19:29:21.906583+0000","last_peered":"2024-09-12T19:29:21.906583+0000","last_clean":"2024-09-12T19:29:21.906583+0000","last_became_active":"2024-09-12T17:36:38.907007+0000","last_became_peered":"2024-09-12T17:36:38.907007+0000","last_unstale":"2024-09-12T19:29:21.906583+0000","last_undegraded":"2024-09-12T19:29:21.906583+0000","last_fullsized":"2024-09-12T19:29:21.906583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:31.556098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'323","reported_seq":942,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.720307+0000","last_change":"2024-09-12T17:36:40.912235+0000","last_active":"2024-09-12T19:29:10.720307+0000","last_peered":"2024-09-12T19:29:10.720307+0000","last_clean":"2024-09-12T19:29:10.720307+0000","last_became_active":"2024-09-12T17:36:40.911092+0000","last_became_peered":"2024-09-12T17:36:40.911092+0000","last_unstale":"2024-09-12T19:29:10.720307+0000","last_undegraded":"2024-09-12T19:29:10.720307+0000","last_fullsized":"2024-09-12T19:29:10.720307+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:38.796270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":1040,"num_write":430,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.669939+0000","last_change":"2024-09-12T17:36:42.937336+0000","last_active":"2024-09-12T19:25:25.669939+0000","last_peered":"2024-09-12T19:25:25.669939+0000","last_clean":"2024-09-12T19:25:25.669939+0000","last_became_active":"2024-09-12T17:36:42.933808+0000","last_became_peered":"2024-09-12T17:36:42.933808+0000","last_unstale":"2024-09-12T19:25:25.669939+0000","last_undegraded":"2024-09-12T19:25:25.669939+0000","last_fullsized":"2024-09-12T19:25:25.669939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:36.847620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'2432","reported_seq":4293,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.133108+0000","last_change":"2024-09-12T17:36:44.963412+0000","last_active":"2024-09-12T19:28:32.133108+0000","last_peered":"2024-09-12T19:28:32.133108+0000","last_clean":"2024-09-12T19:28:32.133108+0000","last_became_active":"2024-09-12T17:36:44.962630+0000","last_became_peered":"2024-09-12T17:36:44.962630+0000","last_unstale":"2024-09-12T19:28:32.133108+0000","last_undegraded":"2024-09-12T19:28:32.133108+0000","last_fullsized":"2024-09-12T19:28:32.133108+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:56.907799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6095,"num_read_kb":6091,"num_write":4930,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'434","reported_seq":2059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.318071+0000","last_change":"2024-09-12T17:36:36.880733+0000","last_active":"2024-09-12T19:28:00.318071+0000","last_peered":"2024-09-12T19:28:00.318071+0000","last_clean":"2024-09-12T19:28:00.318071+0000","last_became_active":"2024-09-12T17:36:36.880296+0000","last_became_peered":"2024-09-12T17:36:36.880296+0000","last_unstale":"2024-09-12T19:28:00.318071+0000","last_undegraded":"2024-09-12T19:28:00.318071+0000","last_fullsized":"2024-09-12T19:28:00.318071+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:06.645113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2387,"num_read_kb":2259,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'297","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.362024+0000","last_change":"2024-09-12T17:36:34.868949+0000","last_active":"2024-09-12T19:26:50.362024+0000","last_peered":"2024-09-12T19:26:50.362024+0000","last_clean":"2024-09-12T19:26:50.362024+0000","last_became_active":"2024-09-12T17:36:34.868243+0000","last_became_peered":"2024-09-12T17:36:34.868243+0000","last_unstale":"2024-09-12T19:26:50.362024+0000","last_undegraded":"2024-09-12T19:26:50.362024+0000","last_fullsized":"2024-09-12T19:26:50.362024+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:16.699361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2483814,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":502,"num_read_kb":48255,"num_write":1140,"num_write_kb":33494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258752+0000","last_change":"2024-09-12T17:36:38.893533+0000","last_active":"2024-09-12T19:26:55.258752+0000","last_peered":"2024-09-12T19:26:55.258752+0000","last_clean":"2024-09-12T19:26:55.258752+0000","last_became_active":"2024-09-12T17:36:38.892804+0000","last_became_peered":"2024-09-12T17:36:38.892804+0000","last_unstale":"2024-09-12T19:26:55.258752+0000","last_undegraded":"2024-09-12T19:26:55.258752+0000","last_fullsized":"2024-09-12T19:26:55.258752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:56.818407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'394","reported_seq":1044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.396367+0000","last_change":"2024-09-12T17:36:40.889733+0000","last_active":"2024-09-12T19:29:20.396367+0000","last_peered":"2024-09-12T19:29:20.396367+0000","last_clean":"2024-09-12T19:29:20.396367+0000","last_became_active":"2024-09-12T17:36:40.888974+0000","last_became_peered":"2024-09-12T17:36:40.888974+0000","last_unstale":"2024-09-12T19:29:20.396367+0000","last_undegraded":"2024-09-12T19:29:20.396367+0000","last_fullsized":"2024-09-12T19:29:20.396367+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:41.043970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61753,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":631,"num_read_kb":1144,"num_write":502,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'794","reported_seq":3040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.295685+0000","last_change":"2024-09-12T17:36:42.936433+0000","last_active":"2024-09-12T19:29:25.295685+0000","last_peered":"2024-09-12T19:29:25.295685+0000","last_clean":"2024-09-12T19:29:25.295685+0000","last_became_active":"2024-09-12T17:36:42.935529+0000","last_became_peered":"2024-09-12T17:36:42.935529+0000","last_unstale":"2024-09-12T19:29:25.295685+0000","last_undegraded":"2024-09-12T19:29:25.295685+0000","last_fullsized":"2024-09-12T19:29:25.295685+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:25.923124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'112","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.068420+0000","last_change":"2024-09-12T17:36:44.966442+0000","last_active":"2024-09-12T19:29:21.068420+0000","last_peered":"2024-09-12T19:29:21.068420+0000","last_clean":"2024-09-12T19:29:21.068420+0000","last_became_active":"2024-09-12T17:36:44.965763+0000","last_became_peered":"2024-09-12T17:36:44.965763+0000","last_unstale":"2024-09-12T19:29:21.068420+0000","last_undegraded":"2024-09-12T19:29:21.068420+0000","last_fullsized":"2024-09-12T19:29:21.068420+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:31.130717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":137,"num_write":264,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'411","reported_seq":1895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.034719+0000","last_change":"2024-09-12T17:36:36.907634+0000","last_active":"2024-09-12T19:29:21.034719+0000","last_peered":"2024-09-12T19:29:21.034719+0000","last_clean":"2024-09-12T19:29:21.034719+0000","last_became_active":"2024-09-12T17:36:36.905958+0000","last_became_peered":"2024-09-12T17:36:36.905958+0000","last_unstale":"2024-09-12T19:29:21.034719+0000","last_undegraded":"2024-09-12T19:29:21.034719+0000","last_fullsized":"2024-09-12T19:29:21.034719+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:58.834393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'290","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.599727+0000","last_change":"2024-09-12T17:36:34.861236+0000","last_active":"2024-09-12T19:26:50.599727+0000","last_peered":"2024-09-12T19:26:50.599727+0000","last_clean":"2024-09-12T19:26:50.599727+0000","last_became_active":"2024-09-12T17:36:34.860828+0000","last_became_peered":"2024-09-12T17:36:34.860828+0000","last_unstale":"2024-09-12T19:26:50.599727+0000","last_undegraded":"2024-09-12T19:26:50.599727+0000","last_fullsized":"2024-09-12T19:26:50.599727+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:17.732122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6713830,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":402,"num_read_kb":18690,"num_write":1023,"num_write_kb":31228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:24.029382+0000","last_change":"2024-09-12T17:36:38.897935+0000","last_active":"2024-09-12T19:25:24.029382+0000","last_peered":"2024-09-12T19:25:24.029382+0000","last_clean":"2024-09-12T19:25:24.029382+0000","last_became_active":"2024-09-12T17:36:38.897189+0000","last_became_peered":"2024-09-12T17:36:38.897189+0000","last_unstale":"2024-09-12T19:25:24.029382+0000","last_undegraded":"2024-09-12T19:25:24.029382+0000","last_fullsized":"2024-09-12T19:25:24.029382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:35.954626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'500","reported_seq":1178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.982850+0000","last_change":"2024-09-12T17:36:40.907633+0000","last_active":"2024-09-12T19:29:21.982850+0000","last_peered":"2024-09-12T19:29:21.982850+0000","last_clean":"2024-09-12T19:29:21.982850+0000","last_became_active":"2024-09-12T17:36:40.906903+0000","last_became_peered":"2024-09-12T17:36:40.906903+0000","last_unstale":"2024-09-12T19:29:21.982850+0000","last_undegraded":"2024-09-12T19:29:21.982850+0000","last_fullsized":"2024-09-12T19:29:21.982850+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:36.733767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112810,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":875,"num_read_kb":1839,"num_write":714,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263489+0000","last_change":"2024-09-12T17:36:42.933877+0000","last_active":"2024-09-12T19:27:15.263489+0000","last_peered":"2024-09-12T19:27:15.263489+0000","last_clean":"2024-09-12T19:27:15.263489+0000","last_became_active":"2024-09-12T17:36:42.933168+0000","last_became_peered":"2024-09-12T17:36:42.933168+0000","last_unstale":"2024-09-12T19:27:15.263489+0000","last_undegraded":"2024-09-12T19:27:15.263489+0000","last_fullsized":"2024-09-12T19:27:15.263489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:13.861626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'159","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.676473+0000","last_change":"2024-09-12T17:36:44.961695+0000","last_active":"2024-09-12T19:27:15.676473+0000","last_peered":"2024-09-12T19:27:15.676473+0000","last_clean":"2024-09-12T19:27:15.676473+0000","last_became_active":"2024-09-12T17:36:44.960935+0000","last_became_peered":"2024-09-12T17:36:44.960935+0000","last_unstale":"2024-09-12T19:27:15.676473+0000","last_undegraded":"2024-09-12T19:27:15.676473+0000","last_fullsized":"2024-09-12T19:27:15.676473+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:20.892764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1322,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":195,"num_write":366,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1240","reported_seq":2921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.119750+0000","last_change":"2024-09-12T17:36:36.914970+0000","last_active":"2024-09-12T19:28:32.119750+0000","last_peered":"2024-09-12T19:28:32.119750+0000","last_clean":"2024-09-12T19:28:32.119750+0000","last_became_active":"2024-09-12T17:36:36.914518+0000","last_became_peered":"2024-09-12T17:36:36.914518+0000","last_unstale":"2024-09-12T19:28:32.119750+0000","last_undegraded":"2024-09-12T19:28:32.119750+0000","last_fullsized":"2024-09-12T19:28:32.119750+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.726119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5692,"num_read_kb":5056,"num_write":1732,"num_write_kb":743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'269","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670302+0000","last_change":"2024-09-12T17:36:34.879597+0000","last_active":"2024-09-12T19:26:50.670302+0000","last_peered":"2024-09-12T19:26:50.670302+0000","last_clean":"2024-09-12T19:26:50.670302+0000","last_became_active":"2024-09-12T17:36:34.878896+0000","last_became_peered":"2024-09-12T17:36:34.878896+0000","last_unstale":"2024-09-12T19:26:50.670302+0000","last_undegraded":"2024-09-12T19:26:50.670302+0000","last_fullsized":"2024-09-12T19:26:50.670302+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:49.691790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325324,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":465,"num_read_kb":17715,"num_write":989,"num_write_kb":23877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671691+0000","last_change":"2024-09-12T17:36:38.908401+0000","last_active":"2024-09-12T19:26:55.671691+0000","last_peered":"2024-09-12T19:26:55.671691+0000","last_clean":"2024-09-12T19:26:55.671691+0000","last_became_active":"2024-09-12T17:36:38.907609+0000","last_became_peered":"2024-09-12T17:36:38.907609+0000","last_unstale":"2024-09-12T19:26:55.671691+0000","last_undegraded":"2024-09-12T19:26:55.671691+0000","last_fullsized":"2024-09-12T19:26:55.671691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:46.413534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'356","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.119357+0000","last_change":"2024-09-12T17:36:40.895469+0000","last_active":"2024-09-12T19:29:10.119357+0000","last_peered":"2024-09-12T19:29:10.119357+0000","last_clean":"2024-09-12T19:29:10.119357+0000","last_became_active":"2024-09-12T17:36:40.893702+0000","last_became_peered":"2024-09-12T17:36:40.893702+0000","last_unstale":"2024-09-12T19:29:10.119357+0000","last_undegraded":"2024-09-12T19:29:10.119357+0000","last_fullsized":"2024-09-12T19:29:10.119357+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:52.727654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57866,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":1119,"num_write":524,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.677558+0000","last_change":"2024-09-12T17:36:42.939282+0000","last_active":"2024-09-12T19:27:20.677558+0000","last_peered":"2024-09-12T19:27:20.677558+0000","last_clean":"2024-09-12T19:27:20.677558+0000","last_became_active":"2024-09-12T17:36:42.938437+0000","last_became_peered":"2024-09-12T17:36:42.938437+0000","last_unstale":"2024-09-12T19:27:20.677558+0000","last_undegraded":"2024-09-12T19:27:20.677558+0000","last_fullsized":"2024-09-12T19:27:20.677558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:17.930519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'144","reported_seq":718,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:09.868344+0000","last_change":"2024-09-12T17:36:44.959709+0000","last_active":"2024-09-12T19:29:09.868344+0000","last_peered":"2024-09-12T19:29:09.868344+0000","last_clean":"2024-09-12T19:29:09.868344+0000","last_became_active":"2024-09-12T17:36:44.956645+0000","last_became_peered":"2024-09-12T17:36:44.956645+0000","last_unstale":"2024-09-12T19:29:09.868344+0000","last_undegraded":"2024-09-12T19:29:09.868344+0000","last_fullsized":"2024-09-12T19:29:09.868344+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.650537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":356,"num_read_kb":303,"num_write":346,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'499","reported_seq":2115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.117569+0000","last_change":"2024-09-12T17:36:36.882735+0000","last_active":"2024-09-12T19:28:32.117569+0000","last_peered":"2024-09-12T19:28:32.117569+0000","last_clean":"2024-09-12T19:28:32.117569+0000","last_became_active":"2024-09-12T17:36:36.881882+0000","last_became_peered":"2024-09-12T17:36:36.881882+0000","last_unstale":"2024-09-12T19:28:32.117569+0000","last_undegraded":"2024-09-12T19:28:32.117569+0000","last_fullsized":"2024-09-12T19:28:32.117569+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.005619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2445,"num_write":630,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'283","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:51.821156+0000","last_change":"2024-09-12T17:36:34.870444+0000","last_active":"2024-09-12T19:26:51.821156+0000","last_peered":"2024-09-12T19:26:51.821156+0000","last_clean":"2024-09-12T19:26:51.821156+0000","last_became_active":"2024-09-12T17:36:34.870021+0000","last_became_peered":"2024-09-12T17:36:34.870021+0000","last_unstale":"2024-09-12T19:26:51.821156+0000","last_undegraded":"2024-09-12T19:26:51.821156+0000","last_fullsized":"2024-09-12T19:26:51.821156+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:32.502673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1583636,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":452,"num_read_kb":14188,"num_write":1118,"num_write_kb":25082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258787+0000","last_change":"2024-09-12T17:36:38.893625+0000","last_active":"2024-09-12T19:26:55.258787+0000","last_peered":"2024-09-12T19:26:55.258787+0000","last_clean":"2024-09-12T19:26:55.258787+0000","last_became_active":"2024-09-12T17:36:38.892885+0000","last_became_peered":"2024-09-12T17:36:38.892885+0000","last_unstale":"2024-09-12T19:26:55.258787+0000","last_undegraded":"2024-09-12T19:26:55.258787+0000","last_fullsized":"2024-09-12T19:26:55.258787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:23.133743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'374","reported_seq":1027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.049303+0000","last_change":"2024-09-12T17:36:40.898503+0000","last_active":"2024-09-12T19:29:22.049303+0000","last_peered":"2024-09-12T19:29:22.049303+0000","last_clean":"2024-09-12T19:29:22.049303+0000","last_became_active":"2024-09-12T17:36:40.896733+0000","last_became_peered":"2024-09-12T17:36:40.896733+0000","last_unstale":"2024-09-12T19:29:22.049303+0000","last_undegraded":"2024-09-12T19:29:22.049303+0000","last_fullsized":"2024-09-12T19:29:22.049303+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:00.019536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70333,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":1100,"num_write":464,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'767","reported_seq":3233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.079596+0000","last_change":"2024-09-12T17:36:42.935306+0000","last_active":"2024-09-12T19:29:25.079596+0000","last_peered":"2024-09-12T19:29:25.079596+0000","last_clean":"2024-09-12T19:29:25.079596+0000","last_became_active":"2024-09-12T17:36:42.934582+0000","last_became_peered":"2024-09-12T17:36:42.934582+0000","last_unstale":"2024-09-12T19:29:25.079596+0000","last_undegraded":"2024-09-12T19:29:25.079596+0000","last_fullsized":"2024-09-12T19:29:25.079596+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.168171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'100","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.913618+0000","last_change":"2024-09-12T17:36:44.938502+0000","last_active":"2024-09-12T19:28:02.913618+0000","last_peered":"2024-09-12T19:28:02.913618+0000","last_clean":"2024-09-12T19:28:02.913618+0000","last_became_active":"2024-09-12T17:36:44.937368+0000","last_became_peered":"2024-09-12T17:36:44.937368+0000","last_unstale":"2024-09-12T19:28:02.913618+0000","last_undegraded":"2024-09-12T19:28:02.913618+0000","last_fullsized":"2024-09-12T19:28:02.913618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:33.490996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":224,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'653","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.248765+0000","last_change":"2024-09-12T17:36:36.883321+0000","last_active":"2024-09-12T19:26:55.248765+0000","last_peered":"2024-09-12T19:26:55.248765+0000","last_clean":"2024-09-12T19:26:55.248765+0000","last_became_active":"2024-09-12T17:36:36.883043+0000","last_became_peered":"2024-09-12T17:36:36.883043+0000","last_unstale":"2024-09-12T19:26:55.248765+0000","last_undegraded":"2024-09-12T19:26:55.248765+0000","last_fullsized":"2024-09-12T19:26:55.248765+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:50.911594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3181,"num_read_kb":2856,"num_write":918,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'320","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.631187+0000","last_change":"2024-09-12T17:36:34.874846+0000","last_active":"2024-09-12T19:27:38.631187+0000","last_peered":"2024-09-12T19:27:38.631187+0000","last_clean":"2024-09-12T19:27:38.631187+0000","last_became_active":"2024-09-12T17:36:34.873263+0000","last_became_peered":"2024-09-12T17:36:34.873263+0000","last_unstale":"2024-09-12T19:27:38.631187+0000","last_undegraded":"2024-09-12T19:27:38.631187+0000","last_fullsized":"2024-09-12T19:27:38.631187+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:42.358689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11461331,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":517,"num_read_kb":21339,"num_write":1007,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1479,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.922275+0000","last_change":"2024-09-12T17:36:38.889880+0000","last_active":"2024-09-12T19:29:21.922275+0000","last_peered":"2024-09-12T19:29:21.922275+0000","last_clean":"2024-09-12T19:29:21.922275+0000","last_became_active":"2024-09-12T17:36:38.888795+0000","last_became_peered":"2024-09-12T17:36:38.888795+0000","last_unstale":"2024-09-12T19:29:21.922275+0000","last_undegraded":"2024-09-12T19:29:21.922275+0000","last_fullsized":"2024-09-12T19:29:21.922275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:53.568736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'150","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.261761+0000","last_change":"2024-09-12T17:36:40.893833+0000","last_active":"2024-09-12T19:27:30.261761+0000","last_peered":"2024-09-12T19:27:30.261761+0000","last_clean":"2024-09-12T19:27:30.261761+0000","last_became_active":"2024-09-12T17:36:40.893090+0000","last_became_peered":"2024-09-12T17:36:40.893090+0000","last_unstale":"2024-09-12T19:27:30.261761+0000","last_undegraded":"2024-09-12T19:27:30.261761+0000","last_fullsized":"2024-09-12T19:27:30.261761+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:17.912186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'802","reported_seq":3152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.080128+0000","last_change":"2024-09-12T17:36:42.937918+0000","last_active":"2024-09-12T19:29:25.080128+0000","last_peered":"2024-09-12T19:29:25.080128+0000","last_clean":"2024-09-12T19:29:25.080128+0000","last_became_active":"2024-09-12T17:36:42.937195+0000","last_became_peered":"2024-09-12T17:36:42.937195+0000","last_unstale":"2024-09-12T19:29:25.080128+0000","last_undegraded":"2024-09-12T19:29:25.080128+0000","last_fullsized":"2024-09-12T19:29:25.080128+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:27.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'109","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.251823+0000","last_change":"2024-09-12T17:36:44.960800+0000","last_active":"2024-09-12T19:27:10.251823+0000","last_peered":"2024-09-12T19:27:10.251823+0000","last_clean":"2024-09-12T19:27:10.251823+0000","last_became_active":"2024-09-12T17:36:44.960042+0000","last_became_peered":"2024-09-12T17:36:44.960042+0000","last_unstale":"2024-09-12T19:27:10.251823+0000","last_undegraded":"2024-09-12T19:27:10.251823+0000","last_fullsized":"2024-09-12T19:27:10.251823+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:54.849029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'983","reported_seq":2639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.365058+0000","last_change":"2024-09-12T17:36:36.914243+0000","last_active":"2024-09-12T19:28:00.365058+0000","last_peered":"2024-09-12T19:28:00.365058+0000","last_clean":"2024-09-12T19:28:00.365058+0000","last_became_active":"2024-09-12T17:36:36.913566+0000","last_became_peered":"2024-09-12T17:36:36.913566+0000","last_unstale":"2024-09-12T19:28:00.365058+0000","last_undegraded":"2024-09-12T19:28:00.365058+0000","last_fullsized":"2024-09-12T19:28:00.365058+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":900,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:32.358617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4811,"num_read_kb":4293,"num_write":1402,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'239","reported_seq":870,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.692302+0000","last_change":"2024-09-12T17:36:34.863609+0000","last_active":"2024-09-12T19:27:05.692302+0000","last_peered":"2024-09-12T19:27:05.692302+0000","last_clean":"2024-09-12T19:27:05.692302+0000","last_became_active":"2024-09-12T17:36:34.862534+0000","last_became_peered":"2024-09-12T17:36:34.862534+0000","last_unstale":"2024-09-12T19:27:05.692302+0000","last_undegraded":"2024-09-12T19:27:05.692302+0000","last_fullsized":"2024-09-12T19:27:05.692302+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:22.424632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9477394,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":328,"num_read_kb":22960,"num_write":880,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.363062+0000","last_change":"2024-09-12T17:36:38.886369+0000","last_active":"2024-09-12T19:26:55.363062+0000","last_peered":"2024-09-12T19:26:55.363062+0000","last_clean":"2024-09-12T19:26:55.363062+0000","last_became_active":"2024-09-12T17:36:38.885678+0000","last_became_peered":"2024-09-12T17:36:38.885678+0000","last_unstale":"2024-09-12T19:26:55.363062+0000","last_undegraded":"2024-09-12T19:26:55.363062+0000","last_fullsized":"2024-09-12T19:26:55.363062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:06.010071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'409","reported_seq":1088,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.119332+0000","last_change":"2024-09-12T17:36:40.900876+0000","last_active":"2024-09-12T19:29:10.119332+0000","last_peered":"2024-09-12T19:29:10.119332+0000","last_clean":"2024-09-12T19:29:10.119332+0000","last_became_active":"2024-09-12T17:36:40.900295+0000","last_became_peered":"2024-09-12T17:36:40.900295+0000","last_unstale":"2024-09-12T19:29:10.119332+0000","last_undegraded":"2024-09-12T19:29:10.119332+0000","last_fullsized":"2024-09-12T19:29:10.119332+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:17.899103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47862,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":651,"num_read_kb":1074,"num_write":490,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249747+0000","last_change":"2024-09-12T17:36:42.928327+0000","last_active":"2024-09-12T19:27:00.249747+0000","last_peered":"2024-09-12T19:27:00.249747+0000","last_clean":"2024-09-12T19:27:00.249747+0000","last_became_active":"2024-09-12T17:36:42.927716+0000","last_became_peered":"2024-09-12T17:36:42.927716+0000","last_unstale":"2024-09-12T19:27:00.249747+0000","last_undegraded":"2024-09-12T19:27:00.249747+0000","last_fullsized":"2024-09-12T19:27:00.249747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.478941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'114","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:58.451214+0000","last_change":"2024-09-12T17:36:44.943385+0000","last_active":"2024-09-12T19:27:58.451214+0000","last_peered":"2024-09-12T19:27:58.451214+0000","last_clean":"2024-09-12T19:27:58.451214+0000","last_became_active":"2024-09-12T17:36:44.942505+0000","last_became_peered":"2024-09-12T17:36:44.942505+0000","last_unstale":"2024-09-12T19:27:58.451214+0000","last_undegraded":"2024-09-12T19:27:58.451214+0000","last_fullsized":"2024-09-12T19:27:58.451214+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:16.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":134,"num_write":256,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'733","reported_seq":2201,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.626150+0000","last_change":"2024-09-12T17:36:36.882337+0000","last_active":"2024-09-12T19:28:02.626150+0000","last_peered":"2024-09-12T19:28:02.626150+0000","last_clean":"2024-09-12T19:28:02.626150+0000","last_became_active":"2024-09-12T17:36:36.881456+0000","last_became_peered":"2024-09-12T17:36:36.881456+0000","last_unstale":"2024-09-12T19:28:02.626150+0000","last_undegraded":"2024-09-12T19:28:02.626150+0000","last_fullsized":"2024-09-12T19:28:02.626150+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:26.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3432,"num_read_kb":3120,"num_write":969,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.091239+0000","last_change":"2024-09-12T17:36:16.723179+0000","last_active":"2024-09-12T19:26:55.091239+0000","last_peered":"2024-09-12T19:26:55.091239+0000","last_clean":"2024-09-12T19:26:55.091239+0000","last_became_active":"2024-09-12T17:36:16.722334+0000","last_became_peered":"2024-09-12T17:36:16.722334+0000","last_unstale":"2024-09-12T19:26:55.091239+0000","last_undegraded":"2024-09-12T19:26:55.091239+0000","last_fullsized":"2024-09-12T19:26:55.091239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_clean_scrub_stamp":"2024-09-12T17:36:15.696738+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:31.267846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.361940+0000","last_change":"2024-09-12T17:36:23.787411+0000","last_active":"2024-09-12T19:26:50.361940+0000","last_peered":"2024-09-12T19:26:50.361940+0000","last_clean":"2024-09-12T19:26:50.361940+0000","last_became_active":"2024-09-12T17:36:21.777852+0000","last_became_peered":"2024-09-12T17:36:21.777852+0000","last_unstale":"2024-09-12T19:26:50.361940+0000","last_undegraded":"2024-09-12T19:26:50.361940+0000","last_fullsized":"2024-09-12T19:26:50.361940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:45.393945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019340550000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'318","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691212+0000","last_change":"2024-09-12T17:36:34.870746+0000","last_active":"2024-09-12T19:27:00.691212+0000","last_peered":"2024-09-12T19:27:00.691212+0000","last_clean":"2024-09-12T19:27:00.691212+0000","last_became_active":"2024-09-12T17:36:34.865550+0000","last_became_peered":"2024-09-12T17:36:34.865550+0000","last_unstale":"2024-09-12T19:27:00.691212+0000","last_undegraded":"2024-09-12T19:27:00.691212+0000","last_fullsized":"2024-09-12T19:27:00.691212+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:37.982105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5645323,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":608,"num_read_kb":15438,"num_write":1409,"num_write_kb":31533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602989+0000","last_change":"2024-09-12T17:36:38.892479+0000","last_active":"2024-09-12T19:27:05.602989+0000","last_peered":"2024-09-12T19:27:05.602989+0000","last_clean":"2024-09-12T19:27:05.602989+0000","last_became_active":"2024-09-12T17:36:38.891774+0000","last_became_peered":"2024-09-12T17:36:38.891774+0000","last_unstale":"2024-09-12T19:27:05.602989+0000","last_undegraded":"2024-09-12T19:27:05.602989+0000","last_fullsized":"2024-09-12T19:27:05.602989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:04.757971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'732","reported_seq":1464,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.019633+0000","last_change":"2024-09-12T17:36:40.886469+0000","last_active":"2024-09-12T19:29:22.019633+0000","last_peered":"2024-09-12T19:29:22.019633+0000","last_clean":"2024-09-12T19:29:22.019633+0000","last_became_active":"2024-09-12T17:36:40.885684+0000","last_became_peered":"2024-09-12T17:36:40.885684+0000","last_unstale":"2024-09-12T19:29:22.019633+0000","last_undegraded":"2024-09-12T19:29:22.019633+0000","last_fullsized":"2024-09-12T19:29:22.019633+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:17.424179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165348,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1405,"num_read_kb":2814,"num_write":1352,"num_write_kb":1180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263697+0000","last_change":"2024-09-12T17:36:42.919971+0000","last_active":"2024-09-12T19:27:15.263697+0000","last_peered":"2024-09-12T19:27:15.263697+0000","last_clean":"2024-09-12T19:27:15.263697+0000","last_became_active":"2024-09-12T17:36:42.919204+0000","last_became_peered":"2024-09-12T17:36:42.919204+0000","last_unstale":"2024-09-12T19:27:15.263697+0000","last_undegraded":"2024-09-12T19:27:15.263697+0000","last_fullsized":"2024-09-12T19:27:15.263697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:28.580042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'184","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.702184+0000","last_change":"2024-09-12T17:36:44.954972+0000","last_active":"2024-09-12T19:28:02.702184+0000","last_peered":"2024-09-12T19:28:02.702184+0000","last_clean":"2024-09-12T19:28:02.702184+0000","last_became_active":"2024-09-12T17:36:44.954321+0000","last_became_peered":"2024-09-12T17:36:44.954321+0000","last_unstale":"2024-09-12T19:28:02.702184+0000","last_undegraded":"2024-09-12T19:28:02.702184+0000","last_fullsized":"2024-09-12T19:28:02.702184+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:09.226720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":488,"num_write":378,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'504","reported_seq":2085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.262524+0000","last_change":"2024-09-12T17:36:36.907852+0000","last_active":"2024-09-12T19:27:10.262524+0000","last_peered":"2024-09-12T19:27:10.262524+0000","last_clean":"2024-09-12T19:27:10.262524+0000","last_became_active":"2024-09-12T17:36:36.906789+0000","last_became_peered":"2024-09-12T17:36:36.906789+0000","last_unstale":"2024-09-12T19:27:10.262524+0000","last_undegraded":"2024-09-12T19:27:10.262524+0000","last_fullsized":"2024-09-12T19:27:10.262524+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:22.056362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2691,"num_read_kb":2505,"num_write":636,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.362890+0000","last_change":"2024-09-12T17:36:23.786635+0000","last_active":"2024-09-12T19:26:55.362890+0000","last_peered":"2024-09-12T19:26:55.362890+0000","last_clean":"2024-09-12T19:26:55.362890+0000","last_became_active":"2024-09-12T17:36:21.785026+0000","last_became_peered":"2024-09-12T17:36:21.785026+0000","last_unstale":"2024-09-12T19:26:55.362890+0000","last_undegraded":"2024-09-12T19:26:55.362890+0000","last_fullsized":"2024-09-12T19:26:55.362890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:07.883744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184601,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'320","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.049444+0000","last_change":"2024-09-12T17:36:34.885024+0000","last_active":"2024-09-12T19:26:59.049444+0000","last_peered":"2024-09-12T19:26:59.049444+0000","last_clean":"2024-09-12T19:26:59.049444+0000","last_became_active":"2024-09-12T17:36:34.882818+0000","last_became_peered":"2024-09-12T17:36:34.882818+0000","last_unstale":"2024-09-12T19:26:59.049444+0000","last_undegraded":"2024-09-12T19:26:59.049444+0000","last_fullsized":"2024-09-12T19:26:59.049444+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:00.872257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4458353,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":553,"num_read_kb":22197,"num_write":1262,"num_write_kb":15503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366617+0000","last_change":"2024-09-12T17:36:38.895923+0000","last_active":"2024-09-12T19:27:10.366617+0000","last_peered":"2024-09-12T19:27:10.366617+0000","last_clean":"2024-09-12T19:27:10.366617+0000","last_became_active":"2024-09-12T17:36:38.895378+0000","last_became_peered":"2024-09-12T17:36:38.895378+0000","last_unstale":"2024-09-12T19:27:10.366617+0000","last_undegraded":"2024-09-12T19:27:10.366617+0000","last_fullsized":"2024-09-12T19:27:10.366617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:49.295916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1435","reported_seq":3773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.079442+0000","last_change":"2024-09-12T17:36:40.909473+0000","last_active":"2024-09-12T19:29:25.079442+0000","last_peered":"2024-09-12T19:29:25.079442+0000","last_clean":"2024-09-12T19:29:25.079442+0000","last_became_active":"2024-09-12T17:36:40.908721+0000","last_became_peered":"2024-09-12T17:36:40.908721+0000","last_unstale":"2024-09-12T19:29:25.079442+0000","last_undegraded":"2024-09-12T19:29:25.079442+0000","last_fullsized":"2024-09-12T19:29:25.079442+0000","mapping_epoch":30,"log_start":"265'1400","ondisk_log_start":"265'1400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:39.239469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179443,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2228,"num_read_kb":3772,"num_write":1364,"num_write_kb":1128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:35.342807+0000","last_change":"2024-09-12T17:36:42.918278+0000","last_active":"2024-09-12T19:25:35.342807+0000","last_peered":"2024-09-12T19:25:35.342807+0000","last_clean":"2024-09-12T19:25:35.342807+0000","last_became_active":"2024-09-12T17:36:42.917432+0000","last_became_peered":"2024-09-12T17:36:42.917432+0000","last_unstale":"2024-09-12T19:25:35.342807+0000","last_undegraded":"2024-09-12T19:25:35.342807+0000","last_fullsized":"2024-09-12T19:25:35.342807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:35.437908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'252","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:59.716094+0000","last_change":"2024-09-12T17:36:44.959827+0000","last_active":"2024-09-12T19:27:59.716094+0000","last_peered":"2024-09-12T19:27:59.716094+0000","last_clean":"2024-09-12T19:27:59.716094+0000","last_became_active":"2024-09-12T17:36:44.956687+0000","last_became_peered":"2024-09-12T17:36:44.956687+0000","last_unstale":"2024-09-12T19:27:59.716094+0000","last_undegraded":"2024-09-12T19:27:59.716094+0000","last_fullsized":"2024-09-12T19:27:59.716094+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:45.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":419,"num_write":569,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'457","reported_seq":1909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.363563+0000","last_change":"2024-09-12T17:36:36.877140+0000","last_active":"2024-09-12T19:28:00.363563+0000","last_peered":"2024-09-12T19:28:00.363563+0000","last_clean":"2024-09-12T19:28:00.363563+0000","last_became_active":"2024-09-12T17:36:36.876424+0000","last_became_peered":"2024-09-12T17:36:36.876424+0000","last_unstale":"2024-09-12T19:28:00.363563+0000","last_undegraded":"2024-09-12T19:28:00.363563+0000","last_fullsized":"2024-09-12T19:28:00.363563+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:09.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2313,"num_read_kb":2138,"num_write":582,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670217+0000","last_change":"2024-09-12T17:36:23.789501+0000","last_active":"2024-09-12T19:26:50.670217+0000","last_peered":"2024-09-12T19:26:50.670217+0000","last_clean":"2024-09-12T19:26:50.670217+0000","last_became_active":"2024-09-12T17:36:21.786793+0000","last_became_peered":"2024-09-12T17:36:21.786793+0000","last_unstale":"2024-09-12T19:26:50.670217+0000","last_undegraded":"2024-09-12T19:26:50.670217+0000","last_fullsized":"2024-09-12T19:26:50.670217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:31.878088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011925740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'269","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261041+0000","last_change":"2024-09-12T17:36:34.879706+0000","last_active":"2024-09-12T19:27:05.261041+0000","last_peered":"2024-09-12T19:27:05.261041+0000","last_clean":"2024-09-12T19:27:05.261041+0000","last_became_active":"2024-09-12T17:36:34.878944+0000","last_became_peered":"2024-09-12T17:36:34.878944+0000","last_unstale":"2024-09-12T19:27:05.261041+0000","last_undegraded":"2024-09-12T19:27:05.261041+0000","last_fullsized":"2024-09-12T19:27:05.261041+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:35.362609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10044398,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":464,"num_read_kb":44432,"num_write":1056,"num_write_kb":34964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675306+0000","last_change":"2024-09-12T17:36:38.908387+0000","last_active":"2024-09-12T19:27:10.675306+0000","last_peered":"2024-09-12T19:27:10.675306+0000","last_clean":"2024-09-12T19:27:10.675306+0000","last_became_active":"2024-09-12T17:36:38.907685+0000","last_became_peered":"2024-09-12T17:36:38.907685+0000","last_unstale":"2024-09-12T19:27:10.675306+0000","last_undegraded":"2024-09-12T19:27:10.675306+0000","last_fullsized":"2024-09-12T19:27:10.675306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:58.506591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'385","reported_seq":2346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.224631+0000","last_change":"2024-09-12T17:36:40.907875+0000","last_active":"2024-09-12T19:29:22.224631+0000","last_peered":"2024-09-12T19:29:22.224631+0000","last_clean":"2024-09-12T19:29:22.224631+0000","last_became_active":"2024-09-12T17:36:40.907340+0000","last_became_peered":"2024-09-12T17:36:40.907340+0000","last_unstale":"2024-09-12T19:29:22.224631+0000","last_undegraded":"2024-09-12T19:29:22.224631+0000","last_fullsized":"2024-09-12T19:29:22.224631+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:01.365979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":374,"num_read_kb":364,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.693668+0000","last_change":"2024-09-12T17:36:42.932731+0000","last_active":"2024-09-12T19:27:10.693668+0000","last_peered":"2024-09-12T19:27:10.693668+0000","last_clean":"2024-09-12T19:27:10.693668+0000","last_became_active":"2024-09-12T17:36:42.931884+0000","last_became_peered":"2024-09-12T17:36:42.931884+0000","last_unstale":"2024-09-12T19:27:10.693668+0000","last_undegraded":"2024-09-12T19:27:10.693668+0000","last_fullsized":"2024-09-12T19:27:10.693668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:21.823146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'257","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.184602+0000","last_change":"2024-09-12T17:36:44.940743+0000","last_active":"2024-09-12T19:28:03.184602+0000","last_peered":"2024-09-12T19:28:03.184602+0000","last_clean":"2024-09-12T19:28:03.184602+0000","last_became_active":"2024-09-12T17:36:44.940041+0000","last_became_peered":"2024-09-12T17:36:44.940041+0000","last_unstale":"2024-09-12T19:28:03.184602+0000","last_undegraded":"2024-09-12T19:28:03.184602+0000","last_fullsized":"2024-09-12T19:28:03.184602+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:45.197303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":565,"num_write":575,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'749","reported_seq":2219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181845+0000","last_change":"2024-09-12T17:36:36.897102+0000","last_active":"2024-09-12T19:27:10.181845+0000","last_peered":"2024-09-12T19:27:10.181845+0000","last_clean":"2024-09-12T19:27:10.181845+0000","last_became_active":"2024-09-12T17:36:36.896152+0000","last_became_peered":"2024-09-12T17:36:36.896152+0000","last_unstale":"2024-09-12T19:27:10.181845+0000","last_undegraded":"2024-09-12T19:27:10.181845+0000","last_fullsized":"2024-09-12T19:27:10.181845+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:23.827520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3496,"num_read_kb":3152,"num_write":986,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":552,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.361888+0000","last_change":"2024-09-12T17:36:23.787252+0000","last_active":"2024-09-12T19:26:50.361888+0000","last_peered":"2024-09-12T19:26:50.361888+0000","last_clean":"2024-09-12T19:26:50.361888+0000","last_became_active":"2024-09-12T17:36:21.777173+0000","last_became_peered":"2024-09-12T17:36:21.777173+0000","last_unstale":"2024-09-12T19:26:50.361888+0000","last_undegraded":"2024-09-12T19:26:50.361888+0000","last_fullsized":"2024-09-12T19:26:50.361888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:26.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001776889,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'295","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.138619+0000","last_change":"2024-09-12T17:37:07.868392+0000","last_active":"2024-09-12T19:29:20.138619+0000","last_peered":"2024-09-12T19:29:20.138619+0000","last_clean":"2024-09-12T19:29:20.138619+0000","last_became_active":"2024-09-12T17:37:07.867652+0000","last_became_peered":"2024-09-12T17:37:07.867652+0000","last_unstale":"2024-09-12T19:29:20.138619+0000","last_undegraded":"2024-09-12T19:29:20.138619+0000","last_fullsized":"2024-09-12T19:29:20.138619+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:35.602532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663260,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":580,"num_read_kb":7398,"num_write":1078,"num_write_kb":18590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:25.678699+0000","last_change":"2024-09-12T17:36:38.912854+0000","last_active":"2024-09-12T19:27:25.678699+0000","last_peered":"2024-09-12T19:27:25.678699+0000","last_clean":"2024-09-12T19:27:25.678699+0000","last_became_active":"2024-09-12T17:36:38.912059+0000","last_became_peered":"2024-09-12T17:36:38.912059+0000","last_unstale":"2024-09-12T19:27:25.678699+0000","last_undegraded":"2024-09-12T19:27:25.678699+0000","last_fullsized":"2024-09-12T19:27:25.678699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:05.736408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'216","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.294596+0000","last_change":"2024-09-12T17:36:40.885516+0000","last_active":"2024-09-12T19:29:20.294596+0000","last_peered":"2024-09-12T19:29:20.294596+0000","last_clean":"2024-09-12T19:29:20.294596+0000","last_became_active":"2024-09-12T17:36:40.884794+0000","last_became_peered":"2024-09-12T17:36:40.884794+0000","last_unstale":"2024-09-12T19:29:20.294596+0000","last_undegraded":"2024-09-12T19:29:20.294596+0000","last_fullsized":"2024-09-12T19:29:20.294596+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:21.742525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":278,"num_read_kb":269,"num_write":202,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.367743+0000","last_change":"2024-09-12T17:36:42.921806+0000","last_active":"2024-09-12T19:27:15.367743+0000","last_peered":"2024-09-12T19:27:15.367743+0000","last_clean":"2024-09-12T19:27:15.367743+0000","last_became_active":"2024-09-12T17:36:42.920887+0000","last_became_peered":"2024-09-12T17:36:42.920887+0000","last_unstale":"2024-09-12T19:27:15.367743+0000","last_undegraded":"2024-09-12T19:27:15.367743+0000","last_fullsized":"2024-09-12T19:27:15.367743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:38.116745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'126","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.095950+0000","last_change":"2024-09-12T17:36:44.938503+0000","last_active":"2024-09-12T19:27:15.095950+0000","last_peered":"2024-09-12T19:27:15.095950+0000","last_clean":"2024-09-12T19:27:15.095950+0000","last_became_active":"2024-09-12T17:36:44.937666+0000","last_became_peered":"2024-09-12T17:36:44.937666+0000","last_unstale":"2024-09-12T19:27:15.095950+0000","last_undegraded":"2024-09-12T19:27:15.095950+0000","last_fullsized":"2024-09-12T19:27:15.095950+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:23.897144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":289,"num_read_kb":276,"num_write":312,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'528","reported_seq":2139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.120710+0000","last_change":"2024-09-12T17:36:36.881070+0000","last_active":"2024-09-12T19:28:32.120710+0000","last_peered":"2024-09-12T19:28:32.120710+0000","last_clean":"2024-09-12T19:28:32.120710+0000","last_became_active":"2024-09-12T17:36:36.880335+0000","last_became_peered":"2024-09-12T17:36:36.880335+0000","last_unstale":"2024-09-12T19:28:32.120710+0000","last_undegraded":"2024-09-12T19:28:32.120710+0000","last_fullsized":"2024-09-12T19:28:32.120710+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:22.571992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2654,"num_read_kb":2484,"num_write":644,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'304","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.631813+0000","last_change":"2024-09-12T17:36:34.878244+0000","last_active":"2024-09-12T19:27:38.631813+0000","last_peered":"2024-09-12T19:27:38.631813+0000","last_clean":"2024-09-12T19:27:38.631813+0000","last_became_active":"2024-09-12T17:36:34.877412+0000","last_became_peered":"2024-09-12T17:36:34.877412+0000","last_unstale":"2024-09-12T19:27:38.631813+0000","last_undegraded":"2024-09-12T19:27:38.631813+0000","last_fullsized":"2024-09-12T19:27:38.631813+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:42.929889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20396436,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":459,"num_read_kb":26718,"num_write":1098,"num_write_kb":36792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":555,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.257613+0000","last_change":"2024-09-12T17:36:23.789441+0000","last_active":"2024-09-12T19:26:50.257613+0000","last_peered":"2024-09-12T19:26:50.257613+0000","last_clean":"2024-09-12T19:26:50.257613+0000","last_became_active":"2024-09-12T17:36:21.786429+0000","last_became_peered":"2024-09-12T17:36:21.786429+0000","last_unstale":"2024-09-12T19:26:50.257613+0000","last_undegraded":"2024-09-12T19:26:50.257613+0000","last_fullsized":"2024-09-12T19:26:50.257613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:14.667779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011387680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"36'5","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.905407+0000","last_change":"2024-09-12T17:36:38.903117+0000","last_active":"2024-09-12T19:29:21.905407+0000","last_peered":"2024-09-12T19:29:21.905407+0000","last_clean":"2024-09-12T19:29:21.905407+0000","last_became_active":"2024-09-12T17:36:38.902432+0000","last_became_peered":"2024-09-12T17:36:38.902432+0000","last_unstale":"2024-09-12T19:29:21.905407+0000","last_undegraded":"2024-09-12T19:29:21.905407+0000","last_fullsized":"2024-09-12T19:29:21.905407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:28.729642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1191,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'744","reported_seq":1472,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.999995+0000","last_change":"2024-09-12T17:36:40.903273+0000","last_active":"2024-09-12T19:29:21.999995+0000","last_peered":"2024-09-12T19:29:21.999995+0000","last_clean":"2024-09-12T19:29:21.999995+0000","last_became_active":"2024-09-12T17:36:40.902488+0000","last_became_peered":"2024-09-12T17:36:40.902488+0000","last_unstale":"2024-09-12T19:29:21.999995+0000","last_undegraded":"2024-09-12T19:29:21.999995+0000","last_fullsized":"2024-09-12T19:29:21.999995+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:44.794951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114766,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1929,"num_read_kb":2923,"num_write":2602,"num_write_kb":2363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.251784+0000","last_change":"2024-09-12T17:36:42.932443+0000","last_active":"2024-09-12T19:27:10.251784+0000","last_peered":"2024-09-12T19:27:10.251784+0000","last_clean":"2024-09-12T19:27:10.251784+0000","last_became_active":"2024-09-12T17:36:42.931746+0000","last_became_peered":"2024-09-12T17:36:42.931746+0000","last_unstale":"2024-09-12T19:27:10.251784+0000","last_undegraded":"2024-09-12T19:27:10.251784+0000","last_fullsized":"2024-09-12T19:27:10.251784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:17.226964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'136","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.427148+0000","last_change":"2024-09-12T17:36:44.959931+0000","last_active":"2024-09-12T19:27:55.427148+0000","last_peered":"2024-09-12T19:27:55.427148+0000","last_clean":"2024-09-12T19:27:55.427148+0000","last_became_active":"2024-09-12T17:36:44.959109+0000","last_became_peered":"2024-09-12T17:36:44.959109+0000","last_unstale":"2024-09-12T19:27:55.427148+0000","last_undegraded":"2024-09-12T19:27:55.427148+0000","last_fullsized":"2024-09-12T19:27:55.427148+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:21.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'606","reported_seq":2146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.022973+0000","last_change":"2024-09-12T17:36:36.884101+0000","last_active":"2024-09-12T19:29:21.022973+0000","last_peered":"2024-09-12T19:29:21.022973+0000","last_clean":"2024-09-12T19:29:21.022973+0000","last_became_active":"2024-09-12T17:36:36.883397+0000","last_became_peered":"2024-09-12T17:36:36.883397+0000","last_unstale":"2024-09-12T19:29:21.022973+0000","last_undegraded":"2024-09-12T19:29:21.022973+0000","last_fullsized":"2024-09-12T19:29:21.022973+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:32.872711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3050,"num_read_kb":2738,"num_write":793,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'298","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.049575+0000","last_change":"2024-09-12T17:36:34.892972+0000","last_active":"2024-09-12T19:26:59.049575+0000","last_peered":"2024-09-12T19:26:59.049575+0000","last_clean":"2024-09-12T19:26:59.049575+0000","last_became_active":"2024-09-12T17:36:34.892255+0000","last_became_peered":"2024-09-12T17:36:34.892255+0000","last_unstale":"2024-09-12T19:26:59.049575+0000","last_undegraded":"2024-09-12T19:26:59.049575+0000","last_fullsized":"2024-09-12T19:26:59.049575+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:18.707321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15391900,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":556,"num_read_kb":68904,"num_write":987,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368858+0000","last_change":"2024-09-12T17:36:23.786560+0000","last_active":"2024-09-12T19:27:20.368858+0000","last_peered":"2024-09-12T19:27:20.368858+0000","last_clean":"2024-09-12T19:27:20.368858+0000","last_became_active":"2024-09-12T17:36:21.783069+0000","last_became_peered":"2024-09-12T17:36:21.783069+0000","last_unstale":"2024-09-12T19:27:20.368858+0000","last_undegraded":"2024-09-12T19:27:20.368858+0000","last_fullsized":"2024-09-12T19:27:20.368858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:06.261529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135285,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602908+0000","last_change":"2024-09-12T17:36:38.901020+0000","last_active":"2024-09-12T19:27:05.602908+0000","last_peered":"2024-09-12T19:27:05.602908+0000","last_clean":"2024-09-12T19:27:05.602908+0000","last_became_active":"2024-09-12T17:36:38.900433+0000","last_became_peered":"2024-09-12T17:36:38.900433+0000","last_unstale":"2024-09-12T19:27:05.602908+0000","last_undegraded":"2024-09-12T19:27:05.602908+0000","last_fullsized":"2024-09-12T19:27:05.602908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:42.477669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'247","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:34.719450+0000","last_change":"2024-09-12T17:36:40.887225+0000","last_active":"2024-09-12T19:27:34.719450+0000","last_peered":"2024-09-12T19:27:34.719450+0000","last_clean":"2024-09-12T19:27:34.719450+0000","last_became_active":"2024-09-12T17:36:40.886345+0000","last_became_peered":"2024-09-12T17:36:40.886345+0000","last_unstale":"2024-09-12T19:27:34.719450+0000","last_undegraded":"2024-09-12T19:27:34.719450+0000","last_fullsized":"2024-09-12T19:27:34.719450+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:50.264902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'801","reported_seq":3497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.080315+0000","last_change":"2024-09-12T17:36:42.932438+0000","last_active":"2024-09-12T19:29:25.080315+0000","last_peered":"2024-09-12T19:29:25.080315+0000","last_clean":"2024-09-12T19:29:25.080315+0000","last_became_active":"2024-09-12T17:36:42.931598+0000","last_became_peered":"2024-09-12T17:36:42.931598+0000","last_unstale":"2024-09-12T19:29:25.080315+0000","last_undegraded":"2024-09-12T19:29:25.080315+0000","last_fullsized":"2024-09-12T19:29:25.080315+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:00.606220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'133","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.059775+0000","last_change":"2024-09-12T17:36:44.952618+0000","last_active":"2024-09-12T19:29:22.059775+0000","last_peered":"2024-09-12T19:29:22.059775+0000","last_clean":"2024-09-12T19:29:22.059775+0000","last_became_active":"2024-09-12T17:36:44.951849+0000","last_became_peered":"2024-09-12T17:36:44.951849+0000","last_unstale":"2024-09-12T19:29:22.059775+0000","last_undegraded":"2024-09-12T19:29:22.059775+0000","last_fullsized":"2024-09-12T19:29:22.059775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:49.786200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'742","reported_seq":2375,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691100+0000","last_change":"2024-09-12T17:36:36.893671+0000","last_active":"2024-09-12T19:27:00.691100+0000","last_peered":"2024-09-12T19:27:00.691100+0000","last_clean":"2024-09-12T19:27:00.691100+0000","last_became_active":"2024-09-12T17:36:36.892861+0000","last_became_peered":"2024-09-12T17:36:36.892861+0000","last_unstale":"2024-09-12T19:27:00.691100+0000","last_undegraded":"2024-09-12T19:27:00.691100+0000","last_fullsized":"2024-09-12T19:27:00.691100+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:54.133834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3560,"num_read_kb":3257,"num_write":956,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'294","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.692527+0000","last_change":"2024-09-12T17:36:34.883910+0000","last_active":"2024-09-12T19:27:05.692527+0000","last_peered":"2024-09-12T19:27:05.692527+0000","last_clean":"2024-09-12T19:27:05.692527+0000","last_became_active":"2024-09-12T17:36:34.883331+0000","last_became_peered":"2024-09-12T17:36:34.883331+0000","last_unstale":"2024-09-12T19:27:05.692527+0000","last_undegraded":"2024-09-12T19:27:05.692527+0000","last_fullsized":"2024-09-12T19:27:05.692527+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:14.534598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243609,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":458,"num_read_kb":26130,"num_write":1124,"num_write_kb":40752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":555,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690113+0000","last_change":"2024-09-12T17:36:24.506296+0000","last_active":"2024-09-12T19:26:55.690113+0000","last_peered":"2024-09-12T19:26:55.690113+0000","last_clean":"2024-09-12T19:26:55.690113+0000","last_became_active":"2024-09-12T17:36:22.059379+0000","last_became_peered":"2024-09-12T17:36:22.059379+0000","last_unstale":"2024-09-12T19:26:55.690113+0000","last_undegraded":"2024-09-12T19:26:55.690113+0000","last_fullsized":"2024-09-12T19:26:55.690113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:24.672143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012087210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.365102+0000","last_change":"2024-09-12T17:36:38.892129+0000","last_active":"2024-09-12T19:27:05.365102+0000","last_peered":"2024-09-12T19:27:05.365102+0000","last_clean":"2024-09-12T19:27:05.365102+0000","last_became_active":"2024-09-12T17:36:38.891807+0000","last_became_peered":"2024-09-12T17:36:38.891807+0000","last_unstale":"2024-09-12T19:27:05.365102+0000","last_undegraded":"2024-09-12T19:27:05.365102+0000","last_fullsized":"2024-09-12T19:27:05.365102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:48.578150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'173","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:33.637507+0000","last_change":"2024-09-12T17:36:40.898576+0000","last_active":"2024-09-12T19:27:33.637507+0000","last_peered":"2024-09-12T19:27:33.637507+0000","last_clean":"2024-09-12T19:27:33.637507+0000","last_became_active":"2024-09-12T17:36:40.897763+0000","last_became_peered":"2024-09-12T17:36:40.897763+0000","last_unstale":"2024-09-12T19:27:33.637507+0000","last_undegraded":"2024-09-12T19:27:33.637507+0000","last_fullsized":"2024-09-12T19:27:33.637507+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:41.559054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'797","reported_seq":3144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.067722+0000","last_change":"2024-09-12T17:36:42.930005+0000","last_active":"2024-09-12T19:29:25.067722+0000","last_peered":"2024-09-12T19:29:25.067722+0000","last_clean":"2024-09-12T19:29:25.067722+0000","last_became_active":"2024-09-12T17:36:42.928978+0000","last_became_peered":"2024-09-12T17:36:42.928978+0000","last_unstale":"2024-09-12T19:29:25.067722+0000","last_undegraded":"2024-09-12T19:29:25.067722+0000","last_fullsized":"2024-09-12T19:29:25.067722+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:50.493434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'235","reported_seq":781,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.583893+0000","last_change":"2024-09-12T17:36:44.960384+0000","last_active":"2024-09-12T19:28:02.583893+0000","last_peered":"2024-09-12T19:28:02.583893+0000","last_clean":"2024-09-12T19:28:02.583893+0000","last_became_active":"2024-09-12T17:36:44.956784+0000","last_became_peered":"2024-09-12T17:36:44.956784+0000","last_unstale":"2024-09-12T19:28:02.583893+0000","last_undegraded":"2024-09-12T19:28:02.583893+0000","last_fullsized":"2024-09-12T19:28:02.583893+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:30.401098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":233,"num_read_kb":216,"num_write":428,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'373","reported_seq":2039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250850+0000","last_change":"2024-09-12T17:36:36.884169+0000","last_active":"2024-09-12T19:27:05.250850+0000","last_peered":"2024-09-12T19:27:05.250850+0000","last_clean":"2024-09-12T19:27:05.250850+0000","last_became_active":"2024-09-12T17:36:36.883862+0000","last_became_peered":"2024-09-12T17:36:36.883862+0000","last_unstale":"2024-09-12T19:27:05.250850+0000","last_undegraded":"2024-09-12T19:27:05.250850+0000","last_fullsized":"2024-09-12T19:27:05.250850+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:01.097363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2422,"num_read_kb":2340,"num_write":416,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'287","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.692494+0000","last_change":"2024-09-12T17:36:34.869612+0000","last_active":"2024-09-12T19:27:05.692494+0000","last_peered":"2024-09-12T19:27:05.692494+0000","last_clean":"2024-09-12T19:27:05.692494+0000","last_became_active":"2024-09-12T17:36:34.868641+0000","last_became_peered":"2024-09-12T17:36:34.868641+0000","last_unstale":"2024-09-12T19:27:05.692494+0000","last_undegraded":"2024-09-12T19:27:05.692494+0000","last_fullsized":"2024-09-12T19:27:05.692494+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:13.423256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8059094,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":485,"num_read_kb":35743,"num_write":1119,"num_write_kb":32710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":548,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.363084+0000","last_change":"2024-09-12T17:36:23.787880+0000","last_active":"2024-09-12T19:26:55.363084+0000","last_peered":"2024-09-12T19:26:55.363084+0000","last_clean":"2024-09-12T19:26:55.363084+0000","last_became_active":"2024-09-12T17:36:22.058794+0000","last_became_peered":"2024-09-12T17:36:22.058794+0000","last_unstale":"2024-09-12T19:26:55.363084+0000","last_undegraded":"2024-09-12T19:26:55.363084+0000","last_fullsized":"2024-09-12T19:26:55.363084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:04.896637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691146+0000","last_change":"2024-09-12T17:36:38.902092+0000","last_active":"2024-09-12T19:27:00.691146+0000","last_peered":"2024-09-12T19:27:00.691146+0000","last_clean":"2024-09-12T19:27:00.691146+0000","last_became_active":"2024-09-12T17:36:38.901418+0000","last_became_peered":"2024-09-12T17:36:38.901418+0000","last_unstale":"2024-09-12T19:27:00.691146+0000","last_undegraded":"2024-09-12T19:27:00.691146+0000","last_fullsized":"2024-09-12T19:27:00.691146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:20.898210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'796","reported_seq":1570,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.995362+0000","last_change":"2024-09-12T17:36:40.908672+0000","last_active":"2024-09-12T19:29:21.995362+0000","last_peered":"2024-09-12T19:29:21.995362+0000","last_clean":"2024-09-12T19:29:21.995362+0000","last_became_active":"2024-09-12T17:36:40.908231+0000","last_became_peered":"2024-09-12T17:36:40.908231+0000","last_unstale":"2024-09-12T19:29:21.995362+0000","last_undegraded":"2024-09-12T19:29:21.995362+0000","last_fullsized":"2024-09-12T19:29:21.995362+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:35.140601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1393,"num_read_kb":2880,"num_write":1134,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.693604+0000","last_change":"2024-09-12T17:36:42.933142+0000","last_active":"2024-09-12T19:27:10.693604+0000","last_peered":"2024-09-12T19:27:10.693604+0000","last_clean":"2024-09-12T19:27:10.693604+0000","last_became_active":"2024-09-12T17:36:42.932086+0000","last_became_peered":"2024-09-12T17:36:42.932086+0000","last_unstale":"2024-09-12T19:27:10.693604+0000","last_undegraded":"2024-09-12T19:27:10.693604+0000","last_fullsized":"2024-09-12T19:27:10.693604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:49.913999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'126","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249809+0000","last_change":"2024-09-12T17:36:44.961527+0000","last_active":"2024-09-12T19:27:00.249809+0000","last_peered":"2024-09-12T19:27:00.249809+0000","last_clean":"2024-09-12T19:27:00.249809+0000","last_became_active":"2024-09-12T17:36:44.960744+0000","last_became_peered":"2024-09-12T17:36:44.960744+0000","last_unstale":"2024-09-12T19:27:00.249809+0000","last_undegraded":"2024-09-12T19:27:00.249809+0000","last_fullsized":"2024-09-12T19:27:00.249809+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:42.564425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":186,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'135","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.080882+0000","last_change":"2024-09-12T17:36:44.940544+0000","last_active":"2024-09-12T19:28:03.080882+0000","last_peered":"2024-09-12T19:28:03.080882+0000","last_clean":"2024-09-12T19:28:03.080882+0000","last_became_active":"2024-09-12T17:36:44.939820+0000","last_became_peered":"2024-09-12T17:36:44.939820+0000","last_unstale":"2024-09-12T19:28:03.080882+0000","last_undegraded":"2024-09-12T19:28:03.080882+0000","last_fullsized":"2024-09-12T19:28:03.080882+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:23.567209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":235,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'799","reported_seq":2458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.117512+0000","last_change":"2024-09-12T17:36:36.883861+0000","last_active":"2024-09-12T19:28:32.117512+0000","last_peered":"2024-09-12T19:28:32.117512+0000","last_clean":"2024-09-12T19:28:32.117512+0000","last_became_active":"2024-09-12T17:36:36.883481+0000","last_became_peered":"2024-09-12T17:36:36.883481+0000","last_unstale":"2024-09-12T19:28:32.117512+0000","last_undegraded":"2024-09-12T19:28:32.117512+0000","last_fullsized":"2024-09-12T19:28:32.117512+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:44.086651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3831,"num_read_kb":3485,"num_write":1040,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'255","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360876+0000","last_change":"2024-09-12T17:36:34.862214+0000","last_active":"2024-09-12T19:26:45.360876+0000","last_peered":"2024-09-12T19:26:45.360876+0000","last_clean":"2024-09-12T19:26:45.360876+0000","last_became_active":"2024-09-12T17:36:34.861702+0000","last_became_peered":"2024-09-12T17:36:34.861702+0000","last_unstale":"2024-09-12T19:26:45.360876+0000","last_undegraded":"2024-09-12T19:26:45.360876+0000","last_fullsized":"2024-09-12T19:26:45.360876+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:53.824355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8653012,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":408,"num_read_kb":26224,"num_write":989,"num_write_kb":25793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.040900+0000","last_change":"2024-09-12T17:36:38.895498+0000","last_active":"2024-09-12T19:26:19.040900+0000","last_peered":"2024-09-12T19:26:19.040900+0000","last_clean":"2024-09-12T19:26:19.040900+0000","last_became_active":"2024-09-12T17:36:38.894742+0000","last_became_peered":"2024-09-12T17:36:38.894742+0000","last_unstale":"2024-09-12T19:26:19.040900+0000","last_undegraded":"2024-09-12T19:26:19.040900+0000","last_fullsized":"2024-09-12T19:26:19.040900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:33.054267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'322","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:44.072532+0000","last_change":"2024-09-12T17:36:40.893532+0000","last_active":"2024-09-12T19:28:44.072532+0000","last_peered":"2024-09-12T19:28:44.072532+0000","last_clean":"2024-09-12T19:28:44.072532+0000","last_became_active":"2024-09-12T17:36:40.892710+0000","last_became_peered":"2024-09-12T17:36:40.892710+0000","last_unstale":"2024-09-12T19:28:44.072532+0000","last_undegraded":"2024-09-12T19:28:44.072532+0000","last_fullsized":"2024-09-12T19:28:44.072532+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:12.985322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55952,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":978,"num_write":412,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664522+0000","last_change":"2024-09-12T17:36:42.939570+0000","last_active":"2024-09-12T19:26:25.664522+0000","last_peered":"2024-09-12T19:26:25.664522+0000","last_clean":"2024-09-12T19:26:25.664522+0000","last_became_active":"2024-09-12T17:36:42.938834+0000","last_became_peered":"2024-09-12T17:36:42.938834+0000","last_unstale":"2024-09-12T19:26:25.664522+0000","last_undegraded":"2024-09-12T19:26:25.664522+0000","last_fullsized":"2024-09-12T19:26:25.664522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:13.130674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'139","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.674057+0000","last_change":"2024-09-12T17:36:44.953890+0000","last_active":"2024-09-12T19:27:05.674057+0000","last_peered":"2024-09-12T19:27:05.674057+0000","last_clean":"2024-09-12T19:27:05.674057+0000","last_became_active":"2024-09-12T17:36:44.953117+0000","last_became_peered":"2024-09-12T17:36:44.953117+0000","last_unstale":"2024-09-12T19:27:05.674057+0000","last_undegraded":"2024-09-12T19:27:05.674057+0000","last_fullsized":"2024-09-12T19:27:05.674057+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:53.223197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":202,"num_write":357,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'468","reported_seq":2073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682046+0000","last_change":"2024-09-12T17:36:36.901726+0000","last_active":"2024-09-12T19:26:20.682046+0000","last_peered":"2024-09-12T19:26:20.682046+0000","last_clean":"2024-09-12T19:26:20.682046+0000","last_became_active":"2024-09-12T17:36:36.900955+0000","last_became_peered":"2024-09-12T17:36:36.900955+0000","last_unstale":"2024-09-12T19:26:20.682046+0000","last_undegraded":"2024-09-12T19:26:20.682046+0000","last_fullsized":"2024-09-12T19:26:20.682046+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:39.022567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2490,"num_read_kb":2331,"num_write":571,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'264","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:47.673872+0000","last_change":"2024-09-12T17:36:34.878783+0000","last_active":"2024-09-12T19:26:47.673872+0000","last_peered":"2024-09-12T19:26:47.673872+0000","last_clean":"2024-09-12T19:26:47.673872+0000","last_became_active":"2024-09-12T17:36:34.878069+0000","last_became_peered":"2024-09-12T17:36:34.878069+0000","last_unstale":"2024-09-12T19:26:47.673872+0000","last_undegraded":"2024-09-12T19:26:47.673872+0000","last_fullsized":"2024-09-12T19:26:47.673872+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:53.462388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7783745,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":705,"num_read_kb":26278,"num_write":894,"num_write_kb":31119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682090+0000","last_change":"2024-09-12T17:36:38.895965+0000","last_active":"2024-09-12T19:26:20.682090+0000","last_peered":"2024-09-12T19:26:20.682090+0000","last_clean":"2024-09-12T19:26:20.682090+0000","last_became_active":"2024-09-12T17:36:38.894800+0000","last_became_peered":"2024-09-12T17:36:38.894800+0000","last_unstale":"2024-09-12T19:26:20.682090+0000","last_undegraded":"2024-09-12T19:26:20.682090+0000","last_fullsized":"2024-09-12T19:26:20.682090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:45.719885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'81","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:22.977940+0000","last_change":"2024-09-12T17:36:40.910425+0000","last_active":"2024-09-12T19:27:22.977940+0000","last_peered":"2024-09-12T19:27:22.977940+0000","last_clean":"2024-09-12T19:27:22.977940+0000","last_became_active":"2024-09-12T17:36:40.909470+0000","last_became_peered":"2024-09-12T17:36:40.909470+0000","last_unstale":"2024-09-12T19:27:22.977940+0000","last_undegraded":"2024-09-12T19:27:22.977940+0000","last_fullsized":"2024-09-12T19:27:22.977940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:59.636810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242569+0000","last_change":"2024-09-12T17:36:42.923023+0000","last_active":"2024-09-12T19:26:25.242569+0000","last_peered":"2024-09-12T19:26:25.242569+0000","last_clean":"2024-09-12T19:26:25.242569+0000","last_became_active":"2024-09-12T17:36:42.922352+0000","last_became_peered":"2024-09-12T17:36:42.922352+0000","last_unstale":"2024-09-12T19:26:25.242569+0000","last_undegraded":"2024-09-12T19:26:25.242569+0000","last_fullsized":"2024-09-12T19:26:25.242569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:06.521341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'237","reported_seq":778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.928944+0000","last_change":"2024-09-12T17:36:44.946524+0000","last_active":"2024-09-12T19:28:02.928944+0000","last_peered":"2024-09-12T19:28:02.928944+0000","last_clean":"2024-09-12T19:28:02.928944+0000","last_became_active":"2024-09-12T17:36:44.945429+0000","last_became_peered":"2024-09-12T17:36:44.945429+0000","last_unstale":"2024-09-12T19:28:02.928944+0000","last_undegraded":"2024-09-12T19:28:02.928944+0000","last_fullsized":"2024-09-12T19:28:02.928944+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:03.136753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":307,"num_read_kb":303,"num_write":509,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'826","reported_seq":2357,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.322547+0000","last_change":"2024-09-12T17:36:36.901899+0000","last_active":"2024-09-12T19:26:59.322547+0000","last_peered":"2024-09-12T19:26:59.322547+0000","last_clean":"2024-09-12T19:26:59.322547+0000","last_became_active":"2024-09-12T17:36:36.901053+0000","last_became_peered":"2024-09-12T17:36:36.901053+0000","last_unstale":"2024-09-12T19:26:59.322547+0000","last_undegraded":"2024-09-12T19:26:59.322547+0000","last_fullsized":"2024-09-12T19:26:59.322547+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:22.502956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3878,"num_read_kb":3474,"num_write":1082,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'289","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:20.228268+0000","last_change":"2024-09-12T17:36:34.878025+0000","last_active":"2024-09-12T19:25:20.228268+0000","last_peered":"2024-09-12T19:25:20.228268+0000","last_clean":"2024-09-12T19:25:20.228268+0000","last_became_active":"2024-09-12T17:36:34.877620+0000","last_became_peered":"2024-09-12T17:36:34.877620+0000","last_unstale":"2024-09-12T19:25:20.228268+0000","last_undegraded":"2024-09-12T19:25:20.228268+0000","last_fullsized":"2024-09-12T19:25:20.228268+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:44.559070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14748865,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":448,"num_read_kb":51731,"num_write":1016,"num_write_kb":38676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241189+0000","last_change":"2024-09-12T17:36:38.903616+0000","last_active":"2024-09-12T19:26:20.241189+0000","last_peered":"2024-09-12T19:26:20.241189+0000","last_clean":"2024-09-12T19:26:20.241189+0000","last_became_active":"2024-09-12T17:36:38.902188+0000","last_became_peered":"2024-09-12T17:36:38.902188+0000","last_unstale":"2024-09-12T19:26:20.241189+0000","last_undegraded":"2024-09-12T19:26:20.241189+0000","last_fullsized":"2024-09-12T19:26:20.241189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.927110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'372","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.695530+0000","last_change":"2024-09-12T17:36:40.899887+0000","last_active":"2024-09-12T19:28:40.695530+0000","last_peered":"2024-09-12T19:28:40.695530+0000","last_clean":"2024-09-12T19:28:40.695530+0000","last_became_active":"2024-09-12T17:36:40.899201+0000","last_became_peered":"2024-09-12T17:36:40.899201+0000","last_unstale":"2024-09-12T19:28:40.695530+0000","last_undegraded":"2024-09-12T19:28:40.695530+0000","last_fullsized":"2024-09-12T19:28:40.695530+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:19.009661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66074,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":1145,"num_write":480,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.084454+0000","last_change":"2024-09-12T17:36:42.930518+0000","last_active":"2024-09-12T19:26:25.084454+0000","last_peered":"2024-09-12T19:26:25.084454+0000","last_clean":"2024-09-12T19:26:25.084454+0000","last_became_active":"2024-09-12T17:36:42.928596+0000","last_became_peered":"2024-09-12T17:36:42.928596+0000","last_unstale":"2024-09-12T19:26:25.084454+0000","last_undegraded":"2024-09-12T19:26:25.084454+0000","last_fullsized":"2024-09-12T19:26:25.084454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:38.476152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'143","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360848+0000","last_change":"2024-09-12T17:36:44.963106+0000","last_active":"2024-09-12T19:26:45.360848+0000","last_peered":"2024-09-12T19:26:45.360848+0000","last_clean":"2024-09-12T19:26:45.360848+0000","last_became_active":"2024-09-12T17:36:44.962445+0000","last_became_peered":"2024-09-12T17:36:44.962445+0000","last_unstale":"2024-09-12T19:26:45.360848+0000","last_undegraded":"2024-09-12T19:26:45.360848+0000","last_fullsized":"2024-09-12T19:26:45.360848+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:03.293578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":234,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'601","reported_seq":2246,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.663326+0000","last_change":"2024-09-12T17:36:36.904547+0000","last_active":"2024-09-12T19:26:20.663326+0000","last_peered":"2024-09-12T19:26:20.663326+0000","last_clean":"2024-09-12T19:26:20.663326+0000","last_became_active":"2024-09-12T17:36:36.903813+0000","last_became_peered":"2024-09-12T17:36:36.903813+0000","last_unstale":"2024-09-12T19:26:20.663326+0000","last_undegraded":"2024-09-12T19:26:20.663326+0000","last_fullsized":"2024-09-12T19:26:20.663326+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:28.273003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3115,"num_read_kb":2836,"num_write":758,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'244","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.910712+0000","last_change":"2024-09-12T17:36:34.887548+0000","last_active":"2024-09-12T19:27:38.910712+0000","last_peered":"2024-09-12T19:27:38.910712+0000","last_clean":"2024-09-12T19:27:38.910712+0000","last_became_active":"2024-09-12T17:36:34.886741+0000","last_became_peered":"2024-09-12T17:36:34.886741+0000","last_unstale":"2024-09-12T19:27:38.910712+0000","last_undegraded":"2024-09-12T19:27:38.910712+0000","last_fullsized":"2024-09-12T19:27:38.910712+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:29.979024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4139249,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":404,"num_read_kb":24643,"num_write":953,"num_write_kb":38417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.353955+0000","last_change":"2024-09-12T17:36:38.903818+0000","last_active":"2024-09-12T19:26:20.353955+0000","last_peered":"2024-09-12T19:26:20.353955+0000","last_clean":"2024-09-12T19:26:20.353955+0000","last_became_active":"2024-09-12T17:36:38.903210+0000","last_became_peered":"2024-09-12T17:36:38.903210+0000","last_unstale":"2024-09-12T19:26:20.353955+0000","last_undegraded":"2024-09-12T19:26:20.353955+0000","last_fullsized":"2024-09-12T19:26:20.353955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:00.851761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'303","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.622156+0000","last_change":"2024-09-12T17:36:40.913086+0000","last_active":"2024-09-12T19:28:40.622156+0000","last_peered":"2024-09-12T19:28:40.622156+0000","last_clean":"2024-09-12T19:28:40.622156+0000","last_became_active":"2024-09-12T17:36:40.912283+0000","last_became_peered":"2024-09-12T17:36:40.912283+0000","last_unstale":"2024-09-12T19:28:40.622156+0000","last_undegraded":"2024-09-12T19:28:40.622156+0000","last_fullsized":"2024-09-12T19:28:40.622156+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:05.161253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58005,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":495,"num_read_kb":989,"num_write":398,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664637+0000","last_change":"2024-09-12T17:36:42.928432+0000","last_active":"2024-09-12T19:26:25.664637+0000","last_peered":"2024-09-12T19:26:25.664637+0000","last_clean":"2024-09-12T19:26:25.664637+0000","last_became_active":"2024-09-12T17:36:42.927724+0000","last_became_peered":"2024-09-12T17:36:42.927724+0000","last_unstale":"2024-09-12T19:26:25.664637+0000","last_undegraded":"2024-09-12T19:26:25.664637+0000","last_fullsized":"2024-09-12T19:26:25.664637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:30.771719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'721","reported_seq":2248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.028622+0000","last_change":"2024-09-12T17:36:36.886104+0000","last_active":"2024-09-12T19:29:21.028622+0000","last_peered":"2024-09-12T19:29:21.028622+0000","last_clean":"2024-09-12T19:29:21.028622+0000","last_became_active":"2024-09-12T17:36:36.885820+0000","last_became_peered":"2024-09-12T17:36:36.885820+0000","last_unstale":"2024-09-12T19:29:21.028622+0000","last_undegraded":"2024-09-12T19:29:21.028622+0000","last_fullsized":"2024-09-12T19:29:21.028622+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.701415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3501,"num_read_kb":3197,"num_write":936,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'277","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.631236+0000","last_change":"2024-09-12T17:36:34.888051+0000","last_active":"2024-09-12T19:27:38.631236+0000","last_peered":"2024-09-12T19:27:38.631236+0000","last_clean":"2024-09-12T19:27:38.631236+0000","last_became_active":"2024-09-12T17:36:34.887018+0000","last_became_peered":"2024-09-12T17:36:34.887018+0000","last_unstale":"2024-09-12T19:27:38.631236+0000","last_undegraded":"2024-09-12T19:27:38.631236+0000","last_fullsized":"2024-09-12T19:27:38.631236+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:00.894469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9444109,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":476,"num_read_kb":38391,"num_write":1011,"num_write_kb":34235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:04.050979+0000","last_change":"2024-09-12T17:36:38.895303+0000","last_active":"2024-09-12T19:27:04.050979+0000","last_peered":"2024-09-12T19:27:04.050979+0000","last_clean":"2024-09-12T19:27:04.050979+0000","last_became_active":"2024-09-12T17:36:38.894452+0000","last_became_peered":"2024-09-12T17:36:38.894452+0000","last_unstale":"2024-09-12T19:27:04.050979+0000","last_undegraded":"2024-09-12T19:27:04.050979+0000","last_fullsized":"2024-09-12T19:27:04.050979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:40.122335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'504","reported_seq":1167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.987702+0000","last_change":"2024-09-12T17:36:40.910273+0000","last_active":"2024-09-12T19:29:21.987702+0000","last_peered":"2024-09-12T19:29:21.987702+0000","last_clean":"2024-09-12T19:29:21.987702+0000","last_became_active":"2024-09-12T17:36:40.909552+0000","last_became_peered":"2024-09-12T17:36:40.909552+0000","last_unstale":"2024-09-12T19:29:21.987702+0000","last_undegraded":"2024-09-12T19:29:21.987702+0000","last_fullsized":"2024-09-12T19:29:21.987702+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:32.101093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120151,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":878,"num_read_kb":1821,"num_write":754,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.247037+0000","last_change":"2024-09-12T17:36:42.943311+0000","last_active":"2024-09-12T19:26:45.247037+0000","last_peered":"2024-09-12T19:26:45.247037+0000","last_clean":"2024-09-12T19:26:45.247037+0000","last_became_active":"2024-09-12T17:36:42.942627+0000","last_became_peered":"2024-09-12T17:36:42.942627+0000","last_unstale":"2024-09-12T19:26:45.247037+0000","last_undegraded":"2024-09-12T19:26:45.247037+0000","last_fullsized":"2024-09-12T19:26:45.247037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:28.862834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'167","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:57.461795+0000","last_change":"2024-09-12T17:36:44.959491+0000","last_active":"2024-09-12T19:27:57.461795+0000","last_peered":"2024-09-12T19:27:57.461795+0000","last_clean":"2024-09-12T19:27:57.461795+0000","last_became_active":"2024-09-12T17:36:44.956655+0000","last_became_peered":"2024-09-12T17:36:44.956655+0000","last_unstale":"2024-09-12T19:27:57.461795+0000","last_undegraded":"2024-09-12T19:27:57.461795+0000","last_fullsized":"2024-09-12T19:27:57.461795+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:59.575861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":241,"num_write":385,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'357","reported_seq":1938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691336+0000","last_change":"2024-09-12T17:36:36.912708+0000","last_active":"2024-09-12T19:27:00.691336+0000","last_peered":"2024-09-12T19:27:00.691336+0000","last_clean":"2024-09-12T19:27:00.691336+0000","last_became_active":"2024-09-12T17:36:36.911889+0000","last_became_peered":"2024-09-12T17:36:36.911889+0000","last_unstale":"2024-09-12T19:27:00.691336+0000","last_undegraded":"2024-09-12T19:27:00.691336+0000","last_fullsized":"2024-09-12T19:27:00.691336+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:52.030740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2021,"num_read_kb":1969,"num_write":390,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'285","reported_seq":1058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.673216+0000","last_change":"2024-09-12T17:36:34.852681+0000","last_active":"2024-09-12T19:25:40.673216+0000","last_peered":"2024-09-12T19:25:40.673216+0000","last_clean":"2024-09-12T19:25:40.673216+0000","last_became_active":"2024-09-12T17:36:34.851161+0000","last_became_peered":"2024-09-12T17:36:34.851161+0000","last_unstale":"2024-09-12T19:25:40.673216+0000","last_undegraded":"2024-09-12T19:25:40.673216+0000","last_fullsized":"2024-09-12T19:25:40.673216+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:27.435874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14503381,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":662,"num_read_kb":47360,"num_write":1031,"num_write_kb":33375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.251083+0000","last_change":"2024-09-12T17:36:38.905238+0000","last_active":"2024-09-12T19:27:05.251083+0000","last_peered":"2024-09-12T19:27:05.251083+0000","last_clean":"2024-09-12T19:27:05.251083+0000","last_became_active":"2024-09-12T17:36:38.904409+0000","last_became_peered":"2024-09-12T17:36:38.904409+0000","last_unstale":"2024-09-12T19:27:05.251083+0000","last_undegraded":"2024-09-12T19:27:05.251083+0000","last_fullsized":"2024-09-12T19:27:05.251083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:40.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'399","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.393502+0000","last_change":"2024-09-12T17:36:40.903223+0000","last_active":"2024-09-12T19:29:10.393502+0000","last_peered":"2024-09-12T19:29:10.393502+0000","last_clean":"2024-09-12T19:29:10.393502+0000","last_became_active":"2024-09-12T17:36:40.902718+0000","last_became_peered":"2024-09-12T17:36:40.902718+0000","last_unstale":"2024-09-12T19:29:10.393502+0000","last_undegraded":"2024-09-12T19:29:10.393502+0000","last_fullsized":"2024-09-12T19:29:10.393502+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.363639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66972,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":666,"num_read_kb":1223,"num_write":558,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.256436+0000","last_change":"2024-09-12T17:36:42.921077+0000","last_active":"2024-09-12T19:26:45.256436+0000","last_peered":"2024-09-12T19:26:45.256436+0000","last_clean":"2024-09-12T19:26:45.256436+0000","last_became_active":"2024-09-12T17:36:42.920352+0000","last_became_peered":"2024-09-12T17:36:42.920352+0000","last_unstale":"2024-09-12T19:26:45.256436+0000","last_undegraded":"2024-09-12T19:26:45.256436+0000","last_fullsized":"2024-09-12T19:26:45.256436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:47.099873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'181","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355355+0000","last_change":"2024-09-12T17:36:44.946661+0000","last_active":"2024-09-12T19:26:25.355355+0000","last_peered":"2024-09-12T19:26:25.355355+0000","last_clean":"2024-09-12T19:26:25.355355+0000","last_became_active":"2024-09-12T17:36:44.945753+0000","last_became_peered":"2024-09-12T17:36:44.945753+0000","last_unstale":"2024-09-12T19:26:25.355355+0000","last_undegraded":"2024-09-12T19:26:25.355355+0000","last_fullsized":"2024-09-12T19:26:25.355355+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:51.605529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":278,"num_read_kb":268,"num_write":526,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'523","reported_seq":2253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.623056+0000","last_change":"2024-09-12T17:36:36.910292+0000","last_active":"2024-09-12T19:28:02.623056+0000","last_peered":"2024-09-12T19:28:02.623056+0000","last_clean":"2024-09-12T19:28:02.623056+0000","last_became_active":"2024-09-12T17:36:36.909488+0000","last_became_peered":"2024-09-12T17:36:36.909488+0000","last_unstale":"2024-09-12T19:28:02.623056+0000","last_undegraded":"2024-09-12T19:28:02.623056+0000","last_fullsized":"2024-09-12T19:28:02.623056+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:27.498312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2968,"num_read_kb":2777,"num_write":639,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'320","reported_seq":1005,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:05.118153+0000","last_change":"2024-09-12T17:36:34.857968+0000","last_active":"2024-09-12T19:29:05.118153+0000","last_peered":"2024-09-12T19:29:05.118153+0000","last_clean":"2024-09-12T19:29:05.118153+0000","last_became_active":"2024-09-12T17:36:34.857645+0000","last_became_peered":"2024-09-12T17:36:34.857645+0000","last_unstale":"2024-09-12T19:29:05.118153+0000","last_undegraded":"2024-09-12T19:29:05.118153+0000","last_fullsized":"2024-09-12T19:29:05.118153+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:06.150098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7980169,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":539,"num_read_kb":13472,"num_write":1233,"num_write_kb":33813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.245950+0000","last_change":"2024-09-12T17:36:38.905353+0000","last_active":"2024-09-12T19:26:40.245950+0000","last_peered":"2024-09-12T19:26:40.245950+0000","last_clean":"2024-09-12T19:26:40.245950+0000","last_became_active":"2024-09-12T17:36:38.904619+0000","last_became_peered":"2024-09-12T17:36:38.904619+0000","last_unstale":"2024-09-12T19:26:40.245950+0000","last_undegraded":"2024-09-12T19:26:40.245950+0000","last_fullsized":"2024-09-12T19:26:40.245950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:01.832724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'311","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:14.079656+0000","last_change":"2024-09-12T17:36:40.909967+0000","last_active":"2024-09-12T19:29:14.079656+0000","last_peered":"2024-09-12T19:29:14.079656+0000","last_clean":"2024-09-12T19:29:14.079656+0000","last_became_active":"2024-09-12T17:36:40.909189+0000","last_became_peered":"2024-09-12T17:36:40.909189+0000","last_unstale":"2024-09-12T19:29:14.079656+0000","last_undegraded":"2024-09-12T19:29:14.079656+0000","last_fullsized":"2024-09-12T19:29:14.079656+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:32.736700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55815,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":964,"num_write":398,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.674082+0000","last_change":"2024-09-12T17:36:42.939553+0000","last_active":"2024-09-12T19:27:05.674082+0000","last_peered":"2024-09-12T19:27:05.674082+0000","last_clean":"2024-09-12T19:27:05.674082+0000","last_became_active":"2024-09-12T17:36:42.938451+0000","last_became_peered":"2024-09-12T17:36:42.938451+0000","last_unstale":"2024-09-12T19:27:05.674082+0000","last_undegraded":"2024-09-12T19:27:05.674082+0000","last_fullsized":"2024-09-12T19:27:05.674082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:33.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'109","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.052785+0000","last_change":"2024-09-12T17:36:44.950080+0000","last_active":"2024-09-12T19:29:22.052785+0000","last_peered":"2024-09-12T19:29:22.052785+0000","last_clean":"2024-09-12T19:29:22.052785+0000","last_became_active":"2024-09-12T17:36:44.949351+0000","last_became_peered":"2024-09-12T17:36:44.949351+0000","last_unstale":"2024-09-12T19:29:22.052785+0000","last_undegraded":"2024-09-12T19:29:22.052785+0000","last_fullsized":"2024-09-12T19:29:22.052785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:39.166790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":161,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'473","reported_seq":2149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181763+0000","last_change":"2024-09-12T17:36:36.903747+0000","last_active":"2024-09-12T19:27:10.181763+0000","last_peered":"2024-09-12T19:27:10.181763+0000","last_clean":"2024-09-12T19:27:10.181763+0000","last_became_active":"2024-09-12T17:36:36.902998+0000","last_became_peered":"2024-09-12T17:36:36.902998+0000","last_unstale":"2024-09-12T19:27:10.181763+0000","last_undegraded":"2024-09-12T19:27:10.181763+0000","last_fullsized":"2024-09-12T19:27:10.181763+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:30.836602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2683,"num_read_kb":2531,"num_write":585,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'327","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:39.252794+0000","last_change":"2024-09-12T17:36:34.869269+0000","last_active":"2024-09-12T19:26:39.252794+0000","last_peered":"2024-09-12T19:26:39.252794+0000","last_clean":"2024-09-12T19:26:39.252794+0000","last_became_active":"2024-09-12T17:36:34.867987+0000","last_became_peered":"2024-09-12T17:36:34.867987+0000","last_unstale":"2024-09-12T19:26:39.252794+0000","last_undegraded":"2024-09-12T19:26:39.252794+0000","last_fullsized":"2024-09-12T19:26:39.252794+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:07.281605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14033056,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":541,"num_read_kb":94353,"num_write":1195,"num_write_kb":45131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686764+0000","last_change":"2024-09-12T17:36:38.901399+0000","last_active":"2024-09-12T19:26:40.686764+0000","last_peered":"2024-09-12T19:26:40.686764+0000","last_clean":"2024-09-12T19:26:40.686764+0000","last_became_active":"2024-09-12T17:36:38.900687+0000","last_became_peered":"2024-09-12T17:36:38.900687+0000","last_unstale":"2024-09-12T19:26:40.686764+0000","last_undegraded":"2024-09-12T19:26:40.686764+0000","last_fullsized":"2024-09-12T19:26:40.686764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:39.929327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'157","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:34.443859+0000","last_change":"2024-09-12T17:36:40.905441+0000","last_active":"2024-09-12T19:27:34.443859+0000","last_peered":"2024-09-12T19:27:34.443859+0000","last_clean":"2024-09-12T19:27:34.443859+0000","last_became_active":"2024-09-12T17:36:40.904671+0000","last_became_peered":"2024-09-12T17:36:40.904671+0000","last_unstale":"2024-09-12T19:27:34.443859+0000","last_undegraded":"2024-09-12T19:27:34.443859+0000","last_fullsized":"2024-09-12T19:27:34.443859+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:48.997983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":202,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'767","reported_seq":3474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:25.060059+0000","last_change":"2024-09-12T17:36:42.930179+0000","last_active":"2024-09-12T19:29:25.060059+0000","last_peered":"2024-09-12T19:29:25.060059+0000","last_clean":"2024-09-12T19:29:25.060059+0000","last_became_active":"2024-09-12T17:36:42.929232+0000","last_became_peered":"2024-09-12T17:36:42.929232+0000","last_unstale":"2024-09-12T19:29:25.060059+0000","last_undegraded":"2024-09-12T19:29:25.060059+0000","last_fullsized":"2024-09-12T19:29:25.060059+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:00.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'132","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.338006+0000","last_change":"2024-09-12T17:36:44.946960+0000","last_active":"2024-09-12T19:26:59.338006+0000","last_peered":"2024-09-12T19:26:59.338006+0000","last_clean":"2024-09-12T19:26:59.338006+0000","last_became_active":"2024-09-12T17:36:44.945777+0000","last_became_peered":"2024-09-12T17:36:44.945777+0000","last_unstale":"2024-09-12T19:26:59.338006+0000","last_undegraded":"2024-09-12T19:26:59.338006+0000","last_fullsized":"2024-09-12T19:26:59.338006+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:22.225543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":212,"num_write":329,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'428","reported_seq":1981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.044099+0000","last_change":"2024-09-12T17:36:36.897272+0000","last_active":"2024-09-12T19:29:21.044099+0000","last_peered":"2024-09-12T19:29:21.044099+0000","last_clean":"2024-09-12T19:29:21.044099+0000","last_became_active":"2024-09-12T17:36:36.896871+0000","last_became_peered":"2024-09-12T17:36:36.896871+0000","last_unstale":"2024-09-12T19:29:21.044099+0000","last_undegraded":"2024-09-12T19:29:21.044099+0000","last_fullsized":"2024-09-12T19:29:21.044099+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:55.322767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2316,"num_read_kb":2187,"num_write":500,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'327","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.086645+0000","last_change":"2024-09-12T17:36:34.869011+0000","last_active":"2024-09-12T19:26:35.086645+0000","last_peered":"2024-09-12T19:26:35.086645+0000","last_clean":"2024-09-12T19:26:35.086645+0000","last_became_active":"2024-09-12T17:36:34.868685+0000","last_became_peered":"2024-09-12T17:36:34.868685+0000","last_unstale":"2024-09-12T19:26:35.086645+0000","last_undegraded":"2024-09-12T19:26:35.086645+0000","last_fullsized":"2024-09-12T19:26:35.086645+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:45.839499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4354196,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":512,"num_read_kb":59980,"num_write":1179,"num_write_kb":34100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.087989+0000","last_change":"2024-09-12T17:36:38.885901+0000","last_active":"2024-09-12T19:26:40.087989+0000","last_peered":"2024-09-12T19:26:40.087989+0000","last_clean":"2024-09-12T19:26:40.087989+0000","last_became_active":"2024-09-12T17:36:38.885092+0000","last_became_peered":"2024-09-12T17:36:38.885092+0000","last_unstale":"2024-09-12T19:26:40.087989+0000","last_undegraded":"2024-09-12T19:26:40.087989+0000","last_fullsized":"2024-09-12T19:26:40.087989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:14.638797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'404","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.617612+0000","last_change":"2024-09-12T17:36:40.902995+0000","last_active":"2024-09-12T19:28:15.617612+0000","last_peered":"2024-09-12T19:28:15.617612+0000","last_clean":"2024-09-12T19:28:15.617612+0000","last_became_active":"2024-09-12T17:36:40.902484+0000","last_became_peered":"2024-09-12T17:36:40.902484+0000","last_unstale":"2024-09-12T19:28:15.617612+0000","last_undegraded":"2024-09-12T19:28:15.617612+0000","last_fullsized":"2024-09-12T19:28:15.617612+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:00.010334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59659,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":629,"num_read_kb":1134,"num_write":500,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.671027+0000","last_change":"2024-09-12T17:36:42.937350+0000","last_active":"2024-09-12T19:25:30.671027+0000","last_peered":"2024-09-12T19:25:30.671027+0000","last_clean":"2024-09-12T19:25:30.671027+0000","last_became_active":"2024-09-12T17:36:42.932462+0000","last_became_peered":"2024-09-12T17:36:42.932462+0000","last_unstale":"2024-09-12T19:25:30.671027+0000","last_undegraded":"2024-09-12T19:25:30.671027+0000","last_fullsized":"2024-09-12T19:25:30.671027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:45.961114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'125","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:59.522990+0000","last_change":"2024-09-12T17:36:44.944698+0000","last_active":"2024-09-12T19:27:59.522990+0000","last_peered":"2024-09-12T19:27:59.522990+0000","last_clean":"2024-09-12T19:27:59.522990+0000","last_became_active":"2024-09-12T17:36:44.943948+0000","last_became_peered":"2024-09-12T17:36:44.943948+0000","last_unstale":"2024-09-12T19:27:59.522990+0000","last_undegraded":"2024-09-12T19:27:59.522990+0000","last_fullsized":"2024-09-12T19:27:59.522990+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:55.649115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":170,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'823","reported_seq":2518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.620849+0000","last_change":"2024-09-12T17:36:36.888995+0000","last_active":"2024-09-12T19:28:02.620849+0000","last_peered":"2024-09-12T19:28:02.620849+0000","last_clean":"2024-09-12T19:28:02.620849+0000","last_became_active":"2024-09-12T17:36:36.888747+0000","last_became_peered":"2024-09-12T17:36:36.888747+0000","last_unstale":"2024-09-12T19:28:02.620849+0000","last_undegraded":"2024-09-12T19:28:02.620849+0000","last_fullsized":"2024-09-12T19:28:02.620849+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:00.206667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3583,"num_write":1069,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'411","reported_seq":1100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.357959+0000","last_change":"2024-09-12T17:36:34.877161+0000","last_active":"2024-09-12T19:26:35.357959+0000","last_peered":"2024-09-12T19:26:35.357959+0000","last_clean":"2024-09-12T19:26:35.357959+0000","last_became_active":"2024-09-12T17:36:34.876487+0000","last_became_peered":"2024-09-12T17:36:34.876487+0000","last_unstale":"2024-09-12T19:26:35.357959+0000","last_undegraded":"2024-09-12T19:26:35.357959+0000","last_fullsized":"2024-09-12T19:26:35.357959+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:54.874115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5389541,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":764,"num_read_kb":5903,"num_write":1319,"num_write_kb":31714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.245910+0000","last_change":"2024-09-12T17:36:38.902372+0000","last_active":"2024-09-12T19:26:40.245910+0000","last_peered":"2024-09-12T19:26:40.245910+0000","last_clean":"2024-09-12T19:26:40.245910+0000","last_became_active":"2024-09-12T17:36:38.901575+0000","last_became_peered":"2024-09-12T17:36:38.901575+0000","last_unstale":"2024-09-12T19:26:40.245910+0000","last_undegraded":"2024-09-12T19:26:40.245910+0000","last_fullsized":"2024-09-12T19:26:40.245910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:49.517366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'321","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.129535+0000","last_change":"2024-09-12T17:36:40.901766+0000","last_active":"2024-09-12T19:29:21.129535+0000","last_peered":"2024-09-12T19:29:21.129535+0000","last_clean":"2024-09-12T19:29:21.129535+0000","last_became_active":"2024-09-12T17:36:40.900739+0000","last_became_peered":"2024-09-12T17:36:40.900739+0000","last_unstale":"2024-09-12T19:29:21.129535+0000","last_undegraded":"2024-09-12T19:29:21.129535+0000","last_fullsized":"2024-09-12T19:29:21.129535+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:19.813863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69459,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":540,"num_read_kb":1109,"num_write":442,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.348981+0000","last_change":"2024-09-12T17:36:42.921850+0000","last_active":"2024-09-12T19:26:00.348981+0000","last_peered":"2024-09-12T19:26:00.348981+0000","last_clean":"2024-09-12T19:26:00.348981+0000","last_became_active":"2024-09-12T17:36:42.920767+0000","last_became_peered":"2024-09-12T17:36:42.920767+0000","last_unstale":"2024-09-12T19:26:00.348981+0000","last_undegraded":"2024-09-12T19:26:00.348981+0000","last_fullsized":"2024-09-12T19:26:00.348981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:22.058824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'123","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.194923+0000","last_change":"2024-09-12T17:36:44.961031+0000","last_active":"2024-09-12T19:27:10.194923+0000","last_peered":"2024-09-12T19:27:10.194923+0000","last_clean":"2024-09-12T19:27:10.194923+0000","last_became_active":"2024-09-12T17:36:44.959535+0000","last_became_peered":"2024-09-12T17:36:44.959535+0000","last_unstale":"2024-09-12T19:27:10.194923+0000","last_undegraded":"2024-09-12T19:27:10.194923+0000","last_fullsized":"2024-09-12T19:27:10.194923+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:18.916773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":231,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'446","reported_seq":1831,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.364011+0000","last_change":"2024-09-12T17:36:36.895868+0000","last_active":"2024-09-12T19:28:00.364011+0000","last_peered":"2024-09-12T19:28:00.364011+0000","last_clean":"2024-09-12T19:28:00.364011+0000","last_became_active":"2024-09-12T17:36:36.895126+0000","last_became_peered":"2024-09-12T17:36:36.895126+0000","last_unstale":"2024-09-12T19:28:00.364011+0000","last_undegraded":"2024-09-12T19:28:00.364011+0000","last_fullsized":"2024-09-12T19:28:00.364011+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:38.358463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2194,"num_read_kb":2018,"num_write":546,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'285","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261243+0000","last_change":"2024-09-12T17:36:34.879150+0000","last_active":"2024-09-12T19:27:05.261243+0000","last_peered":"2024-09-12T19:27:05.261243+0000","last_clean":"2024-09-12T19:27:05.261243+0000","last_became_active":"2024-09-12T17:36:34.878381+0000","last_became_peered":"2024-09-12T17:36:34.878381+0000","last_unstale":"2024-09-12T19:27:05.261243+0000","last_undegraded":"2024-09-12T19:27:05.261243+0000","last_fullsized":"2024-09-12T19:27:05.261243+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:53.395319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4200358,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":497,"num_read_kb":62026,"num_write":1000,"num_write_kb":23225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.071542+0000","last_change":"2024-09-12T17:36:38.888449+0000","last_active":"2024-09-12T19:25:25.071542+0000","last_peered":"2024-09-12T19:25:25.071542+0000","last_clean":"2024-09-12T19:25:25.071542+0000","last_became_active":"2024-09-12T17:36:38.887476+0000","last_became_peered":"2024-09-12T17:36:38.887476+0000","last_unstale":"2024-09-12T19:25:25.071542+0000","last_undegraded":"2024-09-12T19:25:25.071542+0000","last_fullsized":"2024-09-12T19:25:25.071542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:59.359839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'241","reported_seq":823,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:14.079459+0000","last_change":"2024-09-12T17:36:40.904837+0000","last_active":"2024-09-12T19:29:14.079459+0000","last_peered":"2024-09-12T19:29:14.079459+0000","last_clean":"2024-09-12T19:29:14.079459+0000","last_became_active":"2024-09-12T17:36:40.904126+0000","last_became_peered":"2024-09-12T17:36:40.904126+0000","last_unstale":"2024-09-12T19:29:14.079459+0000","last_undegraded":"2024-09-12T19:29:14.079459+0000","last_fullsized":"2024-09-12T19:29:14.079459+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:14.815589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57238,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":853,"num_write":320,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360790+0000","last_change":"2024-09-12T17:36:42.935140+0000","last_active":"2024-09-12T19:26:45.360790+0000","last_peered":"2024-09-12T19:26:45.360790+0000","last_clean":"2024-09-12T19:26:45.360790+0000","last_became_active":"2024-09-12T17:36:42.934140+0000","last_became_peered":"2024-09-12T17:36:42.934140+0000","last_unstale":"2024-09-12T19:26:45.360790+0000","last_undegraded":"2024-09-12T19:26:45.360790+0000","last_fullsized":"2024-09-12T19:26:45.360790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:50.636896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'159","reported_seq":1650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.254322+0000","last_change":"2024-09-12T17:36:44.966081+0000","last_active":"2024-09-12T19:27:55.254322+0000","last_peered":"2024-09-12T19:27:55.254322+0000","last_clean":"2024-09-12T19:27:55.254322+0000","last_became_active":"2024-09-12T17:36:44.965427+0000","last_became_peered":"2024-09-12T17:36:44.965427+0000","last_unstale":"2024-09-12T19:27:55.254322+0000","last_undegraded":"2024-09-12T19:27:55.254322+0000","last_fullsized":"2024-09-12T19:27:55.254322+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:20.397523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1232,"num_read_kb":1221,"num_write":362,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'993","reported_seq":2719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.539915+0000","last_change":"2024-09-12T17:36:36.914615+0000","last_active":"2024-09-12T19:28:02.539915+0000","last_peered":"2024-09-12T19:28:02.539915+0000","last_clean":"2024-09-12T19:28:02.539915+0000","last_became_active":"2024-09-12T17:36:36.914315+0000","last_became_peered":"2024-09-12T17:36:36.914315+0000","last_unstale":"2024-09-12T19:28:02.539915+0000","last_undegraded":"2024-09-12T19:28:02.539915+0000","last_fullsized":"2024-09-12T19:28:02.539915+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":900,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:24.570940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4811,"num_read_kb":4330,"num_write":1385,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'279","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.260089+0000","last_change":"2024-09-12T17:36:34.873212+0000","last_active":"2024-09-12T19:27:00.260089+0000","last_peered":"2024-09-12T19:27:00.260089+0000","last_clean":"2024-09-12T19:27:00.260089+0000","last_became_active":"2024-09-12T17:36:34.871889+0000","last_became_peered":"2024-09-12T17:36:34.871889+0000","last_unstale":"2024-09-12T19:27:00.260089+0000","last_undegraded":"2024-09-12T19:27:00.260089+0000","last_fullsized":"2024-09-12T19:27:00.260089+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:28.254769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5234730,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":414,"num_read_kb":13875,"num_write":1077,"num_write_kb":46739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:45.674374+0000","last_change":"2024-09-12T17:36:38.882816+0000","last_active":"2024-09-12T19:25:45.674374+0000","last_peered":"2024-09-12T19:25:45.674374+0000","last_clean":"2024-09-12T19:25:45.674374+0000","last_became_active":"2024-09-12T17:36:38.882018+0000","last_became_peered":"2024-09-12T17:36:38.882018+0000","last_unstale":"2024-09-12T19:25:45.674374+0000","last_undegraded":"2024-09-12T19:25:45.674374+0000","last_fullsized":"2024-09-12T19:25:45.674374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:50.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'322","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.393445+0000","last_change":"2024-09-12T17:36:40.909328+0000","last_active":"2024-09-12T19:29:10.393445+0000","last_peered":"2024-09-12T19:29:10.393445+0000","last_clean":"2024-09-12T19:29:10.393445+0000","last_became_active":"2024-09-12T17:36:40.908611+0000","last_became_peered":"2024-09-12T17:36:40.908611+0000","last_unstale":"2024-09-12T19:29:10.393445+0000","last_undegraded":"2024-09-12T19:29:10.393445+0000","last_fullsized":"2024-09-12T19:29:10.393445+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:15.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67068,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":547,"num_read_kb":1063,"num_write":434,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.687795+0000","last_change":"2024-09-12T17:36:42.936919+0000","last_active":"2024-09-12T19:26:45.687795+0000","last_peered":"2024-09-12T19:26:45.687795+0000","last_clean":"2024-09-12T19:26:45.687795+0000","last_became_active":"2024-09-12T17:36:42.933510+0000","last_became_peered":"2024-09-12T17:36:42.933510+0000","last_unstale":"2024-09-12T19:26:45.687795+0000","last_undegraded":"2024-09-12T19:26:45.687795+0000","last_fullsized":"2024-09-12T19:26:45.687795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:11.996658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'126","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.020550+0000","last_change":"2024-09-12T17:36:44.961303+0000","last_active":"2024-09-12T19:29:21.020550+0000","last_peered":"2024-09-12T19:29:21.020550+0000","last_clean":"2024-09-12T19:29:21.020550+0000","last_became_active":"2024-09-12T17:36:44.960641+0000","last_became_peered":"2024-09-12T17:36:44.960641+0000","last_unstale":"2024-09-12T19:29:21.020550+0000","last_undegraded":"2024-09-12T19:29:21.020550+0000","last_fullsized":"2024-09-12T19:29:21.020550+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:20.007631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":181,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'930","reported_seq":2728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.366097+0000","last_change":"2024-09-12T17:36:36.901682+0000","last_active":"2024-09-12T19:28:00.366097+0000","last_peered":"2024-09-12T19:28:00.366097+0000","last_clean":"2024-09-12T19:28:00.366097+0000","last_became_active":"2024-09-12T17:36:36.901046+0000","last_became_peered":"2024-09-12T17:36:36.901046+0000","last_unstale":"2024-09-12T19:28:00.366097+0000","last_undegraded":"2024-09-12T19:28:00.366097+0000","last_fullsized":"2024-09-12T19:28:00.366097+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:29.856231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4712,"num_read_kb":4247,"num_write":1250,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'348","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:38.632279+0000","last_change":"2024-09-12T17:36:34.884343+0000","last_active":"2024-09-12T19:27:38.632279+0000","last_peered":"2024-09-12T19:27:38.632279+0000","last_clean":"2024-09-12T19:27:38.632279+0000","last_became_active":"2024-09-12T17:36:34.884112+0000","last_became_peered":"2024-09-12T17:36:34.884112+0000","last_unstale":"2024-09-12T19:27:38.632279+0000","last_undegraded":"2024-09-12T19:27:38.632279+0000","last_fullsized":"2024-09-12T19:27:38.632279+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:05.952592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4519802,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":613,"num_read_kb":11450,"num_write":1219,"num_write_kb":27380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'653","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675264+0000","last_change":"2024-09-12T17:36:36.917185+0000","last_active":"2024-09-12T19:27:10.675264+0000","last_peered":"2024-09-12T19:27:10.675264+0000","last_clean":"2024-09-12T19:27:10.675264+0000","last_became_active":"2024-09-12T17:36:36.916477+0000","last_became_peered":"2024-09-12T17:36:36.916477+0000","last_unstale":"2024-09-12T19:27:10.675264+0000","last_undegraded":"2024-09-12T19:27:10.675264+0000","last_fullsized":"2024-09-12T19:27:10.675264+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.646760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3261,"num_read_kb":2946,"num_write":856,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'297","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.672783+0000","last_change":"2024-09-12T17:36:34.862778+0000","last_active":"2024-09-12T19:27:00.672783+0000","last_peered":"2024-09-12T19:27:00.672783+0000","last_clean":"2024-09-12T19:27:00.672783+0000","last_became_active":"2024-09-12T17:36:34.862008+0000","last_became_peered":"2024-09-12T17:36:34.862008+0000","last_unstale":"2024-09-12T19:27:00.672783+0000","last_undegraded":"2024-09-12T19:27:00.672783+0000","last_fullsized":"2024-09-12T19:27:00.672783+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:34.713584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13207013,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":447,"num_read_kb":45708,"num_write":1085,"num_write_kb":41141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'442","reported_seq":2006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366473+0000","last_change":"2024-09-12T17:36:36.876715+0000","last_active":"2024-09-12T19:27:10.366473+0000","last_peered":"2024-09-12T19:27:10.366473+0000","last_clean":"2024-09-12T19:27:10.366473+0000","last_became_active":"2024-09-12T17:36:36.875947+0000","last_became_peered":"2024-09-12T17:36:36.875947+0000","last_unstale":"2024-09-12T19:27:10.366473+0000","last_undegraded":"2024-09-12T19:27:10.366473+0000","last_fullsized":"2024-09-12T19:27:10.366473+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:53.224464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2143,"num_write":507,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'281","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.363957+0000","last_change":"2024-09-12T17:36:34.892965+0000","last_active":"2024-09-12T19:27:00.363957+0000","last_peered":"2024-09-12T19:27:00.363957+0000","last_clean":"2024-09-12T19:27:00.363957+0000","last_became_active":"2024-09-12T17:36:34.892664+0000","last_became_peered":"2024-09-12T17:36:34.892664+0000","last_unstale":"2024-09-12T19:27:00.363957+0000","last_undegraded":"2024-09-12T19:27:00.363957+0000","last_fullsized":"2024-09-12T19:27:00.363957+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:17.794367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16579603,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":461,"num_read_kb":15114,"num_write":1027,"num_write_kb":33687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'449","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.620587+0000","last_change":"2024-09-12T17:36:36.887427+0000","last_active":"2024-09-12T19:28:02.620587+0000","last_peered":"2024-09-12T19:28:02.620587+0000","last_clean":"2024-09-12T19:28:02.620587+0000","last_became_active":"2024-09-12T17:36:36.886646+0000","last_became_peered":"2024-09-12T17:36:36.886646+0000","last_unstale":"2024-09-12T19:28:02.620587+0000","last_undegraded":"2024-09-12T19:28:02.620587+0000","last_fullsized":"2024-09-12T19:28:02.620587+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:16.527812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2431,"num_read_kb":2290,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'254","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.267092+0000","last_change":"2024-09-12T17:36:34.878872+0000","last_active":"2024-09-12T19:27:30.267092+0000","last_peered":"2024-09-12T19:27:30.267092+0000","last_clean":"2024-09-12T19:27:30.267092+0000","last_became_active":"2024-09-12T17:36:34.875514+0000","last_became_peered":"2024-09-12T17:36:34.875514+0000","last_unstale":"2024-09-12T19:27:30.267092+0000","last_undegraded":"2024-09-12T19:27:30.267092+0000","last_fullsized":"2024-09-12T19:27:30.267092+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:00.883687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3684293,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":355,"num_read_kb":12722,"num_write":873,"num_write_kb":21079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'472","reported_seq":2079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:35.268283+0000","last_change":"2024-09-12T17:36:36.896549+0000","last_active":"2024-09-12T19:27:35.268283+0000","last_peered":"2024-09-12T19:27:35.268283+0000","last_clean":"2024-09-12T19:27:35.268283+0000","last_became_active":"2024-09-12T17:36:36.895580+0000","last_became_peered":"2024-09-12T17:36:36.895580+0000","last_unstale":"2024-09-12T19:27:35.268283+0000","last_undegraded":"2024-09-12T19:27:35.268283+0000","last_fullsized":"2024-09-12T19:27:35.268283+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:38.232699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2410,"num_read_kb":2268,"num_write":522,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'311","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:04.050868+0000","last_change":"2024-09-12T17:36:34.876065+0000","last_active":"2024-09-12T19:27:04.050868+0000","last_peered":"2024-09-12T19:27:04.050868+0000","last_clean":"2024-09-12T19:27:04.050868+0000","last_became_active":"2024-09-12T17:36:34.875282+0000","last_became_peered":"2024-09-12T17:36:34.875282+0000","last_unstale":"2024-09-12T19:27:04.050868+0000","last_undegraded":"2024-09-12T19:27:04.050868+0000","last_fullsized":"2024-09-12T19:27:04.050868+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:40.356381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3778182,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":460,"num_read_kb":16782,"num_write":1005,"num_write_kb":43648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'867","reported_seq":2674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.119778+0000","last_change":"2024-09-12T17:36:36.880245+0000","last_active":"2024-09-12T19:28:32.119778+0000","last_peered":"2024-09-12T19:28:32.119778+0000","last_clean":"2024-09-12T19:28:32.119778+0000","last_became_active":"2024-09-12T17:36:36.879875+0000","last_became_peered":"2024-09-12T17:36:36.879875+0000","last_unstale":"2024-09-12T19:28:32.119778+0000","last_undegraded":"2024-09-12T19:28:32.119778+0000","last_fullsized":"2024-09-12T19:28:32.119778+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:34.212835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4378,"num_read_kb":3985,"num_write":1124,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'257","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:10.794574+0000","last_change":"2024-09-12T17:36:34.882320+0000","last_active":"2024-09-12T19:29:10.794574+0000","last_peered":"2024-09-12T19:29:10.794574+0000","last_clean":"2024-09-12T19:29:10.794574+0000","last_became_active":"2024-09-12T17:36:34.880893+0000","last_became_peered":"2024-09-12T17:36:34.880893+0000","last_unstale":"2024-09-12T19:29:10.794574+0000","last_undegraded":"2024-09-12T19:29:10.794574+0000","last_fullsized":"2024-09-12T19:29:10.794574+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:46.683258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20722098,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":395,"num_read_kb":34770,"num_write":991,"num_write_kb":43573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'1177","reported_seq":2763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:04.050596+0000","last_change":"2024-09-12T17:36:36.898718+0000","last_active":"2024-09-12T19:27:04.050596+0000","last_peered":"2024-09-12T19:27:04.050596+0000","last_clean":"2024-09-12T19:27:04.050596+0000","last_became_active":"2024-09-12T17:36:36.897985+0000","last_became_peered":"2024-09-12T17:36:36.897985+0000","last_unstale":"2024-09-12T19:27:04.050596+0000","last_undegraded":"2024-09-12T19:27:04.050596+0000","last_fullsized":"2024-09-12T19:27:04.050596+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:33.241292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5405,"num_read_kb":4772,"num_write":1628,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'320","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:16.332232+0000","last_change":"2024-09-12T17:36:34.877091+0000","last_active":"2024-09-12T19:29:16.332232+0000","last_peered":"2024-09-12T19:29:16.332232+0000","last_clean":"2024-09-12T19:29:16.332232+0000","last_became_active":"2024-09-12T17:36:34.876834+0000","last_became_peered":"2024-09-12T17:36:34.876834+0000","last_unstale":"2024-09-12T19:29:16.332232+0000","last_undegraded":"2024-09-12T19:29:16.332232+0000","last_fullsized":"2024-09-12T19:29:16.332232+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:36.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8440145,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":522,"num_read_kb":4635,"num_write":1163,"num_write_kb":22932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'773","reported_seq":2362,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.058729+0000","last_change":"2024-09-12T17:36:36.901626+0000","last_active":"2024-09-12T19:29:21.058729+0000","last_peered":"2024-09-12T19:29:21.058729+0000","last_clean":"2024-09-12T19:29:21.058729+0000","last_became_active":"2024-09-12T17:36:36.901293+0000","last_became_peered":"2024-09-12T17:36:36.901293+0000","last_unstale":"2024-09-12T19:29:21.058729+0000","last_undegraded":"2024-09-12T19:29:21.058729+0000","last_fullsized":"2024-09-12T19:29:21.058729+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:48.170779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3323,"num_write":979,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'281","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261280+0000","last_change":"2024-09-12T17:36:34.875326+0000","last_active":"2024-09-12T19:27:05.261280+0000","last_peered":"2024-09-12T19:27:05.261280+0000","last_clean":"2024-09-12T19:27:05.261280+0000","last_became_active":"2024-09-12T17:36:34.872999+0000","last_became_peered":"2024-09-12T17:36:34.872999+0000","last_unstale":"2024-09-12T19:27:05.261280+0000","last_undegraded":"2024-09-12T19:27:05.261280+0000","last_fullsized":"2024-09-12T19:27:05.261280+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:47.461128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4879593,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":608,"num_read_kb":7832,"num_write":1068,"num_write_kb":31819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'779","reported_seq":2247,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.049150+0000","last_change":"2024-09-12T17:36:36.904735+0000","last_active":"2024-09-12T19:29:21.049150+0000","last_peered":"2024-09-12T19:29:21.049150+0000","last_clean":"2024-09-12T19:29:21.049150+0000","last_became_active":"2024-09-12T17:36:36.903948+0000","last_became_peered":"2024-09-12T17:36:36.903948+0000","last_unstale":"2024-09-12T19:29:21.049150+0000","last_undegraded":"2024-09-12T19:29:21.049150+0000","last_fullsized":"2024-09-12T19:29:21.049150+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:06.384871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3650,"num_read_kb":3275,"num_write":1024,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'345","reported_seq":1104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:07.685342+0000","last_change":"2024-09-12T17:36:34.891921+0000","last_active":"2024-09-12T19:26:07.685342+0000","last_peered":"2024-09-12T19:26:07.685342+0000","last_clean":"2024-09-12T19:26:07.685342+0000","last_became_active":"2024-09-12T17:36:34.891638+0000","last_became_peered":"2024-09-12T17:36:34.891638+0000","last_unstale":"2024-09-12T19:26:07.685342+0000","last_undegraded":"2024-09-12T19:26:07.685342+0000","last_fullsized":"2024-09-12T19:26:07.685342+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:27.837483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765041,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":763,"num_read_kb":23553,"num_write":1256,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'1230","reported_seq":2980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.593064+0000","last_change":"2024-09-12T17:36:36.906715+0000","last_active":"2024-09-12T19:26:20.593064+0000","last_peered":"2024-09-12T19:26:20.593064+0000","last_clean":"2024-09-12T19:26:20.593064+0000","last_became_active":"2024-09-12T17:36:36.906463+0000","last_became_peered":"2024-09-12T17:36:36.906463+0000","last_unstale":"2024-09-12T19:26:20.593064+0000","last_undegraded":"2024-09-12T19:26:20.593064+0000","last_fullsized":"2024-09-12T19:26:20.593064+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:50.870597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5684,"num_read_kb":5045,"num_write":1688,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'262","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.257503+0000","last_change":"2024-09-12T17:36:34.874816+0000","last_active":"2024-09-12T19:26:50.257503+0000","last_peered":"2024-09-12T19:26:50.257503+0000","last_clean":"2024-09-12T19:26:50.257503+0000","last_became_active":"2024-09-12T17:36:34.873189+0000","last_became_peered":"2024-09-12T17:36:34.873189+0000","last_unstale":"2024-09-12T19:26:50.257503+0000","last_undegraded":"2024-09-12T19:26:50.257503+0000","last_fullsized":"2024-09-12T19:26:50.257503+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:16.748289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11129714,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":374,"num_read_kb":39048,"num_write":883,"num_write_kb":38605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'997","reported_seq":2702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.116025+0000","last_change":"2024-09-12T17:36:36.876501+0000","last_active":"2024-09-12T19:28:32.116025+0000","last_peered":"2024-09-12T19:28:32.116025+0000","last_clean":"2024-09-12T19:28:32.116025+0000","last_became_active":"2024-09-12T17:36:36.875791+0000","last_became_peered":"2024-09-12T17:36:36.875791+0000","last_unstale":"2024-09-12T19:28:32.116025+0000","last_undegraded":"2024-09-12T19:28:32.116025+0000","last_fullsized":"2024-09-12T19:28:32.116025+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:20.751412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4962,"num_read_kb":4419,"num_write":1465,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'194","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.090313+0000","last_change":"2024-09-12T17:36:34.867040+0000","last_active":"2024-09-12T19:26:50.090313+0000","last_peered":"2024-09-12T19:26:50.090313+0000","last_clean":"2024-09-12T19:26:50.090313+0000","last_became_active":"2024-09-12T17:36:34.866719+0000","last_became_peered":"2024-09-12T17:36:34.866719+0000","last_unstale":"2024-09-12T19:26:50.090313+0000","last_undegraded":"2024-09-12T19:26:50.090313+0000","last_fullsized":"2024-09-12T19:26:50.090313+0000","mapping_epoch":24,"log_start":"265'100","ondisk_log_start":"265'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:38.881915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5352417,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":331,"num_read_kb":13747,"num_write":730,"num_write_kb":14866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'511","reported_seq":2129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.091439+0000","last_change":"2024-09-12T17:36:36.914630+0000","last_active":"2024-09-12T19:26:55.091439+0000","last_peered":"2024-09-12T19:26:55.091439+0000","last_clean":"2024-09-12T19:26:55.091439+0000","last_became_active":"2024-09-12T17:36:36.914327+0000","last_became_peered":"2024-09-12T17:36:36.914327+0000","last_unstale":"2024-09-12T19:26:55.091439+0000","last_undegraded":"2024-09-12T19:26:55.091439+0000","last_fullsized":"2024-09-12T19:26:55.091439+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:59.445859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2629,"num_read_kb":2439,"num_write":603,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'238","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.688932+0000","last_change":"2024-09-12T17:36:34.865386+0000","last_active":"2024-09-12T19:26:50.688932+0000","last_peered":"2024-09-12T19:26:50.688932+0000","last_clean":"2024-09-12T19:26:50.688932+0000","last_became_active":"2024-09-12T17:36:34.864682+0000","last_became_peered":"2024-09-12T17:36:34.864682+0000","last_unstale":"2024-09-12T19:26:50.688932+0000","last_undegraded":"2024-09-12T19:26:50.688932+0000","last_fullsized":"2024-09-12T19:26:50.688932+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:44.124063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4211819,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":324,"num_read_kb":10447,"num_write":844,"num_write_kb":22906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'843","reported_seq":2465,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.325029+0000","last_change":"2024-09-12T17:36:36.886698+0000","last_active":"2024-09-12T19:26:59.325029+0000","last_peered":"2024-09-12T19:26:59.325029+0000","last_clean":"2024-09-12T19:26:59.325029+0000","last_became_active":"2024-09-12T17:36:36.885956+0000","last_became_peered":"2024-09-12T17:36:36.885956+0000","last_unstale":"2024-09-12T19:26:59.325029+0000","last_undegraded":"2024-09-12T19:26:59.325029+0000","last_fullsized":"2024-09-12T19:26:59.325029+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:14.336258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3814,"num_read_kb":3459,"num_write":1078,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'289","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.599808+0000","last_change":"2024-09-12T17:36:34.867183+0000","last_active":"2024-09-12T19:26:50.599808+0000","last_peered":"2024-09-12T19:26:50.599808+0000","last_clean":"2024-09-12T19:26:50.599808+0000","last_became_active":"2024-09-12T17:36:34.865344+0000","last_became_peered":"2024-09-12T17:36:34.865344+0000","last_unstale":"2024-09-12T19:26:50.599808+0000","last_undegraded":"2024-09-12T19:26:50.599808+0000","last_fullsized":"2024-09-12T19:26:50.599808+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:57.377914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13665091,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":485,"num_read_kb":55805,"num_write":1120,"num_write_kb":26331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'722","reported_seq":2134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671563+0000","last_change":"2024-09-12T17:36:36.916852+0000","last_active":"2024-09-12T19:26:55.671563+0000","last_peered":"2024-09-12T19:26:55.671563+0000","last_clean":"2024-09-12T19:26:55.671563+0000","last_became_active":"2024-09-12T17:36:36.916289+0000","last_became_peered":"2024-09-12T17:36:36.916289+0000","last_unstale":"2024-09-12T19:26:55.671563+0000","last_undegraded":"2024-09-12T19:26:55.671563+0000","last_fullsized":"2024-09-12T19:26:55.671563+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:24.873023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3361,"num_read_kb":3032,"num_write":954,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'296","reported_seq":1182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368897+0000","last_change":"2024-09-12T17:36:34.876882+0000","last_active":"2024-09-12T19:27:20.368897+0000","last_peered":"2024-09-12T19:27:20.368897+0000","last_clean":"2024-09-12T19:27:20.368897+0000","last_became_active":"2024-09-12T17:36:34.875748+0000","last_became_peered":"2024-09-12T17:36:34.875748+0000","last_unstale":"2024-09-12T19:27:20.368897+0000","last_undegraded":"2024-09-12T19:27:20.368897+0000","last_fullsized":"2024-09-12T19:27:20.368897+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:38.898125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14247268,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":869,"num_read_kb":75770,"num_write":949,"num_write_kb":38932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'575","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.115291+0000","last_change":"2024-09-12T17:36:36.904688+0000","last_active":"2024-09-12T19:28:32.115291+0000","last_peered":"2024-09-12T19:28:32.115291+0000","last_clean":"2024-09-12T19:28:32.115291+0000","last_became_active":"2024-09-12T17:36:36.902941+0000","last_became_peered":"2024-09-12T17:36:36.902941+0000","last_unstale":"2024-09-12T19:28:32.115291+0000","last_undegraded":"2024-09-12T19:28:32.115291+0000","last_fullsized":"2024-09-12T19:28:32.115291+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:02.556913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2851,"num_read_kb":2607,"num_write":694,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'309","reported_seq":987,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.925526+0000","last_change":"2024-09-12T17:36:34.873753+0000","last_active":"2024-09-12T19:26:55.925526+0000","last_peered":"2024-09-12T19:26:55.925526+0000","last_clean":"2024-09-12T19:26:55.925526+0000","last_became_active":"2024-09-12T17:36:34.868083+0000","last_became_peered":"2024-09-12T17:36:34.868083+0000","last_unstale":"2024-09-12T19:26:55.925526+0000","last_undegraded":"2024-09-12T19:26:55.925526+0000","last_fullsized":"2024-09-12T19:26:55.925526+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:12.169519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13117121,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":486,"num_read_kb":53045,"num_write":1152,"num_write_kb":26068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'576","reported_seq":2515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:53.296831+0000","last_change":"2024-09-12T17:36:36.891765+0000","last_active":"2024-09-12T19:26:53.296831+0000","last_peered":"2024-09-12T19:26:53.296831+0000","last_clean":"2024-09-12T19:26:53.296831+0000","last_became_active":"2024-09-12T17:36:36.891412+0000","last_became_peered":"2024-09-12T17:36:36.891412+0000","last_unstale":"2024-09-12T19:26:53.296831+0000","last_undegraded":"2024-09-12T19:26:53.296831+0000","last_fullsized":"2024-09-12T19:26:53.296831+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:43.215780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3296,"num_read_kb":3095,"num_write":679,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'325","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.352773+0000","last_change":"2024-09-12T17:36:34.872524+0000","last_active":"2024-09-12T19:26:15.352773+0000","last_peered":"2024-09-12T19:26:15.352773+0000","last_clean":"2024-09-12T19:26:15.352773+0000","last_became_active":"2024-09-12T17:36:34.872242+0000","last_became_peered":"2024-09-12T17:36:34.872242+0000","last_unstale":"2024-09-12T19:26:15.352773+0000","last_undegraded":"2024-09-12T19:26:15.352773+0000","last_fullsized":"2024-09-12T19:26:15.352773+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:13.591648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7342728,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":466,"num_read_kb":8809,"num_write":1123,"num_write_kb":19313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'298","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.352448+0000","last_change":"2024-09-12T17:36:34.862643+0000","last_active":"2024-09-12T19:26:15.352448+0000","last_peered":"2024-09-12T19:26:15.352448+0000","last_clean":"2024-09-12T19:26:15.352448+0000","last_became_active":"2024-09-12T17:36:34.861821+0000","last_became_peered":"2024-09-12T17:36:34.861821+0000","last_unstale":"2024-09-12T19:26:15.352448+0000","last_undegraded":"2024-09-12T19:26:15.352448+0000","last_fullsized":"2024-09-12T19:26:15.352448+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.821144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11196651,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":490,"num_read_kb":100665,"num_write":1010,"num_write_kb":41422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'568","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.624055+0000","last_change":"2024-09-12T17:36:36.912672+0000","last_active":"2024-09-12T19:28:02.624055+0000","last_peered":"2024-09-12T19:28:02.624055+0000","last_clean":"2024-09-12T19:28:02.624055+0000","last_became_active":"2024-09-12T17:36:36.911855+0000","last_became_peered":"2024-09-12T17:36:36.911855+0000","last_unstale":"2024-09-12T19:28:02.624055+0000","last_undegraded":"2024-09-12T19:28:02.624055+0000","last_fullsized":"2024-09-12T19:28:02.624055+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:51.023621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2849,"num_read_kb":2620,"num_write":728,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'271","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.249382+0000","last_change":"2024-09-12T17:36:34.881995+0000","last_active":"2024-09-12T19:26:15.249382+0000","last_peered":"2024-09-12T19:26:15.249382+0000","last_clean":"2024-09-12T19:26:15.249382+0000","last_became_active":"2024-09-12T17:36:34.881262+0000","last_became_peered":"2024-09-12T17:36:34.881262+0000","last_unstale":"2024-09-12T19:26:15.249382+0000","last_undegraded":"2024-09-12T19:26:15.249382+0000","last_fullsized":"2024-09-12T19:26:15.249382+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:56.865811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11520182,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":413,"num_read_kb":5153,"num_write":968,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'505","reported_seq":2109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:49.753418+0000","last_change":"2024-09-12T17:36:36.902225+0000","last_active":"2024-09-12T19:25:49.753418+0000","last_peered":"2024-09-12T19:25:49.753418+0000","last_clean":"2024-09-12T19:25:49.753418+0000","last_became_active":"2024-09-12T17:36:36.901857+0000","last_became_peered":"2024-09-12T17:36:36.901857+0000","last_unstale":"2024-09-12T19:25:49.753418+0000","last_undegraded":"2024-09-12T19:25:49.753418+0000","last_fullsized":"2024-09-12T19:25:49.753418+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:17.433881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2642,"num_read_kb":2459,"num_write":621,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5957,"num_read_kb":4161,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16299,"num_read_kb":15966,"num_write":16741,"num_write_kb":4895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1571,"ondisk_log_size":1571,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":722,"ondisk_log_size":722,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1913607,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":20557,"num_read_kb":36393,"num_write":17323,"num_write_kb":12410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":2788680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1939,"ondisk_log_size":1939,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194467,"num_write":55293,"num_write_kb":18855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3723,"ondisk_log_size":3723,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":519850088,"num_objects":4468,"num_object_clones":0,"num_object_copies":8936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4468,"num_whiteouts":0,"num_read":32213,"num_read_kb":1890942,"num_write":67741,"num_write_kb":2051812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1072496640,"data_stored":1039700176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4377,"ondisk_log_size":4377,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":73036616,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":143,"num_read_kb":193786,"num_write":158,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73036616,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":139,"num_read_kb":184511,"num_write":158,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146079744,"data_stored":146073232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510808,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370948,"kb_used_data":151028,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94000892,"statfs":{"total":96636764160,"available":96256913408,"internally_reserved":0,"allocated":154652672,"data_stored":150487234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510805,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446784,"kb_used_data":221232,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93925056,"statfs":{"total":96636764160,"available":96179257344,"internally_reserved":0,"allocated":226541568,"data_stored":220467625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510809,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310544,"kb_used_data":139200,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94061296,"statfs":{"total":96636764160,"available":96318767104,"internally_reserved":0,"allocated":142540800,"data_stored":137549121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510805,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397560,"kb_used_data":191464,"kb_used_omap":1,"kb_used_meta":206078,"kb_avail":93974280,"statfs":{"total":96636764160,"available":96229662720,"internally_reserved":0,"allocated":196059136,"data_stored":189525965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":211024327},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510808,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279000,"kb_used_data":179784,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94092840,"statfs":{"total":96636764160,"available":96351068160,"internally_reserved":0,"allocated":184098816,"data_stored":177830188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510805,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":386308,"kb_used_data":124660,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93985532,"statfs":{"total":96636764160,"available":96241184768,"internally_reserved":0,"allocated":127651840,"data_stored":122482092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510806,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274572,"kb_used_data":180988,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94097268,"statfs":{"total":96636764160,"available":96355602432,"internally_reserved":0,"allocated":185331712,"data_stored":178220707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543510,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262300,"kb_used_data":177036,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94109540,"statfs":{"total":96636764160,"available":96368168960,"internally_reserved":0,"allocated":181284864,"data_stored":176165638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":154353664,"data_stored":148832606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102948864,"data_stored":99377080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":153522176,"data_stored":148783469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159535104,"data_stored":154580672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":113229824,"data_stored":109814101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":158314496,"data_stored":153836991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":132567040,"data_stored":129039281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98025472,"data_stored":95435976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":475982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":480024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":134977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":265497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":392629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":386072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":346573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":306926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11071488,"data_stored":11070123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15265792,"data_stored":15264427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29462528,"data_stored":29460637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10022912,"data_stored":10021547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12644352,"data_stored":12643276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":48275456,"data_stored":48274641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":19460096,"data_stored":19458731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23171072,"data_stored":23169181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:29:44.471 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T19:29:44.811 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:29:44.811 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":265,"fsid":"140363d0-879c-4957-b68a-2ee681f3fbda","created":"2024-09-12T17:36:01.889308+0000","modified":"2024-09-12T18:25:53.573031+0000","last_up_change":"2024-09-12T17:36:14.691362+0000","last_in_change":"2024-09-12T17:36:04.579304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:36:14.750254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:36:20.516840+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:36:33.653693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:36:35.182660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:36:36.978212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:36:39.214259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:36:40.914907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:36:43.058995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T17:52:38.658194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T17:58:38.971921+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T17:58:45.610295+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T18:25:51.554646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"265","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a9c01c8-3996-45b9-9328-cc191a45b1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6801","nonce":642959985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6803","nonce":642959985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6807","nonce":642959985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":642959985},{"type":"v1","addr":"172.21.15.97:6805","nonce":642959985}]},"public_addr":"172.21.15.97:6801/642959985","cluster_addr":"172.21.15.97:6803/642959985","heartbeat_back_addr":"172.21.15.97:6807/642959985","heartbeat_front_addr":"172.21.15.97:6805/642959985","state":["exists","up"]},{"osd":1,"uuid":"2f81d0ad-5929-4ee1-876d-08485e1aa27f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6809","nonce":1696697607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6811","nonce":1696697607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6815","nonce":1696697607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1696697607},{"type":"v1","addr":"172.21.15.97:6813","nonce":1696697607}]},"public_addr":"172.21.15.97:6809/1696697607","cluster_addr":"172.21.15.97:6811/1696697607","heartbeat_back_addr":"172.21.15.97:6815/1696697607","heartbeat_front_addr":"172.21.15.97:6813/1696697607","state":["exists","up"]},{"osd":2,"uuid":"85086976-50ca-4160-a530-d565fb79d0a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6825","nonce":193866730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6827","nonce":193866730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6831","nonce":193866730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":193866730},{"type":"v1","addr":"172.21.15.97:6829","nonce":193866730}]},"public_addr":"172.21.15.97:6825/193866730","cluster_addr":"172.21.15.97:6827/193866730","heartbeat_back_addr":"172.21.15.97:6831/193866730","heartbeat_front_addr":"172.21.15.97:6829/193866730","state":["exists","up"]},{"osd":3,"uuid":"dcf75ff5-baf8-426d-a617-76a575141b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6817","nonce":3061077368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6819","nonce":3061077368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6823","nonce":3061077368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":3061077368},{"type":"v1","addr":"172.21.15.97:6821","nonce":3061077368}]},"public_addr":"172.21.15.97:6817/3061077368","cluster_addr":"172.21.15.97:6819/3061077368","heartbeat_back_addr":"172.21.15.97:6823/3061077368","heartbeat_front_addr":"172.21.15.97:6821/3061077368","state":["exists","up"]},{"osd":4,"uuid":"eb42906d-fd6d-4f9c-b747-78973e5eaf6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6825","nonce":2114276410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6827","nonce":2114276410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6831","nonce":2114276410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2114276410},{"type":"v1","addr":"172.21.15.154:6829","nonce":2114276410}]},"public_addr":"172.21.15.154:6825/2114276410","cluster_addr":"172.21.15.154:6827/2114276410","heartbeat_back_addr":"172.21.15.154:6831/2114276410","heartbeat_front_addr":"172.21.15.154:6829/2114276410","state":["exists","up"]},{"osd":5,"uuid":"1f595162-1674-4bb4-9e4a-ad9668dc0d90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6817","nonce":4233979797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6819","nonce":4233979797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6823","nonce":4233979797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4233979797},{"type":"v1","addr":"172.21.15.154:6821","nonce":4233979797}]},"public_addr":"172.21.15.154:6817/4233979797","cluster_addr":"172.21.15.154:6819/4233979797","heartbeat_back_addr":"172.21.15.154:6823/4233979797","heartbeat_front_addr":"172.21.15.154:6821/4233979797","state":["exists","up"]},{"osd":6,"uuid":"7a65a21c-542a-47b5-a103-8cbb7db1de88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6801","nonce":2443191286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6803","nonce":2443191286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6807","nonce":2443191286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2443191286},{"type":"v1","addr":"172.21.15.154:6805","nonce":2443191286}]},"public_addr":"172.21.15.154:6801/2443191286","cluster_addr":"172.21.15.154:6803/2443191286","heartbeat_back_addr":"172.21.15.154:6807/2443191286","heartbeat_front_addr":"172.21.15.154:6805/2443191286","state":["exists","up"]},{"osd":7,"uuid":"13feed67-5697-4e4b-83cc-0d903f25cbfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6809","nonce":3304684764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6811","nonce":3304684764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6815","nonce":3304684764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3304684764},{"type":"v1","addr":"172.21.15.154:6813","nonce":3304684764}]},"public_addr":"172.21.15.154:6809/3304684764","cluster_addr":"172.21.15.154:6811/3304684764","heartbeat_back_addr":"172.21.15.154:6815/3304684764","heartbeat_front_addr":"172.21.15.154:6813/3304684764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.950930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.168590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.753805+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.327355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.362604+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.982481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:10.835104+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:36:11.232583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T19:29:45.831 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T19:29:45.831 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:29:45.988 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T19:29:45.989 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:29:45.989 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T19:29:46.005 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T19:29:46.297 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T19:29:46.315 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T19:29:46.315 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:29:46.453 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T19:29:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:29:46.453 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T19:29:46.468 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T19:29:46.747 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T19:29:46.767 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T19:29:46.768 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:29:46.913 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T19:29:46.913 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:29:46.913 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T19:29:46.928 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T19:29:47.215 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T19:29:47.234 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T19:29:47.234 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:29:47.373 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T19:29:47.373 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:29:47.373 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T19:29:47.389 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T19:29:47.664 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T19:29:47.684 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T19:29:47.684 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:29:47.830 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T19:29:47.830 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:29:47.830 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T19:29:47.844 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T19:29:48.139 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T19:29:48.157 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T19:29:48.157 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:29:48.296 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T19:29:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:29:48.296 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T19:29:48.311 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T19:29:48.608 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T19:29:48.627 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T19:29:48.627 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:29:48.767 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T19:29:48.767 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:29:48.767 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T19:29:48.782 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T19:29:49.068 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T19:29:49.087 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T19:29:49.087 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:29:49.231 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-12T19:29:49.231 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:29:49.231 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-12T19:29:49.246 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T19:29:49.535 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T19:29:49.554 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:29:49.862 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:29:49.875 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-12T19:29:49.877 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":3664,"stamp":"2024-09-12T19:29:49.216877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69294871,"num_objects":850,"num_object_clones":0,"num_object_copies":1700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":850,"num_whiteouts":0,"num_read":295267,"num_read_kb":2527306,"num_write":163888,"num_write_kb":2342783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":204,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13026,"ondisk_log_size":13026,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1509176,"kb_used_data":162064,"kb_used_omap":12,"kb_used_meta":1345843,"kb_avail":753465544,"statfs":{"total":773094113280,"available":771548717056,"internally_reserved":0,"allocated":165953536,"data_stored":152266106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1378143792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-599149881,"num_objects":-4145,"num_object_clones":0,"num_object_copies":-8290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4145,"num_whiteouts":0,"num_read":4633,"num_read_kb":4148,"num_write":4396,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006830"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.587902+0000","last_change":"2024-09-12T18:25:52.622405+0000","last_active":"2024-09-12T19:25:55.587902+0000","last_peered":"2024-09-12T19:25:55.587902+0000","last_clean":"2024-09-12T19:25:55.587902+0000","last_became_active":"2024-09-12T18:25:52.621735+0000","last_became_peered":"2024-09-12T18:25:52.621735+0000","last_unstale":"2024-09-12T19:25:55.587902+0000","last_undegraded":"2024-09-12T19:25:55.587902+0000","last_fullsized":"2024-09-12T19:25:55.587902+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:09.919704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.083326+0000","last_change":"2024-09-12T17:58:47.223973+0000","last_active":"2024-09-12T19:26:20.083326+0000","last_peered":"2024-09-12T19:26:20.083326+0000","last_clean":"2024-09-12T19:26:20.083326+0000","last_became_active":"2024-09-12T17:58:47.223202+0000","last_became_peered":"2024-09-12T17:58:47.223202+0000","last_unstale":"2024-09-12T19:26:20.083326+0000","last_undegraded":"2024-09-12T19:26:20.083326+0000","last_fullsized":"2024-09-12T19:26:20.083326+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:23.110262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'5","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.964477+0000","last_change":"2024-09-12T17:58:40.207149+0000","last_active":"2024-09-12T19:29:41.964477+0000","last_peered":"2024-09-12T19:29:41.964477+0000","last_clean":"2024-09-12T19:29:41.964477+0000","last_became_active":"2024-09-12T17:58:40.206469+0000","last_became_peered":"2024-09-12T17:58:40.206469+0000","last_unstale":"2024-09-12T19:29:41.964477+0000","last_undegraded":"2024-09-12T19:29:41.964477+0000","last_fullsized":"2024-09-12T19:29:41.964477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:10.914751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'13","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.683354+0000","last_change":"2024-09-12T17:52:39.873196+0000","last_active":"2024-09-12T19:26:25.683354+0000","last_peered":"2024-09-12T19:26:25.683354+0000","last_clean":"2024-09-12T19:26:25.683354+0000","last_became_active":"2024-09-12T17:52:39.872356+0000","last_became_peered":"2024-09-12T17:52:39.872356+0000","last_unstale":"2024-09-12T19:26:25.683354+0000","last_undegraded":"2024-09-12T19:26:25.683354+0000","last_fullsized":"2024-09-12T19:26:25.683354+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:36.475086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.035593+0000","last_change":"2024-09-12T18:25:52.625279+0000","last_active":"2024-09-12T19:25:54.035593+0000","last_peered":"2024-09-12T19:25:54.035593+0000","last_clean":"2024-09-12T19:25:54.035593+0000","last_became_active":"2024-09-12T18:25:52.624565+0000","last_became_peered":"2024-09-12T18:25:52.624565+0000","last_unstale":"2024-09-12T19:25:54.035593+0000","last_undegraded":"2024-09-12T19:25:54.035593+0000","last_fullsized":"2024-09-12T19:25:54.035593+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:32.002014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'4","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241488+0000","last_change":"2024-09-12T17:58:47.249699+0000","last_active":"2024-09-12T19:26:20.241488+0000","last_peered":"2024-09-12T19:26:20.241488+0000","last_clean":"2024-09-12T19:26:20.241488+0000","last_became_active":"2024-09-12T17:58:47.249050+0000","last_became_peered":"2024-09-12T17:58:47.249050+0000","last_unstale":"2024-09-12T19:26:20.241488+0000","last_undegraded":"2024-09-12T19:26:20.241488+0000","last_fullsized":"2024-09-12T19:26:20.241488+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:09.406806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.284136+0000","last_change":"2024-09-12T17:58:40.210474+0000","last_active":"2024-09-12T19:28:40.284136+0000","last_peered":"2024-09-12T19:28:40.284136+0000","last_clean":"2024-09-12T19:28:40.284136+0000","last_became_active":"2024-09-12T17:58:40.209447+0000","last_became_peered":"2024-09-12T17:58:40.209447+0000","last_unstale":"2024-09-12T19:28:40.284136+0000","last_undegraded":"2024-09-12T19:28:40.284136+0000","last_fullsized":"2024-09-12T19:28:40.284136+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:51.043086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'14","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691311+0000","last_change":"2024-09-12T17:52:39.885082+0000","last_active":"2024-09-12T19:27:00.691311+0000","last_peered":"2024-09-12T19:27:00.691311+0000","last_clean":"2024-09-12T19:27:00.691311+0000","last_became_active":"2024-09-12T17:52:39.884327+0000","last_became_peered":"2024-09-12T17:52:39.884327+0000","last_unstale":"2024-09-12T19:27:00.691311+0000","last_undegraded":"2024-09-12T19:27:00.691311+0000","last_fullsized":"2024-09-12T19:27:00.691311+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:05.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.083157+0000","last_change":"2024-09-12T18:25:52.622449+0000","last_active":"2024-09-12T19:26:20.083157+0000","last_peered":"2024-09-12T19:26:20.083157+0000","last_clean":"2024-09-12T19:26:20.083157+0000","last_became_active":"2024-09-12T18:25:52.621796+0000","last_became_peered":"2024-09-12T18:25:52.621796+0000","last_unstale":"2024-09-12T19:26:20.083157+0000","last_undegraded":"2024-09-12T19:26:20.083157+0000","last_fullsized":"2024-09-12T19:26:20.083157+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:45.223769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'7","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.929370+0000","last_change":"2024-09-12T17:58:47.240760+0000","last_active":"2024-09-12T19:29:41.929370+0000","last_peered":"2024-09-12T19:29:41.929370+0000","last_clean":"2024-09-12T19:29:41.929370+0000","last_became_active":"2024-09-12T17:58:47.239390+0000","last_became_peered":"2024-09-12T17:58:47.239390+0000","last_unstale":"2024-09-12T19:29:41.929370+0000","last_undegraded":"2024-09-12T19:29:41.929370+0000","last_fullsized":"2024-09-12T19:29:41.929370+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:08.068553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'4","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.616496+0000","last_change":"2024-09-12T17:58:40.194349+0000","last_active":"2024-09-12T19:29:41.616496+0000","last_peered":"2024-09-12T19:29:41.616496+0000","last_clean":"2024-09-12T19:29:41.616496+0000","last_became_active":"2024-09-12T17:58:40.193462+0000","last_became_peered":"2024-09-12T17:58:40.193462+0000","last_unstale":"2024-09-12T19:29:41.616496+0000","last_undegraded":"2024-09-12T19:29:41.616496+0000","last_fullsized":"2024-09-12T19:29:41.616496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:14.830909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1083,"num_write":4,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'6","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026309+0000","last_change":"2024-09-12T17:52:39.872689+0000","last_active":"2024-09-12T19:25:09.026309+0000","last_peered":"2024-09-12T19:25:09.026309+0000","last_clean":"2024-09-12T19:25:09.026309+0000","last_became_active":"2024-09-12T17:52:39.871998+0000","last_became_peered":"2024-09-12T17:52:39.871998+0000","last_unstale":"2024-09-12T19:25:09.026309+0000","last_undegraded":"2024-09-12T19:25:09.026309+0000","last_fullsized":"2024-09-12T19:25:09.026309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:54.365755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255185+0000","last_change":"2024-09-12T18:25:52.613287+0000","last_active":"2024-09-12T19:26:40.255185+0000","last_peered":"2024-09-12T19:26:40.255185+0000","last_clean":"2024-09-12T19:26:40.255185+0000","last_became_active":"2024-09-12T18:25:52.612472+0000","last_became_peered":"2024-09-12T18:25:52.612472+0000","last_unstale":"2024-09-12T19:26:40.255185+0000","last_undegraded":"2024-09-12T19:26:40.255185+0000","last_fullsized":"2024-09-12T19:26:40.255185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:42.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"262'5","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263726+0000","last_change":"2024-09-12T17:58:47.248310+0000","last_active":"2024-09-12T19:27:15.263726+0000","last_peered":"2024-09-12T19:27:15.263726+0000","last_clean":"2024-09-12T19:27:15.263726+0000","last_became_active":"2024-09-12T17:58:47.247496+0000","last_became_peered":"2024-09-12T17:58:47.247496+0000","last_unstale":"2024-09-12T19:27:15.263726+0000","last_undegraded":"2024-09-12T19:27:15.263726+0000","last_fullsized":"2024-09-12T19:27:15.263726+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:24.161042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'12","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.109326+0000","last_change":"2024-09-12T17:58:40.214834+0000","last_active":"2024-09-12T19:28:15.109326+0000","last_peered":"2024-09-12T19:28:15.109326+0000","last_clean":"2024-09-12T19:28:15.109326+0000","last_became_active":"2024-09-12T17:58:40.207945+0000","last_became_peered":"2024-09-12T17:58:40.207945+0000","last_unstale":"2024-09-12T19:28:15.109326+0000","last_undegraded":"2024-09-12T19:28:15.109326+0000","last_fullsized":"2024-09-12T19:28:15.109326+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:52.444564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8196,"num_write":22,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'37","reported_seq":169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026256+0000","last_change":"2024-09-12T17:52:39.871937+0000","last_active":"2024-09-12T19:25:09.026256+0000","last_peered":"2024-09-12T19:25:09.026256+0000","last_clean":"2024-09-12T19:25:09.026256+0000","last_became_active":"2024-09-12T17:52:39.871148+0000","last_became_peered":"2024-09-12T17:52:39.871148+0000","last_unstale":"2024-09-12T19:25:09.026256+0000","last_undegraded":"2024-09-12T19:25:09.026256+0000","last_fullsized":"2024-09-12T19:25:09.026256+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:45.467030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":131,"num_write":69,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.659086+0000","last_change":"2024-09-12T18:25:52.605404+0000","last_active":"2024-09-12T19:26:00.659086+0000","last_peered":"2024-09-12T19:26:00.659086+0000","last_clean":"2024-09-12T19:26:00.659086+0000","last_became_active":"2024-09-12T18:25:52.604589+0000","last_became_peered":"2024-09-12T18:25:52.604589+0000","last_unstale":"2024-09-12T19:26:00.659086+0000","last_undegraded":"2024-09-12T19:26:00.659086+0000","last_fullsized":"2024-09-12T19:26:00.659086+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.091248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'8","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.618447+0000","last_change":"2024-09-12T17:58:47.243839+0000","last_active":"2024-09-12T19:29:41.618447+0000","last_peered":"2024-09-12T19:29:41.618447+0000","last_clean":"2024-09-12T19:29:41.618447+0000","last_became_active":"2024-09-12T17:58:47.242756+0000","last_became_peered":"2024-09-12T17:58:47.242756+0000","last_unstale":"2024-09-12T19:29:41.618447+0000","last_undegraded":"2024-09-12T19:29:41.618447+0000","last_fullsized":"2024-09-12T19:29:41.618447+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:13.909298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":7170,"num_write":8,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"262'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.241656+0000","last_change":"2024-09-12T17:58:40.211442+0000","last_active":"2024-09-12T19:25:40.241656+0000","last_peered":"2024-09-12T19:25:40.241656+0000","last_clean":"2024-09-12T19:25:40.241656+0000","last_became_active":"2024-09-12T17:58:40.202787+0000","last_became_peered":"2024-09-12T17:58:40.202787+0000","last_unstale":"2024-09-12T19:25:40.241656+0000","last_undegraded":"2024-09-12T19:25:40.241656+0000","last_fullsized":"2024-09-12T19:25:40.241656+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.258488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'30","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:09.026173+0000","last_change":"2024-09-12T17:52:39.889339+0000","last_active":"2024-09-12T19:25:09.026173+0000","last_peered":"2024-09-12T19:25:09.026173+0000","last_clean":"2024-09-12T19:25:09.026173+0000","last_became_active":"2024-09-12T17:52:39.888092+0000","last_became_peered":"2024-09-12T17:52:39.888092+0000","last_unstale":"2024-09-12T19:25:09.026173+0000","last_undegraded":"2024-09-12T19:25:09.026173+0000","last_fullsized":"2024-09-12T19:25:09.026173+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:52.955862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682167+0000","last_change":"2024-09-12T18:25:52.615541+0000","last_active":"2024-09-12T19:26:20.682167+0000","last_peered":"2024-09-12T19:26:20.682167+0000","last_clean":"2024-09-12T19:26:20.682167+0000","last_became_active":"2024-09-12T18:25:52.614862+0000","last_became_peered":"2024-09-12T18:25:52.614862+0000","last_unstale":"2024-09-12T19:26:20.682167+0000","last_undegraded":"2024-09-12T19:26:20.682167+0000","last_fullsized":"2024-09-12T19:26:20.682167+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:20.974947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.346428+0000","last_change":"2024-09-12T17:58:47.251966+0000","last_active":"2024-09-12T19:25:50.346428+0000","last_peered":"2024-09-12T19:25:50.346428+0000","last_clean":"2024-09-12T19:25:50.346428+0000","last_became_active":"2024-09-12T17:58:47.246322+0000","last_became_peered":"2024-09-12T17:58:47.246322+0000","last_unstale":"2024-09-12T19:25:50.346428+0000","last_undegraded":"2024-09-12T19:25:50.346428+0000","last_fullsized":"2024-09-12T19:25:50.346428+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:04.147241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'4","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:35.387017+0000","last_change":"2024-09-12T17:58:40.207847+0000","last_active":"2024-09-12T19:28:35.387017+0000","last_peered":"2024-09-12T19:28:35.387017+0000","last_clean":"2024-09-12T19:28:35.387017+0000","last_became_active":"2024-09-12T17:58:40.207064+0000","last_became_peered":"2024-09-12T17:58:40.207064+0000","last_unstale":"2024-09-12T19:28:35.387017+0000","last_undegraded":"2024-09-12T19:28:35.387017+0000","last_fullsized":"2024-09-12T19:28:35.387017+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:41.646154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.225969+0000","last_change":"2024-09-12T17:52:39.884527+0000","last_active":"2024-09-12T19:25:10.225969+0000","last_peered":"2024-09-12T19:25:10.225969+0000","last_clean":"2024-09-12T19:25:10.225969+0000","last_became_active":"2024-09-12T17:52:39.883689+0000","last_became_peered":"2024-09-12T17:52:39.883689+0000","last_unstale":"2024-09-12T19:25:10.225969+0000","last_undegraded":"2024-09-12T19:25:10.225969+0000","last_fullsized":"2024-09-12T19:25:10.225969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:21.651937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.235695+0000","last_change":"2024-09-12T18:25:52.605313+0000","last_active":"2024-09-12T19:25:55.235695+0000","last_peered":"2024-09-12T19:25:55.235695+0000","last_clean":"2024-09-12T19:25:55.235695+0000","last_became_active":"2024-09-12T18:25:52.598221+0000","last_became_peered":"2024-09-12T18:25:52.598221+0000","last_unstale":"2024-09-12T19:25:55.235695+0000","last_undegraded":"2024-09-12T19:25:55.235695+0000","last_fullsized":"2024-09-12T19:25:55.235695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.818370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241434+0000","last_change":"2024-09-12T17:58:47.247385+0000","last_active":"2024-09-12T19:26:20.241434+0000","last_peered":"2024-09-12T19:26:20.241434+0000","last_clean":"2024-09-12T19:26:20.241434+0000","last_became_active":"2024-09-12T17:58:47.238781+0000","last_became_peered":"2024-09-12T17:58:47.238781+0000","last_unstale":"2024-09-12T19:26:20.241434+0000","last_undegraded":"2024-09-12T19:26:20.241434+0000","last_fullsized":"2024-09-12T19:26:20.241434+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:59.988556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.590718+0000","last_change":"2024-09-12T17:58:40.188716+0000","last_active":"2024-09-12T19:26:10.590718+0000","last_peered":"2024-09-12T19:26:10.590718+0000","last_clean":"2024-09-12T19:26:10.590718+0000","last_became_active":"2024-09-12T17:58:40.187973+0000","last_became_peered":"2024-09-12T17:58:40.187973+0000","last_unstale":"2024-09-12T19:26:10.590718+0000","last_undegraded":"2024-09-12T19:26:10.590718+0000","last_fullsized":"2024-09-12T19:26:10.590718+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:19.654518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'31","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675055+0000","last_change":"2024-09-12T17:52:39.892332+0000","last_active":"2024-09-12T19:27:10.675055+0000","last_peered":"2024-09-12T19:27:10.675055+0000","last_clean":"2024-09-12T19:27:10.675055+0000","last_became_active":"2024-09-12T17:52:39.891830+0000","last_became_peered":"2024-09-12T17:52:39.891830+0000","last_unstale":"2024-09-12T19:27:10.675055+0000","last_undegraded":"2024-09-12T19:27:10.675055+0000","last_fullsized":"2024-09-12T19:27:10.675055+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:19.516571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.588010+0000","last_change":"2024-09-12T18:25:52.607506+0000","last_active":"2024-09-12T19:25:55.588010+0000","last_peered":"2024-09-12T19:25:55.588010+0000","last_clean":"2024-09-12T19:25:55.588010+0000","last_became_active":"2024-09-12T18:25:52.606714+0000","last_became_peered":"2024-09-12T18:25:52.606714+0000","last_unstale":"2024-09-12T19:25:55.588010+0000","last_undegraded":"2024-09-12T19:25:55.588010+0000","last_fullsized":"2024-09-12T19:25:55.588010+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:29.094403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'4","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:50.697775+0000","last_change":"2024-09-12T17:58:47.251261+0000","last_active":"2024-09-12T19:28:50.697775+0000","last_peered":"2024-09-12T19:28:50.697775+0000","last_clean":"2024-09-12T19:28:50.697775+0000","last_became_active":"2024-09-12T17:58:47.250364+0000","last_became_peered":"2024-09-12T17:58:47.250364+0000","last_unstale":"2024-09-12T19:28:50.697775+0000","last_undegraded":"2024-09-12T19:28:50.697775+0000","last_fullsized":"2024-09-12T19:28:50.697775+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:18.815473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:09.038794+0000","last_change":"2024-09-12T17:58:40.212846+0000","last_active":"2024-09-12T19:26:09.038794+0000","last_peered":"2024-09-12T19:26:09.038794+0000","last_clean":"2024-09-12T19:26:09.038794+0000","last_became_active":"2024-09-12T17:58:40.212280+0000","last_became_peered":"2024-09-12T17:58:40.212280+0000","last_unstale":"2024-09-12T19:26:09.038794+0000","last_undegraded":"2024-09-12T19:26:09.038794+0000","last_fullsized":"2024-09-12T19:26:09.038794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:58.695339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'30","reported_seq":152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:54.048336+0000","last_change":"2024-09-12T17:52:39.871278+0000","last_active":"2024-09-12T19:26:54.048336+0000","last_peered":"2024-09-12T19:26:54.048336+0000","last_clean":"2024-09-12T19:26:54.048336+0000","last_became_active":"2024-09-12T17:52:39.870304+0000","last_became_peered":"2024-09-12T17:52:39.870304+0000","last_unstale":"2024-09-12T19:26:54.048336+0000","last_undegraded":"2024-09-12T19:26:54.048336+0000","last_fullsized":"2024-09-12T19:26:54.048336+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:38.765024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":59,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254085+0000","last_change":"2024-09-12T18:25:52.623401+0000","last_active":"2024-09-12T19:26:35.254085+0000","last_peered":"2024-09-12T19:26:35.254085+0000","last_clean":"2024-09-12T19:26:35.254085+0000","last_became_active":"2024-09-12T18:25:52.622842+0000","last_became_peered":"2024-09-12T18:25:52.622842+0000","last_unstale":"2024-09-12T19:26:35.254085+0000","last_undegraded":"2024-09-12T19:26:35.254085+0000","last_fullsized":"2024-09-12T19:26:35.254085+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:22.497623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'4","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.690031+0000","last_change":"2024-09-12T17:58:47.256168+0000","last_active":"2024-09-12T19:28:15.690031+0000","last_peered":"2024-09-12T19:28:15.690031+0000","last_clean":"2024-09-12T19:28:15.690031+0000","last_became_active":"2024-09-12T17:58:47.255379+0000","last_became_peered":"2024-09-12T17:58:47.255379+0000","last_unstale":"2024-09-12T19:28:15.690031+0000","last_undegraded":"2024-09-12T19:28:15.690031+0000","last_fullsized":"2024-09-12T19:28:15.690031+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:28.202469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.341509+0000","last_change":"2024-09-12T17:58:40.194167+0000","last_active":"2024-09-12T19:25:30.341509+0000","last_peered":"2024-09-12T19:25:30.341509+0000","last_clean":"2024-09-12T19:25:30.341509+0000","last_became_active":"2024-09-12T17:58:40.193471+0000","last_became_peered":"2024-09-12T17:58:40.193471+0000","last_unstale":"2024-09-12T19:25:30.341509+0000","last_undegraded":"2024-09-12T19:25:30.341509+0000","last_fullsized":"2024-09-12T19:25:30.341509+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:18.036549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'46","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690191+0000","last_change":"2024-09-12T17:52:39.883998+0000","last_active":"2024-09-12T19:26:55.690191+0000","last_peered":"2024-09-12T19:26:55.690191+0000","last_clean":"2024-09-12T19:26:55.690191+0000","last_became_active":"2024-09-12T17:52:39.883248+0000","last_became_peered":"2024-09-12T17:52:39.883248+0000","last_unstale":"2024-09-12T19:26:55.690191+0000","last_undegraded":"2024-09-12T19:26:55.690191+0000","last_fullsized":"2024-09-12T19:26:55.690191+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:59.309550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":156,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:34.044189+0000","last_change":"2024-09-12T18:25:52.612372+0000","last_active":"2024-09-12T19:26:34.044189+0000","last_peered":"2024-09-12T19:26:34.044189+0000","last_clean":"2024-09-12T19:26:34.044189+0000","last_became_active":"2024-09-12T18:25:52.611620+0000","last_became_peered":"2024-09-12T18:25:52.611620+0000","last_unstale":"2024-09-12T19:26:34.044189+0000","last_undegraded":"2024-09-12T19:26:34.044189+0000","last_fullsized":"2024-09-12T19:26:34.044189+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:49.193437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'7","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.273211+0000","last_change":"2024-09-12T17:58:47.250813+0000","last_active":"2024-09-12T19:27:55.273211+0000","last_peered":"2024-09-12T19:27:55.273211+0000","last_clean":"2024-09-12T19:27:55.273211+0000","last_became_active":"2024-09-12T17:58:47.249833+0000","last_became_peered":"2024-09-12T17:58:47.249833+0000","last_unstale":"2024-09-12T19:27:55.273211+0000","last_undegraded":"2024-09-12T19:27:55.273211+0000","last_fullsized":"2024-09-12T19:27:55.273211+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:00.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.584687+0000","last_change":"2024-09-12T17:58:40.204716+0000","last_active":"2024-09-12T19:25:40.584687+0000","last_peered":"2024-09-12T19:25:40.584687+0000","last_clean":"2024-09-12T19:25:40.584687+0000","last_became_active":"2024-09-12T17:58:40.203917+0000","last_became_peered":"2024-09-12T17:58:40.203917+0000","last_unstale":"2024-09-12T19:25:40.584687+0000","last_undegraded":"2024-09-12T19:25:40.584687+0000","last_fullsized":"2024-09-12T19:25:40.584687+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:29.039732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690138+0000","last_change":"2024-09-12T17:52:39.885011+0000","last_active":"2024-09-12T19:26:55.690138+0000","last_peered":"2024-09-12T19:26:55.690138+0000","last_clean":"2024-09-12T19:26:55.690138+0000","last_became_active":"2024-09-12T17:52:39.884285+0000","last_became_peered":"2024-09-12T17:52:39.884285+0000","last_unstale":"2024-09-12T19:26:55.690138+0000","last_undegraded":"2024-09-12T19:26:55.690138+0000","last_fullsized":"2024-09-12T19:26:55.690138+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:22.466454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.244671+0000","last_change":"2024-09-12T18:25:52.624010+0000","last_active":"2024-09-12T19:26:35.244671+0000","last_peered":"2024-09-12T19:26:35.244671+0000","last_clean":"2024-09-12T19:26:35.244671+0000","last_became_active":"2024-09-12T18:25:52.623502+0000","last_became_peered":"2024-09-12T18:25:52.623502+0000","last_unstale":"2024-09-12T19:26:35.244671+0000","last_undegraded":"2024-09-12T19:26:35.244671+0000","last_fullsized":"2024-09-12T19:26:35.244671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:54.401588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'7","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.654410+0000","last_change":"2024-09-12T17:58:47.257454+0000","last_active":"2024-09-12T19:29:41.654410+0000","last_peered":"2024-09-12T19:29:41.654410+0000","last_clean":"2024-09-12T19:29:41.654410+0000","last_became_active":"2024-09-12T17:58:47.256721+0000","last_became_peered":"2024-09-12T17:58:47.256721+0000","last_unstale":"2024-09-12T19:29:41.654410+0000","last_undegraded":"2024-09-12T19:29:41.654410+0000","last_fullsized":"2024-09-12T19:29:41.654410+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:39.335691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16424,"num_write":12,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:05.687759+0000","last_change":"2024-09-12T17:58:40.199627+0000","last_active":"2024-09-12T19:28:05.687759+0000","last_peered":"2024-09-12T19:28:05.687759+0000","last_clean":"2024-09-12T19:28:05.687759+0000","last_became_active":"2024-09-12T17:58:40.198765+0000","last_became_peered":"2024-09-12T17:58:40.198765+0000","last_unstale":"2024-09-12T19:28:05.687759+0000","last_undegraded":"2024-09-12T19:28:05.687759+0000","last_fullsized":"2024-09-12T19:28:05.687759+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:37.234886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'58","reported_seq":224,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671649+0000","last_change":"2024-09-12T17:52:39.886405+0000","last_active":"2024-09-12T19:26:55.671649+0000","last_peered":"2024-09-12T19:26:55.671649+0000","last_clean":"2024-09-12T19:26:55.671649+0000","last_became_active":"2024-09-12T17:52:39.885875+0000","last_became_peered":"2024-09-12T17:52:39.885875+0000","last_unstale":"2024-09-12T19:26:55.671649+0000","last_undegraded":"2024-09-12T19:26:55.671649+0000","last_fullsized":"2024-09-12T19:26:55.671649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:42.953403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":205,"num_write":103,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.596249+0000","last_change":"2024-09-12T18:25:52.618187+0000","last_active":"2024-09-12T19:26:35.596249+0000","last_peered":"2024-09-12T19:26:35.596249+0000","last_clean":"2024-09-12T19:26:35.596249+0000","last_became_active":"2024-09-12T18:25:52.617665+0000","last_became_peered":"2024-09-12T18:25:52.617665+0000","last_unstale":"2024-09-12T19:26:35.596249+0000","last_undegraded":"2024-09-12T19:26:35.596249+0000","last_fullsized":"2024-09-12T19:26:35.596249+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:16.143458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'5","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586974+0000","last_change":"2024-09-12T17:58:47.254576+0000","last_active":"2024-09-12T19:25:50.586974+0000","last_peered":"2024-09-12T19:25:50.586974+0000","last_clean":"2024-09-12T19:25:50.586974+0000","last_became_active":"2024-09-12T17:58:47.253819+0000","last_became_peered":"2024-09-12T17:58:47.253819+0000","last_unstale":"2024-09-12T19:25:50.586974+0000","last_undegraded":"2024-09-12T19:25:50.586974+0000","last_fullsized":"2024-09-12T19:25:50.586974+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:16.422570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:05.275765+0000","last_change":"2024-09-12T17:58:40.208386+0000","last_active":"2024-09-12T19:28:05.275765+0000","last_peered":"2024-09-12T19:28:05.275765+0000","last_clean":"2024-09-12T19:28:05.275765+0000","last_became_active":"2024-09-12T17:58:40.202790+0000","last_became_peered":"2024-09-12T17:58:40.202790+0000","last_unstale":"2024-09-12T19:28:05.275765+0000","last_undegraded":"2024-09-12T19:28:05.275765+0000","last_fullsized":"2024-09-12T19:28:05.275765+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:41.561154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'30","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:30.356662+0000","last_change":"2024-09-12T17:52:39.872248+0000","last_active":"2024-09-12T19:26:30.356662+0000","last_peered":"2024-09-12T19:26:30.356662+0000","last_clean":"2024-09-12T19:26:30.356662+0000","last_became_active":"2024-09-12T17:52:39.871009+0000","last_became_peered":"2024-09-12T17:52:39.871009+0000","last_unstale":"2024-09-12T19:26:30.356662+0000","last_undegraded":"2024-09-12T19:26:30.356662+0000","last_fullsized":"2024-09-12T19:26:30.356662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:36.952465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250730+0000","last_change":"2024-09-12T18:25:52.620335+0000","last_active":"2024-09-12T19:26:20.250730+0000","last_peered":"2024-09-12T19:26:20.250730+0000","last_clean":"2024-09-12T19:26:20.250730+0000","last_became_active":"2024-09-12T18:25:52.617863+0000","last_became_peered":"2024-09-12T18:25:52.617863+0000","last_unstale":"2024-09-12T19:26:20.250730+0000","last_undegraded":"2024-09-12T19:26:20.250730+0000","last_fullsized":"2024-09-12T19:26:20.250730+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:38.215652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"262'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.234651+0000","last_change":"2024-09-12T17:58:47.248615+0000","last_active":"2024-09-12T19:25:10.234651+0000","last_peered":"2024-09-12T19:25:10.234651+0000","last_clean":"2024-09-12T19:25:10.234651+0000","last_became_active":"2024-09-12T17:58:47.247475+0000","last_became_peered":"2024-09-12T17:58:47.247475+0000","last_unstale":"2024-09-12T19:25:10.234651+0000","last_undegraded":"2024-09-12T19:25:10.234651+0000","last_fullsized":"2024-09-12T19:25:10.234651+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:38.703200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"265'5","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.125898+0000","last_change":"2024-09-12T17:58:40.203206+0000","last_active":"2024-09-12T19:29:40.125898+0000","last_peered":"2024-09-12T19:29:40.125898+0000","last_clean":"2024-09-12T19:29:40.125898+0000","last_became_active":"2024-09-12T17:58:40.202141+0000","last_became_peered":"2024-09-12T17:58:40.202141+0000","last_unstale":"2024-09-12T19:29:40.125898+0000","last_undegraded":"2024-09-12T19:29:40.125898+0000","last_fullsized":"2024-09-12T19:29:40.125898+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:09.764989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'22","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.349102+0000","last_change":"2024-09-12T17:52:39.885280+0000","last_active":"2024-09-12T19:26:00.349102+0000","last_peered":"2024-09-12T19:26:00.349102+0000","last_clean":"2024-09-12T19:26:00.349102+0000","last_became_active":"2024-09-12T17:52:39.884686+0000","last_became_peered":"2024-09-12T17:52:39.884686+0000","last_unstale":"2024-09-12T19:26:00.349102+0000","last_undegraded":"2024-09-12T19:26:00.349102+0000","last_fullsized":"2024-09-12T19:26:00.349102+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:49.000832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041069+0000","last_change":"2024-09-12T18:25:52.613926+0000","last_active":"2024-09-12T19:26:19.041069+0000","last_peered":"2024-09-12T19:26:19.041069+0000","last_clean":"2024-09-12T19:26:19.041069+0000","last_became_active":"2024-09-12T18:25:52.611450+0000","last_became_peered":"2024-09-12T18:25:52.611450+0000","last_unstale":"2024-09-12T19:26:19.041069+0000","last_undegraded":"2024-09-12T19:26:19.041069+0000","last_fullsized":"2024-09-12T19:26:19.041069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:02.885475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'4","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.381474+0000","last_change":"2024-09-12T17:58:47.254616+0000","last_active":"2024-09-12T19:29:42.381474+0000","last_peered":"2024-09-12T19:29:42.381474+0000","last_clean":"2024-09-12T19:29:42.381474+0000","last_became_active":"2024-09-12T17:58:47.254061+0000","last_became_peered":"2024-09-12T17:58:47.254061+0000","last_unstale":"2024-09-12T19:29:42.381474+0000","last_undegraded":"2024-09-12T19:29:42.381474+0000","last_fullsized":"2024-09-12T19:29:42.381474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:06.779952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.299227+0000","last_change":"2024-09-12T17:58:40.203937+0000","last_active":"2024-09-12T19:29:40.299227+0000","last_peered":"2024-09-12T19:29:40.299227+0000","last_clean":"2024-09-12T19:29:40.299227+0000","last_became_active":"2024-09-12T17:58:40.203144+0000","last_became_peered":"2024-09-12T17:58:40.203144+0000","last_unstale":"2024-09-12T19:29:40.299227+0000","last_undegraded":"2024-09-12T19:29:40.299227+0000","last_fullsized":"2024-09-12T19:29:40.299227+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:57.360002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"262'16","reported_seq":117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.658972+0000","last_change":"2024-09-12T17:52:39.879536+0000","last_active":"2024-09-12T19:26:00.658972+0000","last_peered":"2024-09-12T19:26:00.658972+0000","last_clean":"2024-09-12T19:26:00.658972+0000","last_became_active":"2024-09-12T17:52:39.878797+0000","last_became_peered":"2024-09-12T17:52:39.878797+0000","last_unstale":"2024-09-12T19:26:00.658972+0000","last_undegraded":"2024-09-12T19:26:00.658972+0000","last_fullsized":"2024-09-12T19:26:00.658972+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:15.860760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.687851+0000","last_change":"2024-09-12T18:25:52.615680+0000","last_active":"2024-09-12T19:26:45.687851+0000","last_peered":"2024-09-12T19:26:45.687851+0000","last_clean":"2024-09-12T19:26:45.687851+0000","last_became_active":"2024-09-12T18:25:52.614949+0000","last_became_peered":"2024-09-12T18:25:52.614949+0000","last_unstale":"2024-09-12T19:26:45.687851+0000","last_undegraded":"2024-09-12T19:26:45.687851+0000","last_fullsized":"2024-09-12T19:26:45.687851+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:20.554312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.647849+0000","last_change":"2024-09-12T17:58:47.247578+0000","last_active":"2024-09-12T19:25:10.647849+0000","last_peered":"2024-09-12T19:25:10.647849+0000","last_clean":"2024-09-12T19:25:10.647849+0000","last_became_active":"2024-09-12T17:58:47.246916+0000","last_became_peered":"2024-09-12T17:58:47.246916+0000","last_unstale":"2024-09-12T19:25:10.647849+0000","last_undegraded":"2024-09-12T19:25:10.647849+0000","last_fullsized":"2024-09-12T19:25:10.647849+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.850549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"262'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097274+0000","last_change":"2024-09-12T17:58:40.208435+0000","last_active":"2024-09-12T19:27:20.097274+0000","last_peered":"2024-09-12T19:27:20.097274+0000","last_clean":"2024-09-12T19:27:20.097274+0000","last_became_active":"2024-09-12T17:58:40.207311+0000","last_became_peered":"2024-09-12T17:58:40.207311+0000","last_unstale":"2024-09-12T19:27:20.097274+0000","last_undegraded":"2024-09-12T19:27:20.097274+0000","last_fullsized":"2024-09-12T19:27:20.097274+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:09.258846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'29","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.236763+0000","last_change":"2024-09-12T17:52:39.867898+0000","last_active":"2024-09-12T19:26:00.236763+0000","last_peered":"2024-09-12T19:26:00.236763+0000","last_clean":"2024-09-12T19:26:00.236763+0000","last_became_active":"2024-09-12T17:52:39.867179+0000","last_became_peered":"2024-09-12T17:52:39.867179+0000","last_unstale":"2024-09-12T19:26:00.236763+0000","last_undegraded":"2024-09-12T19:26:00.236763+0000","last_fullsized":"2024-09-12T19:26:00.236763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:01.169877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":56,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041017+0000","last_change":"2024-09-12T18:25:52.612961+0000","last_active":"2024-09-12T19:26:19.041017+0000","last_peered":"2024-09-12T19:26:19.041017+0000","last_clean":"2024-09-12T19:26:19.041017+0000","last_became_active":"2024-09-12T18:25:52.610587+0000","last_became_peered":"2024-09-12T18:25:52.610587+0000","last_unstale":"2024-09-12T19:26:19.041017+0000","last_undegraded":"2024-09-12T19:26:19.041017+0000","last_fullsized":"2024-09-12T19:26:19.041017+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:48.847349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.336407+0000","last_change":"2024-09-12T17:58:47.251206+0000","last_active":"2024-09-12T19:25:10.336407+0000","last_peered":"2024-09-12T19:25:10.336407+0000","last_clean":"2024-09-12T19:25:10.336407+0000","last_became_active":"2024-09-12T17:58:47.245601+0000","last_became_peered":"2024-09-12T17:58:47.245601+0000","last_unstale":"2024-09-12T19:25:10.336407+0000","last_undegraded":"2024-09-12T19:25:10.336407+0000","last_fullsized":"2024-09-12T19:25:10.336407+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:19.101729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097320+0000","last_change":"2024-09-12T17:58:40.203425+0000","last_active":"2024-09-12T19:27:20.097320+0000","last_peered":"2024-09-12T19:27:20.097320+0000","last_clean":"2024-09-12T19:27:20.097320+0000","last_became_active":"2024-09-12T17:58:40.202408+0000","last_became_peered":"2024-09-12T17:58:40.202408+0000","last_unstale":"2024-09-12T19:27:20.097320+0000","last_undegraded":"2024-09-12T19:27:20.097320+0000","last_fullsized":"2024-09-12T19:27:20.097320+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:04.410943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":531,"num_write":4,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'108","reported_seq":441,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.658909+0000","last_change":"2024-09-12T17:52:39.881369+0000","last_active":"2024-09-12T19:26:00.658909+0000","last_peered":"2024-09-12T19:26:00.658909+0000","last_clean":"2024-09-12T19:26:00.658909+0000","last_became_active":"2024-09-12T17:52:39.880742+0000","last_became_peered":"2024-09-12T17:52:39.880742+0000","last_unstale":"2024-09-12T19:26:00.658909+0000","last_undegraded":"2024-09-12T19:26:00.658909+0000","last_fullsized":"2024-09-12T19:26:00.658909+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:12.083548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":720,"num_read_kb":486,"num_write":145,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258684+0000","last_change":"2024-09-12T18:25:52.605986+0000","last_active":"2024-09-12T19:26:55.258684+0000","last_peered":"2024-09-12T19:26:55.258684+0000","last_clean":"2024-09-12T19:26:55.258684+0000","last_became_active":"2024-09-12T18:25:52.605039+0000","last_became_peered":"2024-09-12T18:25:52.605039+0000","last_unstale":"2024-09-12T19:26:55.258684+0000","last_undegraded":"2024-09-12T19:26:55.258684+0000","last_fullsized":"2024-09-12T19:26:55.258684+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.770637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'7","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:50.697898+0000","last_change":"2024-09-12T17:58:47.242884+0000","last_active":"2024-09-12T19:28:50.697898+0000","last_peered":"2024-09-12T19:28:50.697898+0000","last_clean":"2024-09-12T19:28:50.697898+0000","last_became_active":"2024-09-12T17:58:47.241778+0000","last_became_peered":"2024-09-12T17:58:47.241778+0000","last_unstale":"2024-09-12T19:28:50.697898+0000","last_undegraded":"2024-09-12T19:28:50.697898+0000","last_fullsized":"2024-09-12T19:28:50.697898+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:36.555666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3074,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.119045+0000","last_change":"2024-09-12T17:58:40.196234+0000","last_active":"2024-09-12T19:29:42.119045+0000","last_peered":"2024-09-12T19:29:42.119045+0000","last_clean":"2024-09-12T19:29:42.119045+0000","last_became_active":"2024-09-12T17:58:40.195309+0000","last_became_peered":"2024-09-12T17:58:40.195309+0000","last_unstale":"2024-09-12T19:29:42.119045+0000","last_undegraded":"2024-09-12T19:29:42.119045+0000","last_fullsized":"2024-09-12T19:29:42.119045+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:30.098876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"262'110","reported_seq":458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:25.678784+0000","last_change":"2024-09-12T17:52:39.886824+0000","last_active":"2024-09-12T19:27:25.678784+0000","last_peered":"2024-09-12T19:27:25.678784+0000","last_clean":"2024-09-12T19:27:25.678784+0000","last_became_active":"2024-09-12T17:52:39.886185+0000","last_became_peered":"2024-09-12T17:52:39.886185+0000","last_unstale":"2024-09-12T19:27:25.678784+0000","last_undegraded":"2024-09-12T19:27:25.678784+0000","last_fullsized":"2024-09-12T19:27:25.678784+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:31.714670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":756,"num_read_kb":514,"num_write":140,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.088040+0000","last_change":"2024-09-12T18:25:52.624391+0000","last_active":"2024-09-12T19:26:40.088040+0000","last_peered":"2024-09-12T19:26:40.088040+0000","last_clean":"2024-09-12T19:26:40.088040+0000","last_became_active":"2024-09-12T18:25:52.623444+0000","last_became_peered":"2024-09-12T18:25:52.623444+0000","last_unstale":"2024-09-12T19:26:40.088040+0000","last_undegraded":"2024-09-12T19:26:40.088040+0000","last_fullsized":"2024-09-12T19:26:40.088040+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:41.418750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667006+0000","last_change":"2024-09-12T17:58:47.255347+0000","last_active":"2024-09-12T19:26:35.667006+0000","last_peered":"2024-09-12T19:26:35.667006+0000","last_clean":"2024-09-12T19:26:35.667006+0000","last_became_active":"2024-09-12T17:58:47.254273+0000","last_became_peered":"2024-09-12T17:58:47.254273+0000","last_unstale":"2024-09-12T19:26:35.667006+0000","last_undegraded":"2024-09-12T19:26:35.667006+0000","last_fullsized":"2024-09-12T19:26:35.667006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:34.502761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:39.071620+0000","last_change":"2024-09-12T17:58:40.202847+0000","last_active":"2024-09-12T19:28:39.071620+0000","last_peered":"2024-09-12T19:28:39.071620+0000","last_clean":"2024-09-12T19:28:39.071620+0000","last_became_active":"2024-09-12T17:58:40.202027+0000","last_became_peered":"2024-09-12T17:58:40.202027+0000","last_unstale":"2024-09-12T19:28:39.071620+0000","last_undegraded":"2024-09-12T19:28:39.071620+0000","last_fullsized":"2024-09-12T19:28:39.071620+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:12.912226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'31","reported_seq":153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366551+0000","last_change":"2024-09-12T17:52:39.877904+0000","last_active":"2024-09-12T19:27:10.366551+0000","last_peered":"2024-09-12T19:27:10.366551+0000","last_clean":"2024-09-12T19:27:10.366551+0000","last_became_active":"2024-09-12T17:52:39.877206+0000","last_became_peered":"2024-09-12T17:52:39.877206+0000","last_unstale":"2024-09-12T19:27:10.366551+0000","last_undegraded":"2024-09-12T19:27:10.366551+0000","last_fullsized":"2024-09-12T19:27:10.366551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.931327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":97,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.357743+0000","last_change":"2024-09-12T18:25:52.620716+0000","last_active":"2024-09-12T19:26:35.357743+0000","last_peered":"2024-09-12T19:26:35.357743+0000","last_clean":"2024-09-12T19:26:35.357743+0000","last_became_active":"2024-09-12T18:25:52.620045+0000","last_became_peered":"2024-09-12T18:25:52.620045+0000","last_unstale":"2024-09-12T19:26:35.357743+0000","last_undegraded":"2024-09-12T19:26:35.357743+0000","last_fullsized":"2024-09-12T19:26:35.357743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:58.464498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670475+0000","last_change":"2024-09-12T17:58:47.253752+0000","last_active":"2024-09-12T19:26:50.670475+0000","last_peered":"2024-09-12T19:26:50.670475+0000","last_clean":"2024-09-12T19:26:50.670475+0000","last_became_active":"2024-09-12T17:58:47.252966+0000","last_became_peered":"2024-09-12T17:58:47.252966+0000","last_unstale":"2024-09-12T19:26:50.670475+0000","last_undegraded":"2024-09-12T19:26:50.670475+0000","last_fullsized":"2024-09-12T19:26:50.670475+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:12.503210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'9","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.966100+0000","last_change":"2024-09-12T17:58:40.198879+0000","last_active":"2024-09-12T19:29:41.966100+0000","last_peered":"2024-09-12T19:29:41.966100+0000","last_clean":"2024-09-12T19:29:41.966100+0000","last_became_active":"2024-09-12T17:58:40.198161+0000","last_became_peered":"2024-09-12T17:58:40.198161+0000","last_unstale":"2024-09-12T19:29:41.966100+0000","last_undegraded":"2024-09-12T19:29:41.966100+0000","last_fullsized":"2024-09-12T19:29:41.966100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:50.706791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'31","reported_seq":154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.094779+0000","last_change":"2024-09-12T17:52:39.867437+0000","last_active":"2024-09-12T19:27:10.094779+0000","last_peered":"2024-09-12T19:27:10.094779+0000","last_clean":"2024-09-12T19:27:10.094779+0000","last_became_active":"2024-09-12T17:52:39.866342+0000","last_became_peered":"2024-09-12T17:52:39.866342+0000","last_unstale":"2024-09-12T19:27:10.094779+0000","last_undegraded":"2024-09-12T19:27:10.094779+0000","last_fullsized":"2024-09-12T19:27:10.094779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:36.550336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":107,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.086529+0000","last_change":"2024-09-12T18:25:52.601482+0000","last_active":"2024-09-12T19:26:35.086529+0000","last_peered":"2024-09-12T19:26:35.086529+0000","last_clean":"2024-09-12T19:26:35.086529+0000","last_became_active":"2024-09-12T18:25:52.599679+0000","last_became_peered":"2024-09-12T18:25:52.599679+0000","last_unstale":"2024-09-12T19:26:35.086529+0000","last_undegraded":"2024-09-12T19:26:35.086529+0000","last_fullsized":"2024-09-12T19:26:35.086529+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:02.845957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'2","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:50.286775+0000","last_change":"2024-09-12T17:58:47.256589+0000","last_active":"2024-09-12T19:28:50.286775+0000","last_peered":"2024-09-12T19:28:50.286775+0000","last_clean":"2024-09-12T19:28:50.286775+0000","last_became_active":"2024-09-12T17:58:47.255891+0000","last_became_peered":"2024-09-12T17:58:47.255891+0000","last_unstale":"2024-09-12T19:28:50.286775+0000","last_undegraded":"2024-09-12T19:28:50.286775+0000","last_fullsized":"2024-09-12T19:28:50.286775+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:52.933367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"262'3","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668287+0000","last_change":"2024-09-12T17:58:40.212187+0000","last_active":"2024-09-12T19:26:40.668287+0000","last_peered":"2024-09-12T19:26:40.668287+0000","last_clean":"2024-09-12T19:26:40.668287+0000","last_became_active":"2024-09-12T17:58:40.211450+0000","last_became_peered":"2024-09-12T17:58:40.211450+0000","last_unstale":"2024-09-12T19:26:40.668287+0000","last_undegraded":"2024-09-12T19:26:40.668287+0000","last_fullsized":"2024-09-12T19:26:40.668287+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:21.169200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'25","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:09.052206+0000","last_change":"2024-09-12T17:52:39.866705+0000","last_active":"2024-09-12T19:27:09.052206+0000","last_peered":"2024-09-12T19:27:09.052206+0000","last_clean":"2024-09-12T19:27:09.052206+0000","last_became_active":"2024-09-12T17:52:39.865914+0000","last_became_peered":"2024-09-12T17:52:39.865914+0000","last_unstale":"2024-09-12T19:27:09.052206+0000","last_undegraded":"2024-09-12T19:27:09.052206+0000","last_fullsized":"2024-09-12T19:27:09.052206+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:43.382459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255364+0000","last_change":"2024-09-12T18:25:52.613354+0000","last_active":"2024-09-12T19:26:40.255364+0000","last_peered":"2024-09-12T19:26:40.255364+0000","last_clean":"2024-09-12T19:26:40.255364+0000","last_became_active":"2024-09-12T18:25:52.612421+0000","last_became_peered":"2024-09-12T18:25:52.612421+0000","last_unstale":"2024-09-12T19:26:40.255364+0000","last_undegraded":"2024-09-12T19:26:40.255364+0000","last_fullsized":"2024-09-12T19:26:40.255364+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:29.095745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'2","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:40.373512+0000","last_change":"2024-09-12T17:58:47.246522+0000","last_active":"2024-09-12T19:27:40.373512+0000","last_peered":"2024-09-12T19:27:40.373512+0000","last_clean":"2024-09-12T19:27:40.373512+0000","last_became_active":"2024-09-12T17:58:47.238172+0000","last_became_peered":"2024-09-12T17:58:47.238172+0000","last_unstale":"2024-09-12T19:27:40.373512+0000","last_undegraded":"2024-09-12T19:27:40.373512+0000","last_fullsized":"2024-09-12T19:27:40.373512+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:56.402000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'7","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.730764+0000","last_change":"2024-09-12T17:58:40.194862+0000","last_active":"2024-09-12T19:29:41.730764+0000","last_peered":"2024-09-12T19:29:41.730764+0000","last_clean":"2024-09-12T19:29:41.730764+0000","last_became_active":"2024-09-12T17:58:40.194093+0000","last_became_peered":"2024-09-12T17:58:40.194093+0000","last_unstale":"2024-09-12T19:29:41.730764+0000","last_undegraded":"2024-09-12T19:29:41.730764+0000","last_fullsized":"2024-09-12T19:29:41.730764+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:55.158370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'38","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:09.052156+0000","last_change":"2024-09-12T17:52:39.888669+0000","last_active":"2024-09-12T19:27:09.052156+0000","last_peered":"2024-09-12T19:27:09.052156+0000","last_clean":"2024-09-12T19:27:09.052156+0000","last_became_active":"2024-09-12T17:52:39.887302+0000","last_became_peered":"2024-09-12T17:52:39.887302+0000","last_unstale":"2024-09-12T19:27:09.052156+0000","last_undegraded":"2024-09-12T19:27:09.052156+0000","last_fullsized":"2024-09-12T19:27:09.052156+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:45.562829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":146,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249879+0000","last_change":"2024-09-12T18:25:52.611745+0000","last_active":"2024-09-12T19:27:00.249879+0000","last_peered":"2024-09-12T19:27:00.249879+0000","last_clean":"2024-09-12T19:27:00.249879+0000","last_became_active":"2024-09-12T18:25:52.611022+0000","last_became_peered":"2024-09-12T18:25:52.611022+0000","last_unstale":"2024-09-12T19:27:00.249879+0000","last_undegraded":"2024-09-12T19:27:00.249879+0000","last_fullsized":"2024-09-12T19:27:00.249879+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:05.067276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"262'5","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.230402+0000","last_change":"2024-09-12T17:58:47.248839+0000","last_active":"2024-09-12T19:25:30.230402+0000","last_peered":"2024-09-12T19:25:30.230402+0000","last_clean":"2024-09-12T19:25:30.230402+0000","last_became_active":"2024-09-12T17:58:47.247599+0000","last_became_peered":"2024-09-12T17:58:47.247599+0000","last_unstale":"2024-09-12T19:25:30.230402+0000","last_undegraded":"2024-09-12T19:25:30.230402+0000","last_fullsized":"2024-09-12T19:25:30.230402+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:14.680201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'8","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.299268+0000","last_change":"2024-09-12T17:58:40.203966+0000","last_active":"2024-09-12T19:29:40.299268+0000","last_peered":"2024-09-12T19:29:40.299268+0000","last_clean":"2024-09-12T19:29:40.299268+0000","last_became_active":"2024-09-12T17:58:40.203177+0000","last_became_peered":"2024-09-12T17:58:40.203177+0000","last_unstale":"2024-09-12T19:29:40.299268+0000","last_undegraded":"2024-09-12T19:29:40.299268+0000","last_fullsized":"2024-09-12T19:29:40.299268+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:05.344996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'30","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.240017+0000","last_change":"2024-09-12T17:52:39.878505+0000","last_active":"2024-09-12T19:26:15.240017+0000","last_peered":"2024-09-12T19:26:15.240017+0000","last_clean":"2024-09-12T19:26:15.240017+0000","last_became_active":"2024-09-12T17:52:39.877793+0000","last_became_peered":"2024-09-12T17:52:39.877793+0000","last_unstale":"2024-09-12T19:26:15.240017+0000","last_undegraded":"2024-09-12T19:26:15.240017+0000","last_fullsized":"2024-09-12T19:26:15.240017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:26.899906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.597487+0000","last_change":"2024-09-12T18:25:52.618530+0000","last_active":"2024-09-12T19:26:40.597487+0000","last_peered":"2024-09-12T19:26:40.597487+0000","last_clean":"2024-09-12T19:26:40.597487+0000","last_became_active":"2024-09-12T18:25:52.617815+0000","last_became_peered":"2024-09-12T18:25:52.617815+0000","last_unstale":"2024-09-12T19:26:40.597487+0000","last_undegraded":"2024-09-12T19:26:40.597487+0000","last_fullsized":"2024-09-12T19:26:40.597487+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:26.125712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:34.044128+0000","last_change":"2024-09-12T17:58:47.257576+0000","last_active":"2024-09-12T19:26:34.044128+0000","last_peered":"2024-09-12T19:26:34.044128+0000","last_clean":"2024-09-12T19:26:34.044128+0000","last_became_active":"2024-09-12T17:58:47.256924+0000","last_became_peered":"2024-09-12T17:58:47.256924+0000","last_unstale":"2024-09-12T19:26:34.044128+0000","last_undegraded":"2024-09-12T19:26:34.044128+0000","last_fullsized":"2024-09-12T19:26:34.044128+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:39.738133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:35.653357+0000","last_change":"2024-09-12T17:58:40.194527+0000","last_active":"2024-09-12T19:25:35.653357+0000","last_peered":"2024-09-12T19:25:35.653357+0000","last_clean":"2024-09-12T19:25:35.653357+0000","last_became_active":"2024-09-12T17:58:40.193786+0000","last_became_peered":"2024-09-12T17:58:40.193786+0000","last_unstale":"2024-09-12T19:25:35.653357+0000","last_undegraded":"2024-09-12T19:25:35.653357+0000","last_fullsized":"2024-09-12T19:25:35.653357+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:14.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'23","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.243911+0000","last_change":"2024-09-12T17:52:39.875927+0000","last_active":"2024-09-12T19:25:50.243911+0000","last_peered":"2024-09-12T19:25:50.243911+0000","last_clean":"2024-09-12T19:25:50.243911+0000","last_became_active":"2024-09-12T17:52:39.869627+0000","last_became_peered":"2024-09-12T17:52:39.869627+0000","last_unstale":"2024-09-12T19:25:50.243911+0000","last_undegraded":"2024-09-12T19:25:50.243911+0000","last_fullsized":"2024-09-12T19:25:50.243911+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.817489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":43,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668164+0000","last_change":"2024-09-12T18:25:52.624807+0000","last_active":"2024-09-12T19:26:40.668164+0000","last_peered":"2024-09-12T19:26:40.668164+0000","last_clean":"2024-09-12T19:26:40.668164+0000","last_became_active":"2024-09-12T18:25:52.624296+0000","last_became_peered":"2024-09-12T18:25:52.624296+0000","last_unstale":"2024-09-12T19:26:40.668164+0000","last_undegraded":"2024-09-12T19:26:40.668164+0000","last_fullsized":"2024-09-12T19:26:40.668164+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:35.580294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"265'8","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.614343+0000","last_change":"2024-09-12T17:58:47.244823+0000","last_active":"2024-09-12T19:28:00.614343+0000","last_peered":"2024-09-12T19:28:00.614343+0000","last_clean":"2024-09-12T19:28:00.614343+0000","last_became_active":"2024-09-12T17:58:47.242874+0000","last_became_peered":"2024-09-12T17:58:47.242874+0000","last_unstale":"2024-09-12T19:28:00.614343+0000","last_undegraded":"2024-09-12T19:28:00.614343+0000","last_fullsized":"2024-09-12T19:28:00.614343+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:49.961011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9787,"num_write":8,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'5","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.387779+0000","last_change":"2024-09-12T17:58:40.175758+0000","last_active":"2024-09-12T19:28:40.387779+0000","last_peered":"2024-09-12T19:28:40.387779+0000","last_clean":"2024-09-12T19:28:40.387779+0000","last_became_active":"2024-09-12T17:58:40.175011+0000","last_became_peered":"2024-09-12T17:58:40.175011+0000","last_unstale":"2024-09-12T19:28:40.387779+0000","last_undegraded":"2024-09-12T19:28:40.387779+0000","last_fullsized":"2024-09-12T19:28:40.387779+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:29.337157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'56","reported_seq":233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586722+0000","last_change":"2024-09-12T17:52:39.885688+0000","last_active":"2024-09-12T19:25:50.586722+0000","last_peered":"2024-09-12T19:25:50.586722+0000","last_clean":"2024-09-12T19:25:50.586722+0000","last_became_active":"2024-09-12T17:52:39.884599+0000","last_became_peered":"2024-09-12T17:52:39.884599+0000","last_unstale":"2024-09-12T19:25:50.586722+0000","last_undegraded":"2024-09-12T19:25:50.586722+0000","last_fullsized":"2024-09-12T19:25:50.586722+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:48.524948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":231,"num_write":89,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.592964+0000","last_change":"2024-09-12T18:25:52.603197+0000","last_active":"2024-09-12T19:26:20.592964+0000","last_peered":"2024-09-12T19:26:20.592964+0000","last_clean":"2024-09-12T19:26:20.592964+0000","last_became_active":"2024-09-12T18:25:52.602495+0000","last_became_peered":"2024-09-12T18:25:52.602495+0000","last_unstale":"2024-09-12T19:26:20.592964+0000","last_undegraded":"2024-09-12T19:26:20.592964+0000","last_fullsized":"2024-09-12T19:26:20.592964+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:36.706795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'12","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.929898+0000","last_change":"2024-09-12T17:58:47.255006+0000","last_active":"2024-09-12T19:29:41.929898+0000","last_peered":"2024-09-12T19:29:41.929898+0000","last_clean":"2024-09-12T19:29:41.929898+0000","last_became_active":"2024-09-12T17:58:47.254272+0000","last_became_peered":"2024-09-12T17:58:47.254272+0000","last_unstale":"2024-09-12T19:29:41.929898+0000","last_undegraded":"2024-09-12T19:29:41.929898+0000","last_fullsized":"2024-09-12T19:29:41.929898+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:11.620938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":22,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'6","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.382034+0000","last_change":"2024-09-12T17:58:40.195873+0000","last_active":"2024-09-12T19:28:15.382034+0000","last_peered":"2024-09-12T19:28:15.382034+0000","last_clean":"2024-09-12T19:28:15.382034+0000","last_became_active":"2024-09-12T17:58:40.195089+0000","last_became_peered":"2024-09-12T17:58:40.195089+0000","last_unstale":"2024-09-12T19:28:15.382034+0000","last_undegraded":"2024-09-12T19:28:15.382034+0000","last_fullsized":"2024-09-12T19:28:15.382034+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.723902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'27","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.675603+0000","last_change":"2024-09-12T17:52:39.868988+0000","last_active":"2024-09-12T19:25:50.675603+0000","last_peered":"2024-09-12T19:25:50.675603+0000","last_clean":"2024-09-12T19:25:50.675603+0000","last_became_active":"2024-09-12T17:52:39.867605+0000","last_became_peered":"2024-09-12T17:52:39.867605+0000","last_unstale":"2024-09-12T19:25:50.675603+0000","last_undegraded":"2024-09-12T19:25:50.675603+0000","last_fullsized":"2024-09-12T19:25:50.675603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:31.849687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":99,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.592985+0000","last_change":"2024-09-12T18:25:52.615107+0000","last_active":"2024-09-12T19:26:20.592985+0000","last_peered":"2024-09-12T19:26:20.592985+0000","last_clean":"2024-09-12T19:26:20.592985+0000","last_became_active":"2024-09-12T18:25:52.614383+0000","last_became_peered":"2024-09-12T18:25:52.614383+0000","last_unstale":"2024-09-12T19:26:20.592985+0000","last_undegraded":"2024-09-12T19:26:20.592985+0000","last_fullsized":"2024-09-12T19:26:20.592985+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:02.087383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"265'5","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.617664+0000","last_change":"2024-09-12T17:58:47.249774+0000","last_active":"2024-09-12T19:29:41.617664+0000","last_peered":"2024-09-12T19:29:41.617664+0000","last_clean":"2024-09-12T19:29:41.617664+0000","last_became_active":"2024-09-12T17:58:47.248924+0000","last_became_peered":"2024-09-12T17:58:47.248924+0000","last_unstale":"2024-09-12T19:29:41.617664+0000","last_undegraded":"2024-09-12T19:29:41.617664+0000","last_fullsized":"2024-09-12T19:29:41.617664+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.643262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:35.712307+0000","last_change":"2024-09-12T17:58:40.188344+0000","last_active":"2024-09-12T19:28:35.712307+0000","last_peered":"2024-09-12T19:28:35.712307+0000","last_clean":"2024-09-12T19:28:35.712307+0000","last_became_active":"2024-09-12T17:58:40.187590+0000","last_became_peered":"2024-09-12T17:58:40.187590+0000","last_unstale":"2024-09-12T19:28:35.712307+0000","last_undegraded":"2024-09-12T19:28:35.712307+0000","last_fullsized":"2024-09-12T19:28:35.712307+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:15.651076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'13","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.346788+0000","last_change":"2024-09-12T17:52:39.881326+0000","last_active":"2024-09-12T19:25:50.346788+0000","last_peered":"2024-09-12T19:25:50.346788+0000","last_clean":"2024-09-12T19:25:50.346788+0000","last_became_active":"2024-09-12T17:52:39.872599+0000","last_became_peered":"2024-09-12T17:52:39.872599+0000","last_unstale":"2024-09-12T19:25:50.346788+0000","last_undegraded":"2024-09-12T19:25:50.346788+0000","last_fullsized":"2024-09-12T19:25:50.346788+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:37.156957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.249303+0000","last_change":"2024-09-12T18:25:52.612438+0000","last_active":"2024-09-12T19:26:15.249303+0000","last_peered":"2024-09-12T19:26:15.249303+0000","last_clean":"2024-09-12T19:26:15.249303+0000","last_became_active":"2024-09-12T18:25:52.611377+0000","last_became_peered":"2024-09-12T18:25:52.611377+0000","last_unstale":"2024-09-12T19:26:15.249303+0000","last_undegraded":"2024-09-12T19:26:15.249303+0000","last_fullsized":"2024-09-12T19:26:15.249303+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:57.823730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'2","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:40.610123+0000","last_change":"2024-09-12T17:58:47.243005+0000","last_active":"2024-09-12T19:27:40.610123+0000","last_peered":"2024-09-12T19:27:40.610123+0000","last_clean":"2024-09-12T19:27:40.610123+0000","last_became_active":"2024-09-12T17:58:47.242171+0000","last_became_peered":"2024-09-12T17:58:47.242171+0000","last_unstale":"2024-09-12T19:27:40.610123+0000","last_undegraded":"2024-09-12T19:27:40.610123+0000","last_fullsized":"2024-09-12T19:27:40.610123+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:43.801606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.256971+0000","last_change":"2024-09-12T17:58:40.211247+0000","last_active":"2024-09-12T19:27:30.256971+0000","last_peered":"2024-09-12T19:27:30.256971+0000","last_clean":"2024-09-12T19:27:30.256971+0000","last_became_active":"2024-09-12T17:58:40.210485+0000","last_became_peered":"2024-09-12T17:58:40.210485+0000","last_unstale":"2024-09-12T19:27:30.256971+0000","last_undegraded":"2024-09-12T19:27:30.256971+0000","last_fullsized":"2024-09-12T19:27:30.256971+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:45.166206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'25","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.248017+0000","last_change":"2024-09-12T17:52:39.880057+0000","last_active":"2024-09-12T19:26:50.248017+0000","last_peered":"2024-09-12T19:26:50.248017+0000","last_clean":"2024-09-12T19:26:50.248017+0000","last_became_active":"2024-09-12T17:52:39.868837+0000","last_became_peered":"2024-09-12T17:52:39.868837+0000","last_unstale":"2024-09-12T19:26:50.248017+0000","last_undegraded":"2024-09-12T19:26:50.248017+0000","last_fullsized":"2024-09-12T19:26:50.248017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.133723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.353905+0000","last_change":"2024-09-12T18:25:52.615446+0000","last_active":"2024-09-12T19:26:20.353905+0000","last_peered":"2024-09-12T19:26:20.353905+0000","last_clean":"2024-09-12T19:26:20.353905+0000","last_became_active":"2024-09-12T18:25:52.611546+0000","last_became_peered":"2024-09-12T18:25:52.611546+0000","last_unstale":"2024-09-12T19:26:20.353905+0000","last_undegraded":"2024-09-12T19:26:20.353905+0000","last_fullsized":"2024-09-12T19:26:20.353905+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:59.006168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'7","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.809137+0000","last_change":"2024-09-12T17:58:47.246295+0000","last_active":"2024-09-12T19:29:41.809137+0000","last_peered":"2024-09-12T19:29:41.809137+0000","last_clean":"2024-09-12T19:29:41.809137+0000","last_became_active":"2024-09-12T17:58:47.245441+0000","last_became_peered":"2024-09-12T17:58:47.245441+0000","last_unstale":"2024-09-12T19:29:41.809137+0000","last_undegraded":"2024-09-12T19:29:41.809137+0000","last_fullsized":"2024-09-12T19:29:41.809137+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:06.410509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.401205+0000","last_change":"2024-09-12T17:58:40.192872+0000","last_active":"2024-09-12T19:29:40.401205+0000","last_peered":"2024-09-12T19:29:40.401205+0000","last_clean":"2024-09-12T19:29:40.401205+0000","last_became_active":"2024-09-12T17:58:40.191999+0000","last_became_peered":"2024-09-12T17:58:40.191999+0000","last_unstale":"2024-09-12T19:29:40.401205+0000","last_undegraded":"2024-09-12T19:29:40.401205+0000","last_fullsized":"2024-09-12T19:29:40.401205+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.003714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'36","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664694+0000","last_change":"2024-09-12T17:52:39.891322+0000","last_active":"2024-09-12T19:26:25.664694+0000","last_peered":"2024-09-12T19:26:25.664694+0000","last_clean":"2024-09-12T19:26:25.664694+0000","last_became_active":"2024-09-12T17:52:39.890678+0000","last_became_peered":"2024-09-12T17:52:39.890678+0000","last_unstale":"2024-09-12T19:26:25.664694+0000","last_undegraded":"2024-09-12T19:26:25.664694+0000","last_fullsized":"2024-09-12T19:26:25.664694+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:49.955143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667105+0000","last_change":"2024-09-12T18:25:52.612356+0000","last_active":"2024-09-12T19:26:35.667105+0000","last_peered":"2024-09-12T19:26:35.667105+0000","last_clean":"2024-09-12T19:26:35.667105+0000","last_became_active":"2024-09-12T18:25:52.611397+0000","last_became_peered":"2024-09-12T18:25:52.611397+0000","last_unstale":"2024-09-12T19:26:35.667105+0000","last_undegraded":"2024-09-12T19:26:35.667105+0000","last_fullsized":"2024-09-12T19:26:35.667105+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:59.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:25.709867+0000","last_change":"2024-09-12T17:58:47.241676+0000","last_active":"2024-09-12T19:28:25.709867+0000","last_peered":"2024-09-12T19:28:25.709867+0000","last_clean":"2024-09-12T19:28:25.709867+0000","last_became_active":"2024-09-12T17:58:47.240951+0000","last_became_peered":"2024-09-12T17:58:47.240951+0000","last_unstale":"2024-09-12T19:28:25.709867+0000","last_undegraded":"2024-09-12T19:28:25.709867+0000","last_fullsized":"2024-09-12T19:28:25.709867+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:38.662807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:05.277008+0000","last_change":"2024-09-12T17:58:40.212464+0000","last_active":"2024-09-12T19:29:05.277008+0000","last_peered":"2024-09-12T19:29:05.277008+0000","last_clean":"2024-09-12T19:29:05.277008+0000","last_became_active":"2024-09-12T17:58:40.211891+0000","last_became_peered":"2024-09-12T17:58:40.211891+0000","last_unstale":"2024-09-12T19:29:05.277008+0000","last_undegraded":"2024-09-12T19:29:05.277008+0000","last_fullsized":"2024-09-12T19:29:05.277008+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:27.802674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'53","reported_seq":225,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242648+0000","last_change":"2024-09-12T17:52:39.879319+0000","last_active":"2024-09-12T19:26:25.242648+0000","last_peered":"2024-09-12T19:26:25.242648+0000","last_clean":"2024-09-12T19:26:25.242648+0000","last_became_active":"2024-09-12T17:52:39.878694+0000","last_became_peered":"2024-09-12T17:52:39.878694+0000","last_unstale":"2024-09-12T19:26:25.242648+0000","last_undegraded":"2024-09-12T19:26:25.242648+0000","last_fullsized":"2024-09-12T19:26:25.242648+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:48.298171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":199,"num_write":92,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.685676+0000","last_change":"2024-09-12T18:25:52.620080+0000","last_active":"2024-09-12T19:26:35.685676+0000","last_peered":"2024-09-12T19:26:35.685676+0000","last_clean":"2024-09-12T19:26:35.685676+0000","last_became_active":"2024-09-12T18:25:52.619540+0000","last_became_peered":"2024-09-12T18:25:52.619540+0000","last_unstale":"2024-09-12T19:26:35.685676+0000","last_undegraded":"2024-09-12T19:26:35.685676+0000","last_fullsized":"2024-09-12T19:26:35.685676+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:07.956389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368657+0000","last_change":"2024-09-12T17:58:47.245205+0000","last_active":"2024-09-12T19:27:20.368657+0000","last_peered":"2024-09-12T19:27:20.368657+0000","last_clean":"2024-09-12T19:27:20.368657+0000","last_became_active":"2024-09-12T17:58:47.238232+0000","last_became_peered":"2024-09-12T17:58:47.238232+0000","last_unstale":"2024-09-12T19:27:20.368657+0000","last_undegraded":"2024-09-12T19:27:20.368657+0000","last_fullsized":"2024-09-12T19:27:20.368657+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:59.889739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"262'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.351356+0000","last_change":"2024-09-12T17:58:40.198949+0000","last_active":"2024-09-12T19:26:10.351356+0000","last_peered":"2024-09-12T19:26:10.351356+0000","last_clean":"2024-09-12T19:26:10.351356+0000","last_became_active":"2024-09-12T17:58:40.197815+0000","last_became_peered":"2024-09-12T17:58:40.197815+0000","last_unstale":"2024-09-12T19:26:10.351356+0000","last_undegraded":"2024-09-12T19:26:10.351356+0000","last_fullsized":"2024-09-12T19:26:10.351356+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:15.963939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'72","reported_seq":273,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355384+0000","last_change":"2024-09-12T17:52:39.876517+0000","last_active":"2024-09-12T19:26:25.355384+0000","last_peered":"2024-09-12T19:26:25.355384+0000","last_clean":"2024-09-12T19:26:25.355384+0000","last_became_active":"2024-09-12T17:52:39.872148+0000","last_became_peered":"2024-09-12T17:52:39.872148+0000","last_unstale":"2024-09-12T19:26:25.355384+0000","last_undegraded":"2024-09-12T19:26:25.355384+0000","last_fullsized":"2024-09-12T19:26:25.355384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.681891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":261,"num_write":116,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250622+0000","last_change":"2024-09-12T18:25:52.624296+0000","last_active":"2024-09-12T19:26:20.250622+0000","last_peered":"2024-09-12T19:26:20.250622+0000","last_clean":"2024-09-12T19:26:20.250622+0000","last_became_active":"2024-09-12T18:25:52.623635+0000","last_became_peered":"2024-09-12T18:25:52.623635+0000","last_unstale":"2024-09-12T19:26:20.250622+0000","last_undegraded":"2024-09-12T19:26:20.250622+0000","last_fullsized":"2024-09-12T19:26:20.250622+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:13.996677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"265'9","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.364060+0000","last_change":"2024-09-12T17:58:47.251669+0000","last_active":"2024-09-12T19:29:41.364060+0000","last_peered":"2024-09-12T19:29:41.364060+0000","last_clean":"2024-09-12T19:29:41.364060+0000","last_became_active":"2024-09-12T17:58:47.250762+0000","last_became_peered":"2024-09-12T17:58:47.250762+0000","last_unstale":"2024-09-12T19:29:41.364060+0000","last_undegraded":"2024-09-12T19:29:41.364060+0000","last_fullsized":"2024-09-12T19:29:41.364060+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:16.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9216,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:09.038722+0000","last_change":"2024-09-12T17:58:40.210753+0000","last_active":"2024-09-12T19:26:09.038722+0000","last_peered":"2024-09-12T19:26:09.038722+0000","last_clean":"2024-09-12T19:26:09.038722+0000","last_became_active":"2024-09-12T17:58:40.210072+0000","last_became_peered":"2024-09-12T17:58:40.210072+0000","last_unstale":"2024-09-12T19:26:09.038722+0000","last_undegraded":"2024-09-12T19:26:09.038722+0000","last_fullsized":"2024-09-12T19:26:09.038722+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.700767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'26","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355281+0000","last_change":"2024-09-12T17:52:39.872036+0000","last_active":"2024-09-12T19:26:25.355281+0000","last_peered":"2024-09-12T19:26:25.355281+0000","last_clean":"2024-09-12T19:26:25.355281+0000","last_became_active":"2024-09-12T17:52:39.871247+0000","last_became_peered":"2024-09-12T17:52:39.871247+0000","last_unstale":"2024-09-12T19:26:25.355281+0000","last_undegraded":"2024-09-12T19:26:25.355281+0000","last_fullsized":"2024-09-12T19:26:25.355281+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:34.468531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":46,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.359612+0000","last_change":"2024-09-12T18:25:52.622440+0000","last_active":"2024-09-12T19:26:40.359612+0000","last_peered":"2024-09-12T19:26:40.359612+0000","last_clean":"2024-09-12T19:26:40.359612+0000","last_became_active":"2024-09-12T18:25:52.621808+0000","last_became_peered":"2024-09-12T18:25:52.621808+0000","last_unstale":"2024-09-12T19:26:40.359612+0000","last_undegraded":"2024-09-12T19:26:40.359612+0000","last_fullsized":"2024-09-12T19:26:40.359612+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:05.559442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:25.268945+0000","last_change":"2024-09-12T17:58:47.236975+0000","last_active":"2024-09-12T19:28:25.268945+0000","last_peered":"2024-09-12T19:28:25.268945+0000","last_clean":"2024-09-12T19:28:25.268945+0000","last_became_active":"2024-09-12T17:58:47.236237+0000","last_became_peered":"2024-09-12T17:58:47.236237+0000","last_unstale":"2024-09-12T19:28:25.268945+0000","last_undegraded":"2024-09-12T19:28:25.268945+0000","last_fullsized":"2024-09-12T19:28:25.268945+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:34.439221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'8","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.732882+0000","last_change":"2024-09-12T17:58:40.207822+0000","last_active":"2024-09-12T19:29:41.732882+0000","last_peered":"2024-09-12T19:29:41.732882+0000","last_clean":"2024-09-12T19:29:41.732882+0000","last_became_active":"2024-09-12T17:58:40.207179+0000","last_became_peered":"2024-09-12T17:58:40.207179+0000","last_unstale":"2024-09-12T19:29:41.732882+0000","last_undegraded":"2024-09-12T19:29:41.732882+0000","last_fullsized":"2024-09-12T19:29:41.732882+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:00.148566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'9","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250774+0000","last_change":"2024-09-12T17:52:39.884615+0000","last_active":"2024-09-12T19:27:05.250774+0000","last_peered":"2024-09-12T19:27:05.250774+0000","last_clean":"2024-09-12T19:27:05.250774+0000","last_became_active":"2024-09-12T17:52:39.883782+0000","last_became_peered":"2024-09-12T17:52:39.883782+0000","last_unstale":"2024-09-12T19:27:05.250774+0000","last_undegraded":"2024-09-12T19:27:05.250774+0000","last_fullsized":"2024-09-12T19:27:05.250774+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:22.293480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'333","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.394958+0000","last_change":"2024-09-12T17:36:34.874827+0000","last_active":"2024-09-12T19:29:42.394958+0000","last_peered":"2024-09-12T19:29:42.394958+0000","last_clean":"2024-09-12T19:29:42.394958+0000","last_became_active":"2024-09-12T17:36:34.874529+0000","last_became_peered":"2024-09-12T17:36:34.874529+0000","last_unstale":"2024-09-12T19:29:42.394958+0000","last_undegraded":"2024-09-12T19:29:42.394958+0000","last_fullsized":"2024-09-12T19:29:42.394958+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:19.340681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424460,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":579,"num_read_kb":47675,"num_write":1041,"num_write_kb":57869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'948","reported_seq":2619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.087864+0000","last_change":"2024-09-12T17:36:36.882005+0000","last_active":"2024-09-12T19:26:40.087864+0000","last_peered":"2024-09-12T19:26:40.087864+0000","last_clean":"2024-09-12T19:26:40.087864+0000","last_became_active":"2024-09-12T17:36:36.881586+0000","last_became_peered":"2024-09-12T17:36:36.881586+0000","last_unstale":"2024-09-12T19:26:40.087864+0000","last_undegraded":"2024-09-12T19:26:40.087864+0000","last_fullsized":"2024-09-12T19:26:40.087864+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:20.270667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4539,"num_read_kb":4030,"num_write":1302,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'359","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.348700+0000","last_change":"2024-09-12T17:36:34.886842+0000","last_active":"2024-09-12T19:29:42.348700+0000","last_peered":"2024-09-12T19:29:42.348700+0000","last_clean":"2024-09-12T19:29:42.348700+0000","last_became_active":"2024-09-12T17:36:34.886040+0000","last_became_peered":"2024-09-12T17:36:34.886040+0000","last_unstale":"2024-09-12T19:29:42.348700+0000","last_undegraded":"2024-09-12T19:29:42.348700+0000","last_fullsized":"2024-09-12T19:29:42.348700+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:53.879522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1749425,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":512,"num_read_kb":42124,"num_write":1111,"num_write_kb":49494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'796","reported_seq":2316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.047571+0000","last_change":"2024-09-12T17:36:36.875611+0000","last_active":"2024-09-12T19:29:21.047571+0000","last_peered":"2024-09-12T19:29:21.047571+0000","last_clean":"2024-09-12T19:29:21.047571+0000","last_became_active":"2024-09-12T17:36:36.875285+0000","last_became_peered":"2024-09-12T17:36:36.875285+0000","last_unstale":"2024-09-12T19:29:21.047571+0000","last_undegraded":"2024-09-12T19:29:21.047571+0000","last_fullsized":"2024-09-12T19:29:21.047571+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:54.905863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3836,"num_read_kb":3465,"num_write":1049,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'346","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.389200+0000","last_change":"2024-09-12T17:36:34.873831+0000","last_active":"2024-09-12T19:29:42.389200+0000","last_peered":"2024-09-12T19:29:42.389200+0000","last_clean":"2024-09-12T19:29:42.389200+0000","last_became_active":"2024-09-12T17:36:34.871993+0000","last_became_peered":"2024-09-12T17:36:34.871993+0000","last_unstale":"2024-09-12T19:29:42.389200+0000","last_undegraded":"2024-09-12T19:29:42.389200+0000","last_fullsized":"2024-09-12T19:29:42.389200+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:33.922670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":16153,"num_write":1071,"num_write_kb":33332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'911","reported_seq":2448,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:53.304327+0000","last_change":"2024-09-12T17:36:36.885378+0000","last_active":"2024-09-12T19:26:53.304327+0000","last_peered":"2024-09-12T19:26:53.304327+0000","last_clean":"2024-09-12T19:26:53.304327+0000","last_became_active":"2024-09-12T17:36:36.883008+0000","last_became_peered":"2024-09-12T17:36:36.883008+0000","last_unstale":"2024-09-12T19:26:53.304327+0000","last_undegraded":"2024-09-12T19:26:53.304327+0000","last_fullsized":"2024-09-12T19:26:53.304327+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":900,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:58.093073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4392,"num_read_kb":3928,"num_write":1272,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'357","reported_seq":1044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.355049+0000","last_change":"2024-09-12T17:36:34.871813+0000","last_active":"2024-09-12T19:29:42.355049+0000","last_peered":"2024-09-12T19:29:42.355049+0000","last_clean":"2024-09-12T19:29:42.355049+0000","last_became_active":"2024-09-12T17:36:34.871414+0000","last_became_peered":"2024-09-12T17:36:34.871414+0000","last_unstale":"2024-09-12T19:29:42.355049+0000","last_undegraded":"2024-09-12T19:29:42.355049+0000","last_fullsized":"2024-09-12T19:29:42.355049+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:37.103933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":504,"num_read_kb":53693,"num_write":1108,"num_write_kb":40210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'837","reported_seq":2343,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686623+0000","last_change":"2024-09-12T17:36:36.902897+0000","last_active":"2024-09-12T19:26:40.686623+0000","last_peered":"2024-09-12T19:26:40.686623+0000","last_clean":"2024-09-12T19:26:40.686623+0000","last_became_active":"2024-09-12T17:36:36.902241+0000","last_became_peered":"2024-09-12T17:36:36.902241+0000","last_unstale":"2024-09-12T19:26:40.686623+0000","last_undegraded":"2024-09-12T19:26:40.686623+0000","last_fullsized":"2024-09-12T19:26:40.686623+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:25.892315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3905,"num_read_kb":3484,"num_write":1127,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'347","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.351545+0000","last_change":"2024-09-12T17:36:34.890708+0000","last_active":"2024-09-12T19:29:42.351545+0000","last_peered":"2024-09-12T19:29:42.351545+0000","last_clean":"2024-09-12T19:29:42.351545+0000","last_became_active":"2024-09-12T17:36:34.890281+0000","last_became_peered":"2024-09-12T17:36:34.890281+0000","last_unstale":"2024-09-12T19:29:42.351545+0000","last_undegraded":"2024-09-12T19:29:42.351545+0000","last_fullsized":"2024-09-12T19:29:42.351545+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:59.249812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":533,"num_read_kb":3791,"num_write":1159,"num_write_kb":30376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'481","reported_seq":2174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602973+0000","last_change":"2024-09-12T17:36:36.899570+0000","last_active":"2024-09-12T19:27:05.602973+0000","last_peered":"2024-09-12T19:27:05.602973+0000","last_clean":"2024-09-12T19:27:05.602973+0000","last_became_active":"2024-09-12T17:36:36.899249+0000","last_became_peered":"2024-09-12T17:36:36.899249+0000","last_unstale":"2024-09-12T19:27:05.602973+0000","last_undegraded":"2024-09-12T19:27:05.602973+0000","last_fullsized":"2024-09-12T19:27:05.602973+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:17.239845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2730,"num_read_kb":2583,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'373","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.405347+0000","last_change":"2024-09-12T17:36:34.871230+0000","last_active":"2024-09-12T19:29:42.405347+0000","last_peered":"2024-09-12T19:29:42.405347+0000","last_clean":"2024-09-12T19:29:42.405347+0000","last_became_active":"2024-09-12T17:36:34.870994+0000","last_became_peered":"2024-09-12T17:36:34.870994+0000","last_unstale":"2024-09-12T19:29:42.405347+0000","last_undegraded":"2024-09-12T19:29:42.405347+0000","last_fullsized":"2024-09-12T19:29:42.405347+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:08.263522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526411,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":2344,"num_write":1206,"num_write_kb":29584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'374","reported_seq":1826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.603010+0000","last_change":"2024-09-12T17:36:36.897967+0000","last_active":"2024-09-12T19:27:05.603010+0000","last_peered":"2024-09-12T19:27:05.603010+0000","last_clean":"2024-09-12T19:27:05.603010+0000","last_became_active":"2024-09-12T17:36:36.897609+0000","last_became_peered":"2024-09-12T17:36:36.897609+0000","last_unstale":"2024-09-12T19:27:05.603010+0000","last_undegraded":"2024-09-12T19:27:05.603010+0000","last_fullsized":"2024-09-12T19:27:05.603010+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:31.958437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2010,"num_read_kb":1904,"num_write":440,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'353","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.385976+0000","last_change":"2024-09-12T17:36:34.859377+0000","last_active":"2024-09-12T19:29:42.385976+0000","last_peered":"2024-09-12T19:29:42.385976+0000","last_clean":"2024-09-12T19:29:42.385976+0000","last_became_active":"2024-09-12T17:36:34.859023+0000","last_became_peered":"2024-09-12T17:36:34.859023+0000","last_unstale":"2024-09-12T19:29:42.385976+0000","last_undegraded":"2024-09-12T19:29:42.385976+0000","last_fullsized":"2024-09-12T19:29:42.385976+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:13.591648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136901,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1894,"num_write":1220,"num_write_kb":19389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'831","reported_seq":2372,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.367029+0000","last_change":"2024-09-12T17:36:36.914649+0000","last_active":"2024-09-12T19:28:00.367029+0000","last_peered":"2024-09-12T19:28:00.367029+0000","last_clean":"2024-09-12T19:28:00.367029+0000","last_became_active":"2024-09-12T17:36:36.914366+0000","last_became_peered":"2024-09-12T17:36:36.914366+0000","last_unstale":"2024-09-12T19:28:00.367029+0000","last_undegraded":"2024-09-12T19:28:00.367029+0000","last_fullsized":"2024-09-12T19:28:00.367029+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:37.673498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4038,"num_read_kb":3626,"num_write":1143,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'338","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.401260+0000","last_change":"2024-09-12T17:36:34.883337+0000","last_active":"2024-09-12T19:29:42.401260+0000","last_peered":"2024-09-12T19:29:42.401260+0000","last_clean":"2024-09-12T19:29:42.401260+0000","last_became_active":"2024-09-12T17:36:34.882704+0000","last_became_peered":"2024-09-12T17:36:34.882704+0000","last_unstale":"2024-09-12T19:29:42.401260+0000","last_undegraded":"2024-09-12T19:29:42.401260+0000","last_fullsized":"2024-09-12T19:29:42.401260+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:19.965473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2535846,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":64003,"num_write":1113,"num_write_kb":46422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1166","reported_seq":2735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261311+0000","last_change":"2024-09-12T17:36:36.889657+0000","last_active":"2024-09-12T19:27:05.261311+0000","last_peered":"2024-09-12T19:27:05.261311+0000","last_clean":"2024-09-12T19:27:05.261311+0000","last_became_active":"2024-09-12T17:36:36.888829+0000","last_became_peered":"2024-09-12T17:36:36.888829+0000","last_unstale":"2024-09-12T19:27:05.261311+0000","last_undegraded":"2024-09-12T19:27:05.261311+0000","last_fullsized":"2024-09-12T19:27:05.261311+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:42.143143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5211,"num_read_kb":4613,"num_write":1589,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'494","reported_seq":2221,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181954+0000","last_change":"2024-09-12T17:36:36.905062+0000","last_active":"2024-09-12T19:27:10.181954+0000","last_peered":"2024-09-12T19:27:10.181954+0000","last_clean":"2024-09-12T19:27:10.181954+0000","last_became_active":"2024-09-12T17:36:36.904820+0000","last_became_peered":"2024-09-12T17:36:36.904820+0000","last_unstale":"2024-09-12T19:27:10.181954+0000","last_undegraded":"2024-09-12T19:27:10.181954+0000","last_fullsized":"2024-09-12T19:27:10.181954+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:38.103419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2913,"num_read_kb":2753,"num_write":585,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'368","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.364795+0000","last_change":"2024-09-12T17:36:34.866831+0000","last_active":"2024-09-12T19:29:42.364795+0000","last_peered":"2024-09-12T19:29:42.364795+0000","last_clean":"2024-09-12T19:29:42.364795+0000","last_became_active":"2024-09-12T17:36:34.866283+0000","last_became_peered":"2024-09-12T17:36:34.866283+0000","last_unstale":"2024-09-12T19:29:42.364795+0000","last_undegraded":"2024-09-12T19:29:42.364795+0000","last_fullsized":"2024-09-12T19:29:42.364795+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:57.776484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":73276,"num_write":1099,"num_write_kb":24135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'478","reported_seq":2093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.032911+0000","last_change":"2024-09-12T17:36:36.911581+0000","last_active":"2024-09-12T19:29:21.032911+0000","last_peered":"2024-09-12T19:29:21.032911+0000","last_clean":"2024-09-12T19:29:21.032911+0000","last_became_active":"2024-09-12T17:36:36.911310+0000","last_became_peered":"2024-09-12T17:36:36.911310+0000","last_unstale":"2024-09-12T19:29:21.032911+0000","last_undegraded":"2024-09-12T19:29:21.032911+0000","last_fullsized":"2024-09-12T19:29:21.032911+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.005619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2526,"num_read_kb":2384,"num_write":531,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'347","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.400375+0000","last_change":"2024-09-12T17:36:34.865767+0000","last_active":"2024-09-12T19:29:42.400375+0000","last_peered":"2024-09-12T19:29:42.400375+0000","last_clean":"2024-09-12T19:29:42.400375+0000","last_became_active":"2024-09-12T17:36:34.865119+0000","last_became_peered":"2024-09-12T17:36:34.865119+0000","last_unstale":"2024-09-12T19:29:42.400375+0000","last_undegraded":"2024-09-12T19:29:42.400375+0000","last_fullsized":"2024-09-12T19:29:42.400375+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:35.180554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109517,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":573,"num_read_kb":7316,"num_write":1055,"num_write_kb":28671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'738","reported_seq":2229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.121403+0000","last_change":"2024-09-12T17:36:36.886366+0000","last_active":"2024-09-12T19:28:32.121403+0000","last_peered":"2024-09-12T19:28:32.121403+0000","last_clean":"2024-09-12T19:28:32.121403+0000","last_became_active":"2024-09-12T17:36:36.885876+0000","last_became_peered":"2024-09-12T17:36:36.885876+0000","last_unstale":"2024-09-12T19:28:32.121403+0000","last_undegraded":"2024-09-12T19:28:32.121403+0000","last_fullsized":"2024-09-12T19:28:32.121403+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:38.338908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3432,"num_read_kb":3117,"num_write":958,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'387","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.364662+0000","last_change":"2024-09-12T17:36:34.873997+0000","last_active":"2024-09-12T19:29:42.364662+0000","last_peered":"2024-09-12T19:29:42.364662+0000","last_clean":"2024-09-12T19:29:42.364662+0000","last_became_active":"2024-09-12T17:36:34.873456+0000","last_became_peered":"2024-09-12T17:36:34.873456+0000","last_unstale":"2024-09-12T19:29:42.364662+0000","last_undegraded":"2024-09-12T19:29:42.364662+0000","last_fullsized":"2024-09-12T19:29:42.364662+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:57.720538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":11973,"num_write":1244,"num_write_kb":23205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'620","reported_seq":2306,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.394693+0000","last_change":"2024-09-12T17:36:36.900540+0000","last_active":"2024-09-12T19:25:54.394693+0000","last_peered":"2024-09-12T19:25:54.394693+0000","last_clean":"2024-09-12T19:25:54.394693+0000","last_became_active":"2024-09-12T17:36:36.899850+0000","last_became_peered":"2024-09-12T17:36:36.899850+0000","last_unstale":"2024-09-12T19:25:54.394693+0000","last_undegraded":"2024-09-12T19:25:54.394693+0000","last_fullsized":"2024-09-12T19:25:54.394693+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:39.690377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3224,"num_read_kb":2959,"num_write":847,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'336","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.396375+0000","last_change":"2024-09-12T17:36:34.864903+0000","last_active":"2024-09-12T19:29:42.396375+0000","last_peered":"2024-09-12T19:29:42.396375+0000","last_clean":"2024-09-12T19:29:42.396375+0000","last_became_active":"2024-09-12T17:36:34.864547+0000","last_became_peered":"2024-09-12T17:36:34.864547+0000","last_unstale":"2024-09-12T19:29:42.396375+0000","last_undegraded":"2024-09-12T19:29:42.396375+0000","last_fullsized":"2024-09-12T19:29:42.396375+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:37.836961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":555,"num_read_kb":20889,"num_write":1050,"num_write_kb":32386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'297","reported_seq":1673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.565486+0000","last_change":"2024-09-12T17:36:36.875932+0000","last_active":"2024-09-12T19:28:02.565486+0000","last_peered":"2024-09-12T19:28:02.565486+0000","last_clean":"2024-09-12T19:28:02.565486+0000","last_became_active":"2024-09-12T17:36:36.873937+0000","last_became_peered":"2024-09-12T17:36:36.873937+0000","last_unstale":"2024-09-12T19:28:02.565486+0000","last_undegraded":"2024-09-12T19:28:02.565486+0000","last_fullsized":"2024-09-12T19:28:02.565486+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:57.251507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1689,"num_read_kb":1636,"num_write":323,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'370","reported_seq":1133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.400711+0000","last_change":"2024-09-12T17:36:34.881828+0000","last_active":"2024-09-12T19:29:42.400711+0000","last_peered":"2024-09-12T19:29:42.400711+0000","last_clean":"2024-09-12T19:29:42.400711+0000","last_became_active":"2024-09-12T17:36:34.880986+0000","last_became_peered":"2024-09-12T17:36:34.880986+0000","last_unstale":"2024-09-12T19:29:42.400711+0000","last_undegraded":"2024-09-12T19:29:42.400711+0000","last_fullsized":"2024-09-12T19:29:42.400711+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:28.093624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1802093,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":10570,"num_write":1059,"num_write_kb":33432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'404","reported_seq":1892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.398707+0000","last_change":"2024-09-12T17:36:36.881697+0000","last_active":"2024-09-12T19:25:54.398707+0000","last_peered":"2024-09-12T19:25:54.398707+0000","last_clean":"2024-09-12T19:25:54.398707+0000","last_became_active":"2024-09-12T17:36:36.881228+0000","last_became_peered":"2024-09-12T17:36:36.881228+0000","last_unstale":"2024-09-12T19:25:54.398707+0000","last_undegraded":"2024-09-12T19:25:54.398707+0000","last_fullsized":"2024-09-12T19:25:54.398707+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:17.469345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2076,"num_read_kb":1970,"num_write":455,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'417","reported_seq":1178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.385795+0000","last_change":"2024-09-12T17:36:34.879064+0000","last_active":"2024-09-12T19:29:42.385795+0000","last_peered":"2024-09-12T19:29:42.385795+0000","last_clean":"2024-09-12T19:29:42.385795+0000","last_became_active":"2024-09-12T17:36:34.878377+0000","last_became_peered":"2024-09-12T17:36:34.878377+0000","last_unstale":"2024-09-12T19:29:42.385795+0000","last_undegraded":"2024-09-12T19:29:42.385795+0000","last_fullsized":"2024-09-12T19:29:42.385795+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:13.927187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":879,"num_read_kb":13596,"num_write":1342,"num_write_kb":22678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'109","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.849979+0000","last_change":"2024-09-12T17:36:44.936393+0000","last_active":"2024-09-12T19:28:02.849979+0000","last_peered":"2024-09-12T19:28:02.849979+0000","last_clean":"2024-09-12T19:28:02.849979+0000","last_became_active":"2024-09-12T17:36:44.934662+0000","last_became_peered":"2024-09-12T17:36:44.934662+0000","last_unstale":"2024-09-12T19:28:02.849979+0000","last_undegraded":"2024-09-12T19:28:02.849979+0000","last_fullsized":"2024-09-12T19:28:02.849979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:30.459321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'640","reported_seq":2289,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:44.046417+0000","last_change":"2024-09-12T17:36:36.914077+0000","last_active":"2024-09-12T19:26:44.046417+0000","last_peered":"2024-09-12T19:26:44.046417+0000","last_clean":"2024-09-12T19:26:44.046417+0000","last_became_active":"2024-09-12T17:36:36.913372+0000","last_became_peered":"2024-09-12T17:36:36.913372+0000","last_unstale":"2024-09-12T19:26:44.046417+0000","last_undegraded":"2024-09-12T19:26:44.046417+0000","last_fullsized":"2024-09-12T19:26:44.046417+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:28.282227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3256,"num_read_kb":2969,"num_write":868,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'391","reported_seq":1069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.364155+0000","last_change":"2024-09-12T17:36:34.866247+0000","last_active":"2024-09-12T19:29:42.364155+0000","last_peered":"2024-09-12T19:29:42.364155+0000","last_clean":"2024-09-12T19:29:42.364155+0000","last_became_active":"2024-09-12T17:36:34.865894+0000","last_became_peered":"2024-09-12T17:36:34.865894+0000","last_unstale":"2024-09-12T19:29:42.364155+0000","last_undegraded":"2024-09-12T19:29:42.364155+0000","last_fullsized":"2024-09-12T19:29:42.364155+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:18.929221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661307,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":35668,"num_write":1342,"num_write_kb":51737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.340265+0000","last_change":"2024-09-12T17:36:38.881794+0000","last_active":"2024-09-12T19:25:25.340265+0000","last_peered":"2024-09-12T19:25:25.340265+0000","last_clean":"2024-09-12T19:25:25.340265+0000","last_became_active":"2024-09-12T17:36:38.881044+0000","last_became_peered":"2024-09-12T17:36:38.881044+0000","last_unstale":"2024-09-12T19:25:25.340265+0000","last_undegraded":"2024-09-12T19:25:25.340265+0000","last_fullsized":"2024-09-12T19:25:25.340265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:18.605129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'386","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.075230+0000","last_change":"2024-09-12T17:36:40.907618+0000","last_active":"2024-09-12T19:29:42.075230+0000","last_peered":"2024-09-12T19:29:42.075230+0000","last_clean":"2024-09-12T19:29:42.075230+0000","last_became_active":"2024-09-12T17:36:40.906825+0000","last_became_peered":"2024-09-12T17:36:40.906825+0000","last_unstale":"2024-09-12T19:29:42.075230+0000","last_undegraded":"2024-09-12T19:29:42.075230+0000","last_fullsized":"2024-09-12T19:29:42.075230+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:34.227775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":626,"num_read_kb":1284,"num_write":492,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.073133+0000","last_change":"2024-09-12T17:36:42.929571+0000","last_active":"2024-09-12T19:25:30.073133+0000","last_peered":"2024-09-12T19:25:30.073133+0000","last_clean":"2024-09-12T19:25:30.073133+0000","last_became_active":"2024-09-12T17:36:42.928794+0000","last_became_peered":"2024-09-12T17:36:42.928794+0000","last_unstale":"2024-09-12T19:25:30.073133+0000","last_undegraded":"2024-09-12T19:25:30.073133+0000","last_fullsized":"2024-09-12T19:25:30.073133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:22.503558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'168","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.748607+0000","last_change":"2024-09-12T17:36:44.941028+0000","last_active":"2024-09-12T19:29:20.748607+0000","last_peered":"2024-09-12T19:29:20.748607+0000","last_clean":"2024-09-12T19:29:20.748607+0000","last_became_active":"2024-09-12T17:36:44.939447+0000","last_became_peered":"2024-09-12T17:36:44.939447+0000","last_unstale":"2024-09-12T19:29:20.748607+0000","last_undegraded":"2024-09-12T19:29:20.748607+0000","last_fullsized":"2024-09-12T19:29:20.748607+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:17.779839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":297,"num_read_kb":283,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'450","reported_seq":1944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.054779+0000","last_change":"2024-09-12T17:36:36.876325+0000","last_active":"2024-09-12T19:29:21.054779+0000","last_peered":"2024-09-12T19:29:21.054779+0000","last_clean":"2024-09-12T19:29:21.054779+0000","last_became_active":"2024-09-12T17:36:36.875459+0000","last_became_peered":"2024-09-12T17:36:36.875459+0000","last_unstale":"2024-09-12T19:29:21.054779+0000","last_undegraded":"2024-09-12T19:29:21.054779+0000","last_fullsized":"2024-09-12T19:29:21.054779+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.726119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2269,"num_read_kb":2126,"num_write":529,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'319","reported_seq":950,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.367984+0000","last_change":"2024-09-12T17:36:34.881380+0000","last_active":"2024-09-12T19:29:42.367984+0000","last_peered":"2024-09-12T19:29:42.367984+0000","last_clean":"2024-09-12T19:29:42.367984+0000","last_became_active":"2024-09-12T17:36:34.880644+0000","last_became_peered":"2024-09-12T17:36:34.880644+0000","last_unstale":"2024-09-12T19:29:42.367984+0000","last_undegraded":"2024-09-12T19:29:42.367984+0000","last_fullsized":"2024-09-12T19:29:42.367984+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.644365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174790,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":12215,"num_write":1010,"num_write_kb":18682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686717+0000","last_change":"2024-09-12T17:36:38.901489+0000","last_active":"2024-09-12T19:26:40.686717+0000","last_peered":"2024-09-12T19:26:40.686717+0000","last_clean":"2024-09-12T19:26:40.686717+0000","last_became_active":"2024-09-12T17:36:38.900684+0000","last_became_peered":"2024-09-12T17:36:38.900684+0000","last_unstale":"2024-09-12T19:26:40.686717+0000","last_undegraded":"2024-09-12T19:26:40.686717+0000","last_fullsized":"2024-09-12T19:26:40.686717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:05.502369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'126","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:31.644856+0000","last_change":"2024-09-12T17:36:40.900116+0000","last_active":"2024-09-12T19:27:31.644856+0000","last_peered":"2024-09-12T19:27:31.644856+0000","last_clean":"2024-09-12T19:27:31.644856+0000","last_became_active":"2024-09-12T17:36:40.899340+0000","last_became_peered":"2024-09-12T17:36:40.899340+0000","last_unstale":"2024-09-12T19:27:31.644856+0000","last_undegraded":"2024-09-12T19:27:31.644856+0000","last_fullsized":"2024-09-12T19:27:31.644856+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:14.476334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.073064+0000","last_change":"2024-09-12T17:36:42.932966+0000","last_active":"2024-09-12T19:25:30.073064+0000","last_peered":"2024-09-12T19:25:30.073064+0000","last_clean":"2024-09-12T19:25:30.073064+0000","last_became_active":"2024-09-12T17:36:42.932100+0000","last_became_peered":"2024-09-12T17:36:42.932100+0000","last_unstale":"2024-09-12T19:25:30.073064+0000","last_undegraded":"2024-09-12T19:25:30.073064+0000","last_fullsized":"2024-09-12T19:25:30.073064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:17.207909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'122","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:58.466580+0000","last_change":"2024-09-12T17:36:44.966580+0000","last_active":"2024-09-12T19:27:58.466580+0000","last_peered":"2024-09-12T19:27:58.466580+0000","last_clean":"2024-09-12T19:27:58.466580+0000","last_became_active":"2024-09-12T17:36:44.965913+0000","last_became_peered":"2024-09-12T17:36:44.965913+0000","last_unstale":"2024-09-12T19:27:58.466580+0000","last_undegraded":"2024-09-12T19:27:58.466580+0000","last_fullsized":"2024-09-12T19:27:58.466580+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:05.954565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":210,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'399","reported_seq":1900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.293238+0000","last_change":"2024-09-12T17:36:36.905410+0000","last_active":"2024-09-12T19:28:00.293238+0000","last_peered":"2024-09-12T19:28:00.293238+0000","last_clean":"2024-09-12T19:28:00.293238+0000","last_became_active":"2024-09-12T17:36:36.904639+0000","last_became_peered":"2024-09-12T17:36:36.904639+0000","last_unstale":"2024-09-12T19:28:00.293238+0000","last_undegraded":"2024-09-12T19:28:00.293238+0000","last_fullsized":"2024-09-12T19:28:00.293238+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:07.140445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2242,"num_read_kb":2124,"num_write":448,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'312","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.374254+0000","last_change":"2024-09-12T17:36:34.879554+0000","last_active":"2024-09-12T19:29:42.374254+0000","last_peered":"2024-09-12T19:29:42.374254+0000","last_clean":"2024-09-12T19:29:42.374254+0000","last_became_active":"2024-09-12T17:36:34.879098+0000","last_became_peered":"2024-09-12T17:36:34.879098+0000","last_unstale":"2024-09-12T19:29:42.374254+0000","last_undegraded":"2024-09-12T19:29:42.374254+0000","last_fullsized":"2024-09-12T19:29:42.374254+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:31.845547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763036,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":388,"num_read_kb":4507,"num_write":999,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.670087+0000","last_change":"2024-09-12T17:36:38.884358+0000","last_active":"2024-09-12T19:25:25.670087+0000","last_peered":"2024-09-12T19:25:25.670087+0000","last_clean":"2024-09-12T19:25:25.670087+0000","last_became_active":"2024-09-12T17:36:38.883758+0000","last_became_peered":"2024-09-12T17:36:38.883758+0000","last_unstale":"2024-09-12T19:25:25.670087+0000","last_undegraded":"2024-09-12T19:25:25.670087+0000","last_fullsized":"2024-09-12T19:25:25.670087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:23.851056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'185","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:33.286596+0000","last_change":"2024-09-12T17:36:40.908353+0000","last_active":"2024-09-12T19:27:33.286596+0000","last_peered":"2024-09-12T19:27:33.286596+0000","last_clean":"2024-09-12T19:27:33.286596+0000","last_became_active":"2024-09-12T17:36:40.907410+0000","last_became_peered":"2024-09-12T17:36:40.907410+0000","last_unstale":"2024-09-12T19:27:33.286596+0000","last_undegraded":"2024-09-12T19:27:33.286596+0000","last_fullsized":"2024-09-12T19:27:33.286596+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:48.613522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'805","reported_seq":7120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.284199+0000","last_change":"2024-09-12T17:36:42.918180+0000","last_active":"2024-09-12T19:29:42.284199+0000","last_peered":"2024-09-12T19:29:42.284199+0000","last_clean":"2024-09-12T19:29:42.284199+0000","last_became_active":"2024-09-12T17:36:42.916847+0000","last_became_peered":"2024-09-12T17:36:42.916847+0000","last_unstale":"2024-09-12T19:29:42.284199+0000","last_undegraded":"2024-09-12T19:29:42.284199+0000","last_fullsized":"2024-09-12T19:29:42.284199+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:45.795888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'223","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.042171+0000","last_change":"2024-09-12T17:36:44.958620+0000","last_active":"2024-09-12T19:28:03.042171+0000","last_peered":"2024-09-12T19:28:03.042171+0000","last_clean":"2024-09-12T19:28:03.042171+0000","last_became_active":"2024-09-12T17:36:44.954183+0000","last_became_peered":"2024-09-12T17:36:44.954183+0000","last_unstale":"2024-09-12T19:28:03.042171+0000","last_undegraded":"2024-09-12T19:28:03.042171+0000","last_fullsized":"2024-09-12T19:28:03.042171+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:52.168028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":505,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'457","reported_seq":2139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.060710+0000","last_change":"2024-09-12T17:36:36.878129+0000","last_active":"2024-09-12T19:29:21.060710+0000","last_peered":"2024-09-12T19:29:21.060710+0000","last_clean":"2024-09-12T19:29:21.060710+0000","last_became_active":"2024-09-12T17:36:36.877420+0000","last_became_peered":"2024-09-12T17:36:36.877420+0000","last_unstale":"2024-09-12T19:29:21.060710+0000","last_undegraded":"2024-09-12T19:29:21.060710+0000","last_fullsized":"2024-09-12T19:29:21.060710+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:44.309313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2635,"num_read_kb":2492,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'359","reported_seq":1069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.389082+0000","last_change":"2024-09-12T17:36:34.883169+0000","last_active":"2024-09-12T19:29:42.389082+0000","last_peered":"2024-09-12T19:29:42.389082+0000","last_clean":"2024-09-12T19:29:42.389082+0000","last_became_active":"2024-09-12T17:36:34.882902+0000","last_became_peered":"2024-09-12T17:36:34.882902+0000","last_unstale":"2024-09-12T19:29:42.389082+0000","last_undegraded":"2024-09-12T19:29:42.389082+0000","last_fullsized":"2024-09-12T19:29:42.389082+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:36.819998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":587,"num_read_kb":75125,"num_write":1046,"num_write_kb":28457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.340316+0000","last_change":"2024-09-12T17:36:38.899727+0000","last_active":"2024-09-12T19:25:25.340316+0000","last_peered":"2024-09-12T19:25:25.340316+0000","last_clean":"2024-09-12T19:25:25.340316+0000","last_became_active":"2024-09-12T17:36:38.899405+0000","last_became_peered":"2024-09-12T17:36:38.899405+0000","last_unstale":"2024-09-12T19:25:25.340316+0000","last_undegraded":"2024-09-12T19:25:25.340316+0000","last_fullsized":"2024-09-12T19:25:25.340316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:16.514700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'338","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.890794+0000","last_change":"2024-09-12T17:36:40.911431+0000","last_active":"2024-09-12T19:29:41.890794+0000","last_peered":"2024-09-12T19:29:41.890794+0000","last_clean":"2024-09-12T19:29:41.890794+0000","last_became_active":"2024-09-12T17:36:40.910700+0000","last_became_peered":"2024-09-12T17:36:40.910700+0000","last_unstale":"2024-09-12T19:29:41.890794+0000","last_undegraded":"2024-09-12T19:29:41.890794+0000","last_fullsized":"2024-09-12T19:29:41.890794+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:03.951315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54278,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":1174,"num_write":438,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'799","reported_seq":3156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.031256+0000","last_change":"2024-09-12T17:36:42.940750+0000","last_active":"2024-09-12T19:29:42.031256+0000","last_peered":"2024-09-12T19:29:42.031256+0000","last_clean":"2024-09-12T19:29:42.031256+0000","last_became_active":"2024-09-12T17:36:42.939966+0000","last_became_peered":"2024-09-12T17:36:42.939966+0000","last_unstale":"2024-09-12T19:29:42.031256+0000","last_undegraded":"2024-09-12T19:29:42.031256+0000","last_fullsized":"2024-09-12T19:29:42.031256+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:48.117866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'1125","reported_seq":2730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.116710+0000","last_change":"2024-09-12T17:36:36.886873+0000","last_active":"2024-09-12T19:28:32.116710+0000","last_peered":"2024-09-12T19:28:32.116710+0000","last_clean":"2024-09-12T19:28:32.116710+0000","last_became_active":"2024-09-12T17:36:36.886244+0000","last_became_peered":"2024-09-12T17:36:36.886244+0000","last_unstale":"2024-09-12T19:28:32.116710+0000","last_undegraded":"2024-09-12T19:28:32.116710+0000","last_fullsized":"2024-09-12T19:28:32.116710+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:16.947822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5270,"num_read_kb":4695,"num_write":1548,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'294","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.382436+0000","last_change":"2024-09-12T17:36:34.865757+0000","last_active":"2024-09-12T19:29:42.382436+0000","last_peered":"2024-09-12T19:29:42.382436+0000","last_clean":"2024-09-12T19:29:42.382436+0000","last_became_active":"2024-09-12T17:36:34.865417+0000","last_became_peered":"2024-09-12T17:36:34.865417+0000","last_unstale":"2024-09-12T19:29:42.382436+0000","last_undegraded":"2024-09-12T19:29:42.382436+0000","last_fullsized":"2024-09-12T19:29:42.382436+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:22.490874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":517,"num_read_kb":1839,"num_write":970,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.094709+0000","last_change":"2024-09-12T17:36:38.888368+0000","last_active":"2024-09-12T19:27:10.094709+0000","last_peered":"2024-09-12T19:27:10.094709+0000","last_clean":"2024-09-12T19:27:10.094709+0000","last_became_active":"2024-09-12T17:36:38.887444+0000","last_became_peered":"2024-09-12T17:36:38.887444+0000","last_unstale":"2024-09-12T19:27:10.094709+0000","last_undegraded":"2024-09-12T19:27:10.094709+0000","last_fullsized":"2024-09-12T19:27:10.094709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:57.724697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'448","reported_seq":1147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.223836+0000","last_change":"2024-09-12T17:36:40.914188+0000","last_active":"2024-09-12T19:29:42.223836+0000","last_peered":"2024-09-12T19:29:42.223836+0000","last_clean":"2024-09-12T19:29:42.223836+0000","last_became_active":"2024-09-12T17:36:40.911095+0000","last_became_peered":"2024-09-12T17:36:40.911095+0000","last_unstale":"2024-09-12T19:29:42.223836+0000","last_undegraded":"2024-09-12T19:29:42.223836+0000","last_fullsized":"2024-09-12T19:29:42.223836+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:16.975199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":738,"num_read_kb":1351,"num_write":556,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.049545+0000","last_change":"2024-09-12T17:36:42.928393+0000","last_active":"2024-09-12T19:26:59.049545+0000","last_peered":"2024-09-12T19:26:59.049545+0000","last_clean":"2024-09-12T19:26:59.049545+0000","last_became_active":"2024-09-12T17:36:42.927582+0000","last_became_peered":"2024-09-12T17:36:42.927582+0000","last_unstale":"2024-09-12T19:26:59.049545+0000","last_undegraded":"2024-09-12T19:26:59.049545+0000","last_fullsized":"2024-09-12T19:26:59.049545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:38.031907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'554","reported_seq":1399,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.053521+0000","last_change":"2024-09-12T17:36:44.958491+0000","last_active":"2024-09-12T19:29:22.053521+0000","last_peered":"2024-09-12T19:29:22.053521+0000","last_clean":"2024-09-12T19:29:22.053521+0000","last_became_active":"2024-09-12T17:36:44.953926+0000","last_became_peered":"2024-09-12T17:36:44.953926+0000","last_unstale":"2024-09-12T19:29:22.053521+0000","last_undegraded":"2024-09-12T19:29:22.053521+0000","last_fullsized":"2024-09-12T19:29:22.053521+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:32.984877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":1310,"num_write":1167,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'838","reported_seq":2541,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.040399+0000","last_change":"2024-09-12T17:36:36.886760+0000","last_active":"2024-09-12T19:29:21.040399+0000","last_peered":"2024-09-12T19:29:21.040399+0000","last_clean":"2024-09-12T19:29:21.040399+0000","last_became_active":"2024-09-12T17:36:36.886395+0000","last_became_peered":"2024-09-12T17:36:36.886395+0000","last_unstale":"2024-09-12T19:29:21.040399+0000","last_undegraded":"2024-09-12T19:29:21.040399+0000","last_fullsized":"2024-09-12T19:29:21.040399+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:47.591431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4184,"num_read_kb":3783,"num_write":1092,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'368","reported_seq":1044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.375673+0000","last_change":"2024-09-12T17:36:34.869074+0000","last_active":"2024-09-12T19:29:42.375673+0000","last_peered":"2024-09-12T19:29:42.375673+0000","last_clean":"2024-09-12T19:29:42.375673+0000","last_became_active":"2024-09-12T17:36:34.868465+0000","last_became_peered":"2024-09-12T17:36:34.868465+0000","last_unstale":"2024-09-12T19:29:42.375673+0000","last_undegraded":"2024-09-12T19:29:42.375673+0000","last_fullsized":"2024-09-12T19:29:42.375673+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:49.416583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109619,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":2937,"num_write":1162,"num_write_kb":21558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"36'3","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.739087+0000","last_change":"2024-09-12T17:36:38.907718+0000","last_active":"2024-09-12T19:29:40.739087+0000","last_peered":"2024-09-12T19:29:40.739087+0000","last_clean":"2024-09-12T19:29:40.739087+0000","last_became_active":"2024-09-12T17:36:38.907007+0000","last_became_peered":"2024-09-12T17:36:38.907007+0000","last_unstale":"2024-09-12T19:29:40.739087+0000","last_undegraded":"2024-09-12T19:29:40.739087+0000","last_fullsized":"2024-09-12T19:29:40.739087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:31.556098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'328","reported_seq":952,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.480005+0000","last_change":"2024-09-12T17:36:40.912235+0000","last_active":"2024-09-12T19:29:41.480005+0000","last_peered":"2024-09-12T19:29:41.480005+0000","last_clean":"2024-09-12T19:29:41.480005+0000","last_became_active":"2024-09-12T17:36:40.911092+0000","last_became_peered":"2024-09-12T17:36:40.911092+0000","last_unstale":"2024-09-12T19:29:41.480005+0000","last_undegraded":"2024-09-12T19:29:41.480005+0000","last_fullsized":"2024-09-12T19:29:41.480005+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:38.796270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1173,"num_write":436,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:35.698971+0000","last_change":"2024-09-12T17:36:42.937336+0000","last_active":"2024-09-12T19:27:35.698971+0000","last_peered":"2024-09-12T19:27:35.698971+0000","last_clean":"2024-09-12T19:27:35.698971+0000","last_became_active":"2024-09-12T17:36:42.933808+0000","last_became_peered":"2024-09-12T17:36:42.933808+0000","last_unstale":"2024-09-12T19:27:35.698971+0000","last_undegraded":"2024-09-12T19:27:35.698971+0000","last_fullsized":"2024-09-12T19:27:35.698971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:36.847620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'2432","reported_seq":4293,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.133108+0000","last_change":"2024-09-12T17:36:44.963412+0000","last_active":"2024-09-12T19:28:32.133108+0000","last_peered":"2024-09-12T19:28:32.133108+0000","last_clean":"2024-09-12T19:28:32.133108+0000","last_became_active":"2024-09-12T17:36:44.962630+0000","last_became_peered":"2024-09-12T17:36:44.962630+0000","last_unstale":"2024-09-12T19:28:32.133108+0000","last_undegraded":"2024-09-12T19:28:32.133108+0000","last_fullsized":"2024-09-12T19:28:32.133108+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:56.907799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6095,"num_read_kb":6091,"num_write":4930,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'434","reported_seq":2059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.318071+0000","last_change":"2024-09-12T17:36:36.880733+0000","last_active":"2024-09-12T19:28:00.318071+0000","last_peered":"2024-09-12T19:28:00.318071+0000","last_clean":"2024-09-12T19:28:00.318071+0000","last_became_active":"2024-09-12T17:36:36.880296+0000","last_became_peered":"2024-09-12T17:36:36.880296+0000","last_unstale":"2024-09-12T19:28:00.318071+0000","last_undegraded":"2024-09-12T19:28:00.318071+0000","last_fullsized":"2024-09-12T19:28:00.318071+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:06.645113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2387,"num_read_kb":2259,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'345","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.386432+0000","last_change":"2024-09-12T17:36:34.868949+0000","last_active":"2024-09-12T19:29:42.386432+0000","last_peered":"2024-09-12T19:29:42.386432+0000","last_clean":"2024-09-12T19:29:42.386432+0000","last_became_active":"2024-09-12T17:36:34.868243+0000","last_became_peered":"2024-09-12T17:36:34.868243+0000","last_unstale":"2024-09-12T19:29:42.386432+0000","last_undegraded":"2024-09-12T19:29:42.386432+0000","last_fullsized":"2024-09-12T19:29:42.386432+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:16.699361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":550,"num_read_kb":48255,"num_write":1188,"num_write_kb":33494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258752+0000","last_change":"2024-09-12T17:36:38.893533+0000","last_active":"2024-09-12T19:26:55.258752+0000","last_peered":"2024-09-12T19:26:55.258752+0000","last_clean":"2024-09-12T19:26:55.258752+0000","last_became_active":"2024-09-12T17:36:38.892804+0000","last_became_peered":"2024-09-12T17:36:38.892804+0000","last_unstale":"2024-09-12T19:26:55.258752+0000","last_undegraded":"2024-09-12T19:26:55.258752+0000","last_fullsized":"2024-09-12T19:26:55.258752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:56.818407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'399","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.304851+0000","last_change":"2024-09-12T17:36:40.889733+0000","last_active":"2024-09-12T19:29:42.304851+0000","last_peered":"2024-09-12T19:29:42.304851+0000","last_clean":"2024-09-12T19:29:42.304851+0000","last_became_active":"2024-09-12T17:36:40.888974+0000","last_became_peered":"2024-09-12T17:36:40.888974+0000","last_unstale":"2024-09-12T19:29:42.304851+0000","last_undegraded":"2024-09-12T19:29:42.304851+0000","last_fullsized":"2024-09-12T19:29:42.304851+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:41.043970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45462,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":644,"num_read_kb":1295,"num_write":508,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'798","reported_seq":3044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.031283+0000","last_change":"2024-09-12T17:36:42.936433+0000","last_active":"2024-09-12T19:29:42.031283+0000","last_peered":"2024-09-12T19:29:42.031283+0000","last_clean":"2024-09-12T19:29:42.031283+0000","last_became_active":"2024-09-12T17:36:42.935529+0000","last_became_peered":"2024-09-12T17:36:42.935529+0000","last_unstale":"2024-09-12T19:29:42.031283+0000","last_undegraded":"2024-09-12T19:29:42.031283+0000","last_fullsized":"2024-09-12T19:29:42.031283+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:25.923124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'112","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.068420+0000","last_change":"2024-09-12T17:36:44.966442+0000","last_active":"2024-09-12T19:29:21.068420+0000","last_peered":"2024-09-12T19:29:21.068420+0000","last_clean":"2024-09-12T19:29:21.068420+0000","last_became_active":"2024-09-12T17:36:44.965763+0000","last_became_peered":"2024-09-12T17:36:44.965763+0000","last_unstale":"2024-09-12T19:29:21.068420+0000","last_undegraded":"2024-09-12T19:29:21.068420+0000","last_fullsized":"2024-09-12T19:29:21.068420+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:31.130717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":137,"num_write":264,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'411","reported_seq":1895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.034719+0000","last_change":"2024-09-12T17:36:36.907634+0000","last_active":"2024-09-12T19:29:21.034719+0000","last_peered":"2024-09-12T19:29:21.034719+0000","last_clean":"2024-09-12T19:29:21.034719+0000","last_became_active":"2024-09-12T17:36:36.905958+0000","last_became_peered":"2024-09-12T17:36:36.905958+0000","last_unstale":"2024-09-12T19:29:21.034719+0000","last_undegraded":"2024-09-12T19:29:21.034719+0000","last_fullsized":"2024-09-12T19:29:21.034719+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:58.834393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'340","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.357391+0000","last_change":"2024-09-12T17:36:34.861236+0000","last_active":"2024-09-12T19:29:42.357391+0000","last_peered":"2024-09-12T19:29:42.357391+0000","last_clean":"2024-09-12T19:29:42.357391+0000","last_became_active":"2024-09-12T17:36:34.860828+0000","last_became_peered":"2024-09-12T17:36:34.860828+0000","last_unstale":"2024-09-12T19:29:42.357391+0000","last_undegraded":"2024-09-12T19:29:42.357391+0000","last_fullsized":"2024-09-12T19:29:42.357391+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:17.732122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399137,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":452,"num_read_kb":18690,"num_write":1073,"num_write_kb":31228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:34.057656+0000","last_change":"2024-09-12T17:36:38.897935+0000","last_active":"2024-09-12T19:27:34.057656+0000","last_peered":"2024-09-12T19:27:34.057656+0000","last_clean":"2024-09-12T19:27:34.057656+0000","last_became_active":"2024-09-12T17:36:38.897189+0000","last_became_peered":"2024-09-12T17:36:38.897189+0000","last_unstale":"2024-09-12T19:27:34.057656+0000","last_undegraded":"2024-09-12T19:27:34.057656+0000","last_fullsized":"2024-09-12T19:27:34.057656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:35.954626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'510","reported_seq":1198,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.375229+0000","last_change":"2024-09-12T17:36:40.907633+0000","last_active":"2024-09-12T19:29:42.375229+0000","last_peered":"2024-09-12T19:29:42.375229+0000","last_clean":"2024-09-12T19:29:42.375229+0000","last_became_active":"2024-09-12T17:36:40.906903+0000","last_became_peered":"2024-09-12T17:36:40.906903+0000","last_unstale":"2024-09-12T19:29:42.375229+0000","last_undegraded":"2024-09-12T19:29:42.375229+0000","last_fullsized":"2024-09-12T19:29:42.375229+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:36.733767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96745,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":901,"num_read_kb":2079,"num_write":726,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263489+0000","last_change":"2024-09-12T17:36:42.933877+0000","last_active":"2024-09-12T19:27:15.263489+0000","last_peered":"2024-09-12T19:27:15.263489+0000","last_clean":"2024-09-12T19:27:15.263489+0000","last_became_active":"2024-09-12T17:36:42.933168+0000","last_became_peered":"2024-09-12T17:36:42.933168+0000","last_unstale":"2024-09-12T19:27:15.263489+0000","last_undegraded":"2024-09-12T19:27:15.263489+0000","last_fullsized":"2024-09-12T19:27:15.263489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:13.861626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'159","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.676473+0000","last_change":"2024-09-12T17:36:44.961695+0000","last_active":"2024-09-12T19:27:15.676473+0000","last_peered":"2024-09-12T19:27:15.676473+0000","last_clean":"2024-09-12T19:27:15.676473+0000","last_became_active":"2024-09-12T17:36:44.960935+0000","last_became_peered":"2024-09-12T17:36:44.960935+0000","last_unstale":"2024-09-12T19:27:15.676473+0000","last_undegraded":"2024-09-12T19:27:15.676473+0000","last_fullsized":"2024-09-12T19:27:15.676473+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:20.892764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1322,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":195,"num_write":366,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1240","reported_seq":2921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.119750+0000","last_change":"2024-09-12T17:36:36.914970+0000","last_active":"2024-09-12T19:28:32.119750+0000","last_peered":"2024-09-12T19:28:32.119750+0000","last_clean":"2024-09-12T19:28:32.119750+0000","last_became_active":"2024-09-12T17:36:36.914518+0000","last_became_peered":"2024-09-12T17:36:36.914518+0000","last_unstale":"2024-09-12T19:28:32.119750+0000","last_undegraded":"2024-09-12T19:28:32.119750+0000","last_fullsized":"2024-09-12T19:28:32.119750+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.726119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5692,"num_read_kb":5056,"num_write":1732,"num_write_kb":743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'322","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.403521+0000","last_change":"2024-09-12T17:36:34.879597+0000","last_active":"2024-09-12T19:29:42.403521+0000","last_peered":"2024-09-12T19:29:42.403521+0000","last_clean":"2024-09-12T19:29:42.403521+0000","last_became_active":"2024-09-12T17:36:34.878896+0000","last_became_peered":"2024-09-12T17:36:34.878896+0000","last_unstale":"2024-09-12T19:29:42.403521+0000","last_undegraded":"2024-09-12T19:29:42.403521+0000","last_fullsized":"2024-09-12T19:29:42.403521+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:49.691790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":17715,"num_write":1042,"num_write_kb":23877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671691+0000","last_change":"2024-09-12T17:36:38.908401+0000","last_active":"2024-09-12T19:26:55.671691+0000","last_peered":"2024-09-12T19:26:55.671691+0000","last_clean":"2024-09-12T19:26:55.671691+0000","last_became_active":"2024-09-12T17:36:38.907609+0000","last_became_peered":"2024-09-12T17:36:38.907609+0000","last_unstale":"2024-09-12T19:26:55.671691+0000","last_undegraded":"2024-09-12T19:26:55.671691+0000","last_fullsized":"2024-09-12T19:26:55.671691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:46.413534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'361","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.650380+0000","last_change":"2024-09-12T17:36:40.895469+0000","last_active":"2024-09-12T19:29:41.650380+0000","last_peered":"2024-09-12T19:29:41.650380+0000","last_clean":"2024-09-12T19:29:41.650380+0000","last_became_active":"2024-09-12T17:36:40.893702+0000","last_became_peered":"2024-09-12T17:36:40.893702+0000","last_unstale":"2024-09-12T19:29:41.650380+0000","last_undegraded":"2024-09-12T19:29:41.650380+0000","last_fullsized":"2024-09-12T19:29:41.650380+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:52.727654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47801,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":608,"num_read_kb":1248,"num_write":530,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.677558+0000","last_change":"2024-09-12T17:36:42.939282+0000","last_active":"2024-09-12T19:27:20.677558+0000","last_peered":"2024-09-12T19:27:20.677558+0000","last_clean":"2024-09-12T19:27:20.677558+0000","last_became_active":"2024-09-12T17:36:42.938437+0000","last_became_peered":"2024-09-12T17:36:42.938437+0000","last_unstale":"2024-09-12T19:27:20.677558+0000","last_undegraded":"2024-09-12T19:27:20.677558+0000","last_fullsized":"2024-09-12T19:27:20.677558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:17.930519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'144","reported_seq":718,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:09.868344+0000","last_change":"2024-09-12T17:36:44.959709+0000","last_active":"2024-09-12T19:29:09.868344+0000","last_peered":"2024-09-12T19:29:09.868344+0000","last_clean":"2024-09-12T19:29:09.868344+0000","last_became_active":"2024-09-12T17:36:44.956645+0000","last_became_peered":"2024-09-12T17:36:44.956645+0000","last_unstale":"2024-09-12T19:29:09.868344+0000","last_undegraded":"2024-09-12T19:29:09.868344+0000","last_fullsized":"2024-09-12T19:29:09.868344+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.650537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":356,"num_read_kb":303,"num_write":346,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'499","reported_seq":2115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.117569+0000","last_change":"2024-09-12T17:36:36.882735+0000","last_active":"2024-09-12T19:28:32.117569+0000","last_peered":"2024-09-12T19:28:32.117569+0000","last_clean":"2024-09-12T19:28:32.117569+0000","last_became_active":"2024-09-12T17:36:36.881882+0000","last_became_peered":"2024-09-12T17:36:36.881882+0000","last_unstale":"2024-09-12T19:28:32.117569+0000","last_undegraded":"2024-09-12T19:28:32.117569+0000","last_fullsized":"2024-09-12T19:28:32.117569+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.005619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2445,"num_write":630,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'354","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.412008+0000","last_change":"2024-09-12T17:36:34.870444+0000","last_active":"2024-09-12T19:29:42.412008+0000","last_peered":"2024-09-12T19:29:42.412008+0000","last_clean":"2024-09-12T19:29:42.412008+0000","last_became_active":"2024-09-12T17:36:34.870021+0000","last_became_peered":"2024-09-12T17:36:34.870021+0000","last_unstale":"2024-09-12T19:29:42.412008+0000","last_undegraded":"2024-09-12T19:29:42.412008+0000","last_fullsized":"2024-09-12T19:29:42.412008+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:32.502673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":14188,"num_write":1189,"num_write_kb":25082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258787+0000","last_change":"2024-09-12T17:36:38.893625+0000","last_active":"2024-09-12T19:26:55.258787+0000","last_peered":"2024-09-12T19:26:55.258787+0000","last_clean":"2024-09-12T19:26:55.258787+0000","last_became_active":"2024-09-12T17:36:38.892885+0000","last_became_peered":"2024-09-12T17:36:38.892885+0000","last_unstale":"2024-09-12T19:26:55.258787+0000","last_undegraded":"2024-09-12T19:26:55.258787+0000","last_fullsized":"2024-09-12T19:26:55.258787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:23.133743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'379","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.355333+0000","last_change":"2024-09-12T17:36:40.898503+0000","last_active":"2024-09-12T19:29:41.355333+0000","last_peered":"2024-09-12T19:29:41.355333+0000","last_clean":"2024-09-12T19:29:41.355333+0000","last_became_active":"2024-09-12T17:36:40.896733+0000","last_became_peered":"2024-09-12T17:36:40.896733+0000","last_unstale":"2024-09-12T19:29:41.355333+0000","last_undegraded":"2024-09-12T19:29:41.355333+0000","last_fullsized":"2024-09-12T19:29:41.355333+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:00.019536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60156,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1227,"num_write":470,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'770","reported_seq":3236,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.001508+0000","last_change":"2024-09-12T17:36:42.935306+0000","last_active":"2024-09-12T19:29:41.001508+0000","last_peered":"2024-09-12T19:29:41.001508+0000","last_clean":"2024-09-12T19:29:41.001508+0000","last_became_active":"2024-09-12T17:36:42.934582+0000","last_became_peered":"2024-09-12T17:36:42.934582+0000","last_unstale":"2024-09-12T19:29:41.001508+0000","last_undegraded":"2024-09-12T19:29:41.001508+0000","last_fullsized":"2024-09-12T19:29:41.001508+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.168171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'100","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.913618+0000","last_change":"2024-09-12T17:36:44.938502+0000","last_active":"2024-09-12T19:28:02.913618+0000","last_peered":"2024-09-12T19:28:02.913618+0000","last_clean":"2024-09-12T19:28:02.913618+0000","last_became_active":"2024-09-12T17:36:44.937368+0000","last_became_peered":"2024-09-12T17:36:44.937368+0000","last_unstale":"2024-09-12T19:28:02.913618+0000","last_undegraded":"2024-09-12T19:28:02.913618+0000","last_fullsized":"2024-09-12T19:28:02.913618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:33.490996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":224,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'653","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.248765+0000","last_change":"2024-09-12T17:36:36.883321+0000","last_active":"2024-09-12T19:26:55.248765+0000","last_peered":"2024-09-12T19:26:55.248765+0000","last_clean":"2024-09-12T19:26:55.248765+0000","last_became_active":"2024-09-12T17:36:36.883043+0000","last_became_peered":"2024-09-12T17:36:36.883043+0000","last_unstale":"2024-09-12T19:26:55.248765+0000","last_undegraded":"2024-09-12T19:26:55.248765+0000","last_fullsized":"2024-09-12T19:26:55.248765+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:50.911594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3181,"num_read_kb":2856,"num_write":918,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'389","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.399757+0000","last_change":"2024-09-12T17:36:34.874846+0000","last_active":"2024-09-12T19:29:42.399757+0000","last_peered":"2024-09-12T19:29:42.399757+0000","last_clean":"2024-09-12T19:29:42.399757+0000","last_became_active":"2024-09-12T17:36:34.873263+0000","last_became_peered":"2024-09-12T17:36:34.873263+0000","last_unstale":"2024-09-12T19:29:42.399757+0000","last_undegraded":"2024-09-12T19:29:42.399757+0000","last_fullsized":"2024-09-12T19:29:42.399757+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:42.358689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194346,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":21339,"num_write":1076,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.984870+0000","last_change":"2024-09-12T17:36:38.889880+0000","last_active":"2024-09-12T19:29:40.984870+0000","last_peered":"2024-09-12T19:29:40.984870+0000","last_clean":"2024-09-12T19:29:40.984870+0000","last_became_active":"2024-09-12T17:36:38.888795+0000","last_became_peered":"2024-09-12T17:36:38.888795+0000","last_unstale":"2024-09-12T19:29:40.984870+0000","last_undegraded":"2024-09-12T19:29:40.984870+0000","last_fullsized":"2024-09-12T19:29:40.984870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:53.568736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'150","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.261761+0000","last_change":"2024-09-12T17:36:40.893833+0000","last_active":"2024-09-12T19:27:30.261761+0000","last_peered":"2024-09-12T19:27:30.261761+0000","last_clean":"2024-09-12T19:27:30.261761+0000","last_became_active":"2024-09-12T17:36:40.893090+0000","last_became_peered":"2024-09-12T17:36:40.893090+0000","last_unstale":"2024-09-12T19:27:30.261761+0000","last_undegraded":"2024-09-12T19:27:30.261761+0000","last_fullsized":"2024-09-12T19:27:30.261761+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:17.912186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'806","reported_seq":3156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.737614+0000","last_change":"2024-09-12T17:36:42.937918+0000","last_active":"2024-09-12T19:29:41.737614+0000","last_peered":"2024-09-12T19:29:41.737614+0000","last_clean":"2024-09-12T19:29:41.737614+0000","last_became_active":"2024-09-12T17:36:42.937195+0000","last_became_peered":"2024-09-12T17:36:42.937195+0000","last_unstale":"2024-09-12T19:29:41.737614+0000","last_undegraded":"2024-09-12T19:29:41.737614+0000","last_fullsized":"2024-09-12T19:29:41.737614+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:27.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'109","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.251823+0000","last_change":"2024-09-12T17:36:44.960800+0000","last_active":"2024-09-12T19:27:10.251823+0000","last_peered":"2024-09-12T19:27:10.251823+0000","last_clean":"2024-09-12T19:27:10.251823+0000","last_became_active":"2024-09-12T17:36:44.960042+0000","last_became_peered":"2024-09-12T17:36:44.960042+0000","last_unstale":"2024-09-12T19:27:10.251823+0000","last_undegraded":"2024-09-12T19:27:10.251823+0000","last_fullsized":"2024-09-12T19:27:10.251823+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:54.849029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'983","reported_seq":2639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.365058+0000","last_change":"2024-09-12T17:36:36.914243+0000","last_active":"2024-09-12T19:28:00.365058+0000","last_peered":"2024-09-12T19:28:00.365058+0000","last_clean":"2024-09-12T19:28:00.365058+0000","last_became_active":"2024-09-12T17:36:36.913566+0000","last_became_peered":"2024-09-12T17:36:36.913566+0000","last_unstale":"2024-09-12T19:28:00.365058+0000","last_undegraded":"2024-09-12T19:28:00.365058+0000","last_fullsized":"2024-09-12T19:28:00.365058+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":900,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:32.358617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4811,"num_read_kb":4293,"num_write":1402,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'299","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.371346+0000","last_change":"2024-09-12T17:36:34.863609+0000","last_active":"2024-09-12T19:29:42.371346+0000","last_peered":"2024-09-12T19:29:42.371346+0000","last_clean":"2024-09-12T19:29:42.371346+0000","last_became_active":"2024-09-12T17:36:34.862534+0000","last_became_peered":"2024-09-12T17:36:34.862534+0000","last_unstale":"2024-09-12T19:29:42.371346+0000","last_undegraded":"2024-09-12T19:29:42.371346+0000","last_fullsized":"2024-09-12T19:29:42.371346+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:22.424632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":22960,"num_write":940,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.363062+0000","last_change":"2024-09-12T17:36:38.886369+0000","last_active":"2024-09-12T19:26:55.363062+0000","last_peered":"2024-09-12T19:26:55.363062+0000","last_clean":"2024-09-12T19:26:55.363062+0000","last_became_active":"2024-09-12T17:36:38.885678+0000","last_became_peered":"2024-09-12T17:36:38.885678+0000","last_unstale":"2024-09-12T19:26:55.363062+0000","last_undegraded":"2024-09-12T19:26:55.363062+0000","last_fullsized":"2024-09-12T19:26:55.363062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:06.010071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'414","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.111556+0000","last_change":"2024-09-12T17:36:40.900876+0000","last_active":"2024-09-12T19:29:42.111556+0000","last_peered":"2024-09-12T19:29:42.111556+0000","last_clean":"2024-09-12T19:29:42.111556+0000","last_became_active":"2024-09-12T17:36:40.900295+0000","last_became_peered":"2024-09-12T17:36:40.900295+0000","last_unstale":"2024-09-12T19:29:42.111556+0000","last_undegraded":"2024-09-12T19:29:42.111556+0000","last_fullsized":"2024-09-12T19:29:42.111556+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:17.899103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41300,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":664,"num_read_kb":1187,"num_write":496,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249747+0000","last_change":"2024-09-12T17:36:42.928327+0000","last_active":"2024-09-12T19:27:00.249747+0000","last_peered":"2024-09-12T19:27:00.249747+0000","last_clean":"2024-09-12T19:27:00.249747+0000","last_became_active":"2024-09-12T17:36:42.927716+0000","last_became_peered":"2024-09-12T17:36:42.927716+0000","last_unstale":"2024-09-12T19:27:00.249747+0000","last_undegraded":"2024-09-12T19:27:00.249747+0000","last_fullsized":"2024-09-12T19:27:00.249747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.478941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'114","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:58.451214+0000","last_change":"2024-09-12T17:36:44.943385+0000","last_active":"2024-09-12T19:27:58.451214+0000","last_peered":"2024-09-12T19:27:58.451214+0000","last_clean":"2024-09-12T19:27:58.451214+0000","last_became_active":"2024-09-12T17:36:44.942505+0000","last_became_peered":"2024-09-12T17:36:44.942505+0000","last_unstale":"2024-09-12T19:27:58.451214+0000","last_undegraded":"2024-09-12T19:27:58.451214+0000","last_fullsized":"2024-09-12T19:27:58.451214+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:16.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":134,"num_write":256,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'733","reported_seq":2201,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.626150+0000","last_change":"2024-09-12T17:36:36.882337+0000","last_active":"2024-09-12T19:28:02.626150+0000","last_peered":"2024-09-12T19:28:02.626150+0000","last_clean":"2024-09-12T19:28:02.626150+0000","last_became_active":"2024-09-12T17:36:36.881456+0000","last_became_peered":"2024-09-12T17:36:36.881456+0000","last_unstale":"2024-09-12T19:28:02.626150+0000","last_undegraded":"2024-09-12T19:28:02.626150+0000","last_fullsized":"2024-09-12T19:28:02.626150+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:26.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3432,"num_read_kb":3120,"num_write":969,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.091239+0000","last_change":"2024-09-12T17:36:16.723179+0000","last_active":"2024-09-12T19:26:55.091239+0000","last_peered":"2024-09-12T19:26:55.091239+0000","last_clean":"2024-09-12T19:26:55.091239+0000","last_became_active":"2024-09-12T17:36:16.722334+0000","last_became_peered":"2024-09-12T17:36:16.722334+0000","last_unstale":"2024-09-12T19:26:55.091239+0000","last_undegraded":"2024-09-12T19:26:55.091239+0000","last_fullsized":"2024-09-12T19:26:55.091239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:15.696738+0000","last_clean_scrub_stamp":"2024-09-12T17:36:15.696738+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:31.267846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.361940+0000","last_change":"2024-09-12T17:36:23.787411+0000","last_active":"2024-09-12T19:26:50.361940+0000","last_peered":"2024-09-12T19:26:50.361940+0000","last_clean":"2024-09-12T19:26:50.361940+0000","last_became_active":"2024-09-12T17:36:21.777852+0000","last_became_peered":"2024-09-12T17:36:21.777852+0000","last_unstale":"2024-09-12T19:26:50.361940+0000","last_undegraded":"2024-09-12T19:26:50.361940+0000","last_fullsized":"2024-09-12T19:26:50.361940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:45.393945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019340550000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'382","reported_seq":1123,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.391227+0000","last_change":"2024-09-12T17:36:34.870746+0000","last_active":"2024-09-12T19:29:42.391227+0000","last_peered":"2024-09-12T19:29:42.391227+0000","last_clean":"2024-09-12T19:29:42.391227+0000","last_became_active":"2024-09-12T17:36:34.865550+0000","last_became_peered":"2024-09-12T17:36:34.865550+0000","last_unstale":"2024-09-12T19:29:42.391227+0000","last_undegraded":"2024-09-12T19:29:42.391227+0000","last_fullsized":"2024-09-12T19:29:42.391227+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:37.982105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":672,"num_read_kb":15438,"num_write":1473,"num_write_kb":31533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602989+0000","last_change":"2024-09-12T17:36:38.892479+0000","last_active":"2024-09-12T19:27:05.602989+0000","last_peered":"2024-09-12T19:27:05.602989+0000","last_clean":"2024-09-12T19:27:05.602989+0000","last_became_active":"2024-09-12T17:36:38.891774+0000","last_became_peered":"2024-09-12T17:36:38.891774+0000","last_unstale":"2024-09-12T19:27:05.602989+0000","last_undegraded":"2024-09-12T19:27:05.602989+0000","last_fullsized":"2024-09-12T19:27:05.602989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:04.757971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'747","reported_seq":1494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.186442+0000","last_change":"2024-09-12T17:36:40.886469+0000","last_active":"2024-09-12T19:29:42.186442+0000","last_peered":"2024-09-12T19:29:42.186442+0000","last_clean":"2024-09-12T19:29:42.186442+0000","last_became_active":"2024-09-12T17:36:40.885684+0000","last_became_peered":"2024-09-12T17:36:40.885684+0000","last_unstale":"2024-09-12T19:29:42.186442+0000","last_undegraded":"2024-09-12T19:29:42.186442+0000","last_fullsized":"2024-09-12T19:29:42.186442+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:17.424179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144787,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1444,"num_read_kb":3163,"num_write":1370,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263697+0000","last_change":"2024-09-12T17:36:42.919971+0000","last_active":"2024-09-12T19:27:15.263697+0000","last_peered":"2024-09-12T19:27:15.263697+0000","last_clean":"2024-09-12T19:27:15.263697+0000","last_became_active":"2024-09-12T17:36:42.919204+0000","last_became_peered":"2024-09-12T17:36:42.919204+0000","last_unstale":"2024-09-12T19:27:15.263697+0000","last_undegraded":"2024-09-12T19:27:15.263697+0000","last_fullsized":"2024-09-12T19:27:15.263697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:28.580042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'184","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.702184+0000","last_change":"2024-09-12T17:36:44.954972+0000","last_active":"2024-09-12T19:28:02.702184+0000","last_peered":"2024-09-12T19:28:02.702184+0000","last_clean":"2024-09-12T19:28:02.702184+0000","last_became_active":"2024-09-12T17:36:44.954321+0000","last_became_peered":"2024-09-12T17:36:44.954321+0000","last_unstale":"2024-09-12T19:28:02.702184+0000","last_undegraded":"2024-09-12T19:28:02.702184+0000","last_fullsized":"2024-09-12T19:28:02.702184+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:09.226720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":488,"num_write":378,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'504","reported_seq":2085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.262524+0000","last_change":"2024-09-12T17:36:36.907852+0000","last_active":"2024-09-12T19:27:10.262524+0000","last_peered":"2024-09-12T19:27:10.262524+0000","last_clean":"2024-09-12T19:27:10.262524+0000","last_became_active":"2024-09-12T17:36:36.906789+0000","last_became_peered":"2024-09-12T17:36:36.906789+0000","last_unstale":"2024-09-12T19:27:10.262524+0000","last_undegraded":"2024-09-12T19:27:10.262524+0000","last_fullsized":"2024-09-12T19:27:10.262524+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:22.056362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2691,"num_read_kb":2505,"num_write":636,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.362890+0000","last_change":"2024-09-12T17:36:23.786635+0000","last_active":"2024-09-12T19:26:55.362890+0000","last_peered":"2024-09-12T19:26:55.362890+0000","last_clean":"2024-09-12T19:26:55.362890+0000","last_became_active":"2024-09-12T17:36:21.785026+0000","last_became_peered":"2024-09-12T17:36:21.785026+0000","last_unstale":"2024-09-12T19:26:55.362890+0000","last_undegraded":"2024-09-12T19:26:55.362890+0000","last_fullsized":"2024-09-12T19:26:55.362890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:07.883744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184601,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'376","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.368260+0000","last_change":"2024-09-12T17:36:34.885024+0000","last_active":"2024-09-12T19:29:42.368260+0000","last_peered":"2024-09-12T19:29:42.368260+0000","last_clean":"2024-09-12T19:29:42.368260+0000","last_became_active":"2024-09-12T17:36:34.882818+0000","last_became_peered":"2024-09-12T17:36:34.882818+0000","last_unstale":"2024-09-12T19:29:42.368260+0000","last_undegraded":"2024-09-12T19:29:42.368260+0000","last_fullsized":"2024-09-12T19:29:42.368260+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:00.872257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263289,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":609,"num_read_kb":22197,"num_write":1318,"num_write_kb":15503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366617+0000","last_change":"2024-09-12T17:36:38.895923+0000","last_active":"2024-09-12T19:27:10.366617+0000","last_peered":"2024-09-12T19:27:10.366617+0000","last_clean":"2024-09-12T19:27:10.366617+0000","last_became_active":"2024-09-12T17:36:38.895378+0000","last_became_peered":"2024-09-12T17:36:38.895378+0000","last_unstale":"2024-09-12T19:27:10.366617+0000","last_undegraded":"2024-09-12T19:27:10.366617+0000","last_fullsized":"2024-09-12T19:27:10.366617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:49.295916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1452","reported_seq":3806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.147267+0000","last_change":"2024-09-12T17:36:40.909473+0000","last_active":"2024-09-12T19:29:42.147267+0000","last_peered":"2024-09-12T19:29:42.147267+0000","last_clean":"2024-09-12T19:29:42.147267+0000","last_became_active":"2024-09-12T17:36:40.908721+0000","last_became_peered":"2024-09-12T17:36:40.908721+0000","last_unstale":"2024-09-12T19:29:42.147267+0000","last_undegraded":"2024-09-12T19:29:42.147267+0000","last_fullsized":"2024-09-12T19:29:42.147267+0000","mapping_epoch":30,"log_start":"265'1400","ondisk_log_start":"265'1400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:39.239469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146546,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2270,"num_read_kb":4170,"num_write":1382,"num_write_kb":1134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:40.373748+0000","last_change":"2024-09-12T17:36:42.918278+0000","last_active":"2024-09-12T19:27:40.373748+0000","last_peered":"2024-09-12T19:27:40.373748+0000","last_clean":"2024-09-12T19:27:40.373748+0000","last_became_active":"2024-09-12T17:36:42.917432+0000","last_became_peered":"2024-09-12T17:36:42.917432+0000","last_unstale":"2024-09-12T19:27:40.373748+0000","last_undegraded":"2024-09-12T19:27:40.373748+0000","last_fullsized":"2024-09-12T19:27:40.373748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:35.437908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'252","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:59.716094+0000","last_change":"2024-09-12T17:36:44.959827+0000","last_active":"2024-09-12T19:27:59.716094+0000","last_peered":"2024-09-12T19:27:59.716094+0000","last_clean":"2024-09-12T19:27:59.716094+0000","last_became_active":"2024-09-12T17:36:44.956687+0000","last_became_peered":"2024-09-12T17:36:44.956687+0000","last_unstale":"2024-09-12T19:27:59.716094+0000","last_undegraded":"2024-09-12T19:27:59.716094+0000","last_fullsized":"2024-09-12T19:27:59.716094+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:45.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":419,"num_write":569,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'457","reported_seq":1909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.363563+0000","last_change":"2024-09-12T17:36:36.877140+0000","last_active":"2024-09-12T19:28:00.363563+0000","last_peered":"2024-09-12T19:28:00.363563+0000","last_clean":"2024-09-12T19:28:00.363563+0000","last_became_active":"2024-09-12T17:36:36.876424+0000","last_became_peered":"2024-09-12T17:36:36.876424+0000","last_unstale":"2024-09-12T19:28:00.363563+0000","last_undegraded":"2024-09-12T19:28:00.363563+0000","last_fullsized":"2024-09-12T19:28:00.363563+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:09.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2313,"num_read_kb":2138,"num_write":582,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670217+0000","last_change":"2024-09-12T17:36:23.789501+0000","last_active":"2024-09-12T19:26:50.670217+0000","last_peered":"2024-09-12T19:26:50.670217+0000","last_clean":"2024-09-12T19:26:50.670217+0000","last_became_active":"2024-09-12T17:36:21.786793+0000","last_became_peered":"2024-09-12T17:36:21.786793+0000","last_unstale":"2024-09-12T19:26:50.670217+0000","last_undegraded":"2024-09-12T19:26:50.670217+0000","last_fullsized":"2024-09-12T19:26:50.670217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:31.878088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011925740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'322","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.394486+0000","last_change":"2024-09-12T17:36:34.879706+0000","last_active":"2024-09-12T19:29:42.394486+0000","last_peered":"2024-09-12T19:29:42.394486+0000","last_clean":"2024-09-12T19:29:42.394486+0000","last_became_active":"2024-09-12T17:36:34.878944+0000","last_became_peered":"2024-09-12T17:36:34.878944+0000","last_unstale":"2024-09-12T19:29:42.394486+0000","last_undegraded":"2024-09-12T19:29:42.394486+0000","last_fullsized":"2024-09-12T19:29:42.394486+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:35.362609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526370,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":517,"num_read_kb":44432,"num_write":1109,"num_write_kb":34964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675306+0000","last_change":"2024-09-12T17:36:38.908387+0000","last_active":"2024-09-12T19:27:10.675306+0000","last_peered":"2024-09-12T19:27:10.675306+0000","last_clean":"2024-09-12T19:27:10.675306+0000","last_became_active":"2024-09-12T17:36:38.907685+0000","last_became_peered":"2024-09-12T17:36:38.907685+0000","last_unstale":"2024-09-12T19:27:10.675306+0000","last_undegraded":"2024-09-12T19:27:10.675306+0000","last_fullsized":"2024-09-12T19:27:10.675306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:58.506591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'385","reported_seq":2346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.224631+0000","last_change":"2024-09-12T17:36:40.907875+0000","last_active":"2024-09-12T19:29:22.224631+0000","last_peered":"2024-09-12T19:29:22.224631+0000","last_clean":"2024-09-12T19:29:22.224631+0000","last_became_active":"2024-09-12T17:36:40.907340+0000","last_became_peered":"2024-09-12T17:36:40.907340+0000","last_unstale":"2024-09-12T19:29:22.224631+0000","last_undegraded":"2024-09-12T19:29:22.224631+0000","last_fullsized":"2024-09-12T19:29:22.224631+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:01.365979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":374,"num_read_kb":364,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.693668+0000","last_change":"2024-09-12T17:36:42.932731+0000","last_active":"2024-09-12T19:27:10.693668+0000","last_peered":"2024-09-12T19:27:10.693668+0000","last_clean":"2024-09-12T19:27:10.693668+0000","last_became_active":"2024-09-12T17:36:42.931884+0000","last_became_peered":"2024-09-12T17:36:42.931884+0000","last_unstale":"2024-09-12T19:27:10.693668+0000","last_undegraded":"2024-09-12T19:27:10.693668+0000","last_fullsized":"2024-09-12T19:27:10.693668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:21.823146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'257","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.184602+0000","last_change":"2024-09-12T17:36:44.940743+0000","last_active":"2024-09-12T19:28:03.184602+0000","last_peered":"2024-09-12T19:28:03.184602+0000","last_clean":"2024-09-12T19:28:03.184602+0000","last_became_active":"2024-09-12T17:36:44.940041+0000","last_became_peered":"2024-09-12T17:36:44.940041+0000","last_unstale":"2024-09-12T19:28:03.184602+0000","last_undegraded":"2024-09-12T19:28:03.184602+0000","last_fullsized":"2024-09-12T19:28:03.184602+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:45.197303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":565,"num_write":575,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'749","reported_seq":2219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181845+0000","last_change":"2024-09-12T17:36:36.897102+0000","last_active":"2024-09-12T19:27:10.181845+0000","last_peered":"2024-09-12T19:27:10.181845+0000","last_clean":"2024-09-12T19:27:10.181845+0000","last_became_active":"2024-09-12T17:36:36.896152+0000","last_became_peered":"2024-09-12T17:36:36.896152+0000","last_unstale":"2024-09-12T19:27:10.181845+0000","last_undegraded":"2024-09-12T19:27:10.181845+0000","last_fullsized":"2024-09-12T19:27:10.181845+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:23.827520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3496,"num_read_kb":3152,"num_write":986,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":552,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.361888+0000","last_change":"2024-09-12T17:36:23.787252+0000","last_active":"2024-09-12T19:26:50.361888+0000","last_peered":"2024-09-12T19:26:50.361888+0000","last_clean":"2024-09-12T19:26:50.361888+0000","last_became_active":"2024-09-12T17:36:21.777173+0000","last_became_peered":"2024-09-12T17:36:21.777173+0000","last_unstale":"2024-09-12T19:26:50.361888+0000","last_undegraded":"2024-09-12T19:26:50.361888+0000","last_fullsized":"2024-09-12T19:26:50.361888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:26.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001776889,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'354","reported_seq":1083,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.383008+0000","last_change":"2024-09-12T17:37:07.868392+0000","last_active":"2024-09-12T19:29:42.383008+0000","last_peered":"2024-09-12T19:29:42.383008+0000","last_clean":"2024-09-12T19:29:42.383008+0000","last_became_active":"2024-09-12T17:37:07.867652+0000","last_became_peered":"2024-09-12T17:37:07.867652+0000","last_unstale":"2024-09-12T19:29:42.383008+0000","last_undegraded":"2024-09-12T19:29:42.383008+0000","last_fullsized":"2024-09-12T19:29:42.383008+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:35.602532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":639,"num_read_kb":7400,"num_write":1137,"num_write_kb":18590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:25.678699+0000","last_change":"2024-09-12T17:36:38.912854+0000","last_active":"2024-09-12T19:27:25.678699+0000","last_peered":"2024-09-12T19:27:25.678699+0000","last_clean":"2024-09-12T19:27:25.678699+0000","last_became_active":"2024-09-12T17:36:38.912059+0000","last_became_peered":"2024-09-12T17:36:38.912059+0000","last_unstale":"2024-09-12T19:27:25.678699+0000","last_undegraded":"2024-09-12T19:27:25.678699+0000","last_fullsized":"2024-09-12T19:27:25.678699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:05.736408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'216","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.294596+0000","last_change":"2024-09-12T17:36:40.885516+0000","last_active":"2024-09-12T19:29:20.294596+0000","last_peered":"2024-09-12T19:29:20.294596+0000","last_clean":"2024-09-12T19:29:20.294596+0000","last_became_active":"2024-09-12T17:36:40.884794+0000","last_became_peered":"2024-09-12T17:36:40.884794+0000","last_unstale":"2024-09-12T19:29:20.294596+0000","last_undegraded":"2024-09-12T19:29:20.294596+0000","last_fullsized":"2024-09-12T19:29:20.294596+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:21.742525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":278,"num_read_kb":269,"num_write":202,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.367743+0000","last_change":"2024-09-12T17:36:42.921806+0000","last_active":"2024-09-12T19:27:15.367743+0000","last_peered":"2024-09-12T19:27:15.367743+0000","last_clean":"2024-09-12T19:27:15.367743+0000","last_became_active":"2024-09-12T17:36:42.920887+0000","last_became_peered":"2024-09-12T17:36:42.920887+0000","last_unstale":"2024-09-12T19:27:15.367743+0000","last_undegraded":"2024-09-12T19:27:15.367743+0000","last_fullsized":"2024-09-12T19:27:15.367743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:38.116745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'126","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.095950+0000","last_change":"2024-09-12T17:36:44.938503+0000","last_active":"2024-09-12T19:27:15.095950+0000","last_peered":"2024-09-12T19:27:15.095950+0000","last_clean":"2024-09-12T19:27:15.095950+0000","last_became_active":"2024-09-12T17:36:44.937666+0000","last_became_peered":"2024-09-12T17:36:44.937666+0000","last_unstale":"2024-09-12T19:27:15.095950+0000","last_undegraded":"2024-09-12T19:27:15.095950+0000","last_fullsized":"2024-09-12T19:27:15.095950+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:23.897144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":289,"num_read_kb":276,"num_write":312,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'528","reported_seq":2139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.120710+0000","last_change":"2024-09-12T17:36:36.881070+0000","last_active":"2024-09-12T19:28:32.120710+0000","last_peered":"2024-09-12T19:28:32.120710+0000","last_clean":"2024-09-12T19:28:32.120710+0000","last_became_active":"2024-09-12T17:36:36.880335+0000","last_became_peered":"2024-09-12T17:36:36.880335+0000","last_unstale":"2024-09-12T19:28:32.120710+0000","last_undegraded":"2024-09-12T19:28:32.120710+0000","last_fullsized":"2024-09-12T19:28:32.120710+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:22.571992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2654,"num_read_kb":2484,"num_write":644,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'371","reported_seq":1044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.403002+0000","last_change":"2024-09-12T17:36:34.878244+0000","last_active":"2024-09-12T19:29:42.403002+0000","last_peered":"2024-09-12T19:29:42.403002+0000","last_clean":"2024-09-12T19:29:42.403002+0000","last_became_active":"2024-09-12T17:36:34.877412+0000","last_became_peered":"2024-09-12T17:36:34.877412+0000","last_unstale":"2024-09-12T19:29:42.403002+0000","last_undegraded":"2024-09-12T19:29:42.403002+0000","last_fullsized":"2024-09-12T19:29:42.403002+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:42.929889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6755987,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":26720,"num_write":1165,"num_write_kb":36792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":555,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.257613+0000","last_change":"2024-09-12T17:36:23.789441+0000","last_active":"2024-09-12T19:26:50.257613+0000","last_peered":"2024-09-12T19:26:50.257613+0000","last_clean":"2024-09-12T19:26:50.257613+0000","last_became_active":"2024-09-12T17:36:21.786429+0000","last_became_peered":"2024-09-12T17:36:21.786429+0000","last_unstale":"2024-09-12T19:26:50.257613+0000","last_undegraded":"2024-09-12T19:26:50.257613+0000","last_fullsized":"2024-09-12T19:26:50.257613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:14.667779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011387680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"36'5","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.737746+0000","last_change":"2024-09-12T17:36:38.903117+0000","last_active":"2024-09-12T19:29:40.737746+0000","last_peered":"2024-09-12T19:29:40.737746+0000","last_clean":"2024-09-12T19:29:40.737746+0000","last_became_active":"2024-09-12T17:36:38.902432+0000","last_became_peered":"2024-09-12T17:36:38.902432+0000","last_unstale":"2024-09-12T19:29:40.737746+0000","last_undegraded":"2024-09-12T19:29:40.737746+0000","last_fullsized":"2024-09-12T19:29:40.737746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:28.729642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":1196,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'754","reported_seq":1492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.923163+0000","last_change":"2024-09-12T17:36:40.903273+0000","last_active":"2024-09-12T19:29:41.923163+0000","last_peered":"2024-09-12T19:29:41.923163+0000","last_clean":"2024-09-12T19:29:41.923163+0000","last_became_active":"2024-09-12T17:36:40.902488+0000","last_became_peered":"2024-09-12T17:36:40.902488+0000","last_unstale":"2024-09-12T19:29:41.923163+0000","last_undegraded":"2024-09-12T19:29:41.923163+0000","last_fullsized":"2024-09-12T19:29:41.923163+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:44.794951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98161,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1955,"num_read_kb":3163,"num_write":2614,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.251784+0000","last_change":"2024-09-12T17:36:42.932443+0000","last_active":"2024-09-12T19:27:10.251784+0000","last_peered":"2024-09-12T19:27:10.251784+0000","last_clean":"2024-09-12T19:27:10.251784+0000","last_became_active":"2024-09-12T17:36:42.931746+0000","last_became_peered":"2024-09-12T17:36:42.931746+0000","last_unstale":"2024-09-12T19:27:10.251784+0000","last_undegraded":"2024-09-12T19:27:10.251784+0000","last_fullsized":"2024-09-12T19:27:10.251784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:17.226964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'136","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.427148+0000","last_change":"2024-09-12T17:36:44.959931+0000","last_active":"2024-09-12T19:27:55.427148+0000","last_peered":"2024-09-12T19:27:55.427148+0000","last_clean":"2024-09-12T19:27:55.427148+0000","last_became_active":"2024-09-12T17:36:44.959109+0000","last_became_peered":"2024-09-12T17:36:44.959109+0000","last_unstale":"2024-09-12T19:27:55.427148+0000","last_undegraded":"2024-09-12T19:27:55.427148+0000","last_fullsized":"2024-09-12T19:27:55.427148+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:21.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'606","reported_seq":2146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.022973+0000","last_change":"2024-09-12T17:36:36.884101+0000","last_active":"2024-09-12T19:29:21.022973+0000","last_peered":"2024-09-12T19:29:21.022973+0000","last_clean":"2024-09-12T19:29:21.022973+0000","last_became_active":"2024-09-12T17:36:36.883397+0000","last_became_peered":"2024-09-12T17:36:36.883397+0000","last_unstale":"2024-09-12T19:29:21.022973+0000","last_undegraded":"2024-09-12T19:29:21.022973+0000","last_fullsized":"2024-09-12T19:29:21.022973+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:32.872711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3050,"num_read_kb":2738,"num_write":793,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'369","reported_seq":1093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.396303+0000","last_change":"2024-09-12T17:36:34.892972+0000","last_active":"2024-09-12T19:29:42.396303+0000","last_peered":"2024-09-12T19:29:42.396303+0000","last_clean":"2024-09-12T19:29:42.396303+0000","last_became_active":"2024-09-12T17:36:34.892255+0000","last_became_peered":"2024-09-12T17:36:34.892255+0000","last_unstale":"2024-09-12T19:29:42.396303+0000","last_undegraded":"2024-09-12T19:29:42.396303+0000","last_fullsized":"2024-09-12T19:29:42.396303+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:18.707321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400040,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":627,"num_read_kb":68904,"num_write":1058,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368858+0000","last_change":"2024-09-12T17:36:23.786560+0000","last_active":"2024-09-12T19:27:20.368858+0000","last_peered":"2024-09-12T19:27:20.368858+0000","last_clean":"2024-09-12T19:27:20.368858+0000","last_became_active":"2024-09-12T17:36:21.783069+0000","last_became_peered":"2024-09-12T17:36:21.783069+0000","last_unstale":"2024-09-12T19:27:20.368858+0000","last_undegraded":"2024-09-12T19:27:20.368858+0000","last_fullsized":"2024-09-12T19:27:20.368858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:06.261529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135285,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.602908+0000","last_change":"2024-09-12T17:36:38.901020+0000","last_active":"2024-09-12T19:27:05.602908+0000","last_peered":"2024-09-12T19:27:05.602908+0000","last_clean":"2024-09-12T19:27:05.602908+0000","last_became_active":"2024-09-12T17:36:38.900433+0000","last_became_peered":"2024-09-12T17:36:38.900433+0000","last_unstale":"2024-09-12T19:27:05.602908+0000","last_undegraded":"2024-09-12T19:27:05.602908+0000","last_fullsized":"2024-09-12T19:27:05.602908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:42.477669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'247","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:34.719450+0000","last_change":"2024-09-12T17:36:40.887225+0000","last_active":"2024-09-12T19:27:34.719450+0000","last_peered":"2024-09-12T19:27:34.719450+0000","last_clean":"2024-09-12T19:27:34.719450+0000","last_became_active":"2024-09-12T17:36:40.886345+0000","last_became_peered":"2024-09-12T17:36:40.886345+0000","last_unstale":"2024-09-12T19:27:34.719450+0000","last_undegraded":"2024-09-12T19:27:34.719450+0000","last_fullsized":"2024-09-12T19:27:34.719450+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:50.264902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'805","reported_seq":3501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.736271+0000","last_change":"2024-09-12T17:36:42.932438+0000","last_active":"2024-09-12T19:29:41.736271+0000","last_peered":"2024-09-12T19:29:41.736271+0000","last_clean":"2024-09-12T19:29:41.736271+0000","last_became_active":"2024-09-12T17:36:42.931598+0000","last_became_peered":"2024-09-12T17:36:42.931598+0000","last_unstale":"2024-09-12T19:29:41.736271+0000","last_undegraded":"2024-09-12T19:29:41.736271+0000","last_fullsized":"2024-09-12T19:29:41.736271+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:00.606220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'133","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.059775+0000","last_change":"2024-09-12T17:36:44.952618+0000","last_active":"2024-09-12T19:29:22.059775+0000","last_peered":"2024-09-12T19:29:22.059775+0000","last_clean":"2024-09-12T19:29:22.059775+0000","last_became_active":"2024-09-12T17:36:44.951849+0000","last_became_peered":"2024-09-12T17:36:44.951849+0000","last_unstale":"2024-09-12T19:29:22.059775+0000","last_undegraded":"2024-09-12T19:29:22.059775+0000","last_fullsized":"2024-09-12T19:29:22.059775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:49.786200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'742","reported_seq":2375,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691100+0000","last_change":"2024-09-12T17:36:36.893671+0000","last_active":"2024-09-12T19:27:00.691100+0000","last_peered":"2024-09-12T19:27:00.691100+0000","last_clean":"2024-09-12T19:27:00.691100+0000","last_became_active":"2024-09-12T17:36:36.892861+0000","last_became_peered":"2024-09-12T17:36:36.892861+0000","last_unstale":"2024-09-12T19:27:00.691100+0000","last_undegraded":"2024-09-12T19:27:00.691100+0000","last_fullsized":"2024-09-12T19:27:00.691100+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:54.133834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3560,"num_read_kb":3257,"num_write":956,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'347","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.389277+0000","last_change":"2024-09-12T17:36:34.883910+0000","last_active":"2024-09-12T19:29:42.389277+0000","last_peered":"2024-09-12T19:29:42.389277+0000","last_clean":"2024-09-12T19:29:42.389277+0000","last_became_active":"2024-09-12T17:36:34.883331+0000","last_became_peered":"2024-09-12T17:36:34.883331+0000","last_unstale":"2024-09-12T19:29:42.389277+0000","last_undegraded":"2024-09-12T19:29:42.389277+0000","last_fullsized":"2024-09-12T19:29:42.389277+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:14.534598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":26132,"num_write":1177,"num_write_kb":40752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":555,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690113+0000","last_change":"2024-09-12T17:36:24.506296+0000","last_active":"2024-09-12T19:26:55.690113+0000","last_peered":"2024-09-12T19:26:55.690113+0000","last_clean":"2024-09-12T19:26:55.690113+0000","last_became_active":"2024-09-12T17:36:22.059379+0000","last_became_peered":"2024-09-12T17:36:22.059379+0000","last_unstale":"2024-09-12T19:26:55.690113+0000","last_undegraded":"2024-09-12T19:26:55.690113+0000","last_fullsized":"2024-09-12T19:26:55.690113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:24.672143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012087210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.365102+0000","last_change":"2024-09-12T17:36:38.892129+0000","last_active":"2024-09-12T19:27:05.365102+0000","last_peered":"2024-09-12T19:27:05.365102+0000","last_clean":"2024-09-12T19:27:05.365102+0000","last_became_active":"2024-09-12T17:36:38.891807+0000","last_became_peered":"2024-09-12T17:36:38.891807+0000","last_unstale":"2024-09-12T19:27:05.365102+0000","last_undegraded":"2024-09-12T19:27:05.365102+0000","last_fullsized":"2024-09-12T19:27:05.365102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:48.578150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'173","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:33.637507+0000","last_change":"2024-09-12T17:36:40.898576+0000","last_active":"2024-09-12T19:27:33.637507+0000","last_peered":"2024-09-12T19:27:33.637507+0000","last_clean":"2024-09-12T19:27:33.637507+0000","last_became_active":"2024-09-12T17:36:40.897763+0000","last_became_peered":"2024-09-12T17:36:40.897763+0000","last_unstale":"2024-09-12T19:27:33.637507+0000","last_undegraded":"2024-09-12T19:27:33.637507+0000","last_fullsized":"2024-09-12T19:27:33.637507+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:41.559054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'801","reported_seq":3148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.031106+0000","last_change":"2024-09-12T17:36:42.930005+0000","last_active":"2024-09-12T19:29:42.031106+0000","last_peered":"2024-09-12T19:29:42.031106+0000","last_clean":"2024-09-12T19:29:42.031106+0000","last_became_active":"2024-09-12T17:36:42.928978+0000","last_became_peered":"2024-09-12T17:36:42.928978+0000","last_unstale":"2024-09-12T19:29:42.031106+0000","last_undegraded":"2024-09-12T19:29:42.031106+0000","last_fullsized":"2024-09-12T19:29:42.031106+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:50.493434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'235","reported_seq":781,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.583893+0000","last_change":"2024-09-12T17:36:44.960384+0000","last_active":"2024-09-12T19:28:02.583893+0000","last_peered":"2024-09-12T19:28:02.583893+0000","last_clean":"2024-09-12T19:28:02.583893+0000","last_became_active":"2024-09-12T17:36:44.956784+0000","last_became_peered":"2024-09-12T17:36:44.956784+0000","last_unstale":"2024-09-12T19:28:02.583893+0000","last_undegraded":"2024-09-12T19:28:02.583893+0000","last_fullsized":"2024-09-12T19:28:02.583893+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:30.401098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":233,"num_read_kb":216,"num_write":428,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'373","reported_seq":2039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250850+0000","last_change":"2024-09-12T17:36:36.884169+0000","last_active":"2024-09-12T19:27:05.250850+0000","last_peered":"2024-09-12T19:27:05.250850+0000","last_clean":"2024-09-12T19:27:05.250850+0000","last_became_active":"2024-09-12T17:36:36.883862+0000","last_became_peered":"2024-09-12T17:36:36.883862+0000","last_unstale":"2024-09-12T19:27:05.250850+0000","last_undegraded":"2024-09-12T19:27:05.250850+0000","last_fullsized":"2024-09-12T19:27:05.250850+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:01.097363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2422,"num_read_kb":2340,"num_write":416,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'349","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.310663+0000","last_change":"2024-09-12T17:36:34.869612+0000","last_active":"2024-09-12T19:29:42.310663+0000","last_peered":"2024-09-12T19:29:42.310663+0000","last_clean":"2024-09-12T19:29:42.310663+0000","last_became_active":"2024-09-12T17:36:34.868641+0000","last_became_peered":"2024-09-12T17:36:34.868641+0000","last_unstale":"2024-09-12T19:29:42.310663+0000","last_undegraded":"2024-09-12T19:29:42.310663+0000","last_fullsized":"2024-09-12T19:29:42.310663+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:13.423256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1398988,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":547,"num_read_kb":35743,"num_write":1181,"num_write_kb":32710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":548,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.363084+0000","last_change":"2024-09-12T17:36:23.787880+0000","last_active":"2024-09-12T19:26:55.363084+0000","last_peered":"2024-09-12T19:26:55.363084+0000","last_clean":"2024-09-12T19:26:55.363084+0000","last_became_active":"2024-09-12T17:36:22.058794+0000","last_became_peered":"2024-09-12T17:36:22.058794+0000","last_unstale":"2024-09-12T19:26:55.363084+0000","last_undegraded":"2024-09-12T19:26:55.363084+0000","last_fullsized":"2024-09-12T19:26:55.363084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:20.758971+0000","last_clean_scrub_stamp":"2024-09-12T17:36:20.758971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:04.896637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691146+0000","last_change":"2024-09-12T17:36:38.902092+0000","last_active":"2024-09-12T19:27:00.691146+0000","last_peered":"2024-09-12T19:27:00.691146+0000","last_clean":"2024-09-12T19:27:00.691146+0000","last_became_active":"2024-09-12T17:36:38.901418+0000","last_became_peered":"2024-09-12T17:36:38.901418+0000","last_unstale":"2024-09-12T19:27:00.691146+0000","last_undegraded":"2024-09-12T19:27:00.691146+0000","last_fullsized":"2024-09-12T19:27:00.691146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:20.898210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'811","reported_seq":1600,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.034585+0000","last_change":"2024-09-12T17:36:40.908672+0000","last_active":"2024-09-12T19:29:42.034585+0000","last_peered":"2024-09-12T19:29:42.034585+0000","last_clean":"2024-09-12T19:29:42.034585+0000","last_became_active":"2024-09-12T17:36:40.908231+0000","last_became_peered":"2024-09-12T17:36:40.908231+0000","last_unstale":"2024-09-12T19:29:42.034585+0000","last_undegraded":"2024-09-12T19:29:42.034585+0000","last_fullsized":"2024-09-12T19:29:42.034585+0000","mapping_epoch":30,"log_start":"265'800","ondisk_log_start":"265'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:35.140601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146317,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3243,"num_write":1152,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.693604+0000","last_change":"2024-09-12T17:36:42.933142+0000","last_active":"2024-09-12T19:27:10.693604+0000","last_peered":"2024-09-12T19:27:10.693604+0000","last_clean":"2024-09-12T19:27:10.693604+0000","last_became_active":"2024-09-12T17:36:42.932086+0000","last_became_peered":"2024-09-12T17:36:42.932086+0000","last_unstale":"2024-09-12T19:27:10.693604+0000","last_undegraded":"2024-09-12T19:27:10.693604+0000","last_fullsized":"2024-09-12T19:27:10.693604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:49.913999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'126","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249809+0000","last_change":"2024-09-12T17:36:44.961527+0000","last_active":"2024-09-12T19:27:00.249809+0000","last_peered":"2024-09-12T19:27:00.249809+0000","last_clean":"2024-09-12T19:27:00.249809+0000","last_became_active":"2024-09-12T17:36:44.960744+0000","last_became_peered":"2024-09-12T17:36:44.960744+0000","last_unstale":"2024-09-12T19:27:00.249809+0000","last_undegraded":"2024-09-12T19:27:00.249809+0000","last_fullsized":"2024-09-12T19:27:00.249809+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:42.564425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":186,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'135","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.080882+0000","last_change":"2024-09-12T17:36:44.940544+0000","last_active":"2024-09-12T19:28:03.080882+0000","last_peered":"2024-09-12T19:28:03.080882+0000","last_clean":"2024-09-12T19:28:03.080882+0000","last_became_active":"2024-09-12T17:36:44.939820+0000","last_became_peered":"2024-09-12T17:36:44.939820+0000","last_unstale":"2024-09-12T19:28:03.080882+0000","last_undegraded":"2024-09-12T19:28:03.080882+0000","last_fullsized":"2024-09-12T19:28:03.080882+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:23.567209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":235,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'799","reported_seq":2458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.117512+0000","last_change":"2024-09-12T17:36:36.883861+0000","last_active":"2024-09-12T19:28:32.117512+0000","last_peered":"2024-09-12T19:28:32.117512+0000","last_clean":"2024-09-12T19:28:32.117512+0000","last_became_active":"2024-09-12T17:36:36.883481+0000","last_became_peered":"2024-09-12T17:36:36.883481+0000","last_unstale":"2024-09-12T19:28:32.117512+0000","last_undegraded":"2024-09-12T19:28:32.117512+0000","last_fullsized":"2024-09-12T19:28:32.117512+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:44.086651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3831,"num_read_kb":3485,"num_write":1040,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'311","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.301687+0000","last_change":"2024-09-12T17:36:34.862214+0000","last_active":"2024-09-12T19:29:42.301687+0000","last_peered":"2024-09-12T19:29:42.301687+0000","last_clean":"2024-09-12T19:29:42.301687+0000","last_became_active":"2024-09-12T17:36:34.861702+0000","last_became_peered":"2024-09-12T17:36:34.861702+0000","last_unstale":"2024-09-12T19:29:42.301687+0000","last_undegraded":"2024-09-12T19:29:42.301687+0000","last_fullsized":"2024-09-12T19:29:42.301687+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:53.824355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273696,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":464,"num_read_kb":26224,"num_write":1045,"num_write_kb":25793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.040900+0000","last_change":"2024-09-12T17:36:38.895498+0000","last_active":"2024-09-12T19:26:19.040900+0000","last_peered":"2024-09-12T19:26:19.040900+0000","last_clean":"2024-09-12T19:26:19.040900+0000","last_became_active":"2024-09-12T17:36:38.894742+0000","last_became_peered":"2024-09-12T17:36:38.894742+0000","last_unstale":"2024-09-12T19:26:19.040900+0000","last_undegraded":"2024-09-12T19:26:19.040900+0000","last_fullsized":"2024-09-12T19:26:19.040900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:33.054267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'327","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.255285+0000","last_change":"2024-09-12T17:36:40.893532+0000","last_active":"2024-09-12T19:29:42.255285+0000","last_peered":"2024-09-12T19:29:42.255285+0000","last_clean":"2024-09-12T19:29:42.255285+0000","last_became_active":"2024-09-12T17:36:40.892710+0000","last_became_peered":"2024-09-12T17:36:40.892710+0000","last_unstale":"2024-09-12T19:29:42.255285+0000","last_undegraded":"2024-09-12T19:29:42.255285+0000","last_fullsized":"2024-09-12T19:29:42.255285+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:12.985322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49819,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":1091,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664522+0000","last_change":"2024-09-12T17:36:42.939570+0000","last_active":"2024-09-12T19:26:25.664522+0000","last_peered":"2024-09-12T19:26:25.664522+0000","last_clean":"2024-09-12T19:26:25.664522+0000","last_became_active":"2024-09-12T17:36:42.938834+0000","last_became_peered":"2024-09-12T17:36:42.938834+0000","last_unstale":"2024-09-12T19:26:25.664522+0000","last_undegraded":"2024-09-12T19:26:25.664522+0000","last_fullsized":"2024-09-12T19:26:25.664522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:13.130674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'139","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.674057+0000","last_change":"2024-09-12T17:36:44.953890+0000","last_active":"2024-09-12T19:27:05.674057+0000","last_peered":"2024-09-12T19:27:05.674057+0000","last_clean":"2024-09-12T19:27:05.674057+0000","last_became_active":"2024-09-12T17:36:44.953117+0000","last_became_peered":"2024-09-12T17:36:44.953117+0000","last_unstale":"2024-09-12T19:27:05.674057+0000","last_undegraded":"2024-09-12T19:27:05.674057+0000","last_fullsized":"2024-09-12T19:27:05.674057+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:53.223197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":202,"num_write":357,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'468","reported_seq":2073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682046+0000","last_change":"2024-09-12T17:36:36.901726+0000","last_active":"2024-09-12T19:26:20.682046+0000","last_peered":"2024-09-12T19:26:20.682046+0000","last_clean":"2024-09-12T19:26:20.682046+0000","last_became_active":"2024-09-12T17:36:36.900955+0000","last_became_peered":"2024-09-12T17:36:36.900955+0000","last_unstale":"2024-09-12T19:26:20.682046+0000","last_undegraded":"2024-09-12T19:26:20.682046+0000","last_fullsized":"2024-09-12T19:26:20.682046+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:39.022567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2490,"num_read_kb":2331,"num_write":571,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'341","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.364373+0000","last_change":"2024-09-12T17:36:34.878783+0000","last_active":"2024-09-12T19:29:42.364373+0000","last_peered":"2024-09-12T19:29:42.364373+0000","last_clean":"2024-09-12T19:29:42.364373+0000","last_became_active":"2024-09-12T17:36:34.878069+0000","last_became_peered":"2024-09-12T17:36:34.878069+0000","last_unstale":"2024-09-12T19:29:42.364373+0000","last_undegraded":"2024-09-12T19:29:42.364373+0000","last_fullsized":"2024-09-12T19:29:42.364373+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:53.462388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097855,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":782,"num_read_kb":26278,"num_write":971,"num_write_kb":31119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682090+0000","last_change":"2024-09-12T17:36:38.895965+0000","last_active":"2024-09-12T19:26:20.682090+0000","last_peered":"2024-09-12T19:26:20.682090+0000","last_clean":"2024-09-12T19:26:20.682090+0000","last_became_active":"2024-09-12T17:36:38.894800+0000","last_became_peered":"2024-09-12T17:36:38.894800+0000","last_unstale":"2024-09-12T19:26:20.682090+0000","last_undegraded":"2024-09-12T19:26:20.682090+0000","last_fullsized":"2024-09-12T19:26:20.682090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:45.719885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'81","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:22.977940+0000","last_change":"2024-09-12T17:36:40.910425+0000","last_active":"2024-09-12T19:27:22.977940+0000","last_peered":"2024-09-12T19:27:22.977940+0000","last_clean":"2024-09-12T19:27:22.977940+0000","last_became_active":"2024-09-12T17:36:40.909470+0000","last_became_peered":"2024-09-12T17:36:40.909470+0000","last_unstale":"2024-09-12T19:27:22.977940+0000","last_undegraded":"2024-09-12T19:27:22.977940+0000","last_fullsized":"2024-09-12T19:27:22.977940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:59.636810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242569+0000","last_change":"2024-09-12T17:36:42.923023+0000","last_active":"2024-09-12T19:26:25.242569+0000","last_peered":"2024-09-12T19:26:25.242569+0000","last_clean":"2024-09-12T19:26:25.242569+0000","last_became_active":"2024-09-12T17:36:42.922352+0000","last_became_peered":"2024-09-12T17:36:42.922352+0000","last_unstale":"2024-09-12T19:26:25.242569+0000","last_undegraded":"2024-09-12T19:26:25.242569+0000","last_fullsized":"2024-09-12T19:26:25.242569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:06.521341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'237","reported_seq":778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.928944+0000","last_change":"2024-09-12T17:36:44.946524+0000","last_active":"2024-09-12T19:28:02.928944+0000","last_peered":"2024-09-12T19:28:02.928944+0000","last_clean":"2024-09-12T19:28:02.928944+0000","last_became_active":"2024-09-12T17:36:44.945429+0000","last_became_peered":"2024-09-12T17:36:44.945429+0000","last_unstale":"2024-09-12T19:28:02.928944+0000","last_undegraded":"2024-09-12T19:28:02.928944+0000","last_fullsized":"2024-09-12T19:28:02.928944+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:03.136753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":307,"num_read_kb":303,"num_write":509,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'826","reported_seq":2357,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.322547+0000","last_change":"2024-09-12T17:36:36.901899+0000","last_active":"2024-09-12T19:26:59.322547+0000","last_peered":"2024-09-12T19:26:59.322547+0000","last_clean":"2024-09-12T19:26:59.322547+0000","last_became_active":"2024-09-12T17:36:36.901053+0000","last_became_peered":"2024-09-12T17:36:36.901053+0000","last_unstale":"2024-09-12T19:26:59.322547+0000","last_undegraded":"2024-09-12T19:26:59.322547+0000","last_fullsized":"2024-09-12T19:26:59.322547+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:22.502956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3878,"num_read_kb":3474,"num_write":1082,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'354","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.405414+0000","last_change":"2024-09-12T17:36:34.878025+0000","last_active":"2024-09-12T19:29:42.405414+0000","last_peered":"2024-09-12T19:29:42.405414+0000","last_clean":"2024-09-12T19:29:42.405414+0000","last_became_active":"2024-09-12T17:36:34.877620+0000","last_became_peered":"2024-09-12T17:36:34.877620+0000","last_unstale":"2024-09-12T19:29:42.405414+0000","last_undegraded":"2024-09-12T19:29:42.405414+0000","last_fullsized":"2024-09-12T19:29:42.405414+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:44.559070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048740,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":51733,"num_write":1081,"num_write_kb":38676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241189+0000","last_change":"2024-09-12T17:36:38.903616+0000","last_active":"2024-09-12T19:26:20.241189+0000","last_peered":"2024-09-12T19:26:20.241189+0000","last_clean":"2024-09-12T19:26:20.241189+0000","last_became_active":"2024-09-12T17:36:38.902188+0000","last_became_peered":"2024-09-12T17:36:38.902188+0000","last_unstale":"2024-09-12T19:26:20.241189+0000","last_undegraded":"2024-09-12T19:26:20.241189+0000","last_fullsized":"2024-09-12T19:26:20.241189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:51.927110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'377","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.842788+0000","last_change":"2024-09-12T17:36:40.899887+0000","last_active":"2024-09-12T19:29:41.842788+0000","last_peered":"2024-09-12T19:29:41.842788+0000","last_clean":"2024-09-12T19:29:41.842788+0000","last_became_active":"2024-09-12T17:36:40.899201+0000","last_became_peered":"2024-09-12T17:36:40.899201+0000","last_unstale":"2024-09-12T19:29:41.842788+0000","last_undegraded":"2024-09-12T19:29:41.842788+0000","last_fullsized":"2024-09-12T19:29:41.842788+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:19.009661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51900,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":1290,"num_write":486,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.084454+0000","last_change":"2024-09-12T17:36:42.930518+0000","last_active":"2024-09-12T19:26:25.084454+0000","last_peered":"2024-09-12T19:26:25.084454+0000","last_clean":"2024-09-12T19:26:25.084454+0000","last_became_active":"2024-09-12T17:36:42.928596+0000","last_became_peered":"2024-09-12T17:36:42.928596+0000","last_unstale":"2024-09-12T19:26:25.084454+0000","last_undegraded":"2024-09-12T19:26:25.084454+0000","last_fullsized":"2024-09-12T19:26:25.084454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:38.476152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'143","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360848+0000","last_change":"2024-09-12T17:36:44.963106+0000","last_active":"2024-09-12T19:26:45.360848+0000","last_peered":"2024-09-12T19:26:45.360848+0000","last_clean":"2024-09-12T19:26:45.360848+0000","last_became_active":"2024-09-12T17:36:44.962445+0000","last_became_peered":"2024-09-12T17:36:44.962445+0000","last_unstale":"2024-09-12T19:26:45.360848+0000","last_undegraded":"2024-09-12T19:26:45.360848+0000","last_fullsized":"2024-09-12T19:26:45.360848+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:03.293578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":234,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'601","reported_seq":2246,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.663326+0000","last_change":"2024-09-12T17:36:36.904547+0000","last_active":"2024-09-12T19:26:20.663326+0000","last_peered":"2024-09-12T19:26:20.663326+0000","last_clean":"2024-09-12T19:26:20.663326+0000","last_became_active":"2024-09-12T17:36:36.903813+0000","last_became_peered":"2024-09-12T17:36:36.903813+0000","last_unstale":"2024-09-12T19:26:20.663326+0000","last_undegraded":"2024-09-12T19:26:20.663326+0000","last_fullsized":"2024-09-12T19:26:20.663326+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:28.273003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3115,"num_read_kb":2836,"num_write":758,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'294","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.396235+0000","last_change":"2024-09-12T17:36:34.887548+0000","last_active":"2024-09-12T19:29:42.396235+0000","last_peered":"2024-09-12T19:29:42.396235+0000","last_clean":"2024-09-12T19:29:42.396235+0000","last_became_active":"2024-09-12T17:36:34.886741+0000","last_became_peered":"2024-09-12T17:36:34.886741+0000","last_unstale":"2024-09-12T19:29:42.396235+0000","last_undegraded":"2024-09-12T19:29:42.396235+0000","last_fullsized":"2024-09-12T19:29:42.396235+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:29.979024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1961495,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":454,"num_read_kb":24643,"num_write":1003,"num_write_kb":38417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.353955+0000","last_change":"2024-09-12T17:36:38.903818+0000","last_active":"2024-09-12T19:26:20.353955+0000","last_peered":"2024-09-12T19:26:20.353955+0000","last_clean":"2024-09-12T19:26:20.353955+0000","last_became_active":"2024-09-12T17:36:38.903210+0000","last_became_peered":"2024-09-12T17:36:38.903210+0000","last_unstale":"2024-09-12T19:26:20.353955+0000","last_undegraded":"2024-09-12T19:26:20.353955+0000","last_fullsized":"2024-09-12T19:26:20.353955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:00.851761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'308","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.727023+0000","last_change":"2024-09-12T17:36:40.913086+0000","last_active":"2024-09-12T19:29:41.727023+0000","last_peered":"2024-09-12T19:29:41.727023+0000","last_clean":"2024-09-12T19:29:41.727023+0000","last_became_active":"2024-09-12T17:36:40.912283+0000","last_became_peered":"2024-09-12T17:36:40.912283+0000","last_unstale":"2024-09-12T19:29:41.727023+0000","last_undegraded":"2024-09-12T19:29:41.727023+0000","last_fullsized":"2024-09-12T19:29:41.727023+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:05.161253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1100,"num_write":404,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664637+0000","last_change":"2024-09-12T17:36:42.928432+0000","last_active":"2024-09-12T19:26:25.664637+0000","last_peered":"2024-09-12T19:26:25.664637+0000","last_clean":"2024-09-12T19:26:25.664637+0000","last_became_active":"2024-09-12T17:36:42.927724+0000","last_became_peered":"2024-09-12T17:36:42.927724+0000","last_unstale":"2024-09-12T19:26:25.664637+0000","last_undegraded":"2024-09-12T19:26:25.664637+0000","last_fullsized":"2024-09-12T19:26:25.664637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:30.771719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'721","reported_seq":2248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.028622+0000","last_change":"2024-09-12T17:36:36.886104+0000","last_active":"2024-09-12T19:29:21.028622+0000","last_peered":"2024-09-12T19:29:21.028622+0000","last_clean":"2024-09-12T19:29:21.028622+0000","last_became_active":"2024-09-12T17:36:36.885820+0000","last_became_peered":"2024-09-12T17:36:36.885820+0000","last_unstale":"2024-09-12T19:29:21.028622+0000","last_undegraded":"2024-09-12T19:29:21.028622+0000","last_fullsized":"2024-09-12T19:29:21.028622+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.701415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3501,"num_read_kb":3197,"num_write":936,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'338","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.344044+0000","last_change":"2024-09-12T17:36:34.888051+0000","last_active":"2024-09-12T19:29:42.344044+0000","last_peered":"2024-09-12T19:29:42.344044+0000","last_clean":"2024-09-12T19:29:42.344044+0000","last_became_active":"2024-09-12T17:36:34.887018+0000","last_became_peered":"2024-09-12T17:36:34.887018+0000","last_unstale":"2024-09-12T19:29:42.344044+0000","last_undegraded":"2024-09-12T19:29:42.344044+0000","last_fullsized":"2024-09-12T19:29:42.344044+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:00.894469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":38393,"num_write":1072,"num_write_kb":34235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:04.050979+0000","last_change":"2024-09-12T17:36:38.895303+0000","last_active":"2024-09-12T19:27:04.050979+0000","last_peered":"2024-09-12T19:27:04.050979+0000","last_clean":"2024-09-12T19:27:04.050979+0000","last_became_active":"2024-09-12T17:36:38.894452+0000","last_became_peered":"2024-09-12T17:36:38.894452+0000","last_unstale":"2024-09-12T19:27:04.050979+0000","last_undegraded":"2024-09-12T19:27:04.050979+0000","last_fullsized":"2024-09-12T19:27:04.050979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:40.122335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'514","reported_seq":1187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.688440+0000","last_change":"2024-09-12T17:36:40.910273+0000","last_active":"2024-09-12T19:29:41.688440+0000","last_peered":"2024-09-12T19:29:41.688440+0000","last_clean":"2024-09-12T19:29:41.688440+0000","last_became_active":"2024-09-12T17:36:40.909552+0000","last_became_peered":"2024-09-12T17:36:40.909552+0000","last_unstale":"2024-09-12T19:29:41.688440+0000","last_undegraded":"2024-09-12T19:29:41.688440+0000","last_fullsized":"2024-09-12T19:29:41.688440+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:32.101093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105771,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":904,"num_read_kb":2059,"num_write":766,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.247037+0000","last_change":"2024-09-12T17:36:42.943311+0000","last_active":"2024-09-12T19:26:45.247037+0000","last_peered":"2024-09-12T19:26:45.247037+0000","last_clean":"2024-09-12T19:26:45.247037+0000","last_became_active":"2024-09-12T17:36:42.942627+0000","last_became_peered":"2024-09-12T17:36:42.942627+0000","last_unstale":"2024-09-12T19:26:45.247037+0000","last_undegraded":"2024-09-12T19:26:45.247037+0000","last_fullsized":"2024-09-12T19:26:45.247037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:28.862834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'167","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:57.461795+0000","last_change":"2024-09-12T17:36:44.959491+0000","last_active":"2024-09-12T19:27:57.461795+0000","last_peered":"2024-09-12T19:27:57.461795+0000","last_clean":"2024-09-12T19:27:57.461795+0000","last_became_active":"2024-09-12T17:36:44.956655+0000","last_became_peered":"2024-09-12T17:36:44.956655+0000","last_unstale":"2024-09-12T19:27:57.461795+0000","last_undegraded":"2024-09-12T19:27:57.461795+0000","last_fullsized":"2024-09-12T19:27:57.461795+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:59.575861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":241,"num_write":385,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'357","reported_seq":1938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691336+0000","last_change":"2024-09-12T17:36:36.912708+0000","last_active":"2024-09-12T19:27:00.691336+0000","last_peered":"2024-09-12T19:27:00.691336+0000","last_clean":"2024-09-12T19:27:00.691336+0000","last_became_active":"2024-09-12T17:36:36.911889+0000","last_became_peered":"2024-09-12T17:36:36.911889+0000","last_unstale":"2024-09-12T19:27:00.691336+0000","last_undegraded":"2024-09-12T19:27:00.691336+0000","last_fullsized":"2024-09-12T19:27:00.691336+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:52.030740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2021,"num_read_kb":1969,"num_write":390,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'354","reported_seq":1127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.391919+0000","last_change":"2024-09-12T17:36:34.852681+0000","last_active":"2024-09-12T19:29:42.391919+0000","last_peered":"2024-09-12T19:29:42.391919+0000","last_clean":"2024-09-12T19:29:42.391919+0000","last_became_active":"2024-09-12T17:36:34.851161+0000","last_became_peered":"2024-09-12T17:36:34.851161+0000","last_unstale":"2024-09-12T19:29:42.391919+0000","last_undegraded":"2024-09-12T19:29:42.391919+0000","last_fullsized":"2024-09-12T19:29:42.391919+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:27.435874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273705,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":731,"num_read_kb":47360,"num_write":1100,"num_write_kb":33375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.251083+0000","last_change":"2024-09-12T17:36:38.905238+0000","last_active":"2024-09-12T19:27:05.251083+0000","last_peered":"2024-09-12T19:27:05.251083+0000","last_clean":"2024-09-12T19:27:05.251083+0000","last_became_active":"2024-09-12T17:36:38.904409+0000","last_became_peered":"2024-09-12T17:36:38.904409+0000","last_unstale":"2024-09-12T19:27:05.251083+0000","last_undegraded":"2024-09-12T19:27:05.251083+0000","last_fullsized":"2024-09-12T19:27:05.251083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:40.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'404","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.767941+0000","last_change":"2024-09-12T17:36:40.903223+0000","last_active":"2024-09-12T19:29:41.767941+0000","last_peered":"2024-09-12T19:29:41.767941+0000","last_clean":"2024-09-12T19:29:41.767941+0000","last_became_active":"2024-09-12T17:36:40.902718+0000","last_became_peered":"2024-09-12T17:36:40.902718+0000","last_unstale":"2024-09-12T19:29:41.767941+0000","last_undegraded":"2024-09-12T19:29:41.767941+0000","last_fullsized":"2024-09-12T19:29:41.767941+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.363639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54769,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":679,"num_read_kb":1358,"num_write":564,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.256436+0000","last_change":"2024-09-12T17:36:42.921077+0000","last_active":"2024-09-12T19:26:45.256436+0000","last_peered":"2024-09-12T19:26:45.256436+0000","last_clean":"2024-09-12T19:26:45.256436+0000","last_became_active":"2024-09-12T17:36:42.920352+0000","last_became_peered":"2024-09-12T17:36:42.920352+0000","last_unstale":"2024-09-12T19:26:45.256436+0000","last_undegraded":"2024-09-12T19:26:45.256436+0000","last_fullsized":"2024-09-12T19:26:45.256436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:47.099873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'181","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355355+0000","last_change":"2024-09-12T17:36:44.946661+0000","last_active":"2024-09-12T19:26:25.355355+0000","last_peered":"2024-09-12T19:26:25.355355+0000","last_clean":"2024-09-12T19:26:25.355355+0000","last_became_active":"2024-09-12T17:36:44.945753+0000","last_became_peered":"2024-09-12T17:36:44.945753+0000","last_unstale":"2024-09-12T19:26:25.355355+0000","last_undegraded":"2024-09-12T19:26:25.355355+0000","last_fullsized":"2024-09-12T19:26:25.355355+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:51.605529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":278,"num_read_kb":268,"num_write":526,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'523","reported_seq":2253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.623056+0000","last_change":"2024-09-12T17:36:36.910292+0000","last_active":"2024-09-12T19:28:02.623056+0000","last_peered":"2024-09-12T19:28:02.623056+0000","last_clean":"2024-09-12T19:28:02.623056+0000","last_became_active":"2024-09-12T17:36:36.909488+0000","last_became_peered":"2024-09-12T17:36:36.909488+0000","last_unstale":"2024-09-12T19:28:02.623056+0000","last_undegraded":"2024-09-12T19:28:02.623056+0000","last_fullsized":"2024-09-12T19:28:02.623056+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:27.498312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2968,"num_read_kb":2777,"num_write":639,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'386","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.369568+0000","last_change":"2024-09-12T17:36:34.857968+0000","last_active":"2024-09-12T19:29:42.369568+0000","last_peered":"2024-09-12T19:29:42.369568+0000","last_clean":"2024-09-12T19:29:42.369568+0000","last_became_active":"2024-09-12T17:36:34.857645+0000","last_became_peered":"2024-09-12T17:36:34.857645+0000","last_unstale":"2024-09-12T19:29:42.369568+0000","last_undegraded":"2024-09-12T19:29:42.369568+0000","last_fullsized":"2024-09-12T19:29:42.369568+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:06.150098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287556,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":605,"num_read_kb":13478,"num_write":1299,"num_write_kb":33813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.245950+0000","last_change":"2024-09-12T17:36:38.905353+0000","last_active":"2024-09-12T19:26:40.245950+0000","last_peered":"2024-09-12T19:26:40.245950+0000","last_clean":"2024-09-12T19:26:40.245950+0000","last_became_active":"2024-09-12T17:36:38.904619+0000","last_became_peered":"2024-09-12T17:36:38.904619+0000","last_unstale":"2024-09-12T19:26:40.245950+0000","last_undegraded":"2024-09-12T19:26:40.245950+0000","last_fullsized":"2024-09-12T19:26:40.245950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:01.832724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'316","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.412015+0000","last_change":"2024-09-12T17:36:40.909967+0000","last_active":"2024-09-12T19:29:42.412015+0000","last_peered":"2024-09-12T19:29:42.412015+0000","last_clean":"2024-09-12T19:29:42.412015+0000","last_became_active":"2024-09-12T17:36:40.909189+0000","last_became_peered":"2024-09-12T17:36:40.909189+0000","last_unstale":"2024-09-12T19:29:42.412015+0000","last_undegraded":"2024-09-12T19:29:42.412015+0000","last_fullsized":"2024-09-12T19:29:42.412015+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:32.736700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":521,"num_read_kb":1073,"num_write":404,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.674082+0000","last_change":"2024-09-12T17:36:42.939553+0000","last_active":"2024-09-12T19:27:05.674082+0000","last_peered":"2024-09-12T19:27:05.674082+0000","last_clean":"2024-09-12T19:27:05.674082+0000","last_became_active":"2024-09-12T17:36:42.938451+0000","last_became_peered":"2024-09-12T17:36:42.938451+0000","last_unstale":"2024-09-12T19:27:05.674082+0000","last_undegraded":"2024-09-12T19:27:05.674082+0000","last_fullsized":"2024-09-12T19:27:05.674082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:33.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'109","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.052785+0000","last_change":"2024-09-12T17:36:44.950080+0000","last_active":"2024-09-12T19:29:22.052785+0000","last_peered":"2024-09-12T19:29:22.052785+0000","last_clean":"2024-09-12T19:29:22.052785+0000","last_became_active":"2024-09-12T17:36:44.949351+0000","last_became_peered":"2024-09-12T17:36:44.949351+0000","last_unstale":"2024-09-12T19:29:22.052785+0000","last_undegraded":"2024-09-12T19:29:22.052785+0000","last_fullsized":"2024-09-12T19:29:22.052785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:39.166790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":161,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'473","reported_seq":2149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181763+0000","last_change":"2024-09-12T17:36:36.903747+0000","last_active":"2024-09-12T19:27:10.181763+0000","last_peered":"2024-09-12T19:27:10.181763+0000","last_clean":"2024-09-12T19:27:10.181763+0000","last_became_active":"2024-09-12T17:36:36.902998+0000","last_became_peered":"2024-09-12T17:36:36.902998+0000","last_unstale":"2024-09-12T19:27:10.181763+0000","last_undegraded":"2024-09-12T19:27:10.181763+0000","last_fullsized":"2024-09-12T19:27:10.181763+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:30.836602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2683,"num_read_kb":2531,"num_write":585,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'402","reported_seq":1130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.329285+0000","last_change":"2024-09-12T17:36:34.869269+0000","last_active":"2024-09-12T19:29:42.329285+0000","last_peered":"2024-09-12T19:29:42.329285+0000","last_clean":"2024-09-12T19:29:42.329285+0000","last_became_active":"2024-09-12T17:36:34.867987+0000","last_became_peered":"2024-09-12T17:36:34.867987+0000","last_unstale":"2024-09-12T19:29:42.329285+0000","last_undegraded":"2024-09-12T19:29:42.329285+0000","last_fullsized":"2024-09-12T19:29:42.329285+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:07.281605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062574,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":616,"num_read_kb":94353,"num_write":1270,"num_write_kb":45131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686764+0000","last_change":"2024-09-12T17:36:38.901399+0000","last_active":"2024-09-12T19:26:40.686764+0000","last_peered":"2024-09-12T19:26:40.686764+0000","last_clean":"2024-09-12T19:26:40.686764+0000","last_became_active":"2024-09-12T17:36:38.900687+0000","last_became_peered":"2024-09-12T17:36:38.900687+0000","last_unstale":"2024-09-12T19:26:40.686764+0000","last_undegraded":"2024-09-12T19:26:40.686764+0000","last_fullsized":"2024-09-12T19:26:40.686764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:39.929327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'157","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:34.443859+0000","last_change":"2024-09-12T17:36:40.905441+0000","last_active":"2024-09-12T19:27:34.443859+0000","last_peered":"2024-09-12T19:27:34.443859+0000","last_clean":"2024-09-12T19:27:34.443859+0000","last_became_active":"2024-09-12T17:36:40.904671+0000","last_became_peered":"2024-09-12T17:36:40.904671+0000","last_unstale":"2024-09-12T19:27:34.443859+0000","last_undegraded":"2024-09-12T19:27:34.443859+0000","last_fullsized":"2024-09-12T19:27:34.443859+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:48.997983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":202,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'770","reported_seq":3477,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.993434+0000","last_change":"2024-09-12T17:36:42.930179+0000","last_active":"2024-09-12T19:29:40.993434+0000","last_peered":"2024-09-12T19:29:40.993434+0000","last_clean":"2024-09-12T19:29:40.993434+0000","last_became_active":"2024-09-12T17:36:42.929232+0000","last_became_peered":"2024-09-12T17:36:42.929232+0000","last_unstale":"2024-09-12T19:29:40.993434+0000","last_undegraded":"2024-09-12T19:29:40.993434+0000","last_fullsized":"2024-09-12T19:29:40.993434+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:00.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'132","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.338006+0000","last_change":"2024-09-12T17:36:44.946960+0000","last_active":"2024-09-12T19:26:59.338006+0000","last_peered":"2024-09-12T19:26:59.338006+0000","last_clean":"2024-09-12T19:26:59.338006+0000","last_became_active":"2024-09-12T17:36:44.945777+0000","last_became_peered":"2024-09-12T17:36:44.945777+0000","last_unstale":"2024-09-12T19:26:59.338006+0000","last_undegraded":"2024-09-12T19:26:59.338006+0000","last_fullsized":"2024-09-12T19:26:59.338006+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:22.225543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":212,"num_write":329,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'428","reported_seq":1981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.044099+0000","last_change":"2024-09-12T17:36:36.897272+0000","last_active":"2024-09-12T19:29:21.044099+0000","last_peered":"2024-09-12T19:29:21.044099+0000","last_clean":"2024-09-12T19:29:21.044099+0000","last_became_active":"2024-09-12T17:36:36.896871+0000","last_became_peered":"2024-09-12T17:36:36.896871+0000","last_unstale":"2024-09-12T19:29:21.044099+0000","last_undegraded":"2024-09-12T19:29:21.044099+0000","last_fullsized":"2024-09-12T19:29:21.044099+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:55.322767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2316,"num_read_kb":2187,"num_write":500,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'400","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.349477+0000","last_change":"2024-09-12T17:36:34.869011+0000","last_active":"2024-09-12T19:29:42.349477+0000","last_peered":"2024-09-12T19:29:42.349477+0000","last_clean":"2024-09-12T19:29:42.349477+0000","last_became_active":"2024-09-12T17:36:34.868685+0000","last_became_peered":"2024-09-12T17:36:34.868685+0000","last_unstale":"2024-09-12T19:29:42.349477+0000","last_undegraded":"2024-09-12T19:29:42.349477+0000","last_fullsized":"2024-09-12T19:29:42.349477+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:45.839499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":585,"num_read_kb":59989,"num_write":1252,"num_write_kb":34100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.087989+0000","last_change":"2024-09-12T17:36:38.885901+0000","last_active":"2024-09-12T19:26:40.087989+0000","last_peered":"2024-09-12T19:26:40.087989+0000","last_clean":"2024-09-12T19:26:40.087989+0000","last_became_active":"2024-09-12T17:36:38.885092+0000","last_became_peered":"2024-09-12T17:36:38.885092+0000","last_unstale":"2024-09-12T19:26:40.087989+0000","last_undegraded":"2024-09-12T19:26:40.087989+0000","last_fullsized":"2024-09-12T19:26:40.087989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:14.638797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'409","reported_seq":1062,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.399047+0000","last_change":"2024-09-12T17:36:40.902995+0000","last_active":"2024-09-12T19:29:41.399047+0000","last_peered":"2024-09-12T19:29:41.399047+0000","last_clean":"2024-09-12T19:29:41.399047+0000","last_became_active":"2024-09-12T17:36:40.902484+0000","last_became_peered":"2024-09-12T17:36:40.902484+0000","last_unstale":"2024-09-12T19:29:41.399047+0000","last_undegraded":"2024-09-12T19:29:41.399047+0000","last_fullsized":"2024-09-12T19:29:41.399047+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:00.010334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48470,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":642,"num_read_kb":1267,"num_write":506,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.671027+0000","last_change":"2024-09-12T17:36:42.937350+0000","last_active":"2024-09-12T19:25:30.671027+0000","last_peered":"2024-09-12T19:25:30.671027+0000","last_clean":"2024-09-12T19:25:30.671027+0000","last_became_active":"2024-09-12T17:36:42.932462+0000","last_became_peered":"2024-09-12T17:36:42.932462+0000","last_unstale":"2024-09-12T19:25:30.671027+0000","last_undegraded":"2024-09-12T19:25:30.671027+0000","last_fullsized":"2024-09-12T19:25:30.671027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:45.961114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'125","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:59.522990+0000","last_change":"2024-09-12T17:36:44.944698+0000","last_active":"2024-09-12T19:27:59.522990+0000","last_peered":"2024-09-12T19:27:59.522990+0000","last_clean":"2024-09-12T19:27:59.522990+0000","last_became_active":"2024-09-12T17:36:44.943948+0000","last_became_peered":"2024-09-12T17:36:44.943948+0000","last_unstale":"2024-09-12T19:27:59.522990+0000","last_undegraded":"2024-09-12T19:27:59.522990+0000","last_fullsized":"2024-09-12T19:27:59.522990+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:55.649115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":170,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'823","reported_seq":2518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.620849+0000","last_change":"2024-09-12T17:36:36.888995+0000","last_active":"2024-09-12T19:28:02.620849+0000","last_peered":"2024-09-12T19:28:02.620849+0000","last_clean":"2024-09-12T19:28:02.620849+0000","last_became_active":"2024-09-12T17:36:36.888747+0000","last_became_peered":"2024-09-12T17:36:36.888747+0000","last_unstale":"2024-09-12T19:28:02.620849+0000","last_undegraded":"2024-09-12T19:28:02.620849+0000","last_fullsized":"2024-09-12T19:28:02.620849+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:00.206667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3583,"num_write":1069,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'486","reported_seq":1175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.362952+0000","last_change":"2024-09-12T17:36:34.877161+0000","last_active":"2024-09-12T19:29:42.362952+0000","last_peered":"2024-09-12T19:29:42.362952+0000","last_clean":"2024-09-12T19:29:42.362952+0000","last_became_active":"2024-09-12T17:36:34.876487+0000","last_became_peered":"2024-09-12T17:36:34.876487+0000","last_unstale":"2024-09-12T19:29:42.362952+0000","last_undegraded":"2024-09-12T19:29:42.362952+0000","last_fullsized":"2024-09-12T19:29:42.362952+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:54.874115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":839,"num_read_kb":5903,"num_write":1394,"num_write_kb":31714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.245910+0000","last_change":"2024-09-12T17:36:38.902372+0000","last_active":"2024-09-12T19:26:40.245910+0000","last_peered":"2024-09-12T19:26:40.245910+0000","last_clean":"2024-09-12T19:26:40.245910+0000","last_became_active":"2024-09-12T17:36:38.901575+0000","last_became_peered":"2024-09-12T17:36:38.901575+0000","last_unstale":"2024-09-12T19:26:40.245910+0000","last_undegraded":"2024-09-12T19:26:40.245910+0000","last_fullsized":"2024-09-12T19:26:40.245910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:49.517366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'326","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.441504+0000","last_change":"2024-09-12T17:36:40.901766+0000","last_active":"2024-09-12T19:29:41.441504+0000","last_peered":"2024-09-12T19:29:41.441504+0000","last_clean":"2024-09-12T19:29:41.441504+0000","last_became_active":"2024-09-12T17:36:40.900739+0000","last_became_peered":"2024-09-12T17:36:40.900739+0000","last_unstale":"2024-09-12T19:29:41.441504+0000","last_undegraded":"2024-09-12T19:29:41.441504+0000","last_fullsized":"2024-09-12T19:29:41.441504+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:19.813863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":1258,"num_write":448,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.348981+0000","last_change":"2024-09-12T17:36:42.921850+0000","last_active":"2024-09-12T19:26:00.348981+0000","last_peered":"2024-09-12T19:26:00.348981+0000","last_clean":"2024-09-12T19:26:00.348981+0000","last_became_active":"2024-09-12T17:36:42.920767+0000","last_became_peered":"2024-09-12T17:36:42.920767+0000","last_unstale":"2024-09-12T19:26:00.348981+0000","last_undegraded":"2024-09-12T19:26:00.348981+0000","last_fullsized":"2024-09-12T19:26:00.348981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:22.058824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'123","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.194923+0000","last_change":"2024-09-12T17:36:44.961031+0000","last_active":"2024-09-12T19:27:10.194923+0000","last_peered":"2024-09-12T19:27:10.194923+0000","last_clean":"2024-09-12T19:27:10.194923+0000","last_became_active":"2024-09-12T17:36:44.959535+0000","last_became_peered":"2024-09-12T17:36:44.959535+0000","last_unstale":"2024-09-12T19:27:10.194923+0000","last_undegraded":"2024-09-12T19:27:10.194923+0000","last_fullsized":"2024-09-12T19:27:10.194923+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:18.916773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":231,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'446","reported_seq":1831,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.364011+0000","last_change":"2024-09-12T17:36:36.895868+0000","last_active":"2024-09-12T19:28:00.364011+0000","last_peered":"2024-09-12T19:28:00.364011+0000","last_clean":"2024-09-12T19:28:00.364011+0000","last_became_active":"2024-09-12T17:36:36.895126+0000","last_became_peered":"2024-09-12T17:36:36.895126+0000","last_unstale":"2024-09-12T19:28:00.364011+0000","last_undegraded":"2024-09-12T19:28:00.364011+0000","last_fullsized":"2024-09-12T19:28:00.364011+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:38.358463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2194,"num_read_kb":2018,"num_write":546,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'356","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.347253+0000","last_change":"2024-09-12T17:36:34.879150+0000","last_active":"2024-09-12T19:29:42.347253+0000","last_peered":"2024-09-12T19:29:42.347253+0000","last_clean":"2024-09-12T19:29:42.347253+0000","last_became_active":"2024-09-12T17:36:34.878381+0000","last_became_peered":"2024-09-12T17:36:34.878381+0000","last_unstale":"2024-09-12T19:29:42.347253+0000","last_undegraded":"2024-09-12T19:29:42.347253+0000","last_fullsized":"2024-09-12T19:29:42.347253+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:53.395319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":568,"num_read_kb":62029,"num_write":1071,"num_write_kb":23225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.071542+0000","last_change":"2024-09-12T17:36:38.888449+0000","last_active":"2024-09-12T19:25:25.071542+0000","last_peered":"2024-09-12T19:25:25.071542+0000","last_clean":"2024-09-12T19:25:25.071542+0000","last_became_active":"2024-09-12T17:36:38.887476+0000","last_became_peered":"2024-09-12T17:36:38.887476+0000","last_unstale":"2024-09-12T19:25:25.071542+0000","last_undegraded":"2024-09-12T19:25:25.071542+0000","last_fullsized":"2024-09-12T19:25:25.071542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:59.359839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'246","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.336165+0000","last_change":"2024-09-12T17:36:40.904837+0000","last_active":"2024-09-12T19:29:42.336165+0000","last_peered":"2024-09-12T19:29:42.336165+0000","last_clean":"2024-09-12T19:29:42.336165+0000","last_became_active":"2024-09-12T17:36:40.904126+0000","last_became_peered":"2024-09-12T17:36:40.904126+0000","last_unstale":"2024-09-12T19:29:42.336165+0000","last_undegraded":"2024-09-12T19:29:42.336165+0000","last_fullsized":"2024-09-12T19:29:42.336165+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:14.815589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52700,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":960,"num_write":326,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360790+0000","last_change":"2024-09-12T17:36:42.935140+0000","last_active":"2024-09-12T19:26:45.360790+0000","last_peered":"2024-09-12T19:26:45.360790+0000","last_clean":"2024-09-12T19:26:45.360790+0000","last_became_active":"2024-09-12T17:36:42.934140+0000","last_became_peered":"2024-09-12T17:36:42.934140+0000","last_unstale":"2024-09-12T19:26:45.360790+0000","last_undegraded":"2024-09-12T19:26:45.360790+0000","last_fullsized":"2024-09-12T19:26:45.360790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:50.636896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'159","reported_seq":1650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.254322+0000","last_change":"2024-09-12T17:36:44.966081+0000","last_active":"2024-09-12T19:27:55.254322+0000","last_peered":"2024-09-12T19:27:55.254322+0000","last_clean":"2024-09-12T19:27:55.254322+0000","last_became_active":"2024-09-12T17:36:44.965427+0000","last_became_peered":"2024-09-12T17:36:44.965427+0000","last_unstale":"2024-09-12T19:27:55.254322+0000","last_undegraded":"2024-09-12T19:27:55.254322+0000","last_fullsized":"2024-09-12T19:27:55.254322+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:20.397523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1232,"num_read_kb":1221,"num_write":362,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'993","reported_seq":2719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.539915+0000","last_change":"2024-09-12T17:36:36.914615+0000","last_active":"2024-09-12T19:28:02.539915+0000","last_peered":"2024-09-12T19:28:02.539915+0000","last_clean":"2024-09-12T19:28:02.539915+0000","last_became_active":"2024-09-12T17:36:36.914315+0000","last_became_peered":"2024-09-12T17:36:36.914315+0000","last_unstale":"2024-09-12T19:28:02.539915+0000","last_undegraded":"2024-09-12T19:28:02.539915+0000","last_fullsized":"2024-09-12T19:28:02.539915+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":900,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:24.570940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4811,"num_read_kb":4330,"num_write":1385,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'333","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.398970+0000","last_change":"2024-09-12T17:36:34.873212+0000","last_active":"2024-09-12T19:29:42.398970+0000","last_peered":"2024-09-12T19:29:42.398970+0000","last_clean":"2024-09-12T19:29:42.398970+0000","last_became_active":"2024-09-12T17:36:34.871889+0000","last_became_peered":"2024-09-12T17:36:34.871889+0000","last_unstale":"2024-09-12T19:29:42.398970+0000","last_undegraded":"2024-09-12T19:29:42.398970+0000","last_fullsized":"2024-09-12T19:29:42.398970+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:28.254769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526421,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":468,"num_read_kb":13877,"num_write":1131,"num_write_kb":46739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:45.674374+0000","last_change":"2024-09-12T17:36:38.882816+0000","last_active":"2024-09-12T19:25:45.674374+0000","last_peered":"2024-09-12T19:25:45.674374+0000","last_clean":"2024-09-12T19:25:45.674374+0000","last_became_active":"2024-09-12T17:36:38.882018+0000","last_became_peered":"2024-09-12T17:36:38.882018+0000","last_unstale":"2024-09-12T19:25:45.674374+0000","last_undegraded":"2024-09-12T19:25:45.674374+0000","last_fullsized":"2024-09-12T19:25:45.674374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:50.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'327","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.181289+0000","last_change":"2024-09-12T17:36:40.909328+0000","last_active":"2024-09-12T19:29:41.181289+0000","last_peered":"2024-09-12T19:29:41.181289+0000","last_clean":"2024-09-12T19:29:41.181289+0000","last_became_active":"2024-09-12T17:36:40.908611+0000","last_became_peered":"2024-09-12T17:36:40.908611+0000","last_unstale":"2024-09-12T19:29:41.181289+0000","last_undegraded":"2024-09-12T19:29:41.181289+0000","last_fullsized":"2024-09-12T19:29:41.181289+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:15.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53448,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":560,"num_read_kb":1204,"num_write":440,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.687795+0000","last_change":"2024-09-12T17:36:42.936919+0000","last_active":"2024-09-12T19:26:45.687795+0000","last_peered":"2024-09-12T19:26:45.687795+0000","last_clean":"2024-09-12T19:26:45.687795+0000","last_became_active":"2024-09-12T17:36:42.933510+0000","last_became_peered":"2024-09-12T17:36:42.933510+0000","last_unstale":"2024-09-12T19:26:45.687795+0000","last_undegraded":"2024-09-12T19:26:45.687795+0000","last_fullsized":"2024-09-12T19:26:45.687795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:11.996658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'126","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.020550+0000","last_change":"2024-09-12T17:36:44.961303+0000","last_active":"2024-09-12T19:29:21.020550+0000","last_peered":"2024-09-12T19:29:21.020550+0000","last_clean":"2024-09-12T19:29:21.020550+0000","last_became_active":"2024-09-12T17:36:44.960641+0000","last_became_peered":"2024-09-12T17:36:44.960641+0000","last_unstale":"2024-09-12T19:29:21.020550+0000","last_undegraded":"2024-09-12T19:29:21.020550+0000","last_fullsized":"2024-09-12T19:29:21.020550+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:20.007631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":181,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'930","reported_seq":2728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.366097+0000","last_change":"2024-09-12T17:36:36.901682+0000","last_active":"2024-09-12T19:28:00.366097+0000","last_peered":"2024-09-12T19:28:00.366097+0000","last_clean":"2024-09-12T19:28:00.366097+0000","last_became_active":"2024-09-12T17:36:36.901046+0000","last_became_peered":"2024-09-12T17:36:36.901046+0000","last_unstale":"2024-09-12T19:28:00.366097+0000","last_undegraded":"2024-09-12T19:28:00.366097+0000","last_fullsized":"2024-09-12T19:28:00.366097+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:29.856231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4712,"num_read_kb":4247,"num_write":1250,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'411","reported_seq":1123,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.365415+0000","last_change":"2024-09-12T17:36:34.884343+0000","last_active":"2024-09-12T19:29:42.365415+0000","last_peered":"2024-09-12T19:29:42.365415+0000","last_clean":"2024-09-12T19:29:42.365415+0000","last_became_active":"2024-09-12T17:36:34.884112+0000","last_became_peered":"2024-09-12T17:36:34.884112+0000","last_unstale":"2024-09-12T19:29:42.365415+0000","last_undegraded":"2024-09-12T19:29:42.365415+0000","last_fullsized":"2024-09-12T19:29:42.365415+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:05.952592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":11450,"num_write":1282,"num_write_kb":27380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'653","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675264+0000","last_change":"2024-09-12T17:36:36.917185+0000","last_active":"2024-09-12T19:27:10.675264+0000","last_peered":"2024-09-12T19:27:10.675264+0000","last_clean":"2024-09-12T19:27:10.675264+0000","last_became_active":"2024-09-12T17:36:36.916477+0000","last_became_peered":"2024-09-12T17:36:36.916477+0000","last_unstale":"2024-09-12T19:27:10.675264+0000","last_undegraded":"2024-09-12T19:27:10.675264+0000","last_fullsized":"2024-09-12T19:27:10.675264+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.646760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3261,"num_read_kb":2946,"num_write":856,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'366","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.383715+0000","last_change":"2024-09-12T17:36:34.862778+0000","last_active":"2024-09-12T19:29:42.383715+0000","last_peered":"2024-09-12T19:29:42.383715+0000","last_clean":"2024-09-12T19:29:42.383715+0000","last_became_active":"2024-09-12T17:36:34.862008+0000","last_became_peered":"2024-09-12T17:36:34.862008+0000","last_unstale":"2024-09-12T19:29:42.383715+0000","last_undegraded":"2024-09-12T19:29:42.383715+0000","last_fullsized":"2024-09-12T19:29:42.383715+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:34.713584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648670,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":45708,"num_write":1154,"num_write_kb":41141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'442","reported_seq":2006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366473+0000","last_change":"2024-09-12T17:36:36.876715+0000","last_active":"2024-09-12T19:27:10.366473+0000","last_peered":"2024-09-12T19:27:10.366473+0000","last_clean":"2024-09-12T19:27:10.366473+0000","last_became_active":"2024-09-12T17:36:36.875947+0000","last_became_peered":"2024-09-12T17:36:36.875947+0000","last_unstale":"2024-09-12T19:27:10.366473+0000","last_undegraded":"2024-09-12T19:27:10.366473+0000","last_fullsized":"2024-09-12T19:27:10.366473+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:53.224464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2143,"num_write":507,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'343","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.385382+0000","last_change":"2024-09-12T17:36:34.892965+0000","last_active":"2024-09-12T19:29:42.385382+0000","last_peered":"2024-09-12T19:29:42.385382+0000","last_clean":"2024-09-12T19:29:42.385382+0000","last_became_active":"2024-09-12T17:36:34.892664+0000","last_became_peered":"2024-09-12T17:36:34.892664+0000","last_unstale":"2024-09-12T19:29:42.385382+0000","last_undegraded":"2024-09-12T19:29:42.385382+0000","last_fullsized":"2024-09-12T19:29:42.385382+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:17.794367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4719915,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":523,"num_read_kb":15114,"num_write":1089,"num_write_kb":33687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'449","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.620587+0000","last_change":"2024-09-12T17:36:36.887427+0000","last_active":"2024-09-12T19:28:02.620587+0000","last_peered":"2024-09-12T19:28:02.620587+0000","last_clean":"2024-09-12T19:28:02.620587+0000","last_became_active":"2024-09-12T17:36:36.886646+0000","last_became_peered":"2024-09-12T17:36:36.886646+0000","last_unstale":"2024-09-12T19:28:02.620587+0000","last_undegraded":"2024-09-12T19:28:02.620587+0000","last_fullsized":"2024-09-12T19:28:02.620587+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:16.527812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2431,"num_read_kb":2290,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'319","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.370021+0000","last_change":"2024-09-12T17:36:34.878872+0000","last_active":"2024-09-12T19:29:42.370021+0000","last_peered":"2024-09-12T19:29:42.370021+0000","last_clean":"2024-09-12T19:29:42.370021+0000","last_became_active":"2024-09-12T17:36:34.875514+0000","last_became_peered":"2024-09-12T17:36:34.875514+0000","last_unstale":"2024-09-12T19:29:42.370021+0000","last_undegraded":"2024-09-12T19:29:42.370021+0000","last_fullsized":"2024-09-12T19:29:42.370021+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:00.883687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515054,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":12724,"num_write":938,"num_write_kb":21079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'472","reported_seq":2079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:35.268283+0000","last_change":"2024-09-12T17:36:36.896549+0000","last_active":"2024-09-12T19:27:35.268283+0000","last_peered":"2024-09-12T19:27:35.268283+0000","last_clean":"2024-09-12T19:27:35.268283+0000","last_became_active":"2024-09-12T17:36:36.895580+0000","last_became_peered":"2024-09-12T17:36:36.895580+0000","last_unstale":"2024-09-12T19:27:35.268283+0000","last_undegraded":"2024-09-12T19:27:35.268283+0000","last_fullsized":"2024-09-12T19:27:35.268283+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:38.232699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2410,"num_read_kb":2268,"num_write":522,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'377","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.360313+0000","last_change":"2024-09-12T17:36:34.876065+0000","last_active":"2024-09-12T19:29:42.360313+0000","last_peered":"2024-09-12T19:29:42.360313+0000","last_clean":"2024-09-12T19:29:42.360313+0000","last_became_active":"2024-09-12T17:36:34.875282+0000","last_became_peered":"2024-09-12T17:36:34.875282+0000","last_unstale":"2024-09-12T19:29:42.360313+0000","last_undegraded":"2024-09-12T19:29:42.360313+0000","last_fullsized":"2024-09-12T19:29:42.360313+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:40.356381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568489,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":16784,"num_write":1071,"num_write_kb":43648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'867","reported_seq":2674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.119778+0000","last_change":"2024-09-12T17:36:36.880245+0000","last_active":"2024-09-12T19:28:32.119778+0000","last_peered":"2024-09-12T19:28:32.119778+0000","last_clean":"2024-09-12T19:28:32.119778+0000","last_became_active":"2024-09-12T17:36:36.879875+0000","last_became_peered":"2024-09-12T17:36:36.879875+0000","last_unstale":"2024-09-12T19:28:32.119778+0000","last_undegraded":"2024-09-12T19:28:32.119778+0000","last_fullsized":"2024-09-12T19:28:32.119778+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:34.212835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4378,"num_read_kb":3985,"num_write":1124,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'315","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.322371+0000","last_change":"2024-09-12T17:36:34.882320+0000","last_active":"2024-09-12T19:29:42.322371+0000","last_peered":"2024-09-12T19:29:42.322371+0000","last_clean":"2024-09-12T19:29:42.322371+0000","last_became_active":"2024-09-12T17:36:34.880893+0000","last_became_peered":"2024-09-12T17:36:34.880893+0000","last_unstale":"2024-09-12T19:29:42.322371+0000","last_undegraded":"2024-09-12T19:29:42.322371+0000","last_fullsized":"2024-09-12T19:29:42.322371+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:46.683258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":34772,"num_write":1049,"num_write_kb":43573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'1177","reported_seq":2763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:04.050596+0000","last_change":"2024-09-12T17:36:36.898718+0000","last_active":"2024-09-12T19:27:04.050596+0000","last_peered":"2024-09-12T19:27:04.050596+0000","last_clean":"2024-09-12T19:27:04.050596+0000","last_became_active":"2024-09-12T17:36:36.897985+0000","last_became_peered":"2024-09-12T17:36:36.897985+0000","last_unstale":"2024-09-12T19:27:04.050596+0000","last_undegraded":"2024-09-12T19:27:04.050596+0000","last_fullsized":"2024-09-12T19:27:04.050596+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:33.241292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5405,"num_read_kb":4772,"num_write":1628,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'393","reported_seq":1082,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.403972+0000","last_change":"2024-09-12T17:36:34.877091+0000","last_active":"2024-09-12T19:29:42.403972+0000","last_peered":"2024-09-12T19:29:42.403972+0000","last_clean":"2024-09-12T19:29:42.403972+0000","last_became_active":"2024-09-12T17:36:34.876834+0000","last_became_peered":"2024-09-12T17:36:34.876834+0000","last_unstale":"2024-09-12T19:29:42.403972+0000","last_undegraded":"2024-09-12T19:29:42.403972+0000","last_fullsized":"2024-09-12T19:29:42.403972+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:36.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":595,"num_read_kb":4635,"num_write":1236,"num_write_kb":22932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'773","reported_seq":2362,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.058729+0000","last_change":"2024-09-12T17:36:36.901626+0000","last_active":"2024-09-12T19:29:21.058729+0000","last_peered":"2024-09-12T19:29:21.058729+0000","last_clean":"2024-09-12T19:29:21.058729+0000","last_became_active":"2024-09-12T17:36:36.901293+0000","last_became_peered":"2024-09-12T17:36:36.901293+0000","last_unstale":"2024-09-12T19:29:21.058729+0000","last_undegraded":"2024-09-12T19:29:21.058729+0000","last_fullsized":"2024-09-12T19:29:21.058729+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:48.170779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3323,"num_write":979,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'340","reported_seq":1081,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.403260+0000","last_change":"2024-09-12T17:36:34.875326+0000","last_active":"2024-09-12T19:29:42.403260+0000","last_peered":"2024-09-12T19:29:42.403260+0000","last_clean":"2024-09-12T19:29:42.403260+0000","last_became_active":"2024-09-12T17:36:34.872999+0000","last_became_peered":"2024-09-12T17:36:34.872999+0000","last_unstale":"2024-09-12T19:29:42.403260+0000","last_undegraded":"2024-09-12T19:29:42.403260+0000","last_fullsized":"2024-09-12T19:29:42.403260+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:47.461128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":667,"num_read_kb":7832,"num_write":1127,"num_write_kb":31819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'779","reported_seq":2247,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.049150+0000","last_change":"2024-09-12T17:36:36.904735+0000","last_active":"2024-09-12T19:29:21.049150+0000","last_peered":"2024-09-12T19:29:21.049150+0000","last_clean":"2024-09-12T19:29:21.049150+0000","last_became_active":"2024-09-12T17:36:36.903948+0000","last_became_peered":"2024-09-12T17:36:36.903948+0000","last_unstale":"2024-09-12T19:29:21.049150+0000","last_undegraded":"2024-09-12T19:29:21.049150+0000","last_fullsized":"2024-09-12T19:29:21.049150+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:06.384871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3650,"num_read_kb":3275,"num_write":1024,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'406","reported_seq":1166,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.403248+0000","last_change":"2024-09-12T17:36:34.891921+0000","last_active":"2024-09-12T19:29:42.403248+0000","last_peered":"2024-09-12T19:29:42.403248+0000","last_clean":"2024-09-12T19:29:42.403248+0000","last_became_active":"2024-09-12T17:36:34.891638+0000","last_became_peered":"2024-09-12T17:36:34.891638+0000","last_unstale":"2024-09-12T19:29:42.403248+0000","last_undegraded":"2024-09-12T19:29:42.403248+0000","last_fullsized":"2024-09-12T19:29:42.403248+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:27.837483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":824,"num_read_kb":23553,"num_write":1317,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'1230","reported_seq":2980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.593064+0000","last_change":"2024-09-12T17:36:36.906715+0000","last_active":"2024-09-12T19:26:20.593064+0000","last_peered":"2024-09-12T19:26:20.593064+0000","last_clean":"2024-09-12T19:26:20.593064+0000","last_became_active":"2024-09-12T17:36:36.906463+0000","last_became_peered":"2024-09-12T17:36:36.906463+0000","last_unstale":"2024-09-12T19:26:20.593064+0000","last_undegraded":"2024-09-12T19:26:20.593064+0000","last_fullsized":"2024-09-12T19:26:20.593064+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:50.870597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5684,"num_read_kb":5045,"num_write":1688,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'337","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.399143+0000","last_change":"2024-09-12T17:36:34.874816+0000","last_active":"2024-09-12T19:29:42.399143+0000","last_peered":"2024-09-12T19:29:42.399143+0000","last_clean":"2024-09-12T19:29:42.399143+0000","last_became_active":"2024-09-12T17:36:34.873189+0000","last_became_peered":"2024-09-12T17:36:34.873189+0000","last_unstale":"2024-09-12T19:29:42.399143+0000","last_undegraded":"2024-09-12T19:29:42.399143+0000","last_fullsized":"2024-09-12T19:29:42.399143+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:16.748289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284213,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":39048,"num_write":958,"num_write_kb":38605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'997","reported_seq":2702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.116025+0000","last_change":"2024-09-12T17:36:36.876501+0000","last_active":"2024-09-12T19:28:32.116025+0000","last_peered":"2024-09-12T19:28:32.116025+0000","last_clean":"2024-09-12T19:28:32.116025+0000","last_became_active":"2024-09-12T17:36:36.875791+0000","last_became_peered":"2024-09-12T17:36:36.875791+0000","last_unstale":"2024-09-12T19:28:32.116025+0000","last_undegraded":"2024-09-12T19:28:32.116025+0000","last_fullsized":"2024-09-12T19:28:32.116025+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:20.751412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4962,"num_read_kb":4419,"num_write":1465,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'251","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.331792+0000","last_change":"2024-09-12T17:36:34.867040+0000","last_active":"2024-09-12T19:29:42.331792+0000","last_peered":"2024-09-12T19:29:42.331792+0000","last_clean":"2024-09-12T19:29:42.331792+0000","last_became_active":"2024-09-12T17:36:34.866719+0000","last_became_peered":"2024-09-12T17:36:34.866719+0000","last_unstale":"2024-09-12T19:29:42.331792+0000","last_undegraded":"2024-09-12T19:29:42.331792+0000","last_fullsized":"2024-09-12T19:29:42.331792+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:38.881915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":13747,"num_write":787,"num_write_kb":14866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'511","reported_seq":2129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.091439+0000","last_change":"2024-09-12T17:36:36.914630+0000","last_active":"2024-09-12T19:26:55.091439+0000","last_peered":"2024-09-12T19:26:55.091439+0000","last_clean":"2024-09-12T19:26:55.091439+0000","last_became_active":"2024-09-12T17:36:36.914327+0000","last_became_peered":"2024-09-12T17:36:36.914327+0000","last_unstale":"2024-09-12T19:26:55.091439+0000","last_undegraded":"2024-09-12T19:26:55.091439+0000","last_fullsized":"2024-09-12T19:26:55.091439+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:59.445859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2629,"num_read_kb":2439,"num_write":603,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'300","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.357841+0000","last_change":"2024-09-12T17:36:34.865386+0000","last_active":"2024-09-12T19:29:42.357841+0000","last_peered":"2024-09-12T19:29:42.357841+0000","last_clean":"2024-09-12T19:29:42.357841+0000","last_became_active":"2024-09-12T17:36:34.864682+0000","last_became_peered":"2024-09-12T17:36:34.864682+0000","last_unstale":"2024-09-12T19:29:42.357841+0000","last_undegraded":"2024-09-12T19:29:42.357841+0000","last_fullsized":"2024-09-12T19:29:42.357841+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:44.124063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":386,"num_read_kb":10447,"num_write":906,"num_write_kb":22906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'843","reported_seq":2465,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.325029+0000","last_change":"2024-09-12T17:36:36.886698+0000","last_active":"2024-09-12T19:26:59.325029+0000","last_peered":"2024-09-12T19:26:59.325029+0000","last_clean":"2024-09-12T19:26:59.325029+0000","last_became_active":"2024-09-12T17:36:36.885956+0000","last_became_peered":"2024-09-12T17:36:36.885956+0000","last_unstale":"2024-09-12T19:26:59.325029+0000","last_undegraded":"2024-09-12T19:26:59.325029+0000","last_fullsized":"2024-09-12T19:26:59.325029+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:14.336258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3814,"num_read_kb":3459,"num_write":1078,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'368","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.400418+0000","last_change":"2024-09-12T17:36:34.867183+0000","last_active":"2024-09-12T19:29:42.400418+0000","last_peered":"2024-09-12T19:29:42.400418+0000","last_clean":"2024-09-12T19:29:42.400418+0000","last_became_active":"2024-09-12T17:36:34.865344+0000","last_became_peered":"2024-09-12T17:36:34.865344+0000","last_unstale":"2024-09-12T19:29:42.400418+0000","last_undegraded":"2024-09-12T19:29:42.400418+0000","last_fullsized":"2024-09-12T19:29:42.400418+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:57.377914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":55805,"num_write":1199,"num_write_kb":26331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'722","reported_seq":2134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671563+0000","last_change":"2024-09-12T17:36:36.916852+0000","last_active":"2024-09-12T19:26:55.671563+0000","last_peered":"2024-09-12T19:26:55.671563+0000","last_clean":"2024-09-12T19:26:55.671563+0000","last_became_active":"2024-09-12T17:36:36.916289+0000","last_became_peered":"2024-09-12T17:36:36.916289+0000","last_unstale":"2024-09-12T19:26:55.671563+0000","last_undegraded":"2024-09-12T19:26:55.671563+0000","last_fullsized":"2024-09-12T19:26:55.671563+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:24.873023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3361,"num_read_kb":3032,"num_write":954,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'374","reported_seq":1260,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.394721+0000","last_change":"2024-09-12T17:36:34.876882+0000","last_active":"2024-09-12T19:29:42.394721+0000","last_peered":"2024-09-12T19:29:42.394721+0000","last_clean":"2024-09-12T19:29:42.394721+0000","last_became_active":"2024-09-12T17:36:34.875748+0000","last_became_peered":"2024-09-12T17:36:34.875748+0000","last_unstale":"2024-09-12T19:29:42.394721+0000","last_undegraded":"2024-09-12T19:29:42.394721+0000","last_fullsized":"2024-09-12T19:29:42.394721+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:38.898125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311597,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":946,"num_read_kb":75770,"num_write":1026,"num_write_kb":38932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'575","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.115291+0000","last_change":"2024-09-12T17:36:36.904688+0000","last_active":"2024-09-12T19:28:32.115291+0000","last_peered":"2024-09-12T19:28:32.115291+0000","last_clean":"2024-09-12T19:28:32.115291+0000","last_became_active":"2024-09-12T17:36:36.902941+0000","last_became_peered":"2024-09-12T17:36:36.902941+0000","last_unstale":"2024-09-12T19:28:32.115291+0000","last_undegraded":"2024-09-12T19:28:32.115291+0000","last_fullsized":"2024-09-12T19:28:32.115291+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:02.556913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2851,"num_read_kb":2607,"num_write":694,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'372","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.317184+0000","last_change":"2024-09-12T17:36:34.873753+0000","last_active":"2024-09-12T19:29:42.317184+0000","last_peered":"2024-09-12T19:29:42.317184+0000","last_clean":"2024-09-12T19:29:42.317184+0000","last_became_active":"2024-09-12T17:36:34.868083+0000","last_became_peered":"2024-09-12T17:36:34.868083+0000","last_unstale":"2024-09-12T19:29:42.317184+0000","last_undegraded":"2024-09-12T19:29:42.317184+0000","last_fullsized":"2024-09-12T19:29:42.317184+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:12.169519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526437,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":549,"num_read_kb":53048,"num_write":1215,"num_write_kb":26068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'576","reported_seq":2515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:53.296831+0000","last_change":"2024-09-12T17:36:36.891765+0000","last_active":"2024-09-12T19:26:53.296831+0000","last_peered":"2024-09-12T19:26:53.296831+0000","last_clean":"2024-09-12T19:26:53.296831+0000","last_became_active":"2024-09-12T17:36:36.891412+0000","last_became_peered":"2024-09-12T17:36:36.891412+0000","last_unstale":"2024-09-12T19:26:53.296831+0000","last_undegraded":"2024-09-12T19:26:53.296831+0000","last_fullsized":"2024-09-12T19:26:53.296831+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:43.215780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3296,"num_read_kb":3095,"num_write":679,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'397","reported_seq":1082,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.386832+0000","last_change":"2024-09-12T17:36:34.872524+0000","last_active":"2024-09-12T19:29:42.386832+0000","last_peered":"2024-09-12T19:29:42.386832+0000","last_clean":"2024-09-12T19:29:42.386832+0000","last_became_active":"2024-09-12T17:36:34.872242+0000","last_became_peered":"2024-09-12T17:36:34.872242+0000","last_unstale":"2024-09-12T19:29:42.386832+0000","last_undegraded":"2024-09-12T19:29:42.386832+0000","last_fullsized":"2024-09-12T19:29:42.386832+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:13.591648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2448269,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":538,"num_read_kb":8811,"num_write":1195,"num_write_kb":19313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'372","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.394105+0000","last_change":"2024-09-12T17:36:34.862643+0000","last_active":"2024-09-12T19:29:42.394105+0000","last_peered":"2024-09-12T19:29:42.394105+0000","last_clean":"2024-09-12T19:29:42.394105+0000","last_became_active":"2024-09-12T17:36:34.861821+0000","last_became_peered":"2024-09-12T17:36:34.861821+0000","last_unstale":"2024-09-12T19:29:42.394105+0000","last_undegraded":"2024-09-12T19:29:42.394105+0000","last_fullsized":"2024-09-12T19:29:42.394105+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.821144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":100665,"num_write":1084,"num_write_kb":41422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'568","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.624055+0000","last_change":"2024-09-12T17:36:36.912672+0000","last_active":"2024-09-12T19:28:02.624055+0000","last_peered":"2024-09-12T19:28:02.624055+0000","last_clean":"2024-09-12T19:28:02.624055+0000","last_became_active":"2024-09-12T17:36:36.911855+0000","last_became_peered":"2024-09-12T17:36:36.911855+0000","last_unstale":"2024-09-12T19:28:02.624055+0000","last_undegraded":"2024-09-12T19:28:02.624055+0000","last_fullsized":"2024-09-12T19:28:02.624055+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:51.023621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2849,"num_read_kb":2620,"num_write":728,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'337","reported_seq":1003,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.399010+0000","last_change":"2024-09-12T17:36:34.881995+0000","last_active":"2024-09-12T19:29:42.399010+0000","last_peered":"2024-09-12T19:29:42.399010+0000","last_clean":"2024-09-12T19:29:42.399010+0000","last_became_active":"2024-09-12T17:36:34.881262+0000","last_became_peered":"2024-09-12T17:36:34.881262+0000","last_unstale":"2024-09-12T19:29:42.399010+0000","last_undegraded":"2024-09-12T19:29:42.399010+0000","last_fullsized":"2024-09-12T19:29:42.399010+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:33.823459+0000","last_clean_scrub_stamp":"2024-09-12T17:36:33.823459+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:56.865811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":969137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":479,"num_read_kb":5153,"num_write":1034,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'505","reported_seq":2109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:49.753418+0000","last_change":"2024-09-12T17:36:36.902225+0000","last_active":"2024-09-12T19:25:49.753418+0000","last_peered":"2024-09-12T19:25:49.753418+0000","last_clean":"2024-09-12T19:25:49.753418+0000","last_became_active":"2024-09-12T17:36:36.901857+0000","last_became_peered":"2024-09-12T17:36:36.901857+0000","last_unstale":"2024-09-12T19:25:49.753418+0000","last_undegraded":"2024-09-12T19:25:49.753418+0000","last_fullsized":"2024-09-12T19:25:49.753418+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:17.433881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2642,"num_read_kb":2459,"num_write":621,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5957,"num_read_kb":4161,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16299,"num_read_kb":15966,"num_write":16741,"num_write_kb":4895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1571,"ondisk_log_size":1571,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":754,"ondisk_log_size":754,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1604320,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":20976,"num_read_kb":40444,"num_write":17515,"num_write_kb":12474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1801,"ondisk_log_size":1801,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194467,"num_write":55293,"num_write_kb":18855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3723,"ondisk_log_size":3723,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":67082726,"num_objects":379,"num_object_clones":0,"num_object_copies":758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":36361,"num_read_kb":1891027,"num_write":71889,"num_write_kb":2051812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135487488,"data_stored":134165452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3726,"ondisk_log_size":3726,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":193786,"num_write":186,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":184511,"num_write":186,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510809,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217740,"kb_used_data":9972,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94154100,"statfs":{"total":96636764160,"available":96413798400,"internally_reserved":0,"allocated":10211328,"data_stored":8566552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510806,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254576,"kb_used_data":24816,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94117264,"statfs":{"total":96636764160,"available":96376078336,"internally_reserved":0,"allocated":25411584,"data_stored":23641054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510810,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191160,"kb_used_data":15608,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94180680,"statfs":{"total":96636764160,"available":96441016320,"internally_reserved":0,"allocated":15982592,"data_stored":14328646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510806,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":223184,"kb_used_data":29280,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94148656,"statfs":{"total":96636764160,"available":96408223744,"internally_reserved":0,"allocated":29982720,"data_stored":28233002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510809,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127852,"kb_used_data":24336,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94243988,"statfs":{"total":96636764160,"available":96505843712,"internally_reserved":0,"allocated":24920064,"data_stored":23230965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510806,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276472,"kb_used_data":10524,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94095368,"statfs":{"total":96636764160,"available":96353656832,"internally_reserved":0,"allocated":10776576,"data_stored":9102273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510807,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102180,"kb_used_data":20940,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94269660,"statfs":{"total":96636764160,"available":96532131840,"internally_reserved":0,"allocated":21442560,"data_stored":19672532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543512,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116012,"kb_used_data":26588,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94255828,"statfs":{"total":96636764160,"available":96517967872,"internally_reserved":0,"allocated":27226112,"data_stored":25491082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17780736,"data_stored":17557812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6524928,"data_stored":6398837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21286912,"data_stored":21117656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26320896,"data_stored":26118766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12324864,"data_stored":12211453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21143552,"data_stored":20934570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23552000,"data_stored":23375118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6553600,"data_stored":6451240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:29:49.899 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.899 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.899 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.899 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.900 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.900 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.900 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.900 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.900 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.900 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.900 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.901 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.901 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.901 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.901 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.901 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.901 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.901 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.901 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.901 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.902 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.902 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.902 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.902 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.902 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.902 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.902 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.902 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.902 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.903 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.903 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.903 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.903 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.903 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.903 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.903 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.903 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.903 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.904 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.904 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.904 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.904 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.904 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.904 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.904 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.905 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.905 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.905 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.905 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.905 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.905 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.905 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.906 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.906 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.906 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.906 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.906 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.906 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.906 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.907 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.907 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.907 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.907 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.907 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.907 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.907 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.907 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.908 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.908 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.908 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.908 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.908 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.908 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.908 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.908 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.909 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.909 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.909 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.909 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.909 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.910 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.910 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.910 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.910 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.910 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.910 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.910 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.910 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.910 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.911 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.911 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.911 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.911 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.911 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.911 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.911 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.911 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.911 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.912 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.912 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.912 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.912 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.912 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.912 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.912 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.913 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.913 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.913 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.913 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.913 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.913 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.913 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.913 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.914 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.914 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.914 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.914 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.914 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.914 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.914 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.914 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.915 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.915 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.915 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.915 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.915 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.915 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.915 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.916 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.916 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.916 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.916 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.916 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.916 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.916 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.917 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.917 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.917 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.917 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.917 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.917 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.917 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.917 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.918 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.918 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.918 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.918 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.918 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.918 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.918 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.918 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.919 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.919 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.919 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.919 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.919 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.919 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.919 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.920 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.920 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.920 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.920 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.920 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.920 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.920 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.920 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.920 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.921 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.921 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.921 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.921 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.921 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.921 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.921 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.921 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.922 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.922 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.922 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.922 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.922 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.923 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.923 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.923 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.923 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.923 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.924 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.924 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.924 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.924 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.924 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.924 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.924 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.924 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.924 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.925 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.925 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.925 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.925 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.926 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.926 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.927 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.927 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.927 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.927 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.927 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.927 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.927 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.927 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.928 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.928 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.928 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.928 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.928 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.928 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.928 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.929 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.929 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.929 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.929 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.929 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.929 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.929 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.929 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.930 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.930 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.930 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.930 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.930 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.930 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.930 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:36:15.696738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.931 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:36:20.758971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.931 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.931 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.931 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.931 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.931 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.931 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.931 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:36:20.758971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.932 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.932 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.932 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.932 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.932 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.932 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.933 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:36:20.758971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.933 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.933 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.933 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.933 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.933 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.934 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.934 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:36:20.758971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.934 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.934 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.934 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.934 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.934 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.934 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.934 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.935 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T17:36:20.758971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.935 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.935 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.935 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.935 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.935 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.935 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.935 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:36:20.758971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.936 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.936 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.936 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.936 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.936 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.936 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.937 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T17:36:20.758971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.937 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.937 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.937 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.937 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.937 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.938 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.938 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:36:20.758971+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.938 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.938 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.938 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.939 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.939 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.939 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.939 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.939 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.940 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.940 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.940 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.941 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.941 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.941 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.941 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.941 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.941 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.942 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.942 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.942 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.942 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.942 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.943 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.943 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.943 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.943 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.943 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.944 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.944 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.944 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.944 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.944 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.945 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.945 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.945 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.945 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.945 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.946 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.946 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.946 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.946 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.946 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.947 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.947 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.947 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.947 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.947 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.947 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.948 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.948 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.948 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.948 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.949 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.949 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.949 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.949 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.949 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.950 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.950 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.950 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.950 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.950 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.950 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.951 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.951 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.951 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.951 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.951 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.951 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.952 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.952 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.952 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.952 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.952 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.952 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.952 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.952 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.953 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.953 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.953 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.953 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.953 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.953 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.953 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.953 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.953 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.954 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.954 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.954 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.954 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.954 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.954 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.954 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.954 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.954 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.955 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.955 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.955 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.955 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.955 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.955 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.955 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.956 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.956 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.956 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.956 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.956 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.956 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.956 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.956 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.956 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:36:33.823459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.957 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:29:49.957 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:30:09.958 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:30:10.327 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:30:10.344 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-12T19:30:10.363 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":3674,"stamp":"2024-09-12T19:30:09.230981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69294871,"num_objects":850,"num_object_clones":0,"num_object_copies":1700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":850,"num_whiteouts":0,"num_read":295267,"num_read_kb":2527306,"num_write":163888,"num_write_kb":2342783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":204,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":543516,"num_omap_keys":1296,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13361,"ondisk_log_size":13361,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1512208,"kb_used_data":162064,"kb_used_omap":12,"kb_used_meta":1350003,"kb_avail":753462512,"statfs":{"total":773094113280,"available":771545612288,"internally_reserved":0,"allocated":165953536,"data_stored":152266106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1382403632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537243,"num_omap_keys":1271,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009398"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.587902+0000","last_change":"2024-09-12T18:25:52.622405+0000","last_active":"2024-09-12T19:25:55.587902+0000","last_peered":"2024-09-12T19:25:55.587902+0000","last_clean":"2024-09-12T19:25:55.587902+0000","last_became_active":"2024-09-12T18:25:52.621735+0000","last_became_peered":"2024-09-12T18:25:52.621735+0000","last_unstale":"2024-09-12T19:25:55.587902+0000","last_undegraded":"2024-09-12T19:25:55.587902+0000","last_fullsized":"2024-09-12T19:25:55.587902+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:09.919704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.083326+0000","last_change":"2024-09-12T17:58:47.223973+0000","last_active":"2024-09-12T19:26:20.083326+0000","last_peered":"2024-09-12T19:26:20.083326+0000","last_clean":"2024-09-12T19:26:20.083326+0000","last_became_active":"2024-09-12T17:58:47.223202+0000","last_became_peered":"2024-09-12T17:58:47.223202+0000","last_unstale":"2024-09-12T19:26:20.083326+0000","last_undegraded":"2024-09-12T19:26:20.083326+0000","last_fullsized":"2024-09-12T19:26:20.083326+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:23.110262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'5","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.964477+0000","last_change":"2024-09-12T17:58:40.207149+0000","last_active":"2024-09-12T19:29:41.964477+0000","last_peered":"2024-09-12T19:29:41.964477+0000","last_clean":"2024-09-12T19:29:41.964477+0000","last_became_active":"2024-09-12T17:58:40.206469+0000","last_became_peered":"2024-09-12T17:58:40.206469+0000","last_unstale":"2024-09-12T19:29:41.964477+0000","last_undegraded":"2024-09-12T19:29:41.964477+0000","last_fullsized":"2024-09-12T19:29:41.964477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:10.914751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'13","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.683354+0000","last_change":"2024-09-12T17:52:39.873196+0000","last_active":"2024-09-12T19:26:25.683354+0000","last_peered":"2024-09-12T19:26:25.683354+0000","last_clean":"2024-09-12T19:26:25.683354+0000","last_became_active":"2024-09-12T17:52:39.872356+0000","last_became_peered":"2024-09-12T17:52:39.872356+0000","last_unstale":"2024-09-12T19:26:25.683354+0000","last_undegraded":"2024-09-12T19:26:25.683354+0000","last_fullsized":"2024-09-12T19:26:25.683354+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:36.475086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.035593+0000","last_change":"2024-09-12T18:25:52.625279+0000","last_active":"2024-09-12T19:25:54.035593+0000","last_peered":"2024-09-12T19:25:54.035593+0000","last_clean":"2024-09-12T19:25:54.035593+0000","last_became_active":"2024-09-12T18:25:52.624565+0000","last_became_peered":"2024-09-12T18:25:52.624565+0000","last_unstale":"2024-09-12T19:25:54.035593+0000","last_undegraded":"2024-09-12T19:25:54.035593+0000","last_fullsized":"2024-09-12T19:25:54.035593+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:32.002014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'4","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241488+0000","last_change":"2024-09-12T17:58:47.249699+0000","last_active":"2024-09-12T19:26:20.241488+0000","last_peered":"2024-09-12T19:26:20.241488+0000","last_clean":"2024-09-12T19:26:20.241488+0000","last_became_active":"2024-09-12T17:58:47.249050+0000","last_became_peered":"2024-09-12T17:58:47.249050+0000","last_unstale":"2024-09-12T19:26:20.241488+0000","last_undegraded":"2024-09-12T19:26:20.241488+0000","last_fullsized":"2024-09-12T19:26:20.241488+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:09.406806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.284136+0000","last_change":"2024-09-12T17:58:40.210474+0000","last_active":"2024-09-12T19:28:40.284136+0000","last_peered":"2024-09-12T19:28:40.284136+0000","last_clean":"2024-09-12T19:28:40.284136+0000","last_became_active":"2024-09-12T17:58:40.209447+0000","last_became_peered":"2024-09-12T17:58:40.209447+0000","last_unstale":"2024-09-12T19:28:40.284136+0000","last_undegraded":"2024-09-12T19:28:40.284136+0000","last_fullsized":"2024-09-12T19:28:40.284136+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:51.043086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'14","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691311+0000","last_change":"2024-09-12T17:52:39.885082+0000","last_active":"2024-09-12T19:27:00.691311+0000","last_peered":"2024-09-12T19:27:00.691311+0000","last_clean":"2024-09-12T19:27:00.691311+0000","last_became_active":"2024-09-12T17:52:39.884327+0000","last_became_peered":"2024-09-12T17:52:39.884327+0000","last_unstale":"2024-09-12T19:27:00.691311+0000","last_undegraded":"2024-09-12T19:27:00.691311+0000","last_fullsized":"2024-09-12T19:27:00.691311+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:05.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.083157+0000","last_change":"2024-09-12T18:25:52.622449+0000","last_active":"2024-09-12T19:26:20.083157+0000","last_peered":"2024-09-12T19:26:20.083157+0000","last_clean":"2024-09-12T19:26:20.083157+0000","last_became_active":"2024-09-12T18:25:52.621796+0000","last_became_peered":"2024-09-12T18:25:52.621796+0000","last_unstale":"2024-09-12T19:26:20.083157+0000","last_undegraded":"2024-09-12T19:26:20.083157+0000","last_fullsized":"2024-09-12T19:26:20.083157+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:45.223769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'7","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.929370+0000","last_change":"2024-09-12T17:58:47.240760+0000","last_active":"2024-09-12T19:29:41.929370+0000","last_peered":"2024-09-12T19:29:41.929370+0000","last_clean":"2024-09-12T19:29:41.929370+0000","last_became_active":"2024-09-12T17:58:47.239390+0000","last_became_peered":"2024-09-12T17:58:47.239390+0000","last_unstale":"2024-09-12T19:29:41.929370+0000","last_undegraded":"2024-09-12T19:29:41.929370+0000","last_fullsized":"2024-09-12T19:29:41.929370+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:08.068553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'4","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.616496+0000","last_change":"2024-09-12T17:58:40.194349+0000","last_active":"2024-09-12T19:29:41.616496+0000","last_peered":"2024-09-12T19:29:41.616496+0000","last_clean":"2024-09-12T19:29:41.616496+0000","last_became_active":"2024-09-12T17:58:40.193462+0000","last_became_peered":"2024-09-12T17:58:40.193462+0000","last_unstale":"2024-09-12T19:29:41.616496+0000","last_undegraded":"2024-09-12T19:29:41.616496+0000","last_fullsized":"2024-09-12T19:29:41.616496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:14.830909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1083,"num_write":4,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'6","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:39.058829+0000","last_change":"2024-09-12T17:52:39.872689+0000","last_active":"2024-09-12T19:27:39.058829+0000","last_peered":"2024-09-12T19:27:39.058829+0000","last_clean":"2024-09-12T19:27:39.058829+0000","last_became_active":"2024-09-12T17:52:39.871998+0000","last_became_peered":"2024-09-12T17:52:39.871998+0000","last_unstale":"2024-09-12T19:27:39.058829+0000","last_undegraded":"2024-09-12T19:27:39.058829+0000","last_fullsized":"2024-09-12T19:27:39.058829+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255185+0000","last_change":"2024-09-12T18:25:52.613287+0000","last_active":"2024-09-12T19:26:40.255185+0000","last_peered":"2024-09-12T19:26:40.255185+0000","last_clean":"2024-09-12T19:26:40.255185+0000","last_became_active":"2024-09-12T18:25:52.612472+0000","last_became_peered":"2024-09-12T18:25:52.612472+0000","last_unstale":"2024-09-12T19:26:40.255185+0000","last_undegraded":"2024-09-12T19:26:40.255185+0000","last_fullsized":"2024-09-12T19:26:40.255185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:42.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"262'5","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263726+0000","last_change":"2024-09-12T17:58:47.248310+0000","last_active":"2024-09-12T19:27:15.263726+0000","last_peered":"2024-09-12T19:27:15.263726+0000","last_clean":"2024-09-12T19:27:15.263726+0000","last_became_active":"2024-09-12T17:58:47.247496+0000","last_became_peered":"2024-09-12T17:58:47.247496+0000","last_unstale":"2024-09-12T19:27:15.263726+0000","last_undegraded":"2024-09-12T19:27:15.263726+0000","last_fullsized":"2024-09-12T19:27:15.263726+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:24.161042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'12","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.109326+0000","last_change":"2024-09-12T17:58:40.214834+0000","last_active":"2024-09-12T19:28:15.109326+0000","last_peered":"2024-09-12T19:28:15.109326+0000","last_clean":"2024-09-12T19:28:15.109326+0000","last_became_active":"2024-09-12T17:58:40.207945+0000","last_became_peered":"2024-09-12T17:58:40.207945+0000","last_unstale":"2024-09-12T19:28:15.109326+0000","last_undegraded":"2024-09-12T19:28:15.109326+0000","last_fullsized":"2024-09-12T19:28:15.109326+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:52.444564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8196,"num_write":22,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'37","reported_seq":170,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:39.058777+0000","last_change":"2024-09-12T17:52:39.871937+0000","last_active":"2024-09-12T19:27:39.058777+0000","last_peered":"2024-09-12T19:27:39.058777+0000","last_clean":"2024-09-12T19:27:39.058777+0000","last_became_active":"2024-09-12T17:52:39.871148+0000","last_became_peered":"2024-09-12T17:52:39.871148+0000","last_unstale":"2024-09-12T19:27:39.058777+0000","last_undegraded":"2024-09-12T19:27:39.058777+0000","last_fullsized":"2024-09-12T19:27:39.058777+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":131,"num_write":69,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.686653+0000","last_change":"2024-09-12T18:25:52.605404+0000","last_active":"2024-09-12T19:28:00.686653+0000","last_peered":"2024-09-12T19:28:00.686653+0000","last_clean":"2024-09-12T19:28:00.686653+0000","last_became_active":"2024-09-12T18:25:52.604589+0000","last_became_peered":"2024-09-12T18:25:52.604589+0000","last_unstale":"2024-09-12T19:28:00.686653+0000","last_undegraded":"2024-09-12T19:28:00.686653+0000","last_fullsized":"2024-09-12T19:28:00.686653+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'8","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.618447+0000","last_change":"2024-09-12T17:58:47.243839+0000","last_active":"2024-09-12T19:29:41.618447+0000","last_peered":"2024-09-12T19:29:41.618447+0000","last_clean":"2024-09-12T19:29:41.618447+0000","last_became_active":"2024-09-12T17:58:47.242756+0000","last_became_peered":"2024-09-12T17:58:47.242756+0000","last_unstale":"2024-09-12T19:29:41.618447+0000","last_undegraded":"2024-09-12T19:29:41.618447+0000","last_fullsized":"2024-09-12T19:29:41.618447+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:13.909298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":7170,"num_write":8,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"262'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.241656+0000","last_change":"2024-09-12T17:58:40.211442+0000","last_active":"2024-09-12T19:25:40.241656+0000","last_peered":"2024-09-12T19:25:40.241656+0000","last_clean":"2024-09-12T19:25:40.241656+0000","last_became_active":"2024-09-12T17:58:40.202787+0000","last_became_peered":"2024-09-12T17:58:40.202787+0000","last_unstale":"2024-09-12T19:25:40.241656+0000","last_undegraded":"2024-09-12T19:25:40.241656+0000","last_fullsized":"2024-09-12T19:25:40.241656+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.258488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'30","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:39.058704+0000","last_change":"2024-09-12T17:52:39.889339+0000","last_active":"2024-09-12T19:27:39.058704+0000","last_peered":"2024-09-12T19:27:39.058704+0000","last_clean":"2024-09-12T19:27:39.058704+0000","last_became_active":"2024-09-12T17:52:39.888092+0000","last_became_peered":"2024-09-12T17:52:39.888092+0000","last_unstale":"2024-09-12T19:27:39.058704+0000","last_undegraded":"2024-09-12T19:27:39.058704+0000","last_fullsized":"2024-09-12T19:27:39.058704+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682167+0000","last_change":"2024-09-12T18:25:52.615541+0000","last_active":"2024-09-12T19:26:20.682167+0000","last_peered":"2024-09-12T19:26:20.682167+0000","last_clean":"2024-09-12T19:26:20.682167+0000","last_became_active":"2024-09-12T18:25:52.614862+0000","last_became_peered":"2024-09-12T18:25:52.614862+0000","last_unstale":"2024-09-12T19:26:20.682167+0000","last_undegraded":"2024-09-12T19:26:20.682167+0000","last_fullsized":"2024-09-12T19:26:20.682167+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:20.974947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.346428+0000","last_change":"2024-09-12T17:58:47.251966+0000","last_active":"2024-09-12T19:25:50.346428+0000","last_peered":"2024-09-12T19:25:50.346428+0000","last_clean":"2024-09-12T19:25:50.346428+0000","last_became_active":"2024-09-12T17:58:47.246322+0000","last_became_peered":"2024-09-12T17:58:47.246322+0000","last_unstale":"2024-09-12T19:25:50.346428+0000","last_undegraded":"2024-09-12T19:25:50.346428+0000","last_fullsized":"2024-09-12T19:25:50.346428+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:04.147241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'4","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:35.387017+0000","last_change":"2024-09-12T17:58:40.207847+0000","last_active":"2024-09-12T19:28:35.387017+0000","last_peered":"2024-09-12T19:28:35.387017+0000","last_clean":"2024-09-12T19:28:35.387017+0000","last_became_active":"2024-09-12T17:58:40.207064+0000","last_became_peered":"2024-09-12T17:58:40.207064+0000","last_unstale":"2024-09-12T19:28:35.387017+0000","last_undegraded":"2024-09-12T19:28:35.387017+0000","last_fullsized":"2024-09-12T19:28:35.387017+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:41.646154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:10.225969+0000","last_change":"2024-09-12T17:52:39.884527+0000","last_active":"2024-09-12T19:25:10.225969+0000","last_peered":"2024-09-12T19:25:10.225969+0000","last_clean":"2024-09-12T19:25:10.225969+0000","last_became_active":"2024-09-12T17:52:39.883689+0000","last_became_peered":"2024-09-12T17:52:39.883689+0000","last_unstale":"2024-09-12T19:25:10.225969+0000","last_undegraded":"2024-09-12T19:25:10.225969+0000","last_fullsized":"2024-09-12T19:25:10.225969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:21.651937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.235695+0000","last_change":"2024-09-12T18:25:52.605313+0000","last_active":"2024-09-12T19:25:55.235695+0000","last_peered":"2024-09-12T19:25:55.235695+0000","last_clean":"2024-09-12T19:25:55.235695+0000","last_became_active":"2024-09-12T18:25:52.598221+0000","last_became_peered":"2024-09-12T18:25:52.598221+0000","last_unstale":"2024-09-12T19:25:55.235695+0000","last_undegraded":"2024-09-12T19:25:55.235695+0000","last_fullsized":"2024-09-12T19:25:55.235695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.818370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241434+0000","last_change":"2024-09-12T17:58:47.247385+0000","last_active":"2024-09-12T19:26:20.241434+0000","last_peered":"2024-09-12T19:26:20.241434+0000","last_clean":"2024-09-12T19:26:20.241434+0000","last_became_active":"2024-09-12T17:58:47.238781+0000","last_became_peered":"2024-09-12T17:58:47.238781+0000","last_unstale":"2024-09-12T19:26:20.241434+0000","last_undegraded":"2024-09-12T19:26:20.241434+0000","last_fullsized":"2024-09-12T19:26:20.241434+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:59.988556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.590718+0000","last_change":"2024-09-12T17:58:40.188716+0000","last_active":"2024-09-12T19:26:10.590718+0000","last_peered":"2024-09-12T19:26:10.590718+0000","last_clean":"2024-09-12T19:26:10.590718+0000","last_became_active":"2024-09-12T17:58:40.187973+0000","last_became_peered":"2024-09-12T17:58:40.187973+0000","last_unstale":"2024-09-12T19:26:10.590718+0000","last_undegraded":"2024-09-12T19:26:10.590718+0000","last_fullsized":"2024-09-12T19:26:10.590718+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:19.654518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'31","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.675055+0000","last_change":"2024-09-12T17:52:39.892332+0000","last_active":"2024-09-12T19:27:10.675055+0000","last_peered":"2024-09-12T19:27:10.675055+0000","last_clean":"2024-09-12T19:27:10.675055+0000","last_became_active":"2024-09-12T17:52:39.891830+0000","last_became_peered":"2024-09-12T17:52:39.891830+0000","last_unstale":"2024-09-12T19:27:10.675055+0000","last_undegraded":"2024-09-12T19:27:10.675055+0000","last_fullsized":"2024-09-12T19:27:10.675055+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:19.516571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.588010+0000","last_change":"2024-09-12T18:25:52.607506+0000","last_active":"2024-09-12T19:25:55.588010+0000","last_peered":"2024-09-12T19:25:55.588010+0000","last_clean":"2024-09-12T19:25:55.588010+0000","last_became_active":"2024-09-12T18:25:52.606714+0000","last_became_peered":"2024-09-12T18:25:52.606714+0000","last_unstale":"2024-09-12T19:25:55.588010+0000","last_undegraded":"2024-09-12T19:25:55.588010+0000","last_fullsized":"2024-09-12T19:25:55.588010+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:29.094403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'4","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:50.697775+0000","last_change":"2024-09-12T17:58:47.251261+0000","last_active":"2024-09-12T19:28:50.697775+0000","last_peered":"2024-09-12T19:28:50.697775+0000","last_clean":"2024-09-12T19:28:50.697775+0000","last_became_active":"2024-09-12T17:58:47.250364+0000","last_became_peered":"2024-09-12T17:58:47.250364+0000","last_unstale":"2024-09-12T19:28:50.697775+0000","last_undegraded":"2024-09-12T19:28:50.697775+0000","last_fullsized":"2024-09-12T19:28:50.697775+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:18.815473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:09.038794+0000","last_change":"2024-09-12T17:58:40.212846+0000","last_active":"2024-09-12T19:26:09.038794+0000","last_peered":"2024-09-12T19:26:09.038794+0000","last_clean":"2024-09-12T19:26:09.038794+0000","last_became_active":"2024-09-12T17:58:40.212280+0000","last_became_peered":"2024-09-12T17:58:40.212280+0000","last_unstale":"2024-09-12T19:26:09.038794+0000","last_undegraded":"2024-09-12T19:26:09.038794+0000","last_fullsized":"2024-09-12T19:26:09.038794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:58.695339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'30","reported_seq":152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:54.048336+0000","last_change":"2024-09-12T17:52:39.871278+0000","last_active":"2024-09-12T19:26:54.048336+0000","last_peered":"2024-09-12T19:26:54.048336+0000","last_clean":"2024-09-12T19:26:54.048336+0000","last_became_active":"2024-09-12T17:52:39.870304+0000","last_became_peered":"2024-09-12T17:52:39.870304+0000","last_unstale":"2024-09-12T19:26:54.048336+0000","last_undegraded":"2024-09-12T19:26:54.048336+0000","last_fullsized":"2024-09-12T19:26:54.048336+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:38.765024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":59,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254085+0000","last_change":"2024-09-12T18:25:52.623401+0000","last_active":"2024-09-12T19:26:35.254085+0000","last_peered":"2024-09-12T19:26:35.254085+0000","last_clean":"2024-09-12T19:26:35.254085+0000","last_became_active":"2024-09-12T18:25:52.622842+0000","last_became_peered":"2024-09-12T18:25:52.622842+0000","last_unstale":"2024-09-12T19:26:35.254085+0000","last_undegraded":"2024-09-12T19:26:35.254085+0000","last_fullsized":"2024-09-12T19:26:35.254085+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:22.497623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'4","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.690031+0000","last_change":"2024-09-12T17:58:47.256168+0000","last_active":"2024-09-12T19:28:15.690031+0000","last_peered":"2024-09-12T19:28:15.690031+0000","last_clean":"2024-09-12T19:28:15.690031+0000","last_became_active":"2024-09-12T17:58:47.255379+0000","last_became_peered":"2024-09-12T17:58:47.255379+0000","last_unstale":"2024-09-12T19:28:15.690031+0000","last_undegraded":"2024-09-12T19:28:15.690031+0000","last_fullsized":"2024-09-12T19:28:15.690031+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:28.202469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.341509+0000","last_change":"2024-09-12T17:58:40.194167+0000","last_active":"2024-09-12T19:25:30.341509+0000","last_peered":"2024-09-12T19:25:30.341509+0000","last_clean":"2024-09-12T19:25:30.341509+0000","last_became_active":"2024-09-12T17:58:40.193471+0000","last_became_peered":"2024-09-12T17:58:40.193471+0000","last_unstale":"2024-09-12T19:25:30.341509+0000","last_undegraded":"2024-09-12T19:25:30.341509+0000","last_fullsized":"2024-09-12T19:25:30.341509+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:18.036549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'46","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690191+0000","last_change":"2024-09-12T17:52:39.883998+0000","last_active":"2024-09-12T19:26:55.690191+0000","last_peered":"2024-09-12T19:26:55.690191+0000","last_clean":"2024-09-12T19:26:55.690191+0000","last_became_active":"2024-09-12T17:52:39.883248+0000","last_became_peered":"2024-09-12T17:52:39.883248+0000","last_unstale":"2024-09-12T19:26:55.690191+0000","last_undegraded":"2024-09-12T19:26:55.690191+0000","last_fullsized":"2024-09-12T19:26:55.690191+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:59.309550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":156,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:34.044189+0000","last_change":"2024-09-12T18:25:52.612372+0000","last_active":"2024-09-12T19:26:34.044189+0000","last_peered":"2024-09-12T19:26:34.044189+0000","last_clean":"2024-09-12T19:26:34.044189+0000","last_became_active":"2024-09-12T18:25:52.611620+0000","last_became_peered":"2024-09-12T18:25:52.611620+0000","last_unstale":"2024-09-12T19:26:34.044189+0000","last_undegraded":"2024-09-12T19:26:34.044189+0000","last_fullsized":"2024-09-12T19:26:34.044189+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:49.193437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'7","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.273211+0000","last_change":"2024-09-12T17:58:47.250813+0000","last_active":"2024-09-12T19:27:55.273211+0000","last_peered":"2024-09-12T19:27:55.273211+0000","last_clean":"2024-09-12T19:27:55.273211+0000","last_became_active":"2024-09-12T17:58:47.249833+0000","last_became_peered":"2024-09-12T17:58:47.249833+0000","last_unstale":"2024-09-12T19:27:55.273211+0000","last_undegraded":"2024-09-12T19:27:55.273211+0000","last_fullsized":"2024-09-12T19:27:55.273211+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:00.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.584687+0000","last_change":"2024-09-12T17:58:40.204716+0000","last_active":"2024-09-12T19:25:40.584687+0000","last_peered":"2024-09-12T19:25:40.584687+0000","last_clean":"2024-09-12T19:25:40.584687+0000","last_became_active":"2024-09-12T17:58:40.203917+0000","last_became_peered":"2024-09-12T17:58:40.203917+0000","last_unstale":"2024-09-12T19:25:40.584687+0000","last_undegraded":"2024-09-12T19:25:40.584687+0000","last_fullsized":"2024-09-12T19:25:40.584687+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:29.039732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690138+0000","last_change":"2024-09-12T17:52:39.885011+0000","last_active":"2024-09-12T19:26:55.690138+0000","last_peered":"2024-09-12T19:26:55.690138+0000","last_clean":"2024-09-12T19:26:55.690138+0000","last_became_active":"2024-09-12T17:52:39.884285+0000","last_became_peered":"2024-09-12T17:52:39.884285+0000","last_unstale":"2024-09-12T19:26:55.690138+0000","last_undegraded":"2024-09-12T19:26:55.690138+0000","last_fullsized":"2024-09-12T19:26:55.690138+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:22.466454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.244671+0000","last_change":"2024-09-12T18:25:52.624010+0000","last_active":"2024-09-12T19:26:35.244671+0000","last_peered":"2024-09-12T19:26:35.244671+0000","last_clean":"2024-09-12T19:26:35.244671+0000","last_became_active":"2024-09-12T18:25:52.623502+0000","last_became_peered":"2024-09-12T18:25:52.623502+0000","last_unstale":"2024-09-12T19:26:35.244671+0000","last_undegraded":"2024-09-12T19:26:35.244671+0000","last_fullsized":"2024-09-12T19:26:35.244671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:54.401588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'7","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.654410+0000","last_change":"2024-09-12T17:58:47.257454+0000","last_active":"2024-09-12T19:29:41.654410+0000","last_peered":"2024-09-12T19:29:41.654410+0000","last_clean":"2024-09-12T19:29:41.654410+0000","last_became_active":"2024-09-12T17:58:47.256721+0000","last_became_peered":"2024-09-12T17:58:47.256721+0000","last_unstale":"2024-09-12T19:29:41.654410+0000","last_undegraded":"2024-09-12T19:29:41.654410+0000","last_fullsized":"2024-09-12T19:29:41.654410+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:39.335691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16424,"num_write":12,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:05.687759+0000","last_change":"2024-09-12T17:58:40.199627+0000","last_active":"2024-09-12T19:28:05.687759+0000","last_peered":"2024-09-12T19:28:05.687759+0000","last_clean":"2024-09-12T19:28:05.687759+0000","last_became_active":"2024-09-12T17:58:40.198765+0000","last_became_peered":"2024-09-12T17:58:40.198765+0000","last_unstale":"2024-09-12T19:28:05.687759+0000","last_undegraded":"2024-09-12T19:28:05.687759+0000","last_fullsized":"2024-09-12T19:28:05.687759+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:37.234886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'58","reported_seq":224,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.671649+0000","last_change":"2024-09-12T17:52:39.886405+0000","last_active":"2024-09-12T19:26:55.671649+0000","last_peered":"2024-09-12T19:26:55.671649+0000","last_clean":"2024-09-12T19:26:55.671649+0000","last_became_active":"2024-09-12T17:52:39.885875+0000","last_became_peered":"2024-09-12T17:52:39.885875+0000","last_unstale":"2024-09-12T19:26:55.671649+0000","last_undegraded":"2024-09-12T19:26:55.671649+0000","last_fullsized":"2024-09-12T19:26:55.671649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:42.953403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":205,"num_write":103,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.596249+0000","last_change":"2024-09-12T18:25:52.618187+0000","last_active":"2024-09-12T19:26:35.596249+0000","last_peered":"2024-09-12T19:26:35.596249+0000","last_clean":"2024-09-12T19:26:35.596249+0000","last_became_active":"2024-09-12T18:25:52.617665+0000","last_became_peered":"2024-09-12T18:25:52.617665+0000","last_unstale":"2024-09-12T19:26:35.596249+0000","last_undegraded":"2024-09-12T19:26:35.596249+0000","last_fullsized":"2024-09-12T19:26:35.596249+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:16.143458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'5","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586974+0000","last_change":"2024-09-12T17:58:47.254576+0000","last_active":"2024-09-12T19:25:50.586974+0000","last_peered":"2024-09-12T19:25:50.586974+0000","last_clean":"2024-09-12T19:25:50.586974+0000","last_became_active":"2024-09-12T17:58:47.253819+0000","last_became_peered":"2024-09-12T17:58:47.253819+0000","last_unstale":"2024-09-12T19:25:50.586974+0000","last_undegraded":"2024-09-12T19:25:50.586974+0000","last_fullsized":"2024-09-12T19:25:50.586974+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:16.422570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:05.275765+0000","last_change":"2024-09-12T17:58:40.208386+0000","last_active":"2024-09-12T19:28:05.275765+0000","last_peered":"2024-09-12T19:28:05.275765+0000","last_clean":"2024-09-12T19:28:05.275765+0000","last_became_active":"2024-09-12T17:58:40.202790+0000","last_became_peered":"2024-09-12T17:58:40.202790+0000","last_unstale":"2024-09-12T19:28:05.275765+0000","last_undegraded":"2024-09-12T19:28:05.275765+0000","last_fullsized":"2024-09-12T19:28:05.275765+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:41.561154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'30","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:30.356662+0000","last_change":"2024-09-12T17:52:39.872248+0000","last_active":"2024-09-12T19:26:30.356662+0000","last_peered":"2024-09-12T19:26:30.356662+0000","last_clean":"2024-09-12T19:26:30.356662+0000","last_became_active":"2024-09-12T17:52:39.871009+0000","last_became_peered":"2024-09-12T17:52:39.871009+0000","last_unstale":"2024-09-12T19:26:30.356662+0000","last_undegraded":"2024-09-12T19:26:30.356662+0000","last_fullsized":"2024-09-12T19:26:30.356662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:36.952465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250730+0000","last_change":"2024-09-12T18:25:52.620335+0000","last_active":"2024-09-12T19:26:20.250730+0000","last_peered":"2024-09-12T19:26:20.250730+0000","last_clean":"2024-09-12T19:26:20.250730+0000","last_became_active":"2024-09-12T18:25:52.617863+0000","last_became_peered":"2024-09-12T18:25:52.617863+0000","last_unstale":"2024-09-12T19:26:20.250730+0000","last_undegraded":"2024-09-12T19:26:20.250730+0000","last_fullsized":"2024-09-12T19:26:20.250730+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:38.215652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"262'2","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.267001+0000","last_change":"2024-09-12T17:58:47.248615+0000","last_active":"2024-09-12T19:27:30.267001+0000","last_peered":"2024-09-12T19:27:30.267001+0000","last_clean":"2024-09-12T19:27:30.267001+0000","last_became_active":"2024-09-12T17:58:47.247475+0000","last_became_peered":"2024-09-12T17:58:47.247475+0000","last_unstale":"2024-09-12T19:27:30.267001+0000","last_undegraded":"2024-09-12T19:27:30.267001+0000","last_fullsized":"2024-09-12T19:27:30.267001+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"265'5","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.125898+0000","last_change":"2024-09-12T17:58:40.203206+0000","last_active":"2024-09-12T19:29:40.125898+0000","last_peered":"2024-09-12T19:29:40.125898+0000","last_clean":"2024-09-12T19:29:40.125898+0000","last_became_active":"2024-09-12T17:58:40.202141+0000","last_became_peered":"2024-09-12T17:58:40.202141+0000","last_unstale":"2024-09-12T19:29:40.125898+0000","last_undegraded":"2024-09-12T19:29:40.125898+0000","last_fullsized":"2024-09-12T19:29:40.125898+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:09.764989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'22","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.349102+0000","last_change":"2024-09-12T17:52:39.885280+0000","last_active":"2024-09-12T19:26:00.349102+0000","last_peered":"2024-09-12T19:26:00.349102+0000","last_clean":"2024-09-12T19:26:00.349102+0000","last_became_active":"2024-09-12T17:52:39.884686+0000","last_became_peered":"2024-09-12T17:52:39.884686+0000","last_unstale":"2024-09-12T19:26:00.349102+0000","last_undegraded":"2024-09-12T19:26:00.349102+0000","last_fullsized":"2024-09-12T19:26:00.349102+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:49.000832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041069+0000","last_change":"2024-09-12T18:25:52.613926+0000","last_active":"2024-09-12T19:26:19.041069+0000","last_peered":"2024-09-12T19:26:19.041069+0000","last_clean":"2024-09-12T19:26:19.041069+0000","last_became_active":"2024-09-12T18:25:52.611450+0000","last_became_peered":"2024-09-12T18:25:52.611450+0000","last_unstale":"2024-09-12T19:26:19.041069+0000","last_undegraded":"2024-09-12T19:26:19.041069+0000","last_fullsized":"2024-09-12T19:26:19.041069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:02.885475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'4","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.381716+0000","last_change":"2024-09-12T17:58:47.254616+0000","last_active":"2024-09-12T19:29:42.381716+0000","last_peered":"2024-09-12T19:29:42.381716+0000","last_clean":"2024-09-12T19:29:42.381716+0000","last_became_active":"2024-09-12T17:58:47.254061+0000","last_became_peered":"2024-09-12T17:58:47.254061+0000","last_unstale":"2024-09-12T19:29:42.381716+0000","last_undegraded":"2024-09-12T19:29:42.381716+0000","last_fullsized":"2024-09-12T19:29:42.381716+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.299227+0000","last_change":"2024-09-12T17:58:40.203937+0000","last_active":"2024-09-12T19:29:40.299227+0000","last_peered":"2024-09-12T19:29:40.299227+0000","last_clean":"2024-09-12T19:29:40.299227+0000","last_became_active":"2024-09-12T17:58:40.203144+0000","last_became_peered":"2024-09-12T17:58:40.203144+0000","last_unstale":"2024-09-12T19:29:40.299227+0000","last_undegraded":"2024-09-12T19:29:40.299227+0000","last_fullsized":"2024-09-12T19:29:40.299227+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:57.360002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"262'16","reported_seq":117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.658972+0000","last_change":"2024-09-12T17:52:39.879536+0000","last_active":"2024-09-12T19:26:00.658972+0000","last_peered":"2024-09-12T19:26:00.658972+0000","last_clean":"2024-09-12T19:26:00.658972+0000","last_became_active":"2024-09-12T17:52:39.878797+0000","last_became_peered":"2024-09-12T17:52:39.878797+0000","last_unstale":"2024-09-12T19:26:00.658972+0000","last_undegraded":"2024-09-12T19:26:00.658972+0000","last_fullsized":"2024-09-12T19:26:00.658972+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:15.860760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.687851+0000","last_change":"2024-09-12T18:25:52.615680+0000","last_active":"2024-09-12T19:26:45.687851+0000","last_peered":"2024-09-12T19:26:45.687851+0000","last_clean":"2024-09-12T19:26:45.687851+0000","last_became_active":"2024-09-12T18:25:52.614949+0000","last_became_peered":"2024-09-12T18:25:52.614949+0000","last_unstale":"2024-09-12T19:26:45.687851+0000","last_undegraded":"2024-09-12T19:26:45.687851+0000","last_fullsized":"2024-09-12T19:26:45.687851+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:20.554312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.679828+0000","last_change":"2024-09-12T17:58:47.247578+0000","last_active":"2024-09-12T19:27:30.679828+0000","last_peered":"2024-09-12T19:27:30.679828+0000","last_clean":"2024-09-12T19:27:30.679828+0000","last_became_active":"2024-09-12T17:58:47.246916+0000","last_became_peered":"2024-09-12T17:58:47.246916+0000","last_unstale":"2024-09-12T19:27:30.679828+0000","last_undegraded":"2024-09-12T19:27:30.679828+0000","last_fullsized":"2024-09-12T19:27:30.679828+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"262'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097274+0000","last_change":"2024-09-12T17:58:40.208435+0000","last_active":"2024-09-12T19:27:20.097274+0000","last_peered":"2024-09-12T19:27:20.097274+0000","last_clean":"2024-09-12T19:27:20.097274+0000","last_became_active":"2024-09-12T17:58:40.207311+0000","last_became_peered":"2024-09-12T17:58:40.207311+0000","last_unstale":"2024-09-12T19:27:20.097274+0000","last_undegraded":"2024-09-12T19:27:20.097274+0000","last_fullsized":"2024-09-12T19:27:20.097274+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:09.258846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'29","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.236763+0000","last_change":"2024-09-12T17:52:39.867898+0000","last_active":"2024-09-12T19:26:00.236763+0000","last_peered":"2024-09-12T19:26:00.236763+0000","last_clean":"2024-09-12T19:26:00.236763+0000","last_became_active":"2024-09-12T17:52:39.867179+0000","last_became_peered":"2024-09-12T17:52:39.867179+0000","last_unstale":"2024-09-12T19:26:00.236763+0000","last_undegraded":"2024-09-12T19:26:00.236763+0000","last_fullsized":"2024-09-12T19:26:00.236763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:01.169877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":56,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041017+0000","last_change":"2024-09-12T18:25:52.612961+0000","last_active":"2024-09-12T19:26:19.041017+0000","last_peered":"2024-09-12T19:26:19.041017+0000","last_clean":"2024-09-12T19:26:19.041017+0000","last_became_active":"2024-09-12T18:25:52.610587+0000","last_became_peered":"2024-09-12T18:25:52.610587+0000","last_unstale":"2024-09-12T19:26:19.041017+0000","last_undegraded":"2024-09-12T19:26:19.041017+0000","last_fullsized":"2024-09-12T19:26:19.041017+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:48.847349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.371113+0000","last_change":"2024-09-12T17:58:47.251206+0000","last_active":"2024-09-12T19:27:30.371113+0000","last_peered":"2024-09-12T19:27:30.371113+0000","last_clean":"2024-09-12T19:27:30.371113+0000","last_became_active":"2024-09-12T17:58:47.245601+0000","last_became_peered":"2024-09-12T17:58:47.245601+0000","last_unstale":"2024-09-12T19:27:30.371113+0000","last_undegraded":"2024-09-12T19:27:30.371113+0000","last_fullsized":"2024-09-12T19:27:30.371113+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.097320+0000","last_change":"2024-09-12T17:58:40.203425+0000","last_active":"2024-09-12T19:27:20.097320+0000","last_peered":"2024-09-12T19:27:20.097320+0000","last_clean":"2024-09-12T19:27:20.097320+0000","last_became_active":"2024-09-12T17:58:40.202408+0000","last_became_peered":"2024-09-12T17:58:40.202408+0000","last_unstale":"2024-09-12T19:27:20.097320+0000","last_undegraded":"2024-09-12T19:27:20.097320+0000","last_fullsized":"2024-09-12T19:27:20.097320+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:04.410943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":531,"num_write":4,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'108","reported_seq":441,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.658909+0000","last_change":"2024-09-12T17:52:39.881369+0000","last_active":"2024-09-12T19:26:00.658909+0000","last_peered":"2024-09-12T19:26:00.658909+0000","last_clean":"2024-09-12T19:26:00.658909+0000","last_became_active":"2024-09-12T17:52:39.880742+0000","last_became_peered":"2024-09-12T17:52:39.880742+0000","last_unstale":"2024-09-12T19:26:00.658909+0000","last_undegraded":"2024-09-12T19:26:00.658909+0000","last_fullsized":"2024-09-12T19:26:00.658909+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:12.083548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":720,"num_read_kb":486,"num_write":145,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258684+0000","last_change":"2024-09-12T18:25:52.605986+0000","last_active":"2024-09-12T19:26:55.258684+0000","last_peered":"2024-09-12T19:26:55.258684+0000","last_clean":"2024-09-12T19:26:55.258684+0000","last_became_active":"2024-09-12T18:25:52.605039+0000","last_became_peered":"2024-09-12T18:25:52.605039+0000","last_unstale":"2024-09-12T19:26:55.258684+0000","last_undegraded":"2024-09-12T19:26:55.258684+0000","last_fullsized":"2024-09-12T19:26:55.258684+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.770637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'7","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:50.697898+0000","last_change":"2024-09-12T17:58:47.242884+0000","last_active":"2024-09-12T19:28:50.697898+0000","last_peered":"2024-09-12T19:28:50.697898+0000","last_clean":"2024-09-12T19:28:50.697898+0000","last_became_active":"2024-09-12T17:58:47.241778+0000","last_became_peered":"2024-09-12T17:58:47.241778+0000","last_unstale":"2024-09-12T19:28:50.697898+0000","last_undegraded":"2024-09-12T19:28:50.697898+0000","last_fullsized":"2024-09-12T19:28:50.697898+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:36.555666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3074,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.119045+0000","last_change":"2024-09-12T17:58:40.196234+0000","last_active":"2024-09-12T19:29:42.119045+0000","last_peered":"2024-09-12T19:29:42.119045+0000","last_clean":"2024-09-12T19:29:42.119045+0000","last_became_active":"2024-09-12T17:58:40.195309+0000","last_became_peered":"2024-09-12T17:58:40.195309+0000","last_unstale":"2024-09-12T19:29:42.119045+0000","last_undegraded":"2024-09-12T19:29:42.119045+0000","last_fullsized":"2024-09-12T19:29:42.119045+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:30.098876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"262'110","reported_seq":458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:25.678784+0000","last_change":"2024-09-12T17:52:39.886824+0000","last_active":"2024-09-12T19:27:25.678784+0000","last_peered":"2024-09-12T19:27:25.678784+0000","last_clean":"2024-09-12T19:27:25.678784+0000","last_became_active":"2024-09-12T17:52:39.886185+0000","last_became_peered":"2024-09-12T17:52:39.886185+0000","last_unstale":"2024-09-12T19:27:25.678784+0000","last_undegraded":"2024-09-12T19:27:25.678784+0000","last_fullsized":"2024-09-12T19:27:25.678784+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:31.714670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":756,"num_read_kb":514,"num_write":140,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.088040+0000","last_change":"2024-09-12T18:25:52.624391+0000","last_active":"2024-09-12T19:26:40.088040+0000","last_peered":"2024-09-12T19:26:40.088040+0000","last_clean":"2024-09-12T19:26:40.088040+0000","last_became_active":"2024-09-12T18:25:52.623444+0000","last_became_peered":"2024-09-12T18:25:52.623444+0000","last_unstale":"2024-09-12T19:26:40.088040+0000","last_undegraded":"2024-09-12T19:26:40.088040+0000","last_fullsized":"2024-09-12T19:26:40.088040+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:41.418750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667006+0000","last_change":"2024-09-12T17:58:47.255347+0000","last_active":"2024-09-12T19:26:35.667006+0000","last_peered":"2024-09-12T19:26:35.667006+0000","last_clean":"2024-09-12T19:26:35.667006+0000","last_became_active":"2024-09-12T17:58:47.254273+0000","last_became_peered":"2024-09-12T17:58:47.254273+0000","last_unstale":"2024-09-12T19:26:35.667006+0000","last_undegraded":"2024-09-12T19:26:35.667006+0000","last_fullsized":"2024-09-12T19:26:35.667006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:34.502761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:39.071620+0000","last_change":"2024-09-12T17:58:40.202847+0000","last_active":"2024-09-12T19:28:39.071620+0000","last_peered":"2024-09-12T19:28:39.071620+0000","last_clean":"2024-09-12T19:28:39.071620+0000","last_became_active":"2024-09-12T17:58:40.202027+0000","last_became_peered":"2024-09-12T17:58:40.202027+0000","last_unstale":"2024-09-12T19:28:39.071620+0000","last_undegraded":"2024-09-12T19:28:39.071620+0000","last_fullsized":"2024-09-12T19:28:39.071620+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:12.912226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'31","reported_seq":153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366551+0000","last_change":"2024-09-12T17:52:39.877904+0000","last_active":"2024-09-12T19:27:10.366551+0000","last_peered":"2024-09-12T19:27:10.366551+0000","last_clean":"2024-09-12T19:27:10.366551+0000","last_became_active":"2024-09-12T17:52:39.877206+0000","last_became_peered":"2024-09-12T17:52:39.877206+0000","last_unstale":"2024-09-12T19:27:10.366551+0000","last_undegraded":"2024-09-12T19:27:10.366551+0000","last_fullsized":"2024-09-12T19:27:10.366551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.931327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":97,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.357743+0000","last_change":"2024-09-12T18:25:52.620716+0000","last_active":"2024-09-12T19:26:35.357743+0000","last_peered":"2024-09-12T19:26:35.357743+0000","last_clean":"2024-09-12T19:26:35.357743+0000","last_became_active":"2024-09-12T18:25:52.620045+0000","last_became_peered":"2024-09-12T18:25:52.620045+0000","last_unstale":"2024-09-12T19:26:35.357743+0000","last_undegraded":"2024-09-12T19:26:35.357743+0000","last_fullsized":"2024-09-12T19:26:35.357743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:58.464498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670475+0000","last_change":"2024-09-12T17:58:47.253752+0000","last_active":"2024-09-12T19:26:50.670475+0000","last_peered":"2024-09-12T19:26:50.670475+0000","last_clean":"2024-09-12T19:26:50.670475+0000","last_became_active":"2024-09-12T17:58:47.252966+0000","last_became_peered":"2024-09-12T17:58:47.252966+0000","last_unstale":"2024-09-12T19:26:50.670475+0000","last_undegraded":"2024-09-12T19:26:50.670475+0000","last_fullsized":"2024-09-12T19:26:50.670475+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:12.503210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'9","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.966100+0000","last_change":"2024-09-12T17:58:40.198879+0000","last_active":"2024-09-12T19:29:41.966100+0000","last_peered":"2024-09-12T19:29:41.966100+0000","last_clean":"2024-09-12T19:29:41.966100+0000","last_became_active":"2024-09-12T17:58:40.198161+0000","last_became_peered":"2024-09-12T17:58:40.198161+0000","last_unstale":"2024-09-12T19:29:41.966100+0000","last_undegraded":"2024-09-12T19:29:41.966100+0000","last_fullsized":"2024-09-12T19:29:41.966100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:50.706791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'31","reported_seq":154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.094779+0000","last_change":"2024-09-12T17:52:39.867437+0000","last_active":"2024-09-12T19:27:10.094779+0000","last_peered":"2024-09-12T19:27:10.094779+0000","last_clean":"2024-09-12T19:27:10.094779+0000","last_became_active":"2024-09-12T17:52:39.866342+0000","last_became_peered":"2024-09-12T17:52:39.866342+0000","last_unstale":"2024-09-12T19:27:10.094779+0000","last_undegraded":"2024-09-12T19:27:10.094779+0000","last_fullsized":"2024-09-12T19:27:10.094779+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:36.550336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":107,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.086529+0000","last_change":"2024-09-12T18:25:52.601482+0000","last_active":"2024-09-12T19:26:35.086529+0000","last_peered":"2024-09-12T19:26:35.086529+0000","last_clean":"2024-09-12T19:26:35.086529+0000","last_became_active":"2024-09-12T18:25:52.599679+0000","last_became_peered":"2024-09-12T18:25:52.599679+0000","last_unstale":"2024-09-12T19:26:35.086529+0000","last_undegraded":"2024-09-12T19:26:35.086529+0000","last_fullsized":"2024-09-12T19:26:35.086529+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:02.845957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'2","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:50.286775+0000","last_change":"2024-09-12T17:58:47.256589+0000","last_active":"2024-09-12T19:28:50.286775+0000","last_peered":"2024-09-12T19:28:50.286775+0000","last_clean":"2024-09-12T19:28:50.286775+0000","last_became_active":"2024-09-12T17:58:47.255891+0000","last_became_peered":"2024-09-12T17:58:47.255891+0000","last_unstale":"2024-09-12T19:28:50.286775+0000","last_undegraded":"2024-09-12T19:28:50.286775+0000","last_fullsized":"2024-09-12T19:28:50.286775+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:52.933367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"262'3","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668287+0000","last_change":"2024-09-12T17:58:40.212187+0000","last_active":"2024-09-12T19:26:40.668287+0000","last_peered":"2024-09-12T19:26:40.668287+0000","last_clean":"2024-09-12T19:26:40.668287+0000","last_became_active":"2024-09-12T17:58:40.211450+0000","last_became_peered":"2024-09-12T17:58:40.211450+0000","last_unstale":"2024-09-12T19:26:40.668287+0000","last_undegraded":"2024-09-12T19:26:40.668287+0000","last_fullsized":"2024-09-12T19:26:40.668287+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:21.169200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'25","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:09.052206+0000","last_change":"2024-09-12T17:52:39.866705+0000","last_active":"2024-09-12T19:27:09.052206+0000","last_peered":"2024-09-12T19:27:09.052206+0000","last_clean":"2024-09-12T19:27:09.052206+0000","last_became_active":"2024-09-12T17:52:39.865914+0000","last_became_peered":"2024-09-12T17:52:39.865914+0000","last_unstale":"2024-09-12T19:27:09.052206+0000","last_undegraded":"2024-09-12T19:27:09.052206+0000","last_fullsized":"2024-09-12T19:27:09.052206+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:43.382459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255364+0000","last_change":"2024-09-12T18:25:52.613354+0000","last_active":"2024-09-12T19:26:40.255364+0000","last_peered":"2024-09-12T19:26:40.255364+0000","last_clean":"2024-09-12T19:26:40.255364+0000","last_became_active":"2024-09-12T18:25:52.612421+0000","last_became_peered":"2024-09-12T18:25:52.612421+0000","last_unstale":"2024-09-12T19:26:40.255364+0000","last_undegraded":"2024-09-12T19:26:40.255364+0000","last_fullsized":"2024-09-12T19:26:40.255364+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:29.095745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.153845+0000","last_change":"2024-09-12T17:58:47.246522+0000","last_active":"2024-09-12T19:29:42.153845+0000","last_peered":"2024-09-12T19:29:42.153845+0000","last_clean":"2024-09-12T19:29:42.153845+0000","last_became_active":"2024-09-12T17:58:47.238172+0000","last_became_peered":"2024-09-12T17:58:47.238172+0000","last_unstale":"2024-09-12T19:29:42.153845+0000","last_undegraded":"2024-09-12T19:29:42.153845+0000","last_fullsized":"2024-09-12T19:29:42.153845+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'7","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.730764+0000","last_change":"2024-09-12T17:58:40.194862+0000","last_active":"2024-09-12T19:29:41.730764+0000","last_peered":"2024-09-12T19:29:41.730764+0000","last_clean":"2024-09-12T19:29:41.730764+0000","last_became_active":"2024-09-12T17:58:40.194093+0000","last_became_peered":"2024-09-12T17:58:40.194093+0000","last_unstale":"2024-09-12T19:29:41.730764+0000","last_undegraded":"2024-09-12T19:29:41.730764+0000","last_fullsized":"2024-09-12T19:29:41.730764+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:55.158370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'38","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:09.052156+0000","last_change":"2024-09-12T17:52:39.888669+0000","last_active":"2024-09-12T19:27:09.052156+0000","last_peered":"2024-09-12T19:27:09.052156+0000","last_clean":"2024-09-12T19:27:09.052156+0000","last_became_active":"2024-09-12T17:52:39.887302+0000","last_became_peered":"2024-09-12T17:52:39.887302+0000","last_unstale":"2024-09-12T19:27:09.052156+0000","last_undegraded":"2024-09-12T19:27:09.052156+0000","last_fullsized":"2024-09-12T19:27:09.052156+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:45.562829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":146,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249879+0000","last_change":"2024-09-12T18:25:52.611745+0000","last_active":"2024-09-12T19:27:00.249879+0000","last_peered":"2024-09-12T19:27:00.249879+0000","last_clean":"2024-09-12T19:27:00.249879+0000","last_became_active":"2024-09-12T18:25:52.611022+0000","last_became_peered":"2024-09-12T18:25:52.611022+0000","last_unstale":"2024-09-12T19:27:00.249879+0000","last_undegraded":"2024-09-12T19:27:00.249879+0000","last_fullsized":"2024-09-12T19:27:00.249879+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:05.067276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"262'5","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:40.258672+0000","last_change":"2024-09-12T17:58:47.248839+0000","last_active":"2024-09-12T19:27:40.258672+0000","last_peered":"2024-09-12T19:27:40.258672+0000","last_clean":"2024-09-12T19:27:40.258672+0000","last_became_active":"2024-09-12T17:58:47.247599+0000","last_became_peered":"2024-09-12T17:58:47.247599+0000","last_unstale":"2024-09-12T19:27:40.258672+0000","last_undegraded":"2024-09-12T19:27:40.258672+0000","last_fullsized":"2024-09-12T19:27:40.258672+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'8","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.299268+0000","last_change":"2024-09-12T17:58:40.203966+0000","last_active":"2024-09-12T19:29:40.299268+0000","last_peered":"2024-09-12T19:29:40.299268+0000","last_clean":"2024-09-12T19:29:40.299268+0000","last_became_active":"2024-09-12T17:58:40.203177+0000","last_became_peered":"2024-09-12T17:58:40.203177+0000","last_unstale":"2024-09-12T19:29:40.299268+0000","last_undegraded":"2024-09-12T19:29:40.299268+0000","last_fullsized":"2024-09-12T19:29:40.299268+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:05.344996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'30","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.240017+0000","last_change":"2024-09-12T17:52:39.878505+0000","last_active":"2024-09-12T19:26:15.240017+0000","last_peered":"2024-09-12T19:26:15.240017+0000","last_clean":"2024-09-12T19:26:15.240017+0000","last_became_active":"2024-09-12T17:52:39.877793+0000","last_became_peered":"2024-09-12T17:52:39.877793+0000","last_unstale":"2024-09-12T19:26:15.240017+0000","last_undegraded":"2024-09-12T19:26:15.240017+0000","last_fullsized":"2024-09-12T19:26:15.240017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:26.899906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.597487+0000","last_change":"2024-09-12T18:25:52.618530+0000","last_active":"2024-09-12T19:26:40.597487+0000","last_peered":"2024-09-12T19:26:40.597487+0000","last_clean":"2024-09-12T19:26:40.597487+0000","last_became_active":"2024-09-12T18:25:52.617815+0000","last_became_peered":"2024-09-12T18:25:52.617815+0000","last_unstale":"2024-09-12T19:26:40.597487+0000","last_undegraded":"2024-09-12T19:26:40.597487+0000","last_fullsized":"2024-09-12T19:26:40.597487+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:26.125712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:34.044128+0000","last_change":"2024-09-12T17:58:47.257576+0000","last_active":"2024-09-12T19:26:34.044128+0000","last_peered":"2024-09-12T19:26:34.044128+0000","last_clean":"2024-09-12T19:26:34.044128+0000","last_became_active":"2024-09-12T17:58:47.256924+0000","last_became_peered":"2024-09-12T17:58:47.256924+0000","last_unstale":"2024-09-12T19:26:34.044128+0000","last_undegraded":"2024-09-12T19:26:34.044128+0000","last_fullsized":"2024-09-12T19:26:34.044128+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:39.738133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:45.683276+0000","last_change":"2024-09-12T17:58:40.194527+0000","last_active":"2024-09-12T19:27:45.683276+0000","last_peered":"2024-09-12T19:27:45.683276+0000","last_clean":"2024-09-12T19:27:45.683276+0000","last_became_active":"2024-09-12T17:58:40.193786+0000","last_became_peered":"2024-09-12T17:58:40.193786+0000","last_unstale":"2024-09-12T19:27:45.683276+0000","last_undegraded":"2024-09-12T19:27:45.683276+0000","last_fullsized":"2024-09-12T19:27:45.683276+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'23","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.243911+0000","last_change":"2024-09-12T17:52:39.875927+0000","last_active":"2024-09-12T19:25:50.243911+0000","last_peered":"2024-09-12T19:25:50.243911+0000","last_clean":"2024-09-12T19:25:50.243911+0000","last_became_active":"2024-09-12T17:52:39.869627+0000","last_became_peered":"2024-09-12T17:52:39.869627+0000","last_unstale":"2024-09-12T19:25:50.243911+0000","last_undegraded":"2024-09-12T19:25:50.243911+0000","last_fullsized":"2024-09-12T19:25:50.243911+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:00.817489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":43,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668164+0000","last_change":"2024-09-12T18:25:52.624807+0000","last_active":"2024-09-12T19:26:40.668164+0000","last_peered":"2024-09-12T19:26:40.668164+0000","last_clean":"2024-09-12T19:26:40.668164+0000","last_became_active":"2024-09-12T18:25:52.624296+0000","last_became_peered":"2024-09-12T18:25:52.624296+0000","last_unstale":"2024-09-12T19:26:40.668164+0000","last_undegraded":"2024-09-12T19:26:40.668164+0000","last_fullsized":"2024-09-12T19:26:40.668164+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:35.580294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"265'8","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.614343+0000","last_change":"2024-09-12T17:58:47.244823+0000","last_active":"2024-09-12T19:28:00.614343+0000","last_peered":"2024-09-12T19:28:00.614343+0000","last_clean":"2024-09-12T19:28:00.614343+0000","last_became_active":"2024-09-12T17:58:47.242874+0000","last_became_peered":"2024-09-12T17:58:47.242874+0000","last_unstale":"2024-09-12T19:28:00.614343+0000","last_undegraded":"2024-09-12T19:28:00.614343+0000","last_fullsized":"2024-09-12T19:28:00.614343+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:49.961011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9787,"num_write":8,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'5","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.387779+0000","last_change":"2024-09-12T17:58:40.175758+0000","last_active":"2024-09-12T19:28:40.387779+0000","last_peered":"2024-09-12T19:28:40.387779+0000","last_clean":"2024-09-12T19:28:40.387779+0000","last_became_active":"2024-09-12T17:58:40.175011+0000","last_became_peered":"2024-09-12T17:58:40.175011+0000","last_unstale":"2024-09-12T19:28:40.387779+0000","last_undegraded":"2024-09-12T19:28:40.387779+0000","last_fullsized":"2024-09-12T19:28:40.387779+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:29.337157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'56","reported_seq":233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.586722+0000","last_change":"2024-09-12T17:52:39.885688+0000","last_active":"2024-09-12T19:25:50.586722+0000","last_peered":"2024-09-12T19:25:50.586722+0000","last_clean":"2024-09-12T19:25:50.586722+0000","last_became_active":"2024-09-12T17:52:39.884599+0000","last_became_peered":"2024-09-12T17:52:39.884599+0000","last_unstale":"2024-09-12T19:25:50.586722+0000","last_undegraded":"2024-09-12T19:25:50.586722+0000","last_fullsized":"2024-09-12T19:25:50.586722+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:48.524948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":231,"num_write":89,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.592964+0000","last_change":"2024-09-12T18:25:52.603197+0000","last_active":"2024-09-12T19:26:20.592964+0000","last_peered":"2024-09-12T19:26:20.592964+0000","last_clean":"2024-09-12T19:26:20.592964+0000","last_became_active":"2024-09-12T18:25:52.602495+0000","last_became_peered":"2024-09-12T18:25:52.602495+0000","last_unstale":"2024-09-12T19:26:20.592964+0000","last_undegraded":"2024-09-12T19:26:20.592964+0000","last_fullsized":"2024-09-12T19:26:20.592964+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:36.706795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'12","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.929898+0000","last_change":"2024-09-12T17:58:47.255006+0000","last_active":"2024-09-12T19:29:41.929898+0000","last_peered":"2024-09-12T19:29:41.929898+0000","last_clean":"2024-09-12T19:29:41.929898+0000","last_became_active":"2024-09-12T17:58:47.254272+0000","last_became_peered":"2024-09-12T17:58:47.254272+0000","last_unstale":"2024-09-12T19:29:41.929898+0000","last_undegraded":"2024-09-12T19:29:41.929898+0000","last_fullsized":"2024-09-12T19:29:41.929898+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:11.620938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":22,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'6","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.382034+0000","last_change":"2024-09-12T17:58:40.195873+0000","last_active":"2024-09-12T19:28:15.382034+0000","last_peered":"2024-09-12T19:28:15.382034+0000","last_clean":"2024-09-12T19:28:15.382034+0000","last_became_active":"2024-09-12T17:58:40.195089+0000","last_became_peered":"2024-09-12T17:58:40.195089+0000","last_unstale":"2024-09-12T19:28:15.382034+0000","last_undegraded":"2024-09-12T19:28:15.382034+0000","last_fullsized":"2024-09-12T19:28:15.382034+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.723902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'27","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.675603+0000","last_change":"2024-09-12T17:52:39.868988+0000","last_active":"2024-09-12T19:25:50.675603+0000","last_peered":"2024-09-12T19:25:50.675603+0000","last_clean":"2024-09-12T19:25:50.675603+0000","last_became_active":"2024-09-12T17:52:39.867605+0000","last_became_peered":"2024-09-12T17:52:39.867605+0000","last_unstale":"2024-09-12T19:25:50.675603+0000","last_undegraded":"2024-09-12T19:25:50.675603+0000","last_fullsized":"2024-09-12T19:25:50.675603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:31.849687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":99,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.592985+0000","last_change":"2024-09-12T18:25:52.615107+0000","last_active":"2024-09-12T19:26:20.592985+0000","last_peered":"2024-09-12T19:26:20.592985+0000","last_clean":"2024-09-12T19:26:20.592985+0000","last_became_active":"2024-09-12T18:25:52.614383+0000","last_became_peered":"2024-09-12T18:25:52.614383+0000","last_unstale":"2024-09-12T19:26:20.592985+0000","last_undegraded":"2024-09-12T19:26:20.592985+0000","last_fullsized":"2024-09-12T19:26:20.592985+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:02.087383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"265'5","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.617664+0000","last_change":"2024-09-12T17:58:47.249774+0000","last_active":"2024-09-12T19:29:41.617664+0000","last_peered":"2024-09-12T19:29:41.617664+0000","last_clean":"2024-09-12T19:29:41.617664+0000","last_became_active":"2024-09-12T17:58:47.248924+0000","last_became_peered":"2024-09-12T17:58:47.248924+0000","last_unstale":"2024-09-12T19:29:41.617664+0000","last_undegraded":"2024-09-12T19:29:41.617664+0000","last_fullsized":"2024-09-12T19:29:41.617664+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.643262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:35.712307+0000","last_change":"2024-09-12T17:58:40.188344+0000","last_active":"2024-09-12T19:28:35.712307+0000","last_peered":"2024-09-12T19:28:35.712307+0000","last_clean":"2024-09-12T19:28:35.712307+0000","last_became_active":"2024-09-12T17:58:40.187590+0000","last_became_peered":"2024-09-12T17:58:40.187590+0000","last_unstale":"2024-09-12T19:28:35.712307+0000","last_undegraded":"2024-09-12T19:28:35.712307+0000","last_fullsized":"2024-09-12T19:28:35.712307+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:15.651076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'13","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.346788+0000","last_change":"2024-09-12T17:52:39.881326+0000","last_active":"2024-09-12T19:25:50.346788+0000","last_peered":"2024-09-12T19:25:50.346788+0000","last_clean":"2024-09-12T19:25:50.346788+0000","last_became_active":"2024-09-12T17:52:39.872599+0000","last_became_peered":"2024-09-12T17:52:39.872599+0000","last_unstale":"2024-09-12T19:25:50.346788+0000","last_undegraded":"2024-09-12T19:25:50.346788+0000","last_fullsized":"2024-09-12T19:25:50.346788+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:37.156957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:15.249303+0000","last_change":"2024-09-12T18:25:52.612438+0000","last_active":"2024-09-12T19:26:15.249303+0000","last_peered":"2024-09-12T19:26:15.249303+0000","last_clean":"2024-09-12T19:26:15.249303+0000","last_became_active":"2024-09-12T18:25:52.611377+0000","last_became_peered":"2024-09-12T18:25:52.611377+0000","last_unstale":"2024-09-12T19:26:15.249303+0000","last_undegraded":"2024-09-12T19:26:15.249303+0000","last_fullsized":"2024-09-12T19:26:15.249303+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:57.823730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'2","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.619343+0000","last_change":"2024-09-12T17:58:47.243005+0000","last_active":"2024-09-12T19:29:41.619343+0000","last_peered":"2024-09-12T19:29:41.619343+0000","last_clean":"2024-09-12T19:29:41.619343+0000","last_became_active":"2024-09-12T17:58:47.242171+0000","last_became_peered":"2024-09-12T17:58:47.242171+0000","last_unstale":"2024-09-12T19:29:41.619343+0000","last_undegraded":"2024-09-12T19:29:41.619343+0000","last_fullsized":"2024-09-12T19:29:41.619343+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.256971+0000","last_change":"2024-09-12T17:58:40.211247+0000","last_active":"2024-09-12T19:27:30.256971+0000","last_peered":"2024-09-12T19:27:30.256971+0000","last_clean":"2024-09-12T19:27:30.256971+0000","last_became_active":"2024-09-12T17:58:40.210485+0000","last_became_peered":"2024-09-12T17:58:40.210485+0000","last_unstale":"2024-09-12T19:27:30.256971+0000","last_undegraded":"2024-09-12T19:27:30.256971+0000","last_fullsized":"2024-09-12T19:27:30.256971+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:45.166206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'25","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.248017+0000","last_change":"2024-09-12T17:52:39.880057+0000","last_active":"2024-09-12T19:26:50.248017+0000","last_peered":"2024-09-12T19:26:50.248017+0000","last_clean":"2024-09-12T19:26:50.248017+0000","last_became_active":"2024-09-12T17:52:39.868837+0000","last_became_peered":"2024-09-12T17:52:39.868837+0000","last_unstale":"2024-09-12T19:26:50.248017+0000","last_undegraded":"2024-09-12T19:26:50.248017+0000","last_fullsized":"2024-09-12T19:26:50.248017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.133723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.353905+0000","last_change":"2024-09-12T18:25:52.615446+0000","last_active":"2024-09-12T19:26:20.353905+0000","last_peered":"2024-09-12T19:26:20.353905+0000","last_clean":"2024-09-12T19:26:20.353905+0000","last_became_active":"2024-09-12T18:25:52.611546+0000","last_became_peered":"2024-09-12T18:25:52.611546+0000","last_unstale":"2024-09-12T19:26:20.353905+0000","last_undegraded":"2024-09-12T19:26:20.353905+0000","last_fullsized":"2024-09-12T19:26:20.353905+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:59.006168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'7","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.263769+0000","last_change":"2024-09-12T17:58:47.246295+0000","last_active":"2024-09-12T19:29:42.263769+0000","last_peered":"2024-09-12T19:29:42.263769+0000","last_clean":"2024-09-12T19:29:42.263769+0000","last_became_active":"2024-09-12T17:58:47.245441+0000","last_became_peered":"2024-09-12T17:58:47.245441+0000","last_unstale":"2024-09-12T19:29:42.263769+0000","last_undegraded":"2024-09-12T19:29:42.263769+0000","last_fullsized":"2024-09-12T19:29:42.263769+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.401205+0000","last_change":"2024-09-12T17:58:40.192872+0000","last_active":"2024-09-12T19:29:40.401205+0000","last_peered":"2024-09-12T19:29:40.401205+0000","last_clean":"2024-09-12T19:29:40.401205+0000","last_became_active":"2024-09-12T17:58:40.191999+0000","last_became_peered":"2024-09-12T17:58:40.191999+0000","last_unstale":"2024-09-12T19:29:40.401205+0000","last_undegraded":"2024-09-12T19:29:40.401205+0000","last_fullsized":"2024-09-12T19:29:40.401205+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.003714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'36","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664694+0000","last_change":"2024-09-12T17:52:39.891322+0000","last_active":"2024-09-12T19:26:25.664694+0000","last_peered":"2024-09-12T19:26:25.664694+0000","last_clean":"2024-09-12T19:26:25.664694+0000","last_became_active":"2024-09-12T17:52:39.890678+0000","last_became_peered":"2024-09-12T17:52:39.890678+0000","last_unstale":"2024-09-12T19:26:25.664694+0000","last_undegraded":"2024-09-12T19:26:25.664694+0000","last_fullsized":"2024-09-12T19:26:25.664694+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:49.955143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667105+0000","last_change":"2024-09-12T18:25:52.612356+0000","last_active":"2024-09-12T19:26:35.667105+0000","last_peered":"2024-09-12T19:26:35.667105+0000","last_clean":"2024-09-12T19:26:35.667105+0000","last_became_active":"2024-09-12T18:25:52.611397+0000","last_became_peered":"2024-09-12T18:25:52.611397+0000","last_unstale":"2024-09-12T19:26:35.667105+0000","last_undegraded":"2024-09-12T19:26:35.667105+0000","last_fullsized":"2024-09-12T19:26:35.667105+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:59.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:25.709867+0000","last_change":"2024-09-12T17:58:47.241676+0000","last_active":"2024-09-12T19:28:25.709867+0000","last_peered":"2024-09-12T19:28:25.709867+0000","last_clean":"2024-09-12T19:28:25.709867+0000","last_became_active":"2024-09-12T17:58:47.240951+0000","last_became_peered":"2024-09-12T17:58:47.240951+0000","last_unstale":"2024-09-12T19:28:25.709867+0000","last_undegraded":"2024-09-12T19:28:25.709867+0000","last_fullsized":"2024-09-12T19:28:25.709867+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:38.662807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:05.277008+0000","last_change":"2024-09-12T17:58:40.212464+0000","last_active":"2024-09-12T19:29:05.277008+0000","last_peered":"2024-09-12T19:29:05.277008+0000","last_clean":"2024-09-12T19:29:05.277008+0000","last_became_active":"2024-09-12T17:58:40.211891+0000","last_became_peered":"2024-09-12T17:58:40.211891+0000","last_unstale":"2024-09-12T19:29:05.277008+0000","last_undegraded":"2024-09-12T19:29:05.277008+0000","last_fullsized":"2024-09-12T19:29:05.277008+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:27.802674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'53","reported_seq":225,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242648+0000","last_change":"2024-09-12T17:52:39.879319+0000","last_active":"2024-09-12T19:26:25.242648+0000","last_peered":"2024-09-12T19:26:25.242648+0000","last_clean":"2024-09-12T19:26:25.242648+0000","last_became_active":"2024-09-12T17:52:39.878694+0000","last_became_peered":"2024-09-12T17:52:39.878694+0000","last_unstale":"2024-09-12T19:26:25.242648+0000","last_undegraded":"2024-09-12T19:26:25.242648+0000","last_fullsized":"2024-09-12T19:26:25.242648+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:48.298171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":199,"num_write":92,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.685676+0000","last_change":"2024-09-12T18:25:52.620080+0000","last_active":"2024-09-12T19:26:35.685676+0000","last_peered":"2024-09-12T19:26:35.685676+0000","last_clean":"2024-09-12T19:26:35.685676+0000","last_became_active":"2024-09-12T18:25:52.619540+0000","last_became_peered":"2024-09-12T18:25:52.619540+0000","last_unstale":"2024-09-12T19:26:35.685676+0000","last_undegraded":"2024-09-12T19:26:35.685676+0000","last_fullsized":"2024-09-12T19:26:35.685676+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:07.956389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368657+0000","last_change":"2024-09-12T17:58:47.245205+0000","last_active":"2024-09-12T19:27:20.368657+0000","last_peered":"2024-09-12T19:27:20.368657+0000","last_clean":"2024-09-12T19:27:20.368657+0000","last_became_active":"2024-09-12T17:58:47.238232+0000","last_became_peered":"2024-09-12T17:58:47.238232+0000","last_unstale":"2024-09-12T19:27:20.368657+0000","last_undegraded":"2024-09-12T19:27:20.368657+0000","last_fullsized":"2024-09-12T19:27:20.368657+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:59.889739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"262'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:10.351356+0000","last_change":"2024-09-12T17:58:40.198949+0000","last_active":"2024-09-12T19:26:10.351356+0000","last_peered":"2024-09-12T19:26:10.351356+0000","last_clean":"2024-09-12T19:26:10.351356+0000","last_became_active":"2024-09-12T17:58:40.197815+0000","last_became_peered":"2024-09-12T17:58:40.197815+0000","last_unstale":"2024-09-12T19:26:10.351356+0000","last_undegraded":"2024-09-12T19:26:10.351356+0000","last_fullsized":"2024-09-12T19:26:10.351356+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:15.963939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'72","reported_seq":273,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355384+0000","last_change":"2024-09-12T17:52:39.876517+0000","last_active":"2024-09-12T19:26:25.355384+0000","last_peered":"2024-09-12T19:26:25.355384+0000","last_clean":"2024-09-12T19:26:25.355384+0000","last_became_active":"2024-09-12T17:52:39.872148+0000","last_became_peered":"2024-09-12T17:52:39.872148+0000","last_unstale":"2024-09-12T19:26:25.355384+0000","last_undegraded":"2024-09-12T19:26:25.355384+0000","last_fullsized":"2024-09-12T19:26:25.355384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.681891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":261,"num_write":116,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250622+0000","last_change":"2024-09-12T18:25:52.624296+0000","last_active":"2024-09-12T19:26:20.250622+0000","last_peered":"2024-09-12T19:26:20.250622+0000","last_clean":"2024-09-12T19:26:20.250622+0000","last_became_active":"2024-09-12T18:25:52.623635+0000","last_became_peered":"2024-09-12T18:25:52.623635+0000","last_unstale":"2024-09-12T19:26:20.250622+0000","last_undegraded":"2024-09-12T19:26:20.250622+0000","last_fullsized":"2024-09-12T19:26:20.250622+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:13.996677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"265'9","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.364060+0000","last_change":"2024-09-12T17:58:47.251669+0000","last_active":"2024-09-12T19:29:41.364060+0000","last_peered":"2024-09-12T19:29:41.364060+0000","last_clean":"2024-09-12T19:29:41.364060+0000","last_became_active":"2024-09-12T17:58:47.250762+0000","last_became_peered":"2024-09-12T17:58:47.250762+0000","last_unstale":"2024-09-12T19:29:41.364060+0000","last_undegraded":"2024-09-12T19:29:41.364060+0000","last_fullsized":"2024-09-12T19:29:41.364060+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:16.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9216,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:09.038722+0000","last_change":"2024-09-12T17:58:40.210753+0000","last_active":"2024-09-12T19:26:09.038722+0000","last_peered":"2024-09-12T19:26:09.038722+0000","last_clean":"2024-09-12T19:26:09.038722+0000","last_became_active":"2024-09-12T17:58:40.210072+0000","last_became_peered":"2024-09-12T17:58:40.210072+0000","last_unstale":"2024-09-12T19:26:09.038722+0000","last_undegraded":"2024-09-12T19:26:09.038722+0000","last_fullsized":"2024-09-12T19:26:09.038722+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.700767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'26","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355281+0000","last_change":"2024-09-12T17:52:39.872036+0000","last_active":"2024-09-12T19:26:25.355281+0000","last_peered":"2024-09-12T19:26:25.355281+0000","last_clean":"2024-09-12T19:26:25.355281+0000","last_became_active":"2024-09-12T17:52:39.871247+0000","last_became_peered":"2024-09-12T17:52:39.871247+0000","last_unstale":"2024-09-12T19:26:25.355281+0000","last_undegraded":"2024-09-12T19:26:25.355281+0000","last_fullsized":"2024-09-12T19:26:25.355281+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:34.468531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":46,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.359612+0000","last_change":"2024-09-12T18:25:52.622440+0000","last_active":"2024-09-12T19:26:40.359612+0000","last_peered":"2024-09-12T19:26:40.359612+0000","last_clean":"2024-09-12T19:26:40.359612+0000","last_became_active":"2024-09-12T18:25:52.621808+0000","last_became_peered":"2024-09-12T18:25:52.621808+0000","last_unstale":"2024-09-12T19:26:40.359612+0000","last_undegraded":"2024-09-12T19:26:40.359612+0000","last_fullsized":"2024-09-12T19:26:40.359612+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:05.559442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:25.268945+0000","last_change":"2024-09-12T17:58:47.236975+0000","last_active":"2024-09-12T19:28:25.268945+0000","last_peered":"2024-09-12T19:28:25.268945+0000","last_clean":"2024-09-12T19:28:25.268945+0000","last_became_active":"2024-09-12T17:58:47.236237+0000","last_became_peered":"2024-09-12T17:58:47.236237+0000","last_unstale":"2024-09-12T19:28:25.268945+0000","last_undegraded":"2024-09-12T19:28:25.268945+0000","last_fullsized":"2024-09-12T19:28:25.268945+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:34.439221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'8","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.732882+0000","last_change":"2024-09-12T17:58:40.207822+0000","last_active":"2024-09-12T19:29:41.732882+0000","last_peered":"2024-09-12T19:29:41.732882+0000","last_clean":"2024-09-12T19:29:41.732882+0000","last_became_active":"2024-09-12T17:58:40.207179+0000","last_became_peered":"2024-09-12T17:58:40.207179+0000","last_unstale":"2024-09-12T19:29:41.732882+0000","last_undegraded":"2024-09-12T19:29:41.732882+0000","last_fullsized":"2024-09-12T19:29:41.732882+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:00.148566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'9","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.250774+0000","last_change":"2024-09-12T17:52:39.884615+0000","last_active":"2024-09-12T19:27:05.250774+0000","last_peered":"2024-09-12T19:27:05.250774+0000","last_clean":"2024-09-12T19:27:05.250774+0000","last_became_active":"2024-09-12T17:52:39.883782+0000","last_became_peered":"2024-09-12T17:52:39.883782+0000","last_unstale":"2024-09-12T19:27:05.250774+0000","last_undegraded":"2024-09-12T19:27:05.250774+0000","last_fullsized":"2024-09-12T19:27:05.250774+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:22.293480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'340","reported_seq":1126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.399985+0000","last_change":"2024-09-12T19:29:55.399985+0000","last_active":"2024-09-12T19:29:55.399985+0000","last_peered":"2024-09-12T19:29:55.399985+0000","last_clean":"2024-09-12T19:29:55.399985+0000","last_became_active":"2024-09-12T17:36:34.874529+0000","last_became_peered":"2024-09-12T17:36:34.874529+0000","last_unstale":"2024-09-12T19:29:55.399985+0000","last_undegraded":"2024-09-12T19:29:55.399985+0000","last_fullsized":"2024-09-12T19:29:55.399985+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T19:29:55.399703+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T19:29:55.399703+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.399703+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:53.827613+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424460,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":579,"num_read_kb":47675,"num_write":1041,"num_write_kb":57869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'949","reported_seq":2628,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.911343+0000","last_change":"2024-09-12T19:29:59.911343+0000","last_active":"2024-09-12T19:29:59.911343+0000","last_peered":"2024-09-12T19:29:59.911343+0000","last_clean":"2024-09-12T19:29:59.911343+0000","last_became_active":"2024-09-12T17:36:36.881586+0000","last_became_peered":"2024-09-12T17:36:36.881586+0000","last_unstale":"2024-09-12T19:29:59.911343+0000","last_undegraded":"2024-09-12T19:29:59.911343+0000","last_fullsized":"2024-09-12T19:29:59.911343+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'949","last_scrub_stamp":"2024-09-12T19:29:59.911151+0000","last_deep_scrub":"265'949","last_deep_scrub_stamp":"2024-09-12T19:29:59.911151+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.911151+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:42.321351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4539,"num_read_kb":4030,"num_write":1302,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'367","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.972021+0000","last_change":"2024-09-12T19:30:00.972021+0000","last_active":"2024-09-12T19:30:00.972021+0000","last_peered":"2024-09-12T19:30:00.972021+0000","last_clean":"2024-09-12T19:30:00.972021+0000","last_became_active":"2024-09-12T17:36:34.886040+0000","last_became_peered":"2024-09-12T17:36:34.886040+0000","last_unstale":"2024-09-12T19:30:00.972021+0000","last_undegraded":"2024-09-12T19:30:00.972021+0000","last_fullsized":"2024-09-12T19:30:00.972021+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T19:30:00.971806+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T19:30:00.971806+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.971806+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:45.651742+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1749425,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":512,"num_read_kb":42124,"num_write":1111,"num_write_kb":49494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'796","reported_seq":2316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.047571+0000","last_change":"2024-09-12T17:36:36.875611+0000","last_active":"2024-09-12T19:29:21.047571+0000","last_peered":"2024-09-12T19:29:21.047571+0000","last_clean":"2024-09-12T19:29:21.047571+0000","last_became_active":"2024-09-12T17:36:36.875285+0000","last_became_peered":"2024-09-12T17:36:36.875285+0000","last_unstale":"2024-09-12T19:29:21.047571+0000","last_undegraded":"2024-09-12T19:29:21.047571+0000","last_fullsized":"2024-09-12T19:29:21.047571+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:54.905863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3836,"num_read_kb":3465,"num_write":1049,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'352","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.961930+0000","last_change":"2024-09-12T19:29:59.961930+0000","last_active":"2024-09-12T19:29:59.961930+0000","last_peered":"2024-09-12T19:29:59.961930+0000","last_clean":"2024-09-12T19:29:59.961930+0000","last_became_active":"2024-09-12T17:36:34.871993+0000","last_became_peered":"2024-09-12T17:36:34.871993+0000","last_unstale":"2024-09-12T19:29:59.961930+0000","last_undegraded":"2024-09-12T19:29:59.961930+0000","last_fullsized":"2024-09-12T19:29:59.961930+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:29:59.961681+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:29:59.961681+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.961681+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:19.644655+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":16153,"num_write":1071,"num_write_kb":33332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'911","reported_seq":2448,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:53.304327+0000","last_change":"2024-09-12T17:36:36.885378+0000","last_active":"2024-09-12T19:26:53.304327+0000","last_peered":"2024-09-12T19:26:53.304327+0000","last_clean":"2024-09-12T19:26:53.304327+0000","last_became_active":"2024-09-12T17:36:36.883008+0000","last_became_peered":"2024-09-12T17:36:36.883008+0000","last_unstale":"2024-09-12T19:26:53.304327+0000","last_undegraded":"2024-09-12T19:26:53.304327+0000","last_fullsized":"2024-09-12T19:26:53.304327+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":900,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:58.093073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4392,"num_read_kb":3928,"num_write":1272,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'362","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.324843+0000","last_change":"2024-09-12T19:29:54.324843+0000","last_active":"2024-09-12T19:29:54.324843+0000","last_peered":"2024-09-12T19:29:54.324843+0000","last_clean":"2024-09-12T19:29:54.324843+0000","last_became_active":"2024-09-12T17:36:34.871414+0000","last_became_peered":"2024-09-12T17:36:34.871414+0000","last_unstale":"2024-09-12T19:29:54.324843+0000","last_undegraded":"2024-09-12T19:29:54.324843+0000","last_fullsized":"2024-09-12T19:29:54.324843+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T19:29:54.324634+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T19:29:54.324634+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.324634+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:16.548675+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":504,"num_read_kb":53693,"num_write":1108,"num_write_kb":40210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'837","reported_seq":2351,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.887607+0000","last_change":"2024-09-12T19:30:02.887607+0000","last_active":"2024-09-12T19:30:02.887607+0000","last_peered":"2024-09-12T19:30:02.887607+0000","last_clean":"2024-09-12T19:30:02.887607+0000","last_became_active":"2024-09-12T17:36:36.902241+0000","last_became_peered":"2024-09-12T17:36:36.902241+0000","last_unstale":"2024-09-12T19:30:02.887607+0000","last_undegraded":"2024-09-12T19:30:02.887607+0000","last_fullsized":"2024-09-12T19:30:02.887607+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'837","last_scrub_stamp":"2024-09-12T19:30:02.887424+0000","last_deep_scrub":"265'837","last_deep_scrub_stamp":"2024-09-12T19:30:02.887424+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.887424+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:23.336621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3905,"num_read_kb":3484,"num_write":1127,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'353","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.348805+0000","last_change":"2024-09-12T19:29:53.348805+0000","last_active":"2024-09-12T19:29:53.348805+0000","last_peered":"2024-09-12T19:29:53.348805+0000","last_clean":"2024-09-12T19:29:53.348805+0000","last_became_active":"2024-09-12T17:36:34.890281+0000","last_became_peered":"2024-09-12T17:36:34.890281+0000","last_unstale":"2024-09-12T19:29:53.348805+0000","last_undegraded":"2024-09-12T19:29:53.348805+0000","last_fullsized":"2024-09-12T19:29:53.348805+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T19:29:53.348577+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T19:29:53.348577+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.348577+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:20.759997+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":533,"num_read_kb":3791,"num_write":1159,"num_write_kb":30376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'485","reported_seq":2186,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.381971+0000","last_change":"2024-09-12T19:30:00.381971+0000","last_active":"2024-09-12T19:30:00.381971+0000","last_peered":"2024-09-12T19:30:00.381971+0000","last_clean":"2024-09-12T19:30:00.381971+0000","last_became_active":"2024-09-12T17:36:36.899249+0000","last_became_peered":"2024-09-12T17:36:36.899249+0000","last_unstale":"2024-09-12T19:30:00.381971+0000","last_undegraded":"2024-09-12T19:30:00.381971+0000","last_fullsized":"2024-09-12T19:30:00.381971+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'485","last_scrub_stamp":"2024-09-12T19:30:00.381780+0000","last_deep_scrub":"265'485","last_deep_scrub_stamp":"2024-09-12T19:30:00.381780+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.381780+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:44.920189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2730,"num_read_kb":2583,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":918,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'378","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.372662+0000","last_change":"2024-09-12T19:29:51.372662+0000","last_active":"2024-09-12T19:29:51.372662+0000","last_peered":"2024-09-12T19:29:51.372662+0000","last_clean":"2024-09-12T19:29:51.372662+0000","last_became_active":"2024-09-12T17:36:34.870994+0000","last_became_peered":"2024-09-12T17:36:34.870994+0000","last_unstale":"2024-09-12T19:29:51.372662+0000","last_undegraded":"2024-09-12T19:29:51.372662+0000","last_fullsized":"2024-09-12T19:29:51.372662+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:29:51.372428+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:29:51.372428+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.372428+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:45.220775+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526411,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":2344,"num_write":1206,"num_write_kb":29584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'377","reported_seq":1837,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.408879+0000","last_change":"2024-09-12T19:30:01.408879+0000","last_active":"2024-09-12T19:30:01.408879+0000","last_peered":"2024-09-12T19:30:01.408879+0000","last_clean":"2024-09-12T19:30:01.408879+0000","last_became_active":"2024-09-12T17:36:36.897609+0000","last_became_peered":"2024-09-12T17:36:36.897609+0000","last_unstale":"2024-09-12T19:30:01.408879+0000","last_undegraded":"2024-09-12T19:30:01.408879+0000","last_fullsized":"2024-09-12T19:30:01.408879+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:30:01.408689+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:30:01.408689+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.408689+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:12.740346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2010,"num_read_kb":1904,"num_write":440,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'357","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.390280+0000","last_change":"2024-09-12T19:29:52.390280+0000","last_active":"2024-09-12T19:29:52.390280+0000","last_peered":"2024-09-12T19:29:52.390280+0000","last_clean":"2024-09-12T19:29:52.390280+0000","last_became_active":"2024-09-12T17:36:34.859023+0000","last_became_peered":"2024-09-12T17:36:34.859023+0000","last_unstale":"2024-09-12T19:29:52.390280+0000","last_undegraded":"2024-09-12T19:29:52.390280+0000","last_fullsized":"2024-09-12T19:29:52.390280+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'357","last_scrub_stamp":"2024-09-12T19:29:52.390106+0000","last_deep_scrub":"265'357","last_deep_scrub_stamp":"2024-09-12T19:29:52.390106+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.390106+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:22.736379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136901,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1894,"num_write":1220,"num_write_kb":19389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'837","reported_seq":2386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.416629+0000","last_change":"2024-09-12T19:30:01.416629+0000","last_active":"2024-09-12T19:30:01.416629+0000","last_peered":"2024-09-12T19:30:01.416629+0000","last_clean":"2024-09-12T19:30:01.416629+0000","last_became_active":"2024-09-12T17:36:36.914366+0000","last_became_peered":"2024-09-12T17:36:36.914366+0000","last_unstale":"2024-09-12T19:30:01.416629+0000","last_undegraded":"2024-09-12T19:30:01.416629+0000","last_fullsized":"2024-09-12T19:30:01.416629+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'837","last_scrub_stamp":"2024-09-12T19:30:01.416434+0000","last_deep_scrub":"265'837","last_deep_scrub_stamp":"2024-09-12T19:30:01.416434+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.416434+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:32.496350+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4038,"num_read_kb":3626,"num_write":1143,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'347","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.927870+0000","last_change":"2024-09-12T19:29:58.927870+0000","last_active":"2024-09-12T19:29:58.927870+0000","last_peered":"2024-09-12T19:29:58.927870+0000","last_clean":"2024-09-12T19:29:58.927870+0000","last_became_active":"2024-09-12T17:36:34.882704+0000","last_became_peered":"2024-09-12T17:36:34.882704+0000","last_unstale":"2024-09-12T19:29:58.927870+0000","last_undegraded":"2024-09-12T19:29:58.927870+0000","last_fullsized":"2024-09-12T19:29:58.927870+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:29:58.927579+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:29:58.927579+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.927579+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:30.908682+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2535846,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":64003,"num_write":1113,"num_write_kb":46422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1166","reported_seq":2735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.261311+0000","last_change":"2024-09-12T17:36:36.889657+0000","last_active":"2024-09-12T19:27:05.261311+0000","last_peered":"2024-09-12T19:27:05.261311+0000","last_clean":"2024-09-12T19:27:05.261311+0000","last_became_active":"2024-09-12T17:36:36.888829+0000","last_became_peered":"2024-09-12T17:36:36.888829+0000","last_unstale":"2024-09-12T19:27:05.261311+0000","last_undegraded":"2024-09-12T19:27:05.261311+0000","last_fullsized":"2024-09-12T19:27:05.261311+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:42.143143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5211,"num_read_kb":4613,"num_write":1589,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'494","reported_seq":2221,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.181954+0000","last_change":"2024-09-12T17:36:36.905062+0000","last_active":"2024-09-12T19:27:10.181954+0000","last_peered":"2024-09-12T19:27:10.181954+0000","last_clean":"2024-09-12T19:27:10.181954+0000","last_became_active":"2024-09-12T17:36:36.904820+0000","last_became_peered":"2024-09-12T17:36:36.904820+0000","last_unstale":"2024-09-12T19:27:10.181954+0000","last_undegraded":"2024-09-12T19:27:10.181954+0000","last_fullsized":"2024-09-12T19:27:10.181954+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:38.103419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2913,"num_read_kb":2753,"num_write":585,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'374","reported_seq":1112,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.902000+0000","last_change":"2024-09-12T19:29:51.902000+0000","last_active":"2024-09-12T19:29:51.902000+0000","last_peered":"2024-09-12T19:29:51.902000+0000","last_clean":"2024-09-12T19:29:51.902000+0000","last_became_active":"2024-09-12T17:36:34.866283+0000","last_became_peered":"2024-09-12T17:36:34.866283+0000","last_unstale":"2024-09-12T19:29:51.902000+0000","last_undegraded":"2024-09-12T19:29:51.902000+0000","last_fullsized":"2024-09-12T19:29:51.902000+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T19:29:51.901740+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T19:29:51.901740+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.901740+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:07.400270+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":73276,"num_write":1099,"num_write_kb":24135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'481","reported_seq":2104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.336855+0000","last_change":"2024-09-12T19:29:58.336855+0000","last_active":"2024-09-12T19:29:58.336855+0000","last_peered":"2024-09-12T19:29:58.336855+0000","last_clean":"2024-09-12T19:29:58.336855+0000","last_became_active":"2024-09-12T17:36:36.911310+0000","last_became_peered":"2024-09-12T17:36:36.911310+0000","last_unstale":"2024-09-12T19:29:58.336855+0000","last_undegraded":"2024-09-12T19:29:58.336855+0000","last_fullsized":"2024-09-12T19:29:58.336855+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'481","last_scrub_stamp":"2024-09-12T19:29:58.336665+0000","last_deep_scrub":"265'481","last_deep_scrub_stamp":"2024-09-12T19:29:58.336665+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.336665+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:39.578088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2526,"num_read_kb":2384,"num_write":531,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'354","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.369352+0000","last_change":"2024-09-12T19:29:50.369352+0000","last_active":"2024-09-12T19:29:50.369352+0000","last_peered":"2024-09-12T19:29:50.369352+0000","last_clean":"2024-09-12T19:29:50.369352+0000","last_became_active":"2024-09-12T17:36:34.865119+0000","last_became_peered":"2024-09-12T17:36:34.865119+0000","last_unstale":"2024-09-12T19:29:50.369352+0000","last_undegraded":"2024-09-12T19:29:50.369352+0000","last_fullsized":"2024-09-12T19:29:50.369352+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T19:29:50.369148+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T19:29:50.369148+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.369148+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:22.772611+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109517,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":573,"num_read_kb":7316,"num_write":1055,"num_write_kb":28671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'739","reported_seq":2238,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.837232+0000","last_change":"2024-09-12T19:29:57.837232+0000","last_active":"2024-09-12T19:29:57.837232+0000","last_peered":"2024-09-12T19:29:57.837232+0000","last_clean":"2024-09-12T19:29:57.837232+0000","last_became_active":"2024-09-12T17:36:36.885876+0000","last_became_peered":"2024-09-12T17:36:36.885876+0000","last_unstale":"2024-09-12T19:29:57.837232+0000","last_undegraded":"2024-09-12T19:29:57.837232+0000","last_fullsized":"2024-09-12T19:29:57.837232+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'739","last_scrub_stamp":"2024-09-12T19:29:57.837032+0000","last_deep_scrub":"265'739","last_deep_scrub_stamp":"2024-09-12T19:29:57.837032+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.837032+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:40.240565+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3432,"num_read_kb":3117,"num_write":958,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1010,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'391","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.371239+0000","last_change":"2024-09-12T19:29:54.371239+0000","last_active":"2024-09-12T19:29:54.371239+0000","last_peered":"2024-09-12T19:29:54.371239+0000","last_clean":"2024-09-12T19:29:54.371239+0000","last_became_active":"2024-09-12T17:36:34.873456+0000","last_became_peered":"2024-09-12T17:36:34.873456+0000","last_unstale":"2024-09-12T19:29:54.371239+0000","last_undegraded":"2024-09-12T19:29:54.371239+0000","last_fullsized":"2024-09-12T19:29:54.371239+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:29:54.371023+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:29:54.371023+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.371023+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:54.568742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":11973,"num_write":1244,"num_write_kb":23205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'621","reported_seq":2315,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.478221+0000","last_change":"2024-09-12T19:29:59.478221+0000","last_active":"2024-09-12T19:29:59.478221+0000","last_peered":"2024-09-12T19:29:59.478221+0000","last_clean":"2024-09-12T19:29:59.478221+0000","last_became_active":"2024-09-12T17:36:36.899850+0000","last_became_peered":"2024-09-12T17:36:36.899850+0000","last_unstale":"2024-09-12T19:29:59.478221+0000","last_undegraded":"2024-09-12T19:29:59.478221+0000","last_fullsized":"2024-09-12T19:29:59.478221+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'621","last_scrub_stamp":"2024-09-12T19:29:59.477997+0000","last_deep_scrub":"265'621","last_deep_scrub_stamp":"2024-09-12T19:29:59.477997+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.477997+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":600,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:01.602724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3224,"num_read_kb":2959,"num_write":847,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'342","reported_seq":1064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.452837+0000","last_change":"2024-09-12T19:29:48.452837+0000","last_active":"2024-09-12T19:29:48.452837+0000","last_peered":"2024-09-12T19:29:48.452837+0000","last_clean":"2024-09-12T19:29:48.452837+0000","last_became_active":"2024-09-12T17:36:34.864547+0000","last_became_peered":"2024-09-12T17:36:34.864547+0000","last_unstale":"2024-09-12T19:29:48.452837+0000","last_undegraded":"2024-09-12T19:29:48.452837+0000","last_fullsized":"2024-09-12T19:29:48.452837+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:48.452700+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:48.452700+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.452700+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:14.375143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":555,"num_read_kb":20889,"num_write":1050,"num_write_kb":32386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'297","reported_seq":1673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.565486+0000","last_change":"2024-09-12T17:36:36.875932+0000","last_active":"2024-09-12T19:28:02.565486+0000","last_peered":"2024-09-12T19:28:02.565486+0000","last_clean":"2024-09-12T19:28:02.565486+0000","last_became_active":"2024-09-12T17:36:36.873937+0000","last_became_peered":"2024-09-12T17:36:36.873937+0000","last_unstale":"2024-09-12T19:28:02.565486+0000","last_undegraded":"2024-09-12T19:28:02.565486+0000","last_fullsized":"2024-09-12T19:28:02.565486+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:57.251507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1689,"num_read_kb":1636,"num_write":323,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'377","reported_seq":1149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.359265+0000","last_change":"2024-09-12T19:29:54.358988+0000","last_active":"2024-09-12T19:29:54.359265+0000","last_peered":"2024-09-12T19:29:54.359265+0000","last_clean":"2024-09-12T19:29:54.359265+0000","last_became_active":"2024-09-12T17:36:34.880986+0000","last_became_peered":"2024-09-12T17:36:34.880986+0000","last_unstale":"2024-09-12T19:29:54.359265+0000","last_undegraded":"2024-09-12T19:29:54.359265+0000","last_fullsized":"2024-09-12T19:29:54.359265+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:29:54.358664+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:29:54.358664+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.358664+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:38.007979+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1802093,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":10570,"num_write":1059,"num_write_kb":33432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'405","reported_seq":1901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.869837+0000","last_change":"2024-09-12T19:29:58.869837+0000","last_active":"2024-09-12T19:29:58.869837+0000","last_peered":"2024-09-12T19:29:58.869837+0000","last_clean":"2024-09-12T19:29:58.869837+0000","last_became_active":"2024-09-12T17:36:36.881228+0000","last_became_peered":"2024-09-12T17:36:36.881228+0000","last_unstale":"2024-09-12T19:29:58.869837+0000","last_undegraded":"2024-09-12T19:29:58.869837+0000","last_fullsized":"2024-09-12T19:29:58.869837+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T19:29:58.869637+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T19:29:58.869637+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.869637+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.969680+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2076,"num_read_kb":1970,"num_write":455,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'419","reported_seq":1188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.348394+0000","last_change":"2024-09-12T19:29:52.348394+0000","last_active":"2024-09-12T19:29:52.348394+0000","last_peered":"2024-09-12T19:29:52.348394+0000","last_clean":"2024-09-12T19:29:52.348394+0000","last_became_active":"2024-09-12T17:36:34.878377+0000","last_became_peered":"2024-09-12T17:36:34.878377+0000","last_unstale":"2024-09-12T19:29:52.348394+0000","last_undegraded":"2024-09-12T19:29:52.348394+0000","last_fullsized":"2024-09-12T19:29:52.348394+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'419","last_scrub_stamp":"2024-09-12T19:29:52.348210+0000","last_deep_scrub":"265'419","last_deep_scrub_stamp":"2024-09-12T19:29:52.348210+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.348210+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:42.321093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":879,"num_read_kb":13596,"num_write":1342,"num_write_kb":22678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'109","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.849979+0000","last_change":"2024-09-12T17:36:44.936393+0000","last_active":"2024-09-12T19:28:02.849979+0000","last_peered":"2024-09-12T19:28:02.849979+0000","last_clean":"2024-09-12T19:28:02.849979+0000","last_became_active":"2024-09-12T17:36:44.934662+0000","last_became_peered":"2024-09-12T17:36:44.934662+0000","last_unstale":"2024-09-12T19:28:02.849979+0000","last_undegraded":"2024-09-12T19:28:02.849979+0000","last_fullsized":"2024-09-12T19:28:02.849979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:30.459321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'641","reported_seq":2298,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.452960+0000","last_change":"2024-09-12T19:30:00.452960+0000","last_active":"2024-09-12T19:30:00.452960+0000","last_peered":"2024-09-12T19:30:00.452960+0000","last_clean":"2024-09-12T19:30:00.452960+0000","last_became_active":"2024-09-12T17:36:36.913372+0000","last_became_peered":"2024-09-12T17:36:36.913372+0000","last_unstale":"2024-09-12T19:30:00.452960+0000","last_undegraded":"2024-09-12T19:30:00.452960+0000","last_fullsized":"2024-09-12T19:30:00.452960+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'641","last_scrub_stamp":"2024-09-12T19:30:00.452763+0000","last_deep_scrub":"265'641","last_deep_scrub_stamp":"2024-09-12T19:30:00.452763+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.452763+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:12.971289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3256,"num_read_kb":2969,"num_write":868,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'399","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.175382+0000","last_change":"2024-09-12T19:29:57.175382+0000","last_active":"2024-09-12T19:29:57.175382+0000","last_peered":"2024-09-12T19:29:57.175382+0000","last_clean":"2024-09-12T19:29:57.175382+0000","last_became_active":"2024-09-12T17:36:34.865894+0000","last_became_peered":"2024-09-12T17:36:34.865894+0000","last_unstale":"2024-09-12T19:29:57.175382+0000","last_undegraded":"2024-09-12T19:29:57.175382+0000","last_fullsized":"2024-09-12T19:29:57.175382+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'399","last_scrub_stamp":"2024-09-12T19:29:57.175150+0000","last_deep_scrub":"265'399","last_deep_scrub_stamp":"2024-09-12T19:29:57.175150+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.175150+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:47.227408+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661307,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":35668,"num_write":1342,"num_write_kb":51737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.340265+0000","last_change":"2024-09-12T17:36:38.881794+0000","last_active":"2024-09-12T19:25:25.340265+0000","last_peered":"2024-09-12T19:25:25.340265+0000","last_clean":"2024-09-12T19:25:25.340265+0000","last_became_active":"2024-09-12T17:36:38.881044+0000","last_became_peered":"2024-09-12T17:36:38.881044+0000","last_unstale":"2024-09-12T19:25:25.340265+0000","last_undegraded":"2024-09-12T19:25:25.340265+0000","last_fullsized":"2024-09-12T19:25:25.340265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:18.605129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'386","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.075230+0000","last_change":"2024-09-12T17:36:40.907618+0000","last_active":"2024-09-12T19:29:42.075230+0000","last_peered":"2024-09-12T19:29:42.075230+0000","last_clean":"2024-09-12T19:29:42.075230+0000","last_became_active":"2024-09-12T17:36:40.906825+0000","last_became_peered":"2024-09-12T17:36:40.906825+0000","last_unstale":"2024-09-12T19:29:42.075230+0000","last_undegraded":"2024-09-12T19:29:42.075230+0000","last_fullsized":"2024-09-12T19:29:42.075230+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:34.227775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":626,"num_read_kb":1284,"num_write":492,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.073133+0000","last_change":"2024-09-12T17:36:42.929571+0000","last_active":"2024-09-12T19:25:30.073133+0000","last_peered":"2024-09-12T19:25:30.073133+0000","last_clean":"2024-09-12T19:25:30.073133+0000","last_became_active":"2024-09-12T17:36:42.928794+0000","last_became_peered":"2024-09-12T17:36:42.928794+0000","last_unstale":"2024-09-12T19:25:30.073133+0000","last_undegraded":"2024-09-12T19:25:30.073133+0000","last_fullsized":"2024-09-12T19:25:30.073133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:22.503558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'168","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.748607+0000","last_change":"2024-09-12T17:36:44.941028+0000","last_active":"2024-09-12T19:29:20.748607+0000","last_peered":"2024-09-12T19:29:20.748607+0000","last_clean":"2024-09-12T19:29:20.748607+0000","last_became_active":"2024-09-12T17:36:44.939447+0000","last_became_peered":"2024-09-12T17:36:44.939447+0000","last_unstale":"2024-09-12T19:29:20.748607+0000","last_undegraded":"2024-09-12T19:29:20.748607+0000","last_fullsized":"2024-09-12T19:29:20.748607+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:17.779839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":297,"num_read_kb":283,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'450","reported_seq":1944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.054779+0000","last_change":"2024-09-12T17:36:36.876325+0000","last_active":"2024-09-12T19:29:21.054779+0000","last_peered":"2024-09-12T19:29:21.054779+0000","last_clean":"2024-09-12T19:29:21.054779+0000","last_became_active":"2024-09-12T17:36:36.875459+0000","last_became_peered":"2024-09-12T17:36:36.875459+0000","last_unstale":"2024-09-12T19:29:21.054779+0000","last_undegraded":"2024-09-12T19:29:21.054779+0000","last_fullsized":"2024-09-12T19:29:21.054779+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.726119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2269,"num_read_kb":2126,"num_write":529,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'324","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.310812+0000","last_change":"2024-09-12T19:29:51.310812+0000","last_active":"2024-09-12T19:29:51.310812+0000","last_peered":"2024-09-12T19:29:51.310812+0000","last_clean":"2024-09-12T19:29:51.310812+0000","last_became_active":"2024-09-12T17:36:34.880644+0000","last_became_peered":"2024-09-12T17:36:34.880644+0000","last_unstale":"2024-09-12T19:29:51.310812+0000","last_undegraded":"2024-09-12T19:29:51.310812+0000","last_fullsized":"2024-09-12T19:29:51.310812+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T19:29:51.310611+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T19:29:51.310611+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.310611+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:42.392409+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174790,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":12215,"num_write":1010,"num_write_kb":18682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686717+0000","last_change":"2024-09-12T17:36:38.901489+0000","last_active":"2024-09-12T19:26:40.686717+0000","last_peered":"2024-09-12T19:26:40.686717+0000","last_clean":"2024-09-12T19:26:40.686717+0000","last_became_active":"2024-09-12T17:36:38.900684+0000","last_became_peered":"2024-09-12T17:36:38.900684+0000","last_unstale":"2024-09-12T19:26:40.686717+0000","last_undegraded":"2024-09-12T19:26:40.686717+0000","last_fullsized":"2024-09-12T19:26:40.686717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:05.502369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'126","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:31.644856+0000","last_change":"2024-09-12T17:36:40.900116+0000","last_active":"2024-09-12T19:27:31.644856+0000","last_peered":"2024-09-12T19:27:31.644856+0000","last_clean":"2024-09-12T19:27:31.644856+0000","last_became_active":"2024-09-12T17:36:40.899340+0000","last_became_peered":"2024-09-12T17:36:40.899340+0000","last_unstale":"2024-09-12T19:27:31.644856+0000","last_undegraded":"2024-09-12T19:27:31.644856+0000","last_fullsized":"2024-09-12T19:27:31.644856+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:14.476334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.073064+0000","last_change":"2024-09-12T17:36:42.932966+0000","last_active":"2024-09-12T19:25:30.073064+0000","last_peered":"2024-09-12T19:25:30.073064+0000","last_clean":"2024-09-12T19:25:30.073064+0000","last_became_active":"2024-09-12T17:36:42.932100+0000","last_became_peered":"2024-09-12T17:36:42.932100+0000","last_unstale":"2024-09-12T19:25:30.073064+0000","last_undegraded":"2024-09-12T19:25:30.073064+0000","last_fullsized":"2024-09-12T19:25:30.073064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:17.207909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'122","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:58.466580+0000","last_change":"2024-09-12T17:36:44.966580+0000","last_active":"2024-09-12T19:27:58.466580+0000","last_peered":"2024-09-12T19:27:58.466580+0000","last_clean":"2024-09-12T19:27:58.466580+0000","last_became_active":"2024-09-12T17:36:44.965913+0000","last_became_peered":"2024-09-12T17:36:44.965913+0000","last_unstale":"2024-09-12T19:27:58.466580+0000","last_undegraded":"2024-09-12T19:27:58.466580+0000","last_fullsized":"2024-09-12T19:27:58.466580+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:05.954565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":210,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.952062+0000","last_change":"2024-09-12T19:30:03.952062+0000","last_active":"2024-09-12T19:30:03.952062+0000","last_peered":"2024-09-12T19:30:03.952062+0000","last_clean":"2024-09-12T19:30:03.952062+0000","last_became_active":"2024-09-12T17:36:36.904639+0000","last_became_peered":"2024-09-12T17:36:36.904639+0000","last_unstale":"2024-09-12T19:30:03.952062+0000","last_undegraded":"2024-09-12T19:30:03.952062+0000","last_fullsized":"2024-09-12T19:30:03.952062+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'401","last_scrub_stamp":"2024-09-12T19:30:03.951878+0000","last_deep_scrub":"265'401","last_deep_scrub_stamp":"2024-09-12T19:30:03.951878+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.951878+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:56.567132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2242,"num_read_kb":2124,"num_write":448,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'318","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.174934+0000","last_change":"2024-09-12T19:29:56.174934+0000","last_active":"2024-09-12T19:29:56.174934+0000","last_peered":"2024-09-12T19:29:56.174934+0000","last_clean":"2024-09-12T19:29:56.174934+0000","last_became_active":"2024-09-12T17:36:34.879098+0000","last_became_peered":"2024-09-12T17:36:34.879098+0000","last_unstale":"2024-09-12T19:29:56.174934+0000","last_undegraded":"2024-09-12T19:29:56.174934+0000","last_fullsized":"2024-09-12T19:29:56.174934+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T19:29:56.174676+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T19:29:56.174676+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.174676+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:55.215925+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763036,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":388,"num_read_kb":4507,"num_write":999,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.670087+0000","last_change":"2024-09-12T17:36:38.884358+0000","last_active":"2024-09-12T19:25:25.670087+0000","last_peered":"2024-09-12T19:25:25.670087+0000","last_clean":"2024-09-12T19:25:25.670087+0000","last_became_active":"2024-09-12T17:36:38.883758+0000","last_became_peered":"2024-09-12T17:36:38.883758+0000","last_unstale":"2024-09-12T19:25:25.670087+0000","last_undegraded":"2024-09-12T19:25:25.670087+0000","last_fullsized":"2024-09-12T19:25:25.670087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:23.851056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'185","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:33.286596+0000","last_change":"2024-09-12T17:36:40.908353+0000","last_active":"2024-09-12T19:27:33.286596+0000","last_peered":"2024-09-12T19:27:33.286596+0000","last_clean":"2024-09-12T19:27:33.286596+0000","last_became_active":"2024-09-12T17:36:40.907410+0000","last_became_peered":"2024-09-12T17:36:40.907410+0000","last_unstale":"2024-09-12T19:27:33.286596+0000","last_undegraded":"2024-09-12T19:27:33.286596+0000","last_fullsized":"2024-09-12T19:27:33.286596+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:48.613522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'805","reported_seq":7120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.284199+0000","last_change":"2024-09-12T17:36:42.918180+0000","last_active":"2024-09-12T19:29:42.284199+0000","last_peered":"2024-09-12T19:29:42.284199+0000","last_clean":"2024-09-12T19:29:42.284199+0000","last_became_active":"2024-09-12T17:36:42.916847+0000","last_became_peered":"2024-09-12T17:36:42.916847+0000","last_unstale":"2024-09-12T19:29:42.284199+0000","last_undegraded":"2024-09-12T19:29:42.284199+0000","last_fullsized":"2024-09-12T19:29:42.284199+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:45.795888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'223","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.042171+0000","last_change":"2024-09-12T17:36:44.958620+0000","last_active":"2024-09-12T19:28:03.042171+0000","last_peered":"2024-09-12T19:28:03.042171+0000","last_clean":"2024-09-12T19:28:03.042171+0000","last_became_active":"2024-09-12T17:36:44.954183+0000","last_became_peered":"2024-09-12T17:36:44.954183+0000","last_unstale":"2024-09-12T19:28:03.042171+0000","last_undegraded":"2024-09-12T19:28:03.042171+0000","last_fullsized":"2024-09-12T19:28:03.042171+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:52.168028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":505,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'460","reported_seq":2150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.958687+0000","last_change":"2024-09-12T19:30:04.958687+0000","last_active":"2024-09-12T19:30:04.958687+0000","last_peered":"2024-09-12T19:30:04.958687+0000","last_clean":"2024-09-12T19:30:04.958687+0000","last_became_active":"2024-09-12T17:36:36.877420+0000","last_became_peered":"2024-09-12T17:36:36.877420+0000","last_unstale":"2024-09-12T19:30:04.958687+0000","last_undegraded":"2024-09-12T19:30:04.958687+0000","last_fullsized":"2024-09-12T19:30:04.958687+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'460","last_scrub_stamp":"2024-09-12T19:30:04.958508+0000","last_deep_scrub":"265'460","last_deep_scrub_stamp":"2024-09-12T19:30:04.958508+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.958508+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:30.786563+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2635,"num_read_kb":2492,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2773,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'364","reported_seq":1082,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.902122+0000","last_change":"2024-09-12T19:29:48.902122+0000","last_active":"2024-09-12T19:29:48.902122+0000","last_peered":"2024-09-12T19:29:48.902122+0000","last_clean":"2024-09-12T19:29:48.902122+0000","last_became_active":"2024-09-12T17:36:34.882902+0000","last_became_peered":"2024-09-12T17:36:34.882902+0000","last_unstale":"2024-09-12T19:29:48.902122+0000","last_undegraded":"2024-09-12T19:29:48.902122+0000","last_fullsized":"2024-09-12T19:29:48.902122+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T19:29:48.902025+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T19:29:48.902025+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.902025+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:07.220628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":587,"num_read_kb":75125,"num_write":1046,"num_write_kb":28457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:25.340316+0000","last_change":"2024-09-12T17:36:38.899727+0000","last_active":"2024-09-12T19:25:25.340316+0000","last_peered":"2024-09-12T19:25:25.340316+0000","last_clean":"2024-09-12T19:25:25.340316+0000","last_became_active":"2024-09-12T17:36:38.899405+0000","last_became_peered":"2024-09-12T17:36:38.899405+0000","last_unstale":"2024-09-12T19:25:25.340316+0000","last_undegraded":"2024-09-12T19:25:25.340316+0000","last_fullsized":"2024-09-12T19:25:25.340316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:16.514700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'338","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.890794+0000","last_change":"2024-09-12T17:36:40.911431+0000","last_active":"2024-09-12T19:29:41.890794+0000","last_peered":"2024-09-12T19:29:41.890794+0000","last_clean":"2024-09-12T19:29:41.890794+0000","last_became_active":"2024-09-12T17:36:40.910700+0000","last_became_peered":"2024-09-12T17:36:40.910700+0000","last_unstale":"2024-09-12T19:29:41.890794+0000","last_undegraded":"2024-09-12T19:29:41.890794+0000","last_fullsized":"2024-09-12T19:29:41.890794+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:03.951315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54278,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":1174,"num_write":438,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'799","reported_seq":3156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.031256+0000","last_change":"2024-09-12T17:36:42.940750+0000","last_active":"2024-09-12T19:29:42.031256+0000","last_peered":"2024-09-12T19:29:42.031256+0000","last_clean":"2024-09-12T19:29:42.031256+0000","last_became_active":"2024-09-12T17:36:42.939966+0000","last_became_peered":"2024-09-12T17:36:42.939966+0000","last_unstale":"2024-09-12T19:29:42.031256+0000","last_undegraded":"2024-09-12T19:29:42.031256+0000","last_fullsized":"2024-09-12T19:29:42.031256+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:48.117866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'1125","reported_seq":2730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.116710+0000","last_change":"2024-09-12T17:36:36.886873+0000","last_active":"2024-09-12T19:28:32.116710+0000","last_peered":"2024-09-12T19:28:32.116710+0000","last_clean":"2024-09-12T19:28:32.116710+0000","last_became_active":"2024-09-12T17:36:36.886244+0000","last_became_peered":"2024-09-12T17:36:36.886244+0000","last_unstale":"2024-09-12T19:28:32.116710+0000","last_undegraded":"2024-09-12T19:28:32.116710+0000","last_fullsized":"2024-09-12T19:28:32.116710+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:16.947822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5270,"num_read_kb":4695,"num_write":1548,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'297","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:46.414341+0000","last_change":"2024-09-12T19:29:46.414341+0000","last_active":"2024-09-12T19:29:46.414341+0000","last_peered":"2024-09-12T19:29:46.414341+0000","last_clean":"2024-09-12T19:29:46.414341+0000","last_became_active":"2024-09-12T17:36:34.865417+0000","last_became_peered":"2024-09-12T17:36:34.865417+0000","last_unstale":"2024-09-12T19:29:46.414341+0000","last_undegraded":"2024-09-12T19:29:46.414341+0000","last_fullsized":"2024-09-12T19:29:46.414341+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'297","last_scrub_stamp":"2024-09-12T19:29:46.414141+0000","last_deep_scrub":"265'297","last_deep_scrub_stamp":"2024-09-12T19:29:46.414141+0000","last_clean_scrub_stamp":"2024-09-12T19:29:46.414141+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.995894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":517,"num_read_kb":1839,"num_write":970,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.875044+0000","last_change":"2024-09-12T19:30:00.875044+0000","last_active":"2024-09-12T19:30:00.875044+0000","last_peered":"2024-09-12T19:30:00.875044+0000","last_clean":"2024-09-12T19:30:00.875044+0000","last_became_active":"2024-09-12T17:36:38.887444+0000","last_became_peered":"2024-09-12T17:36:38.887444+0000","last_unstale":"2024-09-12T19:30:00.875044+0000","last_undegraded":"2024-09-12T19:30:00.875044+0000","last_fullsized":"2024-09-12T19:30:00.875044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:00.874795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:00.874795+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.874795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:17.895761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'448","reported_seq":1148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.224717+0000","last_change":"2024-09-12T17:36:40.914188+0000","last_active":"2024-09-12T19:29:42.224717+0000","last_peered":"2024-09-12T19:29:42.224717+0000","last_clean":"2024-09-12T19:29:42.224717+0000","last_became_active":"2024-09-12T17:36:40.911095+0000","last_became_peered":"2024-09-12T17:36:40.911095+0000","last_unstale":"2024-09-12T19:29:42.224717+0000","last_undegraded":"2024-09-12T19:29:42.224717+0000","last_fullsized":"2024-09-12T19:29:42.224717+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":738,"num_read_kb":1351,"num_write":556,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.049545+0000","last_change":"2024-09-12T17:36:42.928393+0000","last_active":"2024-09-12T19:26:59.049545+0000","last_peered":"2024-09-12T19:26:59.049545+0000","last_clean":"2024-09-12T19:26:59.049545+0000","last_became_active":"2024-09-12T17:36:42.927582+0000","last_became_peered":"2024-09-12T17:36:42.927582+0000","last_unstale":"2024-09-12T19:26:59.049545+0000","last_undegraded":"2024-09-12T19:26:59.049545+0000","last_fullsized":"2024-09-12T19:26:59.049545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:38.031907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'554","reported_seq":1399,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.053521+0000","last_change":"2024-09-12T17:36:44.958491+0000","last_active":"2024-09-12T19:29:22.053521+0000","last_peered":"2024-09-12T19:29:22.053521+0000","last_clean":"2024-09-12T19:29:22.053521+0000","last_became_active":"2024-09-12T17:36:44.953926+0000","last_became_peered":"2024-09-12T17:36:44.953926+0000","last_unstale":"2024-09-12T19:29:22.053521+0000","last_undegraded":"2024-09-12T19:29:22.053521+0000","last_fullsized":"2024-09-12T19:29:22.053521+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:32.984877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":1310,"num_write":1167,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'842","reported_seq":2553,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.908148+0000","last_change":"2024-09-12T19:29:52.908148+0000","last_active":"2024-09-12T19:29:52.908148+0000","last_peered":"2024-09-12T19:29:52.908148+0000","last_clean":"2024-09-12T19:29:52.908148+0000","last_became_active":"2024-09-12T17:36:36.886395+0000","last_became_peered":"2024-09-12T17:36:36.886395+0000","last_unstale":"2024-09-12T19:29:52.908148+0000","last_undegraded":"2024-09-12T19:29:52.908148+0000","last_fullsized":"2024-09-12T19:29:52.908148+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'842","last_scrub_stamp":"2024-09-12T19:29:52.907905+0000","last_deep_scrub":"265'842","last_deep_scrub_stamp":"2024-09-12T19:29:52.907905+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.907905+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.987128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4184,"num_read_kb":3783,"num_write":1092,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3245,"num_omap_keys":13,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'376","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.389093+0000","last_change":"2024-09-12T19:29:49.389093+0000","last_active":"2024-09-12T19:29:49.389093+0000","last_peered":"2024-09-12T19:29:49.389093+0000","last_clean":"2024-09-12T19:29:49.389093+0000","last_became_active":"2024-09-12T17:36:34.868465+0000","last_became_peered":"2024-09-12T17:36:34.868465+0000","last_unstale":"2024-09-12T19:29:49.389093+0000","last_undegraded":"2024-09-12T19:29:49.389093+0000","last_fullsized":"2024-09-12T19:29:49.389093+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:29:49.389019+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:29:49.389019+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.389019+0000","objects_scrubbed":8,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:59.981113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109619,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":2937,"num_write":1162,"num_write_kb":21558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"265'4","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.492624+0000","last_change":"2024-09-12T19:30:03.492624+0000","last_active":"2024-09-12T19:30:03.492624+0000","last_peered":"2024-09-12T19:30:03.492624+0000","last_clean":"2024-09-12T19:30:03.492624+0000","last_became_active":"2024-09-12T17:36:38.907007+0000","last_became_peered":"2024-09-12T17:36:38.907007+0000","last_unstale":"2024-09-12T19:30:03.492624+0000","last_undegraded":"2024-09-12T19:30:03.492624+0000","last_fullsized":"2024-09-12T19:30:03.492624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:03.492431+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:03.492431+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.492431+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:04.343424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'328","reported_seq":952,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.480005+0000","last_change":"2024-09-12T17:36:40.912235+0000","last_active":"2024-09-12T19:29:41.480005+0000","last_peered":"2024-09-12T19:29:41.480005+0000","last_clean":"2024-09-12T19:29:41.480005+0000","last_became_active":"2024-09-12T17:36:40.911092+0000","last_became_peered":"2024-09-12T17:36:40.911092+0000","last_unstale":"2024-09-12T19:29:41.480005+0000","last_undegraded":"2024-09-12T19:29:41.480005+0000","last_fullsized":"2024-09-12T19:29:41.480005+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:38.796270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1173,"num_write":436,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:35.698971+0000","last_change":"2024-09-12T17:36:42.937336+0000","last_active":"2024-09-12T19:27:35.698971+0000","last_peered":"2024-09-12T19:27:35.698971+0000","last_clean":"2024-09-12T19:27:35.698971+0000","last_became_active":"2024-09-12T17:36:42.933808+0000","last_became_peered":"2024-09-12T17:36:42.933808+0000","last_unstale":"2024-09-12T19:27:35.698971+0000","last_undegraded":"2024-09-12T19:27:35.698971+0000","last_fullsized":"2024-09-12T19:27:35.698971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:36.847620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'2432","reported_seq":4294,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:09.864804+0000","last_change":"2024-09-12T17:36:44.963412+0000","last_active":"2024-09-12T19:29:09.864804+0000","last_peered":"2024-09-12T19:29:09.864804+0000","last_clean":"2024-09-12T19:29:09.864804+0000","last_became_active":"2024-09-12T17:36:44.962630+0000","last_became_peered":"2024-09-12T17:36:44.962630+0000","last_unstale":"2024-09-12T19:29:09.864804+0000","last_undegraded":"2024-09-12T19:29:09.864804+0000","last_fullsized":"2024-09-12T19:29:09.864804+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6095,"num_read_kb":6091,"num_write":4930,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'435","reported_seq":2069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.391391+0000","last_change":"2024-09-12T19:29:56.391391+0000","last_active":"2024-09-12T19:29:56.391391+0000","last_peered":"2024-09-12T19:29:56.391391+0000","last_clean":"2024-09-12T19:29:56.391391+0000","last_became_active":"2024-09-12T17:36:36.880296+0000","last_became_peered":"2024-09-12T17:36:36.880296+0000","last_unstale":"2024-09-12T19:29:56.391391+0000","last_undegraded":"2024-09-12T19:29:56.391391+0000","last_fullsized":"2024-09-12T19:29:56.391391+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'435","last_scrub_stamp":"2024-09-12T19:29:56.391216+0000","last_deep_scrub":"265'435","last_deep_scrub_stamp":"2024-09-12T19:29:56.391216+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.391216+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:02.997123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2387,"num_read_kb":2259,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'355","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.142105+0000","last_change":"2024-09-12T19:29:55.142105+0000","last_active":"2024-09-12T19:29:55.142105+0000","last_peered":"2024-09-12T19:29:55.142105+0000","last_clean":"2024-09-12T19:29:55.142105+0000","last_became_active":"2024-09-12T17:36:34.868243+0000","last_became_peered":"2024-09-12T17:36:34.868243+0000","last_unstale":"2024-09-12T19:29:55.142105+0000","last_undegraded":"2024-09-12T19:29:55.142105+0000","last_fullsized":"2024-09-12T19:29:55.142105+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T19:29:55.141865+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T19:29:55.141865+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.141865+0000","objects_scrubbed":10,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:28.760677+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":550,"num_read_kb":48255,"num_write":1188,"num_write_kb":33494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258752+0000","last_change":"2024-09-12T17:36:38.893533+0000","last_active":"2024-09-12T19:26:55.258752+0000","last_peered":"2024-09-12T19:26:55.258752+0000","last_clean":"2024-09-12T19:26:55.258752+0000","last_became_active":"2024-09-12T17:36:38.892804+0000","last_became_peered":"2024-09-12T17:36:38.892804+0000","last_unstale":"2024-09-12T19:26:55.258752+0000","last_undegraded":"2024-09-12T19:26:55.258752+0000","last_fullsized":"2024-09-12T19:26:55.258752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:56.818407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'399","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.304851+0000","last_change":"2024-09-12T17:36:40.889733+0000","last_active":"2024-09-12T19:29:42.304851+0000","last_peered":"2024-09-12T19:29:42.304851+0000","last_clean":"2024-09-12T19:29:42.304851+0000","last_became_active":"2024-09-12T17:36:40.888974+0000","last_became_peered":"2024-09-12T17:36:40.888974+0000","last_unstale":"2024-09-12T19:29:42.304851+0000","last_undegraded":"2024-09-12T19:29:42.304851+0000","last_fullsized":"2024-09-12T19:29:42.304851+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:41.043970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45462,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":644,"num_read_kb":1295,"num_write":508,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'798","reported_seq":3044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.031283+0000","last_change":"2024-09-12T17:36:42.936433+0000","last_active":"2024-09-12T19:29:42.031283+0000","last_peered":"2024-09-12T19:29:42.031283+0000","last_clean":"2024-09-12T19:29:42.031283+0000","last_became_active":"2024-09-12T17:36:42.935529+0000","last_became_peered":"2024-09-12T17:36:42.935529+0000","last_unstale":"2024-09-12T19:29:42.031283+0000","last_undegraded":"2024-09-12T19:29:42.031283+0000","last_fullsized":"2024-09-12T19:29:42.031283+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:25.923124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'112","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.068420+0000","last_change":"2024-09-12T17:36:44.966442+0000","last_active":"2024-09-12T19:29:21.068420+0000","last_peered":"2024-09-12T19:29:21.068420+0000","last_clean":"2024-09-12T19:29:21.068420+0000","last_became_active":"2024-09-12T17:36:44.965763+0000","last_became_peered":"2024-09-12T17:36:44.965763+0000","last_unstale":"2024-09-12T19:29:21.068420+0000","last_undegraded":"2024-09-12T19:29:21.068420+0000","last_fullsized":"2024-09-12T19:29:21.068420+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:31.130717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":137,"num_write":264,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'415","reported_seq":1907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.921903+0000","last_change":"2024-09-12T19:30:01.921903+0000","last_active":"2024-09-12T19:30:01.921903+0000","last_peered":"2024-09-12T19:30:01.921903+0000","last_clean":"2024-09-12T19:30:01.921903+0000","last_became_active":"2024-09-12T17:36:36.905958+0000","last_became_peered":"2024-09-12T17:36:36.905958+0000","last_unstale":"2024-09-12T19:30:01.921903+0000","last_undegraded":"2024-09-12T19:30:01.921903+0000","last_fullsized":"2024-09-12T19:30:01.921903+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:30:01.921717+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:30:01.921717+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.921717+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:06.661883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":964,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'344","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.405949+0000","last_change":"2024-09-12T19:29:49.405949+0000","last_active":"2024-09-12T19:29:49.405949+0000","last_peered":"2024-09-12T19:29:49.405949+0000","last_clean":"2024-09-12T19:29:49.405949+0000","last_became_active":"2024-09-12T17:36:34.860828+0000","last_became_peered":"2024-09-12T17:36:34.860828+0000","last_unstale":"2024-09-12T19:29:49.405949+0000","last_undegraded":"2024-09-12T19:29:49.405949+0000","last_fullsized":"2024-09-12T19:29:49.405949+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T19:29:49.405847+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T19:29:49.405847+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.405847+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:37.116130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399137,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":452,"num_read_kb":18690,"num_write":1073,"num_write_kb":31228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.499917+0000","last_change":"2024-09-12T19:30:04.499917+0000","last_active":"2024-09-12T19:30:04.499917+0000","last_peered":"2024-09-12T19:30:04.499917+0000","last_clean":"2024-09-12T19:30:04.499917+0000","last_became_active":"2024-09-12T17:36:38.897189+0000","last_became_peered":"2024-09-12T17:36:38.897189+0000","last_unstale":"2024-09-12T19:30:04.499917+0000","last_undegraded":"2024-09-12T19:30:04.499917+0000","last_fullsized":"2024-09-12T19:30:04.499917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.499746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.499746+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.499746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:20.326081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'510","reported_seq":1198,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.375229+0000","last_change":"2024-09-12T17:36:40.907633+0000","last_active":"2024-09-12T19:29:42.375229+0000","last_peered":"2024-09-12T19:29:42.375229+0000","last_clean":"2024-09-12T19:29:42.375229+0000","last_became_active":"2024-09-12T17:36:40.906903+0000","last_became_peered":"2024-09-12T17:36:40.906903+0000","last_unstale":"2024-09-12T19:29:42.375229+0000","last_undegraded":"2024-09-12T19:29:42.375229+0000","last_fullsized":"2024-09-12T19:29:42.375229+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:36.733767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96745,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":901,"num_read_kb":2079,"num_write":726,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263489+0000","last_change":"2024-09-12T17:36:42.933877+0000","last_active":"2024-09-12T19:27:15.263489+0000","last_peered":"2024-09-12T19:27:15.263489+0000","last_clean":"2024-09-12T19:27:15.263489+0000","last_became_active":"2024-09-12T17:36:42.933168+0000","last_became_peered":"2024-09-12T17:36:42.933168+0000","last_unstale":"2024-09-12T19:27:15.263489+0000","last_undegraded":"2024-09-12T19:27:15.263489+0000","last_fullsized":"2024-09-12T19:27:15.263489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:13.861626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'159","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.676473+0000","last_change":"2024-09-12T17:36:44.961695+0000","last_active":"2024-09-12T19:27:15.676473+0000","last_peered":"2024-09-12T19:27:15.676473+0000","last_clean":"2024-09-12T19:27:15.676473+0000","last_became_active":"2024-09-12T17:36:44.960935+0000","last_became_peered":"2024-09-12T17:36:44.960935+0000","last_unstale":"2024-09-12T19:27:15.676473+0000","last_undegraded":"2024-09-12T19:27:15.676473+0000","last_fullsized":"2024-09-12T19:27:15.676473+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:20.892764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1322,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":195,"num_write":366,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1243","reported_seq":2932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.364754+0000","last_change":"2024-09-12T19:29:56.364754+0000","last_active":"2024-09-12T19:29:56.364754+0000","last_peered":"2024-09-12T19:29:56.364754+0000","last_clean":"2024-09-12T19:29:56.364754+0000","last_became_active":"2024-09-12T17:36:36.914518+0000","last_became_peered":"2024-09-12T17:36:36.914518+0000","last_unstale":"2024-09-12T19:29:56.364754+0000","last_undegraded":"2024-09-12T19:29:56.364754+0000","last_fullsized":"2024-09-12T19:29:56.364754+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1243","last_scrub_stamp":"2024-09-12T19:29:56.364560+0000","last_deep_scrub":"265'1243","last_deep_scrub_stamp":"2024-09-12T19:29:56.364560+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.364560+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:54.124223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5692,"num_read_kb":5056,"num_write":1732,"num_write_kb":743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'326","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.160320+0000","last_change":"2024-09-12T19:29:52.160320+0000","last_active":"2024-09-12T19:29:52.160320+0000","last_peered":"2024-09-12T19:29:52.160320+0000","last_clean":"2024-09-12T19:29:52.160320+0000","last_became_active":"2024-09-12T17:36:34.878896+0000","last_became_peered":"2024-09-12T17:36:34.878896+0000","last_unstale":"2024-09-12T19:29:52.160320+0000","last_undegraded":"2024-09-12T19:29:52.160320+0000","last_fullsized":"2024-09-12T19:29:52.160320+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'326","last_scrub_stamp":"2024-09-12T19:29:52.160042+0000","last_deep_scrub":"265'326","last_deep_scrub_stamp":"2024-09-12T19:29:52.160042+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.160042+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:02.198272+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":17715,"num_write":1042,"num_write_kb":23877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.101607+0000","last_change":"2024-09-12T19:30:04.101607+0000","last_active":"2024-09-12T19:30:04.101607+0000","last_peered":"2024-09-12T19:30:04.101607+0000","last_clean":"2024-09-12T19:30:04.101607+0000","last_became_active":"2024-09-12T17:36:38.907609+0000","last_became_peered":"2024-09-12T17:36:38.907609+0000","last_unstale":"2024-09-12T19:30:04.101607+0000","last_undegraded":"2024-09-12T19:30:04.101607+0000","last_fullsized":"2024-09-12T19:30:04.101607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.101422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.101422+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.101422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:43.456527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'361","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.650380+0000","last_change":"2024-09-12T17:36:40.895469+0000","last_active":"2024-09-12T19:29:41.650380+0000","last_peered":"2024-09-12T19:29:41.650380+0000","last_clean":"2024-09-12T19:29:41.650380+0000","last_became_active":"2024-09-12T17:36:40.893702+0000","last_became_peered":"2024-09-12T17:36:40.893702+0000","last_unstale":"2024-09-12T19:29:41.650380+0000","last_undegraded":"2024-09-12T19:29:41.650380+0000","last_fullsized":"2024-09-12T19:29:41.650380+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:52.727654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47801,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":608,"num_read_kb":1248,"num_write":530,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.677558+0000","last_change":"2024-09-12T17:36:42.939282+0000","last_active":"2024-09-12T19:27:20.677558+0000","last_peered":"2024-09-12T19:27:20.677558+0000","last_clean":"2024-09-12T19:27:20.677558+0000","last_became_active":"2024-09-12T17:36:42.938437+0000","last_became_peered":"2024-09-12T17:36:42.938437+0000","last_unstale":"2024-09-12T19:27:20.677558+0000","last_undegraded":"2024-09-12T19:27:20.677558+0000","last_fullsized":"2024-09-12T19:27:20.677558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:17.930519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'144","reported_seq":718,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:09.868344+0000","last_change":"2024-09-12T17:36:44.959709+0000","last_active":"2024-09-12T19:29:09.868344+0000","last_peered":"2024-09-12T19:29:09.868344+0000","last_clean":"2024-09-12T19:29:09.868344+0000","last_became_active":"2024-09-12T17:36:44.956645+0000","last_became_peered":"2024-09-12T17:36:44.956645+0000","last_unstale":"2024-09-12T19:29:09.868344+0000","last_undegraded":"2024-09-12T19:29:09.868344+0000","last_fullsized":"2024-09-12T19:29:09.868344+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.650537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":356,"num_read_kb":303,"num_write":346,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'499","reported_seq":2115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.117569+0000","last_change":"2024-09-12T17:36:36.882735+0000","last_active":"2024-09-12T19:28:32.117569+0000","last_peered":"2024-09-12T19:28:32.117569+0000","last_clean":"2024-09-12T19:28:32.117569+0000","last_became_active":"2024-09-12T17:36:36.881882+0000","last_became_peered":"2024-09-12T17:36:36.881882+0000","last_unstale":"2024-09-12T19:28:32.117569+0000","last_undegraded":"2024-09-12T19:28:32.117569+0000","last_fullsized":"2024-09-12T19:28:32.117569+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.005619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2445,"num_write":630,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'360","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.147330+0000","last_change":"2024-09-12T19:29:54.147330+0000","last_active":"2024-09-12T19:29:54.147330+0000","last_peered":"2024-09-12T19:29:54.147330+0000","last_clean":"2024-09-12T19:29:54.147330+0000","last_became_active":"2024-09-12T17:36:34.870021+0000","last_became_peered":"2024-09-12T17:36:34.870021+0000","last_unstale":"2024-09-12T19:29:54.147330+0000","last_undegraded":"2024-09-12T19:29:54.147330+0000","last_fullsized":"2024-09-12T19:29:54.147330+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T19:29:54.147094+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T19:29:54.147094+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.147094+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:37.219375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":14188,"num_write":1189,"num_write_kb":25082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258787+0000","last_change":"2024-09-12T17:36:38.893625+0000","last_active":"2024-09-12T19:26:55.258787+0000","last_peered":"2024-09-12T19:26:55.258787+0000","last_clean":"2024-09-12T19:26:55.258787+0000","last_became_active":"2024-09-12T17:36:38.892885+0000","last_became_peered":"2024-09-12T17:36:38.892885+0000","last_unstale":"2024-09-12T19:26:55.258787+0000","last_undegraded":"2024-09-12T19:26:55.258787+0000","last_fullsized":"2024-09-12T19:26:55.258787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:23.133743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'379","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.355333+0000","last_change":"2024-09-12T17:36:40.898503+0000","last_active":"2024-09-12T19:29:41.355333+0000","last_peered":"2024-09-12T19:29:41.355333+0000","last_clean":"2024-09-12T19:29:41.355333+0000","last_became_active":"2024-09-12T17:36:40.896733+0000","last_became_peered":"2024-09-12T17:36:40.896733+0000","last_unstale":"2024-09-12T19:29:41.355333+0000","last_undegraded":"2024-09-12T19:29:41.355333+0000","last_fullsized":"2024-09-12T19:29:41.355333+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:00.019536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60156,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1227,"num_write":470,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'770","reported_seq":3236,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.001508+0000","last_change":"2024-09-12T17:36:42.935306+0000","last_active":"2024-09-12T19:29:41.001508+0000","last_peered":"2024-09-12T19:29:41.001508+0000","last_clean":"2024-09-12T19:29:41.001508+0000","last_became_active":"2024-09-12T17:36:42.934582+0000","last_became_peered":"2024-09-12T17:36:42.934582+0000","last_unstale":"2024-09-12T19:29:41.001508+0000","last_undegraded":"2024-09-12T19:29:41.001508+0000","last_fullsized":"2024-09-12T19:29:41.001508+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.168171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'100","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.913618+0000","last_change":"2024-09-12T17:36:44.938502+0000","last_active":"2024-09-12T19:28:02.913618+0000","last_peered":"2024-09-12T19:28:02.913618+0000","last_clean":"2024-09-12T19:28:02.913618+0000","last_became_active":"2024-09-12T17:36:44.937368+0000","last_became_peered":"2024-09-12T17:36:44.937368+0000","last_unstale":"2024-09-12T19:28:02.913618+0000","last_undegraded":"2024-09-12T19:28:02.913618+0000","last_fullsized":"2024-09-12T19:28:02.913618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:33.490996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":224,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'655","reported_seq":2169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.360525+0000","last_change":"2024-09-12T19:29:55.360525+0000","last_active":"2024-09-12T19:29:55.360525+0000","last_peered":"2024-09-12T19:29:55.360525+0000","last_clean":"2024-09-12T19:29:55.360525+0000","last_became_active":"2024-09-12T17:36:36.883043+0000","last_became_peered":"2024-09-12T17:36:36.883043+0000","last_unstale":"2024-09-12T19:29:55.360525+0000","last_undegraded":"2024-09-12T19:29:55.360525+0000","last_fullsized":"2024-09-12T19:29:55.360525+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'655","last_scrub_stamp":"2024-09-12T19:29:55.360342+0000","last_deep_scrub":"265'655","last_deep_scrub_stamp":"2024-09-12T19:29:55.360342+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.360342+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:36.568704+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3181,"num_read_kb":2856,"num_write":918,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'393","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.103440+0000","last_change":"2024-09-12T19:29:53.103440+0000","last_active":"2024-09-12T19:29:53.103440+0000","last_peered":"2024-09-12T19:29:53.103440+0000","last_clean":"2024-09-12T19:29:53.103440+0000","last_became_active":"2024-09-12T17:36:34.873263+0000","last_became_peered":"2024-09-12T17:36:34.873263+0000","last_unstale":"2024-09-12T19:29:53.103440+0000","last_undegraded":"2024-09-12T19:29:53.103440+0000","last_fullsized":"2024-09-12T19:29:53.103440+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T19:29:53.103209+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T19:29:53.103209+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.103209+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:42.148875+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194346,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":21339,"num_write":1076,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.888492+0000","last_change":"2024-09-12T19:30:02.888492+0000","last_active":"2024-09-12T19:30:02.888492+0000","last_peered":"2024-09-12T19:30:02.888492+0000","last_clean":"2024-09-12T19:30:02.888492+0000","last_became_active":"2024-09-12T17:36:38.888795+0000","last_became_peered":"2024-09-12T17:36:38.888795+0000","last_unstale":"2024-09-12T19:30:02.888492+0000","last_undegraded":"2024-09-12T19:30:02.888492+0000","last_fullsized":"2024-09-12T19:30:02.888492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:02.888300+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:02.888300+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.888300+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:29.619911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'150","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.261761+0000","last_change":"2024-09-12T17:36:40.893833+0000","last_active":"2024-09-12T19:27:30.261761+0000","last_peered":"2024-09-12T19:27:30.261761+0000","last_clean":"2024-09-12T19:27:30.261761+0000","last_became_active":"2024-09-12T17:36:40.893090+0000","last_became_peered":"2024-09-12T17:36:40.893090+0000","last_unstale":"2024-09-12T19:27:30.261761+0000","last_undegraded":"2024-09-12T19:27:30.261761+0000","last_fullsized":"2024-09-12T19:27:30.261761+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:17.912186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'806","reported_seq":3156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.737614+0000","last_change":"2024-09-12T17:36:42.937918+0000","last_active":"2024-09-12T19:29:41.737614+0000","last_peered":"2024-09-12T19:29:41.737614+0000","last_clean":"2024-09-12T19:29:41.737614+0000","last_became_active":"2024-09-12T17:36:42.937195+0000","last_became_peered":"2024-09-12T17:36:42.937195+0000","last_unstale":"2024-09-12T19:29:41.737614+0000","last_undegraded":"2024-09-12T19:29:41.737614+0000","last_fullsized":"2024-09-12T19:29:41.737614+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:27.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'109","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.251823+0000","last_change":"2024-09-12T17:36:44.960800+0000","last_active":"2024-09-12T19:27:10.251823+0000","last_peered":"2024-09-12T19:27:10.251823+0000","last_clean":"2024-09-12T19:27:10.251823+0000","last_became_active":"2024-09-12T17:36:44.960042+0000","last_became_peered":"2024-09-12T17:36:44.960042+0000","last_unstale":"2024-09-12T19:27:10.251823+0000","last_undegraded":"2024-09-12T19:27:10.251823+0000","last_fullsized":"2024-09-12T19:27:10.251823+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:54.849029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'988","reported_seq":2652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.143275+0000","last_change":"2024-09-12T19:29:55.143275+0000","last_active":"2024-09-12T19:29:55.143275+0000","last_peered":"2024-09-12T19:29:55.143275+0000","last_clean":"2024-09-12T19:29:55.143275+0000","last_became_active":"2024-09-12T17:36:36.913566+0000","last_became_peered":"2024-09-12T17:36:36.913566+0000","last_unstale":"2024-09-12T19:29:55.143275+0000","last_undegraded":"2024-09-12T19:29:55.143275+0000","last_fullsized":"2024-09-12T19:29:55.143275+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'988","last_scrub_stamp":"2024-09-12T19:29:55.143081+0000","last_deep_scrub":"265'988","last_deep_scrub_stamp":"2024-09-12T19:29:55.143081+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.143081+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":900,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:53.114918+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4811,"num_read_kb":4293,"num_write":1402,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'301","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.964599+0000","last_change":"2024-09-12T19:29:51.964599+0000","last_active":"2024-09-12T19:29:51.964599+0000","last_peered":"2024-09-12T19:29:51.964599+0000","last_clean":"2024-09-12T19:29:51.964599+0000","last_became_active":"2024-09-12T17:36:34.862534+0000","last_became_peered":"2024-09-12T17:36:34.862534+0000","last_unstale":"2024-09-12T19:29:51.964599+0000","last_undegraded":"2024-09-12T19:29:51.964599+0000","last_fullsized":"2024-09-12T19:29:51.964599+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T19:29:51.964386+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T19:29:51.964386+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.964386+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:56.102480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":22960,"num_write":940,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.363062+0000","last_change":"2024-09-12T17:36:38.886369+0000","last_active":"2024-09-12T19:26:55.363062+0000","last_peered":"2024-09-12T19:26:55.363062+0000","last_clean":"2024-09-12T19:26:55.363062+0000","last_became_active":"2024-09-12T17:36:38.885678+0000","last_became_peered":"2024-09-12T17:36:38.885678+0000","last_unstale":"2024-09-12T19:26:55.363062+0000","last_undegraded":"2024-09-12T19:26:55.363062+0000","last_fullsized":"2024-09-12T19:26:55.363062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:06.010071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'414","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.111556+0000","last_change":"2024-09-12T17:36:40.900876+0000","last_active":"2024-09-12T19:29:42.111556+0000","last_peered":"2024-09-12T19:29:42.111556+0000","last_clean":"2024-09-12T19:29:42.111556+0000","last_became_active":"2024-09-12T17:36:40.900295+0000","last_became_peered":"2024-09-12T17:36:40.900295+0000","last_unstale":"2024-09-12T19:29:42.111556+0000","last_undegraded":"2024-09-12T19:29:42.111556+0000","last_fullsized":"2024-09-12T19:29:42.111556+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:17.899103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41300,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":664,"num_read_kb":1187,"num_write":496,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249747+0000","last_change":"2024-09-12T17:36:42.928327+0000","last_active":"2024-09-12T19:27:00.249747+0000","last_peered":"2024-09-12T19:27:00.249747+0000","last_clean":"2024-09-12T19:27:00.249747+0000","last_became_active":"2024-09-12T17:36:42.927716+0000","last_became_peered":"2024-09-12T17:36:42.927716+0000","last_unstale":"2024-09-12T19:27:00.249747+0000","last_undegraded":"2024-09-12T19:27:00.249747+0000","last_fullsized":"2024-09-12T19:27:00.249747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.478941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'114","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:58.451214+0000","last_change":"2024-09-12T17:36:44.943385+0000","last_active":"2024-09-12T19:27:58.451214+0000","last_peered":"2024-09-12T19:27:58.451214+0000","last_clean":"2024-09-12T19:27:58.451214+0000","last_became_active":"2024-09-12T17:36:44.942505+0000","last_became_peered":"2024-09-12T17:36:44.942505+0000","last_unstale":"2024-09-12T19:27:58.451214+0000","last_undegraded":"2024-09-12T19:27:58.451214+0000","last_fullsized":"2024-09-12T19:27:58.451214+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:16.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":134,"num_write":256,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'735","reported_seq":2211,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.116820+0000","last_change":"2024-09-12T19:30:05.116820+0000","last_active":"2024-09-12T19:30:05.116820+0000","last_peered":"2024-09-12T19:30:05.116820+0000","last_clean":"2024-09-12T19:30:05.116820+0000","last_became_active":"2024-09-12T17:36:36.881456+0000","last_became_peered":"2024-09-12T17:36:36.881456+0000","last_unstale":"2024-09-12T19:30:05.116820+0000","last_undegraded":"2024-09-12T19:30:05.116820+0000","last_fullsized":"2024-09-12T19:30:05.116820+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'735","last_scrub_stamp":"2024-09-12T19:30:05.116645+0000","last_deep_scrub":"265'735","last_deep_scrub_stamp":"2024-09-12T19:30:05.116645+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.116645+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:47.794091+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3432,"num_read_kb":3120,"num_write":969,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.898417+0000","last_change":"2024-09-12T19:29:49.898417+0000","last_active":"2024-09-12T19:29:49.898417+0000","last_peered":"2024-09-12T19:29:49.898417+0000","last_clean":"2024-09-12T19:29:49.898417+0000","last_became_active":"2024-09-12T17:36:16.722334+0000","last_became_peered":"2024-09-12T17:36:16.722334+0000","last_unstale":"2024-09-12T19:29:49.898417+0000","last_undegraded":"2024-09-12T19:29:49.898417+0000","last_fullsized":"2024-09-12T19:29:49.898417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T19:29:49.898324+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T19:29:49.898324+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.898324+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:33.245609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":560,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.125545+0000","last_change":"2024-09-12T19:29:51.125545+0000","last_active":"2024-09-12T19:29:51.125545+0000","last_peered":"2024-09-12T19:29:51.125545+0000","last_clean":"2024-09-12T19:29:51.125545+0000","last_became_active":"2024-09-12T17:36:21.777852+0000","last_became_peered":"2024-09-12T17:36:21.777852+0000","last_unstale":"2024-09-12T19:29:51.125545+0000","last_undegraded":"2024-09-12T19:29:51.125545+0000","last_fullsized":"2024-09-12T19:29:51.125545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:29:51.125363+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:29:51.125363+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.125363+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.353553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0019340550000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'392","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.973395+0000","last_change":"2024-09-12T19:29:49.973395+0000","last_active":"2024-09-12T19:29:49.973395+0000","last_peered":"2024-09-12T19:29:49.973395+0000","last_clean":"2024-09-12T19:29:49.973395+0000","last_became_active":"2024-09-12T17:36:34.865550+0000","last_became_peered":"2024-09-12T17:36:34.865550+0000","last_unstale":"2024-09-12T19:29:49.973395+0000","last_undegraded":"2024-09-12T19:29:49.973395+0000","last_fullsized":"2024-09-12T19:29:49.973395+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'392","last_scrub_stamp":"2024-09-12T19:29:49.973066+0000","last_deep_scrub":"265'392","last_deep_scrub_stamp":"2024-09-12T19:29:49.973066+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.973066+0000","objects_scrubbed":10,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:01.163698+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":672,"num_read_kb":15438,"num_write":1473,"num_write_kb":31533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.410837+0000","last_change":"2024-09-12T19:30:02.410837+0000","last_active":"2024-09-12T19:30:02.410837+0000","last_peered":"2024-09-12T19:30:02.410837+0000","last_clean":"2024-09-12T19:30:02.410837+0000","last_became_active":"2024-09-12T17:36:38.891774+0000","last_became_peered":"2024-09-12T17:36:38.891774+0000","last_unstale":"2024-09-12T19:30:02.410837+0000","last_undegraded":"2024-09-12T19:30:02.410837+0000","last_fullsized":"2024-09-12T19:30:02.410837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:02.410659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:02.410659+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.410659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:06.637766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'747","reported_seq":1494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.186442+0000","last_change":"2024-09-12T17:36:40.886469+0000","last_active":"2024-09-12T19:29:42.186442+0000","last_peered":"2024-09-12T19:29:42.186442+0000","last_clean":"2024-09-12T19:29:42.186442+0000","last_became_active":"2024-09-12T17:36:40.885684+0000","last_became_peered":"2024-09-12T17:36:40.885684+0000","last_unstale":"2024-09-12T19:29:42.186442+0000","last_undegraded":"2024-09-12T19:29:42.186442+0000","last_fullsized":"2024-09-12T19:29:42.186442+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:17.424179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144787,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1444,"num_read_kb":3163,"num_write":1370,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263697+0000","last_change":"2024-09-12T17:36:42.919971+0000","last_active":"2024-09-12T19:27:15.263697+0000","last_peered":"2024-09-12T19:27:15.263697+0000","last_clean":"2024-09-12T19:27:15.263697+0000","last_became_active":"2024-09-12T17:36:42.919204+0000","last_became_peered":"2024-09-12T17:36:42.919204+0000","last_unstale":"2024-09-12T19:27:15.263697+0000","last_undegraded":"2024-09-12T19:27:15.263697+0000","last_fullsized":"2024-09-12T19:27:15.263697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:28.580042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'184","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.702184+0000","last_change":"2024-09-12T17:36:44.954972+0000","last_active":"2024-09-12T19:28:02.702184+0000","last_peered":"2024-09-12T19:28:02.702184+0000","last_clean":"2024-09-12T19:28:02.702184+0000","last_became_active":"2024-09-12T17:36:44.954321+0000","last_became_peered":"2024-09-12T17:36:44.954321+0000","last_unstale":"2024-09-12T19:28:02.702184+0000","last_undegraded":"2024-09-12T19:28:02.702184+0000","last_fullsized":"2024-09-12T19:28:02.702184+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:09.226720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":488,"num_write":378,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'505","reported_seq":2094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.910531+0000","last_change":"2024-09-12T19:30:02.910531+0000","last_active":"2024-09-12T19:30:02.910531+0000","last_peered":"2024-09-12T19:30:02.910531+0000","last_clean":"2024-09-12T19:30:02.910531+0000","last_became_active":"2024-09-12T17:36:36.906789+0000","last_became_peered":"2024-09-12T17:36:36.906789+0000","last_unstale":"2024-09-12T19:30:02.910531+0000","last_undegraded":"2024-09-12T19:30:02.910531+0000","last_fullsized":"2024-09-12T19:30:02.910531+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:30:02.910308+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:30:02.910308+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.910308+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:02.545989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2691,"num_read_kb":2505,"num_write":636,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":560,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.034793+0000","last_change":"2024-09-12T19:29:49.034793+0000","last_active":"2024-09-12T19:29:49.034793+0000","last_peered":"2024-09-12T19:29:49.034793+0000","last_clean":"2024-09-12T19:29:49.034793+0000","last_became_active":"2024-09-12T17:36:21.785026+0000","last_became_peered":"2024-09-12T17:36:21.785026+0000","last_unstale":"2024-09-12T19:29:49.034793+0000","last_undegraded":"2024-09-12T19:29:49.034793+0000","last_fullsized":"2024-09-12T19:29:49.034793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:49.034625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:49.034625+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.034625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:04.032231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184601,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'384","reported_seq":1094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.337277+0000","last_change":"2024-09-12T19:29:49.337277+0000","last_active":"2024-09-12T19:29:49.337277+0000","last_peered":"2024-09-12T19:29:49.337277+0000","last_clean":"2024-09-12T19:29:49.337277+0000","last_became_active":"2024-09-12T17:36:34.882818+0000","last_became_peered":"2024-09-12T17:36:34.882818+0000","last_unstale":"2024-09-12T19:29:49.337277+0000","last_undegraded":"2024-09-12T19:29:49.337277+0000","last_fullsized":"2024-09-12T19:29:49.337277+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T19:29:49.337016+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T19:29:49.337016+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.337016+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:42.148166+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263289,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":609,"num_read_kb":22197,"num_write":1318,"num_write_kb":15503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366617+0000","last_change":"2024-09-12T17:36:38.895923+0000","last_active":"2024-09-12T19:27:10.366617+0000","last_peered":"2024-09-12T19:27:10.366617+0000","last_clean":"2024-09-12T19:27:10.366617+0000","last_became_active":"2024-09-12T17:36:38.895378+0000","last_became_peered":"2024-09-12T17:36:38.895378+0000","last_unstale":"2024-09-12T19:27:10.366617+0000","last_undegraded":"2024-09-12T19:27:10.366617+0000","last_fullsized":"2024-09-12T19:27:10.366617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:49.295916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1452","reported_seq":3806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.147267+0000","last_change":"2024-09-12T17:36:40.909473+0000","last_active":"2024-09-12T19:29:42.147267+0000","last_peered":"2024-09-12T19:29:42.147267+0000","last_clean":"2024-09-12T19:29:42.147267+0000","last_became_active":"2024-09-12T17:36:40.908721+0000","last_became_peered":"2024-09-12T17:36:40.908721+0000","last_unstale":"2024-09-12T19:29:42.147267+0000","last_undegraded":"2024-09-12T19:29:42.147267+0000","last_fullsized":"2024-09-12T19:29:42.147267+0000","mapping_epoch":30,"log_start":"265'1400","ondisk_log_start":"265'1400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:39.239469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146546,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2270,"num_read_kb":4170,"num_write":1382,"num_write_kb":1134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:40.373748+0000","last_change":"2024-09-12T17:36:42.918278+0000","last_active":"2024-09-12T19:27:40.373748+0000","last_peered":"2024-09-12T19:27:40.373748+0000","last_clean":"2024-09-12T19:27:40.373748+0000","last_became_active":"2024-09-12T17:36:42.917432+0000","last_became_peered":"2024-09-12T17:36:42.917432+0000","last_unstale":"2024-09-12T19:27:40.373748+0000","last_undegraded":"2024-09-12T19:27:40.373748+0000","last_fullsized":"2024-09-12T19:27:40.373748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:35.437908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'252","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.343333+0000","last_change":"2024-09-12T17:36:44.959827+0000","last_active":"2024-09-12T19:28:00.343333+0000","last_peered":"2024-09-12T19:28:00.343333+0000","last_clean":"2024-09-12T19:28:00.343333+0000","last_became_active":"2024-09-12T17:36:44.956687+0000","last_became_peered":"2024-09-12T17:36:44.956687+0000","last_unstale":"2024-09-12T19:28:00.343333+0000","last_undegraded":"2024-09-12T19:28:00.343333+0000","last_fullsized":"2024-09-12T19:28:00.343333+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":419,"num_write":569,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'459","reported_seq":1919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.431161+0000","last_change":"2024-09-12T19:29:57.431161+0000","last_active":"2024-09-12T19:29:57.431161+0000","last_peered":"2024-09-12T19:29:57.431161+0000","last_clean":"2024-09-12T19:29:57.431161+0000","last_became_active":"2024-09-12T17:36:36.876424+0000","last_became_peered":"2024-09-12T17:36:36.876424+0000","last_unstale":"2024-09-12T19:29:57.431161+0000","last_undegraded":"2024-09-12T19:29:57.431161+0000","last_fullsized":"2024-09-12T19:29:57.431161+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'459","last_scrub_stamp":"2024-09-12T19:29:57.430975+0000","last_deep_scrub":"265'459","last_deep_scrub_stamp":"2024-09-12T19:29:57.430975+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.430975+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:09.526597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2313,"num_read_kb":2138,"num_write":582,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":559,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.154192+0000","last_change":"2024-09-12T19:29:50.154192+0000","last_active":"2024-09-12T19:29:50.154192+0000","last_peered":"2024-09-12T19:29:50.154192+0000","last_clean":"2024-09-12T19:29:50.154192+0000","last_became_active":"2024-09-12T17:36:21.786793+0000","last_became_peered":"2024-09-12T17:36:21.786793+0000","last_unstale":"2024-09-12T19:29:50.154192+0000","last_undegraded":"2024-09-12T19:29:50.154192+0000","last_fullsized":"2024-09-12T19:29:50.154192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:50.154015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:50.154015+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.154015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:03.469572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011925740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'325","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.914352+0000","last_change":"2024-09-12T19:29:49.914352+0000","last_active":"2024-09-12T19:29:49.914352+0000","last_peered":"2024-09-12T19:29:49.914352+0000","last_clean":"2024-09-12T19:29:49.914352+0000","last_became_active":"2024-09-12T17:36:34.878944+0000","last_became_peered":"2024-09-12T17:36:34.878944+0000","last_unstale":"2024-09-12T19:29:49.914352+0000","last_undegraded":"2024-09-12T19:29:49.914352+0000","last_fullsized":"2024-09-12T19:29:49.914352+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'325","last_scrub_stamp":"2024-09-12T19:29:49.914119+0000","last_deep_scrub":"265'325","last_deep_scrub_stamp":"2024-09-12T19:29:49.914119+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.914119+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:49.927843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526370,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":517,"num_read_kb":44432,"num_write":1109,"num_write_kb":34964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.067399+0000","last_change":"2024-09-12T19:30:03.067399+0000","last_active":"2024-09-12T19:30:03.067399+0000","last_peered":"2024-09-12T19:30:03.067399+0000","last_clean":"2024-09-12T19:30:03.067399+0000","last_became_active":"2024-09-12T17:36:38.907685+0000","last_became_peered":"2024-09-12T17:36:38.907685+0000","last_unstale":"2024-09-12T19:30:03.067399+0000","last_undegraded":"2024-09-12T19:30:03.067399+0000","last_fullsized":"2024-09-12T19:30:03.067399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:03.067178+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:03.067178+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.067178+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:13.152392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'385","reported_seq":2346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.224631+0000","last_change":"2024-09-12T17:36:40.907875+0000","last_active":"2024-09-12T19:29:22.224631+0000","last_peered":"2024-09-12T19:29:22.224631+0000","last_clean":"2024-09-12T19:29:22.224631+0000","last_became_active":"2024-09-12T17:36:40.907340+0000","last_became_peered":"2024-09-12T17:36:40.907340+0000","last_unstale":"2024-09-12T19:29:22.224631+0000","last_undegraded":"2024-09-12T19:29:22.224631+0000","last_fullsized":"2024-09-12T19:29:22.224631+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:01.365979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":374,"num_read_kb":364,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.693668+0000","last_change":"2024-09-12T17:36:42.932731+0000","last_active":"2024-09-12T19:27:10.693668+0000","last_peered":"2024-09-12T19:27:10.693668+0000","last_clean":"2024-09-12T19:27:10.693668+0000","last_became_active":"2024-09-12T17:36:42.931884+0000","last_became_peered":"2024-09-12T17:36:42.931884+0000","last_unstale":"2024-09-12T19:27:10.693668+0000","last_undegraded":"2024-09-12T19:27:10.693668+0000","last_fullsized":"2024-09-12T19:27:10.693668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:21.823146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'257","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.184602+0000","last_change":"2024-09-12T17:36:44.940743+0000","last_active":"2024-09-12T19:28:03.184602+0000","last_peered":"2024-09-12T19:28:03.184602+0000","last_clean":"2024-09-12T19:28:03.184602+0000","last_became_active":"2024-09-12T17:36:44.940041+0000","last_became_peered":"2024-09-12T17:36:44.940041+0000","last_unstale":"2024-09-12T19:28:03.184602+0000","last_undegraded":"2024-09-12T19:28:03.184602+0000","last_fullsized":"2024-09-12T19:28:03.184602+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:45.197303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":565,"num_write":575,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'751","reported_seq":2229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.430540+0000","last_change":"2024-09-12T19:29:58.430540+0000","last_active":"2024-09-12T19:29:58.430540+0000","last_peered":"2024-09-12T19:29:58.430540+0000","last_clean":"2024-09-12T19:29:58.430540+0000","last_became_active":"2024-09-12T17:36:36.896152+0000","last_became_peered":"2024-09-12T17:36:36.896152+0000","last_unstale":"2024-09-12T19:29:58.430540+0000","last_undegraded":"2024-09-12T19:29:58.430540+0000","last_fullsized":"2024-09-12T19:29:58.430540+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'751","last_scrub_stamp":"2024-09-12T19:29:58.430337+0000","last_deep_scrub":"265'751","last_deep_scrub_stamp":"2024-09-12T19:29:58.430337+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.430337+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:51.087393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3496,"num_read_kb":3152,"num_write":986,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":561,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.061350+0000","last_change":"2024-09-12T19:29:48.061350+0000","last_active":"2024-09-12T19:29:48.061350+0000","last_peered":"2024-09-12T19:29:48.061350+0000","last_clean":"2024-09-12T19:29:48.061350+0000","last_became_active":"2024-09-12T17:36:21.777173+0000","last_became_peered":"2024-09-12T17:36:21.777173+0000","last_unstale":"2024-09-12T19:29:48.061350+0000","last_undegraded":"2024-09-12T19:29:48.061350+0000","last_fullsized":"2024-09-12T19:29:48.061350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T19:29:48.061179+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T19:29:48.061179+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.061179+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:31.413285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001776889,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'361","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.180093+0000","last_change":"2024-09-12T19:29:51.180093+0000","last_active":"2024-09-12T19:29:51.180093+0000","last_peered":"2024-09-12T19:29:51.180093+0000","last_clean":"2024-09-12T19:29:51.180093+0000","last_became_active":"2024-09-12T17:37:07.867652+0000","last_became_peered":"2024-09-12T17:37:07.867652+0000","last_unstale":"2024-09-12T19:29:51.180093+0000","last_undegraded":"2024-09-12T19:29:51.180093+0000","last_fullsized":"2024-09-12T19:29:51.180093+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:29:51.179910+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:29:51.179910+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.179910+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:46.705185+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":639,"num_read_kb":7400,"num_write":1137,"num_write_kb":18590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.125119+0000","last_change":"2024-09-12T19:30:01.125119+0000","last_active":"2024-09-12T19:30:01.125119+0000","last_peered":"2024-09-12T19:30:01.125119+0000","last_clean":"2024-09-12T19:30:01.125119+0000","last_became_active":"2024-09-12T17:36:38.912059+0000","last_became_peered":"2024-09-12T17:36:38.912059+0000","last_unstale":"2024-09-12T19:30:01.125119+0000","last_undegraded":"2024-09-12T19:30:01.125119+0000","last_fullsized":"2024-09-12T19:30:01.125119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:01.124924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:01.124924+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.124924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:24.544303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'216","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:20.294596+0000","last_change":"2024-09-12T17:36:40.885516+0000","last_active":"2024-09-12T19:29:20.294596+0000","last_peered":"2024-09-12T19:29:20.294596+0000","last_clean":"2024-09-12T19:29:20.294596+0000","last_became_active":"2024-09-12T17:36:40.884794+0000","last_became_peered":"2024-09-12T17:36:40.884794+0000","last_unstale":"2024-09-12T19:29:20.294596+0000","last_undegraded":"2024-09-12T19:29:20.294596+0000","last_fullsized":"2024-09-12T19:29:20.294596+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:21.742525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":278,"num_read_kb":269,"num_write":202,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.367743+0000","last_change":"2024-09-12T17:36:42.921806+0000","last_active":"2024-09-12T19:27:15.367743+0000","last_peered":"2024-09-12T19:27:15.367743+0000","last_clean":"2024-09-12T19:27:15.367743+0000","last_became_active":"2024-09-12T17:36:42.920887+0000","last_became_peered":"2024-09-12T17:36:42.920887+0000","last_unstale":"2024-09-12T19:27:15.367743+0000","last_undegraded":"2024-09-12T19:27:15.367743+0000","last_fullsized":"2024-09-12T19:27:15.367743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:38.116745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'126","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.095950+0000","last_change":"2024-09-12T17:36:44.938503+0000","last_active":"2024-09-12T19:27:15.095950+0000","last_peered":"2024-09-12T19:27:15.095950+0000","last_clean":"2024-09-12T19:27:15.095950+0000","last_became_active":"2024-09-12T17:36:44.937666+0000","last_became_peered":"2024-09-12T17:36:44.937666+0000","last_unstale":"2024-09-12T19:27:15.095950+0000","last_undegraded":"2024-09-12T19:27:15.095950+0000","last_fullsized":"2024-09-12T19:27:15.095950+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:23.897144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":289,"num_read_kb":276,"num_write":312,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'531","reported_seq":2150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.379702+0000","last_change":"2024-09-12T19:29:55.379702+0000","last_active":"2024-09-12T19:29:55.379702+0000","last_peered":"2024-09-12T19:29:55.379702+0000","last_clean":"2024-09-12T19:29:55.379702+0000","last_became_active":"2024-09-12T17:36:36.880335+0000","last_became_peered":"2024-09-12T17:36:36.880335+0000","last_unstale":"2024-09-12T19:29:55.379702+0000","last_undegraded":"2024-09-12T19:29:55.379702+0000","last_fullsized":"2024-09-12T19:29:55.379702+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'531","last_scrub_stamp":"2024-09-12T19:29:55.379515+0000","last_deep_scrub":"265'531","last_deep_scrub_stamp":"2024-09-12T19:29:55.379515+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.379515+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:12.812873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2654,"num_read_kb":2484,"num_write":644,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'379","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.385447+0000","last_change":"2024-09-12T19:29:47.385447+0000","last_active":"2024-09-12T19:29:47.385447+0000","last_peered":"2024-09-12T19:29:47.385447+0000","last_clean":"2024-09-12T19:29:47.385447+0000","last_became_active":"2024-09-12T17:36:34.877412+0000","last_became_peered":"2024-09-12T17:36:34.877412+0000","last_unstale":"2024-09-12T19:29:47.385447+0000","last_undegraded":"2024-09-12T19:29:47.385447+0000","last_fullsized":"2024-09-12T19:29:47.385447+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'379","last_scrub_stamp":"2024-09-12T19:29:47.385337+0000","last_deep_scrub":"265'379","last_deep_scrub_stamp":"2024-09-12T19:29:47.385337+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.385337+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:45.645372+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6755987,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":26720,"num_write":1165,"num_write_kb":36792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.889621+0000","last_change":"2024-09-12T19:29:48.889621+0000","last_active":"2024-09-12T19:29:48.889621+0000","last_peered":"2024-09-12T19:29:48.889621+0000","last_clean":"2024-09-12T19:29:48.889621+0000","last_became_active":"2024-09-12T17:36:21.786429+0000","last_became_peered":"2024-09-12T17:36:21.786429+0000","last_unstale":"2024-09-12T19:29:48.889621+0000","last_undegraded":"2024-09-12T19:29:48.889621+0000","last_fullsized":"2024-09-12T19:29:48.889621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:48.889441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:48.889441+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.889441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:45.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011387680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"36'5","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.737746+0000","last_change":"2024-09-12T17:36:38.903117+0000","last_active":"2024-09-12T19:29:40.737746+0000","last_peered":"2024-09-12T19:29:40.737746+0000","last_clean":"2024-09-12T19:29:40.737746+0000","last_became_active":"2024-09-12T17:36:38.902432+0000","last_became_peered":"2024-09-12T17:36:38.902432+0000","last_unstale":"2024-09-12T19:29:40.737746+0000","last_undegraded":"2024-09-12T19:29:40.737746+0000","last_fullsized":"2024-09-12T19:29:40.737746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:28.729642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":1196,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'762","reported_seq":1508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.173560+0000","last_change":"2024-09-12T19:30:05.173560+0000","last_active":"2024-09-12T19:30:05.173560+0000","last_peered":"2024-09-12T19:30:05.173560+0000","last_clean":"2024-09-12T19:30:05.173560+0000","last_became_active":"2024-09-12T17:36:40.902488+0000","last_became_peered":"2024-09-12T17:36:40.902488+0000","last_unstale":"2024-09-12T19:30:05.173560+0000","last_undegraded":"2024-09-12T19:30:05.173560+0000","last_fullsized":"2024-09-12T19:30:05.173560+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'762","last_scrub_stamp":"2024-09-12T19:30:05.173334+0000","last_deep_scrub":"265'762","last_deep_scrub_stamp":"2024-09-12T19:30:05.173334+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.173334+0000","objects_scrubbed":10,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:35.044431+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98161,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1955,"num_read_kb":3163,"num_write":2614,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508704,"num_omap_keys":1156,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.251784+0000","last_change":"2024-09-12T17:36:42.932443+0000","last_active":"2024-09-12T19:27:10.251784+0000","last_peered":"2024-09-12T19:27:10.251784+0000","last_clean":"2024-09-12T19:27:10.251784+0000","last_became_active":"2024-09-12T17:36:42.931746+0000","last_became_peered":"2024-09-12T17:36:42.931746+0000","last_unstale":"2024-09-12T19:27:10.251784+0000","last_undegraded":"2024-09-12T19:27:10.251784+0000","last_fullsized":"2024-09-12T19:27:10.251784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:17.226964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'136","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.427148+0000","last_change":"2024-09-12T17:36:44.959931+0000","last_active":"2024-09-12T19:27:55.427148+0000","last_peered":"2024-09-12T19:27:55.427148+0000","last_clean":"2024-09-12T19:27:55.427148+0000","last_became_active":"2024-09-12T17:36:44.959109+0000","last_became_peered":"2024-09-12T17:36:44.959109+0000","last_unstale":"2024-09-12T19:27:55.427148+0000","last_undegraded":"2024-09-12T19:27:55.427148+0000","last_fullsized":"2024-09-12T19:27:55.427148+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:21.689650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'606","reported_seq":2154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.417555+0000","last_change":"2024-09-12T19:29:56.417555+0000","last_active":"2024-09-12T19:29:56.417555+0000","last_peered":"2024-09-12T19:29:56.417555+0000","last_clean":"2024-09-12T19:29:56.417555+0000","last_became_active":"2024-09-12T17:36:36.883397+0000","last_became_peered":"2024-09-12T17:36:36.883397+0000","last_unstale":"2024-09-12T19:29:56.417555+0000","last_undegraded":"2024-09-12T19:29:56.417555+0000","last_fullsized":"2024-09-12T19:29:56.417555+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'606","last_scrub_stamp":"2024-09-12T19:29:56.417345+0000","last_deep_scrub":"265'606","last_deep_scrub_stamp":"2024-09-12T19:29:56.417345+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.417345+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:40.538277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3050,"num_read_kb":2738,"num_write":793,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'373","reported_seq":1105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.305851+0000","last_change":"2024-09-12T19:29:50.305851+0000","last_active":"2024-09-12T19:29:50.305851+0000","last_peered":"2024-09-12T19:29:50.305851+0000","last_clean":"2024-09-12T19:29:50.305851+0000","last_became_active":"2024-09-12T17:36:34.892255+0000","last_became_peered":"2024-09-12T17:36:34.892255+0000","last_unstale":"2024-09-12T19:29:50.305851+0000","last_undegraded":"2024-09-12T19:29:50.305851+0000","last_fullsized":"2024-09-12T19:29:50.305851+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:29:50.305656+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:29:50.305656+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.305656+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:22.178790+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400040,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":627,"num_read_kb":68904,"num_write":1058,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.074460+0000","last_change":"2024-09-12T19:29:52.074460+0000","last_active":"2024-09-12T19:29:52.074460+0000","last_peered":"2024-09-12T19:29:52.074460+0000","last_clean":"2024-09-12T19:29:52.074460+0000","last_became_active":"2024-09-12T17:36:21.783069+0000","last_became_peered":"2024-09-12T17:36:21.783069+0000","last_unstale":"2024-09-12T19:29:52.074460+0000","last_undegraded":"2024-09-12T19:29:52.074460+0000","last_fullsized":"2024-09-12T19:29:52.074460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:52.074270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:52.074270+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.074270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:39.027678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001135285,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.463533+0000","last_change":"2024-09-12T19:30:04.463533+0000","last_active":"2024-09-12T19:30:04.463533+0000","last_peered":"2024-09-12T19:30:04.463533+0000","last_clean":"2024-09-12T19:30:04.463533+0000","last_became_active":"2024-09-12T17:36:38.900433+0000","last_became_peered":"2024-09-12T17:36:38.900433+0000","last_unstale":"2024-09-12T19:30:04.463533+0000","last_undegraded":"2024-09-12T19:30:04.463533+0000","last_fullsized":"2024-09-12T19:30:04.463533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.463348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.463348+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.463348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:22.114565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'254","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.539472+0000","last_change":"2024-09-12T19:30:07.539472+0000","last_active":"2024-09-12T19:30:07.539472+0000","last_peered":"2024-09-12T19:30:07.539472+0000","last_clean":"2024-09-12T19:30:07.539472+0000","last_became_active":"2024-09-12T17:36:40.886345+0000","last_became_peered":"2024-09-12T17:36:40.886345+0000","last_unstale":"2024-09-12T19:30:07.539472+0000","last_undegraded":"2024-09-12T19:30:07.539472+0000","last_fullsized":"2024-09-12T19:30:07.539472+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-12T19:30:07.539275+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-12T19:30:07.539275+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.539275+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:20.151842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'805","reported_seq":3501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.736271+0000","last_change":"2024-09-12T17:36:42.932438+0000","last_active":"2024-09-12T19:29:41.736271+0000","last_peered":"2024-09-12T19:29:41.736271+0000","last_clean":"2024-09-12T19:29:41.736271+0000","last_became_active":"2024-09-12T17:36:42.931598+0000","last_became_peered":"2024-09-12T17:36:42.931598+0000","last_unstale":"2024-09-12T19:29:41.736271+0000","last_undegraded":"2024-09-12T19:29:41.736271+0000","last_fullsized":"2024-09-12T19:29:41.736271+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:00.606220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'133","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.059775+0000","last_change":"2024-09-12T17:36:44.952618+0000","last_active":"2024-09-12T19:29:22.059775+0000","last_peered":"2024-09-12T19:29:22.059775+0000","last_clean":"2024-09-12T19:29:22.059775+0000","last_became_active":"2024-09-12T17:36:44.951849+0000","last_became_peered":"2024-09-12T17:36:44.951849+0000","last_unstale":"2024-09-12T19:29:22.059775+0000","last_undegraded":"2024-09-12T19:29:22.059775+0000","last_fullsized":"2024-09-12T19:29:22.059775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:49.786200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'744","reported_seq":2385,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.897523+0000","last_change":"2024-09-12T19:29:57.897523+0000","last_active":"2024-09-12T19:29:57.897523+0000","last_peered":"2024-09-12T19:29:57.897523+0000","last_clean":"2024-09-12T19:29:57.897523+0000","last_became_active":"2024-09-12T17:36:36.892861+0000","last_became_peered":"2024-09-12T17:36:36.892861+0000","last_unstale":"2024-09-12T19:29:57.897523+0000","last_undegraded":"2024-09-12T19:29:57.897523+0000","last_fullsized":"2024-09-12T19:29:57.897523+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'744","last_scrub_stamp":"2024-09-12T19:29:57.897218+0000","last_deep_scrub":"265'744","last_deep_scrub_stamp":"2024-09-12T19:29:57.897218+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.897218+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:49.749434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3560,"num_read_kb":3257,"num_write":956,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'351","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.000072+0000","last_change":"2024-09-12T19:29:53.000072+0000","last_active":"2024-09-12T19:29:53.000072+0000","last_peered":"2024-09-12T19:29:53.000072+0000","last_clean":"2024-09-12T19:29:53.000072+0000","last_became_active":"2024-09-12T17:36:34.883331+0000","last_became_peered":"2024-09-12T17:36:34.883331+0000","last_unstale":"2024-09-12T19:29:53.000072+0000","last_undegraded":"2024-09-12T19:29:53.000072+0000","last_fullsized":"2024-09-12T19:29:53.000072+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-12T19:29:52.999859+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-12T19:29:52.999859+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.999859+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:19.508145+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":26132,"num_write":1177,"num_write_kb":40752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.922514+0000","last_change":"2024-09-12T19:29:48.922514+0000","last_active":"2024-09-12T19:29:48.922514+0000","last_peered":"2024-09-12T19:29:48.922514+0000","last_clean":"2024-09-12T19:29:48.922514+0000","last_became_active":"2024-09-12T17:36:22.059379+0000","last_became_peered":"2024-09-12T17:36:22.059379+0000","last_unstale":"2024-09-12T19:29:48.922514+0000","last_undegraded":"2024-09-12T19:29:48.922514+0000","last_fullsized":"2024-09-12T19:29:48.922514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:48.922319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:48.922319+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.922319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:36.603470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012087210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.365102+0000","last_change":"2024-09-12T17:36:38.892129+0000","last_active":"2024-09-12T19:27:05.365102+0000","last_peered":"2024-09-12T19:27:05.365102+0000","last_clean":"2024-09-12T19:27:05.365102+0000","last_became_active":"2024-09-12T17:36:38.891807+0000","last_became_peered":"2024-09-12T17:36:38.891807+0000","last_unstale":"2024-09-12T19:27:05.365102+0000","last_undegraded":"2024-09-12T19:27:05.365102+0000","last_fullsized":"2024-09-12T19:27:05.365102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:48.578150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'173","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:33.637507+0000","last_change":"2024-09-12T17:36:40.898576+0000","last_active":"2024-09-12T19:27:33.637507+0000","last_peered":"2024-09-12T19:27:33.637507+0000","last_clean":"2024-09-12T19:27:33.637507+0000","last_became_active":"2024-09-12T17:36:40.897763+0000","last_became_peered":"2024-09-12T17:36:40.897763+0000","last_unstale":"2024-09-12T19:27:33.637507+0000","last_undegraded":"2024-09-12T19:27:33.637507+0000","last_fullsized":"2024-09-12T19:27:33.637507+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:41.559054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'801","reported_seq":3148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.031106+0000","last_change":"2024-09-12T17:36:42.930005+0000","last_active":"2024-09-12T19:29:42.031106+0000","last_peered":"2024-09-12T19:29:42.031106+0000","last_clean":"2024-09-12T19:29:42.031106+0000","last_became_active":"2024-09-12T17:36:42.928978+0000","last_became_peered":"2024-09-12T17:36:42.928978+0000","last_unstale":"2024-09-12T19:29:42.031106+0000","last_undegraded":"2024-09-12T19:29:42.031106+0000","last_fullsized":"2024-09-12T19:29:42.031106+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:50.493434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'235","reported_seq":781,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.583893+0000","last_change":"2024-09-12T17:36:44.960384+0000","last_active":"2024-09-12T19:28:02.583893+0000","last_peered":"2024-09-12T19:28:02.583893+0000","last_clean":"2024-09-12T19:28:02.583893+0000","last_became_active":"2024-09-12T17:36:44.956784+0000","last_became_peered":"2024-09-12T17:36:44.956784+0000","last_unstale":"2024-09-12T19:28:02.583893+0000","last_undegraded":"2024-09-12T19:28:02.583893+0000","last_fullsized":"2024-09-12T19:28:02.583893+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:30.401098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":233,"num_read_kb":216,"num_write":428,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'374","reported_seq":2048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.351332+0000","last_change":"2024-09-12T19:29:53.351332+0000","last_active":"2024-09-12T19:29:53.351332+0000","last_peered":"2024-09-12T19:29:53.351332+0000","last_clean":"2024-09-12T19:29:53.351332+0000","last_became_active":"2024-09-12T17:36:36.883862+0000","last_became_peered":"2024-09-12T17:36:36.883862+0000","last_unstale":"2024-09-12T19:29:53.351332+0000","last_undegraded":"2024-09-12T19:29:53.351332+0000","last_fullsized":"2024-09-12T19:29:53.351332+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T19:29:53.351161+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T19:29:53.351161+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.351161+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:18.340873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2422,"num_read_kb":2340,"num_write":416,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'355","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.004315+0000","last_change":"2024-09-12T19:29:51.004315+0000","last_active":"2024-09-12T19:29:51.004315+0000","last_peered":"2024-09-12T19:29:51.004315+0000","last_clean":"2024-09-12T19:29:51.004315+0000","last_became_active":"2024-09-12T17:36:34.868641+0000","last_became_peered":"2024-09-12T17:36:34.868641+0000","last_unstale":"2024-09-12T19:29:51.004315+0000","last_undegraded":"2024-09-12T19:29:51.004315+0000","last_fullsized":"2024-09-12T19:29:51.004315+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T19:29:51.004074+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T19:29:51.004074+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.004074+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:19.751431+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1398988,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":547,"num_read_kb":35743,"num_write":1181,"num_write_kb":32710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":556,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.075936+0000","last_change":"2024-09-12T19:29:50.075936+0000","last_active":"2024-09-12T19:29:50.075936+0000","last_peered":"2024-09-12T19:29:50.075936+0000","last_clean":"2024-09-12T19:29:50.075936+0000","last_became_active":"2024-09-12T17:36:22.058794+0000","last_became_peered":"2024-09-12T17:36:22.058794+0000","last_unstale":"2024-09-12T19:29:50.075936+0000","last_undegraded":"2024-09-12T19:29:50.075936+0000","last_fullsized":"2024-09-12T19:29:50.075936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:50.075752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:50.075752+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.075752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:54.554291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":544,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.900228+0000","last_change":"2024-09-12T19:30:04.900228+0000","last_active":"2024-09-12T19:30:04.900228+0000","last_peered":"2024-09-12T19:30:04.900228+0000","last_clean":"2024-09-12T19:30:04.900228+0000","last_became_active":"2024-09-12T17:36:38.901418+0000","last_became_peered":"2024-09-12T17:36:38.901418+0000","last_unstale":"2024-09-12T19:30:04.900228+0000","last_undegraded":"2024-09-12T19:30:04.900228+0000","last_fullsized":"2024-09-12T19:30:04.900228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.900053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.900053+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.900053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:11.827647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'816","reported_seq":1613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.433089+0000","last_change":"2024-09-12T19:30:03.433089+0000","last_active":"2024-09-12T19:30:03.433089+0000","last_peered":"2024-09-12T19:30:03.433089+0000","last_clean":"2024-09-12T19:30:03.433089+0000","last_became_active":"2024-09-12T17:36:40.908231+0000","last_became_peered":"2024-09-12T17:36:40.908231+0000","last_unstale":"2024-09-12T19:30:03.433089+0000","last_undegraded":"2024-09-12T19:30:03.433089+0000","last_fullsized":"2024-09-12T19:30:03.433089+0000","mapping_epoch":30,"log_start":"265'800","ondisk_log_start":"265'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'816","last_scrub_stamp":"2024-09-12T19:30:03.432954+0000","last_deep_scrub":"265'816","last_deep_scrub_stamp":"2024-09-12T19:30:03.432954+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.432954+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:15.981426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146317,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3243,"num_write":1152,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.693604+0000","last_change":"2024-09-12T17:36:42.933142+0000","last_active":"2024-09-12T19:27:10.693604+0000","last_peered":"2024-09-12T19:27:10.693604+0000","last_clean":"2024-09-12T19:27:10.693604+0000","last_became_active":"2024-09-12T17:36:42.932086+0000","last_became_peered":"2024-09-12T17:36:42.932086+0000","last_unstale":"2024-09-12T19:27:10.693604+0000","last_undegraded":"2024-09-12T19:27:10.693604+0000","last_fullsized":"2024-09-12T19:27:10.693604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:49.913999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'126","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249809+0000","last_change":"2024-09-12T17:36:44.961527+0000","last_active":"2024-09-12T19:27:00.249809+0000","last_peered":"2024-09-12T19:27:00.249809+0000","last_clean":"2024-09-12T19:27:00.249809+0000","last_became_active":"2024-09-12T17:36:44.960744+0000","last_became_peered":"2024-09-12T17:36:44.960744+0000","last_unstale":"2024-09-12T19:27:00.249809+0000","last_undegraded":"2024-09-12T19:27:00.249809+0000","last_fullsized":"2024-09-12T19:27:00.249809+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:42.564425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":186,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'135","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:03.080882+0000","last_change":"2024-09-12T17:36:44.940544+0000","last_active":"2024-09-12T19:28:03.080882+0000","last_peered":"2024-09-12T19:28:03.080882+0000","last_clean":"2024-09-12T19:28:03.080882+0000","last_became_active":"2024-09-12T17:36:44.939820+0000","last_became_peered":"2024-09-12T17:36:44.939820+0000","last_unstale":"2024-09-12T19:28:03.080882+0000","last_undegraded":"2024-09-12T19:28:03.080882+0000","last_fullsized":"2024-09-12T19:28:03.080882+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:23.567209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":235,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'802","reported_seq":2469,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.382818+0000","last_change":"2024-09-12T19:29:58.382818+0000","last_active":"2024-09-12T19:29:58.382818+0000","last_peered":"2024-09-12T19:29:58.382818+0000","last_clean":"2024-09-12T19:29:58.382818+0000","last_became_active":"2024-09-12T17:36:36.883481+0000","last_became_peered":"2024-09-12T17:36:36.883481+0000","last_unstale":"2024-09-12T19:29:58.382818+0000","last_undegraded":"2024-09-12T19:29:58.382818+0000","last_fullsized":"2024-09-12T19:29:58.382818+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'802","last_scrub_stamp":"2024-09-12T19:29:58.382629+0000","last_deep_scrub":"265'802","last_deep_scrub_stamp":"2024-09-12T19:29:58.382629+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.382629+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:14.006063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3831,"num_read_kb":3485,"num_write":1040,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'319","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.227016+0000","last_change":"2024-09-12T19:29:58.227016+0000","last_active":"2024-09-12T19:29:58.227016+0000","last_peered":"2024-09-12T19:29:58.227016+0000","last_clean":"2024-09-12T19:29:58.227016+0000","last_became_active":"2024-09-12T17:36:34.861702+0000","last_became_peered":"2024-09-12T17:36:34.861702+0000","last_unstale":"2024-09-12T19:29:58.227016+0000","last_undegraded":"2024-09-12T19:29:58.227016+0000","last_fullsized":"2024-09-12T19:29:58.227016+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T19:29:58.226750+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T19:29:58.226750+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.226750+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:18.778525+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273696,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":464,"num_read_kb":26224,"num_write":1045,"num_write_kb":25793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.536076+0000","last_change":"2024-09-12T19:30:05.536076+0000","last_active":"2024-09-12T19:30:05.536076+0000","last_peered":"2024-09-12T19:30:05.536076+0000","last_clean":"2024-09-12T19:30:05.536076+0000","last_became_active":"2024-09-12T17:36:38.894742+0000","last_became_peered":"2024-09-12T17:36:38.894742+0000","last_unstale":"2024-09-12T19:30:05.536076+0000","last_undegraded":"2024-09-12T19:30:05.536076+0000","last_fullsized":"2024-09-12T19:30:05.536076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:05.535904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:05.535904+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.535904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:41.432968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'332","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.532627+0000","last_change":"2024-09-12T19:30:08.532627+0000","last_active":"2024-09-12T19:30:08.532627+0000","last_peered":"2024-09-12T19:30:08.532627+0000","last_clean":"2024-09-12T19:30:08.532627+0000","last_became_active":"2024-09-12T17:36:40.892710+0000","last_became_peered":"2024-09-12T17:36:40.892710+0000","last_unstale":"2024-09-12T19:30:08.532627+0000","last_undegraded":"2024-09-12T19:30:08.532627+0000","last_fullsized":"2024-09-12T19:30:08.532627+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T19:30:08.532361+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T19:30:08.532361+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.532361+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:49.724335+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49819,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":1091,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664522+0000","last_change":"2024-09-12T17:36:42.939570+0000","last_active":"2024-09-12T19:26:25.664522+0000","last_peered":"2024-09-12T19:26:25.664522+0000","last_clean":"2024-09-12T19:26:25.664522+0000","last_became_active":"2024-09-12T17:36:42.938834+0000","last_became_peered":"2024-09-12T17:36:42.938834+0000","last_unstale":"2024-09-12T19:26:25.664522+0000","last_undegraded":"2024-09-12T19:26:25.664522+0000","last_fullsized":"2024-09-12T19:26:25.664522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:13.130674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'139","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.674057+0000","last_change":"2024-09-12T17:36:44.953890+0000","last_active":"2024-09-12T19:27:05.674057+0000","last_peered":"2024-09-12T19:27:05.674057+0000","last_clean":"2024-09-12T19:27:05.674057+0000","last_became_active":"2024-09-12T17:36:44.953117+0000","last_became_peered":"2024-09-12T17:36:44.953117+0000","last_unstale":"2024-09-12T19:27:05.674057+0000","last_undegraded":"2024-09-12T19:27:05.674057+0000","last_fullsized":"2024-09-12T19:27:05.674057+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:53.223197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":202,"num_write":357,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'472","reported_seq":2085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.921083+0000","last_change":"2024-09-12T19:29:56.921083+0000","last_active":"2024-09-12T19:29:56.921083+0000","last_peered":"2024-09-12T19:29:56.921083+0000","last_clean":"2024-09-12T19:29:56.921083+0000","last_became_active":"2024-09-12T17:36:36.900955+0000","last_became_peered":"2024-09-12T17:36:36.900955+0000","last_unstale":"2024-09-12T19:29:56.921083+0000","last_undegraded":"2024-09-12T19:29:56.921083+0000","last_fullsized":"2024-09-12T19:29:56.921083+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'472","last_scrub_stamp":"2024-09-12T19:29:56.920906+0000","last_deep_scrub":"265'472","last_deep_scrub_stamp":"2024-09-12T19:29:56.920906+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.920906+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:13.700998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2490,"num_read_kb":2331,"num_write":571,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'352","reported_seq":1130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.412206+0000","last_change":"2024-09-12T19:29:51.412206+0000","last_active":"2024-09-12T19:29:51.412206+0000","last_peered":"2024-09-12T19:29:51.412206+0000","last_clean":"2024-09-12T19:29:51.412206+0000","last_became_active":"2024-09-12T17:36:34.878069+0000","last_became_peered":"2024-09-12T17:36:34.878069+0000","last_unstale":"2024-09-12T19:29:51.412206+0000","last_undegraded":"2024-09-12T19:29:51.412206+0000","last_fullsized":"2024-09-12T19:29:51.412206+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:29:51.411936+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:29:51.411936+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.411936+0000","objects_scrubbed":11,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:28.683406+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097855,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":782,"num_read_kb":26278,"num_write":971,"num_write_kb":31119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682090+0000","last_change":"2024-09-12T17:36:38.895965+0000","last_active":"2024-09-12T19:26:20.682090+0000","last_peered":"2024-09-12T19:26:20.682090+0000","last_clean":"2024-09-12T19:26:20.682090+0000","last_became_active":"2024-09-12T17:36:38.894800+0000","last_became_peered":"2024-09-12T17:36:38.894800+0000","last_unstale":"2024-09-12T19:26:20.682090+0000","last_undegraded":"2024-09-12T19:26:20.682090+0000","last_fullsized":"2024-09-12T19:26:20.682090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:45.719885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'81","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:22.977940+0000","last_change":"2024-09-12T17:36:40.910425+0000","last_active":"2024-09-12T19:27:22.977940+0000","last_peered":"2024-09-12T19:27:22.977940+0000","last_clean":"2024-09-12T19:27:22.977940+0000","last_became_active":"2024-09-12T17:36:40.909470+0000","last_became_peered":"2024-09-12T17:36:40.909470+0000","last_unstale":"2024-09-12T19:27:22.977940+0000","last_undegraded":"2024-09-12T19:27:22.977940+0000","last_fullsized":"2024-09-12T19:27:22.977940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:59.636810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.242569+0000","last_change":"2024-09-12T17:36:42.923023+0000","last_active":"2024-09-12T19:26:25.242569+0000","last_peered":"2024-09-12T19:26:25.242569+0000","last_clean":"2024-09-12T19:26:25.242569+0000","last_became_active":"2024-09-12T17:36:42.922352+0000","last_became_peered":"2024-09-12T17:36:42.922352+0000","last_unstale":"2024-09-12T19:26:25.242569+0000","last_undegraded":"2024-09-12T19:26:25.242569+0000","last_fullsized":"2024-09-12T19:26:25.242569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:06.521341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'237","reported_seq":778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.928944+0000","last_change":"2024-09-12T17:36:44.946524+0000","last_active":"2024-09-12T19:28:02.928944+0000","last_peered":"2024-09-12T19:28:02.928944+0000","last_clean":"2024-09-12T19:28:02.928944+0000","last_became_active":"2024-09-12T17:36:44.945429+0000","last_became_peered":"2024-09-12T17:36:44.945429+0000","last_unstale":"2024-09-12T19:28:02.928944+0000","last_undegraded":"2024-09-12T19:28:02.928944+0000","last_fullsized":"2024-09-12T19:28:02.928944+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:03.136753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":307,"num_read_kb":303,"num_write":509,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'828","reported_seq":2367,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.946318+0000","last_change":"2024-09-12T19:29:55.946318+0000","last_active":"2024-09-12T19:29:55.946318+0000","last_peered":"2024-09-12T19:29:55.946318+0000","last_clean":"2024-09-12T19:29:55.946318+0000","last_became_active":"2024-09-12T17:36:36.901053+0000","last_became_peered":"2024-09-12T17:36:36.901053+0000","last_unstale":"2024-09-12T19:29:55.946318+0000","last_undegraded":"2024-09-12T19:29:55.946318+0000","last_fullsized":"2024-09-12T19:29:55.946318+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'828","last_scrub_stamp":"2024-09-12T19:29:55.946101+0000","last_deep_scrub":"265'828","last_deep_scrub_stamp":"2024-09-12T19:29:55.946101+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.946101+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:53.712277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3878,"num_read_kb":3474,"num_write":1082,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'361","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.357889+0000","last_change":"2024-09-12T19:29:50.357889+0000","last_active":"2024-09-12T19:29:50.357889+0000","last_peered":"2024-09-12T19:29:50.357889+0000","last_clean":"2024-09-12T19:29:50.357889+0000","last_became_active":"2024-09-12T17:36:34.877620+0000","last_became_peered":"2024-09-12T17:36:34.877620+0000","last_unstale":"2024-09-12T19:29:50.357889+0000","last_undegraded":"2024-09-12T19:29:50.357889+0000","last_fullsized":"2024-09-12T19:29:50.357889+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:29:50.357552+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:29:50.357552+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.357552+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:17.243177+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048740,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":51733,"num_write":1081,"num_write_kb":38676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":538,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.416021+0000","last_change":"2024-09-12T19:30:02.416021+0000","last_active":"2024-09-12T19:30:02.416021+0000","last_peered":"2024-09-12T19:30:02.416021+0000","last_clean":"2024-09-12T19:30:02.416021+0000","last_became_active":"2024-09-12T17:36:38.902188+0000","last_became_peered":"2024-09-12T17:36:38.902188+0000","last_unstale":"2024-09-12T19:30:02.416021+0000","last_undegraded":"2024-09-12T19:30:02.416021+0000","last_fullsized":"2024-09-12T19:30:02.416021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:02.415808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:02.415808+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.415808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:35.156107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'377","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.842788+0000","last_change":"2024-09-12T17:36:40.899887+0000","last_active":"2024-09-12T19:29:41.842788+0000","last_peered":"2024-09-12T19:29:41.842788+0000","last_clean":"2024-09-12T19:29:41.842788+0000","last_became_active":"2024-09-12T17:36:40.899201+0000","last_became_peered":"2024-09-12T17:36:40.899201+0000","last_unstale":"2024-09-12T19:29:41.842788+0000","last_undegraded":"2024-09-12T19:29:41.842788+0000","last_fullsized":"2024-09-12T19:29:41.842788+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:19.009661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51900,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":1290,"num_write":486,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.084454+0000","last_change":"2024-09-12T17:36:42.930518+0000","last_active":"2024-09-12T19:26:25.084454+0000","last_peered":"2024-09-12T19:26:25.084454+0000","last_clean":"2024-09-12T19:26:25.084454+0000","last_became_active":"2024-09-12T17:36:42.928596+0000","last_became_peered":"2024-09-12T17:36:42.928596+0000","last_unstale":"2024-09-12T19:26:25.084454+0000","last_undegraded":"2024-09-12T19:26:25.084454+0000","last_fullsized":"2024-09-12T19:26:25.084454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:38.476152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'143","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360848+0000","last_change":"2024-09-12T17:36:44.963106+0000","last_active":"2024-09-12T19:26:45.360848+0000","last_peered":"2024-09-12T19:26:45.360848+0000","last_clean":"2024-09-12T19:26:45.360848+0000","last_became_active":"2024-09-12T17:36:44.962445+0000","last_became_peered":"2024-09-12T17:36:44.962445+0000","last_unstale":"2024-09-12T19:26:45.360848+0000","last_undegraded":"2024-09-12T19:26:45.360848+0000","last_fullsized":"2024-09-12T19:26:45.360848+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:03.293578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":234,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'603","reported_seq":2256,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.115050+0000","last_change":"2024-09-12T19:29:56.115050+0000","last_active":"2024-09-12T19:29:56.115050+0000","last_peered":"2024-09-12T19:29:56.115050+0000","last_clean":"2024-09-12T19:29:56.115050+0000","last_became_active":"2024-09-12T17:36:36.903813+0000","last_became_peered":"2024-09-12T17:36:36.903813+0000","last_unstale":"2024-09-12T19:29:56.115050+0000","last_undegraded":"2024-09-12T19:29:56.115050+0000","last_fullsized":"2024-09-12T19:29:56.115050+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'603","last_scrub_stamp":"2024-09-12T19:29:56.114858+0000","last_deep_scrub":"265'603","last_deep_scrub_stamp":"2024-09-12T19:29:56.114858+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.114858+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:39.417617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3115,"num_read_kb":2836,"num_write":758,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'307","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.974381+0000","last_change":"2024-09-12T19:29:50.974381+0000","last_active":"2024-09-12T19:29:50.974381+0000","last_peered":"2024-09-12T19:29:50.974381+0000","last_clean":"2024-09-12T19:29:50.974381+0000","last_became_active":"2024-09-12T17:36:34.886741+0000","last_became_peered":"2024-09-12T17:36:34.886741+0000","last_unstale":"2024-09-12T19:29:50.974381+0000","last_undegraded":"2024-09-12T19:29:50.974381+0000","last_fullsized":"2024-09-12T19:29:50.974381+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'307","last_scrub_stamp":"2024-09-12T19:29:50.974228+0000","last_deep_scrub":"265'307","last_deep_scrub_stamp":"2024-09-12T19:29:50.974228+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.974228+0000","objects_scrubbed":13,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:10.453984+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1961495,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":454,"num_read_kb":24643,"num_write":1003,"num_write_kb":38417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.353955+0000","last_change":"2024-09-12T17:36:38.903818+0000","last_active":"2024-09-12T19:26:20.353955+0000","last_peered":"2024-09-12T19:26:20.353955+0000","last_clean":"2024-09-12T19:26:20.353955+0000","last_became_active":"2024-09-12T17:36:38.903210+0000","last_became_peered":"2024-09-12T17:36:38.903210+0000","last_unstale":"2024-09-12T19:26:20.353955+0000","last_undegraded":"2024-09-12T19:26:20.353955+0000","last_fullsized":"2024-09-12T19:26:20.353955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:00.851761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'308","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.727023+0000","last_change":"2024-09-12T17:36:40.913086+0000","last_active":"2024-09-12T19:29:41.727023+0000","last_peered":"2024-09-12T19:29:41.727023+0000","last_clean":"2024-09-12T19:29:41.727023+0000","last_became_active":"2024-09-12T17:36:40.912283+0000","last_became_peered":"2024-09-12T17:36:40.912283+0000","last_unstale":"2024-09-12T19:29:41.727023+0000","last_undegraded":"2024-09-12T19:29:41.727023+0000","last_fullsized":"2024-09-12T19:29:41.727023+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:05.161253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1100,"num_write":404,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.664637+0000","last_change":"2024-09-12T17:36:42.928432+0000","last_active":"2024-09-12T19:26:25.664637+0000","last_peered":"2024-09-12T19:26:25.664637+0000","last_clean":"2024-09-12T19:26:25.664637+0000","last_became_active":"2024-09-12T17:36:42.927724+0000","last_became_peered":"2024-09-12T17:36:42.927724+0000","last_unstale":"2024-09-12T19:26:25.664637+0000","last_undegraded":"2024-09-12T19:26:25.664637+0000","last_fullsized":"2024-09-12T19:26:25.664637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:30.771719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'721","reported_seq":2248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.028622+0000","last_change":"2024-09-12T17:36:36.886104+0000","last_active":"2024-09-12T19:29:21.028622+0000","last_peered":"2024-09-12T19:29:21.028622+0000","last_clean":"2024-09-12T19:29:21.028622+0000","last_became_active":"2024-09-12T17:36:36.885820+0000","last_became_peered":"2024-09-12T17:36:36.885820+0000","last_unstale":"2024-09-12T19:29:21.028622+0000","last_undegraded":"2024-09-12T19:29:21.028622+0000","last_fullsized":"2024-09-12T19:29:21.028622+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.701415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3501,"num_read_kb":3197,"num_write":936,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'342","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.955269+0000","last_change":"2024-09-12T19:29:51.955269+0000","last_active":"2024-09-12T19:29:51.955269+0000","last_peered":"2024-09-12T19:29:51.955269+0000","last_clean":"2024-09-12T19:29:51.955269+0000","last_became_active":"2024-09-12T17:36:34.887018+0000","last_became_peered":"2024-09-12T17:36:34.887018+0000","last_unstale":"2024-09-12T19:29:51.955269+0000","last_undegraded":"2024-09-12T19:29:51.955269+0000","last_fullsized":"2024-09-12T19:29:51.955269+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:51.955017+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:51.955017+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.955017+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:13.242565+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":38393,"num_write":1072,"num_write_kb":34235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.520319+0000","last_change":"2024-09-12T19:30:06.520319+0000","last_active":"2024-09-12T19:30:06.520319+0000","last_peered":"2024-09-12T19:30:06.520319+0000","last_clean":"2024-09-12T19:30:06.520319+0000","last_became_active":"2024-09-12T17:36:38.894452+0000","last_became_peered":"2024-09-12T17:36:38.894452+0000","last_unstale":"2024-09-12T19:30:06.520319+0000","last_undegraded":"2024-09-12T19:30:06.520319+0000","last_fullsized":"2024-09-12T19:30:06.520319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:06.520134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:06.520134+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.520134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:45.097198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'514","reported_seq":1187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.688440+0000","last_change":"2024-09-12T17:36:40.910273+0000","last_active":"2024-09-12T19:29:41.688440+0000","last_peered":"2024-09-12T19:29:41.688440+0000","last_clean":"2024-09-12T19:29:41.688440+0000","last_became_active":"2024-09-12T17:36:40.909552+0000","last_became_peered":"2024-09-12T17:36:40.909552+0000","last_unstale":"2024-09-12T19:29:41.688440+0000","last_undegraded":"2024-09-12T19:29:41.688440+0000","last_fullsized":"2024-09-12T19:29:41.688440+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:32.101093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105771,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":904,"num_read_kb":2059,"num_write":766,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.247037+0000","last_change":"2024-09-12T17:36:42.943311+0000","last_active":"2024-09-12T19:26:45.247037+0000","last_peered":"2024-09-12T19:26:45.247037+0000","last_clean":"2024-09-12T19:26:45.247037+0000","last_became_active":"2024-09-12T17:36:42.942627+0000","last_became_peered":"2024-09-12T17:36:42.942627+0000","last_unstale":"2024-09-12T19:26:45.247037+0000","last_undegraded":"2024-09-12T19:26:45.247037+0000","last_fullsized":"2024-09-12T19:26:45.247037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:28.862834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'167","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:57.461795+0000","last_change":"2024-09-12T17:36:44.959491+0000","last_active":"2024-09-12T19:27:57.461795+0000","last_peered":"2024-09-12T19:27:57.461795+0000","last_clean":"2024-09-12T19:27:57.461795+0000","last_became_active":"2024-09-12T17:36:44.956655+0000","last_became_peered":"2024-09-12T17:36:44.956655+0000","last_unstale":"2024-09-12T19:27:57.461795+0000","last_undegraded":"2024-09-12T19:27:57.461795+0000","last_fullsized":"2024-09-12T19:27:57.461795+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:59.575861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":241,"num_write":385,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'358","reported_seq":1947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.903872+0000","last_change":"2024-09-12T19:30:00.903872+0000","last_active":"2024-09-12T19:30:00.903872+0000","last_peered":"2024-09-12T19:30:00.903872+0000","last_clean":"2024-09-12T19:30:00.903872+0000","last_became_active":"2024-09-12T17:36:36.911889+0000","last_became_peered":"2024-09-12T17:36:36.911889+0000","last_unstale":"2024-09-12T19:30:00.903872+0000","last_undegraded":"2024-09-12T19:30:00.903872+0000","last_fullsized":"2024-09-12T19:30:00.903872+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T19:30:00.903644+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T19:30:00.903644+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.903644+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:48.670244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2021,"num_read_kb":1969,"num_write":390,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'360","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.982295+0000","last_change":"2024-09-12T19:29:53.982295+0000","last_active":"2024-09-12T19:29:53.982295+0000","last_peered":"2024-09-12T19:29:53.982295+0000","last_clean":"2024-09-12T19:29:53.982295+0000","last_became_active":"2024-09-12T17:36:34.851161+0000","last_became_peered":"2024-09-12T17:36:34.851161+0000","last_unstale":"2024-09-12T19:29:53.982295+0000","last_undegraded":"2024-09-12T19:29:53.982295+0000","last_fullsized":"2024-09-12T19:29:53.982295+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T19:29:53.982102+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T19:29:53.982102+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.982102+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:47.944166+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273705,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":731,"num_read_kb":47360,"num_write":1100,"num_write_kb":33375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.251083+0000","last_change":"2024-09-12T17:36:38.905238+0000","last_active":"2024-09-12T19:27:05.251083+0000","last_peered":"2024-09-12T19:27:05.251083+0000","last_clean":"2024-09-12T19:27:05.251083+0000","last_became_active":"2024-09-12T17:36:38.904409+0000","last_became_peered":"2024-09-12T17:36:38.904409+0000","last_unstale":"2024-09-12T19:27:05.251083+0000","last_undegraded":"2024-09-12T19:27:05.251083+0000","last_fullsized":"2024-09-12T19:27:05.251083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:40.577534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'404","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.767941+0000","last_change":"2024-09-12T17:36:40.903223+0000","last_active":"2024-09-12T19:29:41.767941+0000","last_peered":"2024-09-12T19:29:41.767941+0000","last_clean":"2024-09-12T19:29:41.767941+0000","last_became_active":"2024-09-12T17:36:40.902718+0000","last_became_peered":"2024-09-12T17:36:40.902718+0000","last_unstale":"2024-09-12T19:29:41.767941+0000","last_undegraded":"2024-09-12T19:29:41.767941+0000","last_fullsized":"2024-09-12T19:29:41.767941+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.363639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54769,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":679,"num_read_kb":1358,"num_write":564,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.256436+0000","last_change":"2024-09-12T17:36:42.921077+0000","last_active":"2024-09-12T19:26:45.256436+0000","last_peered":"2024-09-12T19:26:45.256436+0000","last_clean":"2024-09-12T19:26:45.256436+0000","last_became_active":"2024-09-12T17:36:42.920352+0000","last_became_peered":"2024-09-12T17:36:42.920352+0000","last_unstale":"2024-09-12T19:26:45.256436+0000","last_undegraded":"2024-09-12T19:26:45.256436+0000","last_fullsized":"2024-09-12T19:26:45.256436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:47.099873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'181","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355355+0000","last_change":"2024-09-12T17:36:44.946661+0000","last_active":"2024-09-12T19:26:25.355355+0000","last_peered":"2024-09-12T19:26:25.355355+0000","last_clean":"2024-09-12T19:26:25.355355+0000","last_became_active":"2024-09-12T17:36:44.945753+0000","last_became_peered":"2024-09-12T17:36:44.945753+0000","last_unstale":"2024-09-12T19:26:25.355355+0000","last_undegraded":"2024-09-12T19:26:25.355355+0000","last_fullsized":"2024-09-12T19:26:25.355355+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:51.605529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":278,"num_read_kb":268,"num_write":526,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'525","reported_seq":2263,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.085497+0000","last_change":"2024-09-12T19:29:58.085497+0000","last_active":"2024-09-12T19:29:58.085497+0000","last_peered":"2024-09-12T19:29:58.085497+0000","last_clean":"2024-09-12T19:29:58.085497+0000","last_became_active":"2024-09-12T17:36:36.909488+0000","last_became_peered":"2024-09-12T17:36:36.909488+0000","last_unstale":"2024-09-12T19:29:58.085497+0000","last_undegraded":"2024-09-12T19:29:58.085497+0000","last_fullsized":"2024-09-12T19:29:58.085497+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'525","last_scrub_stamp":"2024-09-12T19:29:58.085322+0000","last_deep_scrub":"265'525","last_deep_scrub_stamp":"2024-09-12T19:29:58.085322+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.085322+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:33.573152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2968,"num_read_kb":2777,"num_write":639,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'391","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:46.957992+0000","last_change":"2024-09-12T19:29:46.957992+0000","last_active":"2024-09-12T19:29:46.957992+0000","last_peered":"2024-09-12T19:29:46.957992+0000","last_clean":"2024-09-12T19:29:46.957992+0000","last_became_active":"2024-09-12T17:36:34.857645+0000","last_became_peered":"2024-09-12T17:36:34.857645+0000","last_unstale":"2024-09-12T19:29:46.957992+0000","last_undegraded":"2024-09-12T19:29:46.957992+0000","last_fullsized":"2024-09-12T19:29:46.957992+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:29:46.957895+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:29:46.957895+0000","last_clean_scrub_stamp":"2024-09-12T19:29:46.957895+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:29.114514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287556,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":605,"num_read_kb":13478,"num_write":1299,"num_write_kb":33813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.381026+0000","last_change":"2024-09-12T19:30:04.381026+0000","last_active":"2024-09-12T19:30:04.381026+0000","last_peered":"2024-09-12T19:30:04.381026+0000","last_clean":"2024-09-12T19:30:04.381026+0000","last_became_active":"2024-09-12T17:36:38.904619+0000","last_became_peered":"2024-09-12T17:36:38.904619+0000","last_unstale":"2024-09-12T19:30:04.381026+0000","last_undegraded":"2024-09-12T19:30:04.381026+0000","last_fullsized":"2024-09-12T19:30:04.381026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.380854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.380854+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.380854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:16.162425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'316","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.412015+0000","last_change":"2024-09-12T17:36:40.909967+0000","last_active":"2024-09-12T19:29:42.412015+0000","last_peered":"2024-09-12T19:29:42.412015+0000","last_clean":"2024-09-12T19:29:42.412015+0000","last_became_active":"2024-09-12T17:36:40.909189+0000","last_became_peered":"2024-09-12T17:36:40.909189+0000","last_unstale":"2024-09-12T19:29:42.412015+0000","last_undegraded":"2024-09-12T19:29:42.412015+0000","last_fullsized":"2024-09-12T19:29:42.412015+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:32.736700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":521,"num_read_kb":1073,"num_write":404,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:05.674082+0000","last_change":"2024-09-12T17:36:42.939553+0000","last_active":"2024-09-12T19:27:05.674082+0000","last_peered":"2024-09-12T19:27:05.674082+0000","last_clean":"2024-09-12T19:27:05.674082+0000","last_became_active":"2024-09-12T17:36:42.938451+0000","last_became_peered":"2024-09-12T17:36:42.938451+0000","last_unstale":"2024-09-12T19:27:05.674082+0000","last_undegraded":"2024-09-12T19:27:05.674082+0000","last_fullsized":"2024-09-12T19:27:05.674082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:33.402851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'109","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.052785+0000","last_change":"2024-09-12T17:36:44.950080+0000","last_active":"2024-09-12T19:29:22.052785+0000","last_peered":"2024-09-12T19:29:22.052785+0000","last_clean":"2024-09-12T19:29:22.052785+0000","last_became_active":"2024-09-12T17:36:44.949351+0000","last_became_peered":"2024-09-12T17:36:44.949351+0000","last_unstale":"2024-09-12T19:29:22.052785+0000","last_undegraded":"2024-09-12T19:29:22.052785+0000","last_fullsized":"2024-09-12T19:29:22.052785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:39.166790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":161,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'477","reported_seq":2161,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.916554+0000","last_change":"2024-09-12T19:29:58.916554+0000","last_active":"2024-09-12T19:29:58.916554+0000","last_peered":"2024-09-12T19:29:58.916554+0000","last_clean":"2024-09-12T19:29:58.916554+0000","last_became_active":"2024-09-12T17:36:36.902998+0000","last_became_peered":"2024-09-12T17:36:36.902998+0000","last_unstale":"2024-09-12T19:29:58.916554+0000","last_undegraded":"2024-09-12T19:29:58.916554+0000","last_fullsized":"2024-09-12T19:29:58.916554+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'477","last_scrub_stamp":"2024-09-12T19:29:58.916239+0000","last_deep_scrub":"265'477","last_deep_scrub_stamp":"2024-09-12T19:29:58.916239+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.916239+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:11.138862+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2683,"num_read_kb":2531,"num_write":585,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2003,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'409","reported_seq":1145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.984339+0000","last_change":"2024-09-12T19:29:54.984339+0000","last_active":"2024-09-12T19:29:54.984339+0000","last_peered":"2024-09-12T19:29:54.984339+0000","last_clean":"2024-09-12T19:29:54.984339+0000","last_became_active":"2024-09-12T17:36:34.867987+0000","last_became_peered":"2024-09-12T17:36:34.867987+0000","last_unstale":"2024-09-12T19:29:54.984339+0000","last_undegraded":"2024-09-12T19:29:54.984339+0000","last_fullsized":"2024-09-12T19:29:54.984339+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T19:29:54.984140+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T19:29:54.984140+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.984140+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:32.375716+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062574,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":616,"num_read_kb":94353,"num_write":1270,"num_write_kb":45131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.686764+0000","last_change":"2024-09-12T17:36:38.901399+0000","last_active":"2024-09-12T19:26:40.686764+0000","last_peered":"2024-09-12T19:26:40.686764+0000","last_clean":"2024-09-12T19:26:40.686764+0000","last_became_active":"2024-09-12T17:36:38.900687+0000","last_became_peered":"2024-09-12T17:36:38.900687+0000","last_unstale":"2024-09-12T19:26:40.686764+0000","last_undegraded":"2024-09-12T19:26:40.686764+0000","last_fullsized":"2024-09-12T19:26:40.686764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:39.929327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'157","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:34.443859+0000","last_change":"2024-09-12T17:36:40.905441+0000","last_active":"2024-09-12T19:27:34.443859+0000","last_peered":"2024-09-12T19:27:34.443859+0000","last_clean":"2024-09-12T19:27:34.443859+0000","last_became_active":"2024-09-12T17:36:40.904671+0000","last_became_peered":"2024-09-12T17:36:40.904671+0000","last_unstale":"2024-09-12T19:27:34.443859+0000","last_undegraded":"2024-09-12T19:27:34.443859+0000","last_fullsized":"2024-09-12T19:27:34.443859+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:48.997983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":202,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'770","reported_seq":3477,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.993434+0000","last_change":"2024-09-12T17:36:42.930179+0000","last_active":"2024-09-12T19:29:40.993434+0000","last_peered":"2024-09-12T19:29:40.993434+0000","last_clean":"2024-09-12T19:29:40.993434+0000","last_became_active":"2024-09-12T17:36:42.929232+0000","last_became_peered":"2024-09-12T17:36:42.929232+0000","last_unstale":"2024-09-12T19:29:40.993434+0000","last_undegraded":"2024-09-12T19:29:40.993434+0000","last_fullsized":"2024-09-12T19:29:40.993434+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:00.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'132","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.338006+0000","last_change":"2024-09-12T17:36:44.946960+0000","last_active":"2024-09-12T19:26:59.338006+0000","last_peered":"2024-09-12T19:26:59.338006+0000","last_clean":"2024-09-12T19:26:59.338006+0000","last_became_active":"2024-09-12T17:36:44.945777+0000","last_became_peered":"2024-09-12T17:36:44.945777+0000","last_unstale":"2024-09-12T19:26:59.338006+0000","last_undegraded":"2024-09-12T19:26:59.338006+0000","last_fullsized":"2024-09-12T19:26:59.338006+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:22.225543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":212,"num_write":329,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'432","reported_seq":1993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.395163+0000","last_change":"2024-09-12T19:30:00.395163+0000","last_active":"2024-09-12T19:30:00.395163+0000","last_peered":"2024-09-12T19:30:00.395163+0000","last_clean":"2024-09-12T19:30:00.395163+0000","last_became_active":"2024-09-12T17:36:36.896871+0000","last_became_peered":"2024-09-12T17:36:36.896871+0000","last_unstale":"2024-09-12T19:30:00.395163+0000","last_undegraded":"2024-09-12T19:30:00.395163+0000","last_fullsized":"2024-09-12T19:30:00.395163+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'432","last_scrub_stamp":"2024-09-12T19:30:00.394970+0000","last_deep_scrub":"265'432","last_deep_scrub_stamp":"2024-09-12T19:30:00.394970+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.394970+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:25.462640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2316,"num_read_kb":2187,"num_write":500,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'403","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.911598+0000","last_change":"2024-09-12T19:29:50.911598+0000","last_active":"2024-09-12T19:29:50.911598+0000","last_peered":"2024-09-12T19:29:50.911598+0000","last_clean":"2024-09-12T19:29:50.911598+0000","last_became_active":"2024-09-12T17:36:34.868685+0000","last_became_peered":"2024-09-12T17:36:34.868685+0000","last_unstale":"2024-09-12T19:29:50.911598+0000","last_undegraded":"2024-09-12T19:29:50.911598+0000","last_fullsized":"2024-09-12T19:29:50.911598+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T19:29:50.911321+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T19:29:50.911321+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.911321+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:21:19.555113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":585,"num_read_kb":59989,"num_write":1252,"num_write_kb":34100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.878634+0000","last_change":"2024-09-12T19:30:04.878634+0000","last_active":"2024-09-12T19:30:04.878634+0000","last_peered":"2024-09-12T19:30:04.878634+0000","last_clean":"2024-09-12T19:30:04.878634+0000","last_became_active":"2024-09-12T17:36:38.885092+0000","last_became_peered":"2024-09-12T17:36:38.885092+0000","last_unstale":"2024-09-12T19:30:04.878634+0000","last_undegraded":"2024-09-12T19:30:04.878634+0000","last_fullsized":"2024-09-12T19:30:04.878634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.878450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.878450+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.878450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:40.745336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'417","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.443046+0000","last_change":"2024-09-12T19:30:05.443046+0000","last_active":"2024-09-12T19:30:05.443046+0000","last_peered":"2024-09-12T19:30:05.443046+0000","last_clean":"2024-09-12T19:30:05.443046+0000","last_became_active":"2024-09-12T17:36:40.902484+0000","last_became_peered":"2024-09-12T17:36:40.902484+0000","last_unstale":"2024-09-12T19:30:05.443046+0000","last_undegraded":"2024-09-12T19:30:05.443046+0000","last_fullsized":"2024-09-12T19:30:05.443046+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'417","last_scrub_stamp":"2024-09-12T19:30:05.442825+0000","last_deep_scrub":"265'417","last_deep_scrub_stamp":"2024-09-12T19:30:05.442825+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.442825+0000","objects_scrubbed":9,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:44.363304+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48470,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":642,"num_read_kb":1267,"num_write":506,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:30.671027+0000","last_change":"2024-09-12T17:36:42.937350+0000","last_active":"2024-09-12T19:25:30.671027+0000","last_peered":"2024-09-12T19:25:30.671027+0000","last_clean":"2024-09-12T19:25:30.671027+0000","last_became_active":"2024-09-12T17:36:42.932462+0000","last_became_peered":"2024-09-12T17:36:42.932462+0000","last_unstale":"2024-09-12T19:25:30.671027+0000","last_undegraded":"2024-09-12T19:25:30.671027+0000","last_fullsized":"2024-09-12T19:25:30.671027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:45.961114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'125","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:59.522990+0000","last_change":"2024-09-12T17:36:44.944698+0000","last_active":"2024-09-12T19:27:59.522990+0000","last_peered":"2024-09-12T19:27:59.522990+0000","last_clean":"2024-09-12T19:27:59.522990+0000","last_became_active":"2024-09-12T17:36:44.943948+0000","last_became_peered":"2024-09-12T17:36:44.943948+0000","last_unstale":"2024-09-12T19:27:59.522990+0000","last_undegraded":"2024-09-12T19:27:59.522990+0000","last_fullsized":"2024-09-12T19:27:59.522990+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:55.649115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":170,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'824","reported_seq":2527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.363162+0000","last_change":"2024-09-12T19:29:59.363162+0000","last_active":"2024-09-12T19:29:59.363162+0000","last_peered":"2024-09-12T19:29:59.363162+0000","last_clean":"2024-09-12T19:29:59.363162+0000","last_became_active":"2024-09-12T17:36:36.888747+0000","last_became_peered":"2024-09-12T17:36:36.888747+0000","last_unstale":"2024-09-12T19:29:59.363162+0000","last_undegraded":"2024-09-12T19:29:59.363162+0000","last_fullsized":"2024-09-12T19:29:59.363162+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'824","last_scrub_stamp":"2024-09-12T19:29:59.362904+0000","last_deep_scrub":"265'824","last_deep_scrub_stamp":"2024-09-12T19:29:59.362904+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.362904+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:35.395617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3583,"num_write":1069,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'489","reported_seq":1186,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.227514+0000","last_change":"2024-09-12T19:29:59.227514+0000","last_active":"2024-09-12T19:29:59.227514+0000","last_peered":"2024-09-12T19:29:59.227514+0000","last_clean":"2024-09-12T19:29:59.227514+0000","last_became_active":"2024-09-12T17:36:34.876487+0000","last_became_peered":"2024-09-12T17:36:34.876487+0000","last_unstale":"2024-09-12T19:29:59.227514+0000","last_undegraded":"2024-09-12T19:29:59.227514+0000","last_fullsized":"2024-09-12T19:29:59.227514+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'489","last_scrub_stamp":"2024-09-12T19:29:59.227288+0000","last_deep_scrub":"265'489","last_deep_scrub_stamp":"2024-09-12T19:29:59.227288+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.227288+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:02.444470+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":839,"num_read_kb":5903,"num_write":1394,"num_write_kb":31714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.374675+0000","last_change":"2024-09-12T19:30:03.374675+0000","last_active":"2024-09-12T19:30:03.374675+0000","last_peered":"2024-09-12T19:30:03.374675+0000","last_clean":"2024-09-12T19:30:03.374675+0000","last_became_active":"2024-09-12T17:36:38.901575+0000","last_became_peered":"2024-09-12T17:36:38.901575+0000","last_unstale":"2024-09-12T19:30:03.374675+0000","last_undegraded":"2024-09-12T19:30:03.374675+0000","last_fullsized":"2024-09-12T19:30:03.374675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:03.374500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:03.374500+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.374500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:13.146288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'326","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.441504+0000","last_change":"2024-09-12T17:36:40.901766+0000","last_active":"2024-09-12T19:29:41.441504+0000","last_peered":"2024-09-12T19:29:41.441504+0000","last_clean":"2024-09-12T19:29:41.441504+0000","last_became_active":"2024-09-12T17:36:40.900739+0000","last_became_peered":"2024-09-12T17:36:40.900739+0000","last_unstale":"2024-09-12T19:29:41.441504+0000","last_undegraded":"2024-09-12T19:29:41.441504+0000","last_fullsized":"2024-09-12T19:29:41.441504+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:19.813863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":1258,"num_write":448,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.348981+0000","last_change":"2024-09-12T17:36:42.921850+0000","last_active":"2024-09-12T19:26:00.348981+0000","last_peered":"2024-09-12T19:26:00.348981+0000","last_clean":"2024-09-12T19:26:00.348981+0000","last_became_active":"2024-09-12T17:36:42.920767+0000","last_became_peered":"2024-09-12T17:36:42.920767+0000","last_unstale":"2024-09-12T19:26:00.348981+0000","last_undegraded":"2024-09-12T19:26:00.348981+0000","last_fullsized":"2024-09-12T19:26:00.348981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:22.058824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'123","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.194923+0000","last_change":"2024-09-12T17:36:44.961031+0000","last_active":"2024-09-12T19:27:10.194923+0000","last_peered":"2024-09-12T19:27:10.194923+0000","last_clean":"2024-09-12T19:27:10.194923+0000","last_became_active":"2024-09-12T17:36:44.959535+0000","last_became_peered":"2024-09-12T17:36:44.959535+0000","last_unstale":"2024-09-12T19:27:10.194923+0000","last_undegraded":"2024-09-12T19:27:10.194923+0000","last_fullsized":"2024-09-12T19:27:10.194923+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:18.916773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":231,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'447","reported_seq":1840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.076173+0000","last_change":"2024-09-12T19:29:57.076173+0000","last_active":"2024-09-12T19:29:57.076173+0000","last_peered":"2024-09-12T19:29:57.076173+0000","last_clean":"2024-09-12T19:29:57.076173+0000","last_became_active":"2024-09-12T17:36:36.895126+0000","last_became_peered":"2024-09-12T17:36:36.895126+0000","last_unstale":"2024-09-12T19:29:57.076173+0000","last_undegraded":"2024-09-12T19:29:57.076173+0000","last_fullsized":"2024-09-12T19:29:57.076173+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'447","last_scrub_stamp":"2024-09-12T19:29:57.075990+0000","last_deep_scrub":"265'447","last_deep_scrub_stamp":"2024-09-12T19:29:57.075990+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.075990+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:34.706291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2194,"num_read_kb":2018,"num_write":546,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'364","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.905415+0000","last_change":"2024-09-12T19:29:56.905415+0000","last_active":"2024-09-12T19:29:56.905415+0000","last_peered":"2024-09-12T19:29:56.905415+0000","last_clean":"2024-09-12T19:29:56.905415+0000","last_became_active":"2024-09-12T17:36:34.878381+0000","last_became_peered":"2024-09-12T17:36:34.878381+0000","last_unstale":"2024-09-12T19:29:56.905415+0000","last_undegraded":"2024-09-12T19:29:56.905415+0000","last_fullsized":"2024-09-12T19:29:56.905415+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T19:29:56.905139+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T19:29:56.905139+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.905139+0000","objects_scrubbed":8,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:09.937198+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":568,"num_read_kb":62029,"num_write":1071,"num_write_kb":23225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.906485+0000","last_change":"2024-09-12T19:30:03.906485+0000","last_active":"2024-09-12T19:30:03.906485+0000","last_peered":"2024-09-12T19:30:03.906485+0000","last_clean":"2024-09-12T19:30:03.906485+0000","last_became_active":"2024-09-12T17:36:38.887476+0000","last_became_peered":"2024-09-12T17:36:38.887476+0000","last_unstale":"2024-09-12T19:30:03.906485+0000","last_undegraded":"2024-09-12T19:30:03.906485+0000","last_fullsized":"2024-09-12T19:30:03.906485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:03.906304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:03.906304+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.906304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:42.519260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'246","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.336165+0000","last_change":"2024-09-12T17:36:40.904837+0000","last_active":"2024-09-12T19:29:42.336165+0000","last_peered":"2024-09-12T19:29:42.336165+0000","last_clean":"2024-09-12T19:29:42.336165+0000","last_became_active":"2024-09-12T17:36:40.904126+0000","last_became_peered":"2024-09-12T17:36:40.904126+0000","last_unstale":"2024-09-12T19:29:42.336165+0000","last_undegraded":"2024-09-12T19:29:42.336165+0000","last_fullsized":"2024-09-12T19:29:42.336165+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:14.815589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52700,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":960,"num_write":326,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360790+0000","last_change":"2024-09-12T17:36:42.935140+0000","last_active":"2024-09-12T19:26:45.360790+0000","last_peered":"2024-09-12T19:26:45.360790+0000","last_clean":"2024-09-12T19:26:45.360790+0000","last_became_active":"2024-09-12T17:36:42.934140+0000","last_became_peered":"2024-09-12T17:36:42.934140+0000","last_unstale":"2024-09-12T19:26:45.360790+0000","last_undegraded":"2024-09-12T19:26:45.360790+0000","last_fullsized":"2024-09-12T19:26:45.360790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:50.636896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'159","reported_seq":1650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.254322+0000","last_change":"2024-09-12T17:36:44.966081+0000","last_active":"2024-09-12T19:27:55.254322+0000","last_peered":"2024-09-12T19:27:55.254322+0000","last_clean":"2024-09-12T19:27:55.254322+0000","last_became_active":"2024-09-12T17:36:44.965427+0000","last_became_peered":"2024-09-12T17:36:44.965427+0000","last_unstale":"2024-09-12T19:27:55.254322+0000","last_undegraded":"2024-09-12T19:27:55.254322+0000","last_fullsized":"2024-09-12T19:27:55.254322+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:20.397523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1232,"num_read_kb":1221,"num_write":362,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'996","reported_seq":2730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.363859+0000","last_change":"2024-09-12T19:29:57.363859+0000","last_active":"2024-09-12T19:29:57.363859+0000","last_peered":"2024-09-12T19:29:57.363859+0000","last_clean":"2024-09-12T19:29:57.363859+0000","last_became_active":"2024-09-12T17:36:36.914315+0000","last_became_peered":"2024-09-12T17:36:36.914315+0000","last_unstale":"2024-09-12T19:29:57.363859+0000","last_undegraded":"2024-09-12T19:29:57.363859+0000","last_fullsized":"2024-09-12T19:29:57.363859+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'996","last_scrub_stamp":"2024-09-12T19:29:57.363633+0000","last_deep_scrub":"265'996","last_deep_scrub_stamp":"2024-09-12T19:29:57.363633+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.363633+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":900,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:14.785338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4811,"num_read_kb":4330,"num_write":1385,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'343","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.949861+0000","last_change":"2024-09-12T19:29:53.949861+0000","last_active":"2024-09-12T19:29:53.949861+0000","last_peered":"2024-09-12T19:29:53.949861+0000","last_clean":"2024-09-12T19:29:53.949861+0000","last_became_active":"2024-09-12T17:36:34.871889+0000","last_became_peered":"2024-09-12T17:36:34.871889+0000","last_unstale":"2024-09-12T19:29:53.949861+0000","last_undegraded":"2024-09-12T19:29:53.949861+0000","last_fullsized":"2024-09-12T19:29:53.949861+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:29:53.949641+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:29:53.949641+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.949641+0000","objects_scrubbed":10,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:44.653793+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526421,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":468,"num_read_kb":13877,"num_write":1131,"num_write_kb":46739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:45.674374+0000","last_change":"2024-09-12T17:36:38.882816+0000","last_active":"2024-09-12T19:25:45.674374+0000","last_peered":"2024-09-12T19:25:45.674374+0000","last_clean":"2024-09-12T19:25:45.674374+0000","last_became_active":"2024-09-12T17:36:38.882018+0000","last_became_peered":"2024-09-12T17:36:38.882018+0000","last_unstale":"2024-09-12T19:25:45.674374+0000","last_undegraded":"2024-09-12T19:25:45.674374+0000","last_fullsized":"2024-09-12T19:25:45.674374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:37.859575+0000","last_clean_scrub_stamp":"2024-09-12T17:36:37.859575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:50.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'327","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.181289+0000","last_change":"2024-09-12T17:36:40.909328+0000","last_active":"2024-09-12T19:29:41.181289+0000","last_peered":"2024-09-12T19:29:41.181289+0000","last_clean":"2024-09-12T19:29:41.181289+0000","last_became_active":"2024-09-12T17:36:40.908611+0000","last_became_peered":"2024-09-12T17:36:40.908611+0000","last_unstale":"2024-09-12T19:29:41.181289+0000","last_undegraded":"2024-09-12T19:29:41.181289+0000","last_fullsized":"2024-09-12T19:29:41.181289+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:15.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53448,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":560,"num_read_kb":1204,"num_write":440,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.687795+0000","last_change":"2024-09-12T17:36:42.936919+0000","last_active":"2024-09-12T19:26:45.687795+0000","last_peered":"2024-09-12T19:26:45.687795+0000","last_clean":"2024-09-12T19:26:45.687795+0000","last_became_active":"2024-09-12T17:36:42.933510+0000","last_became_peered":"2024-09-12T17:36:42.933510+0000","last_unstale":"2024-09-12T19:26:45.687795+0000","last_undegraded":"2024-09-12T19:26:45.687795+0000","last_fullsized":"2024-09-12T19:26:45.687795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:11.996658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'126","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:21.020550+0000","last_change":"2024-09-12T17:36:44.961303+0000","last_active":"2024-09-12T19:29:21.020550+0000","last_peered":"2024-09-12T19:29:21.020550+0000","last_clean":"2024-09-12T19:29:21.020550+0000","last_became_active":"2024-09-12T17:36:44.960641+0000","last_became_peered":"2024-09-12T17:36:44.960641+0000","last_unstale":"2024-09-12T19:29:21.020550+0000","last_undegraded":"2024-09-12T19:29:21.020550+0000","last_fullsized":"2024-09-12T19:29:21.020550+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:20.007631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":181,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'933","reported_seq":2739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.902416+0000","last_change":"2024-09-12T19:30:01.902416+0000","last_active":"2024-09-12T19:30:01.902416+0000","last_peered":"2024-09-12T19:30:01.902416+0000","last_clean":"2024-09-12T19:30:01.902416+0000","last_became_active":"2024-09-12T17:36:36.901046+0000","last_became_peered":"2024-09-12T17:36:36.901046+0000","last_unstale":"2024-09-12T19:30:01.902416+0000","last_undegraded":"2024-09-12T19:30:01.902416+0000","last_fullsized":"2024-09-12T19:30:01.902416+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'933","last_scrub_stamp":"2024-09-12T19:30:01.902200+0000","last_deep_scrub":"265'933","last_deep_scrub_stamp":"2024-09-12T19:30:01.902200+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.902200+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:50.473986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4712,"num_read_kb":4247,"num_write":1250,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4079,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'415","reported_seq":1135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.380197+0000","last_change":"2024-09-12T19:29:48.380197+0000","last_active":"2024-09-12T19:29:48.380197+0000","last_peered":"2024-09-12T19:29:48.380197+0000","last_clean":"2024-09-12T19:29:48.380197+0000","last_became_active":"2024-09-12T17:36:34.884112+0000","last_became_peered":"2024-09-12T17:36:34.884112+0000","last_unstale":"2024-09-12T19:29:48.380197+0000","last_undegraded":"2024-09-12T19:29:48.380197+0000","last_fullsized":"2024-09-12T19:29:48.380197+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:29:48.380120+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:29:48.380120+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.380120+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:19.901040+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":11450,"num_write":1282,"num_write_kb":27380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'656","reported_seq":2325,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.057909+0000","last_change":"2024-09-12T19:29:59.057909+0000","last_active":"2024-09-12T19:29:59.057909+0000","last_peered":"2024-09-12T19:29:59.057909+0000","last_clean":"2024-09-12T19:29:59.057909+0000","last_became_active":"2024-09-12T17:36:36.916477+0000","last_became_peered":"2024-09-12T17:36:36.916477+0000","last_unstale":"2024-09-12T19:29:59.057909+0000","last_undegraded":"2024-09-12T19:29:59.057909+0000","last_fullsized":"2024-09-12T19:29:59.057909+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'656","last_scrub_stamp":"2024-09-12T19:29:59.057726+0000","last_deep_scrub":"265'656","last_deep_scrub_stamp":"2024-09-12T19:29:59.057726+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.057726+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:13.858705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3261,"num_read_kb":2946,"num_write":856,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'371","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.125878+0000","last_change":"2024-09-12T19:29:53.125878+0000","last_active":"2024-09-12T19:29:53.125878+0000","last_peered":"2024-09-12T19:29:53.125878+0000","last_clean":"2024-09-12T19:29:53.125878+0000","last_became_active":"2024-09-12T17:36:34.862008+0000","last_became_peered":"2024-09-12T17:36:34.862008+0000","last_unstale":"2024-09-12T19:29:53.125878+0000","last_undegraded":"2024-09-12T19:29:53.125878+0000","last_fullsized":"2024-09-12T19:29:53.125878+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T19:29:53.125690+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T19:29:53.125690+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.125690+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:00.140459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648670,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":45708,"num_write":1154,"num_write_kb":41141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'442","reported_seq":2006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366473+0000","last_change":"2024-09-12T17:36:36.876715+0000","last_active":"2024-09-12T19:27:10.366473+0000","last_peered":"2024-09-12T19:27:10.366473+0000","last_clean":"2024-09-12T19:27:10.366473+0000","last_became_active":"2024-09-12T17:36:36.875947+0000","last_became_peered":"2024-09-12T17:36:36.875947+0000","last_unstale":"2024-09-12T19:27:10.366473+0000","last_undegraded":"2024-09-12T19:27:10.366473+0000","last_fullsized":"2024-09-12T19:27:10.366473+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:53.224464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2143,"num_write":507,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'350","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.197660+0000","last_change":"2024-09-12T19:30:00.197660+0000","last_active":"2024-09-12T19:30:00.197660+0000","last_peered":"2024-09-12T19:30:00.197660+0000","last_clean":"2024-09-12T19:30:00.197660+0000","last_became_active":"2024-09-12T17:36:34.892664+0000","last_became_peered":"2024-09-12T17:36:34.892664+0000","last_unstale":"2024-09-12T19:30:00.197660+0000","last_undegraded":"2024-09-12T19:30:00.197660+0000","last_fullsized":"2024-09-12T19:30:00.197660+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-12T19:30:00.197372+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-12T19:30:00.197372+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.197372+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:40.921623+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4719915,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":523,"num_read_kb":15114,"num_write":1089,"num_write_kb":33687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'449","reported_seq":2051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.620587+0000","last_change":"2024-09-12T17:36:36.887427+0000","last_active":"2024-09-12T19:28:02.620587+0000","last_peered":"2024-09-12T19:28:02.620587+0000","last_clean":"2024-09-12T19:28:02.620587+0000","last_became_active":"2024-09-12T17:36:36.886646+0000","last_became_peered":"2024-09-12T17:36:36.886646+0000","last_unstale":"2024-09-12T19:28:02.620587+0000","last_undegraded":"2024-09-12T19:28:02.620587+0000","last_fullsized":"2024-09-12T19:28:02.620587+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:16.527812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2431,"num_read_kb":2290,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'322","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.891849+0000","last_change":"2024-09-12T19:29:54.891849+0000","last_active":"2024-09-12T19:29:54.891849+0000","last_peered":"2024-09-12T19:29:54.891849+0000","last_clean":"2024-09-12T19:29:54.891849+0000","last_became_active":"2024-09-12T17:36:34.875514+0000","last_became_peered":"2024-09-12T17:36:34.875514+0000","last_unstale":"2024-09-12T19:29:54.891849+0000","last_undegraded":"2024-09-12T19:29:54.891849+0000","last_fullsized":"2024-09-12T19:29:54.891849+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:29:54.891644+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:29:54.891644+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.891644+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:20.204730+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515054,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":12724,"num_write":938,"num_write_kb":21079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'472","reported_seq":2079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:35.268283+0000","last_change":"2024-09-12T17:36:36.896549+0000","last_active":"2024-09-12T19:27:35.268283+0000","last_peered":"2024-09-12T19:27:35.268283+0000","last_clean":"2024-09-12T19:27:35.268283+0000","last_became_active":"2024-09-12T17:36:36.895580+0000","last_became_peered":"2024-09-12T17:36:36.895580+0000","last_unstale":"2024-09-12T19:27:35.268283+0000","last_undegraded":"2024-09-12T19:27:35.268283+0000","last_fullsized":"2024-09-12T19:27:35.268283+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:38.232699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2410,"num_read_kb":2268,"num_write":522,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'383","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.377960+0000","last_change":"2024-09-12T19:29:53.377960+0000","last_active":"2024-09-12T19:29:53.377960+0000","last_peered":"2024-09-12T19:29:53.377960+0000","last_clean":"2024-09-12T19:29:53.377960+0000","last_became_active":"2024-09-12T17:36:34.875282+0000","last_became_peered":"2024-09-12T17:36:34.875282+0000","last_unstale":"2024-09-12T19:29:53.377960+0000","last_undegraded":"2024-09-12T19:29:53.377960+0000","last_fullsized":"2024-09-12T19:29:53.377960+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T19:29:53.377757+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T19:29:53.377757+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.377757+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:35.803143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568489,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":16784,"num_write":1071,"num_write_kb":43648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'874","reported_seq":2689,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.367917+0000","last_change":"2024-09-12T19:29:59.367917+0000","last_active":"2024-09-12T19:29:59.367917+0000","last_peered":"2024-09-12T19:29:59.367917+0000","last_clean":"2024-09-12T19:29:59.367917+0000","last_became_active":"2024-09-12T17:36:36.879875+0000","last_became_peered":"2024-09-12T17:36:36.879875+0000","last_unstale":"2024-09-12T19:29:59.367917+0000","last_undegraded":"2024-09-12T19:29:59.367917+0000","last_fullsized":"2024-09-12T19:29:59.367917+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'874","last_scrub_stamp":"2024-09-12T19:29:59.367728+0000","last_deep_scrub":"265'874","last_deep_scrub_stamp":"2024-09-12T19:29:59.367728+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.367728+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:32.664577+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4378,"num_read_kb":3985,"num_write":1124,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1318,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'322","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.516329+0000","last_change":"2024-09-12T19:30:02.516329+0000","last_active":"2024-09-12T19:30:02.516329+0000","last_peered":"2024-09-12T19:30:02.516329+0000","last_clean":"2024-09-12T19:30:02.516329+0000","last_became_active":"2024-09-12T17:36:34.880893+0000","last_became_peered":"2024-09-12T17:36:34.880893+0000","last_unstale":"2024-09-12T19:30:02.516329+0000","last_undegraded":"2024-09-12T19:30:02.516329+0000","last_fullsized":"2024-09-12T19:30:02.516329+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:30:02.516130+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:30:02.516130+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.516130+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.498669+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":34772,"num_write":1049,"num_write_kb":43573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'1179","reported_seq":2773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.482459+0000","last_change":"2024-09-12T19:30:01.482459+0000","last_active":"2024-09-12T19:30:01.482459+0000","last_peered":"2024-09-12T19:30:01.482459+0000","last_clean":"2024-09-12T19:30:01.482459+0000","last_became_active":"2024-09-12T17:36:36.897985+0000","last_became_peered":"2024-09-12T17:36:36.897985+0000","last_unstale":"2024-09-12T19:30:01.482459+0000","last_undegraded":"2024-09-12T19:30:01.482459+0000","last_fullsized":"2024-09-12T19:30:01.482459+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1179","last_scrub_stamp":"2024-09-12T19:30:01.482241+0000","last_deep_scrub":"265'1179","last_deep_scrub_stamp":"2024-09-12T19:30:01.482241+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.482241+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:27.270588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5405,"num_read_kb":4772,"num_write":1628,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1111,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'394","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.321112+0000","last_change":"2024-09-12T19:29:52.321112+0000","last_active":"2024-09-12T19:29:52.321112+0000","last_peered":"2024-09-12T19:29:52.321112+0000","last_clean":"2024-09-12T19:29:52.321112+0000","last_became_active":"2024-09-12T17:36:34.876834+0000","last_became_peered":"2024-09-12T17:36:34.876834+0000","last_unstale":"2024-09-12T19:29:52.321112+0000","last_undegraded":"2024-09-12T19:29:52.321112+0000","last_fullsized":"2024-09-12T19:29:52.321112+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T19:29:52.320936+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T19:29:52.320936+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.320936+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:16.090065+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":595,"num_read_kb":4635,"num_write":1236,"num_write_kb":22932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'773","reported_seq":2370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.859989+0000","last_change":"2024-09-12T19:29:53.859989+0000","last_active":"2024-09-12T19:29:53.859989+0000","last_peered":"2024-09-12T19:29:53.859989+0000","last_clean":"2024-09-12T19:29:53.859989+0000","last_became_active":"2024-09-12T17:36:36.901293+0000","last_became_peered":"2024-09-12T17:36:36.901293+0000","last_unstale":"2024-09-12T19:29:53.859989+0000","last_undegraded":"2024-09-12T19:29:53.859989+0000","last_fullsized":"2024-09-12T19:29:53.859989+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T19:29:53.859804+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T19:29:53.859804+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.859804+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:29.780177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3323,"num_write":979,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'347","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.926866+0000","last_change":"2024-09-12T19:29:52.926866+0000","last_active":"2024-09-12T19:29:52.926866+0000","last_peered":"2024-09-12T19:29:52.926866+0000","last_clean":"2024-09-12T19:29:52.926866+0000","last_became_active":"2024-09-12T17:36:34.872999+0000","last_became_peered":"2024-09-12T17:36:34.872999+0000","last_unstale":"2024-09-12T19:29:52.926866+0000","last_undegraded":"2024-09-12T19:29:52.926866+0000","last_fullsized":"2024-09-12T19:29:52.926866+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:29:52.926633+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:29:52.926633+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.926633+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:12.827832+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":667,"num_read_kb":7832,"num_write":1127,"num_write_kb":31819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'779","reported_seq":2255,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.088334+0000","last_change":"2024-09-12T19:30:02.088334+0000","last_active":"2024-09-12T19:30:02.088334+0000","last_peered":"2024-09-12T19:30:02.088334+0000","last_clean":"2024-09-12T19:30:02.088334+0000","last_became_active":"2024-09-12T17:36:36.903948+0000","last_became_peered":"2024-09-12T17:36:36.903948+0000","last_unstale":"2024-09-12T19:30:02.088334+0000","last_undegraded":"2024-09-12T19:30:02.088334+0000","last_fullsized":"2024-09-12T19:30:02.088334+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'779","last_scrub_stamp":"2024-09-12T19:30:02.088151+0000","last_deep_scrub":"265'779","last_deep_scrub_stamp":"2024-09-12T19:30:02.088151+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.088151+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:31.427535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3650,"num_read_kb":3275,"num_write":1024,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'413","reported_seq":1181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.145594+0000","last_change":"2024-09-12T19:30:04.145594+0000","last_active":"2024-09-12T19:30:04.145594+0000","last_peered":"2024-09-12T19:30:04.145594+0000","last_clean":"2024-09-12T19:30:04.145594+0000","last_became_active":"2024-09-12T17:36:34.891638+0000","last_became_peered":"2024-09-12T17:36:34.891638+0000","last_unstale":"2024-09-12T19:30:04.145594+0000","last_undegraded":"2024-09-12T19:30:04.145594+0000","last_fullsized":"2024-09-12T19:30:04.145594+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'413","last_scrub_stamp":"2024-09-12T19:30:04.145362+0000","last_deep_scrub":"265'413","last_deep_scrub_stamp":"2024-09-12T19:30:04.145362+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.145362+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:20.894452+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":824,"num_read_kb":23553,"num_write":1317,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'1233","reported_seq":2991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.364430+0000","last_change":"2024-09-12T19:29:57.364430+0000","last_active":"2024-09-12T19:29:57.364430+0000","last_peered":"2024-09-12T19:29:57.364430+0000","last_clean":"2024-09-12T19:29:57.364430+0000","last_became_active":"2024-09-12T17:36:36.906463+0000","last_became_peered":"2024-09-12T17:36:36.906463+0000","last_unstale":"2024-09-12T19:29:57.364430+0000","last_undegraded":"2024-09-12T19:29:57.364430+0000","last_fullsized":"2024-09-12T19:29:57.364430+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1233","last_scrub_stamp":"2024-09-12T19:29:57.364153+0000","last_deep_scrub":"265'1233","last_deep_scrub_stamp":"2024-09-12T19:29:57.364153+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.364153+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":1200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:42.031824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5684,"num_read_kb":5045,"num_write":1688,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'343","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.902923+0000","last_change":"2024-09-12T19:29:55.902923+0000","last_active":"2024-09-12T19:29:55.902923+0000","last_peered":"2024-09-12T19:29:55.902923+0000","last_clean":"2024-09-12T19:29:55.902923+0000","last_became_active":"2024-09-12T17:36:34.873189+0000","last_became_peered":"2024-09-12T17:36:34.873189+0000","last_unstale":"2024-09-12T19:29:55.902923+0000","last_undegraded":"2024-09-12T19:29:55.902923+0000","last_fullsized":"2024-09-12T19:29:55.902923+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:29:55.902646+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:29:55.902646+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.902646+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:22.918198+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284213,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":39048,"num_write":958,"num_write_kb":38605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'997","reported_seq":2702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:32.116025+0000","last_change":"2024-09-12T17:36:36.876501+0000","last_active":"2024-09-12T19:28:32.116025+0000","last_peered":"2024-09-12T19:28:32.116025+0000","last_clean":"2024-09-12T19:28:32.116025+0000","last_became_active":"2024-09-12T17:36:36.875791+0000","last_became_peered":"2024-09-12T17:36:36.875791+0000","last_unstale":"2024-09-12T19:28:32.116025+0000","last_undegraded":"2024-09-12T19:28:32.116025+0000","last_fullsized":"2024-09-12T19:28:32.116025+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:20.751412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4962,"num_read_kb":4419,"num_write":1465,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'253","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.905945+0000","last_change":"2024-09-12T19:29:47.905945+0000","last_active":"2024-09-12T19:29:47.905945+0000","last_peered":"2024-09-12T19:29:47.905945+0000","last_clean":"2024-09-12T19:29:47.905945+0000","last_became_active":"2024-09-12T17:36:34.866719+0000","last_became_peered":"2024-09-12T17:36:34.866719+0000","last_unstale":"2024-09-12T19:29:47.905945+0000","last_undegraded":"2024-09-12T19:29:47.905945+0000","last_fullsized":"2024-09-12T19:29:47.905945+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-12T19:29:47.905866+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-12T19:29:47.905866+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.905866+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:35.987815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":13747,"num_write":787,"num_write_kb":14866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'511","reported_seq":2137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.833711+0000","last_change":"2024-09-12T19:29:55.833711+0000","last_active":"2024-09-12T19:29:55.833711+0000","last_peered":"2024-09-12T19:29:55.833711+0000","last_clean":"2024-09-12T19:29:55.833711+0000","last_became_active":"2024-09-12T17:36:36.914327+0000","last_became_peered":"2024-09-12T17:36:36.914327+0000","last_unstale":"2024-09-12T19:29:55.833711+0000","last_undegraded":"2024-09-12T19:29:55.833711+0000","last_fullsized":"2024-09-12T19:29:55.833711+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'511","last_scrub_stamp":"2024-09-12T19:29:55.833505+0000","last_deep_scrub":"265'511","last_deep_scrub_stamp":"2024-09-12T19:29:55.833505+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.833505+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:26.792835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2629,"num_read_kb":2439,"num_write":603,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'303","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.909782+0000","last_change":"2024-09-12T19:29:59.909782+0000","last_active":"2024-09-12T19:29:59.909782+0000","last_peered":"2024-09-12T19:29:59.909782+0000","last_clean":"2024-09-12T19:29:59.909782+0000","last_became_active":"2024-09-12T17:36:34.864682+0000","last_became_peered":"2024-09-12T17:36:34.864682+0000","last_unstale":"2024-09-12T19:29:59.909782+0000","last_undegraded":"2024-09-12T19:29:59.909782+0000","last_fullsized":"2024-09-12T19:29:59.909782+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T19:29:59.909589+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T19:29:59.909589+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.909589+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:21:13.619686+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":386,"num_read_kb":10447,"num_write":906,"num_write_kb":22906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'846","reported_seq":2476,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.841442+0000","last_change":"2024-09-12T19:29:54.841442+0000","last_active":"2024-09-12T19:29:54.841442+0000","last_peered":"2024-09-12T19:29:54.841442+0000","last_clean":"2024-09-12T19:29:54.841442+0000","last_became_active":"2024-09-12T17:36:36.885956+0000","last_became_peered":"2024-09-12T17:36:36.885956+0000","last_unstale":"2024-09-12T19:29:54.841442+0000","last_undegraded":"2024-09-12T19:29:54.841442+0000","last_fullsized":"2024-09-12T19:29:54.841442+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'846","last_scrub_stamp":"2024-09-12T19:29:54.841249+0000","last_deep_scrub":"265'846","last_deep_scrub_stamp":"2024-09-12T19:29:54.841249+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.841249+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:55.821229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3814,"num_read_kb":3459,"num_write":1078,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'375","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.405081+0000","last_change":"2024-09-12T19:29:47.405081+0000","last_active":"2024-09-12T19:29:47.405081+0000","last_peered":"2024-09-12T19:29:47.405081+0000","last_clean":"2024-09-12T19:29:47.405081+0000","last_became_active":"2024-09-12T17:36:34.865344+0000","last_became_peered":"2024-09-12T17:36:34.865344+0000","last_unstale":"2024-09-12T19:29:47.405081+0000","last_undegraded":"2024-09-12T19:29:47.405081+0000","last_fullsized":"2024-09-12T19:29:47.405081+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:29:47.404998+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:29:47.404998+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.404998+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:12.580297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":55805,"num_write":1199,"num_write_kb":26331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'725","reported_seq":2145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.086920+0000","last_change":"2024-09-12T19:30:00.086920+0000","last_active":"2024-09-12T19:30:00.086920+0000","last_peered":"2024-09-12T19:30:00.086920+0000","last_clean":"2024-09-12T19:30:00.086920+0000","last_became_active":"2024-09-12T17:36:36.916289+0000","last_became_peered":"2024-09-12T17:36:36.916289+0000","last_unstale":"2024-09-12T19:30:00.086920+0000","last_undegraded":"2024-09-12T19:30:00.086920+0000","last_fullsized":"2024-09-12T19:30:00.086920+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'725","last_scrub_stamp":"2024-09-12T19:30:00.086735+0000","last_deep_scrub":"265'725","last_deep_scrub_stamp":"2024-09-12T19:30:00.086735+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.086735+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:01.389997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3361,"num_read_kb":3032,"num_write":954,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'378","reported_seq":1272,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.209603+0000","last_change":"2024-09-12T19:30:01.209603+0000","last_active":"2024-09-12T19:30:01.209603+0000","last_peered":"2024-09-12T19:30:01.209603+0000","last_clean":"2024-09-12T19:30:01.209603+0000","last_became_active":"2024-09-12T17:36:34.875748+0000","last_became_peered":"2024-09-12T17:36:34.875748+0000","last_unstale":"2024-09-12T19:30:01.209603+0000","last_undegraded":"2024-09-12T19:30:01.209603+0000","last_fullsized":"2024-09-12T19:30:01.209603+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:30:01.209395+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:30:01.209395+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.209395+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:15.055583+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311597,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":946,"num_read_kb":75770,"num_write":1026,"num_write_kb":38932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'578","reported_seq":2198,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.899816+0000","last_change":"2024-09-12T19:30:03.899816+0000","last_active":"2024-09-12T19:30:03.899816+0000","last_peered":"2024-09-12T19:30:03.899816+0000","last_clean":"2024-09-12T19:30:03.899816+0000","last_became_active":"2024-09-12T17:36:36.902941+0000","last_became_peered":"2024-09-12T17:36:36.902941+0000","last_unstale":"2024-09-12T19:30:03.899816+0000","last_undegraded":"2024-09-12T19:30:03.899816+0000","last_fullsized":"2024-09-12T19:30:03.899816+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'578","last_scrub_stamp":"2024-09-12T19:30:03.899626+0000","last_deep_scrub":"265'578","last_deep_scrub_stamp":"2024-09-12T19:30:03.899626+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.899626+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:57.866591+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2851,"num_read_kb":2607,"num_write":694,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1263,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'382","reported_seq":1068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.108963+0000","last_change":"2024-09-12T19:29:54.108963+0000","last_active":"2024-09-12T19:29:54.108963+0000","last_peered":"2024-09-12T19:29:54.108963+0000","last_clean":"2024-09-12T19:29:54.108963+0000","last_became_active":"2024-09-12T17:36:34.868083+0000","last_became_peered":"2024-09-12T17:36:34.868083+0000","last_unstale":"2024-09-12T19:29:54.108963+0000","last_undegraded":"2024-09-12T19:29:54.108963+0000","last_fullsized":"2024-09-12T19:29:54.108963+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T19:29:54.108756+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T19:29:54.108756+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.108756+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:42.132817+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526437,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":549,"num_read_kb":53048,"num_write":1215,"num_write_kb":26068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'579","reported_seq":2527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.868550+0000","last_change":"2024-09-12T19:29:56.868550+0000","last_active":"2024-09-12T19:29:56.868550+0000","last_peered":"2024-09-12T19:29:56.868550+0000","last_clean":"2024-09-12T19:29:56.868550+0000","last_became_active":"2024-09-12T17:36:36.891412+0000","last_became_peered":"2024-09-12T17:36:36.891412+0000","last_unstale":"2024-09-12T19:29:56.868550+0000","last_undegraded":"2024-09-12T19:29:56.868550+0000","last_fullsized":"2024-09-12T19:29:56.868550+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'579","last_scrub_stamp":"2024-09-12T19:29:56.868376+0000","last_deep_scrub":"265'579","last_deep_scrub_stamp":"2024-09-12T19:29:56.868376+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.868376+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:06.248111+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3296,"num_read_kb":3095,"num_write":679,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'406","reported_seq":1099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.173896+0000","last_change":"2024-09-12T19:30:02.173896+0000","last_active":"2024-09-12T19:30:02.173896+0000","last_peered":"2024-09-12T19:30:02.173896+0000","last_clean":"2024-09-12T19:30:02.173896+0000","last_became_active":"2024-09-12T17:36:34.872242+0000","last_became_peered":"2024-09-12T17:36:34.872242+0000","last_unstale":"2024-09-12T19:30:02.173896+0000","last_undegraded":"2024-09-12T19:30:02.173896+0000","last_fullsized":"2024-09-12T19:30:02.173896+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'406","last_scrub_stamp":"2024-09-12T19:30:02.173660+0000","last_deep_scrub":"265'406","last_deep_scrub_stamp":"2024-09-12T19:30:02.173660+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.173660+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:33.109697+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2448269,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":538,"num_read_kb":8811,"num_write":1195,"num_write_kb":19313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'376","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.178506+0000","last_change":"2024-09-12T19:30:03.178506+0000","last_active":"2024-09-12T19:30:03.178506+0000","last_peered":"2024-09-12T19:30:03.178506+0000","last_clean":"2024-09-12T19:30:03.178506+0000","last_became_active":"2024-09-12T17:36:34.861821+0000","last_became_peered":"2024-09-12T17:36:34.861821+0000","last_unstale":"2024-09-12T19:30:03.178506+0000","last_undegraded":"2024-09-12T19:30:03.178506+0000","last_fullsized":"2024-09-12T19:30:03.178506+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:30:03.178293+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:30:03.178293+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.178293+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:36.494496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":100665,"num_write":1084,"num_write_kb":41422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'568","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.624055+0000","last_change":"2024-09-12T17:36:36.912672+0000","last_active":"2024-09-12T19:28:02.624055+0000","last_peered":"2024-09-12T19:28:02.624055+0000","last_clean":"2024-09-12T19:28:02.624055+0000","last_became_active":"2024-09-12T17:36:36.911855+0000","last_became_peered":"2024-09-12T17:36:36.911855+0000","last_unstale":"2024-09-12T19:28:02.624055+0000","last_undegraded":"2024-09-12T19:28:02.624055+0000","last_fullsized":"2024-09-12T19:28:02.624055+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:35.842207+0000","last_clean_scrub_stamp":"2024-09-12T17:36:35.842207+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:51.023621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2849,"num_read_kb":2620,"num_write":728,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'342","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.897450+0000","last_change":"2024-09-12T19:29:57.897450+0000","last_active":"2024-09-12T19:29:57.897450+0000","last_peered":"2024-09-12T19:29:57.897450+0000","last_clean":"2024-09-12T19:29:57.897450+0000","last_became_active":"2024-09-12T17:36:34.881262+0000","last_became_peered":"2024-09-12T17:36:34.881262+0000","last_unstale":"2024-09-12T19:29:57.897450+0000","last_undegraded":"2024-09-12T19:29:57.897450+0000","last_fullsized":"2024-09-12T19:29:57.897450+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:57.897247+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:57.897247+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.897247+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:58.010163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":969137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":479,"num_read_kb":5153,"num_write":1034,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'505","reported_seq":2117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.887588+0000","last_change":"2024-09-12T19:30:01.887588+0000","last_active":"2024-09-12T19:30:01.887588+0000","last_peered":"2024-09-12T19:30:01.887588+0000","last_clean":"2024-09-12T19:30:01.887588+0000","last_became_active":"2024-09-12T17:36:36.901857+0000","last_became_peered":"2024-09-12T17:36:36.901857+0000","last_unstale":"2024-09-12T19:30:01.887588+0000","last_undegraded":"2024-09-12T19:30:01.887588+0000","last_fullsized":"2024-09-12T19:30:01.887588+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:30:01.887410+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:30:01.887410+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.887410+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:36.054880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2642,"num_read_kb":2459,"num_write":621,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5957,"num_read_kb":4161,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16299,"num_read_kb":15966,"num_write":16741,"num_write_kb":4895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1571,"ondisk_log_size":1571,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":754,"ondisk_log_size":754,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1604320,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":20976,"num_read_kb":40444,"num_write":17515,"num_write_kb":12474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508704,"num_omap_keys":1156,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1734,"ondisk_log_size":1734,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194467,"num_write":55293,"num_write_kb":18855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34812,"num_omap_keys":140,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3838,"ondisk_log_size":3838,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":67082726,"num_objects":379,"num_object_clones":0,"num_object_copies":758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":36361,"num_read_kb":1891027,"num_write":71889,"num_write_kb":2051812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135487488,"data_stored":134165452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4005,"ondisk_log_size":4005,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":193786,"num_write":186,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":184511,"num_write":186,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510813,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217412,"kb_used_data":9972,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94154428,"statfs":{"total":96636764160,"available":96414134272,"internally_reserved":0,"allocated":10211328,"data_stored":8566552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510810,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254528,"kb_used_data":24816,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94117312,"statfs":{"total":96636764160,"available":96376127488,"internally_reserved":0,"allocated":25411584,"data_stored":23641054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510814,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191112,"kb_used_data":15608,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94180728,"statfs":{"total":96636764160,"available":96441065472,"internally_reserved":0,"allocated":15982592,"data_stored":14328646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510810,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":222896,"kb_used_data":29280,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94148944,"statfs":{"total":96636764160,"available":96408518656,"internally_reserved":0,"allocated":29982720,"data_stored":28233002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510813,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127712,"kb_used_data":24336,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94244128,"statfs":{"total":96636764160,"available":96505987072,"internally_reserved":0,"allocated":24920064,"data_stored":23230965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510810,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276332,"kb_used_data":10524,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94095508,"statfs":{"total":96636764160,"available":96353800192,"internally_reserved":0,"allocated":10776576,"data_stored":9102273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510811,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106204,"kb_used_data":20940,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94265636,"statfs":{"total":96636764160,"available":96528011264,"internally_reserved":0,"allocated":21442560,"data_stored":19672532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543516,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116012,"kb_used_data":26588,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94255828,"statfs":{"total":96636764160,"available":96517967872,"internally_reserved":0,"allocated":27226112,"data_stored":25491082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17780736,"data_stored":17557812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6524928,"data_stored":6398837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21286912,"data_stored":21117656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26320896,"data_stored":26118766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12324864,"data_stored":12211453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21143552,"data_stored":20934570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23552000,"data_stored":23375118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6553600,"data_stored":6451240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:30:10.383 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.420 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.421 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.421 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.421 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.421 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.421 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.421 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.421 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.421 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.421 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.422 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.422 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.422 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.422 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.422 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.422 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.422 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.422 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.422 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.423 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.423 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.423 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.423 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.423 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.423 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.423 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.423 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.423 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.424 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.424 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.424 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.424 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.424 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.424 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.424 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.424 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.424 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.425 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.425 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.425 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.425 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.425 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.425 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.425 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.425 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.425 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.426 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.426 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.426 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.426 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.426 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.426 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.426 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.426 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.426 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.427 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.427 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.427 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.427 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.427 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.427 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.427 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.427 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.427 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.428 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.428 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.428 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.428 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.428 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.428 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.428 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.428 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.428 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.429 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.429 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.429 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.429 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.429 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.429 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.429 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.429 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.429 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.429 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.430 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.430 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.430 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.430 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.430 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.430 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.430 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.430 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.430 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.431 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.431 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.431 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.431 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.431 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.431 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.431 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.431 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.431 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.432 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.432 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.432 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.432 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.432 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.432 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.432 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.432 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.432 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.433 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.433 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.433 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.433 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.433 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.433 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.433 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.433 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.433 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.434 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.434 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.434 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.434 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.434 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.434 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.434 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.434 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.435 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.435 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.435 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.435 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.435 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.435 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.435 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.436 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.436 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.436 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.436 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.436 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.436 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.436 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.436 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.437 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.437 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.437 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.437 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.437 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.437 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.437 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.437 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.438 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.438 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.438 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.438 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.438 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.438 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.438 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.438 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.439 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.439 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.439 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.439 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.439 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.439 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.439 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.440 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.440 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.440 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.440 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.440 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.440 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.440 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.440 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.441 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.441 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.441 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.441 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.441 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.441 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.441 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.441 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.442 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.442 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.442 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.442 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.442 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.442 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.442 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.443 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.443 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.443 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.443 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.443 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.443 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.443 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.444 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.444 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.444 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.444 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.444 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.444 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.444 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.444 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.445 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.445 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.445 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.445 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.445 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.445 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.445 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.446 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.446 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.446 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.446 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.446 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.446 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.446 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.446 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.446 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.447 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.447 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.447 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.447 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.447 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.447 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.447 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.447 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.448 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.448 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.448 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.448 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.448 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.448 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.448 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.448 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.449 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.449 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.449 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.449 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:36:37.859575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.449 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.449 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.449 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.449 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.450 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.450 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.450 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.450 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:36:35.842207+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:10.451 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:30:30.451 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:30:30.810 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:30:30.825 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-12T19:30:30.841 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":3684,"stamp":"2024-09-12T19:30:29.245390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69294871,"num_objects":850,"num_object_clones":0,"num_object_copies":1700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":850,"num_whiteouts":0,"num_read":295267,"num_read_kb":2527306,"num_write":163888,"num_write_kb":2342783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":204,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":723580,"num_omap_keys":1753,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13411,"ondisk_log_size":13411,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1520528,"kb_used_data":162064,"kb_used_omap":12,"kb_used_meta":1358323,"kb_avail":753454192,"statfs":{"total":773094113280,"available":771537092608,"internally_reserved":0,"allocated":165953536,"data_stored":152266106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1390923312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":113575,"num_omap_keys":284,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009254"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.587902+0000","last_change":"2024-09-12T18:25:52.622405+0000","last_active":"2024-09-12T19:25:55.587902+0000","last_peered":"2024-09-12T19:25:55.587902+0000","last_clean":"2024-09-12T19:25:55.587902+0000","last_became_active":"2024-09-12T18:25:52.621735+0000","last_became_peered":"2024-09-12T18:25:52.621735+0000","last_unstale":"2024-09-12T19:25:55.587902+0000","last_undegraded":"2024-09-12T19:25:55.587902+0000","last_fullsized":"2024-09-12T19:25:55.587902+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:09.919704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.761152+0000","last_change":"2024-09-12T19:30:23.761152+0000","last_active":"2024-09-12T19:30:23.761152+0000","last_peered":"2024-09-12T19:30:23.761152+0000","last_clean":"2024-09-12T19:30:23.761152+0000","last_became_active":"2024-09-12T17:58:47.223202+0000","last_became_peered":"2024-09-12T17:58:47.223202+0000","last_unstale":"2024-09-12T19:30:23.761152+0000","last_undegraded":"2024-09-12T19:30:23.761152+0000","last_fullsized":"2024-09-12T19:30:23.761152+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:23.760965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:23.760965+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.760965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:37.841242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'5","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.964477+0000","last_change":"2024-09-12T17:58:40.207149+0000","last_active":"2024-09-12T19:29:41.964477+0000","last_peered":"2024-09-12T19:29:41.964477+0000","last_clean":"2024-09-12T19:29:41.964477+0000","last_became_active":"2024-09-12T17:58:40.206469+0000","last_became_peered":"2024-09-12T17:58:40.206469+0000","last_unstale":"2024-09-12T19:29:41.964477+0000","last_undegraded":"2024-09-12T19:29:41.964477+0000","last_fullsized":"2024-09-12T19:29:41.964477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:10.914751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'13","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.683354+0000","last_change":"2024-09-12T17:52:39.873196+0000","last_active":"2024-09-12T19:26:25.683354+0000","last_peered":"2024-09-12T19:26:25.683354+0000","last_clean":"2024-09-12T19:26:25.683354+0000","last_became_active":"2024-09-12T17:52:39.872356+0000","last_became_peered":"2024-09-12T17:52:39.872356+0000","last_unstale":"2024-09-12T19:26:25.683354+0000","last_undegraded":"2024-09-12T19:26:25.683354+0000","last_fullsized":"2024-09-12T19:26:25.683354+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:36.475086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:54.035593+0000","last_change":"2024-09-12T18:25:52.625279+0000","last_active":"2024-09-12T19:25:54.035593+0000","last_peered":"2024-09-12T19:25:54.035593+0000","last_clean":"2024-09-12T19:25:54.035593+0000","last_became_active":"2024-09-12T18:25:52.624565+0000","last_became_peered":"2024-09-12T18:25:52.624565+0000","last_unstale":"2024-09-12T19:25:54.035593+0000","last_undegraded":"2024-09-12T19:25:54.035593+0000","last_fullsized":"2024-09-12T19:25:54.035593+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:32.002014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'4","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241488+0000","last_change":"2024-09-12T17:58:47.249699+0000","last_active":"2024-09-12T19:26:20.241488+0000","last_peered":"2024-09-12T19:26:20.241488+0000","last_clean":"2024-09-12T19:26:20.241488+0000","last_became_active":"2024-09-12T17:58:47.249050+0000","last_became_peered":"2024-09-12T17:58:47.249050+0000","last_unstale":"2024-09-12T19:26:20.241488+0000","last_undegraded":"2024-09-12T19:26:20.241488+0000","last_fullsized":"2024-09-12T19:26:20.241488+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:09.406806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.284136+0000","last_change":"2024-09-12T17:58:40.210474+0000","last_active":"2024-09-12T19:28:40.284136+0000","last_peered":"2024-09-12T19:28:40.284136+0000","last_clean":"2024-09-12T19:28:40.284136+0000","last_became_active":"2024-09-12T17:58:40.209447+0000","last_became_peered":"2024-09-12T17:58:40.209447+0000","last_unstale":"2024-09-12T19:28:40.284136+0000","last_undegraded":"2024-09-12T19:28:40.284136+0000","last_fullsized":"2024-09-12T19:28:40.284136+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:51.043086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'14","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.691311+0000","last_change":"2024-09-12T17:52:39.885082+0000","last_active":"2024-09-12T19:27:00.691311+0000","last_peered":"2024-09-12T19:27:00.691311+0000","last_clean":"2024-09-12T19:27:00.691311+0000","last_became_active":"2024-09-12T17:52:39.884327+0000","last_became_peered":"2024-09-12T17:52:39.884327+0000","last_unstale":"2024-09-12T19:27:00.691311+0000","last_undegraded":"2024-09-12T19:27:00.691311+0000","last_fullsized":"2024-09-12T19:27:00.691311+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:05.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.083157+0000","last_change":"2024-09-12T18:25:52.622449+0000","last_active":"2024-09-12T19:26:20.083157+0000","last_peered":"2024-09-12T19:26:20.083157+0000","last_clean":"2024-09-12T19:26:20.083157+0000","last_became_active":"2024-09-12T18:25:52.621796+0000","last_became_peered":"2024-09-12T18:25:52.621796+0000","last_unstale":"2024-09-12T19:26:20.083157+0000","last_undegraded":"2024-09-12T19:26:20.083157+0000","last_fullsized":"2024-09-12T19:26:20.083157+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:45.223769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'7","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.929370+0000","last_change":"2024-09-12T17:58:47.240760+0000","last_active":"2024-09-12T19:29:41.929370+0000","last_peered":"2024-09-12T19:29:41.929370+0000","last_clean":"2024-09-12T19:29:41.929370+0000","last_became_active":"2024-09-12T17:58:47.239390+0000","last_became_peered":"2024-09-12T17:58:47.239390+0000","last_unstale":"2024-09-12T19:29:41.929370+0000","last_undegraded":"2024-09-12T19:29:41.929370+0000","last_fullsized":"2024-09-12T19:29:41.929370+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:08.068553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'4","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.616496+0000","last_change":"2024-09-12T17:58:40.194349+0000","last_active":"2024-09-12T19:29:41.616496+0000","last_peered":"2024-09-12T19:29:41.616496+0000","last_clean":"2024-09-12T19:29:41.616496+0000","last_became_active":"2024-09-12T17:58:40.193462+0000","last_became_peered":"2024-09-12T17:58:40.193462+0000","last_unstale":"2024-09-12T19:29:41.616496+0000","last_undegraded":"2024-09-12T19:29:41.616496+0000","last_fullsized":"2024-09-12T19:29:41.616496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:14.830909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1083,"num_write":4,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'6","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.502458+0000","last_change":"2024-09-12T19:30:23.502458+0000","last_active":"2024-09-12T19:30:23.502458+0000","last_peered":"2024-09-12T19:30:23.502458+0000","last_clean":"2024-09-12T19:30:23.502458+0000","last_became_active":"2024-09-12T17:52:39.871998+0000","last_became_peered":"2024-09-12T17:52:39.871998+0000","last_unstale":"2024-09-12T19:30:23.502458+0000","last_undegraded":"2024-09-12T19:30:23.502458+0000","last_fullsized":"2024-09-12T19:30:23.502458+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:30:23.502250+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:30:23.502250+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.502250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:58.693969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255185+0000","last_change":"2024-09-12T18:25:52.613287+0000","last_active":"2024-09-12T19:26:40.255185+0000","last_peered":"2024-09-12T19:26:40.255185+0000","last_clean":"2024-09-12T19:26:40.255185+0000","last_became_active":"2024-09-12T18:25:52.612472+0000","last_became_peered":"2024-09-12T18:25:52.612472+0000","last_unstale":"2024-09-12T19:26:40.255185+0000","last_undegraded":"2024-09-12T19:26:40.255185+0000","last_fullsized":"2024-09-12T19:26:40.255185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:42.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"262'5","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.263726+0000","last_change":"2024-09-12T17:58:47.248310+0000","last_active":"2024-09-12T19:27:15.263726+0000","last_peered":"2024-09-12T19:27:15.263726+0000","last_clean":"2024-09-12T19:27:15.263726+0000","last_became_active":"2024-09-12T17:58:47.247496+0000","last_became_peered":"2024-09-12T17:58:47.247496+0000","last_unstale":"2024-09-12T19:27:15.263726+0000","last_undegraded":"2024-09-12T19:27:15.263726+0000","last_fullsized":"2024-09-12T19:27:15.263726+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:24.161042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'12","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.772048+0000","last_change":"2024-09-12T19:30:22.772048+0000","last_active":"2024-09-12T19:30:22.772048+0000","last_peered":"2024-09-12T19:30:22.772048+0000","last_clean":"2024-09-12T19:30:22.772048+0000","last_became_active":"2024-09-12T17:58:40.207945+0000","last_became_peered":"2024-09-12T17:58:40.207945+0000","last_unstale":"2024-09-12T19:30:22.772048+0000","last_undegraded":"2024-09-12T19:30:22.772048+0000","last_fullsized":"2024-09-12T19:30:22.772048+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T19:30:22.771869+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T19:30:22.771869+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.771869+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:15.066816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8196,"num_write":22,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'37","reported_seq":178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.517183+0000","last_change":"2024-09-12T19:30:22.517183+0000","last_active":"2024-09-12T19:30:22.517183+0000","last_peered":"2024-09-12T19:30:22.517183+0000","last_clean":"2024-09-12T19:30:22.517183+0000","last_became_active":"2024-09-12T17:52:39.871148+0000","last_became_peered":"2024-09-12T17:52:39.871148+0000","last_unstale":"2024-09-12T19:30:22.517183+0000","last_undegraded":"2024-09-12T19:30:22.517183+0000","last_fullsized":"2024-09-12T19:30:22.517183+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'37","last_scrub_stamp":"2024-09-12T19:30:22.516972+0000","last_deep_scrub":"265'37","last_deep_scrub_stamp":"2024-09-12T19:30:22.516972+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.516972+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:14.364994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":131,"num_write":69,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.686653+0000","last_change":"2024-09-12T18:25:52.605404+0000","last_active":"2024-09-12T19:28:00.686653+0000","last_peered":"2024-09-12T19:28:00.686653+0000","last_clean":"2024-09-12T19:28:00.686653+0000","last_became_active":"2024-09-12T18:25:52.604589+0000","last_became_peered":"2024-09-12T18:25:52.604589+0000","last_unstale":"2024-09-12T19:28:00.686653+0000","last_undegraded":"2024-09-12T19:28:00.686653+0000","last_fullsized":"2024-09-12T19:28:00.686653+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'8","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.497357+0000","last_change":"2024-09-12T19:30:18.497357+0000","last_active":"2024-09-12T19:30:18.497357+0000","last_peered":"2024-09-12T19:30:18.497357+0000","last_clean":"2024-09-12T19:30:18.497357+0000","last_became_active":"2024-09-12T17:58:47.242756+0000","last_became_peered":"2024-09-12T17:58:47.242756+0000","last_unstale":"2024-09-12T19:30:18.497357+0000","last_undegraded":"2024-09-12T19:30:18.497357+0000","last_fullsized":"2024-09-12T19:30:18.497357+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:30:18.497092+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:30:18.497092+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.497092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:30.626986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":7170,"num_write":8,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"262'4","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:40.241656+0000","last_change":"2024-09-12T17:58:40.211442+0000","last_active":"2024-09-12T19:25:40.241656+0000","last_peered":"2024-09-12T19:25:40.241656+0000","last_clean":"2024-09-12T19:25:40.241656+0000","last_became_active":"2024-09-12T17:58:40.202787+0000","last_became_peered":"2024-09-12T17:58:40.202787+0000","last_unstale":"2024-09-12T19:25:40.241656+0000","last_undegraded":"2024-09-12T19:25:40.241656+0000","last_fullsized":"2024-09-12T19:25:40.241656+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:23.258488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'30","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.505490+0000","last_change":"2024-09-12T19:30:21.505490+0000","last_active":"2024-09-12T19:30:21.505490+0000","last_peered":"2024-09-12T19:30:21.505490+0000","last_clean":"2024-09-12T19:30:21.505490+0000","last_became_active":"2024-09-12T17:52:39.888092+0000","last_became_peered":"2024-09-12T17:52:39.888092+0000","last_unstale":"2024-09-12T19:30:21.505490+0000","last_undegraded":"2024-09-12T19:30:21.505490+0000","last_fullsized":"2024-09-12T19:30:21.505490+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:30:21.505315+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:30:21.505315+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.505315+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:41.185814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.682167+0000","last_change":"2024-09-12T18:25:52.615541+0000","last_active":"2024-09-12T19:26:20.682167+0000","last_peered":"2024-09-12T19:26:20.682167+0000","last_clean":"2024-09-12T19:26:20.682167+0000","last_became_active":"2024-09-12T18:25:52.614862+0000","last_became_peered":"2024-09-12T18:25:52.614862+0000","last_unstale":"2024-09-12T19:26:20.682167+0000","last_undegraded":"2024-09-12T19:26:20.682167+0000","last_fullsized":"2024-09-12T19:26:20.682167+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:20.974947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:50.346428+0000","last_change":"2024-09-12T17:58:47.251966+0000","last_active":"2024-09-12T19:25:50.346428+0000","last_peered":"2024-09-12T19:25:50.346428+0000","last_clean":"2024-09-12T19:25:50.346428+0000","last_became_active":"2024-09-12T17:58:47.246322+0000","last_became_peered":"2024-09-12T17:58:47.246322+0000","last_unstale":"2024-09-12T19:25:50.346428+0000","last_undegraded":"2024-09-12T19:25:50.346428+0000","last_fullsized":"2024-09-12T19:25:50.346428+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:04.147241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'4","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:35.387017+0000","last_change":"2024-09-12T17:58:40.207847+0000","last_active":"2024-09-12T19:28:35.387017+0000","last_peered":"2024-09-12T19:28:35.387017+0000","last_clean":"2024-09-12T19:28:35.387017+0000","last_became_active":"2024-09-12T17:58:40.207064+0000","last_became_peered":"2024-09-12T17:58:40.207064+0000","last_unstale":"2024-09-12T19:28:35.387017+0000","last_undegraded":"2024-09-12T19:28:35.387017+0000","last_fullsized":"2024-09-12T19:28:35.387017+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:41.646154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.507171+0000","last_change":"2024-09-12T19:30:15.507171+0000","last_active":"2024-09-12T19:30:15.507171+0000","last_peered":"2024-09-12T19:30:15.507171+0000","last_clean":"2024-09-12T19:30:15.507171+0000","last_became_active":"2024-09-12T17:52:39.883689+0000","last_became_peered":"2024-09-12T17:52:39.883689+0000","last_unstale":"2024-09-12T19:30:15.507171+0000","last_undegraded":"2024-09-12T19:30:15.507171+0000","last_fullsized":"2024-09-12T19:30:15.507171+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T19:30:15.506984+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T19:30:15.506984+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.506984+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:49.043767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:25:55.235695+0000","last_change":"2024-09-12T18:25:52.605313+0000","last_active":"2024-09-12T19:25:55.235695+0000","last_peered":"2024-09-12T19:25:55.235695+0000","last_clean":"2024-09-12T19:25:55.235695+0000","last_became_active":"2024-09-12T18:25:52.598221+0000","last_became_peered":"2024-09-12T18:25:52.598221+0000","last_unstale":"2024-09-12T19:25:55.235695+0000","last_undegraded":"2024-09-12T19:25:55.235695+0000","last_fullsized":"2024-09-12T19:25:55.235695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.818370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.241434+0000","last_change":"2024-09-12T17:58:47.247385+0000","last_active":"2024-09-12T19:26:20.241434+0000","last_peered":"2024-09-12T19:26:20.241434+0000","last_clean":"2024-09-12T19:26:20.241434+0000","last_became_active":"2024-09-12T17:58:47.238781+0000","last_became_peered":"2024-09-12T17:58:47.238781+0000","last_unstale":"2024-09-12T19:26:20.241434+0000","last_undegraded":"2024-09-12T19:26:20.241434+0000","last_fullsized":"2024-09-12T19:26:20.241434+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:59.988556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.488936+0000","last_change":"2024-09-12T19:30:17.488936+0000","last_active":"2024-09-12T19:30:17.488936+0000","last_peered":"2024-09-12T19:30:17.488936+0000","last_clean":"2024-09-12T19:30:17.488936+0000","last_became_active":"2024-09-12T17:58:40.187973+0000","last_became_peered":"2024-09-12T17:58:40.187973+0000","last_unstale":"2024-09-12T19:30:17.488936+0000","last_undegraded":"2024-09-12T19:30:17.488936+0000","last_fullsized":"2024-09-12T19:30:17.488936+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T19:30:17.488744+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T19:30:17.488744+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.488744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:15.360529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'31","reported_seq":166,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.139881+0000","last_change":"2024-09-12T19:30:21.139881+0000","last_active":"2024-09-12T19:30:21.139881+0000","last_peered":"2024-09-12T19:30:21.139881+0000","last_clean":"2024-09-12T19:30:21.139881+0000","last_became_active":"2024-09-12T17:52:39.891830+0000","last_became_peered":"2024-09-12T17:52:39.891830+0000","last_unstale":"2024-09-12T19:30:21.139881+0000","last_undegraded":"2024-09-12T19:30:21.139881+0000","last_fullsized":"2024-09-12T19:30:21.139881+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:30:21.139662+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:30:21.139662+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.139662+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:10.758873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.597150+0000","last_change":"2024-09-12T19:30:24.597150+0000","last_active":"2024-09-12T19:30:24.597150+0000","last_peered":"2024-09-12T19:30:24.597150+0000","last_clean":"2024-09-12T19:30:24.597150+0000","last_became_active":"2024-09-12T18:25:52.606714+0000","last_became_peered":"2024-09-12T18:25:52.606714+0000","last_unstale":"2024-09-12T19:30:24.597150+0000","last_undegraded":"2024-09-12T19:30:24.597150+0000","last_fullsized":"2024-09-12T19:30:24.597150+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:24.596947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:24.596947+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.596947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:51.381270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'4","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:50.697775+0000","last_change":"2024-09-12T17:58:47.251261+0000","last_active":"2024-09-12T19:28:50.697775+0000","last_peered":"2024-09-12T19:28:50.697775+0000","last_clean":"2024-09-12T19:28:50.697775+0000","last_became_active":"2024-09-12T17:58:47.250364+0000","last_became_peered":"2024-09-12T17:58:47.250364+0000","last_unstale":"2024-09-12T19:28:50.697775+0000","last_undegraded":"2024-09-12T19:28:50.697775+0000","last_fullsized":"2024-09-12T19:28:50.697775+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:18.815473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.593137+0000","last_change":"2024-09-12T19:30:26.593137+0000","last_active":"2024-09-12T19:30:26.593137+0000","last_peered":"2024-09-12T19:30:26.593137+0000","last_clean":"2024-09-12T19:30:26.593137+0000","last_became_active":"2024-09-12T17:58:40.212280+0000","last_became_peered":"2024-09-12T17:58:40.212280+0000","last_unstale":"2024-09-12T19:30:26.593137+0000","last_undegraded":"2024-09-12T19:30:26.593137+0000","last_fullsized":"2024-09-12T19:30:26.593137+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:26.592949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:26.592949+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.592949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.408090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'30","reported_seq":160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.501810+0000","last_change":"2024-09-12T19:30:20.501810+0000","last_active":"2024-09-12T19:30:20.501810+0000","last_peered":"2024-09-12T19:30:20.501810+0000","last_clean":"2024-09-12T19:30:20.501810+0000","last_became_active":"2024-09-12T17:52:39.870304+0000","last_became_peered":"2024-09-12T17:52:39.870304+0000","last_unstale":"2024-09-12T19:30:20.501810+0000","last_undegraded":"2024-09-12T19:30:20.501810+0000","last_fullsized":"2024-09-12T19:30:20.501810+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:30:20.501593+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:30:20.501593+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.501593+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:29.819395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":59,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.254085+0000","last_change":"2024-09-12T18:25:52.623401+0000","last_active":"2024-09-12T19:26:35.254085+0000","last_peered":"2024-09-12T19:26:35.254085+0000","last_clean":"2024-09-12T19:26:35.254085+0000","last_became_active":"2024-09-12T18:25:52.622842+0000","last_became_peered":"2024-09-12T18:25:52.622842+0000","last_unstale":"2024-09-12T19:26:35.254085+0000","last_undegraded":"2024-09-12T19:26:35.254085+0000","last_fullsized":"2024-09-12T19:26:35.254085+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:22.497623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'4","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.690031+0000","last_change":"2024-09-12T17:58:47.256168+0000","last_active":"2024-09-12T19:28:15.690031+0000","last_peered":"2024-09-12T19:28:15.690031+0000","last_clean":"2024-09-12T19:28:15.690031+0000","last_became_active":"2024-09-12T17:58:47.255379+0000","last_became_peered":"2024-09-12T17:58:47.255379+0000","last_unstale":"2024-09-12T19:28:15.690031+0000","last_undegraded":"2024-09-12T19:28:15.690031+0000","last_fullsized":"2024-09-12T19:28:15.690031+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:28.202469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:50.376095+0000","last_change":"2024-09-12T17:58:40.194167+0000","last_active":"2024-09-12T19:27:50.376095+0000","last_peered":"2024-09-12T19:27:50.376095+0000","last_clean":"2024-09-12T19:27:50.376095+0000","last_became_active":"2024-09-12T17:58:40.193471+0000","last_became_peered":"2024-09-12T17:58:40.193471+0000","last_unstale":"2024-09-12T19:27:50.376095+0000","last_undegraded":"2024-09-12T19:27:50.376095+0000","last_fullsized":"2024-09-12T19:27:50.376095+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'46","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690191+0000","last_change":"2024-09-12T17:52:39.883998+0000","last_active":"2024-09-12T19:26:55.690191+0000","last_peered":"2024-09-12T19:26:55.690191+0000","last_clean":"2024-09-12T19:26:55.690191+0000","last_became_active":"2024-09-12T17:52:39.883248+0000","last_became_peered":"2024-09-12T17:52:39.883248+0000","last_unstale":"2024-09-12T19:26:55.690191+0000","last_undegraded":"2024-09-12T19:26:55.690191+0000","last_fullsized":"2024-09-12T19:26:55.690191+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:59.309550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":156,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.660257+0000","last_change":"2024-09-12T19:30:28.660257+0000","last_active":"2024-09-12T19:30:28.660257+0000","last_peered":"2024-09-12T19:30:28.660257+0000","last_clean":"2024-09-12T19:30:28.660257+0000","last_became_active":"2024-09-12T18:25:52.611620+0000","last_became_peered":"2024-09-12T18:25:52.611620+0000","last_unstale":"2024-09-12T19:30:28.660257+0000","last_undegraded":"2024-09-12T19:30:28.660257+0000","last_fullsized":"2024-09-12T19:30:28.660257+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:28.660072+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:28.660072+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.660072+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:33.213545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'7","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.361601+0000","last_change":"2024-09-12T17:58:47.250813+0000","last_active":"2024-09-12T19:29:41.361601+0000","last_peered":"2024-09-12T19:29:41.361601+0000","last_clean":"2024-09-12T19:29:41.361601+0000","last_became_active":"2024-09-12T17:58:47.249833+0000","last_became_peered":"2024-09-12T17:58:47.249833+0000","last_unstale":"2024-09-12T19:29:41.361601+0000","last_undegraded":"2024-09-12T19:29:41.361601+0000","last_fullsized":"2024-09-12T19:29:41.361601+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.515110+0000","last_change":"2024-09-12T19:30:12.515110+0000","last_active":"2024-09-12T19:30:12.515110+0000","last_peered":"2024-09-12T19:30:12.515110+0000","last_clean":"2024-09-12T19:30:12.515110+0000","last_became_active":"2024-09-12T17:58:40.203917+0000","last_became_peered":"2024-09-12T17:58:40.203917+0000","last_unstale":"2024-09-12T19:30:12.515110+0000","last_undegraded":"2024-09-12T19:30:12.515110+0000","last_fullsized":"2024-09-12T19:30:12.515110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:12.514935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:12.514935+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.514935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:32.269384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.690138+0000","last_change":"2024-09-12T17:52:39.885011+0000","last_active":"2024-09-12T19:26:55.690138+0000","last_peered":"2024-09-12T19:26:55.690138+0000","last_clean":"2024-09-12T19:26:55.690138+0000","last_became_active":"2024-09-12T17:52:39.884285+0000","last_became_peered":"2024-09-12T17:52:39.884285+0000","last_unstale":"2024-09-12T19:26:55.690138+0000","last_undegraded":"2024-09-12T19:26:55.690138+0000","last_fullsized":"2024-09-12T19:26:55.690138+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:22.466454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.244671+0000","last_change":"2024-09-12T18:25:52.624010+0000","last_active":"2024-09-12T19:26:35.244671+0000","last_peered":"2024-09-12T19:26:35.244671+0000","last_clean":"2024-09-12T19:26:35.244671+0000","last_became_active":"2024-09-12T18:25:52.623502+0000","last_became_peered":"2024-09-12T18:25:52.623502+0000","last_unstale":"2024-09-12T19:26:35.244671+0000","last_undegraded":"2024-09-12T19:26:35.244671+0000","last_fullsized":"2024-09-12T19:26:35.244671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:54.401588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'7","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.654410+0000","last_change":"2024-09-12T17:58:47.257454+0000","last_active":"2024-09-12T19:29:41.654410+0000","last_peered":"2024-09-12T19:29:41.654410+0000","last_clean":"2024-09-12T19:29:41.654410+0000","last_became_active":"2024-09-12T17:58:47.256721+0000","last_became_peered":"2024-09-12T17:58:47.256721+0000","last_unstale":"2024-09-12T19:29:41.654410+0000","last_undegraded":"2024-09-12T19:29:41.654410+0000","last_fullsized":"2024-09-12T19:29:41.654410+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:39.335691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16424,"num_write":12,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.150955+0000","last_change":"2024-09-12T19:30:25.150955+0000","last_active":"2024-09-12T19:30:25.150955+0000","last_peered":"2024-09-12T19:30:25.150955+0000","last_clean":"2024-09-12T19:30:25.150955+0000","last_became_active":"2024-09-12T17:58:40.198765+0000","last_became_peered":"2024-09-12T17:58:40.198765+0000","last_unstale":"2024-09-12T19:30:25.150955+0000","last_undegraded":"2024-09-12T19:30:25.150955+0000","last_fullsized":"2024-09-12T19:30:25.150955+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:25.150777+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:25.150777+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.150777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:35.360638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'58","reported_seq":232,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.136126+0000","last_change":"2024-09-12T19:30:20.136126+0000","last_active":"2024-09-12T19:30:20.136126+0000","last_peered":"2024-09-12T19:30:20.136126+0000","last_clean":"2024-09-12T19:30:20.136126+0000","last_became_active":"2024-09-12T17:52:39.885875+0000","last_became_peered":"2024-09-12T17:52:39.885875+0000","last_unstale":"2024-09-12T19:30:20.136126+0000","last_undegraded":"2024-09-12T19:30:20.136126+0000","last_fullsized":"2024-09-12T19:30:20.136126+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'58","last_scrub_stamp":"2024-09-12T19:30:20.135932+0000","last_deep_scrub":"265'58","last_deep_scrub_stamp":"2024-09-12T19:30:20.135932+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.135932+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:38.194208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":205,"num_write":103,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.548430+0000","last_change":"2024-09-12T19:30:23.548430+0000","last_active":"2024-09-12T19:30:23.548430+0000","last_peered":"2024-09-12T19:30:23.548430+0000","last_clean":"2024-09-12T19:30:23.548430+0000","last_became_active":"2024-09-12T18:25:52.617665+0000","last_became_peered":"2024-09-12T18:25:52.617665+0000","last_unstale":"2024-09-12T19:30:23.548430+0000","last_undegraded":"2024-09-12T19:30:23.548430+0000","last_fullsized":"2024-09-12T19:30:23.548430+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:23.548235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:23.548235+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.548235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:56.734201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'5","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.507812+0000","last_change":"2024-09-12T19:30:16.507812+0000","last_active":"2024-09-12T19:30:16.507812+0000","last_peered":"2024-09-12T19:30:16.507812+0000","last_clean":"2024-09-12T19:30:16.507812+0000","last_became_active":"2024-09-12T17:58:47.253819+0000","last_became_peered":"2024-09-12T17:58:47.253819+0000","last_unstale":"2024-09-12T19:30:16.507812+0000","last_undegraded":"2024-09-12T19:30:16.507812+0000","last_fullsized":"2024-09-12T19:30:16.507812+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T19:30:16.507623+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T19:30:16.507623+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.507623+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:51.873967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:05.275765+0000","last_change":"2024-09-12T17:58:40.208386+0000","last_active":"2024-09-12T19:28:05.275765+0000","last_peered":"2024-09-12T19:28:05.275765+0000","last_clean":"2024-09-12T19:28:05.275765+0000","last_became_active":"2024-09-12T17:58:40.202790+0000","last_became_peered":"2024-09-12T17:58:40.202790+0000","last_unstale":"2024-09-12T19:28:05.275765+0000","last_undegraded":"2024-09-12T19:28:05.275765+0000","last_fullsized":"2024-09-12T19:28:05.275765+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:41.561154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'30","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:30.356662+0000","last_change":"2024-09-12T17:52:39.872248+0000","last_active":"2024-09-12T19:26:30.356662+0000","last_peered":"2024-09-12T19:26:30.356662+0000","last_clean":"2024-09-12T19:26:30.356662+0000","last_became_active":"2024-09-12T17:52:39.871009+0000","last_became_peered":"2024-09-12T17:52:39.871009+0000","last_unstale":"2024-09-12T19:26:30.356662+0000","last_undegraded":"2024-09-12T19:26:30.356662+0000","last_fullsized":"2024-09-12T19:26:30.356662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:36.952465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250730+0000","last_change":"2024-09-12T18:25:52.620335+0000","last_active":"2024-09-12T19:26:20.250730+0000","last_peered":"2024-09-12T19:26:20.250730+0000","last_clean":"2024-09-12T19:26:20.250730+0000","last_became_active":"2024-09-12T18:25:52.617863+0000","last_became_peered":"2024-09-12T18:25:52.617863+0000","last_unstale":"2024-09-12T19:26:20.250730+0000","last_undegraded":"2024-09-12T19:26:20.250730+0000","last_fullsized":"2024-09-12T19:26:20.250730+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:38.215652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"262'2","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.267001+0000","last_change":"2024-09-12T17:58:47.248615+0000","last_active":"2024-09-12T19:27:30.267001+0000","last_peered":"2024-09-12T19:27:30.267001+0000","last_clean":"2024-09-12T19:27:30.267001+0000","last_became_active":"2024-09-12T17:58:47.247475+0000","last_became_peered":"2024-09-12T17:58:47.247475+0000","last_unstale":"2024-09-12T19:27:30.267001+0000","last_undegraded":"2024-09-12T19:27:30.267001+0000","last_fullsized":"2024-09-12T19:27:30.267001+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"265'5","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.800883+0000","last_change":"2024-09-12T19:30:21.800883+0000","last_active":"2024-09-12T19:30:21.800883+0000","last_peered":"2024-09-12T19:30:21.800883+0000","last_clean":"2024-09-12T19:30:21.800883+0000","last_became_active":"2024-09-12T17:58:40.202141+0000","last_became_peered":"2024-09-12T17:58:40.202141+0000","last_unstale":"2024-09-12T19:30:21.800883+0000","last_undegraded":"2024-09-12T19:30:21.800883+0000","last_fullsized":"2024-09-12T19:30:21.800883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:30:21.800695+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:30:21.800695+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.800695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:09.542151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'22","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:00.349102+0000","last_change":"2024-09-12T17:52:39.885280+0000","last_active":"2024-09-12T19:26:00.349102+0000","last_peered":"2024-09-12T19:26:00.349102+0000","last_clean":"2024-09-12T19:26:00.349102+0000","last_became_active":"2024-09-12T17:52:39.884686+0000","last_became_peered":"2024-09-12T17:52:39.884686+0000","last_unstale":"2024-09-12T19:26:00.349102+0000","last_undegraded":"2024-09-12T19:26:00.349102+0000","last_fullsized":"2024-09-12T19:26:00.349102+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:49.000832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041069+0000","last_change":"2024-09-12T18:25:52.613926+0000","last_active":"2024-09-12T19:26:19.041069+0000","last_peered":"2024-09-12T19:26:19.041069+0000","last_clean":"2024-09-12T19:26:19.041069+0000","last_became_active":"2024-09-12T18:25:52.611450+0000","last_became_peered":"2024-09-12T18:25:52.611450+0000","last_unstale":"2024-09-12T19:26:19.041069+0000","last_undegraded":"2024-09-12T19:26:19.041069+0000","last_fullsized":"2024-09-12T19:26:19.041069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:02.885475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'4","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.381716+0000","last_change":"2024-09-12T17:58:47.254616+0000","last_active":"2024-09-12T19:29:42.381716+0000","last_peered":"2024-09-12T19:29:42.381716+0000","last_clean":"2024-09-12T19:29:42.381716+0000","last_became_active":"2024-09-12T17:58:47.254061+0000","last_became_peered":"2024-09-12T17:58:47.254061+0000","last_unstale":"2024-09-12T19:29:42.381716+0000","last_undegraded":"2024-09-12T19:29:42.381716+0000","last_fullsized":"2024-09-12T19:29:42.381716+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'2","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.299227+0000","last_change":"2024-09-12T17:58:40.203937+0000","last_active":"2024-09-12T19:29:40.299227+0000","last_peered":"2024-09-12T19:29:40.299227+0000","last_clean":"2024-09-12T19:29:40.299227+0000","last_became_active":"2024-09-12T17:58:40.203144+0000","last_became_peered":"2024-09-12T17:58:40.203144+0000","last_unstale":"2024-09-12T19:29:40.299227+0000","last_undegraded":"2024-09-12T19:29:40.299227+0000","last_fullsized":"2024-09-12T19:29:40.299227+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:57.360002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"262'16","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.148725+0000","last_change":"2024-09-12T19:30:19.148725+0000","last_active":"2024-09-12T19:30:19.148725+0000","last_peered":"2024-09-12T19:30:19.148725+0000","last_clean":"2024-09-12T19:30:19.148725+0000","last_became_active":"2024-09-12T17:52:39.878797+0000","last_became_peered":"2024-09-12T17:52:39.878797+0000","last_unstale":"2024-09-12T19:30:19.148725+0000","last_undegraded":"2024-09-12T19:30:19.148725+0000","last_fullsized":"2024-09-12T19:30:19.148725+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-12T19:30:19.148445+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-12T19:30:19.148445+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.148445+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:54.941095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.687851+0000","last_change":"2024-09-12T18:25:52.615680+0000","last_active":"2024-09-12T19:26:45.687851+0000","last_peered":"2024-09-12T19:26:45.687851+0000","last_clean":"2024-09-12T19:26:45.687851+0000","last_became_active":"2024-09-12T18:25:52.614949+0000","last_became_peered":"2024-09-12T18:25:52.614949+0000","last_unstale":"2024-09-12T19:26:45.687851+0000","last_undegraded":"2024-09-12T19:26:45.687851+0000","last_fullsized":"2024-09-12T19:26:45.687851+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:20.554312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.679828+0000","last_change":"2024-09-12T17:58:47.247578+0000","last_active":"2024-09-12T19:27:30.679828+0000","last_peered":"2024-09-12T19:27:30.679828+0000","last_clean":"2024-09-12T19:27:30.679828+0000","last_became_active":"2024-09-12T17:58:47.246916+0000","last_became_peered":"2024-09-12T17:58:47.246916+0000","last_unstale":"2024-09-12T19:27:30.679828+0000","last_undegraded":"2024-09-12T19:27:30.679828+0000","last_fullsized":"2024-09-12T19:27:30.679828+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"262'2","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.796126+0000","last_change":"2024-09-12T19:30:19.796126+0000","last_active":"2024-09-12T19:30:19.796126+0000","last_peered":"2024-09-12T19:30:19.796126+0000","last_clean":"2024-09-12T19:30:19.796126+0000","last_became_active":"2024-09-12T17:58:40.207311+0000","last_became_peered":"2024-09-12T17:58:40.207311+0000","last_unstale":"2024-09-12T19:30:19.796126+0000","last_undegraded":"2024-09-12T19:30:19.796126+0000","last_fullsized":"2024-09-12T19:30:19.796126+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:30:19.795842+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:30:19.795842+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.795842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:01.987352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'29","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.452754+0000","last_change":"2024-09-12T19:30:23.452754+0000","last_active":"2024-09-12T19:30:23.452754+0000","last_peered":"2024-09-12T19:30:23.452754+0000","last_clean":"2024-09-12T19:30:23.452754+0000","last_became_active":"2024-09-12T17:52:39.867179+0000","last_became_peered":"2024-09-12T17:52:39.867179+0000","last_unstale":"2024-09-12T19:30:23.452754+0000","last_undegraded":"2024-09-12T19:30:23.452754+0000","last_fullsized":"2024-09-12T19:30:23.452754+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T19:30:23.452558+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T19:30:23.452558+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.452558+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:54.100502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":56,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:19.041017+0000","last_change":"2024-09-12T18:25:52.612961+0000","last_active":"2024-09-12T19:26:19.041017+0000","last_peered":"2024-09-12T19:26:19.041017+0000","last_clean":"2024-09-12T19:26:19.041017+0000","last_became_active":"2024-09-12T18:25:52.610587+0000","last_became_peered":"2024-09-12T18:25:52.610587+0000","last_unstale":"2024-09-12T19:26:19.041017+0000","last_undegraded":"2024-09-12T19:26:19.041017+0000","last_fullsized":"2024-09-12T19:26:19.041017+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:48.847349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.371113+0000","last_change":"2024-09-12T17:58:47.251206+0000","last_active":"2024-09-12T19:27:30.371113+0000","last_peered":"2024-09-12T19:27:30.371113+0000","last_clean":"2024-09-12T19:27:30.371113+0000","last_became_active":"2024-09-12T17:58:47.245601+0000","last_became_peered":"2024-09-12T17:58:47.245601+0000","last_unstale":"2024-09-12T19:27:30.371113+0000","last_undegraded":"2024-09-12T19:27:30.371113+0000","last_fullsized":"2024-09-12T19:27:30.371113+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'4","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.763420+0000","last_change":"2024-09-12T19:30:18.763420+0000","last_active":"2024-09-12T19:30:18.763420+0000","last_peered":"2024-09-12T19:30:18.763420+0000","last_clean":"2024-09-12T19:30:18.763420+0000","last_became_active":"2024-09-12T17:58:40.202408+0000","last_became_peered":"2024-09-12T17:58:40.202408+0000","last_unstale":"2024-09-12T19:30:18.763420+0000","last_undegraded":"2024-09-12T19:30:18.763420+0000","last_fullsized":"2024-09-12T19:30:18.763420+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T19:30:18.763226+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T19:30:18.763226+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.763226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:19.391027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":531,"num_write":4,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'109","reported_seq":450,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.106728+0000","last_change":"2024-09-12T19:30:18.106728+0000","last_active":"2024-09-12T19:30:18.106728+0000","last_peered":"2024-09-12T19:30:18.106728+0000","last_clean":"2024-09-12T19:30:18.106728+0000","last_became_active":"2024-09-12T17:52:39.880742+0000","last_became_peered":"2024-09-12T17:52:39.880742+0000","last_unstale":"2024-09-12T19:30:18.106728+0000","last_undegraded":"2024-09-12T19:30:18.106728+0000","last_fullsized":"2024-09-12T19:30:18.106728+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T19:30:18.106534+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T19:30:18.106534+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.106534+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:40.456813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":720,"num_read_kb":486,"num_write":145,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3486,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:55.258684+0000","last_change":"2024-09-12T18:25:52.605986+0000","last_active":"2024-09-12T19:26:55.258684+0000","last_peered":"2024-09-12T19:26:55.258684+0000","last_clean":"2024-09-12T19:26:55.258684+0000","last_became_active":"2024-09-12T18:25:52.605039+0000","last_became_peered":"2024-09-12T18:25:52.605039+0000","last_unstale":"2024-09-12T19:26:55.258684+0000","last_undegraded":"2024-09-12T19:26:55.258684+0000","last_fullsized":"2024-09-12T19:26:55.258684+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.770637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'7","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:50.697898+0000","last_change":"2024-09-12T17:58:47.242884+0000","last_active":"2024-09-12T19:28:50.697898+0000","last_peered":"2024-09-12T19:28:50.697898+0000","last_clean":"2024-09-12T19:28:50.697898+0000","last_became_active":"2024-09-12T17:58:47.241778+0000","last_became_peered":"2024-09-12T17:58:47.241778+0000","last_unstale":"2024-09-12T19:28:50.697898+0000","last_undegraded":"2024-09-12T19:28:50.697898+0000","last_fullsized":"2024-09-12T19:28:50.697898+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:36.555666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3074,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.451881+0000","last_change":"2024-09-12T19:30:22.451881+0000","last_active":"2024-09-12T19:30:22.451881+0000","last_peered":"2024-09-12T19:30:22.451881+0000","last_clean":"2024-09-12T19:30:22.451881+0000","last_became_active":"2024-09-12T17:58:40.195309+0000","last_became_peered":"2024-09-12T17:58:40.195309+0000","last_unstale":"2024-09-12T19:30:22.451881+0000","last_undegraded":"2024-09-12T19:30:22.451881+0000","last_fullsized":"2024-09-12T19:30:22.451881+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:22.451699+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:22.451699+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.451699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:38.841086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"262'110","reported_seq":458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:25.678784+0000","last_change":"2024-09-12T17:52:39.886824+0000","last_active":"2024-09-12T19:27:25.678784+0000","last_peered":"2024-09-12T19:27:25.678784+0000","last_clean":"2024-09-12T19:27:25.678784+0000","last_became_active":"2024-09-12T17:52:39.886185+0000","last_became_peered":"2024-09-12T17:52:39.886185+0000","last_unstale":"2024-09-12T19:27:25.678784+0000","last_undegraded":"2024-09-12T19:27:25.678784+0000","last_fullsized":"2024-09-12T19:27:25.678784+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:31.714670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":756,"num_read_kb":514,"num_write":140,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.088040+0000","last_change":"2024-09-12T18:25:52.624391+0000","last_active":"2024-09-12T19:26:40.088040+0000","last_peered":"2024-09-12T19:26:40.088040+0000","last_clean":"2024-09-12T19:26:40.088040+0000","last_became_active":"2024-09-12T18:25:52.623444+0000","last_became_peered":"2024-09-12T18:25:52.623444+0000","last_unstale":"2024-09-12T19:26:40.088040+0000","last_undegraded":"2024-09-12T19:26:40.088040+0000","last_fullsized":"2024-09-12T19:26:40.088040+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:41.418750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667006+0000","last_change":"2024-09-12T17:58:47.255347+0000","last_active":"2024-09-12T19:26:35.667006+0000","last_peered":"2024-09-12T19:26:35.667006+0000","last_clean":"2024-09-12T19:26:35.667006+0000","last_became_active":"2024-09-12T17:58:47.254273+0000","last_became_peered":"2024-09-12T17:58:47.254273+0000","last_unstale":"2024-09-12T19:26:35.667006+0000","last_undegraded":"2024-09-12T19:26:35.667006+0000","last_fullsized":"2024-09-12T19:26:35.667006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:34.502761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'2","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.560588+0000","last_change":"2024-09-12T19:30:25.560588+0000","last_active":"2024-09-12T19:30:25.560588+0000","last_peered":"2024-09-12T19:30:25.560588+0000","last_clean":"2024-09-12T19:30:25.560588+0000","last_became_active":"2024-09-12T17:58:40.202027+0000","last_became_peered":"2024-09-12T17:58:40.202027+0000","last_unstale":"2024-09-12T19:30:25.560588+0000","last_undegraded":"2024-09-12T19:30:25.560588+0000","last_fullsized":"2024-09-12T19:30:25.560588+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:25.560411+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:25.560411+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.560411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:21.949121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'31","reported_seq":153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:10.366551+0000","last_change":"2024-09-12T17:52:39.877904+0000","last_active":"2024-09-12T19:27:10.366551+0000","last_peered":"2024-09-12T19:27:10.366551+0000","last_clean":"2024-09-12T19:27:10.366551+0000","last_became_active":"2024-09-12T17:52:39.877206+0000","last_became_peered":"2024-09-12T17:52:39.877206+0000","last_unstale":"2024-09-12T19:27:10.366551+0000","last_undegraded":"2024-09-12T19:27:10.366551+0000","last_fullsized":"2024-09-12T19:27:10.366551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.931327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":97,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.357743+0000","last_change":"2024-09-12T18:25:52.620716+0000","last_active":"2024-09-12T19:26:35.357743+0000","last_peered":"2024-09-12T19:26:35.357743+0000","last_clean":"2024-09-12T19:26:35.357743+0000","last_became_active":"2024-09-12T18:25:52.620045+0000","last_became_peered":"2024-09-12T18:25:52.620045+0000","last_unstale":"2024-09-12T19:26:35.357743+0000","last_undegraded":"2024-09-12T19:26:35.357743+0000","last_fullsized":"2024-09-12T19:26:35.357743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:58.464498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:50.670475+0000","last_change":"2024-09-12T17:58:47.253752+0000","last_active":"2024-09-12T19:26:50.670475+0000","last_peered":"2024-09-12T19:26:50.670475+0000","last_clean":"2024-09-12T19:26:50.670475+0000","last_became_active":"2024-09-12T17:58:47.252966+0000","last_became_peered":"2024-09-12T17:58:47.252966+0000","last_unstale":"2024-09-12T19:26:50.670475+0000","last_undegraded":"2024-09-12T19:26:50.670475+0000","last_fullsized":"2024-09-12T19:26:50.670475+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:12.503210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'9","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.154254+0000","last_change":"2024-09-12T19:30:24.154254+0000","last_active":"2024-09-12T19:30:24.154254+0000","last_peered":"2024-09-12T19:30:24.154254+0000","last_clean":"2024-09-12T19:30:24.154254+0000","last_became_active":"2024-09-12T17:58:40.198161+0000","last_became_peered":"2024-09-12T17:58:40.198161+0000","last_unstale":"2024-09-12T19:30:24.154254+0000","last_undegraded":"2024-09-12T19:30:24.154254+0000","last_fullsized":"2024-09-12T19:30:24.154254+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T19:30:24.154077+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T19:30:24.154077+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.154077+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:21.687233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'31","reported_seq":162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.714425+0000","last_change":"2024-09-12T19:30:17.714425+0000","last_active":"2024-09-12T19:30:17.714425+0000","last_peered":"2024-09-12T19:30:17.714425+0000","last_clean":"2024-09-12T19:30:17.714425+0000","last_became_active":"2024-09-12T17:52:39.866342+0000","last_became_peered":"2024-09-12T17:52:39.866342+0000","last_unstale":"2024-09-12T19:30:17.714425+0000","last_undegraded":"2024-09-12T19:30:17.714425+0000","last_fullsized":"2024-09-12T19:30:17.714425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:30:17.714240+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:30:17.714240+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.714240+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:07.207076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":107,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.791871+0000","last_change":"2024-09-12T19:30:24.791871+0000","last_active":"2024-09-12T19:30:24.791871+0000","last_peered":"2024-09-12T19:30:24.791871+0000","last_clean":"2024-09-12T19:30:24.791871+0000","last_became_active":"2024-09-12T18:25:52.599679+0000","last_became_peered":"2024-09-12T18:25:52.599679+0000","last_unstale":"2024-09-12T19:30:24.791871+0000","last_undegraded":"2024-09-12T19:30:24.791871+0000","last_fullsized":"2024-09-12T19:30:24.791871+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:24.791652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:24.791652+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.791652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:49.255999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'2","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:50.286775+0000","last_change":"2024-09-12T17:58:47.256589+0000","last_active":"2024-09-12T19:28:50.286775+0000","last_peered":"2024-09-12T19:28:50.286775+0000","last_clean":"2024-09-12T19:28:50.286775+0000","last_became_active":"2024-09-12T17:58:47.255891+0000","last_became_peered":"2024-09-12T17:58:47.255891+0000","last_unstale":"2024-09-12T19:28:50.286775+0000","last_undegraded":"2024-09-12T19:28:50.286775+0000","last_fullsized":"2024-09-12T19:28:50.286775+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:52.933367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"262'3","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668287+0000","last_change":"2024-09-12T17:58:40.212187+0000","last_active":"2024-09-12T19:26:40.668287+0000","last_peered":"2024-09-12T19:26:40.668287+0000","last_clean":"2024-09-12T19:26:40.668287+0000","last_became_active":"2024-09-12T17:58:40.211450+0000","last_became_peered":"2024-09-12T17:58:40.211450+0000","last_unstale":"2024-09-12T19:26:40.668287+0000","last_undegraded":"2024-09-12T19:26:40.668287+0000","last_fullsized":"2024-09-12T19:26:40.668287+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:21.169200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'25","reported_seq":152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.448771+0000","last_change":"2024-09-12T19:30:18.448771+0000","last_active":"2024-09-12T19:30:18.448771+0000","last_peered":"2024-09-12T19:30:18.448771+0000","last_clean":"2024-09-12T19:30:18.448771+0000","last_became_active":"2024-09-12T17:52:39.865914+0000","last_became_peered":"2024-09-12T17:52:39.865914+0000","last_unstale":"2024-09-12T19:30:18.448771+0000","last_undegraded":"2024-09-12T19:30:18.448771+0000","last_fullsized":"2024-09-12T19:30:18.448771+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T19:30:18.448582+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T19:30:18.448582+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.448582+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:59.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255364+0000","last_change":"2024-09-12T18:25:52.613354+0000","last_active":"2024-09-12T19:26:40.255364+0000","last_peered":"2024-09-12T19:26:40.255364+0000","last_clean":"2024-09-12T19:26:40.255364+0000","last_became_active":"2024-09-12T18:25:52.612421+0000","last_became_peered":"2024-09-12T18:25:52.612421+0000","last_unstale":"2024-09-12T19:26:40.255364+0000","last_undegraded":"2024-09-12T19:26:40.255364+0000","last_fullsized":"2024-09-12T19:26:40.255364+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:29.095745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.153845+0000","last_change":"2024-09-12T17:58:47.246522+0000","last_active":"2024-09-12T19:29:42.153845+0000","last_peered":"2024-09-12T19:29:42.153845+0000","last_clean":"2024-09-12T19:29:42.153845+0000","last_became_active":"2024-09-12T17:58:47.238172+0000","last_became_peered":"2024-09-12T17:58:47.238172+0000","last_unstale":"2024-09-12T19:29:42.153845+0000","last_undegraded":"2024-09-12T19:29:42.153845+0000","last_fullsized":"2024-09-12T19:29:42.153845+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'7","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.122090+0000","last_change":"2024-09-12T19:30:22.122090+0000","last_active":"2024-09-12T19:30:22.122090+0000","last_peered":"2024-09-12T19:30:22.122090+0000","last_clean":"2024-09-12T19:30:22.122090+0000","last_became_active":"2024-09-12T17:58:40.194093+0000","last_became_peered":"2024-09-12T17:58:40.194093+0000","last_unstale":"2024-09-12T19:30:22.122090+0000","last_undegraded":"2024-09-12T19:30:22.122090+0000","last_fullsized":"2024-09-12T19:30:22.122090+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:22.121867+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:22.121867+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.121867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:13.444419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'38","reported_seq":190,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.463274+0000","last_change":"2024-09-12T19:30:19.463274+0000","last_active":"2024-09-12T19:30:19.463274+0000","last_peered":"2024-09-12T19:30:19.463274+0000","last_clean":"2024-09-12T19:30:19.463274+0000","last_became_active":"2024-09-12T17:52:39.887302+0000","last_became_peered":"2024-09-12T17:52:39.887302+0000","last_unstale":"2024-09-12T19:30:19.463274+0000","last_undegraded":"2024-09-12T19:30:19.463274+0000","last_fullsized":"2024-09-12T19:30:19.463274+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T19:30:19.463087+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T19:30:19.463087+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.463087+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:51.782994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":146,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:00.249879+0000","last_change":"2024-09-12T18:25:52.611745+0000","last_active":"2024-09-12T19:27:00.249879+0000","last_peered":"2024-09-12T19:27:00.249879+0000","last_clean":"2024-09-12T19:27:00.249879+0000","last_became_active":"2024-09-12T18:25:52.611022+0000","last_became_peered":"2024-09-12T18:25:52.611022+0000","last_unstale":"2024-09-12T19:27:00.249879+0000","last_undegraded":"2024-09-12T19:27:00.249879+0000","last_fullsized":"2024-09-12T19:27:00.249879+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:05.067276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"262'5","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:40.258672+0000","last_change":"2024-09-12T17:58:47.248839+0000","last_active":"2024-09-12T19:27:40.258672+0000","last_peered":"2024-09-12T19:27:40.258672+0000","last_clean":"2024-09-12T19:27:40.258672+0000","last_became_active":"2024-09-12T17:58:47.247599+0000","last_became_peered":"2024-09-12T17:58:47.247599+0000","last_unstale":"2024-09-12T19:27:40.258672+0000","last_undegraded":"2024-09-12T19:27:40.258672+0000","last_fullsized":"2024-09-12T19:27:40.258672+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'8","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.299268+0000","last_change":"2024-09-12T17:58:40.203966+0000","last_active":"2024-09-12T19:29:40.299268+0000","last_peered":"2024-09-12T19:29:40.299268+0000","last_clean":"2024-09-12T19:29:40.299268+0000","last_became_active":"2024-09-12T17:58:40.203177+0000","last_became_peered":"2024-09-12T17:58:40.203177+0000","last_unstale":"2024-09-12T19:29:40.299268+0000","last_undegraded":"2024-09-12T19:29:40.299268+0000","last_fullsized":"2024-09-12T19:29:40.299268+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:05.344996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'30","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.469599+0000","last_change":"2024-09-12T19:30:14.469599+0000","last_active":"2024-09-12T19:30:14.469599+0000","last_peered":"2024-09-12T19:30:14.469599+0000","last_clean":"2024-09-12T19:30:14.469599+0000","last_became_active":"2024-09-12T17:52:39.877793+0000","last_became_peered":"2024-09-12T17:52:39.877793+0000","last_unstale":"2024-09-12T19:30:14.469599+0000","last_undegraded":"2024-09-12T19:30:14.469599+0000","last_fullsized":"2024-09-12T19:30:14.469599+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:30:14.469391+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:30:14.469391+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.469391+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:09.596072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.583339+0000","last_change":"2024-09-12T19:30:21.583339+0000","last_active":"2024-09-12T19:30:21.583339+0000","last_peered":"2024-09-12T19:30:21.583339+0000","last_clean":"2024-09-12T19:30:21.583339+0000","last_became_active":"2024-09-12T18:25:52.617815+0000","last_became_peered":"2024-09-12T18:25:52.617815+0000","last_unstale":"2024-09-12T19:30:21.583339+0000","last_undegraded":"2024-09-12T19:30:21.583339+0000","last_fullsized":"2024-09-12T19:30:21.583339+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:21.583159+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:21.583159+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.583159+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:14.492012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.630190+0000","last_change":"2024-09-12T19:30:27.630190+0000","last_active":"2024-09-12T19:30:27.630190+0000","last_peered":"2024-09-12T19:30:27.630190+0000","last_clean":"2024-09-12T19:30:27.630190+0000","last_became_active":"2024-09-12T17:58:47.256924+0000","last_became_peered":"2024-09-12T17:58:47.256924+0000","last_unstale":"2024-09-12T19:30:27.630190+0000","last_undegraded":"2024-09-12T19:30:27.630190+0000","last_fullsized":"2024-09-12T19:30:27.630190+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:27.630005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:27.630005+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.630005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:00.280135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.137520+0000","last_change":"2024-09-12T19:30:23.137520+0000","last_active":"2024-09-12T19:30:23.137520+0000","last_peered":"2024-09-12T19:30:23.137520+0000","last_clean":"2024-09-12T19:30:23.137520+0000","last_became_active":"2024-09-12T17:58:40.193786+0000","last_became_peered":"2024-09-12T17:58:40.193786+0000","last_unstale":"2024-09-12T19:30:23.137520+0000","last_undegraded":"2024-09-12T19:30:23.137520+0000","last_fullsized":"2024-09-12T19:30:23.137520+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:23.137344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:23.137344+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.137344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:57.159246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'23","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.274356+0000","last_change":"2024-09-12T17:52:39.875927+0000","last_active":"2024-09-12T19:28:00.274356+0000","last_peered":"2024-09-12T19:28:00.274356+0000","last_clean":"2024-09-12T19:28:00.274356+0000","last_became_active":"2024-09-12T17:52:39.869627+0000","last_became_peered":"2024-09-12T17:52:39.869627+0000","last_unstale":"2024-09-12T19:28:00.274356+0000","last_undegraded":"2024-09-12T19:28:00.274356+0000","last_fullsized":"2024-09-12T19:28:00.274356+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":43,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.668164+0000","last_change":"2024-09-12T18:25:52.624807+0000","last_active":"2024-09-12T19:26:40.668164+0000","last_peered":"2024-09-12T19:26:40.668164+0000","last_clean":"2024-09-12T19:26:40.668164+0000","last_became_active":"2024-09-12T18:25:52.624296+0000","last_became_peered":"2024-09-12T18:25:52.624296+0000","last_unstale":"2024-09-12T19:26:40.668164+0000","last_undegraded":"2024-09-12T19:26:40.668164+0000","last_fullsized":"2024-09-12T19:26:40.668164+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:35.580294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"265'8","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.532548+0000","last_change":"2024-09-12T19:30:19.532548+0000","last_active":"2024-09-12T19:30:19.532548+0000","last_peered":"2024-09-12T19:30:19.532548+0000","last_clean":"2024-09-12T19:30:19.532548+0000","last_became_active":"2024-09-12T17:58:47.242874+0000","last_became_peered":"2024-09-12T17:58:47.242874+0000","last_unstale":"2024-09-12T19:30:19.532548+0000","last_undegraded":"2024-09-12T19:30:19.532548+0000","last_fullsized":"2024-09-12T19:30:19.532548+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:30:19.532362+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:30:19.532362+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.532362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:37.223457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9787,"num_write":8,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'5","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:40.387779+0000","last_change":"2024-09-12T17:58:40.175758+0000","last_active":"2024-09-12T19:28:40.387779+0000","last_peered":"2024-09-12T19:28:40.387779+0000","last_clean":"2024-09-12T19:28:40.387779+0000","last_became_active":"2024-09-12T17:58:40.175011+0000","last_became_peered":"2024-09-12T17:58:40.175011+0000","last_unstale":"2024-09-12T19:28:40.387779+0000","last_undegraded":"2024-09-12T19:28:40.387779+0000","last_fullsized":"2024-09-12T19:28:40.387779+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:29.337157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'56","reported_seq":242,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.530629+0000","last_change":"2024-09-12T19:30:13.530629+0000","last_active":"2024-09-12T19:30:13.530629+0000","last_peered":"2024-09-12T19:30:13.530629+0000","last_clean":"2024-09-12T19:30:13.530629+0000","last_became_active":"2024-09-12T17:52:39.884599+0000","last_became_peered":"2024-09-12T17:52:39.884599+0000","last_unstale":"2024-09-12T19:30:13.530629+0000","last_undegraded":"2024-09-12T19:30:13.530629+0000","last_fullsized":"2024-09-12T19:30:13.530629+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'56","last_scrub_stamp":"2024-09-12T19:30:13.530439+0000","last_deep_scrub":"265'56","last_deep_scrub_stamp":"2024-09-12T19:30:13.530439+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.530439+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:08.962809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":231,"num_write":89,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.567612+0000","last_change":"2024-09-12T19:30:22.567612+0000","last_active":"2024-09-12T19:30:22.567612+0000","last_peered":"2024-09-12T19:30:22.567612+0000","last_clean":"2024-09-12T19:30:22.567612+0000","last_became_active":"2024-09-12T18:25:52.602495+0000","last_became_peered":"2024-09-12T18:25:52.602495+0000","last_unstale":"2024-09-12T19:30:22.567612+0000","last_undegraded":"2024-09-12T19:30:22.567612+0000","last_fullsized":"2024-09-12T19:30:22.567612+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.567427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.567427+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.567427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:55.493271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'12","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.929898+0000","last_change":"2024-09-12T17:58:47.255006+0000","last_active":"2024-09-12T19:29:41.929898+0000","last_peered":"2024-09-12T19:29:41.929898+0000","last_clean":"2024-09-12T19:29:41.929898+0000","last_became_active":"2024-09-12T17:58:47.254272+0000","last_became_peered":"2024-09-12T17:58:47.254272+0000","last_unstale":"2024-09-12T19:29:41.929898+0000","last_undegraded":"2024-09-12T19:29:41.929898+0000","last_fullsized":"2024-09-12T19:29:41.929898+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:11.620938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":22,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'6","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.809942+0000","last_change":"2024-09-12T17:58:40.195873+0000","last_active":"2024-09-12T19:29:41.809942+0000","last_peered":"2024-09-12T19:29:41.809942+0000","last_clean":"2024-09-12T19:29:41.809942+0000","last_became_active":"2024-09-12T17:58:40.195089+0000","last_became_peered":"2024-09-12T17:58:40.195089+0000","last_unstale":"2024-09-12T19:29:41.809942+0000","last_undegraded":"2024-09-12T19:29:41.809942+0000","last_fullsized":"2024-09-12T19:29:41.809942+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'27","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.704524+0000","last_change":"2024-09-12T17:52:39.868988+0000","last_active":"2024-09-12T19:28:00.704524+0000","last_peered":"2024-09-12T19:28:00.704524+0000","last_clean":"2024-09-12T19:28:00.704524+0000","last_became_active":"2024-09-12T17:52:39.867605+0000","last_became_peered":"2024-09-12T17:52:39.867605+0000","last_unstale":"2024-09-12T19:28:00.704524+0000","last_undegraded":"2024-09-12T19:28:00.704524+0000","last_fullsized":"2024-09-12T19:28:00.704524+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":99,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.578328+0000","last_change":"2024-09-12T19:30:20.578328+0000","last_active":"2024-09-12T19:30:20.578328+0000","last_peered":"2024-09-12T19:30:20.578328+0000","last_clean":"2024-09-12T19:30:20.578328+0000","last_became_active":"2024-09-12T18:25:52.614383+0000","last_became_peered":"2024-09-12T18:25:52.614383+0000","last_unstale":"2024-09-12T19:30:20.578328+0000","last_undegraded":"2024-09-12T19:30:20.578328+0000","last_fullsized":"2024-09-12T19:30:20.578328+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:20.578143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:20.578143+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.578143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:29.627919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"265'5","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.617664+0000","last_change":"2024-09-12T17:58:47.249774+0000","last_active":"2024-09-12T19:29:41.617664+0000","last_peered":"2024-09-12T19:29:41.617664+0000","last_clean":"2024-09-12T19:29:41.617664+0000","last_became_active":"2024-09-12T17:58:47.248924+0000","last_became_peered":"2024-09-12T17:58:47.248924+0000","last_unstale":"2024-09-12T19:29:41.617664+0000","last_undegraded":"2024-09-12T19:29:41.617664+0000","last_fullsized":"2024-09-12T19:29:41.617664+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.643262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:35.712307+0000","last_change":"2024-09-12T17:58:40.188344+0000","last_active":"2024-09-12T19:28:35.712307+0000","last_peered":"2024-09-12T19:28:35.712307+0000","last_clean":"2024-09-12T19:28:35.712307+0000","last_became_active":"2024-09-12T17:58:40.187590+0000","last_became_peered":"2024-09-12T17:58:40.187590+0000","last_unstale":"2024-09-12T19:28:35.712307+0000","last_undegraded":"2024-09-12T19:28:35.712307+0000","last_fullsized":"2024-09-12T19:28:35.712307+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:15.651076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'13","reported_seq":112,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:00.378453+0000","last_change":"2024-09-12T17:52:39.881326+0000","last_active":"2024-09-12T19:28:00.378453+0000","last_peered":"2024-09-12T19:28:00.378453+0000","last_clean":"2024-09-12T19:28:00.378453+0000","last_became_active":"2024-09-12T17:52:39.872599+0000","last_became_peered":"2024-09-12T17:52:39.872599+0000","last_unstale":"2024-09-12T19:28:00.378453+0000","last_undegraded":"2024-09-12T19:28:00.378453+0000","last_fullsized":"2024-09-12T19:28:00.378453+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.277939+0000","last_change":"2024-09-12T18:25:52.612438+0000","last_active":"2024-09-12T19:28:15.277939+0000","last_peered":"2024-09-12T19:28:15.277939+0000","last_clean":"2024-09-12T19:28:15.277939+0000","last_became_active":"2024-09-12T18:25:52.611377+0000","last_became_peered":"2024-09-12T18:25:52.611377+0000","last_unstale":"2024-09-12T19:28:15.277939+0000","last_undegraded":"2024-09-12T19:28:15.277939+0000","last_fullsized":"2024-09-12T19:28:15.277939+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'2","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.492975+0000","last_change":"2024-09-12T19:30:15.492975+0000","last_active":"2024-09-12T19:30:15.492975+0000","last_peered":"2024-09-12T19:30:15.492975+0000","last_clean":"2024-09-12T19:30:15.492975+0000","last_became_active":"2024-09-12T17:58:47.242171+0000","last_became_peered":"2024-09-12T17:58:47.242171+0000","last_unstale":"2024-09-12T19:30:15.492975+0000","last_undegraded":"2024-09-12T19:30:15.492975+0000","last_fullsized":"2024-09-12T19:30:15.492975+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:15.492790+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:15.492790+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.492790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:32.038503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.463614+0000","last_change":"2024-09-12T19:30:21.463614+0000","last_active":"2024-09-12T19:30:21.463614+0000","last_peered":"2024-09-12T19:30:21.463614+0000","last_clean":"2024-09-12T19:30:21.463614+0000","last_became_active":"2024-09-12T17:58:40.210485+0000","last_became_peered":"2024-09-12T17:58:40.210485+0000","last_unstale":"2024-09-12T19:30:21.463614+0000","last_undegraded":"2024-09-12T19:30:21.463614+0000","last_fullsized":"2024-09-12T19:30:21.463614+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:21.463437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:21.463437+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.463437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:34.504209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'25","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.476360+0000","last_change":"2024-09-12T19:30:19.476360+0000","last_active":"2024-09-12T19:30:19.476360+0000","last_peered":"2024-09-12T19:30:19.476360+0000","last_clean":"2024-09-12T19:30:19.476360+0000","last_became_active":"2024-09-12T17:52:39.868837+0000","last_became_peered":"2024-09-12T17:52:39.868837+0000","last_unstale":"2024-09-12T19:30:19.476360+0000","last_undegraded":"2024-09-12T19:30:19.476360+0000","last_fullsized":"2024-09-12T19:30:19.476360+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T19:30:19.476149+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T19:30:19.476149+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.476149+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:37.829486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.353905+0000","last_change":"2024-09-12T18:25:52.615446+0000","last_active":"2024-09-12T19:26:20.353905+0000","last_peered":"2024-09-12T19:26:20.353905+0000","last_clean":"2024-09-12T19:26:20.353905+0000","last_became_active":"2024-09-12T18:25:52.611546+0000","last_became_peered":"2024-09-12T18:25:52.611546+0000","last_unstale":"2024-09-12T19:26:20.353905+0000","last_undegraded":"2024-09-12T19:26:20.353905+0000","last_fullsized":"2024-09-12T19:26:20.353905+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:59.006168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'7","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.263769+0000","last_change":"2024-09-12T17:58:47.246295+0000","last_active":"2024-09-12T19:29:42.263769+0000","last_peered":"2024-09-12T19:29:42.263769+0000","last_clean":"2024-09-12T19:29:42.263769+0000","last_became_active":"2024-09-12T17:58:47.245441+0000","last_became_peered":"2024-09-12T17:58:47.245441+0000","last_unstale":"2024-09-12T19:29:42.263769+0000","last_undegraded":"2024-09-12T19:29:42.263769+0000","last_fullsized":"2024-09-12T19:29:42.263769+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:40.401205+0000","last_change":"2024-09-12T17:58:40.192872+0000","last_active":"2024-09-12T19:29:40.401205+0000","last_peered":"2024-09-12T19:29:40.401205+0000","last_clean":"2024-09-12T19:29:40.401205+0000","last_became_active":"2024-09-12T17:58:40.191999+0000","last_became_peered":"2024-09-12T17:58:40.191999+0000","last_unstale":"2024-09-12T19:29:40.401205+0000","last_undegraded":"2024-09-12T19:29:40.401205+0000","last_fullsized":"2024-09-12T19:29:40.401205+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.003714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'36","reported_seq":180,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.142894+0000","last_change":"2024-09-12T19:30:16.142894+0000","last_active":"2024-09-12T19:30:16.142894+0000","last_peered":"2024-09-12T19:30:16.142894+0000","last_clean":"2024-09-12T19:30:16.142894+0000","last_became_active":"2024-09-12T17:52:39.890678+0000","last_became_peered":"2024-09-12T17:52:39.890678+0000","last_unstale":"2024-09-12T19:30:16.142894+0000","last_undegraded":"2024-09-12T19:30:16.142894+0000","last_fullsized":"2024-09-12T19:30:16.142894+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'36","last_scrub_stamp":"2024-09-12T19:30:16.142621+0000","last_deep_scrub":"265'36","last_deep_scrub_stamp":"2024-09-12T19:30:16.142621+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.142621+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:52.794048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.667105+0000","last_change":"2024-09-12T18:25:52.612356+0000","last_active":"2024-09-12T19:26:35.667105+0000","last_peered":"2024-09-12T19:26:35.667105+0000","last_clean":"2024-09-12T19:26:35.667105+0000","last_became_active":"2024-09-12T18:25:52.611397+0000","last_became_peered":"2024-09-12T18:25:52.611397+0000","last_unstale":"2024-09-12T19:26:35.667105+0000","last_undegraded":"2024-09-12T19:26:35.667105+0000","last_fullsized":"2024-09-12T19:26:35.667105+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:59.482482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:25.709867+0000","last_change":"2024-09-12T17:58:47.241676+0000","last_active":"2024-09-12T19:28:25.709867+0000","last_peered":"2024-09-12T19:28:25.709867+0000","last_clean":"2024-09-12T19:28:25.709867+0000","last_became_active":"2024-09-12T17:58:47.240951+0000","last_became_peered":"2024-09-12T17:58:47.240951+0000","last_unstale":"2024-09-12T19:28:25.709867+0000","last_undegraded":"2024-09-12T19:28:25.709867+0000","last_fullsized":"2024-09-12T19:28:25.709867+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:38.662807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.478912+0000","last_change":"2024-09-12T19:30:20.478912+0000","last_active":"2024-09-12T19:30:20.478912+0000","last_peered":"2024-09-12T19:30:20.478912+0000","last_clean":"2024-09-12T19:30:20.478912+0000","last_became_active":"2024-09-12T17:58:40.211891+0000","last_became_peered":"2024-09-12T17:58:40.211891+0000","last_unstale":"2024-09-12T19:30:20.478912+0000","last_undegraded":"2024-09-12T19:30:20.478912+0000","last_fullsized":"2024-09-12T19:30:20.478912+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:20.478718+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:20.478718+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.478718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:47.734936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'53","reported_seq":233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.479087+0000","last_change":"2024-09-12T19:30:18.479087+0000","last_active":"2024-09-12T19:30:18.479087+0000","last_peered":"2024-09-12T19:30:18.479087+0000","last_clean":"2024-09-12T19:30:18.479087+0000","last_became_active":"2024-09-12T17:52:39.878694+0000","last_became_peered":"2024-09-12T17:52:39.878694+0000","last_unstale":"2024-09-12T19:30:18.479087+0000","last_undegraded":"2024-09-12T19:30:18.479087+0000","last_fullsized":"2024-09-12T19:30:18.479087+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'53","last_scrub_stamp":"2024-09-12T19:30:18.478904+0000","last_deep_scrub":"265'53","last_deep_scrub_stamp":"2024-09-12T19:30:18.478904+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.478904+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:35.429667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":199,"num_write":92,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.685676+0000","last_change":"2024-09-12T18:25:52.620080+0000","last_active":"2024-09-12T19:26:35.685676+0000","last_peered":"2024-09-12T19:26:35.685676+0000","last_clean":"2024-09-12T19:26:35.685676+0000","last_became_active":"2024-09-12T18:25:52.619540+0000","last_became_peered":"2024-09-12T18:25:52.619540+0000","last_unstale":"2024-09-12T19:26:35.685676+0000","last_undegraded":"2024-09-12T19:26:35.685676+0000","last_fullsized":"2024-09-12T19:26:35.685676+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:07.956389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368657+0000","last_change":"2024-09-12T17:58:47.245205+0000","last_active":"2024-09-12T19:27:20.368657+0000","last_peered":"2024-09-12T19:27:20.368657+0000","last_clean":"2024-09-12T19:27:20.368657+0000","last_became_active":"2024-09-12T17:58:47.238232+0000","last_became_peered":"2024-09-12T17:58:47.238232+0000","last_unstale":"2024-09-12T19:27:20.368657+0000","last_undegraded":"2024-09-12T19:27:20.368657+0000","last_fullsized":"2024-09-12T19:27:20.368657+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:59.889739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"262'7","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.381893+0000","last_change":"2024-09-12T17:58:40.198949+0000","last_active":"2024-09-12T19:28:15.381893+0000","last_peered":"2024-09-12T19:28:15.381893+0000","last_clean":"2024-09-12T19:28:15.381893+0000","last_became_active":"2024-09-12T17:58:40.197815+0000","last_became_peered":"2024-09-12T17:58:40.197815+0000","last_unstale":"2024-09-12T19:28:15.381893+0000","last_undegraded":"2024-09-12T19:28:15.381893+0000","last_fullsized":"2024-09-12T19:28:15.381893+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'72","reported_seq":273,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355384+0000","last_change":"2024-09-12T17:52:39.876517+0000","last_active":"2024-09-12T19:26:25.355384+0000","last_peered":"2024-09-12T19:26:25.355384+0000","last_clean":"2024-09-12T19:26:25.355384+0000","last_became_active":"2024-09-12T17:52:39.872148+0000","last_became_peered":"2024-09-12T17:52:39.872148+0000","last_unstale":"2024-09-12T19:26:25.355384+0000","last_undegraded":"2024-09-12T19:26:25.355384+0000","last_fullsized":"2024-09-12T19:26:25.355384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.681891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":261,"num_write":116,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250622+0000","last_change":"2024-09-12T18:25:52.624296+0000","last_active":"2024-09-12T19:26:20.250622+0000","last_peered":"2024-09-12T19:26:20.250622+0000","last_clean":"2024-09-12T19:26:20.250622+0000","last_became_active":"2024-09-12T18:25:52.623635+0000","last_became_peered":"2024-09-12T18:25:52.623635+0000","last_unstale":"2024-09-12T19:26:20.250622+0000","last_undegraded":"2024-09-12T19:26:20.250622+0000","last_fullsized":"2024-09-12T19:26:20.250622+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:13.996677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"265'9","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.364060+0000","last_change":"2024-09-12T17:58:47.251669+0000","last_active":"2024-09-12T19:29:41.364060+0000","last_peered":"2024-09-12T19:29:41.364060+0000","last_clean":"2024-09-12T19:29:41.364060+0000","last_became_active":"2024-09-12T17:58:47.250762+0000","last_became_peered":"2024-09-12T17:58:47.250762+0000","last_unstale":"2024-09-12T19:29:41.364060+0000","last_undegraded":"2024-09-12T19:29:41.364060+0000","last_fullsized":"2024-09-12T19:29:41.364060+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:16.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9216,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.511211+0000","last_change":"2024-09-12T19:30:24.511211+0000","last_active":"2024-09-12T19:30:24.511211+0000","last_peered":"2024-09-12T19:30:24.511211+0000","last_clean":"2024-09-12T19:30:24.511211+0000","last_became_active":"2024-09-12T17:58:40.210072+0000","last_became_peered":"2024-09-12T17:58:40.210072+0000","last_unstale":"2024-09-12T19:30:24.511211+0000","last_undegraded":"2024-09-12T19:30:24.511211+0000","last_fullsized":"2024-09-12T19:30:24.511211+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:24.511036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:24.511036+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.511036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:53.909940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'26","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355281+0000","last_change":"2024-09-12T17:52:39.872036+0000","last_active":"2024-09-12T19:26:25.355281+0000","last_peered":"2024-09-12T19:26:25.355281+0000","last_clean":"2024-09-12T19:26:25.355281+0000","last_became_active":"2024-09-12T17:52:39.871247+0000","last_became_peered":"2024-09-12T17:52:39.871247+0000","last_unstale":"2024-09-12T19:26:25.355281+0000","last_undegraded":"2024-09-12T19:26:25.355281+0000","last_fullsized":"2024-09-12T19:26:25.355281+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:52:38.828707+0000","last_clean_scrub_stamp":"2024-09-12T17:52:38.828707+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:34.468531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":46,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.359612+0000","last_change":"2024-09-12T18:25:52.622440+0000","last_active":"2024-09-12T19:26:40.359612+0000","last_peered":"2024-09-12T19:26:40.359612+0000","last_clean":"2024-09-12T19:26:40.359612+0000","last_became_active":"2024-09-12T18:25:52.621808+0000","last_became_peered":"2024-09-12T18:25:52.621808+0000","last_unstale":"2024-09-12T19:26:40.359612+0000","last_undegraded":"2024-09-12T19:26:40.359612+0000","last_fullsized":"2024-09-12T19:26:40.359612+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:05.559442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'2","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.477589+0000","last_change":"2024-09-12T19:30:24.477589+0000","last_active":"2024-09-12T19:30:24.477589+0000","last_peered":"2024-09-12T19:30:24.477589+0000","last_clean":"2024-09-12T19:30:24.477589+0000","last_became_active":"2024-09-12T17:58:47.236237+0000","last_became_peered":"2024-09-12T17:58:47.236237+0000","last_unstale":"2024-09-12T19:30:24.477589+0000","last_undegraded":"2024-09-12T19:30:24.477589+0000","last_fullsized":"2024-09-12T19:30:24.477589+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:24.477402+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:24.477402+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.477402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:07.709944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'8","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.783282+0000","last_change":"2024-09-12T19:30:20.783282+0000","last_active":"2024-09-12T19:30:20.783282+0000","last_peered":"2024-09-12T19:30:20.783282+0000","last_clean":"2024-09-12T19:30:20.783282+0000","last_became_active":"2024-09-12T17:58:40.207179+0000","last_became_peered":"2024-09-12T17:58:40.207179+0000","last_unstale":"2024-09-12T19:30:20.783282+0000","last_undegraded":"2024-09-12T19:30:20.783282+0000","last_fullsized":"2024-09-12T19:30:20.783282+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:30:20.783056+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:30:20.783056+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.783056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:48.399945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'9","reported_seq":109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.423335+0000","last_change":"2024-09-12T19:30:13.423335+0000","last_active":"2024-09-12T19:30:13.423335+0000","last_peered":"2024-09-12T19:30:13.423335+0000","last_clean":"2024-09-12T19:30:13.423335+0000","last_became_active":"2024-09-12T17:52:39.883782+0000","last_became_peered":"2024-09-12T17:52:39.883782+0000","last_unstale":"2024-09-12T19:30:13.423335+0000","last_undegraded":"2024-09-12T19:30:13.423335+0000","last_fullsized":"2024-09-12T19:30:13.423335+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T19:30:13.423150+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T19:30:13.423150+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.423150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:09.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'340","reported_seq":1126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.399985+0000","last_change":"2024-09-12T19:29:55.399985+0000","last_active":"2024-09-12T19:29:55.399985+0000","last_peered":"2024-09-12T19:29:55.399985+0000","last_clean":"2024-09-12T19:29:55.399985+0000","last_became_active":"2024-09-12T17:36:34.874529+0000","last_became_peered":"2024-09-12T17:36:34.874529+0000","last_unstale":"2024-09-12T19:29:55.399985+0000","last_undegraded":"2024-09-12T19:29:55.399985+0000","last_fullsized":"2024-09-12T19:29:55.399985+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T19:29:55.399703+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T19:29:55.399703+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.399703+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:53.827613+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424460,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":579,"num_read_kb":47675,"num_write":1041,"num_write_kb":57869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'949","reported_seq":2628,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.911343+0000","last_change":"2024-09-12T19:29:59.911343+0000","last_active":"2024-09-12T19:29:59.911343+0000","last_peered":"2024-09-12T19:29:59.911343+0000","last_clean":"2024-09-12T19:29:59.911343+0000","last_became_active":"2024-09-12T17:36:36.881586+0000","last_became_peered":"2024-09-12T17:36:36.881586+0000","last_unstale":"2024-09-12T19:29:59.911343+0000","last_undegraded":"2024-09-12T19:29:59.911343+0000","last_fullsized":"2024-09-12T19:29:59.911343+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'949","last_scrub_stamp":"2024-09-12T19:29:59.911151+0000","last_deep_scrub":"265'949","last_deep_scrub_stamp":"2024-09-12T19:29:59.911151+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.911151+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:42.321351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4539,"num_read_kb":4030,"num_write":1302,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'367","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.972021+0000","last_change":"2024-09-12T19:30:00.972021+0000","last_active":"2024-09-12T19:30:00.972021+0000","last_peered":"2024-09-12T19:30:00.972021+0000","last_clean":"2024-09-12T19:30:00.972021+0000","last_became_active":"2024-09-12T17:36:34.886040+0000","last_became_peered":"2024-09-12T17:36:34.886040+0000","last_unstale":"2024-09-12T19:30:00.972021+0000","last_undegraded":"2024-09-12T19:30:00.972021+0000","last_fullsized":"2024-09-12T19:30:00.972021+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T19:30:00.971806+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T19:30:00.971806+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.971806+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:45.651742+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1749425,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":512,"num_read_kb":42124,"num_write":1111,"num_write_kb":49494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'797","reported_seq":2325,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.171881+0000","last_change":"2024-09-12T19:30:13.171881+0000","last_active":"2024-09-12T19:30:13.171881+0000","last_peered":"2024-09-12T19:30:13.171881+0000","last_clean":"2024-09-12T19:30:13.171881+0000","last_became_active":"2024-09-12T17:36:36.875285+0000","last_became_peered":"2024-09-12T17:36:36.875285+0000","last_unstale":"2024-09-12T19:30:13.171881+0000","last_undegraded":"2024-09-12T19:30:13.171881+0000","last_fullsized":"2024-09-12T19:30:13.171881+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'797","last_scrub_stamp":"2024-09-12T19:30:13.171686+0000","last_deep_scrub":"265'797","last_deep_scrub_stamp":"2024-09-12T19:30:13.171686+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.171686+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:53.547645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3836,"num_read_kb":3465,"num_write":1049,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'352","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.961930+0000","last_change":"2024-09-12T19:29:59.961930+0000","last_active":"2024-09-12T19:29:59.961930+0000","last_peered":"2024-09-12T19:29:59.961930+0000","last_clean":"2024-09-12T19:29:59.961930+0000","last_became_active":"2024-09-12T17:36:34.871993+0000","last_became_peered":"2024-09-12T17:36:34.871993+0000","last_unstale":"2024-09-12T19:29:59.961930+0000","last_undegraded":"2024-09-12T19:29:59.961930+0000","last_fullsized":"2024-09-12T19:29:59.961930+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:29:59.961681+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:29:59.961681+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.961681+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:19.644655+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":16153,"num_write":1071,"num_write_kb":33332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'912","reported_seq":2457,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.178935+0000","last_change":"2024-09-12T19:30:11.178935+0000","last_active":"2024-09-12T19:30:11.178935+0000","last_peered":"2024-09-12T19:30:11.178935+0000","last_clean":"2024-09-12T19:30:11.178935+0000","last_became_active":"2024-09-12T17:36:36.883008+0000","last_became_peered":"2024-09-12T17:36:36.883008+0000","last_unstale":"2024-09-12T19:30:11.178935+0000","last_undegraded":"2024-09-12T19:30:11.178935+0000","last_fullsized":"2024-09-12T19:30:11.178935+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'912","last_scrub_stamp":"2024-09-12T19:30:11.178746+0000","last_deep_scrub":"265'912","last_deep_scrub_stamp":"2024-09-12T19:30:11.178746+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.178746+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:42.625052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4392,"num_read_kb":3928,"num_write":1272,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2263,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'362","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.324843+0000","last_change":"2024-09-12T19:29:54.324843+0000","last_active":"2024-09-12T19:29:54.324843+0000","last_peered":"2024-09-12T19:29:54.324843+0000","last_clean":"2024-09-12T19:29:54.324843+0000","last_became_active":"2024-09-12T17:36:34.871414+0000","last_became_peered":"2024-09-12T17:36:34.871414+0000","last_unstale":"2024-09-12T19:29:54.324843+0000","last_undegraded":"2024-09-12T19:29:54.324843+0000","last_fullsized":"2024-09-12T19:29:54.324843+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T19:29:54.324634+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T19:29:54.324634+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.324634+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:16.548675+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":504,"num_read_kb":53693,"num_write":1108,"num_write_kb":40210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'837","reported_seq":2351,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.887607+0000","last_change":"2024-09-12T19:30:02.887607+0000","last_active":"2024-09-12T19:30:02.887607+0000","last_peered":"2024-09-12T19:30:02.887607+0000","last_clean":"2024-09-12T19:30:02.887607+0000","last_became_active":"2024-09-12T17:36:36.902241+0000","last_became_peered":"2024-09-12T17:36:36.902241+0000","last_unstale":"2024-09-12T19:30:02.887607+0000","last_undegraded":"2024-09-12T19:30:02.887607+0000","last_fullsized":"2024-09-12T19:30:02.887607+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'837","last_scrub_stamp":"2024-09-12T19:30:02.887424+0000","last_deep_scrub":"265'837","last_deep_scrub_stamp":"2024-09-12T19:30:02.887424+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.887424+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:23.336621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3905,"num_read_kb":3484,"num_write":1127,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'353","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.348805+0000","last_change":"2024-09-12T19:29:53.348805+0000","last_active":"2024-09-12T19:29:53.348805+0000","last_peered":"2024-09-12T19:29:53.348805+0000","last_clean":"2024-09-12T19:29:53.348805+0000","last_became_active":"2024-09-12T17:36:34.890281+0000","last_became_peered":"2024-09-12T17:36:34.890281+0000","last_unstale":"2024-09-12T19:29:53.348805+0000","last_undegraded":"2024-09-12T19:29:53.348805+0000","last_fullsized":"2024-09-12T19:29:53.348805+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T19:29:53.348577+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T19:29:53.348577+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.348577+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:20.759997+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":533,"num_read_kb":3791,"num_write":1159,"num_write_kb":30376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'485","reported_seq":2186,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.381971+0000","last_change":"2024-09-12T19:30:00.381971+0000","last_active":"2024-09-12T19:30:00.381971+0000","last_peered":"2024-09-12T19:30:00.381971+0000","last_clean":"2024-09-12T19:30:00.381971+0000","last_became_active":"2024-09-12T17:36:36.899249+0000","last_became_peered":"2024-09-12T17:36:36.899249+0000","last_unstale":"2024-09-12T19:30:00.381971+0000","last_undegraded":"2024-09-12T19:30:00.381971+0000","last_fullsized":"2024-09-12T19:30:00.381971+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'485","last_scrub_stamp":"2024-09-12T19:30:00.381780+0000","last_deep_scrub":"265'485","last_deep_scrub_stamp":"2024-09-12T19:30:00.381780+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.381780+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:44.920189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2730,"num_read_kb":2583,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":918,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'378","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.372662+0000","last_change":"2024-09-12T19:29:51.372662+0000","last_active":"2024-09-12T19:29:51.372662+0000","last_peered":"2024-09-12T19:29:51.372662+0000","last_clean":"2024-09-12T19:29:51.372662+0000","last_became_active":"2024-09-12T17:36:34.870994+0000","last_became_peered":"2024-09-12T17:36:34.870994+0000","last_unstale":"2024-09-12T19:29:51.372662+0000","last_undegraded":"2024-09-12T19:29:51.372662+0000","last_fullsized":"2024-09-12T19:29:51.372662+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:29:51.372428+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:29:51.372428+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.372428+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:45.220775+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526411,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":2344,"num_write":1206,"num_write_kb":29584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'377","reported_seq":1837,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.408879+0000","last_change":"2024-09-12T19:30:01.408879+0000","last_active":"2024-09-12T19:30:01.408879+0000","last_peered":"2024-09-12T19:30:01.408879+0000","last_clean":"2024-09-12T19:30:01.408879+0000","last_became_active":"2024-09-12T17:36:36.897609+0000","last_became_peered":"2024-09-12T17:36:36.897609+0000","last_unstale":"2024-09-12T19:30:01.408879+0000","last_undegraded":"2024-09-12T19:30:01.408879+0000","last_fullsized":"2024-09-12T19:30:01.408879+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:30:01.408689+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:30:01.408689+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.408689+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:12.740346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2010,"num_read_kb":1904,"num_write":440,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'357","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.390280+0000","last_change":"2024-09-12T19:29:52.390280+0000","last_active":"2024-09-12T19:29:52.390280+0000","last_peered":"2024-09-12T19:29:52.390280+0000","last_clean":"2024-09-12T19:29:52.390280+0000","last_became_active":"2024-09-12T17:36:34.859023+0000","last_became_peered":"2024-09-12T17:36:34.859023+0000","last_unstale":"2024-09-12T19:29:52.390280+0000","last_undegraded":"2024-09-12T19:29:52.390280+0000","last_fullsized":"2024-09-12T19:29:52.390280+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'357","last_scrub_stamp":"2024-09-12T19:29:52.390106+0000","last_deep_scrub":"265'357","last_deep_scrub_stamp":"2024-09-12T19:29:52.390106+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.390106+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:22.736379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136901,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1894,"num_write":1220,"num_write_kb":19389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'837","reported_seq":2386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.416629+0000","last_change":"2024-09-12T19:30:01.416629+0000","last_active":"2024-09-12T19:30:01.416629+0000","last_peered":"2024-09-12T19:30:01.416629+0000","last_clean":"2024-09-12T19:30:01.416629+0000","last_became_active":"2024-09-12T17:36:36.914366+0000","last_became_peered":"2024-09-12T17:36:36.914366+0000","last_unstale":"2024-09-12T19:30:01.416629+0000","last_undegraded":"2024-09-12T19:30:01.416629+0000","last_fullsized":"2024-09-12T19:30:01.416629+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'837","last_scrub_stamp":"2024-09-12T19:30:01.416434+0000","last_deep_scrub":"265'837","last_deep_scrub_stamp":"2024-09-12T19:30:01.416434+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.416434+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:32.496350+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4038,"num_read_kb":3626,"num_write":1143,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'347","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.927870+0000","last_change":"2024-09-12T19:29:58.927870+0000","last_active":"2024-09-12T19:29:58.927870+0000","last_peered":"2024-09-12T19:29:58.927870+0000","last_clean":"2024-09-12T19:29:58.927870+0000","last_became_active":"2024-09-12T17:36:34.882704+0000","last_became_peered":"2024-09-12T17:36:34.882704+0000","last_unstale":"2024-09-12T19:29:58.927870+0000","last_undegraded":"2024-09-12T19:29:58.927870+0000","last_fullsized":"2024-09-12T19:29:58.927870+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:29:58.927579+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:29:58.927579+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.927579+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:30.908682+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2535846,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":64003,"num_write":1113,"num_write_kb":46422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1169","reported_seq":2746,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.807102+0000","last_change":"2024-09-12T19:30:10.807102+0000","last_active":"2024-09-12T19:30:10.807102+0000","last_peered":"2024-09-12T19:30:10.807102+0000","last_clean":"2024-09-12T19:30:10.807102+0000","last_became_active":"2024-09-12T17:36:36.888829+0000","last_became_peered":"2024-09-12T17:36:36.888829+0000","last_unstale":"2024-09-12T19:30:10.807102+0000","last_undegraded":"2024-09-12T19:30:10.807102+0000","last_fullsized":"2024-09-12T19:30:10.807102+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1169","last_scrub_stamp":"2024-09-12T19:30:10.806912+0000","last_deep_scrub":"265'1169","last_deep_scrub_stamp":"2024-09-12T19:30:10.806912+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.806912+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":1100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:19.923756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5211,"num_read_kb":4613,"num_write":1589,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'496","reported_seq":2231,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.149795+0000","last_change":"2024-09-12T19:30:12.149795+0000","last_active":"2024-09-12T19:30:12.149795+0000","last_peered":"2024-09-12T19:30:12.149795+0000","last_clean":"2024-09-12T19:30:12.149795+0000","last_became_active":"2024-09-12T17:36:36.904820+0000","last_became_peered":"2024-09-12T17:36:36.904820+0000","last_unstale":"2024-09-12T19:30:12.149795+0000","last_undegraded":"2024-09-12T19:30:12.149795+0000","last_fullsized":"2024-09-12T19:30:12.149795+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'496","last_scrub_stamp":"2024-09-12T19:30:12.149611+0000","last_deep_scrub":"265'496","last_deep_scrub_stamp":"2024-09-12T19:30:12.149611+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.149611+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:58.293186+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2913,"num_read_kb":2753,"num_write":585,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'374","reported_seq":1112,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.902000+0000","last_change":"2024-09-12T19:29:51.902000+0000","last_active":"2024-09-12T19:29:51.902000+0000","last_peered":"2024-09-12T19:29:51.902000+0000","last_clean":"2024-09-12T19:29:51.902000+0000","last_became_active":"2024-09-12T17:36:34.866283+0000","last_became_peered":"2024-09-12T17:36:34.866283+0000","last_unstale":"2024-09-12T19:29:51.902000+0000","last_undegraded":"2024-09-12T19:29:51.902000+0000","last_fullsized":"2024-09-12T19:29:51.902000+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T19:29:51.901740+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T19:29:51.901740+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.901740+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:07.400270+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":73276,"num_write":1099,"num_write_kb":24135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'481","reported_seq":2104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.336855+0000","last_change":"2024-09-12T19:29:58.336855+0000","last_active":"2024-09-12T19:29:58.336855+0000","last_peered":"2024-09-12T19:29:58.336855+0000","last_clean":"2024-09-12T19:29:58.336855+0000","last_became_active":"2024-09-12T17:36:36.911310+0000","last_became_peered":"2024-09-12T17:36:36.911310+0000","last_unstale":"2024-09-12T19:29:58.336855+0000","last_undegraded":"2024-09-12T19:29:58.336855+0000","last_fullsized":"2024-09-12T19:29:58.336855+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'481","last_scrub_stamp":"2024-09-12T19:29:58.336665+0000","last_deep_scrub":"265'481","last_deep_scrub_stamp":"2024-09-12T19:29:58.336665+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.336665+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:39.578088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2526,"num_read_kb":2384,"num_write":531,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'354","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.369482+0000","last_change":"2024-09-12T19:29:50.369352+0000","last_active":"2024-09-12T19:29:50.369482+0000","last_peered":"2024-09-12T19:29:50.369482+0000","last_clean":"2024-09-12T19:29:50.369482+0000","last_became_active":"2024-09-12T17:36:34.865119+0000","last_became_peered":"2024-09-12T17:36:34.865119+0000","last_unstale":"2024-09-12T19:29:50.369482+0000","last_undegraded":"2024-09-12T19:29:50.369482+0000","last_fullsized":"2024-09-12T19:29:50.369482+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T19:29:50.369148+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T19:29:50.369148+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.369148+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:22.772611+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109517,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":573,"num_read_kb":7316,"num_write":1055,"num_write_kb":28671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'739","reported_seq":2238,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.837232+0000","last_change":"2024-09-12T19:29:57.837232+0000","last_active":"2024-09-12T19:29:57.837232+0000","last_peered":"2024-09-12T19:29:57.837232+0000","last_clean":"2024-09-12T19:29:57.837232+0000","last_became_active":"2024-09-12T17:36:36.885876+0000","last_became_peered":"2024-09-12T17:36:36.885876+0000","last_unstale":"2024-09-12T19:29:57.837232+0000","last_undegraded":"2024-09-12T19:29:57.837232+0000","last_fullsized":"2024-09-12T19:29:57.837232+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'739","last_scrub_stamp":"2024-09-12T19:29:57.837032+0000","last_deep_scrub":"265'739","last_deep_scrub_stamp":"2024-09-12T19:29:57.837032+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.837032+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:40.240565+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3432,"num_read_kb":3117,"num_write":958,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1010,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'391","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.371378+0000","last_change":"2024-09-12T19:29:54.371239+0000","last_active":"2024-09-12T19:29:54.371378+0000","last_peered":"2024-09-12T19:29:54.371378+0000","last_clean":"2024-09-12T19:29:54.371378+0000","last_became_active":"2024-09-12T17:36:34.873456+0000","last_became_peered":"2024-09-12T17:36:34.873456+0000","last_unstale":"2024-09-12T19:29:54.371378+0000","last_undegraded":"2024-09-12T19:29:54.371378+0000","last_fullsized":"2024-09-12T19:29:54.371378+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:29:54.371023+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:29:54.371023+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.371023+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:54.568742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":11973,"num_write":1244,"num_write_kb":23205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'621","reported_seq":2316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.478518+0000","last_change":"2024-09-12T19:29:59.478221+0000","last_active":"2024-09-12T19:29:59.478518+0000","last_peered":"2024-09-12T19:29:59.478518+0000","last_clean":"2024-09-12T19:29:59.478518+0000","last_became_active":"2024-09-12T17:36:36.899850+0000","last_became_peered":"2024-09-12T17:36:36.899850+0000","last_unstale":"2024-09-12T19:29:59.478518+0000","last_undegraded":"2024-09-12T19:29:59.478518+0000","last_fullsized":"2024-09-12T19:29:59.478518+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'621","last_scrub_stamp":"2024-09-12T19:29:59.477997+0000","last_deep_scrub":"265'621","last_deep_scrub_stamp":"2024-09-12T19:29:59.477997+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.477997+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":600,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:01.602724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3224,"num_read_kb":2959,"num_write":847,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'342","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.452941+0000","last_change":"2024-09-12T19:29:48.452837+0000","last_active":"2024-09-12T19:29:48.452941+0000","last_peered":"2024-09-12T19:29:48.452941+0000","last_clean":"2024-09-12T19:29:48.452941+0000","last_became_active":"2024-09-12T17:36:34.864547+0000","last_became_peered":"2024-09-12T17:36:34.864547+0000","last_unstale":"2024-09-12T19:29:48.452941+0000","last_undegraded":"2024-09-12T19:29:48.452941+0000","last_fullsized":"2024-09-12T19:29:48.452941+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:48.452700+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:48.452700+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.452700+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:14.375143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":555,"num_read_kb":20889,"num_write":1050,"num_write_kb":32386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'302","reported_seq":1687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.873251+0000","last_change":"2024-09-12T19:30:07.873070+0000","last_active":"2024-09-12T19:30:07.873251+0000","last_peered":"2024-09-12T19:30:07.873251+0000","last_clean":"2024-09-12T19:30:07.873251+0000","last_became_active":"2024-09-12T17:36:36.873937+0000","last_became_peered":"2024-09-12T17:36:36.873937+0000","last_unstale":"2024-09-12T19:30:07.873251+0000","last_undegraded":"2024-09-12T19:30:07.873251+0000","last_fullsized":"2024-09-12T19:30:07.873251+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-12T19:30:07.872893+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-12T19:30:07.872893+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.872893+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:39.605056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1689,"num_read_kb":1636,"num_write":323,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'377","reported_seq":1149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.359265+0000","last_change":"2024-09-12T19:29:54.358988+0000","last_active":"2024-09-12T19:29:54.359265+0000","last_peered":"2024-09-12T19:29:54.359265+0000","last_clean":"2024-09-12T19:29:54.359265+0000","last_became_active":"2024-09-12T17:36:34.880986+0000","last_became_peered":"2024-09-12T17:36:34.880986+0000","last_unstale":"2024-09-12T19:29:54.359265+0000","last_undegraded":"2024-09-12T19:29:54.359265+0000","last_fullsized":"2024-09-12T19:29:54.359265+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:29:54.358664+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:29:54.358664+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.358664+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:38.007979+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1802093,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":10570,"num_write":1059,"num_write_kb":33432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'405","reported_seq":1902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.869969+0000","last_change":"2024-09-12T19:29:58.869837+0000","last_active":"2024-09-12T19:29:58.869969+0000","last_peered":"2024-09-12T19:29:58.869969+0000","last_clean":"2024-09-12T19:29:58.869969+0000","last_became_active":"2024-09-12T17:36:36.881228+0000","last_became_peered":"2024-09-12T17:36:36.881228+0000","last_unstale":"2024-09-12T19:29:58.869969+0000","last_undegraded":"2024-09-12T19:29:58.869969+0000","last_fullsized":"2024-09-12T19:29:58.869969+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T19:29:58.869637+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T19:29:58.869637+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.869637+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.969680+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2076,"num_read_kb":1970,"num_write":455,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'419","reported_seq":1188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.348394+0000","last_change":"2024-09-12T19:29:52.348394+0000","last_active":"2024-09-12T19:29:52.348394+0000","last_peered":"2024-09-12T19:29:52.348394+0000","last_clean":"2024-09-12T19:29:52.348394+0000","last_became_active":"2024-09-12T17:36:34.878377+0000","last_became_peered":"2024-09-12T17:36:34.878377+0000","last_unstale":"2024-09-12T19:29:52.348394+0000","last_undegraded":"2024-09-12T19:29:52.348394+0000","last_fullsized":"2024-09-12T19:29:52.348394+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'419","last_scrub_stamp":"2024-09-12T19:29:52.348210+0000","last_deep_scrub":"265'419","last_deep_scrub_stamp":"2024-09-12T19:29:52.348210+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.348210+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:42.321093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":879,"num_read_kb":13596,"num_write":1342,"num_write_kb":22678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'110","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.513285+0000","last_change":"2024-09-12T19:30:10.513033+0000","last_active":"2024-09-12T19:30:10.513285+0000","last_peered":"2024-09-12T19:30:10.513285+0000","last_clean":"2024-09-12T19:30:10.513285+0000","last_became_active":"2024-09-12T17:36:44.934662+0000","last_became_peered":"2024-09-12T17:36:44.934662+0000","last_unstale":"2024-09-12T19:30:10.513285+0000","last_undegraded":"2024-09-12T19:30:10.513285+0000","last_fullsized":"2024-09-12T19:30:10.513285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T19:30:10.512819+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T19:30:10.512819+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.512819+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:38.028024+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'641","reported_seq":2298,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.452960+0000","last_change":"2024-09-12T19:30:00.452960+0000","last_active":"2024-09-12T19:30:00.452960+0000","last_peered":"2024-09-12T19:30:00.452960+0000","last_clean":"2024-09-12T19:30:00.452960+0000","last_became_active":"2024-09-12T17:36:36.913372+0000","last_became_peered":"2024-09-12T17:36:36.913372+0000","last_unstale":"2024-09-12T19:30:00.452960+0000","last_undegraded":"2024-09-12T19:30:00.452960+0000","last_fullsized":"2024-09-12T19:30:00.452960+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'641","last_scrub_stamp":"2024-09-12T19:30:00.452763+0000","last_deep_scrub":"265'641","last_deep_scrub_stamp":"2024-09-12T19:30:00.452763+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.452763+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:12.971289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3256,"num_read_kb":2969,"num_write":868,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'399","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.175382+0000","last_change":"2024-09-12T19:29:57.175382+0000","last_active":"2024-09-12T19:29:57.175382+0000","last_peered":"2024-09-12T19:29:57.175382+0000","last_clean":"2024-09-12T19:29:57.175382+0000","last_became_active":"2024-09-12T17:36:34.865894+0000","last_became_peered":"2024-09-12T17:36:34.865894+0000","last_unstale":"2024-09-12T19:29:57.175382+0000","last_undegraded":"2024-09-12T19:29:57.175382+0000","last_fullsized":"2024-09-12T19:29:57.175382+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'399","last_scrub_stamp":"2024-09-12T19:29:57.175150+0000","last_deep_scrub":"265'399","last_deep_scrub_stamp":"2024-09-12T19:29:57.175150+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.175150+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:47.227408+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661307,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":35668,"num_write":1342,"num_write_kb":51737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.213863+0000","last_change":"2024-09-12T19:30:14.213708+0000","last_active":"2024-09-12T19:30:14.213863+0000","last_peered":"2024-09-12T19:30:14.213863+0000","last_clean":"2024-09-12T19:30:14.213863+0000","last_became_active":"2024-09-12T17:36:38.881044+0000","last_became_peered":"2024-09-12T17:36:38.881044+0000","last_unstale":"2024-09-12T19:30:14.213863+0000","last_undegraded":"2024-09-12T19:30:14.213863+0000","last_fullsized":"2024-09-12T19:30:14.213863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:14.213524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:14.213524+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.213524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:07.524096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'390","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.122619+0000","last_change":"2024-09-12T19:30:17.122619+0000","last_active":"2024-09-12T19:30:17.122619+0000","last_peered":"2024-09-12T19:30:17.122619+0000","last_clean":"2024-09-12T19:30:17.122619+0000","last_became_active":"2024-09-12T17:36:40.906825+0000","last_became_peered":"2024-09-12T17:36:40.906825+0000","last_unstale":"2024-09-12T19:30:17.122619+0000","last_undegraded":"2024-09-12T19:30:17.122619+0000","last_fullsized":"2024-09-12T19:30:17.122619+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'390","last_scrub_stamp":"2024-09-12T19:30:17.122329+0000","last_deep_scrub":"265'390","last_deep_scrub_stamp":"2024-09-12T19:30:17.122329+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.122329+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:56.303295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":626,"num_read_kb":1284,"num_write":492,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.821522+0000","last_change":"2024-09-12T19:30:10.821380+0000","last_active":"2024-09-12T19:30:10.821522+0000","last_peered":"2024-09-12T19:30:10.821522+0000","last_clean":"2024-09-12T19:30:10.821522+0000","last_became_active":"2024-09-12T17:36:42.928794+0000","last_became_peered":"2024-09-12T17:36:42.928794+0000","last_unstale":"2024-09-12T19:30:10.821522+0000","last_undegraded":"2024-09-12T19:30:10.821522+0000","last_fullsized":"2024-09-12T19:30:10.821522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:10.821184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:10.821184+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.821184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:24.400244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'171","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.716331+0000","last_change":"2024-09-12T19:30:16.716331+0000","last_active":"2024-09-12T19:30:16.716331+0000","last_peered":"2024-09-12T19:30:16.716331+0000","last_clean":"2024-09-12T19:30:16.716331+0000","last_became_active":"2024-09-12T17:36:44.939447+0000","last_became_peered":"2024-09-12T17:36:44.939447+0000","last_unstale":"2024-09-12T19:30:16.716331+0000","last_undegraded":"2024-09-12T19:30:16.716331+0000","last_fullsized":"2024-09-12T19:30:16.716331+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'171","last_scrub_stamp":"2024-09-12T19:30:16.716131+0000","last_deep_scrub":"265'171","last_deep_scrub_stamp":"2024-09-12T19:30:16.716131+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.716131+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:44.650347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":297,"num_read_kb":283,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'452","reported_seq":1955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.174336+0000","last_change":"2024-09-12T19:30:08.174162+0000","last_active":"2024-09-12T19:30:08.174336+0000","last_peered":"2024-09-12T19:30:08.174336+0000","last_clean":"2024-09-12T19:30:08.174336+0000","last_became_active":"2024-09-12T17:36:36.875459+0000","last_became_peered":"2024-09-12T17:36:36.875459+0000","last_unstale":"2024-09-12T19:30:08.174336+0000","last_undegraded":"2024-09-12T19:30:08.174336+0000","last_fullsized":"2024-09-12T19:30:08.174336+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'452","last_scrub_stamp":"2024-09-12T19:30:08.173978+0000","last_deep_scrub":"265'452","last_deep_scrub_stamp":"2024-09-12T19:30:08.173978+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.173978+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:35.958234+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2269,"num_read_kb":2126,"num_write":529,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'324","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.310812+0000","last_change":"2024-09-12T19:29:51.310812+0000","last_active":"2024-09-12T19:29:51.310812+0000","last_peered":"2024-09-12T19:29:51.310812+0000","last_clean":"2024-09-12T19:29:51.310812+0000","last_became_active":"2024-09-12T17:36:34.880644+0000","last_became_peered":"2024-09-12T17:36:34.880644+0000","last_unstale":"2024-09-12T19:29:51.310812+0000","last_undegraded":"2024-09-12T19:29:51.310812+0000","last_fullsized":"2024-09-12T19:29:51.310812+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T19:29:51.310611+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T19:29:51.310611+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.310611+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:42.392409+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174790,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":12215,"num_write":1010,"num_write_kb":18682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.016740+0000","last_change":"2024-09-12T19:30:09.016740+0000","last_active":"2024-09-12T19:30:09.016740+0000","last_peered":"2024-09-12T19:30:09.016740+0000","last_clean":"2024-09-12T19:30:09.016740+0000","last_became_active":"2024-09-12T17:36:38.900684+0000","last_became_peered":"2024-09-12T17:36:38.900684+0000","last_unstale":"2024-09-12T19:30:09.016740+0000","last_undegraded":"2024-09-12T19:30:09.016740+0000","last_fullsized":"2024-09-12T19:30:09.016740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.016556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.016556+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.016556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:47.119691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'129","reported_seq":708,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.854416+0000","last_change":"2024-09-12T19:30:07.854249+0000","last_active":"2024-09-12T19:30:07.854416+0000","last_peered":"2024-09-12T19:30:07.854416+0000","last_clean":"2024-09-12T19:30:07.854416+0000","last_became_active":"2024-09-12T17:36:40.899340+0000","last_became_peered":"2024-09-12T17:36:40.899340+0000","last_unstale":"2024-09-12T19:30:07.854416+0000","last_undegraded":"2024-09-12T19:30:07.854416+0000","last_fullsized":"2024-09-12T19:30:07.854416+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T19:30:07.854053+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T19:30:07.854053+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.854053+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:09.119113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.796542+0000","last_change":"2024-09-12T19:30:13.796389+0000","last_active":"2024-09-12T19:30:13.796542+0000","last_peered":"2024-09-12T19:30:13.796542+0000","last_clean":"2024-09-12T19:30:13.796542+0000","last_became_active":"2024-09-12T17:36:42.932100+0000","last_became_peered":"2024-09-12T17:36:42.932100+0000","last_unstale":"2024-09-12T19:30:13.796542+0000","last_undegraded":"2024-09-12T19:30:13.796542+0000","last_fullsized":"2024-09-12T19:30:13.796542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:13.796195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:13.796195+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.796195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:33.303127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'126","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.388821+0000","last_change":"2024-09-12T19:30:16.388821+0000","last_active":"2024-09-12T19:30:16.388821+0000","last_peered":"2024-09-12T19:30:16.388821+0000","last_clean":"2024-09-12T19:30:16.388821+0000","last_became_active":"2024-09-12T17:36:44.965913+0000","last_became_peered":"2024-09-12T17:36:44.965913+0000","last_unstale":"2024-09-12T19:30:16.388821+0000","last_undegraded":"2024-09-12T19:30:16.388821+0000","last_fullsized":"2024-09-12T19:30:16.388821+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T19:30:16.388633+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T19:30:16.388633+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.388633+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:37.822244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":210,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.952195+0000","last_change":"2024-09-12T19:30:03.952062+0000","last_active":"2024-09-12T19:30:03.952195+0000","last_peered":"2024-09-12T19:30:03.952195+0000","last_clean":"2024-09-12T19:30:03.952195+0000","last_became_active":"2024-09-12T17:36:36.904639+0000","last_became_peered":"2024-09-12T17:36:36.904639+0000","last_unstale":"2024-09-12T19:30:03.952195+0000","last_undegraded":"2024-09-12T19:30:03.952195+0000","last_fullsized":"2024-09-12T19:30:03.952195+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'401","last_scrub_stamp":"2024-09-12T19:30:03.951878+0000","last_deep_scrub":"265'401","last_deep_scrub_stamp":"2024-09-12T19:30:03.951878+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.951878+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:56.567132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2242,"num_read_kb":2124,"num_write":448,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'318","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.174934+0000","last_change":"2024-09-12T19:29:56.174934+0000","last_active":"2024-09-12T19:29:56.174934+0000","last_peered":"2024-09-12T19:29:56.174934+0000","last_clean":"2024-09-12T19:29:56.174934+0000","last_became_active":"2024-09-12T17:36:34.879098+0000","last_became_peered":"2024-09-12T17:36:34.879098+0000","last_unstale":"2024-09-12T19:29:56.174934+0000","last_undegraded":"2024-09-12T19:29:56.174934+0000","last_fullsized":"2024-09-12T19:29:56.174934+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T19:29:56.174676+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T19:29:56.174676+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.174676+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:55.215925+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763036,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":388,"num_read_kb":4507,"num_write":999,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.042906+0000","last_change":"2024-09-12T19:30:10.042772+0000","last_active":"2024-09-12T19:30:10.042906+0000","last_peered":"2024-09-12T19:30:10.042906+0000","last_clean":"2024-09-12T19:30:10.042906+0000","last_became_active":"2024-09-12T17:36:38.883758+0000","last_became_peered":"2024-09-12T17:36:38.883758+0000","last_unstale":"2024-09-12T19:30:10.042906+0000","last_undegraded":"2024-09-12T19:30:10.042906+0000","last_fullsized":"2024-09-12T19:30:10.042906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:10.042594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:10.042594+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.042594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:36.648238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'191","reported_seq":799,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.117856+0000","last_change":"2024-09-12T19:30:16.117856+0000","last_active":"2024-09-12T19:30:16.117856+0000","last_peered":"2024-09-12T19:30:16.117856+0000","last_clean":"2024-09-12T19:30:16.117856+0000","last_became_active":"2024-09-12T17:36:40.907410+0000","last_became_peered":"2024-09-12T17:36:40.907410+0000","last_unstale":"2024-09-12T19:30:16.117856+0000","last_undegraded":"2024-09-12T19:30:16.117856+0000","last_fullsized":"2024-09-12T19:30:16.117856+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-12T19:30:16.117678+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-12T19:30:16.117678+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.117678+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:41.966948+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'805","reported_seq":7121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.419958+0000","last_change":"2024-09-12T17:36:42.918180+0000","last_active":"2024-09-12T19:29:42.419958+0000","last_peered":"2024-09-12T19:29:42.419958+0000","last_clean":"2024-09-12T19:29:42.419958+0000","last_became_active":"2024-09-12T17:36:42.916847+0000","last_became_peered":"2024-09-12T17:36:42.916847+0000","last_unstale":"2024-09-12T19:29:42.419958+0000","last_undegraded":"2024-09-12T19:29:42.419958+0000","last_fullsized":"2024-09-12T19:29:42.419958+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'226","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.455780+0000","last_change":"2024-09-12T19:30:12.455780+0000","last_active":"2024-09-12T19:30:12.455780+0000","last_peered":"2024-09-12T19:30:12.455780+0000","last_clean":"2024-09-12T19:30:12.455780+0000","last_became_active":"2024-09-12T17:36:44.954183+0000","last_became_peered":"2024-09-12T17:36:44.954183+0000","last_unstale":"2024-09-12T19:30:12.455780+0000","last_undegraded":"2024-09-12T19:30:12.455780+0000","last_fullsized":"2024-09-12T19:30:12.455780+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-12T19:30:12.455578+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-12T19:30:12.455578+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.455578+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:03.513982+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":505,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'460","reported_seq":2151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.958826+0000","last_change":"2024-09-12T19:30:04.958687+0000","last_active":"2024-09-12T19:30:04.958826+0000","last_peered":"2024-09-12T19:30:04.958826+0000","last_clean":"2024-09-12T19:30:04.958826+0000","last_became_active":"2024-09-12T17:36:36.877420+0000","last_became_peered":"2024-09-12T17:36:36.877420+0000","last_unstale":"2024-09-12T19:30:04.958826+0000","last_undegraded":"2024-09-12T19:30:04.958826+0000","last_fullsized":"2024-09-12T19:30:04.958826+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'460","last_scrub_stamp":"2024-09-12T19:30:04.958508+0000","last_deep_scrub":"265'460","last_deep_scrub_stamp":"2024-09-12T19:30:04.958508+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.958508+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:30.786563+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2635,"num_read_kb":2492,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2773,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'364","reported_seq":1082,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.902122+0000","last_change":"2024-09-12T19:29:48.902122+0000","last_active":"2024-09-12T19:29:48.902122+0000","last_peered":"2024-09-12T19:29:48.902122+0000","last_clean":"2024-09-12T19:29:48.902122+0000","last_became_active":"2024-09-12T17:36:34.882902+0000","last_became_peered":"2024-09-12T17:36:34.882902+0000","last_unstale":"2024-09-12T19:29:48.902122+0000","last_undegraded":"2024-09-12T19:29:48.902122+0000","last_fullsized":"2024-09-12T19:29:48.902122+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T19:29:48.902025+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T19:29:48.902025+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.902025+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:07.220628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":587,"num_read_kb":75125,"num_write":1046,"num_write_kb":28457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.186640+0000","last_change":"2024-09-12T19:30:19.186640+0000","last_active":"2024-09-12T19:30:19.186640+0000","last_peered":"2024-09-12T19:30:19.186640+0000","last_clean":"2024-09-12T19:30:19.186640+0000","last_became_active":"2024-09-12T17:36:38.899405+0000","last_became_peered":"2024-09-12T17:36:38.899405+0000","last_unstale":"2024-09-12T19:30:19.186640+0000","last_undegraded":"2024-09-12T19:30:19.186640+0000","last_fullsized":"2024-09-12T19:30:19.186640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:19.186463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:19.186463+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.186463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:31.132651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'342","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.397532+0000","last_change":"2024-09-12T19:30:05.397397+0000","last_active":"2024-09-12T19:30:05.397532+0000","last_peered":"2024-09-12T19:30:05.397532+0000","last_clean":"2024-09-12T19:30:05.397532+0000","last_became_active":"2024-09-12T17:36:40.910700+0000","last_became_peered":"2024-09-12T17:36:40.910700+0000","last_unstale":"2024-09-12T19:30:05.397532+0000","last_undegraded":"2024-09-12T19:30:05.397532+0000","last_fullsized":"2024-09-12T19:30:05.397532+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:30:05.397149+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:30:05.397149+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.397149+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:25.803180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54278,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":1174,"num_write":438,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'800","reported_seq":3165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.823937+0000","last_change":"2024-09-12T19:30:20.823937+0000","last_active":"2024-09-12T19:30:20.823937+0000","last_peered":"2024-09-12T19:30:20.823937+0000","last_clean":"2024-09-12T19:30:20.823937+0000","last_became_active":"2024-09-12T17:36:42.939966+0000","last_became_peered":"2024-09-12T17:36:42.939966+0000","last_unstale":"2024-09-12T19:30:20.823937+0000","last_undegraded":"2024-09-12T19:30:20.823937+0000","last_fullsized":"2024-09-12T19:30:20.823937+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'800","last_scrub_stamp":"2024-09-12T19:30:20.823742+0000","last_deep_scrub":"265'800","last_deep_scrub_stamp":"2024-09-12T19:30:20.823742+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.823742+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:53.933093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'1127","reported_seq":2740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.113469+0000","last_change":"2024-09-12T19:30:06.113469+0000","last_active":"2024-09-12T19:30:06.113469+0000","last_peered":"2024-09-12T19:30:06.113469+0000","last_clean":"2024-09-12T19:30:06.113469+0000","last_became_active":"2024-09-12T17:36:36.886244+0000","last_became_peered":"2024-09-12T17:36:36.886244+0000","last_unstale":"2024-09-12T19:30:06.113469+0000","last_undegraded":"2024-09-12T19:30:06.113469+0000","last_fullsized":"2024-09-12T19:30:06.113469+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1127","last_scrub_stamp":"2024-09-12T19:30:06.113240+0000","last_deep_scrub":"265'1127","last_deep_scrub_stamp":"2024-09-12T19:30:06.113240+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.113240+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":1100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:06.097619+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5270,"num_read_kb":4695,"num_write":1548,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'297","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:46.414341+0000","last_change":"2024-09-12T19:29:46.414341+0000","last_active":"2024-09-12T19:29:46.414341+0000","last_peered":"2024-09-12T19:29:46.414341+0000","last_clean":"2024-09-12T19:29:46.414341+0000","last_became_active":"2024-09-12T17:36:34.865417+0000","last_became_peered":"2024-09-12T17:36:34.865417+0000","last_unstale":"2024-09-12T19:29:46.414341+0000","last_undegraded":"2024-09-12T19:29:46.414341+0000","last_fullsized":"2024-09-12T19:29:46.414341+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'297","last_scrub_stamp":"2024-09-12T19:29:46.414141+0000","last_deep_scrub":"265'297","last_deep_scrub_stamp":"2024-09-12T19:29:46.414141+0000","last_clean_scrub_stamp":"2024-09-12T19:29:46.414141+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.995894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":517,"num_read_kb":1839,"num_write":970,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.875044+0000","last_change":"2024-09-12T19:30:00.875044+0000","last_active":"2024-09-12T19:30:00.875044+0000","last_peered":"2024-09-12T19:30:00.875044+0000","last_clean":"2024-09-12T19:30:00.875044+0000","last_became_active":"2024-09-12T17:36:38.887444+0000","last_became_peered":"2024-09-12T17:36:38.887444+0000","last_unstale":"2024-09-12T19:30:00.875044+0000","last_undegraded":"2024-09-12T19:30:00.875044+0000","last_fullsized":"2024-09-12T19:30:00.875044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:00.874795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:00.874795+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.874795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:17.895761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'456","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.562005+0000","last_change":"2024-09-12T19:30:11.562005+0000","last_active":"2024-09-12T19:30:11.562005+0000","last_peered":"2024-09-12T19:30:11.562005+0000","last_clean":"2024-09-12T19:30:11.562005+0000","last_became_active":"2024-09-12T17:36:40.911095+0000","last_became_peered":"2024-09-12T17:36:40.911095+0000","last_unstale":"2024-09-12T19:30:11.562005+0000","last_undegraded":"2024-09-12T19:30:11.562005+0000","last_fullsized":"2024-09-12T19:30:11.562005+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'456","last_scrub_stamp":"2024-09-12T19:30:11.561804+0000","last_deep_scrub":"265'456","last_deep_scrub_stamp":"2024-09-12T19:30:11.561804+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.561804+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:55.236202+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":738,"num_read_kb":1351,"num_write":556,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.475388+0000","last_change":"2024-09-12T19:30:13.475388+0000","last_active":"2024-09-12T19:30:13.475388+0000","last_peered":"2024-09-12T19:30:13.475388+0000","last_clean":"2024-09-12T19:30:13.475388+0000","last_became_active":"2024-09-12T17:36:42.927582+0000","last_became_peered":"2024-09-12T17:36:42.927582+0000","last_unstale":"2024-09-12T19:30:13.475388+0000","last_undegraded":"2024-09-12T19:30:13.475388+0000","last_fullsized":"2024-09-12T19:30:13.475388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:13.475191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:13.475191+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.475191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:50.478250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'557","reported_seq":1410,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.488049+0000","last_change":"2024-09-12T19:30:16.488049+0000","last_active":"2024-09-12T19:30:16.488049+0000","last_peered":"2024-09-12T19:30:16.488049+0000","last_clean":"2024-09-12T19:30:16.488049+0000","last_became_active":"2024-09-12T17:36:44.953926+0000","last_became_peered":"2024-09-12T17:36:44.953926+0000","last_unstale":"2024-09-12T19:30:16.488049+0000","last_undegraded":"2024-09-12T19:30:16.488049+0000","last_fullsized":"2024-09-12T19:30:16.488049+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'557","last_scrub_stamp":"2024-09-12T19:30:16.487864+0000","last_deep_scrub":"265'557","last_deep_scrub_stamp":"2024-09-12T19:30:16.487864+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.487864+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:14.423016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":1310,"num_write":1167,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'842","reported_seq":2553,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.908148+0000","last_change":"2024-09-12T19:29:52.908148+0000","last_active":"2024-09-12T19:29:52.908148+0000","last_peered":"2024-09-12T19:29:52.908148+0000","last_clean":"2024-09-12T19:29:52.908148+0000","last_became_active":"2024-09-12T17:36:36.886395+0000","last_became_peered":"2024-09-12T17:36:36.886395+0000","last_unstale":"2024-09-12T19:29:52.908148+0000","last_undegraded":"2024-09-12T19:29:52.908148+0000","last_fullsized":"2024-09-12T19:29:52.908148+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'842","last_scrub_stamp":"2024-09-12T19:29:52.907905+0000","last_deep_scrub":"265'842","last_deep_scrub_stamp":"2024-09-12T19:29:52.907905+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.907905+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.987128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4184,"num_read_kb":3783,"num_write":1092,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3245,"num_omap_keys":13,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'376","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.389093+0000","last_change":"2024-09-12T19:29:49.389093+0000","last_active":"2024-09-12T19:29:49.389093+0000","last_peered":"2024-09-12T19:29:49.389093+0000","last_clean":"2024-09-12T19:29:49.389093+0000","last_became_active":"2024-09-12T17:36:34.868465+0000","last_became_peered":"2024-09-12T17:36:34.868465+0000","last_unstale":"2024-09-12T19:29:49.389093+0000","last_undegraded":"2024-09-12T19:29:49.389093+0000","last_fullsized":"2024-09-12T19:29:49.389093+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:29:49.389019+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:29:49.389019+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.389019+0000","objects_scrubbed":8,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:59.981113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109619,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":2937,"num_write":1162,"num_write_kb":21558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"265'4","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.492624+0000","last_change":"2024-09-12T19:30:03.492624+0000","last_active":"2024-09-12T19:30:03.492624+0000","last_peered":"2024-09-12T19:30:03.492624+0000","last_clean":"2024-09-12T19:30:03.492624+0000","last_became_active":"2024-09-12T17:36:38.907007+0000","last_became_peered":"2024-09-12T17:36:38.907007+0000","last_unstale":"2024-09-12T19:30:03.492624+0000","last_undegraded":"2024-09-12T19:30:03.492624+0000","last_fullsized":"2024-09-12T19:30:03.492624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:03.492431+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:03.492431+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.492431+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:04.343424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'332","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.048831+0000","last_change":"2024-09-12T19:30:13.048831+0000","last_active":"2024-09-12T19:30:13.048831+0000","last_peered":"2024-09-12T19:30:13.048831+0000","last_clean":"2024-09-12T19:30:13.048831+0000","last_became_active":"2024-09-12T17:36:40.911092+0000","last_became_peered":"2024-09-12T17:36:40.911092+0000","last_unstale":"2024-09-12T19:30:13.048831+0000","last_undegraded":"2024-09-12T19:30:13.048831+0000","last_fullsized":"2024-09-12T19:30:13.048831+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T19:30:13.048566+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T19:30:13.048566+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.048566+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.100240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1173,"num_write":436,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.012312+0000","last_change":"2024-09-12T19:30:22.012312+0000","last_active":"2024-09-12T19:30:22.012312+0000","last_peered":"2024-09-12T19:30:22.012312+0000","last_clean":"2024-09-12T19:30:22.012312+0000","last_became_active":"2024-09-12T17:36:42.933808+0000","last_became_peered":"2024-09-12T17:36:42.933808+0000","last_unstale":"2024-09-12T19:30:22.012312+0000","last_undegraded":"2024-09-12T19:30:22.012312+0000","last_fullsized":"2024-09-12T19:30:22.012312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.012112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.012112+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.012112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:50.128460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'2434","reported_seq":4304,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.829330+0000","last_change":"2024-09-12T19:30:12.829330+0000","last_active":"2024-09-12T19:30:12.829330+0000","last_peered":"2024-09-12T19:30:12.829330+0000","last_clean":"2024-09-12T19:30:12.829330+0000","last_became_active":"2024-09-12T17:36:44.962630+0000","last_became_peered":"2024-09-12T17:36:44.962630+0000","last_unstale":"2024-09-12T19:30:12.829330+0000","last_undegraded":"2024-09-12T19:30:12.829330+0000","last_fullsized":"2024-09-12T19:30:12.829330+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2434","last_scrub_stamp":"2024-09-12T19:30:12.829115+0000","last_deep_scrub":"265'2434","last_deep_scrub_stamp":"2024-09-12T19:30:12.829115+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.829115+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":2400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:26.992758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6095,"num_read_kb":6091,"num_write":4930,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'435","reported_seq":2069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.391391+0000","last_change":"2024-09-12T19:29:56.391391+0000","last_active":"2024-09-12T19:29:56.391391+0000","last_peered":"2024-09-12T19:29:56.391391+0000","last_clean":"2024-09-12T19:29:56.391391+0000","last_became_active":"2024-09-12T17:36:36.880296+0000","last_became_peered":"2024-09-12T17:36:36.880296+0000","last_unstale":"2024-09-12T19:29:56.391391+0000","last_undegraded":"2024-09-12T19:29:56.391391+0000","last_fullsized":"2024-09-12T19:29:56.391391+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'435","last_scrub_stamp":"2024-09-12T19:29:56.391216+0000","last_deep_scrub":"265'435","last_deep_scrub_stamp":"2024-09-12T19:29:56.391216+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.391216+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:02.997123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2387,"num_read_kb":2259,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'355","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.142105+0000","last_change":"2024-09-12T19:29:55.142105+0000","last_active":"2024-09-12T19:29:55.142105+0000","last_peered":"2024-09-12T19:29:55.142105+0000","last_clean":"2024-09-12T19:29:55.142105+0000","last_became_active":"2024-09-12T17:36:34.868243+0000","last_became_peered":"2024-09-12T17:36:34.868243+0000","last_unstale":"2024-09-12T19:29:55.142105+0000","last_undegraded":"2024-09-12T19:29:55.142105+0000","last_fullsized":"2024-09-12T19:29:55.142105+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T19:29:55.141865+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T19:29:55.141865+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.141865+0000","objects_scrubbed":10,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:28.760677+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":550,"num_read_kb":48255,"num_write":1188,"num_write_kb":33494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.823386+0000","last_change":"2024-09-12T19:30:09.823386+0000","last_active":"2024-09-12T19:30:09.823386+0000","last_peered":"2024-09-12T19:30:09.823386+0000","last_clean":"2024-09-12T19:30:09.823386+0000","last_became_active":"2024-09-12T17:36:38.892804+0000","last_became_peered":"2024-09-12T17:36:38.892804+0000","last_unstale":"2024-09-12T19:30:09.823386+0000","last_undegraded":"2024-09-12T19:30:09.823386+0000","last_fullsized":"2024-09-12T19:30:09.823386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.823197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.823197+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.823197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:59.559731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'399","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.304851+0000","last_change":"2024-09-12T17:36:40.889733+0000","last_active":"2024-09-12T19:29:42.304851+0000","last_peered":"2024-09-12T19:29:42.304851+0000","last_clean":"2024-09-12T19:29:42.304851+0000","last_became_active":"2024-09-12T17:36:40.888974+0000","last_became_peered":"2024-09-12T17:36:40.888974+0000","last_unstale":"2024-09-12T19:29:42.304851+0000","last_undegraded":"2024-09-12T19:29:42.304851+0000","last_fullsized":"2024-09-12T19:29:42.304851+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:41.043970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45462,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":644,"num_read_kb":1295,"num_write":508,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'799","reported_seq":3053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.854490+0000","last_change":"2024-09-12T19:30:16.854490+0000","last_active":"2024-09-12T19:30:16.854490+0000","last_peered":"2024-09-12T19:30:16.854490+0000","last_clean":"2024-09-12T19:30:16.854490+0000","last_became_active":"2024-09-12T17:36:42.935529+0000","last_became_peered":"2024-09-12T17:36:42.935529+0000","last_unstale":"2024-09-12T19:30:16.854490+0000","last_undegraded":"2024-09-12T19:30:16.854490+0000","last_fullsized":"2024-09-12T19:30:16.854490+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'799","last_scrub_stamp":"2024-09-12T19:30:16.854280+0000","last_deep_scrub":"265'799","last_deep_scrub_stamp":"2024-09-12T19:30:16.854280+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.854280+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:29.036304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'113","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.423550+0000","last_change":"2024-09-12T19:30:15.423550+0000","last_active":"2024-09-12T19:30:15.423550+0000","last_peered":"2024-09-12T19:30:15.423550+0000","last_clean":"2024-09-12T19:30:15.423550+0000","last_became_active":"2024-09-12T17:36:44.965763+0000","last_became_peered":"2024-09-12T17:36:44.965763+0000","last_unstale":"2024-09-12T19:30:15.423550+0000","last_undegraded":"2024-09-12T19:30:15.423550+0000","last_fullsized":"2024-09-12T19:30:15.423550+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'113","last_scrub_stamp":"2024-09-12T19:30:15.423367+0000","last_deep_scrub":"265'113","last_deep_scrub_stamp":"2024-09-12T19:30:15.423367+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.423367+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:46.072716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":137,"num_write":264,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'415","reported_seq":1907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.921903+0000","last_change":"2024-09-12T19:30:01.921903+0000","last_active":"2024-09-12T19:30:01.921903+0000","last_peered":"2024-09-12T19:30:01.921903+0000","last_clean":"2024-09-12T19:30:01.921903+0000","last_became_active":"2024-09-12T17:36:36.905958+0000","last_became_peered":"2024-09-12T17:36:36.905958+0000","last_unstale":"2024-09-12T19:30:01.921903+0000","last_undegraded":"2024-09-12T19:30:01.921903+0000","last_fullsized":"2024-09-12T19:30:01.921903+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:30:01.921717+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:30:01.921717+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.921717+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:06.661883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":964,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'344","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.405949+0000","last_change":"2024-09-12T19:29:49.405949+0000","last_active":"2024-09-12T19:29:49.405949+0000","last_peered":"2024-09-12T19:29:49.405949+0000","last_clean":"2024-09-12T19:29:49.405949+0000","last_became_active":"2024-09-12T17:36:34.860828+0000","last_became_peered":"2024-09-12T17:36:34.860828+0000","last_unstale":"2024-09-12T19:29:49.405949+0000","last_undegraded":"2024-09-12T19:29:49.405949+0000","last_fullsized":"2024-09-12T19:29:49.405949+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T19:29:49.405847+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T19:29:49.405847+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.405847+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:37.116130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399137,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":452,"num_read_kb":18690,"num_write":1073,"num_write_kb":31228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.499917+0000","last_change":"2024-09-12T19:30:04.499917+0000","last_active":"2024-09-12T19:30:04.499917+0000","last_peered":"2024-09-12T19:30:04.499917+0000","last_clean":"2024-09-12T19:30:04.499917+0000","last_became_active":"2024-09-12T17:36:38.897189+0000","last_became_peered":"2024-09-12T17:36:38.897189+0000","last_unstale":"2024-09-12T19:30:04.499917+0000","last_undegraded":"2024-09-12T19:30:04.499917+0000","last_fullsized":"2024-09-12T19:30:04.499917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.499746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.499746+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.499746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:20.326081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'514","reported_seq":1210,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.076417+0000","last_change":"2024-09-12T19:30:12.076417+0000","last_active":"2024-09-12T19:30:12.076417+0000","last_peered":"2024-09-12T19:30:12.076417+0000","last_clean":"2024-09-12T19:30:12.076417+0000","last_became_active":"2024-09-12T17:36:40.906903+0000","last_became_peered":"2024-09-12T17:36:40.906903+0000","last_unstale":"2024-09-12T19:30:12.076417+0000","last_undegraded":"2024-09-12T19:30:12.076417+0000","last_fullsized":"2024-09-12T19:30:12.076417+0000","mapping_epoch":30,"log_start":"265'501","ondisk_log_start":"265'501","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'514","last_scrub_stamp":"2024-09-12T19:30:12.076220+0000","last_deep_scrub":"265'514","last_deep_scrub_stamp":"2024-09-12T19:30:12.076220+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.076220+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":501,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:39.976350+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96745,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":901,"num_read_kb":2079,"num_write":726,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.871490+0000","last_change":"2024-09-12T19:30:15.871490+0000","last_active":"2024-09-12T19:30:15.871490+0000","last_peered":"2024-09-12T19:30:15.871490+0000","last_clean":"2024-09-12T19:30:15.871490+0000","last_became_active":"2024-09-12T17:36:42.933168+0000","last_became_peered":"2024-09-12T17:36:42.933168+0000","last_unstale":"2024-09-12T19:30:15.871490+0000","last_undegraded":"2024-09-12T19:30:15.871490+0000","last_fullsized":"2024-09-12T19:30:15.871490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:15.871307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:15.871307+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.871307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:18.870421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'162","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.197938+0000","last_change":"2024-09-12T19:30:14.197938+0000","last_active":"2024-09-12T19:30:14.197938+0000","last_peered":"2024-09-12T19:30:14.197938+0000","last_clean":"2024-09-12T19:30:14.197938+0000","last_became_active":"2024-09-12T17:36:44.960935+0000","last_became_peered":"2024-09-12T17:36:44.960935+0000","last_unstale":"2024-09-12T19:30:14.197938+0000","last_undegraded":"2024-09-12T19:30:14.197938+0000","last_fullsized":"2024-09-12T19:30:14.197938+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T19:30:14.197639+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T19:30:14.197639+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.197639+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:56.070755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1322,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":195,"num_write":366,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1243","reported_seq":2932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.364754+0000","last_change":"2024-09-12T19:29:56.364754+0000","last_active":"2024-09-12T19:29:56.364754+0000","last_peered":"2024-09-12T19:29:56.364754+0000","last_clean":"2024-09-12T19:29:56.364754+0000","last_became_active":"2024-09-12T17:36:36.914518+0000","last_became_peered":"2024-09-12T17:36:36.914518+0000","last_unstale":"2024-09-12T19:29:56.364754+0000","last_undegraded":"2024-09-12T19:29:56.364754+0000","last_fullsized":"2024-09-12T19:29:56.364754+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1243","last_scrub_stamp":"2024-09-12T19:29:56.364560+0000","last_deep_scrub":"265'1243","last_deep_scrub_stamp":"2024-09-12T19:29:56.364560+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.364560+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:54.124223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5692,"num_read_kb":5056,"num_write":1732,"num_write_kb":743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'326","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.160320+0000","last_change":"2024-09-12T19:29:52.160320+0000","last_active":"2024-09-12T19:29:52.160320+0000","last_peered":"2024-09-12T19:29:52.160320+0000","last_clean":"2024-09-12T19:29:52.160320+0000","last_became_active":"2024-09-12T17:36:34.878896+0000","last_became_peered":"2024-09-12T17:36:34.878896+0000","last_unstale":"2024-09-12T19:29:52.160320+0000","last_undegraded":"2024-09-12T19:29:52.160320+0000","last_fullsized":"2024-09-12T19:29:52.160320+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'326","last_scrub_stamp":"2024-09-12T19:29:52.160042+0000","last_deep_scrub":"265'326","last_deep_scrub_stamp":"2024-09-12T19:29:52.160042+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.160042+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:02.198272+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":17715,"num_write":1042,"num_write_kb":23877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.101607+0000","last_change":"2024-09-12T19:30:04.101607+0000","last_active":"2024-09-12T19:30:04.101607+0000","last_peered":"2024-09-12T19:30:04.101607+0000","last_clean":"2024-09-12T19:30:04.101607+0000","last_became_active":"2024-09-12T17:36:38.907609+0000","last_became_peered":"2024-09-12T17:36:38.907609+0000","last_unstale":"2024-09-12T19:30:04.101607+0000","last_undegraded":"2024-09-12T19:30:04.101607+0000","last_fullsized":"2024-09-12T19:30:04.101607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.101422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.101422+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.101422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:43.456527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'366","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.856226+0000","last_change":"2024-09-12T19:30:06.856226+0000","last_active":"2024-09-12T19:30:06.856226+0000","last_peered":"2024-09-12T19:30:06.856226+0000","last_clean":"2024-09-12T19:30:06.856226+0000","last_became_active":"2024-09-12T17:36:40.893702+0000","last_became_peered":"2024-09-12T17:36:40.893702+0000","last_unstale":"2024-09-12T19:30:06.856226+0000","last_undegraded":"2024-09-12T19:30:06.856226+0000","last_fullsized":"2024-09-12T19:30:06.856226+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T19:30:06.855976+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T19:30:06.855976+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.855976+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:59.315491+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47801,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":608,"num_read_kb":1248,"num_write":530,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.189730+0000","last_change":"2024-09-12T19:30:09.189730+0000","last_active":"2024-09-12T19:30:09.189730+0000","last_peered":"2024-09-12T19:30:09.189730+0000","last_clean":"2024-09-12T19:30:09.189730+0000","last_became_active":"2024-09-12T17:36:42.938437+0000","last_became_peered":"2024-09-12T17:36:42.938437+0000","last_unstale":"2024-09-12T19:30:09.189730+0000","last_undegraded":"2024-09-12T19:30:09.189730+0000","last_fullsized":"2024-09-12T19:30:09.189730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.189503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.189503+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.189503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:16.188315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'151","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.830517+0000","last_change":"2024-09-12T19:30:18.830517+0000","last_active":"2024-09-12T19:30:18.830517+0000","last_peered":"2024-09-12T19:30:18.830517+0000","last_clean":"2024-09-12T19:30:18.830517+0000","last_became_active":"2024-09-12T17:36:44.956645+0000","last_became_peered":"2024-09-12T17:36:44.956645+0000","last_unstale":"2024-09-12T19:30:18.830517+0000","last_undegraded":"2024-09-12T19:30:18.830517+0000","last_fullsized":"2024-09-12T19:30:18.830517+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T19:30:18.830311+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T19:30:18.830311+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.830311+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:17.214413+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":356,"num_read_kb":303,"num_write":346,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'503","reported_seq":2127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.145687+0000","last_change":"2024-09-12T19:30:07.145687+0000","last_active":"2024-09-12T19:30:07.145687+0000","last_peered":"2024-09-12T19:30:07.145687+0000","last_clean":"2024-09-12T19:30:07.145687+0000","last_became_active":"2024-09-12T17:36:36.881882+0000","last_became_peered":"2024-09-12T17:36:36.881882+0000","last_unstale":"2024-09-12T19:30:07.145687+0000","last_undegraded":"2024-09-12T19:30:07.145687+0000","last_fullsized":"2024-09-12T19:30:07.145687+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'503","last_scrub_stamp":"2024-09-12T19:30:07.145481+0000","last_deep_scrub":"265'503","last_deep_scrub_stamp":"2024-09-12T19:30:07.145481+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.145481+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:18.068459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2445,"num_write":630,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1768,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'360","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.147330+0000","last_change":"2024-09-12T19:29:54.147330+0000","last_active":"2024-09-12T19:29:54.147330+0000","last_peered":"2024-09-12T19:29:54.147330+0000","last_clean":"2024-09-12T19:29:54.147330+0000","last_became_active":"2024-09-12T17:36:34.870021+0000","last_became_peered":"2024-09-12T17:36:34.870021+0000","last_unstale":"2024-09-12T19:29:54.147330+0000","last_undegraded":"2024-09-12T19:29:54.147330+0000","last_fullsized":"2024-09-12T19:29:54.147330+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T19:29:54.147094+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T19:29:54.147094+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.147094+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:37.219375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":14188,"num_write":1189,"num_write_kb":25082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.885812+0000","last_change":"2024-09-12T19:30:22.885812+0000","last_active":"2024-09-12T19:30:22.885812+0000","last_peered":"2024-09-12T19:30:22.885812+0000","last_clean":"2024-09-12T19:30:22.885812+0000","last_became_active":"2024-09-12T17:36:38.892885+0000","last_became_peered":"2024-09-12T17:36:38.892885+0000","last_unstale":"2024-09-12T19:30:22.885812+0000","last_undegraded":"2024-09-12T19:30:22.885812+0000","last_fullsized":"2024-09-12T19:30:22.885812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.885627+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:32.386425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'386","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.852949+0000","last_change":"2024-09-12T19:30:12.852949+0000","last_active":"2024-09-12T19:30:12.852949+0000","last_peered":"2024-09-12T19:30:12.852949+0000","last_clean":"2024-09-12T19:30:12.852949+0000","last_became_active":"2024-09-12T17:36:40.896733+0000","last_became_peered":"2024-09-12T17:36:40.896733+0000","last_unstale":"2024-09-12T19:30:12.852949+0000","last_undegraded":"2024-09-12T19:30:12.852949+0000","last_fullsized":"2024-09-12T19:30:12.852949+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T19:30:12.852690+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T19:30:12.852690+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.852690+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:33.164610+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60156,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1227,"num_write":470,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'770","reported_seq":3244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.198293+0000","last_change":"2024-09-12T19:30:07.198293+0000","last_active":"2024-09-12T19:30:07.198293+0000","last_peered":"2024-09-12T19:30:07.198293+0000","last_clean":"2024-09-12T19:30:07.198293+0000","last_became_active":"2024-09-12T17:36:42.934582+0000","last_became_peered":"2024-09-12T17:36:42.934582+0000","last_unstale":"2024-09-12T19:30:07.198293+0000","last_undegraded":"2024-09-12T19:30:07.198293+0000","last_fullsized":"2024-09-12T19:30:07.198293+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'770","last_scrub_stamp":"2024-09-12T19:30:07.198104+0000","last_deep_scrub":"265'770","last_deep_scrub_stamp":"2024-09-12T19:30:07.198104+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.198104+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:23.704998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'104","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.440516+0000","last_change":"2024-09-12T19:30:14.440516+0000","last_active":"2024-09-12T19:30:14.440516+0000","last_peered":"2024-09-12T19:30:14.440516+0000","last_clean":"2024-09-12T19:30:14.440516+0000","last_became_active":"2024-09-12T17:36:44.937368+0000","last_became_peered":"2024-09-12T17:36:44.937368+0000","last_unstale":"2024-09-12T19:30:14.440516+0000","last_undegraded":"2024-09-12T19:30:14.440516+0000","last_fullsized":"2024-09-12T19:30:14.440516+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T19:30:14.440277+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T19:30:14.440277+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.440277+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:13.019102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":224,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'655","reported_seq":2169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.360525+0000","last_change":"2024-09-12T19:29:55.360525+0000","last_active":"2024-09-12T19:29:55.360525+0000","last_peered":"2024-09-12T19:29:55.360525+0000","last_clean":"2024-09-12T19:29:55.360525+0000","last_became_active":"2024-09-12T17:36:36.883043+0000","last_became_peered":"2024-09-12T17:36:36.883043+0000","last_unstale":"2024-09-12T19:29:55.360525+0000","last_undegraded":"2024-09-12T19:29:55.360525+0000","last_fullsized":"2024-09-12T19:29:55.360525+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'655","last_scrub_stamp":"2024-09-12T19:29:55.360342+0000","last_deep_scrub":"265'655","last_deep_scrub_stamp":"2024-09-12T19:29:55.360342+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.360342+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:36.568704+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3181,"num_read_kb":2856,"num_write":918,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'393","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.103440+0000","last_change":"2024-09-12T19:29:53.103440+0000","last_active":"2024-09-12T19:29:53.103440+0000","last_peered":"2024-09-12T19:29:53.103440+0000","last_clean":"2024-09-12T19:29:53.103440+0000","last_became_active":"2024-09-12T17:36:34.873263+0000","last_became_peered":"2024-09-12T17:36:34.873263+0000","last_unstale":"2024-09-12T19:29:53.103440+0000","last_undegraded":"2024-09-12T19:29:53.103440+0000","last_fullsized":"2024-09-12T19:29:53.103440+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T19:29:53.103209+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T19:29:53.103209+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.103209+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:42.148875+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194346,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":21339,"num_write":1076,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.888492+0000","last_change":"2024-09-12T19:30:02.888492+0000","last_active":"2024-09-12T19:30:02.888492+0000","last_peered":"2024-09-12T19:30:02.888492+0000","last_clean":"2024-09-12T19:30:02.888492+0000","last_became_active":"2024-09-12T17:36:38.888795+0000","last_became_peered":"2024-09-12T17:36:38.888795+0000","last_unstale":"2024-09-12T19:30:02.888492+0000","last_undegraded":"2024-09-12T19:30:02.888492+0000","last_fullsized":"2024-09-12T19:30:02.888492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:02.888300+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:02.888300+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.888300+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:29.619911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'155","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.485137+0000","last_change":"2024-09-12T19:30:09.485137+0000","last_active":"2024-09-12T19:30:09.485137+0000","last_peered":"2024-09-12T19:30:09.485137+0000","last_clean":"2024-09-12T19:30:09.485137+0000","last_became_active":"2024-09-12T17:36:40.893090+0000","last_became_peered":"2024-09-12T17:36:40.893090+0000","last_unstale":"2024-09-12T19:30:09.485137+0000","last_undegraded":"2024-09-12T19:30:09.485137+0000","last_fullsized":"2024-09-12T19:30:09.485137+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'155","last_scrub_stamp":"2024-09-12T19:30:09.484944+0000","last_deep_scrub":"265'155","last_deep_scrub_stamp":"2024-09-12T19:30:09.484944+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.484944+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:12.960615+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'806","reported_seq":3164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.813116+0000","last_change":"2024-09-12T19:30:08.813116+0000","last_active":"2024-09-12T19:30:08.813116+0000","last_peered":"2024-09-12T19:30:08.813116+0000","last_clean":"2024-09-12T19:30:08.813116+0000","last_became_active":"2024-09-12T17:36:42.937195+0000","last_became_peered":"2024-09-12T17:36:42.937195+0000","last_unstale":"2024-09-12T19:30:08.813116+0000","last_undegraded":"2024-09-12T19:30:08.813116+0000","last_fullsized":"2024-09-12T19:30:08.813116+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T19:30:08.812938+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T19:30:08.812938+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.812938+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:24.074921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'109","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.379760+0000","last_change":"2024-09-12T19:30:10.379760+0000","last_active":"2024-09-12T19:30:10.379760+0000","last_peered":"2024-09-12T19:30:10.379760+0000","last_clean":"2024-09-12T19:30:10.379760+0000","last_became_active":"2024-09-12T17:36:44.960042+0000","last_became_peered":"2024-09-12T17:36:44.960042+0000","last_unstale":"2024-09-12T19:30:10.379760+0000","last_undegraded":"2024-09-12T19:30:10.379760+0000","last_fullsized":"2024-09-12T19:30:10.379760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T19:30:10.379634+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T19:30:10.379634+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.379634+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:19.555620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'988","reported_seq":2652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.143275+0000","last_change":"2024-09-12T19:29:55.143275+0000","last_active":"2024-09-12T19:29:55.143275+0000","last_peered":"2024-09-12T19:29:55.143275+0000","last_clean":"2024-09-12T19:29:55.143275+0000","last_became_active":"2024-09-12T17:36:36.913566+0000","last_became_peered":"2024-09-12T17:36:36.913566+0000","last_unstale":"2024-09-12T19:29:55.143275+0000","last_undegraded":"2024-09-12T19:29:55.143275+0000","last_fullsized":"2024-09-12T19:29:55.143275+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'988","last_scrub_stamp":"2024-09-12T19:29:55.143081+0000","last_deep_scrub":"265'988","last_deep_scrub_stamp":"2024-09-12T19:29:55.143081+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.143081+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":900,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:53.114918+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4811,"num_read_kb":4293,"num_write":1402,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'301","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.964599+0000","last_change":"2024-09-12T19:29:51.964599+0000","last_active":"2024-09-12T19:29:51.964599+0000","last_peered":"2024-09-12T19:29:51.964599+0000","last_clean":"2024-09-12T19:29:51.964599+0000","last_became_active":"2024-09-12T17:36:34.862534+0000","last_became_peered":"2024-09-12T17:36:34.862534+0000","last_unstale":"2024-09-12T19:29:51.964599+0000","last_undegraded":"2024-09-12T19:29:51.964599+0000","last_fullsized":"2024-09-12T19:29:51.964599+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T19:29:51.964386+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T19:29:51.964386+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.964386+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:56.102480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":22960,"num_write":940,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.244922+0000","last_change":"2024-09-12T19:30:16.244922+0000","last_active":"2024-09-12T19:30:16.244922+0000","last_peered":"2024-09-12T19:30:16.244922+0000","last_clean":"2024-09-12T19:30:16.244922+0000","last_became_active":"2024-09-12T17:36:38.885678+0000","last_became_peered":"2024-09-12T17:36:38.885678+0000","last_unstale":"2024-09-12T19:30:16.244922+0000","last_undegraded":"2024-09-12T19:30:16.244922+0000","last_fullsized":"2024-09-12T19:30:16.244922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:16.244724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:16.244724+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.244724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:32.116672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'421","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.848360+0000","last_change":"2024-09-12T19:30:05.848360+0000","last_active":"2024-09-12T19:30:05.848360+0000","last_peered":"2024-09-12T19:30:05.848360+0000","last_clean":"2024-09-12T19:30:05.848360+0000","last_became_active":"2024-09-12T17:36:40.900295+0000","last_became_peered":"2024-09-12T17:36:40.900295+0000","last_unstale":"2024-09-12T19:30:05.848360+0000","last_undegraded":"2024-09-12T19:30:05.848360+0000","last_fullsized":"2024-09-12T19:30:05.848360+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T19:30:05.848067+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T19:30:05.848067+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.848067+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:04.379582+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41300,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":664,"num_read_kb":1187,"num_write":496,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.479258+0000","last_change":"2024-09-12T19:30:07.479258+0000","last_active":"2024-09-12T19:30:07.479258+0000","last_peered":"2024-09-12T19:30:07.479258+0000","last_clean":"2024-09-12T19:30:07.479258+0000","last_became_active":"2024-09-12T17:36:42.927716+0000","last_became_peered":"2024-09-12T17:36:42.927716+0000","last_unstale":"2024-09-12T19:30:07.479258+0000","last_undegraded":"2024-09-12T19:30:07.479258+0000","last_fullsized":"2024-09-12T19:30:07.479258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:07.478981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:07.478981+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.478981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:54.816352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'116","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.188295+0000","last_change":"2024-09-12T19:30:13.188295+0000","last_active":"2024-09-12T19:30:13.188295+0000","last_peered":"2024-09-12T19:30:13.188295+0000","last_clean":"2024-09-12T19:30:13.188295+0000","last_became_active":"2024-09-12T17:36:44.942505+0000","last_became_peered":"2024-09-12T17:36:44.942505+0000","last_unstale":"2024-09-12T19:30:13.188295+0000","last_undegraded":"2024-09-12T19:30:13.188295+0000","last_fullsized":"2024-09-12T19:30:13.188295+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T19:30:13.188101+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T19:30:13.188101+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.188101+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:41.920035+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":134,"num_write":256,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'735","reported_seq":2211,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.116820+0000","last_change":"2024-09-12T19:30:05.116820+0000","last_active":"2024-09-12T19:30:05.116820+0000","last_peered":"2024-09-12T19:30:05.116820+0000","last_clean":"2024-09-12T19:30:05.116820+0000","last_became_active":"2024-09-12T17:36:36.881456+0000","last_became_peered":"2024-09-12T17:36:36.881456+0000","last_unstale":"2024-09-12T19:30:05.116820+0000","last_undegraded":"2024-09-12T19:30:05.116820+0000","last_fullsized":"2024-09-12T19:30:05.116820+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'735","last_scrub_stamp":"2024-09-12T19:30:05.116645+0000","last_deep_scrub":"265'735","last_deep_scrub_stamp":"2024-09-12T19:30:05.116645+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.116645+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:47.794091+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3432,"num_read_kb":3120,"num_write":969,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.898417+0000","last_change":"2024-09-12T19:29:49.898417+0000","last_active":"2024-09-12T19:29:49.898417+0000","last_peered":"2024-09-12T19:29:49.898417+0000","last_clean":"2024-09-12T19:29:49.898417+0000","last_became_active":"2024-09-12T17:36:16.722334+0000","last_became_peered":"2024-09-12T17:36:16.722334+0000","last_unstale":"2024-09-12T19:29:49.898417+0000","last_undegraded":"2024-09-12T19:29:49.898417+0000","last_fullsized":"2024-09-12T19:29:49.898417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T19:29:49.898324+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T19:29:49.898324+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.898324+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:33.245609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":560,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.125545+0000","last_change":"2024-09-12T19:29:51.125545+0000","last_active":"2024-09-12T19:29:51.125545+0000","last_peered":"2024-09-12T19:29:51.125545+0000","last_clean":"2024-09-12T19:29:51.125545+0000","last_became_active":"2024-09-12T17:36:21.777852+0000","last_became_peered":"2024-09-12T17:36:21.777852+0000","last_unstale":"2024-09-12T19:29:51.125545+0000","last_undegraded":"2024-09-12T19:29:51.125545+0000","last_fullsized":"2024-09-12T19:29:51.125545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:29:51.125363+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:29:51.125363+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.125363+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.353553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0019340550000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'392","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.973395+0000","last_change":"2024-09-12T19:29:49.973395+0000","last_active":"2024-09-12T19:29:49.973395+0000","last_peered":"2024-09-12T19:29:49.973395+0000","last_clean":"2024-09-12T19:29:49.973395+0000","last_became_active":"2024-09-12T17:36:34.865550+0000","last_became_peered":"2024-09-12T17:36:34.865550+0000","last_unstale":"2024-09-12T19:29:49.973395+0000","last_undegraded":"2024-09-12T19:29:49.973395+0000","last_fullsized":"2024-09-12T19:29:49.973395+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'392","last_scrub_stamp":"2024-09-12T19:29:49.973066+0000","last_deep_scrub":"265'392","last_deep_scrub_stamp":"2024-09-12T19:29:49.973066+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.973066+0000","objects_scrubbed":10,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:01.163698+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":672,"num_read_kb":15438,"num_write":1473,"num_write_kb":31533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.410837+0000","last_change":"2024-09-12T19:30:02.410837+0000","last_active":"2024-09-12T19:30:02.410837+0000","last_peered":"2024-09-12T19:30:02.410837+0000","last_clean":"2024-09-12T19:30:02.410837+0000","last_became_active":"2024-09-12T17:36:38.891774+0000","last_became_peered":"2024-09-12T17:36:38.891774+0000","last_unstale":"2024-09-12T19:30:02.410837+0000","last_undegraded":"2024-09-12T19:30:02.410837+0000","last_fullsized":"2024-09-12T19:30:02.410837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:02.410659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:02.410659+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.410659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:06.637766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'753","reported_seq":1508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.147491+0000","last_change":"2024-09-12T19:30:23.147491+0000","last_active":"2024-09-12T19:30:23.147491+0000","last_peered":"2024-09-12T19:30:23.147491+0000","last_clean":"2024-09-12T19:30:23.147491+0000","last_became_active":"2024-09-12T17:36:40.885684+0000","last_became_peered":"2024-09-12T17:36:40.885684+0000","last_unstale":"2024-09-12T19:30:23.147491+0000","last_undegraded":"2024-09-12T19:30:23.147491+0000","last_fullsized":"2024-09-12T19:30:23.147491+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'753","last_scrub_stamp":"2024-09-12T19:30:23.147238+0000","last_deep_scrub":"265'753","last_deep_scrub_stamp":"2024-09-12T19:30:23.147238+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.147238+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:22.325464+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144787,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1444,"num_read_kb":3163,"num_write":1370,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89364,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.874487+0000","last_change":"2024-09-12T19:30:14.874487+0000","last_active":"2024-09-12T19:30:14.874487+0000","last_peered":"2024-09-12T19:30:14.874487+0000","last_clean":"2024-09-12T19:30:14.874487+0000","last_became_active":"2024-09-12T17:36:42.919204+0000","last_became_peered":"2024-09-12T17:36:42.919204+0000","last_unstale":"2024-09-12T19:30:14.874487+0000","last_undegraded":"2024-09-12T19:30:14.874487+0000","last_fullsized":"2024-09-12T19:30:14.874487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:14.874285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:14.874285+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.874285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:05.726412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'188","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.437887+0000","last_change":"2024-09-12T19:30:06.437887+0000","last_active":"2024-09-12T19:30:06.437887+0000","last_peered":"2024-09-12T19:30:06.437887+0000","last_clean":"2024-09-12T19:30:06.437887+0000","last_became_active":"2024-09-12T17:36:44.954321+0000","last_became_peered":"2024-09-12T17:36:44.954321+0000","last_unstale":"2024-09-12T19:30:06.437887+0000","last_undegraded":"2024-09-12T19:30:06.437887+0000","last_fullsized":"2024-09-12T19:30:06.437887+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T19:30:06.437713+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T19:30:06.437713+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.437713+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:02.954841+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":488,"num_write":378,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'505","reported_seq":2094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.910531+0000","last_change":"2024-09-12T19:30:02.910531+0000","last_active":"2024-09-12T19:30:02.910531+0000","last_peered":"2024-09-12T19:30:02.910531+0000","last_clean":"2024-09-12T19:30:02.910531+0000","last_became_active":"2024-09-12T17:36:36.906789+0000","last_became_peered":"2024-09-12T17:36:36.906789+0000","last_unstale":"2024-09-12T19:30:02.910531+0000","last_undegraded":"2024-09-12T19:30:02.910531+0000","last_fullsized":"2024-09-12T19:30:02.910531+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:30:02.910308+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:30:02.910308+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.910308+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:02.545989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2691,"num_read_kb":2505,"num_write":636,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":560,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.034793+0000","last_change":"2024-09-12T19:29:49.034793+0000","last_active":"2024-09-12T19:29:49.034793+0000","last_peered":"2024-09-12T19:29:49.034793+0000","last_clean":"2024-09-12T19:29:49.034793+0000","last_became_active":"2024-09-12T17:36:21.785026+0000","last_became_peered":"2024-09-12T17:36:21.785026+0000","last_unstale":"2024-09-12T19:29:49.034793+0000","last_undegraded":"2024-09-12T19:29:49.034793+0000","last_fullsized":"2024-09-12T19:29:49.034793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:49.034625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:49.034625+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.034625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:04.032231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184601,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'384","reported_seq":1094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.337277+0000","last_change":"2024-09-12T19:29:49.337277+0000","last_active":"2024-09-12T19:29:49.337277+0000","last_peered":"2024-09-12T19:29:49.337277+0000","last_clean":"2024-09-12T19:29:49.337277+0000","last_became_active":"2024-09-12T17:36:34.882818+0000","last_became_peered":"2024-09-12T17:36:34.882818+0000","last_unstale":"2024-09-12T19:29:49.337277+0000","last_undegraded":"2024-09-12T19:29:49.337277+0000","last_fullsized":"2024-09-12T19:29:49.337277+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T19:29:49.337016+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T19:29:49.337016+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.337016+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:42.148166+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263289,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":609,"num_read_kb":22197,"num_write":1318,"num_write_kb":15503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.207386+0000","last_change":"2024-09-12T19:30:17.207386+0000","last_active":"2024-09-12T19:30:17.207386+0000","last_peered":"2024-09-12T19:30:17.207386+0000","last_clean":"2024-09-12T19:30:17.207386+0000","last_became_active":"2024-09-12T17:36:38.895378+0000","last_became_peered":"2024-09-12T17:36:38.895378+0000","last_unstale":"2024-09-12T19:30:17.207386+0000","last_undegraded":"2024-09-12T19:30:17.207386+0000","last_fullsized":"2024-09-12T19:30:17.207386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:17.207209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:17.207209+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.207209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:15.388414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1459","reported_seq":3821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.186738+0000","last_change":"2024-09-12T19:30:08.186738+0000","last_active":"2024-09-12T19:30:08.186738+0000","last_peered":"2024-09-12T19:30:08.186738+0000","last_clean":"2024-09-12T19:30:08.186738+0000","last_became_active":"2024-09-12T17:36:40.908721+0000","last_became_peered":"2024-09-12T17:36:40.908721+0000","last_unstale":"2024-09-12T19:30:08.186738+0000","last_undegraded":"2024-09-12T19:30:08.186738+0000","last_fullsized":"2024-09-12T19:30:08.186738+0000","mapping_epoch":30,"log_start":"265'1400","ondisk_log_start":"265'1400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1459","last_scrub_stamp":"2024-09-12T19:30:08.186556+0000","last_deep_scrub":"265'1459","last_deep_scrub_stamp":"2024-09-12T19:30:08.186556+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.186556+0000","objects_scrubbed":11,"log_size":59,"log_dups_size":1400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:47.270094+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146546,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2270,"num_read_kb":4170,"num_write":1382,"num_write_kb":1134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.167515+0000","last_change":"2024-09-12T19:30:22.167515+0000","last_active":"2024-09-12T19:30:22.167515+0000","last_peered":"2024-09-12T19:30:22.167515+0000","last_clean":"2024-09-12T19:30:22.167515+0000","last_became_active":"2024-09-12T17:36:42.917432+0000","last_became_peered":"2024-09-12T17:36:42.917432+0000","last_unstale":"2024-09-12T19:30:22.167515+0000","last_undegraded":"2024-09-12T19:30:22.167515+0000","last_fullsized":"2024-09-12T19:30:22.167515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.167254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.167254+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.167254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:19.411131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'254","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.833332+0000","last_change":"2024-09-12T19:30:19.833332+0000","last_active":"2024-09-12T19:30:19.833332+0000","last_peered":"2024-09-12T19:30:19.833332+0000","last_clean":"2024-09-12T19:30:19.833332+0000","last_became_active":"2024-09-12T17:36:44.956687+0000","last_became_peered":"2024-09-12T17:36:44.956687+0000","last_unstale":"2024-09-12T19:30:19.833332+0000","last_undegraded":"2024-09-12T19:30:19.833332+0000","last_fullsized":"2024-09-12T19:30:19.833332+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-12T19:30:19.833141+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-12T19:30:19.833141+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.833141+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:20.668124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":419,"num_write":569,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'459","reported_seq":1919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.431161+0000","last_change":"2024-09-12T19:29:57.431161+0000","last_active":"2024-09-12T19:29:57.431161+0000","last_peered":"2024-09-12T19:29:57.431161+0000","last_clean":"2024-09-12T19:29:57.431161+0000","last_became_active":"2024-09-12T17:36:36.876424+0000","last_became_peered":"2024-09-12T17:36:36.876424+0000","last_unstale":"2024-09-12T19:29:57.431161+0000","last_undegraded":"2024-09-12T19:29:57.431161+0000","last_fullsized":"2024-09-12T19:29:57.431161+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'459","last_scrub_stamp":"2024-09-12T19:29:57.430975+0000","last_deep_scrub":"265'459","last_deep_scrub_stamp":"2024-09-12T19:29:57.430975+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.430975+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:09.526597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2313,"num_read_kb":2138,"num_write":582,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":559,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.154192+0000","last_change":"2024-09-12T19:29:50.154192+0000","last_active":"2024-09-12T19:29:50.154192+0000","last_peered":"2024-09-12T19:29:50.154192+0000","last_clean":"2024-09-12T19:29:50.154192+0000","last_became_active":"2024-09-12T17:36:21.786793+0000","last_became_peered":"2024-09-12T17:36:21.786793+0000","last_unstale":"2024-09-12T19:29:50.154192+0000","last_undegraded":"2024-09-12T19:29:50.154192+0000","last_fullsized":"2024-09-12T19:29:50.154192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:50.154015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:50.154015+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.154015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:03.469572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011925740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'325","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.914352+0000","last_change":"2024-09-12T19:29:49.914352+0000","last_active":"2024-09-12T19:29:49.914352+0000","last_peered":"2024-09-12T19:29:49.914352+0000","last_clean":"2024-09-12T19:29:49.914352+0000","last_became_active":"2024-09-12T17:36:34.878944+0000","last_became_peered":"2024-09-12T17:36:34.878944+0000","last_unstale":"2024-09-12T19:29:49.914352+0000","last_undegraded":"2024-09-12T19:29:49.914352+0000","last_fullsized":"2024-09-12T19:29:49.914352+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'325","last_scrub_stamp":"2024-09-12T19:29:49.914119+0000","last_deep_scrub":"265'325","last_deep_scrub_stamp":"2024-09-12T19:29:49.914119+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.914119+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:49.927843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526370,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":517,"num_read_kb":44432,"num_write":1109,"num_write_kb":34964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.067399+0000","last_change":"2024-09-12T19:30:03.067399+0000","last_active":"2024-09-12T19:30:03.067399+0000","last_peered":"2024-09-12T19:30:03.067399+0000","last_clean":"2024-09-12T19:30:03.067399+0000","last_became_active":"2024-09-12T17:36:38.907685+0000","last_became_peered":"2024-09-12T17:36:38.907685+0000","last_unstale":"2024-09-12T19:30:03.067399+0000","last_undegraded":"2024-09-12T19:30:03.067399+0000","last_fullsized":"2024-09-12T19:30:03.067399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:03.067178+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:03.067178+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.067178+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:13.152392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'394","reported_seq":2363,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.492938+0000","last_change":"2024-09-12T19:30:07.492938+0000","last_active":"2024-09-12T19:30:07.492938+0000","last_peered":"2024-09-12T19:30:07.492938+0000","last_clean":"2024-09-12T19:30:07.492938+0000","last_became_active":"2024-09-12T17:36:40.907340+0000","last_became_peered":"2024-09-12T17:36:40.907340+0000","last_unstale":"2024-09-12T19:30:07.492938+0000","last_undegraded":"2024-09-12T19:30:07.492938+0000","last_fullsized":"2024-09-12T19:30:07.492938+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T19:30:07.492731+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T19:30:07.492731+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.492731+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:01.941637+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":374,"num_read_kb":364,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.047061+0000","last_change":"2024-09-12T19:30:20.047061+0000","last_active":"2024-09-12T19:30:20.047061+0000","last_peered":"2024-09-12T19:30:20.047061+0000","last_clean":"2024-09-12T19:30:20.047061+0000","last_became_active":"2024-09-12T17:36:42.931884+0000","last_became_peered":"2024-09-12T17:36:42.931884+0000","last_unstale":"2024-09-12T19:30:20.047061+0000","last_undegraded":"2024-09-12T19:30:20.047061+0000","last_fullsized":"2024-09-12T19:30:20.047061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:20.046878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:20.046878+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.046878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:37.970477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'260","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.041036+0000","last_change":"2024-09-12T19:30:24.041036+0000","last_active":"2024-09-12T19:30:24.041036+0000","last_peered":"2024-09-12T19:30:24.041036+0000","last_clean":"2024-09-12T19:30:24.041036+0000","last_became_active":"2024-09-12T17:36:44.940041+0000","last_became_peered":"2024-09-12T17:36:44.940041+0000","last_unstale":"2024-09-12T19:30:24.041036+0000","last_undegraded":"2024-09-12T19:30:24.041036+0000","last_fullsized":"2024-09-12T19:30:24.041036+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T19:30:24.040859+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T19:30:24.040859+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.040859+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:12.153683+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":565,"num_write":575,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'751","reported_seq":2229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.430540+0000","last_change":"2024-09-12T19:29:58.430540+0000","last_active":"2024-09-12T19:29:58.430540+0000","last_peered":"2024-09-12T19:29:58.430540+0000","last_clean":"2024-09-12T19:29:58.430540+0000","last_became_active":"2024-09-12T17:36:36.896152+0000","last_became_peered":"2024-09-12T17:36:36.896152+0000","last_unstale":"2024-09-12T19:29:58.430540+0000","last_undegraded":"2024-09-12T19:29:58.430540+0000","last_fullsized":"2024-09-12T19:29:58.430540+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'751","last_scrub_stamp":"2024-09-12T19:29:58.430337+0000","last_deep_scrub":"265'751","last_deep_scrub_stamp":"2024-09-12T19:29:58.430337+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.430337+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:51.087393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3496,"num_read_kb":3152,"num_write":986,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":561,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.061350+0000","last_change":"2024-09-12T19:29:48.061350+0000","last_active":"2024-09-12T19:29:48.061350+0000","last_peered":"2024-09-12T19:29:48.061350+0000","last_clean":"2024-09-12T19:29:48.061350+0000","last_became_active":"2024-09-12T17:36:21.777173+0000","last_became_peered":"2024-09-12T17:36:21.777173+0000","last_unstale":"2024-09-12T19:29:48.061350+0000","last_undegraded":"2024-09-12T19:29:48.061350+0000","last_fullsized":"2024-09-12T19:29:48.061350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T19:29:48.061179+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T19:29:48.061179+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.061179+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:31.413285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001776889,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'361","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.180093+0000","last_change":"2024-09-12T19:29:51.180093+0000","last_active":"2024-09-12T19:29:51.180093+0000","last_peered":"2024-09-12T19:29:51.180093+0000","last_clean":"2024-09-12T19:29:51.180093+0000","last_became_active":"2024-09-12T17:37:07.867652+0000","last_became_peered":"2024-09-12T17:37:07.867652+0000","last_unstale":"2024-09-12T19:29:51.180093+0000","last_undegraded":"2024-09-12T19:29:51.180093+0000","last_fullsized":"2024-09-12T19:29:51.180093+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:29:51.179910+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:29:51.179910+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.179910+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:46.705185+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":639,"num_read_kb":7400,"num_write":1137,"num_write_kb":18590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.125119+0000","last_change":"2024-09-12T19:30:01.125119+0000","last_active":"2024-09-12T19:30:01.125119+0000","last_peered":"2024-09-12T19:30:01.125119+0000","last_clean":"2024-09-12T19:30:01.125119+0000","last_became_active":"2024-09-12T17:36:38.912059+0000","last_became_peered":"2024-09-12T17:36:38.912059+0000","last_unstale":"2024-09-12T19:30:01.125119+0000","last_undegraded":"2024-09-12T19:30:01.125119+0000","last_fullsized":"2024-09-12T19:30:01.125119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:01.124924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:01.124924+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.124924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:24.544303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'223","reported_seq":845,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.842299+0000","last_change":"2024-09-12T19:30:11.842299+0000","last_active":"2024-09-12T19:30:11.842299+0000","last_peered":"2024-09-12T19:30:11.842299+0000","last_clean":"2024-09-12T19:30:11.842299+0000","last_became_active":"2024-09-12T17:36:40.884794+0000","last_became_peered":"2024-09-12T17:36:40.884794+0000","last_unstale":"2024-09-12T19:30:11.842299+0000","last_undegraded":"2024-09-12T19:30:11.842299+0000","last_fullsized":"2024-09-12T19:30:11.842299+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'223","last_scrub_stamp":"2024-09-12T19:30:11.842122+0000","last_deep_scrub":"265'223","last_deep_scrub_stamp":"2024-09-12T19:30:11.842122+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.842122+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:00.405422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":278,"num_read_kb":269,"num_write":202,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:15.367743+0000","last_change":"2024-09-12T17:36:42.921806+0000","last_active":"2024-09-12T19:27:15.367743+0000","last_peered":"2024-09-12T19:27:15.367743+0000","last_clean":"2024-09-12T19:27:15.367743+0000","last_became_active":"2024-09-12T17:36:42.920887+0000","last_became_peered":"2024-09-12T17:36:42.920887+0000","last_unstale":"2024-09-12T19:27:15.367743+0000","last_undegraded":"2024-09-12T19:27:15.367743+0000","last_fullsized":"2024-09-12T19:27:15.367743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:38.116745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'127","reported_seq":721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.753785+0000","last_change":"2024-09-12T19:30:15.753785+0000","last_active":"2024-09-12T19:30:15.753785+0000","last_peered":"2024-09-12T19:30:15.753785+0000","last_clean":"2024-09-12T19:30:15.753785+0000","last_became_active":"2024-09-12T17:36:44.937666+0000","last_became_peered":"2024-09-12T17:36:44.937666+0000","last_unstale":"2024-09-12T19:30:15.753785+0000","last_undegraded":"2024-09-12T19:30:15.753785+0000","last_fullsized":"2024-09-12T19:30:15.753785+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T19:30:15.753598+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T19:30:15.753598+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.753598+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.724999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":289,"num_read_kb":276,"num_write":312,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'531","reported_seq":2150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.379702+0000","last_change":"2024-09-12T19:29:55.379702+0000","last_active":"2024-09-12T19:29:55.379702+0000","last_peered":"2024-09-12T19:29:55.379702+0000","last_clean":"2024-09-12T19:29:55.379702+0000","last_became_active":"2024-09-12T17:36:36.880335+0000","last_became_peered":"2024-09-12T17:36:36.880335+0000","last_unstale":"2024-09-12T19:29:55.379702+0000","last_undegraded":"2024-09-12T19:29:55.379702+0000","last_fullsized":"2024-09-12T19:29:55.379702+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'531","last_scrub_stamp":"2024-09-12T19:29:55.379515+0000","last_deep_scrub":"265'531","last_deep_scrub_stamp":"2024-09-12T19:29:55.379515+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.379515+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:12.812873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2654,"num_read_kb":2484,"num_write":644,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'379","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.385447+0000","last_change":"2024-09-12T19:29:47.385447+0000","last_active":"2024-09-12T19:29:47.385447+0000","last_peered":"2024-09-12T19:29:47.385447+0000","last_clean":"2024-09-12T19:29:47.385447+0000","last_became_active":"2024-09-12T17:36:34.877412+0000","last_became_peered":"2024-09-12T17:36:34.877412+0000","last_unstale":"2024-09-12T19:29:47.385447+0000","last_undegraded":"2024-09-12T19:29:47.385447+0000","last_fullsized":"2024-09-12T19:29:47.385447+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'379","last_scrub_stamp":"2024-09-12T19:29:47.385337+0000","last_deep_scrub":"265'379","last_deep_scrub_stamp":"2024-09-12T19:29:47.385337+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.385337+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:45.645372+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6755987,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":26720,"num_write":1165,"num_write_kb":36792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.889621+0000","last_change":"2024-09-12T19:29:48.889621+0000","last_active":"2024-09-12T19:29:48.889621+0000","last_peered":"2024-09-12T19:29:48.889621+0000","last_clean":"2024-09-12T19:29:48.889621+0000","last_became_active":"2024-09-12T17:36:21.786429+0000","last_became_peered":"2024-09-12T17:36:21.786429+0000","last_unstale":"2024-09-12T19:29:48.889621+0000","last_undegraded":"2024-09-12T19:29:48.889621+0000","last_fullsized":"2024-09-12T19:29:48.889621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:48.889441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:48.889441+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.889441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:45.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011387680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"265'6","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.935990+0000","last_change":"2024-09-12T19:30:06.935990+0000","last_active":"2024-09-12T19:30:06.935990+0000","last_peered":"2024-09-12T19:30:06.935990+0000","last_clean":"2024-09-12T19:30:06.935990+0000","last_became_active":"2024-09-12T17:36:38.902432+0000","last_became_peered":"2024-09-12T17:36:38.902432+0000","last_unstale":"2024-09-12T19:30:06.935990+0000","last_undegraded":"2024-09-12T19:30:06.935990+0000","last_fullsized":"2024-09-12T19:30:06.935990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:30:06.935793+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:30:06.935793+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.935793+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:24:01.944572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":1196,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'762","reported_seq":1508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.173560+0000","last_change":"2024-09-12T19:30:05.173560+0000","last_active":"2024-09-12T19:30:05.173560+0000","last_peered":"2024-09-12T19:30:05.173560+0000","last_clean":"2024-09-12T19:30:05.173560+0000","last_became_active":"2024-09-12T17:36:40.902488+0000","last_became_peered":"2024-09-12T17:36:40.902488+0000","last_unstale":"2024-09-12T19:30:05.173560+0000","last_undegraded":"2024-09-12T19:30:05.173560+0000","last_fullsized":"2024-09-12T19:30:05.173560+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'762","last_scrub_stamp":"2024-09-12T19:30:05.173334+0000","last_deep_scrub":"265'762","last_deep_scrub_stamp":"2024-09-12T19:30:05.173334+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.173334+0000","objects_scrubbed":10,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:35.044431+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98161,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1955,"num_read_kb":3163,"num_write":2614,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508704,"num_omap_keys":1156,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.432752+0000","last_change":"2024-09-12T19:30:06.432752+0000","last_active":"2024-09-12T19:30:06.432752+0000","last_peered":"2024-09-12T19:30:06.432752+0000","last_clean":"2024-09-12T19:30:06.432752+0000","last_became_active":"2024-09-12T17:36:42.931746+0000","last_became_peered":"2024-09-12T17:36:42.931746+0000","last_unstale":"2024-09-12T19:30:06.432752+0000","last_undegraded":"2024-09-12T19:30:06.432752+0000","last_fullsized":"2024-09-12T19:30:06.432752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:06.432573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:06.432573+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.432573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:42.589039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'140","reported_seq":688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.862755+0000","last_change":"2024-09-12T19:30:21.862755+0000","last_active":"2024-09-12T19:30:21.862755+0000","last_peered":"2024-09-12T19:30:21.862755+0000","last_clean":"2024-09-12T19:30:21.862755+0000","last_became_active":"2024-09-12T17:36:44.959109+0000","last_became_peered":"2024-09-12T17:36:44.959109+0000","last_unstale":"2024-09-12T19:30:21.862755+0000","last_undegraded":"2024-09-12T19:30:21.862755+0000","last_fullsized":"2024-09-12T19:30:21.862755+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T19:30:21.862544+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T19:30:21.862544+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.862544+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:06.313478+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'606","reported_seq":2154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.417555+0000","last_change":"2024-09-12T19:29:56.417555+0000","last_active":"2024-09-12T19:29:56.417555+0000","last_peered":"2024-09-12T19:29:56.417555+0000","last_clean":"2024-09-12T19:29:56.417555+0000","last_became_active":"2024-09-12T17:36:36.883397+0000","last_became_peered":"2024-09-12T17:36:36.883397+0000","last_unstale":"2024-09-12T19:29:56.417555+0000","last_undegraded":"2024-09-12T19:29:56.417555+0000","last_fullsized":"2024-09-12T19:29:56.417555+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'606","last_scrub_stamp":"2024-09-12T19:29:56.417345+0000","last_deep_scrub":"265'606","last_deep_scrub_stamp":"2024-09-12T19:29:56.417345+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.417345+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:40.538277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3050,"num_read_kb":2738,"num_write":793,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'373","reported_seq":1105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.305851+0000","last_change":"2024-09-12T19:29:50.305851+0000","last_active":"2024-09-12T19:29:50.305851+0000","last_peered":"2024-09-12T19:29:50.305851+0000","last_clean":"2024-09-12T19:29:50.305851+0000","last_became_active":"2024-09-12T17:36:34.892255+0000","last_became_peered":"2024-09-12T17:36:34.892255+0000","last_unstale":"2024-09-12T19:29:50.305851+0000","last_undegraded":"2024-09-12T19:29:50.305851+0000","last_fullsized":"2024-09-12T19:29:50.305851+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:29:50.305656+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:29:50.305656+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.305656+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:22.178790+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400040,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":627,"num_read_kb":68904,"num_write":1058,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.074460+0000","last_change":"2024-09-12T19:29:52.074460+0000","last_active":"2024-09-12T19:29:52.074460+0000","last_peered":"2024-09-12T19:29:52.074460+0000","last_clean":"2024-09-12T19:29:52.074460+0000","last_became_active":"2024-09-12T17:36:21.783069+0000","last_became_peered":"2024-09-12T17:36:21.783069+0000","last_unstale":"2024-09-12T19:29:52.074460+0000","last_undegraded":"2024-09-12T19:29:52.074460+0000","last_fullsized":"2024-09-12T19:29:52.074460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:52.074270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:52.074270+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.074270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:39.027678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001135285,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.463533+0000","last_change":"2024-09-12T19:30:04.463533+0000","last_active":"2024-09-12T19:30:04.463533+0000","last_peered":"2024-09-12T19:30:04.463533+0000","last_clean":"2024-09-12T19:30:04.463533+0000","last_became_active":"2024-09-12T17:36:38.900433+0000","last_became_peered":"2024-09-12T17:36:38.900433+0000","last_unstale":"2024-09-12T19:30:04.463533+0000","last_undegraded":"2024-09-12T19:30:04.463533+0000","last_fullsized":"2024-09-12T19:30:04.463533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.463348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.463348+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.463348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:22.114565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'254","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.539472+0000","last_change":"2024-09-12T19:30:07.539472+0000","last_active":"2024-09-12T19:30:07.539472+0000","last_peered":"2024-09-12T19:30:07.539472+0000","last_clean":"2024-09-12T19:30:07.539472+0000","last_became_active":"2024-09-12T17:36:40.886345+0000","last_became_peered":"2024-09-12T17:36:40.886345+0000","last_unstale":"2024-09-12T19:30:07.539472+0000","last_undegraded":"2024-09-12T19:30:07.539472+0000","last_fullsized":"2024-09-12T19:30:07.539472+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-12T19:30:07.539275+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-12T19:30:07.539275+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.539275+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:20.151842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'805","reported_seq":3509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.776206+0000","last_change":"2024-09-12T19:30:11.776206+0000","last_active":"2024-09-12T19:30:11.776206+0000","last_peered":"2024-09-12T19:30:11.776206+0000","last_clean":"2024-09-12T19:30:11.776206+0000","last_became_active":"2024-09-12T17:36:42.931598+0000","last_became_peered":"2024-09-12T17:36:42.931598+0000","last_unstale":"2024-09-12T19:30:11.776206+0000","last_undegraded":"2024-09-12T19:30:11.776206+0000","last_fullsized":"2024-09-12T19:30:11.776206+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'805","last_scrub_stamp":"2024-09-12T19:30:11.776004+0000","last_deep_scrub":"265'805","last_deep_scrub_stamp":"2024-09-12T19:30:11.776004+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.776004+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:37.485165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'140","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.127004+0000","last_change":"2024-09-12T19:30:17.127004+0000","last_active":"2024-09-12T19:30:17.127004+0000","last_peered":"2024-09-12T19:30:17.127004+0000","last_clean":"2024-09-12T19:30:17.127004+0000","last_became_active":"2024-09-12T17:36:44.951849+0000","last_became_peered":"2024-09-12T17:36:44.951849+0000","last_unstale":"2024-09-12T19:30:17.127004+0000","last_undegraded":"2024-09-12T19:30:17.127004+0000","last_fullsized":"2024-09-12T19:30:17.127004+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T19:30:17.126798+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T19:30:17.126798+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.126798+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:37.952052+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'744","reported_seq":2385,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.897523+0000","last_change":"2024-09-12T19:29:57.897523+0000","last_active":"2024-09-12T19:29:57.897523+0000","last_peered":"2024-09-12T19:29:57.897523+0000","last_clean":"2024-09-12T19:29:57.897523+0000","last_became_active":"2024-09-12T17:36:36.892861+0000","last_became_peered":"2024-09-12T17:36:36.892861+0000","last_unstale":"2024-09-12T19:29:57.897523+0000","last_undegraded":"2024-09-12T19:29:57.897523+0000","last_fullsized":"2024-09-12T19:29:57.897523+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'744","last_scrub_stamp":"2024-09-12T19:29:57.897218+0000","last_deep_scrub":"265'744","last_deep_scrub_stamp":"2024-09-12T19:29:57.897218+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.897218+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:49.749434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3560,"num_read_kb":3257,"num_write":956,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'351","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.000072+0000","last_change":"2024-09-12T19:29:53.000072+0000","last_active":"2024-09-12T19:29:53.000072+0000","last_peered":"2024-09-12T19:29:53.000072+0000","last_clean":"2024-09-12T19:29:53.000072+0000","last_became_active":"2024-09-12T17:36:34.883331+0000","last_became_peered":"2024-09-12T17:36:34.883331+0000","last_unstale":"2024-09-12T19:29:53.000072+0000","last_undegraded":"2024-09-12T19:29:53.000072+0000","last_fullsized":"2024-09-12T19:29:53.000072+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-12T19:29:52.999859+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-12T19:29:52.999859+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.999859+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:19.508145+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":26132,"num_write":1177,"num_write_kb":40752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.922514+0000","last_change":"2024-09-12T19:29:48.922514+0000","last_active":"2024-09-12T19:29:48.922514+0000","last_peered":"2024-09-12T19:29:48.922514+0000","last_clean":"2024-09-12T19:29:48.922514+0000","last_became_active":"2024-09-12T17:36:22.059379+0000","last_became_peered":"2024-09-12T17:36:22.059379+0000","last_unstale":"2024-09-12T19:29:48.922514+0000","last_undegraded":"2024-09-12T19:29:48.922514+0000","last_fullsized":"2024-09-12T19:29:48.922514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:48.922319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:48.922319+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.922319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:36.603470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012087210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.245644+0000","last_change":"2024-09-12T19:30:15.245644+0000","last_active":"2024-09-12T19:30:15.245644+0000","last_peered":"2024-09-12T19:30:15.245644+0000","last_clean":"2024-09-12T19:30:15.245644+0000","last_became_active":"2024-09-12T17:36:38.891807+0000","last_became_peered":"2024-09-12T17:36:38.891807+0000","last_unstale":"2024-09-12T19:30:15.245644+0000","last_undegraded":"2024-09-12T19:30:15.245644+0000","last_fullsized":"2024-09-12T19:30:15.245644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:15.245464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:15.245464+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.245464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:53.751956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'179","reported_seq":786,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.181626+0000","last_change":"2024-09-12T19:30:20.181626+0000","last_active":"2024-09-12T19:30:20.181626+0000","last_peered":"2024-09-12T19:30:20.181626+0000","last_clean":"2024-09-12T19:30:20.181626+0000","last_became_active":"2024-09-12T17:36:40.897763+0000","last_became_peered":"2024-09-12T17:36:40.897763+0000","last_unstale":"2024-09-12T19:30:20.181626+0000","last_undegraded":"2024-09-12T19:30:20.181626+0000","last_fullsized":"2024-09-12T19:30:20.181626+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'179","last_scrub_stamp":"2024-09-12T19:30:20.181421+0000","last_deep_scrub":"265'179","last_deep_scrub_stamp":"2024-09-12T19:30:20.181421+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.181421+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:55.791206+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'802","reported_seq":3157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.827708+0000","last_change":"2024-09-12T19:30:13.827708+0000","last_active":"2024-09-12T19:30:13.827708+0000","last_peered":"2024-09-12T19:30:13.827708+0000","last_clean":"2024-09-12T19:30:13.827708+0000","last_became_active":"2024-09-12T17:36:42.928978+0000","last_became_peered":"2024-09-12T17:36:42.928978+0000","last_unstale":"2024-09-12T19:30:13.827708+0000","last_undegraded":"2024-09-12T19:30:13.827708+0000","last_fullsized":"2024-09-12T19:30:13.827708+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'802","last_scrub_stamp":"2024-09-12T19:30:13.827491+0000","last_deep_scrub":"265'802","last_deep_scrub_stamp":"2024-09-12T19:30:13.827491+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.827491+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:15.050072+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'235","reported_seq":781,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:02.583893+0000","last_change":"2024-09-12T17:36:44.960384+0000","last_active":"2024-09-12T19:28:02.583893+0000","last_peered":"2024-09-12T19:28:02.583893+0000","last_clean":"2024-09-12T19:28:02.583893+0000","last_became_active":"2024-09-12T17:36:44.956784+0000","last_became_peered":"2024-09-12T17:36:44.956784+0000","last_unstale":"2024-09-12T19:28:02.583893+0000","last_undegraded":"2024-09-12T19:28:02.583893+0000","last_fullsized":"2024-09-12T19:28:02.583893+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:30.401098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":233,"num_read_kb":216,"num_write":428,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'374","reported_seq":2048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.351332+0000","last_change":"2024-09-12T19:29:53.351332+0000","last_active":"2024-09-12T19:29:53.351332+0000","last_peered":"2024-09-12T19:29:53.351332+0000","last_clean":"2024-09-12T19:29:53.351332+0000","last_became_active":"2024-09-12T17:36:36.883862+0000","last_became_peered":"2024-09-12T17:36:36.883862+0000","last_unstale":"2024-09-12T19:29:53.351332+0000","last_undegraded":"2024-09-12T19:29:53.351332+0000","last_fullsized":"2024-09-12T19:29:53.351332+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T19:29:53.351161+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T19:29:53.351161+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.351161+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:18.340873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2422,"num_read_kb":2340,"num_write":416,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'355","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.004315+0000","last_change":"2024-09-12T19:29:51.004315+0000","last_active":"2024-09-12T19:29:51.004315+0000","last_peered":"2024-09-12T19:29:51.004315+0000","last_clean":"2024-09-12T19:29:51.004315+0000","last_became_active":"2024-09-12T17:36:34.868641+0000","last_became_peered":"2024-09-12T17:36:34.868641+0000","last_unstale":"2024-09-12T19:29:51.004315+0000","last_undegraded":"2024-09-12T19:29:51.004315+0000","last_fullsized":"2024-09-12T19:29:51.004315+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T19:29:51.004074+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T19:29:51.004074+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.004074+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:19.751431+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1398988,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":547,"num_read_kb":35743,"num_write":1181,"num_write_kb":32710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":556,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.075936+0000","last_change":"2024-09-12T19:29:50.075936+0000","last_active":"2024-09-12T19:29:50.075936+0000","last_peered":"2024-09-12T19:29:50.075936+0000","last_clean":"2024-09-12T19:29:50.075936+0000","last_became_active":"2024-09-12T17:36:22.058794+0000","last_became_peered":"2024-09-12T17:36:22.058794+0000","last_unstale":"2024-09-12T19:29:50.075936+0000","last_undegraded":"2024-09-12T19:29:50.075936+0000","last_fullsized":"2024-09-12T19:29:50.075936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:50.075752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:50.075752+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.075752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:54.554291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":544,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.900228+0000","last_change":"2024-09-12T19:30:04.900228+0000","last_active":"2024-09-12T19:30:04.900228+0000","last_peered":"2024-09-12T19:30:04.900228+0000","last_clean":"2024-09-12T19:30:04.900228+0000","last_became_active":"2024-09-12T17:36:38.901418+0000","last_became_peered":"2024-09-12T17:36:38.901418+0000","last_unstale":"2024-09-12T19:30:04.900228+0000","last_undegraded":"2024-09-12T19:30:04.900228+0000","last_fullsized":"2024-09-12T19:30:04.900228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.900053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.900053+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.900053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:11.827647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'816","reported_seq":1613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.433089+0000","last_change":"2024-09-12T19:30:03.433089+0000","last_active":"2024-09-12T19:30:03.433089+0000","last_peered":"2024-09-12T19:30:03.433089+0000","last_clean":"2024-09-12T19:30:03.433089+0000","last_became_active":"2024-09-12T17:36:40.908231+0000","last_became_peered":"2024-09-12T17:36:40.908231+0000","last_unstale":"2024-09-12T19:30:03.433089+0000","last_undegraded":"2024-09-12T19:30:03.433089+0000","last_fullsized":"2024-09-12T19:30:03.433089+0000","mapping_epoch":30,"log_start":"265'800","ondisk_log_start":"265'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'816","last_scrub_stamp":"2024-09-12T19:30:03.432954+0000","last_deep_scrub":"265'816","last_deep_scrub_stamp":"2024-09-12T19:30:03.432954+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.432954+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:15.981426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146317,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3243,"num_write":1152,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.036553+0000","last_change":"2024-09-12T19:30:19.036553+0000","last_active":"2024-09-12T19:30:19.036553+0000","last_peered":"2024-09-12T19:30:19.036553+0000","last_clean":"2024-09-12T19:30:19.036553+0000","last_became_active":"2024-09-12T17:36:42.932086+0000","last_became_peered":"2024-09-12T17:36:42.932086+0000","last_unstale":"2024-09-12T19:30:19.036553+0000","last_undegraded":"2024-09-12T19:30:19.036553+0000","last_fullsized":"2024-09-12T19:30:19.036553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:19.036334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:19.036334+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.036334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:52.784984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'128","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.459855+0000","last_change":"2024-09-12T19:30:17.459855+0000","last_active":"2024-09-12T19:30:17.459855+0000","last_peered":"2024-09-12T19:30:17.459855+0000","last_clean":"2024-09-12T19:30:17.459855+0000","last_became_active":"2024-09-12T17:36:44.960744+0000","last_became_peered":"2024-09-12T17:36:44.960744+0000","last_unstale":"2024-09-12T19:30:17.459855+0000","last_undegraded":"2024-09-12T19:30:17.459855+0000","last_fullsized":"2024-09-12T19:30:17.459855+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T19:30:17.459640+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T19:30:17.459640+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.459640+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:43.927040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":186,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'136","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.019914+0000","last_change":"2024-09-12T19:30:25.019914+0000","last_active":"2024-09-12T19:30:25.019914+0000","last_peered":"2024-09-12T19:30:25.019914+0000","last_clean":"2024-09-12T19:30:25.019914+0000","last_became_active":"2024-09-12T17:36:44.939820+0000","last_became_peered":"2024-09-12T17:36:44.939820+0000","last_unstale":"2024-09-12T19:30:25.019914+0000","last_undegraded":"2024-09-12T19:30:25.019914+0000","last_fullsized":"2024-09-12T19:30:25.019914+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T19:30:25.019723+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T19:30:25.019723+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.019723+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:30.905979+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":235,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'802","reported_seq":2469,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.382818+0000","last_change":"2024-09-12T19:29:58.382818+0000","last_active":"2024-09-12T19:29:58.382818+0000","last_peered":"2024-09-12T19:29:58.382818+0000","last_clean":"2024-09-12T19:29:58.382818+0000","last_became_active":"2024-09-12T17:36:36.883481+0000","last_became_peered":"2024-09-12T17:36:36.883481+0000","last_unstale":"2024-09-12T19:29:58.382818+0000","last_undegraded":"2024-09-12T19:29:58.382818+0000","last_fullsized":"2024-09-12T19:29:58.382818+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'802","last_scrub_stamp":"2024-09-12T19:29:58.382629+0000","last_deep_scrub":"265'802","last_deep_scrub_stamp":"2024-09-12T19:29:58.382629+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.382629+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:14.006063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3831,"num_read_kb":3485,"num_write":1040,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'319","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.227016+0000","last_change":"2024-09-12T19:29:58.227016+0000","last_active":"2024-09-12T19:29:58.227016+0000","last_peered":"2024-09-12T19:29:58.227016+0000","last_clean":"2024-09-12T19:29:58.227016+0000","last_became_active":"2024-09-12T17:36:34.861702+0000","last_became_peered":"2024-09-12T17:36:34.861702+0000","last_unstale":"2024-09-12T19:29:58.227016+0000","last_undegraded":"2024-09-12T19:29:58.227016+0000","last_fullsized":"2024-09-12T19:29:58.227016+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T19:29:58.226750+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T19:29:58.226750+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.226750+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:18.778525+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273696,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":464,"num_read_kb":26224,"num_write":1045,"num_write_kb":25793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.536076+0000","last_change":"2024-09-12T19:30:05.536076+0000","last_active":"2024-09-12T19:30:05.536076+0000","last_peered":"2024-09-12T19:30:05.536076+0000","last_clean":"2024-09-12T19:30:05.536076+0000","last_became_active":"2024-09-12T17:36:38.894742+0000","last_became_peered":"2024-09-12T17:36:38.894742+0000","last_unstale":"2024-09-12T19:30:05.536076+0000","last_undegraded":"2024-09-12T19:30:05.536076+0000","last_fullsized":"2024-09-12T19:30:05.536076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:05.535904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:05.535904+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.535904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:41.432968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'332","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.532627+0000","last_change":"2024-09-12T19:30:08.532627+0000","last_active":"2024-09-12T19:30:08.532627+0000","last_peered":"2024-09-12T19:30:08.532627+0000","last_clean":"2024-09-12T19:30:08.532627+0000","last_became_active":"2024-09-12T17:36:40.892710+0000","last_became_peered":"2024-09-12T17:36:40.892710+0000","last_unstale":"2024-09-12T19:30:08.532627+0000","last_undegraded":"2024-09-12T19:30:08.532627+0000","last_fullsized":"2024-09-12T19:30:08.532627+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T19:30:08.532361+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T19:30:08.532361+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.532361+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:49.724335+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49819,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":1091,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.235756+0000","last_change":"2024-09-12T19:30:10.235756+0000","last_active":"2024-09-12T19:30:10.235756+0000","last_peered":"2024-09-12T19:30:10.235756+0000","last_clean":"2024-09-12T19:30:10.235756+0000","last_became_active":"2024-09-12T17:36:42.938834+0000","last_became_peered":"2024-09-12T17:36:42.938834+0000","last_unstale":"2024-09-12T19:30:10.235756+0000","last_undegraded":"2024-09-12T19:30:10.235756+0000","last_fullsized":"2024-09-12T19:30:10.235756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:10.235565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:10.235565+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.235565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:24.663063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'141","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.174915+0000","last_change":"2024-09-12T19:30:15.174915+0000","last_active":"2024-09-12T19:30:15.174915+0000","last_peered":"2024-09-12T19:30:15.174915+0000","last_clean":"2024-09-12T19:30:15.174915+0000","last_became_active":"2024-09-12T17:36:44.953117+0000","last_became_peered":"2024-09-12T17:36:44.953117+0000","last_unstale":"2024-09-12T19:30:15.174915+0000","last_undegraded":"2024-09-12T19:30:15.174915+0000","last_fullsized":"2024-09-12T19:30:15.174915+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'141","last_scrub_stamp":"2024-09-12T19:30:15.174732+0000","last_deep_scrub":"265'141","last_deep_scrub_stamp":"2024-09-12T19:30:15.174732+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.174732+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:21.174795+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":202,"num_write":357,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'472","reported_seq":2085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.921083+0000","last_change":"2024-09-12T19:29:56.921083+0000","last_active":"2024-09-12T19:29:56.921083+0000","last_peered":"2024-09-12T19:29:56.921083+0000","last_clean":"2024-09-12T19:29:56.921083+0000","last_became_active":"2024-09-12T17:36:36.900955+0000","last_became_peered":"2024-09-12T17:36:36.900955+0000","last_unstale":"2024-09-12T19:29:56.921083+0000","last_undegraded":"2024-09-12T19:29:56.921083+0000","last_fullsized":"2024-09-12T19:29:56.921083+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'472","last_scrub_stamp":"2024-09-12T19:29:56.920906+0000","last_deep_scrub":"265'472","last_deep_scrub_stamp":"2024-09-12T19:29:56.920906+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.920906+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:13.700998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2490,"num_read_kb":2331,"num_write":571,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'352","reported_seq":1131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.412441+0000","last_change":"2024-09-12T19:29:51.412206+0000","last_active":"2024-09-12T19:29:51.412441+0000","last_peered":"2024-09-12T19:29:51.412441+0000","last_clean":"2024-09-12T19:29:51.412441+0000","last_became_active":"2024-09-12T17:36:34.878069+0000","last_became_peered":"2024-09-12T17:36:34.878069+0000","last_unstale":"2024-09-12T19:29:51.412441+0000","last_undegraded":"2024-09-12T19:29:51.412441+0000","last_fullsized":"2024-09-12T19:29:51.412441+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:29:51.411936+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:29:51.411936+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.411936+0000","objects_scrubbed":11,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:28.683406+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097855,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":782,"num_read_kb":26278,"num_write":971,"num_write_kb":31119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.980372+0000","last_change":"2024-09-12T19:30:07.980372+0000","last_active":"2024-09-12T19:30:07.980372+0000","last_peered":"2024-09-12T19:30:07.980372+0000","last_clean":"2024-09-12T19:30:07.980372+0000","last_became_active":"2024-09-12T17:36:38.894800+0000","last_became_peered":"2024-09-12T17:36:38.894800+0000","last_unstale":"2024-09-12T19:30:07.980372+0000","last_undegraded":"2024-09-12T19:30:07.980372+0000","last_fullsized":"2024-09-12T19:30:07.980372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:07.980191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:07.980191+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.980191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:19.605106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'84","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.092824+0000","last_change":"2024-09-12T19:30:14.092824+0000","last_active":"2024-09-12T19:30:14.092824+0000","last_peered":"2024-09-12T19:30:14.092824+0000","last_clean":"2024-09-12T19:30:14.092824+0000","last_became_active":"2024-09-12T17:36:40.909470+0000","last_became_peered":"2024-09-12T17:36:40.909470+0000","last_unstale":"2024-09-12T19:30:14.092824+0000","last_undegraded":"2024-09-12T19:30:14.092824+0000","last_fullsized":"2024-09-12T19:30:14.092824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'84","last_scrub_stamp":"2024-09-12T19:30:14.092640+0000","last_deep_scrub":"265'84","last_deep_scrub_stamp":"2024-09-12T19:30:14.092640+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.092640+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:43.847026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.444242+0000","last_change":"2024-09-12T19:30:08.444242+0000","last_active":"2024-09-12T19:30:08.444242+0000","last_peered":"2024-09-12T19:30:08.444242+0000","last_clean":"2024-09-12T19:30:08.444242+0000","last_became_active":"2024-09-12T17:36:42.922352+0000","last_became_peered":"2024-09-12T17:36:42.922352+0000","last_unstale":"2024-09-12T19:30:08.444242+0000","last_undegraded":"2024-09-12T19:30:08.444242+0000","last_fullsized":"2024-09-12T19:30:08.444242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:08.444006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:08.444006+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.444006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:28.356175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'239","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.407464+0000","last_change":"2024-09-12T19:30:17.407464+0000","last_active":"2024-09-12T19:30:17.407464+0000","last_peered":"2024-09-12T19:30:17.407464+0000","last_clean":"2024-09-12T19:30:17.407464+0000","last_became_active":"2024-09-12T17:36:44.945429+0000","last_became_peered":"2024-09-12T17:36:44.945429+0000","last_unstale":"2024-09-12T19:30:17.407464+0000","last_undegraded":"2024-09-12T19:30:17.407464+0000","last_fullsized":"2024-09-12T19:30:17.407464+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-12T19:30:17.407256+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-12T19:30:17.407256+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.407256+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:50.565386+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":307,"num_read_kb":303,"num_write":509,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'828","reported_seq":2367,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.946318+0000","last_change":"2024-09-12T19:29:55.946318+0000","last_active":"2024-09-12T19:29:55.946318+0000","last_peered":"2024-09-12T19:29:55.946318+0000","last_clean":"2024-09-12T19:29:55.946318+0000","last_became_active":"2024-09-12T17:36:36.901053+0000","last_became_peered":"2024-09-12T17:36:36.901053+0000","last_unstale":"2024-09-12T19:29:55.946318+0000","last_undegraded":"2024-09-12T19:29:55.946318+0000","last_fullsized":"2024-09-12T19:29:55.946318+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'828","last_scrub_stamp":"2024-09-12T19:29:55.946101+0000","last_deep_scrub":"265'828","last_deep_scrub_stamp":"2024-09-12T19:29:55.946101+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.946101+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:53.712277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3878,"num_read_kb":3474,"num_write":1082,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'361","reported_seq":1044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.358167+0000","last_change":"2024-09-12T19:29:50.357889+0000","last_active":"2024-09-12T19:29:50.358167+0000","last_peered":"2024-09-12T19:29:50.358167+0000","last_clean":"2024-09-12T19:29:50.358167+0000","last_became_active":"2024-09-12T17:36:34.877620+0000","last_became_peered":"2024-09-12T17:36:34.877620+0000","last_unstale":"2024-09-12T19:29:50.358167+0000","last_undegraded":"2024-09-12T19:29:50.358167+0000","last_fullsized":"2024-09-12T19:29:50.358167+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:29:50.357552+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:29:50.357552+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.357552+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:17.243177+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048740,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":51733,"num_write":1081,"num_write_kb":38676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":538,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.416021+0000","last_change":"2024-09-12T19:30:02.416021+0000","last_active":"2024-09-12T19:30:02.416021+0000","last_peered":"2024-09-12T19:30:02.416021+0000","last_clean":"2024-09-12T19:30:02.416021+0000","last_became_active":"2024-09-12T17:36:38.902188+0000","last_became_peered":"2024-09-12T17:36:38.902188+0000","last_unstale":"2024-09-12T19:30:02.416021+0000","last_undegraded":"2024-09-12T19:30:02.416021+0000","last_fullsized":"2024-09-12T19:30:02.416021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:02.415808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:02.415808+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.415808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:35.156107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'381","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.185252+0000","last_change":"2024-09-12T19:30:06.185252+0000","last_active":"2024-09-12T19:30:06.185252+0000","last_peered":"2024-09-12T19:30:06.185252+0000","last_clean":"2024-09-12T19:30:06.185252+0000","last_became_active":"2024-09-12T17:36:40.899201+0000","last_became_peered":"2024-09-12T17:36:40.899201+0000","last_unstale":"2024-09-12T19:30:06.185252+0000","last_undegraded":"2024-09-12T19:30:06.185252+0000","last_fullsized":"2024-09-12T19:30:06.185252+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'381","last_scrub_stamp":"2024-09-12T19:30:06.185067+0000","last_deep_scrub":"265'381","last_deep_scrub_stamp":"2024-09-12T19:30:06.185067+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.185067+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:12.745822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51900,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":1290,"num_write":486,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.860673+0000","last_change":"2024-09-12T19:30:09.860673+0000","last_active":"2024-09-12T19:30:09.860673+0000","last_peered":"2024-09-12T19:30:09.860673+0000","last_clean":"2024-09-12T19:30:09.860673+0000","last_became_active":"2024-09-12T17:36:42.928596+0000","last_became_peered":"2024-09-12T17:36:42.928596+0000","last_unstale":"2024-09-12T19:30:09.860673+0000","last_undegraded":"2024-09-12T19:30:09.860673+0000","last_fullsized":"2024-09-12T19:30:09.860673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.860483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.860483+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.860483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:14.215226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'143","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360848+0000","last_change":"2024-09-12T17:36:44.963106+0000","last_active":"2024-09-12T19:26:45.360848+0000","last_peered":"2024-09-12T19:26:45.360848+0000","last_clean":"2024-09-12T19:26:45.360848+0000","last_became_active":"2024-09-12T17:36:44.962445+0000","last_became_peered":"2024-09-12T17:36:44.962445+0000","last_unstale":"2024-09-12T19:26:45.360848+0000","last_undegraded":"2024-09-12T19:26:45.360848+0000","last_fullsized":"2024-09-12T19:26:45.360848+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:03.293578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":234,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'603","reported_seq":2256,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.115050+0000","last_change":"2024-09-12T19:29:56.115050+0000","last_active":"2024-09-12T19:29:56.115050+0000","last_peered":"2024-09-12T19:29:56.115050+0000","last_clean":"2024-09-12T19:29:56.115050+0000","last_became_active":"2024-09-12T17:36:36.903813+0000","last_became_peered":"2024-09-12T17:36:36.903813+0000","last_unstale":"2024-09-12T19:29:56.115050+0000","last_undegraded":"2024-09-12T19:29:56.115050+0000","last_fullsized":"2024-09-12T19:29:56.115050+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'603","last_scrub_stamp":"2024-09-12T19:29:56.114858+0000","last_deep_scrub":"265'603","last_deep_scrub_stamp":"2024-09-12T19:29:56.114858+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.114858+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:39.417617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3115,"num_read_kb":2836,"num_write":758,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'307","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.974498+0000","last_change":"2024-09-12T19:29:50.974381+0000","last_active":"2024-09-12T19:29:50.974498+0000","last_peered":"2024-09-12T19:29:50.974498+0000","last_clean":"2024-09-12T19:29:50.974498+0000","last_became_active":"2024-09-12T17:36:34.886741+0000","last_became_peered":"2024-09-12T17:36:34.886741+0000","last_unstale":"2024-09-12T19:29:50.974498+0000","last_undegraded":"2024-09-12T19:29:50.974498+0000","last_fullsized":"2024-09-12T19:29:50.974498+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'307","last_scrub_stamp":"2024-09-12T19:29:50.974228+0000","last_deep_scrub":"265'307","last_deep_scrub_stamp":"2024-09-12T19:29:50.974228+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.974228+0000","objects_scrubbed":13,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:10.453984+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1961495,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":454,"num_read_kb":24643,"num_write":1003,"num_write_kb":38417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.211733+0000","last_change":"2024-09-12T19:30:18.211733+0000","last_active":"2024-09-12T19:30:18.211733+0000","last_peered":"2024-09-12T19:30:18.211733+0000","last_clean":"2024-09-12T19:30:18.211733+0000","last_became_active":"2024-09-12T17:36:38.903210+0000","last_became_peered":"2024-09-12T17:36:38.903210+0000","last_unstale":"2024-09-12T19:30:18.211733+0000","last_undegraded":"2024-09-12T19:30:18.211733+0000","last_fullsized":"2024-09-12T19:30:18.211733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:18.211558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:18.211558+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.211558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:05.683729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'312","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.496664+0000","last_change":"2024-09-12T19:30:14.496664+0000","last_active":"2024-09-12T19:30:14.496664+0000","last_peered":"2024-09-12T19:30:14.496664+0000","last_clean":"2024-09-12T19:30:14.496664+0000","last_became_active":"2024-09-12T17:36:40.912283+0000","last_became_peered":"2024-09-12T17:36:40.912283+0000","last_unstale":"2024-09-12T19:30:14.496664+0000","last_undegraded":"2024-09-12T19:30:14.496664+0000","last_fullsized":"2024-09-12T19:30:14.496664+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T19:30:14.496480+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T19:30:14.496480+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.496480+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:49.759859+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1100,"num_write":404,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.212929+0000","last_change":"2024-09-12T19:30:11.212929+0000","last_active":"2024-09-12T19:30:11.212929+0000","last_peered":"2024-09-12T19:30:11.212929+0000","last_clean":"2024-09-12T19:30:11.212929+0000","last_became_active":"2024-09-12T17:36:42.927724+0000","last_became_peered":"2024-09-12T17:36:42.927724+0000","last_unstale":"2024-09-12T19:30:11.212929+0000","last_undegraded":"2024-09-12T19:30:11.212929+0000","last_fullsized":"2024-09-12T19:30:11.212929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:11.212728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:11.212728+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.212728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:09.091627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'722","reported_seq":2257,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.151555+0000","last_change":"2024-09-12T19:30:09.151555+0000","last_active":"2024-09-12T19:30:09.151555+0000","last_peered":"2024-09-12T19:30:09.151555+0000","last_clean":"2024-09-12T19:30:09.151555+0000","last_became_active":"2024-09-12T17:36:36.885820+0000","last_became_peered":"2024-09-12T17:36:36.885820+0000","last_unstale":"2024-09-12T19:30:09.151555+0000","last_undegraded":"2024-09-12T19:30:09.151555+0000","last_fullsized":"2024-09-12T19:30:09.151555+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'722","last_scrub_stamp":"2024-09-12T19:30:09.151370+0000","last_deep_scrub":"265'722","last_deep_scrub_stamp":"2024-09-12T19:30:09.151370+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.151370+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:56.519425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3501,"num_read_kb":3197,"num_write":936,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'342","reported_seq":1027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.955549+0000","last_change":"2024-09-12T19:29:51.955269+0000","last_active":"2024-09-12T19:29:51.955549+0000","last_peered":"2024-09-12T19:29:51.955549+0000","last_clean":"2024-09-12T19:29:51.955549+0000","last_became_active":"2024-09-12T17:36:34.887018+0000","last_became_peered":"2024-09-12T17:36:34.887018+0000","last_unstale":"2024-09-12T19:29:51.955549+0000","last_undegraded":"2024-09-12T19:29:51.955549+0000","last_fullsized":"2024-09-12T19:29:51.955549+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:51.955017+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:51.955017+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.955017+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:13.242565+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":38393,"num_write":1072,"num_write_kb":34235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.520319+0000","last_change":"2024-09-12T19:30:06.520319+0000","last_active":"2024-09-12T19:30:06.520319+0000","last_peered":"2024-09-12T19:30:06.520319+0000","last_clean":"2024-09-12T19:30:06.520319+0000","last_became_active":"2024-09-12T17:36:38.894452+0000","last_became_peered":"2024-09-12T17:36:38.894452+0000","last_unstale":"2024-09-12T19:30:06.520319+0000","last_undegraded":"2024-09-12T19:30:06.520319+0000","last_fullsized":"2024-09-12T19:30:06.520319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:06.520134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:06.520134+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.520134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:45.097198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'519","reported_seq":1200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.437202+0000","last_change":"2024-09-12T19:30:11.437202+0000","last_active":"2024-09-12T19:30:11.437202+0000","last_peered":"2024-09-12T19:30:11.437202+0000","last_clean":"2024-09-12T19:30:11.437202+0000","last_became_active":"2024-09-12T17:36:40.909552+0000","last_became_peered":"2024-09-12T17:36:40.909552+0000","last_unstale":"2024-09-12T19:30:11.437202+0000","last_undegraded":"2024-09-12T19:30:11.437202+0000","last_fullsized":"2024-09-12T19:30:11.437202+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'519","last_scrub_stamp":"2024-09-12T19:30:11.437001+0000","last_deep_scrub":"265'519","last_deep_scrub_stamp":"2024-09-12T19:30:11.437001+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.437001+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:21.401609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105771,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":904,"num_read_kb":2059,"num_write":766,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.411302+0000","last_change":"2024-09-12T19:30:11.411302+0000","last_active":"2024-09-12T19:30:11.411302+0000","last_peered":"2024-09-12T19:30:11.411302+0000","last_clean":"2024-09-12T19:30:11.411302+0000","last_became_active":"2024-09-12T17:36:42.942627+0000","last_became_peered":"2024-09-12T17:36:42.942627+0000","last_unstale":"2024-09-12T19:30:11.411302+0000","last_undegraded":"2024-09-12T19:30:11.411302+0000","last_fullsized":"2024-09-12T19:30:11.411302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:11.411122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:11.411122+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.411122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:16.566570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'171","reported_seq":708,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.863127+0000","last_change":"2024-09-12T19:30:23.863127+0000","last_active":"2024-09-12T19:30:23.863127+0000","last_peered":"2024-09-12T19:30:23.863127+0000","last_clean":"2024-09-12T19:30:23.863127+0000","last_became_active":"2024-09-12T17:36:44.956655+0000","last_became_peered":"2024-09-12T17:36:44.956655+0000","last_unstale":"2024-09-12T19:30:23.863127+0000","last_undegraded":"2024-09-12T19:30:23.863127+0000","last_fullsized":"2024-09-12T19:30:23.863127+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'171","last_scrub_stamp":"2024-09-12T19:30:23.862897+0000","last_deep_scrub":"265'171","last_deep_scrub_stamp":"2024-09-12T19:30:23.862897+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.862897+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:40.667263+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":241,"num_write":385,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'358","reported_seq":1947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.903872+0000","last_change":"2024-09-12T19:30:00.903872+0000","last_active":"2024-09-12T19:30:00.903872+0000","last_peered":"2024-09-12T19:30:00.903872+0000","last_clean":"2024-09-12T19:30:00.903872+0000","last_became_active":"2024-09-12T17:36:36.911889+0000","last_became_peered":"2024-09-12T17:36:36.911889+0000","last_unstale":"2024-09-12T19:30:00.903872+0000","last_undegraded":"2024-09-12T19:30:00.903872+0000","last_fullsized":"2024-09-12T19:30:00.903872+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T19:30:00.903644+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T19:30:00.903644+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.903644+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:48.670244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2021,"num_read_kb":1969,"num_write":390,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'360","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.982295+0000","last_change":"2024-09-12T19:29:53.982295+0000","last_active":"2024-09-12T19:29:53.982295+0000","last_peered":"2024-09-12T19:29:53.982295+0000","last_clean":"2024-09-12T19:29:53.982295+0000","last_became_active":"2024-09-12T17:36:34.851161+0000","last_became_peered":"2024-09-12T17:36:34.851161+0000","last_unstale":"2024-09-12T19:29:53.982295+0000","last_undegraded":"2024-09-12T19:29:53.982295+0000","last_fullsized":"2024-09-12T19:29:53.982295+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T19:29:53.982102+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T19:29:53.982102+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.982102+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:47.944166+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273705,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":731,"num_read_kb":47360,"num_write":1100,"num_write_kb":33375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":544,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.398459+0000","last_change":"2024-09-12T19:30:09.398459+0000","last_active":"2024-09-12T19:30:09.398459+0000","last_peered":"2024-09-12T19:30:09.398459+0000","last_clean":"2024-09-12T19:30:09.398459+0000","last_became_active":"2024-09-12T17:36:38.904409+0000","last_became_peered":"2024-09-12T17:36:38.904409+0000","last_unstale":"2024-09-12T19:30:09.398459+0000","last_undegraded":"2024-09-12T19:30:09.398459+0000","last_fullsized":"2024-09-12T19:30:09.398459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.398271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.398271+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.398271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:53.976519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'404","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.767941+0000","last_change":"2024-09-12T17:36:40.903223+0000","last_active":"2024-09-12T19:29:41.767941+0000","last_peered":"2024-09-12T19:29:41.767941+0000","last_clean":"2024-09-12T19:29:41.767941+0000","last_became_active":"2024-09-12T17:36:40.902718+0000","last_became_peered":"2024-09-12T17:36:40.902718+0000","last_unstale":"2024-09-12T19:29:41.767941+0000","last_undegraded":"2024-09-12T19:29:41.767941+0000","last_fullsized":"2024-09-12T19:29:41.767941+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:39.865714+0000","last_clean_scrub_stamp":"2024-09-12T17:36:39.865714+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.363639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54769,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":679,"num_read_kb":1358,"num_write":564,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.866861+0000","last_change":"2024-09-12T19:30:17.866861+0000","last_active":"2024-09-12T19:30:17.866861+0000","last_peered":"2024-09-12T19:30:17.866861+0000","last_clean":"2024-09-12T19:30:17.866861+0000","last_became_active":"2024-09-12T17:36:42.920352+0000","last_became_peered":"2024-09-12T17:36:42.920352+0000","last_unstale":"2024-09-12T19:30:17.866861+0000","last_undegraded":"2024-09-12T19:30:17.866861+0000","last_fullsized":"2024-09-12T19:30:17.866861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:17.866677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:17.866677+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.866677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:41.980247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'181","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:25.355355+0000","last_change":"2024-09-12T17:36:44.946661+0000","last_active":"2024-09-12T19:26:25.355355+0000","last_peered":"2024-09-12T19:26:25.355355+0000","last_clean":"2024-09-12T19:26:25.355355+0000","last_became_active":"2024-09-12T17:36:44.945753+0000","last_became_peered":"2024-09-12T17:36:44.945753+0000","last_unstale":"2024-09-12T19:26:25.355355+0000","last_undegraded":"2024-09-12T19:26:25.355355+0000","last_fullsized":"2024-09-12T19:26:25.355355+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:51.605529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":278,"num_read_kb":268,"num_write":526,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'525","reported_seq":2263,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.085497+0000","last_change":"2024-09-12T19:29:58.085497+0000","last_active":"2024-09-12T19:29:58.085497+0000","last_peered":"2024-09-12T19:29:58.085497+0000","last_clean":"2024-09-12T19:29:58.085497+0000","last_became_active":"2024-09-12T17:36:36.909488+0000","last_became_peered":"2024-09-12T17:36:36.909488+0000","last_unstale":"2024-09-12T19:29:58.085497+0000","last_undegraded":"2024-09-12T19:29:58.085497+0000","last_fullsized":"2024-09-12T19:29:58.085497+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'525","last_scrub_stamp":"2024-09-12T19:29:58.085322+0000","last_deep_scrub":"265'525","last_deep_scrub_stamp":"2024-09-12T19:29:58.085322+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.085322+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:33.573152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2968,"num_read_kb":2777,"num_write":639,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'391","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:46.957992+0000","last_change":"2024-09-12T19:29:46.957992+0000","last_active":"2024-09-12T19:29:46.957992+0000","last_peered":"2024-09-12T19:29:46.957992+0000","last_clean":"2024-09-12T19:29:46.957992+0000","last_became_active":"2024-09-12T17:36:34.857645+0000","last_became_peered":"2024-09-12T17:36:34.857645+0000","last_unstale":"2024-09-12T19:29:46.957992+0000","last_undegraded":"2024-09-12T19:29:46.957992+0000","last_fullsized":"2024-09-12T19:29:46.957992+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:29:46.957895+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:29:46.957895+0000","last_clean_scrub_stamp":"2024-09-12T19:29:46.957895+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:29.114514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287556,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":605,"num_read_kb":13478,"num_write":1299,"num_write_kb":33813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.381026+0000","last_change":"2024-09-12T19:30:04.381026+0000","last_active":"2024-09-12T19:30:04.381026+0000","last_peered":"2024-09-12T19:30:04.381026+0000","last_clean":"2024-09-12T19:30:04.381026+0000","last_became_active":"2024-09-12T17:36:38.904619+0000","last_became_peered":"2024-09-12T17:36:38.904619+0000","last_unstale":"2024-09-12T19:30:04.381026+0000","last_undegraded":"2024-09-12T19:30:04.381026+0000","last_fullsized":"2024-09-12T19:30:04.381026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.380854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.380854+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.380854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:16.162425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'321","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.471095+0000","last_change":"2024-09-12T19:30:12.471095+0000","last_active":"2024-09-12T19:30:12.471095+0000","last_peered":"2024-09-12T19:30:12.471095+0000","last_clean":"2024-09-12T19:30:12.471095+0000","last_became_active":"2024-09-12T17:36:40.909189+0000","last_became_peered":"2024-09-12T17:36:40.909189+0000","last_unstale":"2024-09-12T19:30:12.471095+0000","last_undegraded":"2024-09-12T19:30:12.471095+0000","last_fullsized":"2024-09-12T19:30:12.471095+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T19:30:12.470910+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T19:30:12.470910+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.470910+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:23.997786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":521,"num_read_kb":1073,"num_write":404,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.167636+0000","last_change":"2024-09-12T19:30:12.167636+0000","last_active":"2024-09-12T19:30:12.167636+0000","last_peered":"2024-09-12T19:30:12.167636+0000","last_clean":"2024-09-12T19:30:12.167636+0000","last_became_active":"2024-09-12T17:36:42.938451+0000","last_became_peered":"2024-09-12T17:36:42.938451+0000","last_unstale":"2024-09-12T19:30:12.167636+0000","last_undegraded":"2024-09-12T19:30:12.167636+0000","last_fullsized":"2024-09-12T19:30:12.167636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:12.167461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:12.167461+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.167461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:34.992368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'109","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:22.052785+0000","last_change":"2024-09-12T17:36:44.950080+0000","last_active":"2024-09-12T19:29:22.052785+0000","last_peered":"2024-09-12T19:29:22.052785+0000","last_clean":"2024-09-12T19:29:22.052785+0000","last_became_active":"2024-09-12T17:36:44.949351+0000","last_became_peered":"2024-09-12T17:36:44.949351+0000","last_unstale":"2024-09-12T19:29:22.052785+0000","last_undegraded":"2024-09-12T19:29:22.052785+0000","last_fullsized":"2024-09-12T19:29:22.052785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:39.166790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":161,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'477","reported_seq":2161,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.916554+0000","last_change":"2024-09-12T19:29:58.916554+0000","last_active":"2024-09-12T19:29:58.916554+0000","last_peered":"2024-09-12T19:29:58.916554+0000","last_clean":"2024-09-12T19:29:58.916554+0000","last_became_active":"2024-09-12T17:36:36.902998+0000","last_became_peered":"2024-09-12T17:36:36.902998+0000","last_unstale":"2024-09-12T19:29:58.916554+0000","last_undegraded":"2024-09-12T19:29:58.916554+0000","last_fullsized":"2024-09-12T19:29:58.916554+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'477","last_scrub_stamp":"2024-09-12T19:29:58.916239+0000","last_deep_scrub":"265'477","last_deep_scrub_stamp":"2024-09-12T19:29:58.916239+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.916239+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:11.138862+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2683,"num_read_kb":2531,"num_write":585,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2003,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'409","reported_seq":1145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.984339+0000","last_change":"2024-09-12T19:29:54.984339+0000","last_active":"2024-09-12T19:29:54.984339+0000","last_peered":"2024-09-12T19:29:54.984339+0000","last_clean":"2024-09-12T19:29:54.984339+0000","last_became_active":"2024-09-12T17:36:34.867987+0000","last_became_peered":"2024-09-12T17:36:34.867987+0000","last_unstale":"2024-09-12T19:29:54.984339+0000","last_undegraded":"2024-09-12T19:29:54.984339+0000","last_fullsized":"2024-09-12T19:29:54.984339+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T19:29:54.984140+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T19:29:54.984140+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.984140+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:32.375716+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062574,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":616,"num_read_kb":94353,"num_write":1270,"num_write_kb":45131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.064541+0000","last_change":"2024-09-12T19:30:15.064541+0000","last_active":"2024-09-12T19:30:15.064541+0000","last_peered":"2024-09-12T19:30:15.064541+0000","last_clean":"2024-09-12T19:30:15.064541+0000","last_became_active":"2024-09-12T17:36:38.900687+0000","last_became_peered":"2024-09-12T17:36:38.900687+0000","last_unstale":"2024-09-12T19:30:15.064541+0000","last_undegraded":"2024-09-12T19:30:15.064541+0000","last_fullsized":"2024-09-12T19:30:15.064541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:15.064365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:15.064365+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.064365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:33.955110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'164","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.180360+0000","last_change":"2024-09-12T19:30:24.180360+0000","last_active":"2024-09-12T19:30:24.180360+0000","last_peered":"2024-09-12T19:30:24.180360+0000","last_clean":"2024-09-12T19:30:24.180360+0000","last_became_active":"2024-09-12T17:36:40.904671+0000","last_became_peered":"2024-09-12T17:36:40.904671+0000","last_unstale":"2024-09-12T19:30:24.180360+0000","last_undegraded":"2024-09-12T19:30:24.180360+0000","last_fullsized":"2024-09-12T19:30:24.180360+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'164","last_scrub_stamp":"2024-09-12T19:30:24.180057+0000","last_deep_scrub":"265'164","last_deep_scrub_stamp":"2024-09-12T19:30:24.180057+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.180057+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:43.035312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":202,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'770","reported_seq":3485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.536601+0000","last_change":"2024-09-12T19:30:09.536601+0000","last_active":"2024-09-12T19:30:09.536601+0000","last_peered":"2024-09-12T19:30:09.536601+0000","last_clean":"2024-09-12T19:30:09.536601+0000","last_became_active":"2024-09-12T17:36:42.929232+0000","last_became_peered":"2024-09-12T17:36:42.929232+0000","last_unstale":"2024-09-12T19:30:09.536601+0000","last_undegraded":"2024-09-12T19:30:09.536601+0000","last_fullsized":"2024-09-12T19:30:09.536601+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'770","last_scrub_stamp":"2024-09-12T19:30:09.536408+0000","last_deep_scrub":"265'770","last_deep_scrub_stamp":"2024-09-12T19:30:09.536408+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.536408+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:48.491520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'132","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:59.338006+0000","last_change":"2024-09-12T17:36:44.946960+0000","last_active":"2024-09-12T19:26:59.338006+0000","last_peered":"2024-09-12T19:26:59.338006+0000","last_clean":"2024-09-12T19:26:59.338006+0000","last_became_active":"2024-09-12T17:36:44.945777+0000","last_became_peered":"2024-09-12T17:36:44.945777+0000","last_unstale":"2024-09-12T19:26:59.338006+0000","last_undegraded":"2024-09-12T19:26:59.338006+0000","last_fullsized":"2024-09-12T19:26:59.338006+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:22.225543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":212,"num_write":329,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'432","reported_seq":1993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.395163+0000","last_change":"2024-09-12T19:30:00.395163+0000","last_active":"2024-09-12T19:30:00.395163+0000","last_peered":"2024-09-12T19:30:00.395163+0000","last_clean":"2024-09-12T19:30:00.395163+0000","last_became_active":"2024-09-12T17:36:36.896871+0000","last_became_peered":"2024-09-12T17:36:36.896871+0000","last_unstale":"2024-09-12T19:30:00.395163+0000","last_undegraded":"2024-09-12T19:30:00.395163+0000","last_fullsized":"2024-09-12T19:30:00.395163+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'432","last_scrub_stamp":"2024-09-12T19:30:00.394970+0000","last_deep_scrub":"265'432","last_deep_scrub_stamp":"2024-09-12T19:30:00.394970+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.394970+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:25.462640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2316,"num_read_kb":2187,"num_write":500,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'403","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.911598+0000","last_change":"2024-09-12T19:29:50.911598+0000","last_active":"2024-09-12T19:29:50.911598+0000","last_peered":"2024-09-12T19:29:50.911598+0000","last_clean":"2024-09-12T19:29:50.911598+0000","last_became_active":"2024-09-12T17:36:34.868685+0000","last_became_peered":"2024-09-12T17:36:34.868685+0000","last_unstale":"2024-09-12T19:29:50.911598+0000","last_undegraded":"2024-09-12T19:29:50.911598+0000","last_fullsized":"2024-09-12T19:29:50.911598+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T19:29:50.911321+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T19:29:50.911321+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.911321+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:21:19.555113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":585,"num_read_kb":59989,"num_write":1252,"num_write_kb":34100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.878634+0000","last_change":"2024-09-12T19:30:04.878634+0000","last_active":"2024-09-12T19:30:04.878634+0000","last_peered":"2024-09-12T19:30:04.878634+0000","last_clean":"2024-09-12T19:30:04.878634+0000","last_became_active":"2024-09-12T17:36:38.885092+0000","last_became_peered":"2024-09-12T17:36:38.885092+0000","last_unstale":"2024-09-12T19:30:04.878634+0000","last_undegraded":"2024-09-12T19:30:04.878634+0000","last_fullsized":"2024-09-12T19:30:04.878634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.878450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.878450+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.878450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:40.745336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'417","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.443046+0000","last_change":"2024-09-12T19:30:05.443046+0000","last_active":"2024-09-12T19:30:05.443046+0000","last_peered":"2024-09-12T19:30:05.443046+0000","last_clean":"2024-09-12T19:30:05.443046+0000","last_became_active":"2024-09-12T17:36:40.902484+0000","last_became_peered":"2024-09-12T17:36:40.902484+0000","last_unstale":"2024-09-12T19:30:05.443046+0000","last_undegraded":"2024-09-12T19:30:05.443046+0000","last_fullsized":"2024-09-12T19:30:05.443046+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'417","last_scrub_stamp":"2024-09-12T19:30:05.442825+0000","last_deep_scrub":"265'417","last_deep_scrub_stamp":"2024-09-12T19:30:05.442825+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.442825+0000","objects_scrubbed":9,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:44.363304+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48470,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":642,"num_read_kb":1267,"num_write":506,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.999926+0000","last_change":"2024-09-12T19:30:20.999926+0000","last_active":"2024-09-12T19:30:20.999926+0000","last_peered":"2024-09-12T19:30:20.999926+0000","last_clean":"2024-09-12T19:30:20.999926+0000","last_became_active":"2024-09-12T17:36:42.932462+0000","last_became_peered":"2024-09-12T17:36:42.932462+0000","last_unstale":"2024-09-12T19:30:20.999926+0000","last_undegraded":"2024-09-12T19:30:20.999926+0000","last_fullsized":"2024-09-12T19:30:20.999926+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:20.999654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:20.999654+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.999654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:28.887032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'130","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.797651+0000","last_change":"2024-09-12T19:30:14.797485+0000","last_active":"2024-09-12T19:30:14.797651+0000","last_peered":"2024-09-12T19:30:14.797651+0000","last_clean":"2024-09-12T19:30:14.797651+0000","last_became_active":"2024-09-12T17:36:44.943948+0000","last_became_peered":"2024-09-12T17:36:44.943948+0000","last_unstale":"2024-09-12T19:30:14.797651+0000","last_undegraded":"2024-09-12T19:30:14.797651+0000","last_fullsized":"2024-09-12T19:30:14.797651+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T19:30:14.797299+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T19:30:14.797299+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.797299+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:46.063265+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":170,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'824","reported_seq":2527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.363162+0000","last_change":"2024-09-12T19:29:59.363162+0000","last_active":"2024-09-12T19:29:59.363162+0000","last_peered":"2024-09-12T19:29:59.363162+0000","last_clean":"2024-09-12T19:29:59.363162+0000","last_became_active":"2024-09-12T17:36:36.888747+0000","last_became_peered":"2024-09-12T17:36:36.888747+0000","last_unstale":"2024-09-12T19:29:59.363162+0000","last_undegraded":"2024-09-12T19:29:59.363162+0000","last_fullsized":"2024-09-12T19:29:59.363162+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'824","last_scrub_stamp":"2024-09-12T19:29:59.362904+0000","last_deep_scrub":"265'824","last_deep_scrub_stamp":"2024-09-12T19:29:59.362904+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.362904+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:35.395617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3583,"num_write":1069,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'489","reported_seq":1186,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.227514+0000","last_change":"2024-09-12T19:29:59.227514+0000","last_active":"2024-09-12T19:29:59.227514+0000","last_peered":"2024-09-12T19:29:59.227514+0000","last_clean":"2024-09-12T19:29:59.227514+0000","last_became_active":"2024-09-12T17:36:34.876487+0000","last_became_peered":"2024-09-12T17:36:34.876487+0000","last_unstale":"2024-09-12T19:29:59.227514+0000","last_undegraded":"2024-09-12T19:29:59.227514+0000","last_fullsized":"2024-09-12T19:29:59.227514+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'489","last_scrub_stamp":"2024-09-12T19:29:59.227288+0000","last_deep_scrub":"265'489","last_deep_scrub_stamp":"2024-09-12T19:29:59.227288+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.227288+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:02.444470+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":839,"num_read_kb":5903,"num_write":1394,"num_write_kb":31714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.374675+0000","last_change":"2024-09-12T19:30:03.374675+0000","last_active":"2024-09-12T19:30:03.374675+0000","last_peered":"2024-09-12T19:30:03.374675+0000","last_clean":"2024-09-12T19:30:03.374675+0000","last_became_active":"2024-09-12T17:36:38.901575+0000","last_became_peered":"2024-09-12T17:36:38.901575+0000","last_unstale":"2024-09-12T19:30:03.374675+0000","last_undegraded":"2024-09-12T19:30:03.374675+0000","last_fullsized":"2024-09-12T19:30:03.374675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:03.374500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:03.374500+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.374500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:13.146288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'330","reported_seq":959,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.086301+0000","last_change":"2024-09-12T19:30:18.086301+0000","last_active":"2024-09-12T19:30:18.086301+0000","last_peered":"2024-09-12T19:30:18.086301+0000","last_clean":"2024-09-12T19:30:18.086301+0000","last_became_active":"2024-09-12T17:36:40.900739+0000","last_became_peered":"2024-09-12T17:36:40.900739+0000","last_unstale":"2024-09-12T19:30:18.086301+0000","last_undegraded":"2024-09-12T19:30:18.086301+0000","last_fullsized":"2024-09-12T19:30:18.086301+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T19:30:18.086117+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T19:30:18.086117+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.086117+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:36.835105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":1258,"num_write":448,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.128013+0000","last_change":"2024-09-12T19:30:25.128013+0000","last_active":"2024-09-12T19:30:25.128013+0000","last_peered":"2024-09-12T19:30:25.128013+0000","last_clean":"2024-09-12T19:30:25.128013+0000","last_became_active":"2024-09-12T17:36:42.920767+0000","last_became_peered":"2024-09-12T17:36:42.920767+0000","last_unstale":"2024-09-12T19:30:25.128013+0000","last_undegraded":"2024-09-12T19:30:25.128013+0000","last_fullsized":"2024-09-12T19:30:25.128013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:25.127761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:25.127761+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.127761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:07.524400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'125","reported_seq":688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.814798+0000","last_change":"2024-09-12T19:30:24.814798+0000","last_active":"2024-09-12T19:30:24.814798+0000","last_peered":"2024-09-12T19:30:24.814798+0000","last_clean":"2024-09-12T19:30:24.814798+0000","last_became_active":"2024-09-12T17:36:44.959535+0000","last_became_peered":"2024-09-12T17:36:44.959535+0000","last_unstale":"2024-09-12T19:30:24.814798+0000","last_undegraded":"2024-09-12T19:30:24.814798+0000","last_fullsized":"2024-09-12T19:30:24.814798+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-12T19:30:24.814575+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-12T19:30:24.814575+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.814575+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:41.099809+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":231,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'447","reported_seq":1840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.076173+0000","last_change":"2024-09-12T19:29:57.076173+0000","last_active":"2024-09-12T19:29:57.076173+0000","last_peered":"2024-09-12T19:29:57.076173+0000","last_clean":"2024-09-12T19:29:57.076173+0000","last_became_active":"2024-09-12T17:36:36.895126+0000","last_became_peered":"2024-09-12T17:36:36.895126+0000","last_unstale":"2024-09-12T19:29:57.076173+0000","last_undegraded":"2024-09-12T19:29:57.076173+0000","last_fullsized":"2024-09-12T19:29:57.076173+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'447","last_scrub_stamp":"2024-09-12T19:29:57.075990+0000","last_deep_scrub":"265'447","last_deep_scrub_stamp":"2024-09-12T19:29:57.075990+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.075990+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:34.706291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2194,"num_read_kb":2018,"num_write":546,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'364","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.905415+0000","last_change":"2024-09-12T19:29:56.905415+0000","last_active":"2024-09-12T19:29:56.905415+0000","last_peered":"2024-09-12T19:29:56.905415+0000","last_clean":"2024-09-12T19:29:56.905415+0000","last_became_active":"2024-09-12T17:36:34.878381+0000","last_became_peered":"2024-09-12T17:36:34.878381+0000","last_unstale":"2024-09-12T19:29:56.905415+0000","last_undegraded":"2024-09-12T19:29:56.905415+0000","last_fullsized":"2024-09-12T19:29:56.905415+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T19:29:56.905139+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T19:29:56.905139+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.905139+0000","objects_scrubbed":8,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:09.937198+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":568,"num_read_kb":62029,"num_write":1071,"num_write_kb":23225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.906627+0000","last_change":"2024-09-12T19:30:03.906485+0000","last_active":"2024-09-12T19:30:03.906627+0000","last_peered":"2024-09-12T19:30:03.906627+0000","last_clean":"2024-09-12T19:30:03.906627+0000","last_became_active":"2024-09-12T17:36:38.887476+0000","last_became_peered":"2024-09-12T17:36:38.887476+0000","last_unstale":"2024-09-12T19:30:03.906627+0000","last_undegraded":"2024-09-12T19:30:03.906627+0000","last_fullsized":"2024-09-12T19:30:03.906627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:03.906304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:03.906304+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.906304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:42.519260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'247","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.473177+0000","last_change":"2024-09-12T19:30:10.473177+0000","last_active":"2024-09-12T19:30:10.473177+0000","last_peered":"2024-09-12T19:30:10.473177+0000","last_clean":"2024-09-12T19:30:10.473177+0000","last_became_active":"2024-09-12T17:36:40.904126+0000","last_became_peered":"2024-09-12T17:36:40.904126+0000","last_unstale":"2024-09-12T19:30:10.473177+0000","last_undegraded":"2024-09-12T19:30:10.473177+0000","last_fullsized":"2024-09-12T19:30:10.473177+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'247","last_scrub_stamp":"2024-09-12T19:30:10.472993+0000","last_deep_scrub":"265'247","last_deep_scrub_stamp":"2024-09-12T19:30:10.472993+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.472993+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:39.731251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52700,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":960,"num_write":326,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:45.360790+0000","last_change":"2024-09-12T17:36:42.935140+0000","last_active":"2024-09-12T19:26:45.360790+0000","last_peered":"2024-09-12T19:26:45.360790+0000","last_clean":"2024-09-12T19:26:45.360790+0000","last_became_active":"2024-09-12T17:36:42.934140+0000","last_became_peered":"2024-09-12T17:36:42.934140+0000","last_unstale":"2024-09-12T19:26:45.360790+0000","last_undegraded":"2024-09-12T19:26:45.360790+0000","last_fullsized":"2024-09-12T19:26:45.360790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:41.871929+0000","last_clean_scrub_stamp":"2024-09-12T17:36:41.871929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:50.636896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'159","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:55.377299+0000","last_change":"2024-09-12T17:36:44.966081+0000","last_active":"2024-09-12T19:27:55.377299+0000","last_peered":"2024-09-12T19:27:55.377299+0000","last_clean":"2024-09-12T19:27:55.377299+0000","last_became_active":"2024-09-12T17:36:44.965427+0000","last_became_peered":"2024-09-12T17:36:44.965427+0000","last_unstale":"2024-09-12T19:27:55.377299+0000","last_undegraded":"2024-09-12T19:27:55.377299+0000","last_fullsized":"2024-09-12T19:27:55.377299+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:36:43.896782+0000","last_clean_scrub_stamp":"2024-09-12T17:36:43.896782+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1232,"num_read_kb":1221,"num_write":362,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'996","reported_seq":2731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.364090+0000","last_change":"2024-09-12T19:29:57.363859+0000","last_active":"2024-09-12T19:29:57.364090+0000","last_peered":"2024-09-12T19:29:57.364090+0000","last_clean":"2024-09-12T19:29:57.364090+0000","last_became_active":"2024-09-12T17:36:36.914315+0000","last_became_peered":"2024-09-12T17:36:36.914315+0000","last_unstale":"2024-09-12T19:29:57.364090+0000","last_undegraded":"2024-09-12T19:29:57.364090+0000","last_fullsized":"2024-09-12T19:29:57.364090+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'996","last_scrub_stamp":"2024-09-12T19:29:57.363633+0000","last_deep_scrub":"265'996","last_deep_scrub_stamp":"2024-09-12T19:29:57.363633+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.363633+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":900,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:14.785338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4811,"num_read_kb":4330,"num_write":1385,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'343","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.949861+0000","last_change":"2024-09-12T19:29:53.949861+0000","last_active":"2024-09-12T19:29:53.949861+0000","last_peered":"2024-09-12T19:29:53.949861+0000","last_clean":"2024-09-12T19:29:53.949861+0000","last_became_active":"2024-09-12T17:36:34.871889+0000","last_became_peered":"2024-09-12T17:36:34.871889+0000","last_unstale":"2024-09-12T19:29:53.949861+0000","last_undegraded":"2024-09-12T19:29:53.949861+0000","last_fullsized":"2024-09-12T19:29:53.949861+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:29:53.949641+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:29:53.949641+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.949641+0000","objects_scrubbed":10,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:44.653793+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526421,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":468,"num_read_kb":13877,"num_write":1131,"num_write_kb":46739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.056083+0000","last_change":"2024-09-12T19:30:11.056083+0000","last_active":"2024-09-12T19:30:11.056083+0000","last_peered":"2024-09-12T19:30:11.056083+0000","last_clean":"2024-09-12T19:30:11.056083+0000","last_became_active":"2024-09-12T17:36:38.882018+0000","last_became_peered":"2024-09-12T17:36:38.882018+0000","last_unstale":"2024-09-12T19:30:11.056083+0000","last_undegraded":"2024-09-12T19:30:11.056083+0000","last_fullsized":"2024-09-12T19:30:11.056083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:11.055899+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:11.055899+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.055899+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:12.704129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'331","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.222919+0000","last_change":"2024-09-12T19:30:21.222919+0000","last_active":"2024-09-12T19:30:21.222919+0000","last_peered":"2024-09-12T19:30:21.222919+0000","last_clean":"2024-09-12T19:30:21.222919+0000","last_became_active":"2024-09-12T17:36:40.908611+0000","last_became_peered":"2024-09-12T17:36:40.908611+0000","last_unstale":"2024-09-12T19:30:21.222919+0000","last_undegraded":"2024-09-12T19:30:21.222919+0000","last_fullsized":"2024-09-12T19:30:21.222919+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T19:30:21.222706+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T19:30:21.222706+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.222706+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:56.630835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53448,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":560,"num_read_kb":1204,"num_write":440,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.993841+0000","last_change":"2024-09-12T19:30:22.993841+0000","last_active":"2024-09-12T19:30:22.993841+0000","last_peered":"2024-09-12T19:30:22.993841+0000","last_clean":"2024-09-12T19:30:22.993841+0000","last_became_active":"2024-09-12T17:36:42.933510+0000","last_became_peered":"2024-09-12T17:36:42.933510+0000","last_unstale":"2024-09-12T19:30:22.993841+0000","last_undegraded":"2024-09-12T19:30:22.993841+0000","last_fullsized":"2024-09-12T19:30:22.993841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.993659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.993659+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.993659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:19.000151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'129","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.498377+0000","last_change":"2024-09-12T19:30:08.498377+0000","last_active":"2024-09-12T19:30:08.498377+0000","last_peered":"2024-09-12T19:30:08.498377+0000","last_clean":"2024-09-12T19:30:08.498377+0000","last_became_active":"2024-09-12T17:36:44.960641+0000","last_became_peered":"2024-09-12T17:36:44.960641+0000","last_unstale":"2024-09-12T19:30:08.498377+0000","last_undegraded":"2024-09-12T19:30:08.498377+0000","last_fullsized":"2024-09-12T19:30:08.498377+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T19:30:08.498183+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T19:30:08.498183+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.498183+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:18.321995+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":181,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'933","reported_seq":2739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.902416+0000","last_change":"2024-09-12T19:30:01.902416+0000","last_active":"2024-09-12T19:30:01.902416+0000","last_peered":"2024-09-12T19:30:01.902416+0000","last_clean":"2024-09-12T19:30:01.902416+0000","last_became_active":"2024-09-12T17:36:36.901046+0000","last_became_peered":"2024-09-12T17:36:36.901046+0000","last_unstale":"2024-09-12T19:30:01.902416+0000","last_undegraded":"2024-09-12T19:30:01.902416+0000","last_fullsized":"2024-09-12T19:30:01.902416+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'933","last_scrub_stamp":"2024-09-12T19:30:01.902200+0000","last_deep_scrub":"265'933","last_deep_scrub_stamp":"2024-09-12T19:30:01.902200+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.902200+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:50.473986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4712,"num_read_kb":4247,"num_write":1250,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4079,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'415","reported_seq":1135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.380197+0000","last_change":"2024-09-12T19:29:48.380197+0000","last_active":"2024-09-12T19:29:48.380197+0000","last_peered":"2024-09-12T19:29:48.380197+0000","last_clean":"2024-09-12T19:29:48.380197+0000","last_became_active":"2024-09-12T17:36:34.884112+0000","last_became_peered":"2024-09-12T17:36:34.884112+0000","last_unstale":"2024-09-12T19:29:48.380197+0000","last_undegraded":"2024-09-12T19:29:48.380197+0000","last_fullsized":"2024-09-12T19:29:48.380197+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:29:48.380120+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:29:48.380120+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.380120+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:19.901040+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":11450,"num_write":1282,"num_write_kb":27380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'656","reported_seq":2325,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.057909+0000","last_change":"2024-09-12T19:29:59.057909+0000","last_active":"2024-09-12T19:29:59.057909+0000","last_peered":"2024-09-12T19:29:59.057909+0000","last_clean":"2024-09-12T19:29:59.057909+0000","last_became_active":"2024-09-12T17:36:36.916477+0000","last_became_peered":"2024-09-12T17:36:36.916477+0000","last_unstale":"2024-09-12T19:29:59.057909+0000","last_undegraded":"2024-09-12T19:29:59.057909+0000","last_fullsized":"2024-09-12T19:29:59.057909+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'656","last_scrub_stamp":"2024-09-12T19:29:59.057726+0000","last_deep_scrub":"265'656","last_deep_scrub_stamp":"2024-09-12T19:29:59.057726+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.057726+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:13.858705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3261,"num_read_kb":2946,"num_write":856,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'371","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.125878+0000","last_change":"2024-09-12T19:29:53.125878+0000","last_active":"2024-09-12T19:29:53.125878+0000","last_peered":"2024-09-12T19:29:53.125878+0000","last_clean":"2024-09-12T19:29:53.125878+0000","last_became_active":"2024-09-12T17:36:34.862008+0000","last_became_peered":"2024-09-12T17:36:34.862008+0000","last_unstale":"2024-09-12T19:29:53.125878+0000","last_undegraded":"2024-09-12T19:29:53.125878+0000","last_fullsized":"2024-09-12T19:29:53.125878+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T19:29:53.125690+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T19:29:53.125690+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.125690+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:00.140459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648670,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":45708,"num_write":1154,"num_write_kb":41141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'444","reported_seq":2016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.196846+0000","last_change":"2024-09-12T19:30:10.196846+0000","last_active":"2024-09-12T19:30:10.196846+0000","last_peered":"2024-09-12T19:30:10.196846+0000","last_clean":"2024-09-12T19:30:10.196846+0000","last_became_active":"2024-09-12T17:36:36.875947+0000","last_became_peered":"2024-09-12T17:36:36.875947+0000","last_unstale":"2024-09-12T19:30:10.196846+0000","last_undegraded":"2024-09-12T19:30:10.196846+0000","last_fullsized":"2024-09-12T19:30:10.196846+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'444","last_scrub_stamp":"2024-09-12T19:30:10.196736+0000","last_deep_scrub":"265'444","last_deep_scrub_stamp":"2024-09-12T19:30:10.196736+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.196736+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:21.092717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2143,"num_write":507,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'350","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.197660+0000","last_change":"2024-09-12T19:30:00.197660+0000","last_active":"2024-09-12T19:30:00.197660+0000","last_peered":"2024-09-12T19:30:00.197660+0000","last_clean":"2024-09-12T19:30:00.197660+0000","last_became_active":"2024-09-12T17:36:34.892664+0000","last_became_peered":"2024-09-12T17:36:34.892664+0000","last_unstale":"2024-09-12T19:30:00.197660+0000","last_undegraded":"2024-09-12T19:30:00.197660+0000","last_fullsized":"2024-09-12T19:30:00.197660+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-12T19:30:00.197372+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-12T19:30:00.197372+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.197372+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:40.921623+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4719915,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":523,"num_read_kb":15114,"num_write":1089,"num_write_kb":33687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'453","reported_seq":2063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.901219+0000","last_change":"2024-09-12T19:30:06.901219+0000","last_active":"2024-09-12T19:30:06.901219+0000","last_peered":"2024-09-12T19:30:06.901219+0000","last_clean":"2024-09-12T19:30:06.901219+0000","last_became_active":"2024-09-12T17:36:36.886646+0000","last_became_peered":"2024-09-12T17:36:36.886646+0000","last_unstale":"2024-09-12T19:30:06.901219+0000","last_undegraded":"2024-09-12T19:30:06.901219+0000","last_fullsized":"2024-09-12T19:30:06.901219+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'453","last_scrub_stamp":"2024-09-12T19:30:06.901026+0000","last_deep_scrub":"265'453","last_deep_scrub_stamp":"2024-09-12T19:30:06.901026+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.901026+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:17.596822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2431,"num_read_kb":2290,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'322","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.891849+0000","last_change":"2024-09-12T19:29:54.891849+0000","last_active":"2024-09-12T19:29:54.891849+0000","last_peered":"2024-09-12T19:29:54.891849+0000","last_clean":"2024-09-12T19:29:54.891849+0000","last_became_active":"2024-09-12T17:36:34.875514+0000","last_became_peered":"2024-09-12T17:36:34.875514+0000","last_unstale":"2024-09-12T19:29:54.891849+0000","last_undegraded":"2024-09-12T19:29:54.891849+0000","last_fullsized":"2024-09-12T19:29:54.891849+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:29:54.891644+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:29:54.891644+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.891644+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:20.204730+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515054,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":12724,"num_write":938,"num_write_kb":21079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'472","reported_seq":2087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.917918+0000","last_change":"2024-09-12T19:30:05.917918+0000","last_active":"2024-09-12T19:30:05.917918+0000","last_peered":"2024-09-12T19:30:05.917918+0000","last_clean":"2024-09-12T19:30:05.917918+0000","last_became_active":"2024-09-12T17:36:36.895580+0000","last_became_peered":"2024-09-12T17:36:36.895580+0000","last_unstale":"2024-09-12T19:30:05.917918+0000","last_undegraded":"2024-09-12T19:30:05.917918+0000","last_fullsized":"2024-09-12T19:30:05.917918+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'472","last_scrub_stamp":"2024-09-12T19:30:05.917613+0000","last_deep_scrub":"265'472","last_deep_scrub_stamp":"2024-09-12T19:30:05.917613+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.917613+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:46.828526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2410,"num_read_kb":2268,"num_write":522,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'383","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.377960+0000","last_change":"2024-09-12T19:29:53.377960+0000","last_active":"2024-09-12T19:29:53.377960+0000","last_peered":"2024-09-12T19:29:53.377960+0000","last_clean":"2024-09-12T19:29:53.377960+0000","last_became_active":"2024-09-12T17:36:34.875282+0000","last_became_peered":"2024-09-12T17:36:34.875282+0000","last_unstale":"2024-09-12T19:29:53.377960+0000","last_undegraded":"2024-09-12T19:29:53.377960+0000","last_fullsized":"2024-09-12T19:29:53.377960+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T19:29:53.377757+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T19:29:53.377757+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.377757+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:35.803143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568489,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":16784,"num_write":1071,"num_write_kb":43648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'874","reported_seq":2689,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.367917+0000","last_change":"2024-09-12T19:29:59.367917+0000","last_active":"2024-09-12T19:29:59.367917+0000","last_peered":"2024-09-12T19:29:59.367917+0000","last_clean":"2024-09-12T19:29:59.367917+0000","last_became_active":"2024-09-12T17:36:36.879875+0000","last_became_peered":"2024-09-12T17:36:36.879875+0000","last_unstale":"2024-09-12T19:29:59.367917+0000","last_undegraded":"2024-09-12T19:29:59.367917+0000","last_fullsized":"2024-09-12T19:29:59.367917+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'874","last_scrub_stamp":"2024-09-12T19:29:59.367728+0000","last_deep_scrub":"265'874","last_deep_scrub_stamp":"2024-09-12T19:29:59.367728+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.367728+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:32.664577+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4378,"num_read_kb":3985,"num_write":1124,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1318,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'322","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.516329+0000","last_change":"2024-09-12T19:30:02.516329+0000","last_active":"2024-09-12T19:30:02.516329+0000","last_peered":"2024-09-12T19:30:02.516329+0000","last_clean":"2024-09-12T19:30:02.516329+0000","last_became_active":"2024-09-12T17:36:34.880893+0000","last_became_peered":"2024-09-12T17:36:34.880893+0000","last_unstale":"2024-09-12T19:30:02.516329+0000","last_undegraded":"2024-09-12T19:30:02.516329+0000","last_fullsized":"2024-09-12T19:30:02.516329+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:30:02.516130+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:30:02.516130+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.516130+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.498669+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":34772,"num_write":1049,"num_write_kb":43573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'1179","reported_seq":2773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.482459+0000","last_change":"2024-09-12T19:30:01.482459+0000","last_active":"2024-09-12T19:30:01.482459+0000","last_peered":"2024-09-12T19:30:01.482459+0000","last_clean":"2024-09-12T19:30:01.482459+0000","last_became_active":"2024-09-12T17:36:36.897985+0000","last_became_peered":"2024-09-12T17:36:36.897985+0000","last_unstale":"2024-09-12T19:30:01.482459+0000","last_undegraded":"2024-09-12T19:30:01.482459+0000","last_fullsized":"2024-09-12T19:30:01.482459+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1179","last_scrub_stamp":"2024-09-12T19:30:01.482241+0000","last_deep_scrub":"265'1179","last_deep_scrub_stamp":"2024-09-12T19:30:01.482241+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.482241+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:27.270588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5405,"num_read_kb":4772,"num_write":1628,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1111,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'394","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.321112+0000","last_change":"2024-09-12T19:29:52.321112+0000","last_active":"2024-09-12T19:29:52.321112+0000","last_peered":"2024-09-12T19:29:52.321112+0000","last_clean":"2024-09-12T19:29:52.321112+0000","last_became_active":"2024-09-12T17:36:34.876834+0000","last_became_peered":"2024-09-12T17:36:34.876834+0000","last_unstale":"2024-09-12T19:29:52.321112+0000","last_undegraded":"2024-09-12T19:29:52.321112+0000","last_fullsized":"2024-09-12T19:29:52.321112+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T19:29:52.320936+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T19:29:52.320936+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.320936+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:16.090065+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":595,"num_read_kb":4635,"num_write":1236,"num_write_kb":22932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'773","reported_seq":2370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.859989+0000","last_change":"2024-09-12T19:29:53.859989+0000","last_active":"2024-09-12T19:29:53.859989+0000","last_peered":"2024-09-12T19:29:53.859989+0000","last_clean":"2024-09-12T19:29:53.859989+0000","last_became_active":"2024-09-12T17:36:36.901293+0000","last_became_peered":"2024-09-12T17:36:36.901293+0000","last_unstale":"2024-09-12T19:29:53.859989+0000","last_undegraded":"2024-09-12T19:29:53.859989+0000","last_fullsized":"2024-09-12T19:29:53.859989+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T19:29:53.859804+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T19:29:53.859804+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.859804+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:29.780177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3323,"num_write":979,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'347","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.926866+0000","last_change":"2024-09-12T19:29:52.926866+0000","last_active":"2024-09-12T19:29:52.926866+0000","last_peered":"2024-09-12T19:29:52.926866+0000","last_clean":"2024-09-12T19:29:52.926866+0000","last_became_active":"2024-09-12T17:36:34.872999+0000","last_became_peered":"2024-09-12T17:36:34.872999+0000","last_unstale":"2024-09-12T19:29:52.926866+0000","last_undegraded":"2024-09-12T19:29:52.926866+0000","last_fullsized":"2024-09-12T19:29:52.926866+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:29:52.926633+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:29:52.926633+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.926633+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:12.827832+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":667,"num_read_kb":7832,"num_write":1127,"num_write_kb":31819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'779","reported_seq":2255,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.088334+0000","last_change":"2024-09-12T19:30:02.088334+0000","last_active":"2024-09-12T19:30:02.088334+0000","last_peered":"2024-09-12T19:30:02.088334+0000","last_clean":"2024-09-12T19:30:02.088334+0000","last_became_active":"2024-09-12T17:36:36.903948+0000","last_became_peered":"2024-09-12T17:36:36.903948+0000","last_unstale":"2024-09-12T19:30:02.088334+0000","last_undegraded":"2024-09-12T19:30:02.088334+0000","last_fullsized":"2024-09-12T19:30:02.088334+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'779","last_scrub_stamp":"2024-09-12T19:30:02.088151+0000","last_deep_scrub":"265'779","last_deep_scrub_stamp":"2024-09-12T19:30:02.088151+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.088151+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:31.427535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3650,"num_read_kb":3275,"num_write":1024,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'413","reported_seq":1181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.145594+0000","last_change":"2024-09-12T19:30:04.145594+0000","last_active":"2024-09-12T19:30:04.145594+0000","last_peered":"2024-09-12T19:30:04.145594+0000","last_clean":"2024-09-12T19:30:04.145594+0000","last_became_active":"2024-09-12T17:36:34.891638+0000","last_became_peered":"2024-09-12T17:36:34.891638+0000","last_unstale":"2024-09-12T19:30:04.145594+0000","last_undegraded":"2024-09-12T19:30:04.145594+0000","last_fullsized":"2024-09-12T19:30:04.145594+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'413","last_scrub_stamp":"2024-09-12T19:30:04.145362+0000","last_deep_scrub":"265'413","last_deep_scrub_stamp":"2024-09-12T19:30:04.145362+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.145362+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:20.894452+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":824,"num_read_kb":23553,"num_write":1317,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'1233","reported_seq":2991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.364430+0000","last_change":"2024-09-12T19:29:57.364430+0000","last_active":"2024-09-12T19:29:57.364430+0000","last_peered":"2024-09-12T19:29:57.364430+0000","last_clean":"2024-09-12T19:29:57.364430+0000","last_became_active":"2024-09-12T17:36:36.906463+0000","last_became_peered":"2024-09-12T17:36:36.906463+0000","last_unstale":"2024-09-12T19:29:57.364430+0000","last_undegraded":"2024-09-12T19:29:57.364430+0000","last_fullsized":"2024-09-12T19:29:57.364430+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1233","last_scrub_stamp":"2024-09-12T19:29:57.364153+0000","last_deep_scrub":"265'1233","last_deep_scrub_stamp":"2024-09-12T19:29:57.364153+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.364153+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":1200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:42.031824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5684,"num_read_kb":5045,"num_write":1688,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'343","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.902923+0000","last_change":"2024-09-12T19:29:55.902923+0000","last_active":"2024-09-12T19:29:55.902923+0000","last_peered":"2024-09-12T19:29:55.902923+0000","last_clean":"2024-09-12T19:29:55.902923+0000","last_became_active":"2024-09-12T17:36:34.873189+0000","last_became_peered":"2024-09-12T17:36:34.873189+0000","last_unstale":"2024-09-12T19:29:55.902923+0000","last_undegraded":"2024-09-12T19:29:55.902923+0000","last_fullsized":"2024-09-12T19:29:55.902923+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:29:55.902646+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:29:55.902646+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.902646+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:22.918198+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284213,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":39048,"num_write":958,"num_write_kb":38605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'1002","reported_seq":2715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.836395+0000","last_change":"2024-09-12T19:30:08.836395+0000","last_active":"2024-09-12T19:30:08.836395+0000","last_peered":"2024-09-12T19:30:08.836395+0000","last_clean":"2024-09-12T19:30:08.836395+0000","last_became_active":"2024-09-12T17:36:36.875791+0000","last_became_peered":"2024-09-12T17:36:36.875791+0000","last_unstale":"2024-09-12T19:30:08.836395+0000","last_undegraded":"2024-09-12T19:30:08.836395+0000","last_fullsized":"2024-09-12T19:30:08.836395+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1002","last_scrub_stamp":"2024-09-12T19:30:08.836221+0000","last_deep_scrub":"265'1002","last_deep_scrub_stamp":"2024-09-12T19:30:08.836221+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.836221+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":900,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:17.299248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4962,"num_read_kb":4419,"num_write":1465,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":724,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'253","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.905945+0000","last_change":"2024-09-12T19:29:47.905945+0000","last_active":"2024-09-12T19:29:47.905945+0000","last_peered":"2024-09-12T19:29:47.905945+0000","last_clean":"2024-09-12T19:29:47.905945+0000","last_became_active":"2024-09-12T17:36:34.866719+0000","last_became_peered":"2024-09-12T17:36:34.866719+0000","last_unstale":"2024-09-12T19:29:47.905945+0000","last_undegraded":"2024-09-12T19:29:47.905945+0000","last_fullsized":"2024-09-12T19:29:47.905945+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-12T19:29:47.905866+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-12T19:29:47.905866+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.905866+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:35.987815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":13747,"num_write":787,"num_write_kb":14866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'511","reported_seq":2137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.833711+0000","last_change":"2024-09-12T19:29:55.833711+0000","last_active":"2024-09-12T19:29:55.833711+0000","last_peered":"2024-09-12T19:29:55.833711+0000","last_clean":"2024-09-12T19:29:55.833711+0000","last_became_active":"2024-09-12T17:36:36.914327+0000","last_became_peered":"2024-09-12T17:36:36.914327+0000","last_unstale":"2024-09-12T19:29:55.833711+0000","last_undegraded":"2024-09-12T19:29:55.833711+0000","last_fullsized":"2024-09-12T19:29:55.833711+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'511","last_scrub_stamp":"2024-09-12T19:29:55.833505+0000","last_deep_scrub":"265'511","last_deep_scrub_stamp":"2024-09-12T19:29:55.833505+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.833505+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:26.792835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2629,"num_read_kb":2439,"num_write":603,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'303","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.909782+0000","last_change":"2024-09-12T19:29:59.909782+0000","last_active":"2024-09-12T19:29:59.909782+0000","last_peered":"2024-09-12T19:29:59.909782+0000","last_clean":"2024-09-12T19:29:59.909782+0000","last_became_active":"2024-09-12T17:36:34.864682+0000","last_became_peered":"2024-09-12T17:36:34.864682+0000","last_unstale":"2024-09-12T19:29:59.909782+0000","last_undegraded":"2024-09-12T19:29:59.909782+0000","last_fullsized":"2024-09-12T19:29:59.909782+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T19:29:59.909589+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T19:29:59.909589+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.909589+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:21:13.619686+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":386,"num_read_kb":10447,"num_write":906,"num_write_kb":22906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'846","reported_seq":2476,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.841442+0000","last_change":"2024-09-12T19:29:54.841442+0000","last_active":"2024-09-12T19:29:54.841442+0000","last_peered":"2024-09-12T19:29:54.841442+0000","last_clean":"2024-09-12T19:29:54.841442+0000","last_became_active":"2024-09-12T17:36:36.885956+0000","last_became_peered":"2024-09-12T17:36:36.885956+0000","last_unstale":"2024-09-12T19:29:54.841442+0000","last_undegraded":"2024-09-12T19:29:54.841442+0000","last_fullsized":"2024-09-12T19:29:54.841442+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'846","last_scrub_stamp":"2024-09-12T19:29:54.841249+0000","last_deep_scrub":"265'846","last_deep_scrub_stamp":"2024-09-12T19:29:54.841249+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.841249+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:55.821229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3814,"num_read_kb":3459,"num_write":1078,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'375","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.405081+0000","last_change":"2024-09-12T19:29:47.405081+0000","last_active":"2024-09-12T19:29:47.405081+0000","last_peered":"2024-09-12T19:29:47.405081+0000","last_clean":"2024-09-12T19:29:47.405081+0000","last_became_active":"2024-09-12T17:36:34.865344+0000","last_became_peered":"2024-09-12T17:36:34.865344+0000","last_unstale":"2024-09-12T19:29:47.405081+0000","last_undegraded":"2024-09-12T19:29:47.405081+0000","last_fullsized":"2024-09-12T19:29:47.405081+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:29:47.404998+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:29:47.404998+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.404998+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:12.580297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":55805,"num_write":1199,"num_write_kb":26331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'725","reported_seq":2145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.086920+0000","last_change":"2024-09-12T19:30:00.086920+0000","last_active":"2024-09-12T19:30:00.086920+0000","last_peered":"2024-09-12T19:30:00.086920+0000","last_clean":"2024-09-12T19:30:00.086920+0000","last_became_active":"2024-09-12T17:36:36.916289+0000","last_became_peered":"2024-09-12T17:36:36.916289+0000","last_unstale":"2024-09-12T19:30:00.086920+0000","last_undegraded":"2024-09-12T19:30:00.086920+0000","last_fullsized":"2024-09-12T19:30:00.086920+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'725","last_scrub_stamp":"2024-09-12T19:30:00.086735+0000","last_deep_scrub":"265'725","last_deep_scrub_stamp":"2024-09-12T19:30:00.086735+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.086735+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:01.389997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3361,"num_read_kb":3032,"num_write":954,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'378","reported_seq":1272,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.209603+0000","last_change":"2024-09-12T19:30:01.209603+0000","last_active":"2024-09-12T19:30:01.209603+0000","last_peered":"2024-09-12T19:30:01.209603+0000","last_clean":"2024-09-12T19:30:01.209603+0000","last_became_active":"2024-09-12T17:36:34.875748+0000","last_became_peered":"2024-09-12T17:36:34.875748+0000","last_unstale":"2024-09-12T19:30:01.209603+0000","last_undegraded":"2024-09-12T19:30:01.209603+0000","last_fullsized":"2024-09-12T19:30:01.209603+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:30:01.209395+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:30:01.209395+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.209395+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:15.055583+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311597,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":946,"num_read_kb":75770,"num_write":1026,"num_write_kb":38932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'578","reported_seq":2198,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.899816+0000","last_change":"2024-09-12T19:30:03.899816+0000","last_active":"2024-09-12T19:30:03.899816+0000","last_peered":"2024-09-12T19:30:03.899816+0000","last_clean":"2024-09-12T19:30:03.899816+0000","last_became_active":"2024-09-12T17:36:36.902941+0000","last_became_peered":"2024-09-12T17:36:36.902941+0000","last_unstale":"2024-09-12T19:30:03.899816+0000","last_undegraded":"2024-09-12T19:30:03.899816+0000","last_fullsized":"2024-09-12T19:30:03.899816+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'578","last_scrub_stamp":"2024-09-12T19:30:03.899626+0000","last_deep_scrub":"265'578","last_deep_scrub_stamp":"2024-09-12T19:30:03.899626+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.899626+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:57.866591+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2851,"num_read_kb":2607,"num_write":694,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1263,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'382","reported_seq":1068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.108963+0000","last_change":"2024-09-12T19:29:54.108963+0000","last_active":"2024-09-12T19:29:54.108963+0000","last_peered":"2024-09-12T19:29:54.108963+0000","last_clean":"2024-09-12T19:29:54.108963+0000","last_became_active":"2024-09-12T17:36:34.868083+0000","last_became_peered":"2024-09-12T17:36:34.868083+0000","last_unstale":"2024-09-12T19:29:54.108963+0000","last_undegraded":"2024-09-12T19:29:54.108963+0000","last_fullsized":"2024-09-12T19:29:54.108963+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T19:29:54.108756+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T19:29:54.108756+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.108756+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:42.132817+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526437,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":549,"num_read_kb":53048,"num_write":1215,"num_write_kb":26068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'579","reported_seq":2527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.868550+0000","last_change":"2024-09-12T19:29:56.868550+0000","last_active":"2024-09-12T19:29:56.868550+0000","last_peered":"2024-09-12T19:29:56.868550+0000","last_clean":"2024-09-12T19:29:56.868550+0000","last_became_active":"2024-09-12T17:36:36.891412+0000","last_became_peered":"2024-09-12T17:36:36.891412+0000","last_unstale":"2024-09-12T19:29:56.868550+0000","last_undegraded":"2024-09-12T19:29:56.868550+0000","last_fullsized":"2024-09-12T19:29:56.868550+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'579","last_scrub_stamp":"2024-09-12T19:29:56.868376+0000","last_deep_scrub":"265'579","last_deep_scrub_stamp":"2024-09-12T19:29:56.868376+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.868376+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:06.248111+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3296,"num_read_kb":3095,"num_write":679,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'406","reported_seq":1099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.173896+0000","last_change":"2024-09-12T19:30:02.173896+0000","last_active":"2024-09-12T19:30:02.173896+0000","last_peered":"2024-09-12T19:30:02.173896+0000","last_clean":"2024-09-12T19:30:02.173896+0000","last_became_active":"2024-09-12T17:36:34.872242+0000","last_became_peered":"2024-09-12T17:36:34.872242+0000","last_unstale":"2024-09-12T19:30:02.173896+0000","last_undegraded":"2024-09-12T19:30:02.173896+0000","last_fullsized":"2024-09-12T19:30:02.173896+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'406","last_scrub_stamp":"2024-09-12T19:30:02.173660+0000","last_deep_scrub":"265'406","last_deep_scrub_stamp":"2024-09-12T19:30:02.173660+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.173660+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:33.109697+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2448269,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":538,"num_read_kb":8811,"num_write":1195,"num_write_kb":19313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'376","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.178506+0000","last_change":"2024-09-12T19:30:03.178506+0000","last_active":"2024-09-12T19:30:03.178506+0000","last_peered":"2024-09-12T19:30:03.178506+0000","last_clean":"2024-09-12T19:30:03.178506+0000","last_became_active":"2024-09-12T17:36:34.861821+0000","last_became_peered":"2024-09-12T17:36:34.861821+0000","last_unstale":"2024-09-12T19:30:03.178506+0000","last_undegraded":"2024-09-12T19:30:03.178506+0000","last_fullsized":"2024-09-12T19:30:03.178506+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:30:03.178293+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:30:03.178293+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.178293+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:36.494496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":100665,"num_write":1084,"num_write_kb":41422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'575","reported_seq":2182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.918153+0000","last_change":"2024-09-12T19:30:05.918153+0000","last_active":"2024-09-12T19:30:05.918153+0000","last_peered":"2024-09-12T19:30:05.918153+0000","last_clean":"2024-09-12T19:30:05.918153+0000","last_became_active":"2024-09-12T17:36:36.911855+0000","last_became_peered":"2024-09-12T17:36:36.911855+0000","last_unstale":"2024-09-12T19:30:05.918153+0000","last_undegraded":"2024-09-12T19:30:05.918153+0000","last_fullsized":"2024-09-12T19:30:05.918153+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'575","last_scrub_stamp":"2024-09-12T19:30:05.917870+0000","last_deep_scrub":"265'575","last_deep_scrub_stamp":"2024-09-12T19:30:05.917870+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.917870+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:40.019170+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2849,"num_read_kb":2620,"num_write":728,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'342","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.897450+0000","last_change":"2024-09-12T19:29:57.897450+0000","last_active":"2024-09-12T19:29:57.897450+0000","last_peered":"2024-09-12T19:29:57.897450+0000","last_clean":"2024-09-12T19:29:57.897450+0000","last_became_active":"2024-09-12T17:36:34.881262+0000","last_became_peered":"2024-09-12T17:36:34.881262+0000","last_unstale":"2024-09-12T19:29:57.897450+0000","last_undegraded":"2024-09-12T19:29:57.897450+0000","last_fullsized":"2024-09-12T19:29:57.897450+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:57.897247+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:57.897247+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.897247+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:58.010163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":969137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":479,"num_read_kb":5153,"num_write":1034,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'505","reported_seq":2118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.887751+0000","last_change":"2024-09-12T19:30:01.887588+0000","last_active":"2024-09-12T19:30:01.887751+0000","last_peered":"2024-09-12T19:30:01.887751+0000","last_clean":"2024-09-12T19:30:01.887751+0000","last_became_active":"2024-09-12T17:36:36.901857+0000","last_became_peered":"2024-09-12T17:36:36.901857+0000","last_unstale":"2024-09-12T19:30:01.887751+0000","last_undegraded":"2024-09-12T19:30:01.887751+0000","last_fullsized":"2024-09-12T19:30:01.887751+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:30:01.887410+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:30:01.887410+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.887410+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:36.054880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2642,"num_read_kb":2459,"num_write":621,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5957,"num_read_kb":4161,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3486,"num_omap_keys":7,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1107,"ondisk_log_size":1107,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16299,"num_read_kb":15966,"num_write":16741,"num_write_kb":4895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1646,"ondisk_log_size":1646,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":757,"ondisk_log_size":757,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1604320,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":20976,"num_read_kb":40444,"num_write":17515,"num_write_kb":12474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673168,"num_omap_keys":1548,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1662,"ondisk_log_size":1662,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194467,"num_write":55293,"num_write_kb":18855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43794,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3877,"ondisk_log_size":3877,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":67082726,"num_objects":379,"num_object_clones":0,"num_object_copies":758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":36361,"num_read_kb":1891027,"num_write":71889,"num_write_kb":2051812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135487488,"data_stored":134165452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4005,"ondisk_log_size":4005,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":193786,"num_write":186,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":184511,"num_write":186,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510817,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217412,"kb_used_data":9972,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94154428,"statfs":{"total":96636764160,"available":96414134272,"internally_reserved":0,"allocated":10211328,"data_stored":8566552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510814,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258688,"kb_used_data":24816,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94113152,"statfs":{"total":96636764160,"available":96371867648,"internally_reserved":0,"allocated":25411584,"data_stored":23641054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510818,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191112,"kb_used_data":15608,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94180728,"statfs":{"total":96636764160,"available":96441065472,"internally_reserved":0,"allocated":15982592,"data_stored":14328646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510814,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":222896,"kb_used_data":29280,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94148944,"statfs":{"total":96636764160,"available":96408518656,"internally_reserved":0,"allocated":29982720,"data_stored":28233002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510817,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131872,"kb_used_data":24336,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94239968,"statfs":{"total":96636764160,"available":96501727232,"internally_reserved":0,"allocated":24920064,"data_stored":23230965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510814,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276332,"kb_used_data":10524,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94095508,"statfs":{"total":96636764160,"available":96353800192,"internally_reserved":0,"allocated":10776576,"data_stored":9102273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510815,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106204,"kb_used_data":20940,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94265636,"statfs":{"total":96636764160,"available":96528011264,"internally_reserved":0,"allocated":21442560,"data_stored":19672532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543520,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116012,"kb_used_data":26588,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94255828,"statfs":{"total":96636764160,"available":96517967872,"internally_reserved":0,"allocated":27226112,"data_stored":25491082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17780736,"data_stored":17557812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6524928,"data_stored":6398837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21286912,"data_stored":21117656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26320896,"data_stored":26118766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12324864,"data_stored":12211453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21143552,"data_stored":20934570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23552000,"data_stored":23375118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6553600,"data_stored":6451240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:30:30.922 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.922 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.923 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.923 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.923 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.923 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.923 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.923 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.923 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.923 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.924 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.924 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.924 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.924 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.924 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.924 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.924 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.924 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.924 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.925 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.925 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.925 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.925 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.925 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.925 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.925 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.925 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.926 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.926 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.926 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.926 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.926 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.926 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.926 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.926 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.927 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.927 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.927 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.927 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.927 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.927 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.927 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.927 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.928 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.928 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.928 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.928 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.928 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.928 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.928 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.928 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.928 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.929 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.929 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.929 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.929 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.929 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.929 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.929 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.930 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.930 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.930 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.930 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.930 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.930 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.930 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.930 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.930 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.931 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.931 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.931 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.931 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.931 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.931 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.931 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.931 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.932 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:52:38.828707+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=52, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.932 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.932 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.933 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.934 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.934 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.935 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.935 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:36:39.865714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.935 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.935 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.935 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.936 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:36:41.871929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.936 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:36:43.896782+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=36, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:30.936 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:30:50.938 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:30:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:30:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-12T19:30:51.298 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":3694,"stamp":"2024-09-12T19:30:49.260151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69294871,"num_objects":850,"num_object_clones":0,"num_object_copies":1700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":850,"num_whiteouts":0,"num_read":295267,"num_read_kb":2527306,"num_write":163888,"num_write_kb":2342783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":204,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740555,"num_omap_keys":1796,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13252,"ondisk_log_size":13252,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1520528,"kb_used_data":162064,"kb_used_omap":12,"kb_used_meta":1358323,"kb_avail":753454192,"statfs":{"total":773094113280,"available":771537092608,"internally_reserved":0,"allocated":165953536,"data_stored":152266106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1390923312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009530"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.565814+0000","last_change":"2024-09-12T19:30:25.565814+0000","last_active":"2024-09-12T19:30:25.565814+0000","last_peered":"2024-09-12T19:30:25.565814+0000","last_clean":"2024-09-12T19:30:25.565814+0000","last_became_active":"2024-09-12T18:25:52.621735+0000","last_became_peered":"2024-09-12T18:25:52.621735+0000","last_unstale":"2024-09-12T19:30:25.565814+0000","last_undegraded":"2024-09-12T19:30:25.565814+0000","last_fullsized":"2024-09-12T19:30:25.565814+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:25.565549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:25.565549+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.565549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:49.025300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.761152+0000","last_change":"2024-09-12T19:30:23.761152+0000","last_active":"2024-09-12T19:30:23.761152+0000","last_peered":"2024-09-12T19:30:23.761152+0000","last_clean":"2024-09-12T19:30:23.761152+0000","last_became_active":"2024-09-12T17:58:47.223202+0000","last_became_peered":"2024-09-12T17:58:47.223202+0000","last_unstale":"2024-09-12T19:30:23.761152+0000","last_undegraded":"2024-09-12T19:30:23.761152+0000","last_fullsized":"2024-09-12T19:30:23.761152+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:23.760965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:23.760965+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.760965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:37.841242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'5","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.196933+0000","last_change":"2024-09-12T19:30:26.196933+0000","last_active":"2024-09-12T19:30:26.196933+0000","last_peered":"2024-09-12T19:30:26.196933+0000","last_clean":"2024-09-12T19:30:26.196933+0000","last_became_active":"2024-09-12T17:58:40.206469+0000","last_became_peered":"2024-09-12T17:58:40.206469+0000","last_unstale":"2024-09-12T19:30:26.196933+0000","last_undegraded":"2024-09-12T19:30:26.196933+0000","last_fullsized":"2024-09-12T19:30:26.196933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:30:26.196759+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:30:26.196759+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.196759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:01.302999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'13","reported_seq":122,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.882317+0000","last_change":"2024-09-12T19:30:29.882146+0000","last_active":"2024-09-12T19:30:29.882317+0000","last_peered":"2024-09-12T19:30:29.882317+0000","last_clean":"2024-09-12T19:30:29.882317+0000","last_became_active":"2024-09-12T17:52:39.872356+0000","last_became_peered":"2024-09-12T17:52:39.872356+0000","last_unstale":"2024-09-12T19:30:29.882317+0000","last_undegraded":"2024-09-12T19:30:29.882317+0000","last_fullsized":"2024-09-12T19:30:29.882317+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'13","last_scrub_stamp":"2024-09-12T19:30:29.881965+0000","last_deep_scrub":"265'13","last_deep_scrub_stamp":"2024-09-12T19:30:29.881965+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.881965+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:55.275431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.646791+0000","last_change":"2024-09-12T19:30:31.646791+0000","last_active":"2024-09-12T19:30:31.646791+0000","last_peered":"2024-09-12T19:30:31.646791+0000","last_clean":"2024-09-12T19:30:31.646791+0000","last_became_active":"2024-09-12T18:25:52.624565+0000","last_became_peered":"2024-09-12T18:25:52.624565+0000","last_unstale":"2024-09-12T19:30:31.646791+0000","last_undegraded":"2024-09-12T19:30:31.646791+0000","last_fullsized":"2024-09-12T19:30:31.646791+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:31.646615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:31.646615+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.646615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:31.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'4","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.555418+0000","last_change":"2024-09-12T19:30:27.555418+0000","last_active":"2024-09-12T19:30:27.555418+0000","last_peered":"2024-09-12T19:30:27.555418+0000","last_clean":"2024-09-12T19:30:27.555418+0000","last_became_active":"2024-09-12T17:58:47.249050+0000","last_became_peered":"2024-09-12T17:58:47.249050+0000","last_unstale":"2024-09-12T19:30:27.555418+0000","last_undegraded":"2024-09-12T19:30:27.555418+0000","last_fullsized":"2024-09-12T19:30:27.555418+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T19:30:27.555229+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T19:30:27.555229+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.555229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:06.279321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.839795+0000","last_change":"2024-09-12T19:30:30.839795+0000","last_active":"2024-09-12T19:30:30.839795+0000","last_peered":"2024-09-12T19:30:30.839795+0000","last_clean":"2024-09-12T19:30:30.839795+0000","last_became_active":"2024-09-12T17:58:40.209447+0000","last_became_peered":"2024-09-12T17:58:40.209447+0000","last_unstale":"2024-09-12T19:30:30.839795+0000","last_undegraded":"2024-09-12T19:30:30.839795+0000","last_fullsized":"2024-09-12T19:30:30.839795+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:30.839613+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:30.839613+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.839613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:17.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'14","reported_seq":126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.916413+0000","last_change":"2024-09-12T19:30:28.916413+0000","last_active":"2024-09-12T19:30:28.916413+0000","last_peered":"2024-09-12T19:30:28.916413+0000","last_clean":"2024-09-12T19:30:28.916413+0000","last_became_active":"2024-09-12T17:52:39.884327+0000","last_became_peered":"2024-09-12T17:52:39.884327+0000","last_unstale":"2024-09-12T19:30:28.916413+0000","last_undegraded":"2024-09-12T19:30:28.916413+0000","last_fullsized":"2024-09-12T19:30:28.916413+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T19:30:28.916194+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T19:30:28.916194+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.916194+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:45.731774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.810340+0000","last_change":"2024-09-12T19:30:26.810340+0000","last_active":"2024-09-12T19:30:26.810340+0000","last_peered":"2024-09-12T19:30:26.810340+0000","last_clean":"2024-09-12T19:30:26.810340+0000","last_became_active":"2024-09-12T18:25:52.621796+0000","last_became_peered":"2024-09-12T18:25:52.621796+0000","last_unstale":"2024-09-12T19:30:26.810340+0000","last_undegraded":"2024-09-12T19:30:26.810340+0000","last_fullsized":"2024-09-12T19:30:26.810340+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:26.810151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:26.810151+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.810151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:05.298957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:38.759035+0000","last_change":"2024-09-12T19:30:38.759035+0000","last_active":"2024-09-12T19:30:38.759035+0000","last_peered":"2024-09-12T19:30:38.759035+0000","last_clean":"2024-09-12T19:30:38.759035+0000","last_became_active":"2024-09-12T17:58:47.239390+0000","last_became_peered":"2024-09-12T17:58:47.239390+0000","last_unstale":"2024-09-12T19:30:38.759035+0000","last_undegraded":"2024-09-12T19:30:38.759035+0000","last_fullsized":"2024-09-12T19:30:38.759035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:38.758835+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:38.758835+0000","last_clean_scrub_stamp":"2024-09-12T19:30:38.758835+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:42.706716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'4","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.193265+0000","last_change":"2024-09-12T19:30:28.193265+0000","last_active":"2024-09-12T19:30:28.193265+0000","last_peered":"2024-09-12T19:30:28.193265+0000","last_clean":"2024-09-12T19:30:28.193265+0000","last_became_active":"2024-09-12T17:58:40.193462+0000","last_became_peered":"2024-09-12T17:58:40.193462+0000","last_unstale":"2024-09-12T19:30:28.193265+0000","last_undegraded":"2024-09-12T19:30:28.193265+0000","last_fullsized":"2024-09-12T19:30:28.193265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:28.193054+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:28.193054+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.193054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.875107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1083,"num_write":4,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'6","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.502458+0000","last_change":"2024-09-12T19:30:23.502458+0000","last_active":"2024-09-12T19:30:23.502458+0000","last_peered":"2024-09-12T19:30:23.502458+0000","last_clean":"2024-09-12T19:30:23.502458+0000","last_became_active":"2024-09-12T17:52:39.871998+0000","last_became_peered":"2024-09-12T17:52:39.871998+0000","last_unstale":"2024-09-12T19:30:23.502458+0000","last_undegraded":"2024-09-12T19:30:23.502458+0000","last_fullsized":"2024-09-12T19:30:23.502458+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:30:23.502250+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:30:23.502250+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.502250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:58.693969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.255185+0000","last_change":"2024-09-12T18:25:52.613287+0000","last_active":"2024-09-12T19:26:40.255185+0000","last_peered":"2024-09-12T19:26:40.255185+0000","last_clean":"2024-09-12T19:26:40.255185+0000","last_became_active":"2024-09-12T18:25:52.612472+0000","last_became_peered":"2024-09-12T18:25:52.612472+0000","last_unstale":"2024-09-12T19:26:40.255185+0000","last_undegraded":"2024-09-12T19:26:40.255185+0000","last_fullsized":"2024-09-12T19:26:40.255185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:42.739715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"262'5","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:39.797434+0000","last_change":"2024-09-12T19:30:39.797434+0000","last_active":"2024-09-12T19:30:39.797434+0000","last_peered":"2024-09-12T19:30:39.797434+0000","last_clean":"2024-09-12T19:30:39.797434+0000","last_became_active":"2024-09-12T17:58:47.247496+0000","last_became_peered":"2024-09-12T17:58:47.247496+0000","last_unstale":"2024-09-12T19:30:39.797434+0000","last_undegraded":"2024-09-12T19:30:39.797434+0000","last_fullsized":"2024-09-12T19:30:39.797434+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T19:30:39.797244+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T19:30:39.797244+0000","last_clean_scrub_stamp":"2024-09-12T19:30:39.797244+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:29.956519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'12","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.772048+0000","last_change":"2024-09-12T19:30:22.772048+0000","last_active":"2024-09-12T19:30:22.772048+0000","last_peered":"2024-09-12T19:30:22.772048+0000","last_clean":"2024-09-12T19:30:22.772048+0000","last_became_active":"2024-09-12T17:58:40.207945+0000","last_became_peered":"2024-09-12T17:58:40.207945+0000","last_unstale":"2024-09-12T19:30:22.772048+0000","last_undegraded":"2024-09-12T19:30:22.772048+0000","last_fullsized":"2024-09-12T19:30:22.772048+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T19:30:22.771869+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T19:30:22.771869+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.771869+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:15.066816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8196,"num_write":22,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'37","reported_seq":178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.517183+0000","last_change":"2024-09-12T19:30:22.517183+0000","last_active":"2024-09-12T19:30:22.517183+0000","last_peered":"2024-09-12T19:30:22.517183+0000","last_clean":"2024-09-12T19:30:22.517183+0000","last_became_active":"2024-09-12T17:52:39.871148+0000","last_became_peered":"2024-09-12T17:52:39.871148+0000","last_unstale":"2024-09-12T19:30:22.517183+0000","last_undegraded":"2024-09-12T19:30:22.517183+0000","last_fullsized":"2024-09-12T19:30:22.517183+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'37","last_scrub_stamp":"2024-09-12T19:30:22.516972+0000","last_deep_scrub":"265'37","last_deep_scrub_stamp":"2024-09-12T19:30:22.516972+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.516972+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:14.364994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":131,"num_write":69,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:38.171409+0000","last_change":"2024-09-12T19:30:38.171409+0000","last_active":"2024-09-12T19:30:38.171409+0000","last_peered":"2024-09-12T19:30:38.171409+0000","last_clean":"2024-09-12T19:30:38.171409+0000","last_became_active":"2024-09-12T18:25:52.604589+0000","last_became_peered":"2024-09-12T18:25:52.604589+0000","last_unstale":"2024-09-12T19:30:38.171409+0000","last_undegraded":"2024-09-12T19:30:38.171409+0000","last_fullsized":"2024-09-12T19:30:38.171409+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:38.171196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:38.171196+0000","last_clean_scrub_stamp":"2024-09-12T19:30:38.171196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:50.341907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'8","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.497357+0000","last_change":"2024-09-12T19:30:18.497357+0000","last_active":"2024-09-12T19:30:18.497357+0000","last_peered":"2024-09-12T19:30:18.497357+0000","last_clean":"2024-09-12T19:30:18.497357+0000","last_became_active":"2024-09-12T17:58:47.242756+0000","last_became_peered":"2024-09-12T17:58:47.242756+0000","last_unstale":"2024-09-12T19:30:18.497357+0000","last_undegraded":"2024-09-12T19:30:18.497357+0000","last_fullsized":"2024-09-12T19:30:18.497357+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:30:18.497092+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:30:18.497092+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.497092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:30.626986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":7170,"num_write":8,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"262'4","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.816110+0000","last_change":"2024-09-12T19:30:31.816110+0000","last_active":"2024-09-12T19:30:31.816110+0000","last_peered":"2024-09-12T19:30:31.816110+0000","last_clean":"2024-09-12T19:30:31.816110+0000","last_became_active":"2024-09-12T17:58:40.202787+0000","last_became_peered":"2024-09-12T17:58:40.202787+0000","last_unstale":"2024-09-12T19:30:31.816110+0000","last_undegraded":"2024-09-12T19:30:31.816110+0000","last_fullsized":"2024-09-12T19:30:31.816110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T19:30:31.815913+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T19:30:31.815913+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.815913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:48.761075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'30","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.505490+0000","last_change":"2024-09-12T19:30:21.505490+0000","last_active":"2024-09-12T19:30:21.505490+0000","last_peered":"2024-09-12T19:30:21.505490+0000","last_clean":"2024-09-12T19:30:21.505490+0000","last_became_active":"2024-09-12T17:52:39.888092+0000","last_became_peered":"2024-09-12T17:52:39.888092+0000","last_unstale":"2024-09-12T19:30:21.505490+0000","last_undegraded":"2024-09-12T19:30:21.505490+0000","last_fullsized":"2024-09-12T19:30:21.505490+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:30:21.505315+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:30:21.505315+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.505315+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:41.185814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:34.901890+0000","last_change":"2024-09-12T19:30:34.901890+0000","last_active":"2024-09-12T19:30:34.901890+0000","last_peered":"2024-09-12T19:30:34.901890+0000","last_clean":"2024-09-12T19:30:34.901890+0000","last_became_active":"2024-09-12T18:25:52.614862+0000","last_became_peered":"2024-09-12T18:25:52.614862+0000","last_unstale":"2024-09-12T19:30:34.901890+0000","last_undegraded":"2024-09-12T19:30:34.901890+0000","last_fullsized":"2024-09-12T19:30:34.901890+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:34.901697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:34.901697+0000","last_clean_scrub_stamp":"2024-09-12T19:30:34.901697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:58.572801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:15.381781+0000","last_change":"2024-09-12T17:58:47.251966+0000","last_active":"2024-09-12T19:28:15.381781+0000","last_peered":"2024-09-12T19:28:15.381781+0000","last_clean":"2024-09-12T19:28:15.381781+0000","last_became_active":"2024-09-12T17:58:47.246322+0000","last_became_peered":"2024-09-12T17:58:47.246322+0000","last_unstale":"2024-09-12T19:28:15.381781+0000","last_undegraded":"2024-09-12T19:28:15.381781+0000","last_fullsized":"2024-09-12T19:28:15.381781+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'4","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:45.251599+0000","last_change":"2024-09-12T19:30:45.251599+0000","last_active":"2024-09-12T19:30:45.251599+0000","last_peered":"2024-09-12T19:30:45.251599+0000","last_clean":"2024-09-12T19:30:45.251599+0000","last_became_active":"2024-09-12T17:58:40.207064+0000","last_became_peered":"2024-09-12T17:58:40.207064+0000","last_unstale":"2024-09-12T19:30:45.251599+0000","last_undegraded":"2024-09-12T19:30:45.251599+0000","last_fullsized":"2024-09-12T19:30:45.251599+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:45.251413+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:45.251413+0000","last_clean_scrub_stamp":"2024-09-12T19:30:45.251413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:20.485560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.507171+0000","last_change":"2024-09-12T19:30:15.507171+0000","last_active":"2024-09-12T19:30:15.507171+0000","last_peered":"2024-09-12T19:30:15.507171+0000","last_clean":"2024-09-12T19:30:15.507171+0000","last_became_active":"2024-09-12T17:52:39.883689+0000","last_became_peered":"2024-09-12T17:52:39.883689+0000","last_unstale":"2024-09-12T19:30:15.507171+0000","last_undegraded":"2024-09-12T19:30:15.507171+0000","last_fullsized":"2024-09-12T19:30:15.507171+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T19:30:15.506984+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T19:30:15.506984+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.506984+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:49.043767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.561180+0000","last_change":"2024-09-12T19:30:30.561180+0000","last_active":"2024-09-12T19:30:30.561180+0000","last_peered":"2024-09-12T19:30:30.561180+0000","last_clean":"2024-09-12T19:30:30.561180+0000","last_became_active":"2024-09-12T18:25:52.598221+0000","last_became_peered":"2024-09-12T18:25:52.598221+0000","last_unstale":"2024-09-12T19:30:30.561180+0000","last_undegraded":"2024-09-12T19:30:30.561180+0000","last_fullsized":"2024-09-12T19:30:30.561180+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:30.561068+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:30.561068+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.561068+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:37.139155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.531772+0000","last_change":"2024-09-12T19:30:31.531772+0000","last_active":"2024-09-12T19:30:31.531772+0000","last_peered":"2024-09-12T19:30:31.531772+0000","last_clean":"2024-09-12T19:30:31.531772+0000","last_became_active":"2024-09-12T17:58:47.238781+0000","last_became_peered":"2024-09-12T17:58:47.238781+0000","last_unstale":"2024-09-12T19:30:31.531772+0000","last_undegraded":"2024-09-12T19:30:31.531772+0000","last_fullsized":"2024-09-12T19:30:31.531772+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:31.531560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:31.531560+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.531560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:21.599091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.488936+0000","last_change":"2024-09-12T19:30:17.488936+0000","last_active":"2024-09-12T19:30:17.488936+0000","last_peered":"2024-09-12T19:30:17.488936+0000","last_clean":"2024-09-12T19:30:17.488936+0000","last_became_active":"2024-09-12T17:58:40.187973+0000","last_became_peered":"2024-09-12T17:58:40.187973+0000","last_unstale":"2024-09-12T19:30:17.488936+0000","last_undegraded":"2024-09-12T19:30:17.488936+0000","last_fullsized":"2024-09-12T19:30:17.488936+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T19:30:17.488744+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T19:30:17.488744+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.488744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:15.360529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'31","reported_seq":166,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.139881+0000","last_change":"2024-09-12T19:30:21.139881+0000","last_active":"2024-09-12T19:30:21.139881+0000","last_peered":"2024-09-12T19:30:21.139881+0000","last_clean":"2024-09-12T19:30:21.139881+0000","last_became_active":"2024-09-12T17:52:39.891830+0000","last_became_peered":"2024-09-12T17:52:39.891830+0000","last_unstale":"2024-09-12T19:30:21.139881+0000","last_undegraded":"2024-09-12T19:30:21.139881+0000","last_fullsized":"2024-09-12T19:30:21.139881+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:30:21.139662+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:30:21.139662+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.139662+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:10.758873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.597150+0000","last_change":"2024-09-12T19:30:24.597150+0000","last_active":"2024-09-12T19:30:24.597150+0000","last_peered":"2024-09-12T19:30:24.597150+0000","last_clean":"2024-09-12T19:30:24.597150+0000","last_became_active":"2024-09-12T18:25:52.606714+0000","last_became_peered":"2024-09-12T18:25:52.606714+0000","last_unstale":"2024-09-12T19:30:24.597150+0000","last_undegraded":"2024-09-12T19:30:24.597150+0000","last_fullsized":"2024-09-12T19:30:24.597150+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:24.596947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:24.596947+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.596947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:51.381270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'4","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:35.176909+0000","last_change":"2024-09-12T19:30:35.176909+0000","last_active":"2024-09-12T19:30:35.176909+0000","last_peered":"2024-09-12T19:30:35.176909+0000","last_clean":"2024-09-12T19:30:35.176909+0000","last_became_active":"2024-09-12T17:58:47.250364+0000","last_became_peered":"2024-09-12T17:58:47.250364+0000","last_unstale":"2024-09-12T19:30:35.176909+0000","last_undegraded":"2024-09-12T19:30:35.176909+0000","last_fullsized":"2024-09-12T19:30:35.176909+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:35.176723+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:35.176723+0000","last_clean_scrub_stamp":"2024-09-12T19:30:35.176723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:18.652063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.593137+0000","last_change":"2024-09-12T19:30:26.593137+0000","last_active":"2024-09-12T19:30:26.593137+0000","last_peered":"2024-09-12T19:30:26.593137+0000","last_clean":"2024-09-12T19:30:26.593137+0000","last_became_active":"2024-09-12T17:58:40.212280+0000","last_became_peered":"2024-09-12T17:58:40.212280+0000","last_unstale":"2024-09-12T19:30:26.593137+0000","last_undegraded":"2024-09-12T19:30:26.593137+0000","last_fullsized":"2024-09-12T19:30:26.593137+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:26.592949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:26.592949+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.592949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.408090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'30","reported_seq":160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.501810+0000","last_change":"2024-09-12T19:30:20.501810+0000","last_active":"2024-09-12T19:30:20.501810+0000","last_peered":"2024-09-12T19:30:20.501810+0000","last_clean":"2024-09-12T19:30:20.501810+0000","last_became_active":"2024-09-12T17:52:39.870304+0000","last_became_peered":"2024-09-12T17:52:39.870304+0000","last_unstale":"2024-09-12T19:30:20.501810+0000","last_undegraded":"2024-09-12T19:30:20.501810+0000","last_fullsized":"2024-09-12T19:30:20.501810+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:30:20.501593+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:30:20.501593+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.501593+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:29.819395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":59,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:44.865569+0000","last_change":"2024-09-12T19:30:44.865569+0000","last_active":"2024-09-12T19:30:44.865569+0000","last_peered":"2024-09-12T19:30:44.865569+0000","last_clean":"2024-09-12T19:30:44.865569+0000","last_became_active":"2024-09-12T18:25:52.622842+0000","last_became_peered":"2024-09-12T18:25:52.622842+0000","last_unstale":"2024-09-12T19:30:44.865569+0000","last_undegraded":"2024-09-12T19:30:44.865569+0000","last_fullsized":"2024-09-12T19:30:44.865569+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:44.865342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:44.865342+0000","last_clean_scrub_stamp":"2024-09-12T19:30:44.865342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:40.545971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'4","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:36.176010+0000","last_change":"2024-09-12T19:30:36.175874+0000","last_active":"2024-09-12T19:30:36.176010+0000","last_peered":"2024-09-12T19:30:36.176010+0000","last_clean":"2024-09-12T19:30:36.176010+0000","last_became_active":"2024-09-12T17:58:47.255379+0000","last_became_peered":"2024-09-12T17:58:47.255379+0000","last_unstale":"2024-09-12T19:30:36.176010+0000","last_undegraded":"2024-09-12T19:30:36.176010+0000","last_fullsized":"2024-09-12T19:30:36.176010+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:36.175697+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:36.175697+0000","last_clean_scrub_stamp":"2024-09-12T19:30:36.175697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:45.701012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:50.376095+0000","last_change":"2024-09-12T17:58:40.194167+0000","last_active":"2024-09-12T19:27:50.376095+0000","last_peered":"2024-09-12T19:27:50.376095+0000","last_clean":"2024-09-12T19:27:50.376095+0000","last_became_active":"2024-09-12T17:58:40.193471+0000","last_became_peered":"2024-09-12T17:58:40.193471+0000","last_unstale":"2024-09-12T19:27:50.376095+0000","last_undegraded":"2024-09-12T19:27:50.376095+0000","last_fullsized":"2024-09-12T19:27:50.376095+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'46","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.946456+0000","last_change":"2024-09-12T19:30:27.946456+0000","last_active":"2024-09-12T19:30:27.946456+0000","last_peered":"2024-09-12T19:30:27.946456+0000","last_clean":"2024-09-12T19:30:27.946456+0000","last_became_active":"2024-09-12T17:52:39.883248+0000","last_became_peered":"2024-09-12T17:52:39.883248+0000","last_unstale":"2024-09-12T19:30:27.946456+0000","last_undegraded":"2024-09-12T19:30:27.946456+0000","last_fullsized":"2024-09-12T19:30:27.946456+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'46","last_scrub_stamp":"2024-09-12T19:30:27.946256+0000","last_deep_scrub":"265'46","last_deep_scrub_stamp":"2024-09-12T19:30:27.946256+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.946256+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:52.487534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":156,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.660257+0000","last_change":"2024-09-12T19:30:28.660257+0000","last_active":"2024-09-12T19:30:28.660257+0000","last_peered":"2024-09-12T19:30:28.660257+0000","last_clean":"2024-09-12T19:30:28.660257+0000","last_became_active":"2024-09-12T18:25:52.611620+0000","last_became_peered":"2024-09-12T18:25:52.611620+0000","last_unstale":"2024-09-12T19:30:28.660257+0000","last_undegraded":"2024-09-12T19:30:28.660257+0000","last_fullsized":"2024-09-12T19:30:28.660257+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:28.660072+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:28.660072+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.660072+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:33.213545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'7","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:36.798251+0000","last_change":"2024-09-12T19:30:36.798251+0000","last_active":"2024-09-12T19:30:36.798251+0000","last_peered":"2024-09-12T19:30:36.798251+0000","last_clean":"2024-09-12T19:30:36.798251+0000","last_became_active":"2024-09-12T17:58:47.249833+0000","last_became_peered":"2024-09-12T17:58:47.249833+0000","last_unstale":"2024-09-12T19:30:36.798251+0000","last_undegraded":"2024-09-12T19:30:36.798251+0000","last_fullsized":"2024-09-12T19:30:36.798251+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:36.797967+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:36.797967+0000","last_clean_scrub_stamp":"2024-09-12T19:30:36.797967+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:44.588825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.515242+0000","last_change":"2024-09-12T19:30:12.515110+0000","last_active":"2024-09-12T19:30:12.515242+0000","last_peered":"2024-09-12T19:30:12.515242+0000","last_clean":"2024-09-12T19:30:12.515242+0000","last_became_active":"2024-09-12T17:58:40.203917+0000","last_became_peered":"2024-09-12T17:58:40.203917+0000","last_unstale":"2024-09-12T19:30:12.515242+0000","last_undegraded":"2024-09-12T19:30:12.515242+0000","last_fullsized":"2024-09-12T19:30:12.515242+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:12.514935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:12.514935+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.514935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:32.269384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.964887+0000","last_change":"2024-09-12T19:30:26.964887+0000","last_active":"2024-09-12T19:30:26.964887+0000","last_peered":"2024-09-12T19:30:26.964887+0000","last_clean":"2024-09-12T19:30:26.964887+0000","last_became_active":"2024-09-12T17:52:39.884285+0000","last_became_peered":"2024-09-12T17:52:39.884285+0000","last_unstale":"2024-09-12T19:30:26.964887+0000","last_undegraded":"2024-09-12T19:30:26.964887+0000","last_fullsized":"2024-09-12T19:30:26.964887+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T19:30:26.964706+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T19:30:26.964706+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.964706+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:47.546323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.595080+0000","last_change":"2024-09-12T19:30:28.595080+0000","last_active":"2024-09-12T19:30:28.595080+0000","last_peered":"2024-09-12T19:30:28.595080+0000","last_clean":"2024-09-12T19:30:28.595080+0000","last_became_active":"2024-09-12T18:25:52.623502+0000","last_became_peered":"2024-09-12T18:25:52.623502+0000","last_unstale":"2024-09-12T19:30:28.595080+0000","last_undegraded":"2024-09-12T19:30:28.595080+0000","last_fullsized":"2024-09-12T19:30:28.595080+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:28.594903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:28.594903+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.594903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:26.161731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'7","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:34.185787+0000","last_change":"2024-09-12T19:30:34.185622+0000","last_active":"2024-09-12T19:30:34.185787+0000","last_peered":"2024-09-12T19:30:34.185787+0000","last_clean":"2024-09-12T19:30:34.185787+0000","last_became_active":"2024-09-12T17:58:47.256721+0000","last_became_peered":"2024-09-12T17:58:47.256721+0000","last_unstale":"2024-09-12T19:30:34.185787+0000","last_undegraded":"2024-09-12T19:30:34.185787+0000","last_fullsized":"2024-09-12T19:30:34.185787+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:34.185441+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:34.185441+0000","last_clean_scrub_stamp":"2024-09-12T19:30:34.185441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:35.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16424,"num_write":12,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.151097+0000","last_change":"2024-09-12T19:30:25.150955+0000","last_active":"2024-09-12T19:30:25.151097+0000","last_peered":"2024-09-12T19:30:25.151097+0000","last_clean":"2024-09-12T19:30:25.151097+0000","last_became_active":"2024-09-12T17:58:40.198765+0000","last_became_peered":"2024-09-12T17:58:40.198765+0000","last_unstale":"2024-09-12T19:30:25.151097+0000","last_undegraded":"2024-09-12T19:30:25.151097+0000","last_fullsized":"2024-09-12T19:30:25.151097+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:25.150777+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:25.150777+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.150777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:35.360638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'58","reported_seq":232,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.136126+0000","last_change":"2024-09-12T19:30:20.136126+0000","last_active":"2024-09-12T19:30:20.136126+0000","last_peered":"2024-09-12T19:30:20.136126+0000","last_clean":"2024-09-12T19:30:20.136126+0000","last_became_active":"2024-09-12T17:52:39.885875+0000","last_became_peered":"2024-09-12T17:52:39.885875+0000","last_unstale":"2024-09-12T19:30:20.136126+0000","last_undegraded":"2024-09-12T19:30:20.136126+0000","last_fullsized":"2024-09-12T19:30:20.136126+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'58","last_scrub_stamp":"2024-09-12T19:30:20.135932+0000","last_deep_scrub":"265'58","last_deep_scrub_stamp":"2024-09-12T19:30:20.135932+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.135932+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:38.194208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":205,"num_write":103,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.548430+0000","last_change":"2024-09-12T19:30:23.548430+0000","last_active":"2024-09-12T19:30:23.548430+0000","last_peered":"2024-09-12T19:30:23.548430+0000","last_clean":"2024-09-12T19:30:23.548430+0000","last_became_active":"2024-09-12T18:25:52.617665+0000","last_became_peered":"2024-09-12T18:25:52.617665+0000","last_unstale":"2024-09-12T19:30:23.548430+0000","last_undegraded":"2024-09-12T19:30:23.548430+0000","last_fullsized":"2024-09-12T19:30:23.548430+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:23.548235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:23.548235+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.548235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:56.734201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'5","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.507942+0000","last_change":"2024-09-12T19:30:16.507812+0000","last_active":"2024-09-12T19:30:16.507942+0000","last_peered":"2024-09-12T19:30:16.507942+0000","last_clean":"2024-09-12T19:30:16.507942+0000","last_became_active":"2024-09-12T17:58:47.253819+0000","last_became_peered":"2024-09-12T17:58:47.253819+0000","last_unstale":"2024-09-12T19:30:16.507942+0000","last_undegraded":"2024-09-12T19:30:16.507942+0000","last_fullsized":"2024-09-12T19:30:16.507942+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T19:30:16.507623+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T19:30:16.507623+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.507623+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:51.873967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.803872+0000","last_change":"2024-09-12T19:30:28.803706+0000","last_active":"2024-09-12T19:30:28.803872+0000","last_peered":"2024-09-12T19:30:28.803872+0000","last_clean":"2024-09-12T19:30:28.803872+0000","last_became_active":"2024-09-12T17:58:40.202790+0000","last_became_peered":"2024-09-12T17:58:40.202790+0000","last_unstale":"2024-09-12T19:30:28.803872+0000","last_undegraded":"2024-09-12T19:30:28.803872+0000","last_fullsized":"2024-09-12T19:30:28.803872+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:28.803523+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:28.803523+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.803523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:40.616987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'30","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:42.248224+0000","last_change":"2024-09-12T19:30:42.248224+0000","last_active":"2024-09-12T19:30:42.248224+0000","last_peered":"2024-09-12T19:30:42.248224+0000","last_clean":"2024-09-12T19:30:42.248224+0000","last_became_active":"2024-09-12T17:52:39.871009+0000","last_became_peered":"2024-09-12T17:52:39.871009+0000","last_unstale":"2024-09-12T19:30:42.248224+0000","last_undegraded":"2024-09-12T19:30:42.248224+0000","last_fullsized":"2024-09-12T19:30:42.248224+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:30:42.248000+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:30:42.248000+0000","last_clean_scrub_stamp":"2024-09-12T19:30:42.248000+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:06.477785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:20.250730+0000","last_change":"2024-09-12T18:25:52.620335+0000","last_active":"2024-09-12T19:26:20.250730+0000","last_peered":"2024-09-12T19:26:20.250730+0000","last_clean":"2024-09-12T19:26:20.250730+0000","last_became_active":"2024-09-12T18:25:52.617863+0000","last_became_peered":"2024-09-12T18:25:52.617863+0000","last_unstale":"2024-09-12T19:26:20.250730+0000","last_undegraded":"2024-09-12T19:26:20.250730+0000","last_fullsized":"2024-09-12T19:26:20.250730+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:38.215652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"262'2","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:37.776900+0000","last_change":"2024-09-12T19:30:37.776900+0000","last_active":"2024-09-12T19:30:37.776900+0000","last_peered":"2024-09-12T19:30:37.776900+0000","last_clean":"2024-09-12T19:30:37.776900+0000","last_became_active":"2024-09-12T17:58:47.247475+0000","last_became_peered":"2024-09-12T17:58:47.247475+0000","last_unstale":"2024-09-12T19:30:37.776900+0000","last_undegraded":"2024-09-12T19:30:37.776900+0000","last_fullsized":"2024-09-12T19:30:37.776900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:30:37.776699+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:30:37.776699+0000","last_clean_scrub_stamp":"2024-09-12T19:30:37.776699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.223683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"265'5","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.800883+0000","last_change":"2024-09-12T19:30:21.800883+0000","last_active":"2024-09-12T19:30:21.800883+0000","last_peered":"2024-09-12T19:30:21.800883+0000","last_clean":"2024-09-12T19:30:21.800883+0000","last_became_active":"2024-09-12T17:58:40.202141+0000","last_became_peered":"2024-09-12T17:58:40.202141+0000","last_unstale":"2024-09-12T19:30:21.800883+0000","last_undegraded":"2024-09-12T19:30:21.800883+0000","last_fullsized":"2024-09-12T19:30:21.800883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:30:21.800695+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:30:21.800695+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.800695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:09.542151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'22","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:40.229444+0000","last_change":"2024-09-12T19:30:40.229308+0000","last_active":"2024-09-12T19:30:40.229444+0000","last_peered":"2024-09-12T19:30:40.229444+0000","last_clean":"2024-09-12T19:30:40.229444+0000","last_became_active":"2024-09-12T17:52:39.884686+0000","last_became_peered":"2024-09-12T17:52:39.884686+0000","last_unstale":"2024-09-12T19:30:40.229444+0000","last_undegraded":"2024-09-12T19:30:40.229444+0000","last_fullsized":"2024-09-12T19:30:40.229444+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'22","last_scrub_stamp":"2024-09-12T19:30:40.229124+0000","last_deep_scrub":"265'22","last_deep_scrub_stamp":"2024-09-12T19:30:40.229124+0000","last_clean_scrub_stamp":"2024-09-12T19:30:40.229124+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:07.610654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.647588+0000","last_change":"2024-09-12T19:30:30.647588+0000","last_active":"2024-09-12T19:30:30.647588+0000","last_peered":"2024-09-12T19:30:30.647588+0000","last_clean":"2024-09-12T19:30:30.647588+0000","last_became_active":"2024-09-12T18:25:52.611450+0000","last_became_peered":"2024-09-12T18:25:52.611450+0000","last_unstale":"2024-09-12T19:30:30.647588+0000","last_undegraded":"2024-09-12T19:30:30.647588+0000","last_fullsized":"2024-09-12T19:30:30.647588+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:30.647384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:30.647384+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.647384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:46.507582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'4","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:34.850807+0000","last_change":"2024-09-12T19:30:34.850807+0000","last_active":"2024-09-12T19:30:34.850807+0000","last_peered":"2024-09-12T19:30:34.850807+0000","last_clean":"2024-09-12T19:30:34.850807+0000","last_became_active":"2024-09-12T17:58:47.254061+0000","last_became_peered":"2024-09-12T17:58:47.254061+0000","last_unstale":"2024-09-12T19:30:34.850807+0000","last_undegraded":"2024-09-12T19:30:34.850807+0000","last_fullsized":"2024-09-12T19:30:34.850807+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:34.850620+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:34.850620+0000","last_clean_scrub_stamp":"2024-09-12T19:30:34.850620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:24.069233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'2","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.829303+0000","last_change":"2024-09-12T19:30:27.829303+0000","last_active":"2024-09-12T19:30:27.829303+0000","last_peered":"2024-09-12T19:30:27.829303+0000","last_clean":"2024-09-12T19:30:27.829303+0000","last_became_active":"2024-09-12T17:58:40.203144+0000","last_became_peered":"2024-09-12T17:58:40.203144+0000","last_unstale":"2024-09-12T19:30:27.829303+0000","last_undegraded":"2024-09-12T19:30:27.829303+0000","last_fullsized":"2024-09-12T19:30:27.829303+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:27.829119+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:27.829119+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.829119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:56.155590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"262'16","reported_seq":126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.148949+0000","last_change":"2024-09-12T19:30:19.148725+0000","last_active":"2024-09-12T19:30:19.148949+0000","last_peered":"2024-09-12T19:30:19.148949+0000","last_clean":"2024-09-12T19:30:19.148949+0000","last_became_active":"2024-09-12T17:52:39.878797+0000","last_became_peered":"2024-09-12T17:52:39.878797+0000","last_unstale":"2024-09-12T19:30:19.148949+0000","last_undegraded":"2024-09-12T19:30:19.148949+0000","last_fullsized":"2024-09-12T19:30:19.148949+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-12T19:30:19.148445+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-12T19:30:19.148445+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.148445+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:54.941095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:33.898644+0000","last_change":"2024-09-12T19:30:33.898644+0000","last_active":"2024-09-12T19:30:33.898644+0000","last_peered":"2024-09-12T19:30:33.898644+0000","last_clean":"2024-09-12T19:30:33.898644+0000","last_became_active":"2024-09-12T18:25:52.614949+0000","last_became_peered":"2024-09-12T18:25:52.614949+0000","last_unstale":"2024-09-12T19:30:33.898644+0000","last_undegraded":"2024-09-12T19:30:33.898644+0000","last_fullsized":"2024-09-12T19:30:33.898644+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:33.898460+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:33.898460+0000","last_clean_scrub_stamp":"2024-09-12T19:30:33.898460+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:59.103700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:32.137538+0000","last_change":"2024-09-12T19:30:32.137538+0000","last_active":"2024-09-12T19:30:32.137538+0000","last_peered":"2024-09-12T19:30:32.137538+0000","last_clean":"2024-09-12T19:30:32.137538+0000","last_became_active":"2024-09-12T17:58:47.246916+0000","last_became_peered":"2024-09-12T17:58:47.246916+0000","last_unstale":"2024-09-12T19:30:32.137538+0000","last_undegraded":"2024-09-12T19:30:32.137538+0000","last_fullsized":"2024-09-12T19:30:32.137538+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:32.137356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:32.137356+0000","last_clean_scrub_stamp":"2024-09-12T19:30:32.137356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:21.391591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"262'2","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.796126+0000","last_change":"2024-09-12T19:30:19.796126+0000","last_active":"2024-09-12T19:30:19.796126+0000","last_peered":"2024-09-12T19:30:19.796126+0000","last_clean":"2024-09-12T19:30:19.796126+0000","last_became_active":"2024-09-12T17:58:40.207311+0000","last_became_peered":"2024-09-12T17:58:40.207311+0000","last_unstale":"2024-09-12T19:30:19.796126+0000","last_undegraded":"2024-09-12T19:30:19.796126+0000","last_fullsized":"2024-09-12T19:30:19.796126+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:30:19.795842+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:30:19.795842+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.795842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:01.987352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'29","reported_seq":160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.452898+0000","last_change":"2024-09-12T19:30:23.452754+0000","last_active":"2024-09-12T19:30:23.452898+0000","last_peered":"2024-09-12T19:30:23.452898+0000","last_clean":"2024-09-12T19:30:23.452898+0000","last_became_active":"2024-09-12T17:52:39.867179+0000","last_became_peered":"2024-09-12T17:52:39.867179+0000","last_unstale":"2024-09-12T19:30:23.452898+0000","last_undegraded":"2024-09-12T19:30:23.452898+0000","last_fullsized":"2024-09-12T19:30:23.452898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T19:30:23.452558+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T19:30:23.452558+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.452558+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:54.100502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":56,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.695283+0000","last_change":"2024-09-12T19:30:29.695283+0000","last_active":"2024-09-12T19:30:29.695283+0000","last_peered":"2024-09-12T19:30:29.695283+0000","last_clean":"2024-09-12T19:30:29.695283+0000","last_became_active":"2024-09-12T18:25:52.610587+0000","last_became_peered":"2024-09-12T18:25:52.610587+0000","last_unstale":"2024-09-12T19:30:29.695283+0000","last_undegraded":"2024-09-12T19:30:29.695283+0000","last_fullsized":"2024-09-12T19:30:29.695283+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:29.695095+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:29.695095+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.695095+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:11.853621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:30.371113+0000","last_change":"2024-09-12T17:58:47.251206+0000","last_active":"2024-09-12T19:27:30.371113+0000","last_peered":"2024-09-12T19:27:30.371113+0000","last_clean":"2024-09-12T19:27:30.371113+0000","last_became_active":"2024-09-12T17:58:47.245601+0000","last_became_peered":"2024-09-12T17:58:47.245601+0000","last_unstale":"2024-09-12T19:27:30.371113+0000","last_undegraded":"2024-09-12T19:27:30.371113+0000","last_fullsized":"2024-09-12T19:27:30.371113+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'4","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.763420+0000","last_change":"2024-09-12T19:30:18.763420+0000","last_active":"2024-09-12T19:30:18.763420+0000","last_peered":"2024-09-12T19:30:18.763420+0000","last_clean":"2024-09-12T19:30:18.763420+0000","last_became_active":"2024-09-12T17:58:40.202408+0000","last_became_peered":"2024-09-12T17:58:40.202408+0000","last_unstale":"2024-09-12T19:30:18.763420+0000","last_undegraded":"2024-09-12T19:30:18.763420+0000","last_fullsized":"2024-09-12T19:30:18.763420+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T19:30:18.763226+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T19:30:18.763226+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.763226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:19.391027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":531,"num_write":4,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'109","reported_seq":451,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.106885+0000","last_change":"2024-09-12T19:30:18.106728+0000","last_active":"2024-09-12T19:30:18.106885+0000","last_peered":"2024-09-12T19:30:18.106885+0000","last_clean":"2024-09-12T19:30:18.106885+0000","last_became_active":"2024-09-12T17:52:39.880742+0000","last_became_peered":"2024-09-12T17:52:39.880742+0000","last_unstale":"2024-09-12T19:30:18.106885+0000","last_undegraded":"2024-09-12T19:30:18.106885+0000","last_fullsized":"2024-09-12T19:30:18.106885+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T19:30:18.106534+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T19:30:18.106534+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.106534+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:40.456813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":720,"num_read_kb":486,"num_write":145,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3486,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:42.898408+0000","last_change":"2024-09-12T19:30:42.898408+0000","last_active":"2024-09-12T19:30:42.898408+0000","last_peered":"2024-09-12T19:30:42.898408+0000","last_clean":"2024-09-12T19:30:42.898408+0000","last_became_active":"2024-09-12T18:25:52.605039+0000","last_became_peered":"2024-09-12T18:25:52.605039+0000","last_unstale":"2024-09-12T19:30:42.898408+0000","last_undegraded":"2024-09-12T19:30:42.898408+0000","last_fullsized":"2024-09-12T19:30:42.898408+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:42.898120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:42.898120+0000","last_clean_scrub_stamp":"2024-09-12T19:30:42.898120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:00.312731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'7","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.118254+0000","last_change":"2024-09-12T19:30:30.118254+0000","last_active":"2024-09-12T19:30:30.118254+0000","last_peered":"2024-09-12T19:30:30.118254+0000","last_clean":"2024-09-12T19:30:30.118254+0000","last_became_active":"2024-09-12T17:58:47.241778+0000","last_became_peered":"2024-09-12T17:58:47.241778+0000","last_unstale":"2024-09-12T19:30:30.118254+0000","last_undegraded":"2024-09-12T19:30:30.118254+0000","last_fullsized":"2024-09-12T19:30:30.118254+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:30.118028+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:30.118028+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.118028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:00.813338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3074,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.451881+0000","last_change":"2024-09-12T19:30:22.451881+0000","last_active":"2024-09-12T19:30:22.451881+0000","last_peered":"2024-09-12T19:30:22.451881+0000","last_clean":"2024-09-12T19:30:22.451881+0000","last_became_active":"2024-09-12T17:58:40.195309+0000","last_became_peered":"2024-09-12T17:58:40.195309+0000","last_unstale":"2024-09-12T19:30:22.451881+0000","last_undegraded":"2024-09-12T19:30:22.451881+0000","last_fullsized":"2024-09-12T19:30:22.451881+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:22.451699+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:22.451699+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.451699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:38.841086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'111","reported_seq":467,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.115973+0000","last_change":"2024-09-12T19:30:31.115973+0000","last_active":"2024-09-12T19:30:31.115973+0000","last_peered":"2024-09-12T19:30:31.115973+0000","last_clean":"2024-09-12T19:30:31.115973+0000","last_became_active":"2024-09-12T17:52:39.886185+0000","last_became_peered":"2024-09-12T17:52:39.886185+0000","last_unstale":"2024-09-12T19:30:31.115973+0000","last_undegraded":"2024-09-12T19:30:31.115973+0000","last_fullsized":"2024-09-12T19:30:31.115973+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'111","last_scrub_stamp":"2024-09-12T19:30:31.115790+0000","last_deep_scrub":"265'111","last_deep_scrub_stamp":"2024-09-12T19:30:31.115790+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.115790+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:27.218809+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":756,"num_read_kb":514,"num_write":140,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3479,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.797595+0000","last_change":"2024-09-12T19:30:25.797595+0000","last_active":"2024-09-12T19:30:25.797595+0000","last_peered":"2024-09-12T19:30:25.797595+0000","last_clean":"2024-09-12T19:30:25.797595+0000","last_became_active":"2024-09-12T18:25:52.623444+0000","last_became_peered":"2024-09-12T18:25:52.623444+0000","last_unstale":"2024-09-12T19:30:25.797595+0000","last_undegraded":"2024-09-12T19:30:25.797595+0000","last_fullsized":"2024-09-12T19:30:25.797595+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:25.797418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:25.797418+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.797418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:34.539442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.156992+0000","last_change":"2024-09-12T19:30:29.156992+0000","last_active":"2024-09-12T19:30:29.156992+0000","last_peered":"2024-09-12T19:30:29.156992+0000","last_clean":"2024-09-12T19:30:29.156992+0000","last_became_active":"2024-09-12T17:58:47.254273+0000","last_became_peered":"2024-09-12T17:58:47.254273+0000","last_unstale":"2024-09-12T19:30:29.156992+0000","last_undegraded":"2024-09-12T19:30:29.156992+0000","last_fullsized":"2024-09-12T19:30:29.156992+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:29.156811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:29.156811+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.156811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:54.104657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'2","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.560588+0000","last_change":"2024-09-12T19:30:25.560588+0000","last_active":"2024-09-12T19:30:25.560588+0000","last_peered":"2024-09-12T19:30:25.560588+0000","last_clean":"2024-09-12T19:30:25.560588+0000","last_became_active":"2024-09-12T17:58:40.202027+0000","last_became_peered":"2024-09-12T17:58:40.202027+0000","last_unstale":"2024-09-12T19:30:25.560588+0000","last_undegraded":"2024-09-12T19:30:25.560588+0000","last_fullsized":"2024-09-12T19:30:25.560588+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:25.560411+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:25.560411+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.560411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:21.949121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'31","reported_seq":161,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:39.245886+0000","last_change":"2024-09-12T19:30:39.245886+0000","last_active":"2024-09-12T19:30:39.245886+0000","last_peered":"2024-09-12T19:30:39.245886+0000","last_clean":"2024-09-12T19:30:39.245886+0000","last_became_active":"2024-09-12T17:52:39.877206+0000","last_became_peered":"2024-09-12T17:52:39.877206+0000","last_unstale":"2024-09-12T19:30:39.245886+0000","last_undegraded":"2024-09-12T19:30:39.245886+0000","last_fullsized":"2024-09-12T19:30:39.245886+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:30:39.245705+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:30:39.245705+0000","last_clean_scrub_stamp":"2024-09-12T19:30:39.245705+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:07.946652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":97,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:35.357743+0000","last_change":"2024-09-12T18:25:52.620716+0000","last_active":"2024-09-12T19:26:35.357743+0000","last_peered":"2024-09-12T19:26:35.357743+0000","last_clean":"2024-09-12T19:26:35.357743+0000","last_became_active":"2024-09-12T18:25:52.620045+0000","last_became_peered":"2024-09-12T18:25:52.620045+0000","last_unstale":"2024-09-12T19:26:35.357743+0000","last_undegraded":"2024-09-12T19:26:35.357743+0000","last_fullsized":"2024-09-12T19:26:35.357743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:58.464498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:33.150190+0000","last_change":"2024-09-12T19:30:33.150190+0000","last_active":"2024-09-12T19:30:33.150190+0000","last_peered":"2024-09-12T19:30:33.150190+0000","last_clean":"2024-09-12T19:30:33.150190+0000","last_became_active":"2024-09-12T17:58:47.252966+0000","last_became_peered":"2024-09-12T17:58:47.252966+0000","last_unstale":"2024-09-12T19:30:33.150190+0000","last_undegraded":"2024-09-12T19:30:33.150190+0000","last_fullsized":"2024-09-12T19:30:33.150190+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:33.150007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:33.150007+0000","last_clean_scrub_stamp":"2024-09-12T19:30:33.150007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:25.151589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'9","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.154254+0000","last_change":"2024-09-12T19:30:24.154254+0000","last_active":"2024-09-12T19:30:24.154254+0000","last_peered":"2024-09-12T19:30:24.154254+0000","last_clean":"2024-09-12T19:30:24.154254+0000","last_became_active":"2024-09-12T17:58:40.198161+0000","last_became_peered":"2024-09-12T17:58:40.198161+0000","last_unstale":"2024-09-12T19:30:24.154254+0000","last_undegraded":"2024-09-12T19:30:24.154254+0000","last_fullsized":"2024-09-12T19:30:24.154254+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T19:30:24.154077+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T19:30:24.154077+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.154077+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:21.687233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'31","reported_seq":162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.714425+0000","last_change":"2024-09-12T19:30:17.714425+0000","last_active":"2024-09-12T19:30:17.714425+0000","last_peered":"2024-09-12T19:30:17.714425+0000","last_clean":"2024-09-12T19:30:17.714425+0000","last_became_active":"2024-09-12T17:52:39.866342+0000","last_became_peered":"2024-09-12T17:52:39.866342+0000","last_unstale":"2024-09-12T19:30:17.714425+0000","last_undegraded":"2024-09-12T19:30:17.714425+0000","last_fullsized":"2024-09-12T19:30:17.714425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:30:17.714240+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:30:17.714240+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.714240+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:07.207076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":107,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.791871+0000","last_change":"2024-09-12T19:30:24.791871+0000","last_active":"2024-09-12T19:30:24.791871+0000","last_peered":"2024-09-12T19:30:24.791871+0000","last_clean":"2024-09-12T19:30:24.791871+0000","last_became_active":"2024-09-12T18:25:52.599679+0000","last_became_peered":"2024-09-12T18:25:52.599679+0000","last_unstale":"2024-09-12T19:30:24.791871+0000","last_undegraded":"2024-09-12T19:30:24.791871+0000","last_fullsized":"2024-09-12T19:30:24.791871+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:24.791652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:24.791652+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.791652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:49.255999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'2","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:33.844114+0000","last_change":"2024-09-12T19:30:33.844114+0000","last_active":"2024-09-12T19:30:33.844114+0000","last_peered":"2024-09-12T19:30:33.844114+0000","last_clean":"2024-09-12T19:30:33.844114+0000","last_became_active":"2024-09-12T17:58:47.255891+0000","last_became_peered":"2024-09-12T17:58:47.255891+0000","last_unstale":"2024-09-12T19:30:33.844114+0000","last_undegraded":"2024-09-12T19:30:33.844114+0000","last_fullsized":"2024-09-12T19:30:33.844114+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:33.843931+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:33.843931+0000","last_clean_scrub_stamp":"2024-09-12T19:30:33.843931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:40.478941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"262'3","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.242723+0000","last_change":"2024-09-12T19:30:27.242723+0000","last_active":"2024-09-12T19:30:27.242723+0000","last_peered":"2024-09-12T19:30:27.242723+0000","last_clean":"2024-09-12T19:30:27.242723+0000","last_became_active":"2024-09-12T17:58:40.211450+0000","last_became_peered":"2024-09-12T17:58:40.211450+0000","last_unstale":"2024-09-12T19:30:27.242723+0000","last_undegraded":"2024-09-12T19:30:27.242723+0000","last_fullsized":"2024-09-12T19:30:27.242723+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T19:30:27.242460+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T19:30:27.242460+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.242460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:42.454642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'25","reported_seq":152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.448771+0000","last_change":"2024-09-12T19:30:18.448771+0000","last_active":"2024-09-12T19:30:18.448771+0000","last_peered":"2024-09-12T19:30:18.448771+0000","last_clean":"2024-09-12T19:30:18.448771+0000","last_became_active":"2024-09-12T17:52:39.865914+0000","last_became_peered":"2024-09-12T17:52:39.865914+0000","last_unstale":"2024-09-12T19:30:18.448771+0000","last_undegraded":"2024-09-12T19:30:18.448771+0000","last_fullsized":"2024-09-12T19:30:18.448771+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T19:30:18.448582+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T19:30:18.448582+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.448582+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:59.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:43.896490+0000","last_change":"2024-09-12T19:30:43.896490+0000","last_active":"2024-09-12T19:30:43.896490+0000","last_peered":"2024-09-12T19:30:43.896490+0000","last_clean":"2024-09-12T19:30:43.896490+0000","last_became_active":"2024-09-12T18:25:52.612421+0000","last_became_peered":"2024-09-12T18:25:52.612421+0000","last_unstale":"2024-09-12T19:30:43.896490+0000","last_undegraded":"2024-09-12T19:30:43.896490+0000","last_fullsized":"2024-09-12T19:30:43.896490+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:43.896289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:43.896289+0000","last_clean_scrub_stamp":"2024-09-12T19:30:43.896289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:36.981829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'2","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.153845+0000","last_change":"2024-09-12T17:58:47.246522+0000","last_active":"2024-09-12T19:29:42.153845+0000","last_peered":"2024-09-12T19:29:42.153845+0000","last_clean":"2024-09-12T19:29:42.153845+0000","last_became_active":"2024-09-12T17:58:47.238172+0000","last_became_peered":"2024-09-12T17:58:47.238172+0000","last_unstale":"2024-09-12T19:29:42.153845+0000","last_undegraded":"2024-09-12T19:29:42.153845+0000","last_fullsized":"2024-09-12T19:29:42.153845+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'7","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.122090+0000","last_change":"2024-09-12T19:30:22.122090+0000","last_active":"2024-09-12T19:30:22.122090+0000","last_peered":"2024-09-12T19:30:22.122090+0000","last_clean":"2024-09-12T19:30:22.122090+0000","last_became_active":"2024-09-12T17:58:40.194093+0000","last_became_peered":"2024-09-12T17:58:40.194093+0000","last_unstale":"2024-09-12T19:30:22.122090+0000","last_undegraded":"2024-09-12T19:30:22.122090+0000","last_fullsized":"2024-09-12T19:30:22.122090+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:22.121867+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:22.121867+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.121867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:13.444419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'38","reported_seq":190,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.463274+0000","last_change":"2024-09-12T19:30:19.463274+0000","last_active":"2024-09-12T19:30:19.463274+0000","last_peered":"2024-09-12T19:30:19.463274+0000","last_clean":"2024-09-12T19:30:19.463274+0000","last_became_active":"2024-09-12T17:52:39.887302+0000","last_became_peered":"2024-09-12T17:52:39.887302+0000","last_unstale":"2024-09-12T19:30:19.463274+0000","last_undegraded":"2024-09-12T19:30:19.463274+0000","last_fullsized":"2024-09-12T19:30:19.463274+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T19:30:19.463087+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T19:30:19.463087+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.463087+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:51.782994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":146,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.607715+0000","last_change":"2024-09-12T19:30:29.607715+0000","last_active":"2024-09-12T19:30:29.607715+0000","last_peered":"2024-09-12T19:30:29.607715+0000","last_clean":"2024-09-12T19:30:29.607715+0000","last_became_active":"2024-09-12T18:25:52.611022+0000","last_became_peered":"2024-09-12T18:25:52.611022+0000","last_unstale":"2024-09-12T19:30:29.607715+0000","last_undegraded":"2024-09-12T19:30:29.607715+0000","last_fullsized":"2024-09-12T19:30:29.607715+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:29.607516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:29.607516+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.607516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:23.197838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"262'5","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.518145+0000","last_change":"2024-09-12T19:30:26.518145+0000","last_active":"2024-09-12T19:30:26.518145+0000","last_peered":"2024-09-12T19:30:26.518145+0000","last_clean":"2024-09-12T19:30:26.518145+0000","last_became_active":"2024-09-12T17:58:47.247599+0000","last_became_peered":"2024-09-12T17:58:47.247599+0000","last_unstale":"2024-09-12T19:30:26.518145+0000","last_undegraded":"2024-09-12T19:30:26.518145+0000","last_fullsized":"2024-09-12T19:30:26.518145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T19:30:26.517949+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T19:30:26.517949+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.517949+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:29.143936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'8","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.816842+0000","last_change":"2024-09-12T19:30:29.816842+0000","last_active":"2024-09-12T19:30:29.816842+0000","last_peered":"2024-09-12T19:30:29.816842+0000","last_clean":"2024-09-12T19:30:29.816842+0000","last_became_active":"2024-09-12T17:58:40.203177+0000","last_became_peered":"2024-09-12T17:58:40.203177+0000","last_unstale":"2024-09-12T19:30:29.816842+0000","last_undegraded":"2024-09-12T19:30:29.816842+0000","last_fullsized":"2024-09-12T19:30:29.816842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:30:29.816657+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:30:29.816657+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.816657+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:14.672776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'30","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.469858+0000","last_change":"2024-09-12T19:30:14.469599+0000","last_active":"2024-09-12T19:30:14.469858+0000","last_peered":"2024-09-12T19:30:14.469858+0000","last_clean":"2024-09-12T19:30:14.469858+0000","last_became_active":"2024-09-12T17:52:39.877793+0000","last_became_peered":"2024-09-12T17:52:39.877793+0000","last_unstale":"2024-09-12T19:30:14.469858+0000","last_undegraded":"2024-09-12T19:30:14.469858+0000","last_fullsized":"2024-09-12T19:30:14.469858+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:30:14.469391+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:30:14.469391+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.469391+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:09.596072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.583339+0000","last_change":"2024-09-12T19:30:21.583339+0000","last_active":"2024-09-12T19:30:21.583339+0000","last_peered":"2024-09-12T19:30:21.583339+0000","last_clean":"2024-09-12T19:30:21.583339+0000","last_became_active":"2024-09-12T18:25:52.617815+0000","last_became_peered":"2024-09-12T18:25:52.617815+0000","last_unstale":"2024-09-12T19:30:21.583339+0000","last_undegraded":"2024-09-12T19:30:21.583339+0000","last_fullsized":"2024-09-12T19:30:21.583339+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:21.583159+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:21.583159+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.583159+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:14.492012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.630190+0000","last_change":"2024-09-12T19:30:27.630190+0000","last_active":"2024-09-12T19:30:27.630190+0000","last_peered":"2024-09-12T19:30:27.630190+0000","last_clean":"2024-09-12T19:30:27.630190+0000","last_became_active":"2024-09-12T17:58:47.256924+0000","last_became_peered":"2024-09-12T17:58:47.256924+0000","last_unstale":"2024-09-12T19:30:27.630190+0000","last_undegraded":"2024-09-12T19:30:27.630190+0000","last_fullsized":"2024-09-12T19:30:27.630190+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:27.630005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:27.630005+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.630005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:00.280135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.137520+0000","last_change":"2024-09-12T19:30:23.137520+0000","last_active":"2024-09-12T19:30:23.137520+0000","last_peered":"2024-09-12T19:30:23.137520+0000","last_clean":"2024-09-12T19:30:23.137520+0000","last_became_active":"2024-09-12T17:58:40.193786+0000","last_became_peered":"2024-09-12T17:58:40.193786+0000","last_unstale":"2024-09-12T19:30:23.137520+0000","last_undegraded":"2024-09-12T19:30:23.137520+0000","last_fullsized":"2024-09-12T19:30:23.137520+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:23.137344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:23.137344+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.137344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:57.159246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'23","reported_seq":147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.775425+0000","last_change":"2024-09-12T19:30:25.775425+0000","last_active":"2024-09-12T19:30:25.775425+0000","last_peered":"2024-09-12T19:30:25.775425+0000","last_clean":"2024-09-12T19:30:25.775425+0000","last_became_active":"2024-09-12T17:52:39.869627+0000","last_became_peered":"2024-09-12T17:52:39.869627+0000","last_unstale":"2024-09-12T19:30:25.775425+0000","last_undegraded":"2024-09-12T19:30:25.775425+0000","last_fullsized":"2024-09-12T19:30:25.775425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'23","last_scrub_stamp":"2024-09-12T19:30:25.775151+0000","last_deep_scrub":"265'23","last_deep_scrub_stamp":"2024-09-12T19:30:25.775151+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.775151+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:26.357018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":43,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:39.144259+0000","last_change":"2024-09-12T19:30:39.144259+0000","last_active":"2024-09-12T19:30:39.144259+0000","last_peered":"2024-09-12T19:30:39.144259+0000","last_clean":"2024-09-12T19:30:39.144259+0000","last_became_active":"2024-09-12T18:25:52.624296+0000","last_became_peered":"2024-09-12T18:25:52.624296+0000","last_unstale":"2024-09-12T19:30:39.144259+0000","last_undegraded":"2024-09-12T19:30:39.144259+0000","last_fullsized":"2024-09-12T19:30:39.144259+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:39.144070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:39.144070+0000","last_clean_scrub_stamp":"2024-09-12T19:30:39.144070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:40.185851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"265'8","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.532548+0000","last_change":"2024-09-12T19:30:19.532548+0000","last_active":"2024-09-12T19:30:19.532548+0000","last_peered":"2024-09-12T19:30:19.532548+0000","last_clean":"2024-09-12T19:30:19.532548+0000","last_became_active":"2024-09-12T17:58:47.242874+0000","last_became_peered":"2024-09-12T17:58:47.242874+0000","last_unstale":"2024-09-12T19:30:19.532548+0000","last_undegraded":"2024-09-12T19:30:19.532548+0000","last_fullsized":"2024-09-12T19:30:19.532548+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:30:19.532362+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:30:19.532362+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.532362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:37.223457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9787,"num_write":8,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'5","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:44.235510+0000","last_change":"2024-09-12T19:30:44.235510+0000","last_active":"2024-09-12T19:30:44.235510+0000","last_peered":"2024-09-12T19:30:44.235510+0000","last_clean":"2024-09-12T19:30:44.235510+0000","last_became_active":"2024-09-12T17:58:40.175011+0000","last_became_peered":"2024-09-12T17:58:40.175011+0000","last_unstale":"2024-09-12T19:30:44.235510+0000","last_undegraded":"2024-09-12T19:30:44.235510+0000","last_fullsized":"2024-09-12T19:30:44.235510+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:30:44.235299+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:30:44.235299+0000","last_clean_scrub_stamp":"2024-09-12T19:30:44.235299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:34.346991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'56","reported_seq":242,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.530629+0000","last_change":"2024-09-12T19:30:13.530629+0000","last_active":"2024-09-12T19:30:13.530629+0000","last_peered":"2024-09-12T19:30:13.530629+0000","last_clean":"2024-09-12T19:30:13.530629+0000","last_became_active":"2024-09-12T17:52:39.884599+0000","last_became_peered":"2024-09-12T17:52:39.884599+0000","last_unstale":"2024-09-12T19:30:13.530629+0000","last_undegraded":"2024-09-12T19:30:13.530629+0000","last_fullsized":"2024-09-12T19:30:13.530629+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'56","last_scrub_stamp":"2024-09-12T19:30:13.530439+0000","last_deep_scrub":"265'56","last_deep_scrub_stamp":"2024-09-12T19:30:13.530439+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.530439+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:08.962809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":231,"num_write":89,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.567749+0000","last_change":"2024-09-12T19:30:22.567612+0000","last_active":"2024-09-12T19:30:22.567749+0000","last_peered":"2024-09-12T19:30:22.567749+0000","last_clean":"2024-09-12T19:30:22.567749+0000","last_became_active":"2024-09-12T18:25:52.602495+0000","last_became_peered":"2024-09-12T18:25:52.602495+0000","last_unstale":"2024-09-12T19:30:22.567749+0000","last_undegraded":"2024-09-12T19:30:22.567749+0000","last_fullsized":"2024-09-12T19:30:22.567749+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.567427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.567427+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.567427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:55.493271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'12","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:35.841077+0000","last_change":"2024-09-12T19:30:35.841077+0000","last_active":"2024-09-12T19:30:35.841077+0000","last_peered":"2024-09-12T19:30:35.841077+0000","last_clean":"2024-09-12T19:30:35.841077+0000","last_became_active":"2024-09-12T17:58:47.254272+0000","last_became_peered":"2024-09-12T17:58:47.254272+0000","last_unstale":"2024-09-12T19:30:35.841077+0000","last_undegraded":"2024-09-12T19:30:35.841077+0000","last_fullsized":"2024-09-12T19:30:35.841077+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T19:30:35.840886+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T19:30:35.840886+0000","last_clean_scrub_stamp":"2024-09-12T19:30:35.840886+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:33.031696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":22,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'6","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:41.809942+0000","last_change":"2024-09-12T17:58:40.195873+0000","last_active":"2024-09-12T19:29:41.809942+0000","last_peered":"2024-09-12T19:29:41.809942+0000","last_clean":"2024-09-12T19:29:41.809942+0000","last_became_active":"2024-09-12T17:58:40.195089+0000","last_became_peered":"2024-09-12T17:58:40.195089+0000","last_unstale":"2024-09-12T19:29:41.809942+0000","last_undegraded":"2024-09-12T19:29:41.809942+0000","last_fullsized":"2024-09-12T19:29:41.809942+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:39.137040+0000","last_clean_scrub_stamp":"2024-09-12T17:58:39.137040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'27","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.974452+0000","last_change":"2024-09-12T19:30:25.974452+0000","last_active":"2024-09-12T19:30:25.974452+0000","last_peered":"2024-09-12T19:30:25.974452+0000","last_clean":"2024-09-12T19:30:25.974452+0000","last_became_active":"2024-09-12T17:52:39.867605+0000","last_became_peered":"2024-09-12T17:52:39.867605+0000","last_unstale":"2024-09-12T19:30:25.974452+0000","last_undegraded":"2024-09-12T19:30:25.974452+0000","last_fullsized":"2024-09-12T19:30:25.974452+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'27","last_scrub_stamp":"2024-09-12T19:30:25.974246+0000","last_deep_scrub":"265'27","last_deep_scrub_stamp":"2024-09-12T19:30:25.974246+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.974246+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:41.321941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":99,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.578467+0000","last_change":"2024-09-12T19:30:20.578328+0000","last_active":"2024-09-12T19:30:20.578467+0000","last_peered":"2024-09-12T19:30:20.578467+0000","last_clean":"2024-09-12T19:30:20.578467+0000","last_became_active":"2024-09-12T18:25:52.614383+0000","last_became_peered":"2024-09-12T18:25:52.614383+0000","last_unstale":"2024-09-12T19:30:20.578467+0000","last_undegraded":"2024-09-12T19:30:20.578467+0000","last_fullsized":"2024-09-12T19:30:20.578467+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:20.578143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:20.578143+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.578143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:29.627919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"265'5","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:32.827111+0000","last_change":"2024-09-12T19:30:32.827111+0000","last_active":"2024-09-12T19:30:32.827111+0000","last_peered":"2024-09-12T19:30:32.827111+0000","last_clean":"2024-09-12T19:30:32.827111+0000","last_became_active":"2024-09-12T17:58:47.248924+0000","last_became_peered":"2024-09-12T17:58:47.248924+0000","last_unstale":"2024-09-12T19:30:32.827111+0000","last_undegraded":"2024-09-12T19:30:32.827111+0000","last_fullsized":"2024-09-12T19:30:32.827111+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:30:32.826919+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:30:32.826919+0000","last_clean_scrub_stamp":"2024-09-12T19:30:32.826919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:46.671251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.919959+0000","last_change":"2024-09-12T19:30:30.919807+0000","last_active":"2024-09-12T19:30:30.919959+0000","last_peered":"2024-09-12T19:30:30.919959+0000","last_clean":"2024-09-12T19:30:30.919959+0000","last_became_active":"2024-09-12T17:58:40.187590+0000","last_became_peered":"2024-09-12T17:58:40.187590+0000","last_unstale":"2024-09-12T19:30:30.919959+0000","last_undegraded":"2024-09-12T19:30:30.919959+0000","last_fullsized":"2024-09-12T19:30:30.919959+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:30.919623+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:30.919623+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.919623+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:16.426133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'13","reported_seq":120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:37.258617+0000","last_change":"2024-09-12T19:30:37.258617+0000","last_active":"2024-09-12T19:30:37.258617+0000","last_peered":"2024-09-12T19:30:37.258617+0000","last_clean":"2024-09-12T19:30:37.258617+0000","last_became_active":"2024-09-12T17:52:39.872599+0000","last_became_peered":"2024-09-12T17:52:39.872599+0000","last_unstale":"2024-09-12T19:30:37.258617+0000","last_undegraded":"2024-09-12T19:30:37.258617+0000","last_fullsized":"2024-09-12T19:30:37.258617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'13","last_scrub_stamp":"2024-09-12T19:30:37.258392+0000","last_deep_scrub":"265'13","last_deep_scrub_stamp":"2024-09-12T19:30:37.258392+0000","last_clean_scrub_stamp":"2024-09-12T19:30:37.258392+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:06.024933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:40.847306+0000","last_change":"2024-09-12T19:30:40.847306+0000","last_active":"2024-09-12T19:30:40.847306+0000","last_peered":"2024-09-12T19:30:40.847306+0000","last_clean":"2024-09-12T19:30:40.847306+0000","last_became_active":"2024-09-12T18:25:52.611377+0000","last_became_peered":"2024-09-12T18:25:52.611377+0000","last_unstale":"2024-09-12T19:30:40.847306+0000","last_undegraded":"2024-09-12T19:30:40.847306+0000","last_fullsized":"2024-09-12T19:30:40.847306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:40.847097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:40.847097+0000","last_clean_scrub_stamp":"2024-09-12T19:30:40.847097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:35.620192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'2","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.492975+0000","last_change":"2024-09-12T19:30:15.492975+0000","last_active":"2024-09-12T19:30:15.492975+0000","last_peered":"2024-09-12T19:30:15.492975+0000","last_clean":"2024-09-12T19:30:15.492975+0000","last_became_active":"2024-09-12T17:58:47.242171+0000","last_became_peered":"2024-09-12T17:58:47.242171+0000","last_unstale":"2024-09-12T19:30:15.492975+0000","last_undegraded":"2024-09-12T19:30:15.492975+0000","last_fullsized":"2024-09-12T19:30:15.492975+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:15.492790+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:15.492790+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.492790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:32.038503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.463614+0000","last_change":"2024-09-12T19:30:21.463614+0000","last_active":"2024-09-12T19:30:21.463614+0000","last_peered":"2024-09-12T19:30:21.463614+0000","last_clean":"2024-09-12T19:30:21.463614+0000","last_became_active":"2024-09-12T17:58:40.210485+0000","last_became_peered":"2024-09-12T17:58:40.210485+0000","last_unstale":"2024-09-12T19:30:21.463614+0000","last_undegraded":"2024-09-12T19:30:21.463614+0000","last_fullsized":"2024-09-12T19:30:21.463614+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:21.463437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:21.463437+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.463437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:34.504209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'25","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.476360+0000","last_change":"2024-09-12T19:30:19.476360+0000","last_active":"2024-09-12T19:30:19.476360+0000","last_peered":"2024-09-12T19:30:19.476360+0000","last_clean":"2024-09-12T19:30:19.476360+0000","last_became_active":"2024-09-12T17:52:39.868837+0000","last_became_peered":"2024-09-12T17:52:39.868837+0000","last_unstale":"2024-09-12T19:30:19.476360+0000","last_undegraded":"2024-09-12T19:30:19.476360+0000","last_fullsized":"2024-09-12T19:30:19.476360+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T19:30:19.476149+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T19:30:19.476149+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.476149+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:37.829486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:28:25.384468+0000","last_change":"2024-09-12T18:25:52.615446+0000","last_active":"2024-09-12T19:28:25.384468+0000","last_peered":"2024-09-12T19:28:25.384468+0000","last_clean":"2024-09-12T19:28:25.384468+0000","last_became_active":"2024-09-12T18:25:52.611546+0000","last_became_peered":"2024-09-12T18:25:52.611546+0000","last_unstale":"2024-09-12T19:28:25.384468+0000","last_undegraded":"2024-09-12T19:28:25.384468+0000","last_fullsized":"2024-09-12T19:28:25.384468+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'7","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:42.263769+0000","last_change":"2024-09-12T17:58:47.246295+0000","last_active":"2024-09-12T19:29:42.263769+0000","last_peered":"2024-09-12T19:29:42.263769+0000","last_clean":"2024-09-12T19:29:42.263769+0000","last_became_active":"2024-09-12T17:58:47.245441+0000","last_became_peered":"2024-09-12T17:58:47.245441+0000","last_unstale":"2024-09-12T19:29:42.263769+0000","last_undegraded":"2024-09-12T19:29:42.263769+0000","last_fullsized":"2024-09-12T19:29:42.263769+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:43.267676+0000","last_change":"2024-09-12T19:30:43.267676+0000","last_active":"2024-09-12T19:30:43.267676+0000","last_peered":"2024-09-12T19:30:43.267676+0000","last_clean":"2024-09-12T19:30:43.267676+0000","last_became_active":"2024-09-12T17:58:40.191999+0000","last_became_peered":"2024-09-12T17:58:40.191999+0000","last_unstale":"2024-09-12T19:30:43.267676+0000","last_undegraded":"2024-09-12T19:30:43.267676+0000","last_fullsized":"2024-09-12T19:30:43.267676+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:43.267489+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:43.267489+0000","last_clean_scrub_stamp":"2024-09-12T19:30:43.267489+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:49.617074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'36","reported_seq":181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.143137+0000","last_change":"2024-09-12T19:30:16.142894+0000","last_active":"2024-09-12T19:30:16.143137+0000","last_peered":"2024-09-12T19:30:16.143137+0000","last_clean":"2024-09-12T19:30:16.143137+0000","last_became_active":"2024-09-12T17:52:39.890678+0000","last_became_peered":"2024-09-12T17:52:39.890678+0000","last_unstale":"2024-09-12T19:30:16.143137+0000","last_undegraded":"2024-09-12T19:30:16.143137+0000","last_fullsized":"2024-09-12T19:30:16.143137+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'36","last_scrub_stamp":"2024-09-12T19:30:16.142621+0000","last_deep_scrub":"265'36","last_deep_scrub_stamp":"2024-09-12T19:30:16.142621+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.142621+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:52.794048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:37.143201+0000","last_change":"2024-09-12T19:30:37.143201+0000","last_active":"2024-09-12T19:30:37.143201+0000","last_peered":"2024-09-12T19:30:37.143201+0000","last_clean":"2024-09-12T19:30:37.143201+0000","last_became_active":"2024-09-12T18:25:52.611397+0000","last_became_peered":"2024-09-12T18:25:52.611397+0000","last_unstale":"2024-09-12T19:30:37.143201+0000","last_undegraded":"2024-09-12T19:30:37.143201+0000","last_fullsized":"2024-09-12T19:30:37.143201+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:37.143014+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:37.143014+0000","last_clean_scrub_stamp":"2024-09-12T19:30:37.143014+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:19.539816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:32.925907+0000","last_change":"2024-09-12T19:30:32.925907+0000","last_active":"2024-09-12T19:30:32.925907+0000","last_peered":"2024-09-12T19:30:32.925907+0000","last_clean":"2024-09-12T19:30:32.925907+0000","last_became_active":"2024-09-12T17:58:47.240951+0000","last_became_peered":"2024-09-12T17:58:47.240951+0000","last_unstale":"2024-09-12T19:30:32.925907+0000","last_undegraded":"2024-09-12T19:30:32.925907+0000","last_fullsized":"2024-09-12T19:30:32.925907+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:32.925725+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:32.925725+0000","last_clean_scrub_stamp":"2024-09-12T19:30:32.925725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:27.896521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.478912+0000","last_change":"2024-09-12T19:30:20.478912+0000","last_active":"2024-09-12T19:30:20.478912+0000","last_peered":"2024-09-12T19:30:20.478912+0000","last_clean":"2024-09-12T19:30:20.478912+0000","last_became_active":"2024-09-12T17:58:40.211891+0000","last_became_peered":"2024-09-12T17:58:40.211891+0000","last_unstale":"2024-09-12T19:30:20.478912+0000","last_undegraded":"2024-09-12T19:30:20.478912+0000","last_fullsized":"2024-09-12T19:30:20.478912+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:20.478718+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:20.478718+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.478718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:47.734936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'53","reported_seq":234,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.479256+0000","last_change":"2024-09-12T19:30:18.479087+0000","last_active":"2024-09-12T19:30:18.479256+0000","last_peered":"2024-09-12T19:30:18.479256+0000","last_clean":"2024-09-12T19:30:18.479256+0000","last_became_active":"2024-09-12T17:52:39.878694+0000","last_became_peered":"2024-09-12T17:52:39.878694+0000","last_unstale":"2024-09-12T19:30:18.479256+0000","last_undegraded":"2024-09-12T19:30:18.479256+0000","last_fullsized":"2024-09-12T19:30:18.479256+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'53","last_scrub_stamp":"2024-09-12T19:30:18.478904+0000","last_deep_scrub":"265'53","last_deep_scrub_stamp":"2024-09-12T19:30:18.478904+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.478904+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:35.429667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":199,"num_write":92,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.905412+0000","last_change":"2024-09-12T19:30:31.905412+0000","last_active":"2024-09-12T19:30:31.905412+0000","last_peered":"2024-09-12T19:30:31.905412+0000","last_clean":"2024-09-12T19:30:31.905412+0000","last_became_active":"2024-09-12T18:25:52.619540+0000","last_became_peered":"2024-09-12T18:25:52.619540+0000","last_unstale":"2024-09-12T19:30:31.905412+0000","last_undegraded":"2024-09-12T19:30:31.905412+0000","last_fullsized":"2024-09-12T19:30:31.905412+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:31.905231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:31.905231+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.905231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:40.276729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:27:20.368657+0000","last_change":"2024-09-12T17:58:47.245205+0000","last_active":"2024-09-12T19:27:20.368657+0000","last_peered":"2024-09-12T19:27:20.368657+0000","last_clean":"2024-09-12T19:27:20.368657+0000","last_became_active":"2024-09-12T17:58:47.238232+0000","last_became_peered":"2024-09-12T17:58:47.238232+0000","last_unstale":"2024-09-12T19:27:20.368657+0000","last_undegraded":"2024-09-12T19:27:20.368657+0000","last_fullsized":"2024-09-12T19:27:20.368657+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:58:46.186423+0000","last_clean_scrub_stamp":"2024-09-12T17:58:46.186423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:59.889739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"262'7","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:41.215775+0000","last_change":"2024-09-12T19:30:41.215775+0000","last_active":"2024-09-12T19:30:41.215775+0000","last_peered":"2024-09-12T19:30:41.215775+0000","last_clean":"2024-09-12T19:30:41.215775+0000","last_became_active":"2024-09-12T17:58:40.197815+0000","last_became_peered":"2024-09-12T17:58:40.197815+0000","last_unstale":"2024-09-12T19:30:41.215775+0000","last_undegraded":"2024-09-12T19:30:41.215775+0000","last_fullsized":"2024-09-12T19:30:41.215775+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T19:30:41.215580+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T19:30:41.215580+0000","last_clean_scrub_stamp":"2024-09-12T19:30:41.215580+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:04.960522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'72","reported_seq":282,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:36.304369+0000","last_change":"2024-09-12T19:30:36.304369+0000","last_active":"2024-09-12T19:30:36.304369+0000","last_peered":"2024-09-12T19:30:36.304369+0000","last_clean":"2024-09-12T19:30:36.304369+0000","last_became_active":"2024-09-12T17:52:39.872148+0000","last_became_peered":"2024-09-12T17:52:39.872148+0000","last_unstale":"2024-09-12T19:30:36.304369+0000","last_undegraded":"2024-09-12T19:30:36.304369+0000","last_fullsized":"2024-09-12T19:30:36.304369+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'72","last_scrub_stamp":"2024-09-12T19:30:36.304121+0000","last_deep_scrub":"265'72","last_deep_scrub_stamp":"2024-09-12T19:30:36.304121+0000","last_clean_scrub_stamp":"2024-09-12T19:30:36.304121+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.696522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":261,"num_write":116,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:41.861535+0000","last_change":"2024-09-12T19:30:41.861535+0000","last_active":"2024-09-12T19:30:41.861535+0000","last_peered":"2024-09-12T19:30:41.861535+0000","last_clean":"2024-09-12T19:30:41.861535+0000","last_became_active":"2024-09-12T18:25:52.623635+0000","last_became_peered":"2024-09-12T18:25:52.623635+0000","last_unstale":"2024-09-12T19:30:41.861535+0000","last_undegraded":"2024-09-12T19:30:41.861535+0000","last_fullsized":"2024-09-12T19:30:41.861535+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:41.861339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:41.861339+0000","last_clean_scrub_stamp":"2024-09-12T19:30:41.861339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:56.500759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"265'9","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.469622+0000","last_change":"2024-09-12T19:30:25.469335+0000","last_active":"2024-09-12T19:30:25.469622+0000","last_peered":"2024-09-12T19:30:25.469622+0000","last_clean":"2024-09-12T19:30:25.469622+0000","last_became_active":"2024-09-12T17:58:47.250762+0000","last_became_peered":"2024-09-12T17:58:47.250762+0000","last_unstale":"2024-09-12T19:30:25.469622+0000","last_undegraded":"2024-09-12T19:30:25.469622+0000","last_fullsized":"2024-09-12T19:30:25.469622+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T19:30:25.469089+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T19:30:25.469089+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.469089+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:31.683645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9216,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.511211+0000","last_change":"2024-09-12T19:30:24.511211+0000","last_active":"2024-09-12T19:30:24.511211+0000","last_peered":"2024-09-12T19:30:24.511211+0000","last_clean":"2024-09-12T19:30:24.511211+0000","last_became_active":"2024-09-12T17:58:40.210072+0000","last_became_peered":"2024-09-12T17:58:40.210072+0000","last_unstale":"2024-09-12T19:30:24.511211+0000","last_undegraded":"2024-09-12T19:30:24.511211+0000","last_fullsized":"2024-09-12T19:30:24.511211+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:24.511036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:24.511036+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.511036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:53.909940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'26","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:35.294009+0000","last_change":"2024-09-12T19:30:35.293869+0000","last_active":"2024-09-12T19:30:35.294009+0000","last_peered":"2024-09-12T19:30:35.294009+0000","last_clean":"2024-09-12T19:30:35.294009+0000","last_became_active":"2024-09-12T17:52:39.871247+0000","last_became_peered":"2024-09-12T17:52:39.871247+0000","last_unstale":"2024-09-12T19:30:35.294009+0000","last_undegraded":"2024-09-12T19:30:35.294009+0000","last_fullsized":"2024-09-12T19:30:35.294009+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'26","last_scrub_stamp":"2024-09-12T19:30:35.293683+0000","last_deep_scrub":"265'26","last_deep_scrub_stamp":"2024-09-12T19:30:35.293683+0000","last_clean_scrub_stamp":"2024-09-12T19:30:35.293683+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:25.730685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":46,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:26:40.359612+0000","last_change":"2024-09-12T18:25:52.622440+0000","last_active":"2024-09-12T19:26:40.359612+0000","last_peered":"2024-09-12T19:26:40.359612+0000","last_clean":"2024-09-12T19:26:40.359612+0000","last_became_active":"2024-09-12T18:25:52.621808+0000","last_became_peered":"2024-09-12T18:25:52.621808+0000","last_unstale":"2024-09-12T19:26:40.359612+0000","last_undegraded":"2024-09-12T19:26:40.359612+0000","last_fullsized":"2024-09-12T19:26:40.359612+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:25:51.559134+0000","last_clean_scrub_stamp":"2024-09-12T18:25:51.559134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:05.559442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'2","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.477805+0000","last_change":"2024-09-12T19:30:24.477589+0000","last_active":"2024-09-12T19:30:24.477805+0000","last_peered":"2024-09-12T19:30:24.477805+0000","last_clean":"2024-09-12T19:30:24.477805+0000","last_became_active":"2024-09-12T17:58:47.236237+0000","last_became_peered":"2024-09-12T17:58:47.236237+0000","last_unstale":"2024-09-12T19:30:24.477805+0000","last_undegraded":"2024-09-12T19:30:24.477805+0000","last_fullsized":"2024-09-12T19:30:24.477805+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:24.477402+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:24.477402+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.477402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:07.709944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'8","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.783282+0000","last_change":"2024-09-12T19:30:20.783282+0000","last_active":"2024-09-12T19:30:20.783282+0000","last_peered":"2024-09-12T19:30:20.783282+0000","last_clean":"2024-09-12T19:30:20.783282+0000","last_became_active":"2024-09-12T17:58:40.207179+0000","last_became_peered":"2024-09-12T17:58:40.207179+0000","last_unstale":"2024-09-12T19:30:20.783282+0000","last_undegraded":"2024-09-12T19:30:20.783282+0000","last_fullsized":"2024-09-12T19:30:20.783282+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:30:20.783056+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:30:20.783056+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.783056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:48.399945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'9","reported_seq":109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.423335+0000","last_change":"2024-09-12T19:30:13.423335+0000","last_active":"2024-09-12T19:30:13.423335+0000","last_peered":"2024-09-12T19:30:13.423335+0000","last_clean":"2024-09-12T19:30:13.423335+0000","last_became_active":"2024-09-12T17:52:39.883782+0000","last_became_peered":"2024-09-12T17:52:39.883782+0000","last_unstale":"2024-09-12T19:30:13.423335+0000","last_undegraded":"2024-09-12T19:30:13.423335+0000","last_fullsized":"2024-09-12T19:30:13.423335+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T19:30:13.423150+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T19:30:13.423150+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.423150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:09.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'340","reported_seq":1126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.399985+0000","last_change":"2024-09-12T19:29:55.399985+0000","last_active":"2024-09-12T19:29:55.399985+0000","last_peered":"2024-09-12T19:29:55.399985+0000","last_clean":"2024-09-12T19:29:55.399985+0000","last_became_active":"2024-09-12T17:36:34.874529+0000","last_became_peered":"2024-09-12T17:36:34.874529+0000","last_unstale":"2024-09-12T19:29:55.399985+0000","last_undegraded":"2024-09-12T19:29:55.399985+0000","last_fullsized":"2024-09-12T19:29:55.399985+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T19:29:55.399703+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T19:29:55.399703+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.399703+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:53.827613+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424460,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":579,"num_read_kb":47675,"num_write":1041,"num_write_kb":57869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'949","reported_seq":2628,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.911343+0000","last_change":"2024-09-12T19:29:59.911343+0000","last_active":"2024-09-12T19:29:59.911343+0000","last_peered":"2024-09-12T19:29:59.911343+0000","last_clean":"2024-09-12T19:29:59.911343+0000","last_became_active":"2024-09-12T17:36:36.881586+0000","last_became_peered":"2024-09-12T17:36:36.881586+0000","last_unstale":"2024-09-12T19:29:59.911343+0000","last_undegraded":"2024-09-12T19:29:59.911343+0000","last_fullsized":"2024-09-12T19:29:59.911343+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'949","last_scrub_stamp":"2024-09-12T19:29:59.911151+0000","last_deep_scrub":"265'949","last_deep_scrub_stamp":"2024-09-12T19:29:59.911151+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.911151+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:42.321351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4539,"num_read_kb":4030,"num_write":1302,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'367","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.972021+0000","last_change":"2024-09-12T19:30:00.972021+0000","last_active":"2024-09-12T19:30:00.972021+0000","last_peered":"2024-09-12T19:30:00.972021+0000","last_clean":"2024-09-12T19:30:00.972021+0000","last_became_active":"2024-09-12T17:36:34.886040+0000","last_became_peered":"2024-09-12T17:36:34.886040+0000","last_unstale":"2024-09-12T19:30:00.972021+0000","last_undegraded":"2024-09-12T19:30:00.972021+0000","last_fullsized":"2024-09-12T19:30:00.972021+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T19:30:00.971806+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T19:30:00.971806+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.971806+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:45.651742+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1749425,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":512,"num_read_kb":42124,"num_write":1111,"num_write_kb":49494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'797","reported_seq":2325,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.171881+0000","last_change":"2024-09-12T19:30:13.171881+0000","last_active":"2024-09-12T19:30:13.171881+0000","last_peered":"2024-09-12T19:30:13.171881+0000","last_clean":"2024-09-12T19:30:13.171881+0000","last_became_active":"2024-09-12T17:36:36.875285+0000","last_became_peered":"2024-09-12T17:36:36.875285+0000","last_unstale":"2024-09-12T19:30:13.171881+0000","last_undegraded":"2024-09-12T19:30:13.171881+0000","last_fullsized":"2024-09-12T19:30:13.171881+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'797","last_scrub_stamp":"2024-09-12T19:30:13.171686+0000","last_deep_scrub":"265'797","last_deep_scrub_stamp":"2024-09-12T19:30:13.171686+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.171686+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:53.547645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3836,"num_read_kb":3465,"num_write":1049,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'352","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.961930+0000","last_change":"2024-09-12T19:29:59.961930+0000","last_active":"2024-09-12T19:29:59.961930+0000","last_peered":"2024-09-12T19:29:59.961930+0000","last_clean":"2024-09-12T19:29:59.961930+0000","last_became_active":"2024-09-12T17:36:34.871993+0000","last_became_peered":"2024-09-12T17:36:34.871993+0000","last_unstale":"2024-09-12T19:29:59.961930+0000","last_undegraded":"2024-09-12T19:29:59.961930+0000","last_fullsized":"2024-09-12T19:29:59.961930+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:29:59.961681+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:29:59.961681+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.961681+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:19.644655+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":16153,"num_write":1071,"num_write_kb":33332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'912","reported_seq":2457,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.178935+0000","last_change":"2024-09-12T19:30:11.178935+0000","last_active":"2024-09-12T19:30:11.178935+0000","last_peered":"2024-09-12T19:30:11.178935+0000","last_clean":"2024-09-12T19:30:11.178935+0000","last_became_active":"2024-09-12T17:36:36.883008+0000","last_became_peered":"2024-09-12T17:36:36.883008+0000","last_unstale":"2024-09-12T19:30:11.178935+0000","last_undegraded":"2024-09-12T19:30:11.178935+0000","last_fullsized":"2024-09-12T19:30:11.178935+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'912","last_scrub_stamp":"2024-09-12T19:30:11.178746+0000","last_deep_scrub":"265'912","last_deep_scrub_stamp":"2024-09-12T19:30:11.178746+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.178746+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:42.625052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4392,"num_read_kb":3928,"num_write":1272,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2263,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'362","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.324843+0000","last_change":"2024-09-12T19:29:54.324843+0000","last_active":"2024-09-12T19:29:54.324843+0000","last_peered":"2024-09-12T19:29:54.324843+0000","last_clean":"2024-09-12T19:29:54.324843+0000","last_became_active":"2024-09-12T17:36:34.871414+0000","last_became_peered":"2024-09-12T17:36:34.871414+0000","last_unstale":"2024-09-12T19:29:54.324843+0000","last_undegraded":"2024-09-12T19:29:54.324843+0000","last_fullsized":"2024-09-12T19:29:54.324843+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T19:29:54.324634+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T19:29:54.324634+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.324634+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:16.548675+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":504,"num_read_kb":53693,"num_write":1108,"num_write_kb":40210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'837","reported_seq":2351,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.887607+0000","last_change":"2024-09-12T19:30:02.887607+0000","last_active":"2024-09-12T19:30:02.887607+0000","last_peered":"2024-09-12T19:30:02.887607+0000","last_clean":"2024-09-12T19:30:02.887607+0000","last_became_active":"2024-09-12T17:36:36.902241+0000","last_became_peered":"2024-09-12T17:36:36.902241+0000","last_unstale":"2024-09-12T19:30:02.887607+0000","last_undegraded":"2024-09-12T19:30:02.887607+0000","last_fullsized":"2024-09-12T19:30:02.887607+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'837","last_scrub_stamp":"2024-09-12T19:30:02.887424+0000","last_deep_scrub":"265'837","last_deep_scrub_stamp":"2024-09-12T19:30:02.887424+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.887424+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:23.336621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3905,"num_read_kb":3484,"num_write":1127,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'353","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.348805+0000","last_change":"2024-09-12T19:29:53.348805+0000","last_active":"2024-09-12T19:29:53.348805+0000","last_peered":"2024-09-12T19:29:53.348805+0000","last_clean":"2024-09-12T19:29:53.348805+0000","last_became_active":"2024-09-12T17:36:34.890281+0000","last_became_peered":"2024-09-12T17:36:34.890281+0000","last_unstale":"2024-09-12T19:29:53.348805+0000","last_undegraded":"2024-09-12T19:29:53.348805+0000","last_fullsized":"2024-09-12T19:29:53.348805+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T19:29:53.348577+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T19:29:53.348577+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.348577+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:20.759997+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":533,"num_read_kb":3791,"num_write":1159,"num_write_kb":30376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'485","reported_seq":2186,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.381971+0000","last_change":"2024-09-12T19:30:00.381971+0000","last_active":"2024-09-12T19:30:00.381971+0000","last_peered":"2024-09-12T19:30:00.381971+0000","last_clean":"2024-09-12T19:30:00.381971+0000","last_became_active":"2024-09-12T17:36:36.899249+0000","last_became_peered":"2024-09-12T17:36:36.899249+0000","last_unstale":"2024-09-12T19:30:00.381971+0000","last_undegraded":"2024-09-12T19:30:00.381971+0000","last_fullsized":"2024-09-12T19:30:00.381971+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'485","last_scrub_stamp":"2024-09-12T19:30:00.381780+0000","last_deep_scrub":"265'485","last_deep_scrub_stamp":"2024-09-12T19:30:00.381780+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.381780+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:44.920189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2730,"num_read_kb":2583,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":918,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'378","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.372662+0000","last_change":"2024-09-12T19:29:51.372662+0000","last_active":"2024-09-12T19:29:51.372662+0000","last_peered":"2024-09-12T19:29:51.372662+0000","last_clean":"2024-09-12T19:29:51.372662+0000","last_became_active":"2024-09-12T17:36:34.870994+0000","last_became_peered":"2024-09-12T17:36:34.870994+0000","last_unstale":"2024-09-12T19:29:51.372662+0000","last_undegraded":"2024-09-12T19:29:51.372662+0000","last_fullsized":"2024-09-12T19:29:51.372662+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:29:51.372428+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:29:51.372428+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.372428+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:45.220775+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526411,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":2344,"num_write":1206,"num_write_kb":29584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'377","reported_seq":1837,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.408879+0000","last_change":"2024-09-12T19:30:01.408879+0000","last_active":"2024-09-12T19:30:01.408879+0000","last_peered":"2024-09-12T19:30:01.408879+0000","last_clean":"2024-09-12T19:30:01.408879+0000","last_became_active":"2024-09-12T17:36:36.897609+0000","last_became_peered":"2024-09-12T17:36:36.897609+0000","last_unstale":"2024-09-12T19:30:01.408879+0000","last_undegraded":"2024-09-12T19:30:01.408879+0000","last_fullsized":"2024-09-12T19:30:01.408879+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:30:01.408689+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:30:01.408689+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.408689+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:12.740346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2010,"num_read_kb":1904,"num_write":440,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'357","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.390280+0000","last_change":"2024-09-12T19:29:52.390280+0000","last_active":"2024-09-12T19:29:52.390280+0000","last_peered":"2024-09-12T19:29:52.390280+0000","last_clean":"2024-09-12T19:29:52.390280+0000","last_became_active":"2024-09-12T17:36:34.859023+0000","last_became_peered":"2024-09-12T17:36:34.859023+0000","last_unstale":"2024-09-12T19:29:52.390280+0000","last_undegraded":"2024-09-12T19:29:52.390280+0000","last_fullsized":"2024-09-12T19:29:52.390280+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'357","last_scrub_stamp":"2024-09-12T19:29:52.390106+0000","last_deep_scrub":"265'357","last_deep_scrub_stamp":"2024-09-12T19:29:52.390106+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.390106+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:22.736379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136901,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1894,"num_write":1220,"num_write_kb":19389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'837","reported_seq":2386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.416629+0000","last_change":"2024-09-12T19:30:01.416629+0000","last_active":"2024-09-12T19:30:01.416629+0000","last_peered":"2024-09-12T19:30:01.416629+0000","last_clean":"2024-09-12T19:30:01.416629+0000","last_became_active":"2024-09-12T17:36:36.914366+0000","last_became_peered":"2024-09-12T17:36:36.914366+0000","last_unstale":"2024-09-12T19:30:01.416629+0000","last_undegraded":"2024-09-12T19:30:01.416629+0000","last_fullsized":"2024-09-12T19:30:01.416629+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'837","last_scrub_stamp":"2024-09-12T19:30:01.416434+0000","last_deep_scrub":"265'837","last_deep_scrub_stamp":"2024-09-12T19:30:01.416434+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.416434+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:32.496350+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4038,"num_read_kb":3626,"num_write":1143,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'347","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.927870+0000","last_change":"2024-09-12T19:29:58.927870+0000","last_active":"2024-09-12T19:29:58.927870+0000","last_peered":"2024-09-12T19:29:58.927870+0000","last_clean":"2024-09-12T19:29:58.927870+0000","last_became_active":"2024-09-12T17:36:34.882704+0000","last_became_peered":"2024-09-12T17:36:34.882704+0000","last_unstale":"2024-09-12T19:29:58.927870+0000","last_undegraded":"2024-09-12T19:29:58.927870+0000","last_fullsized":"2024-09-12T19:29:58.927870+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:29:58.927579+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:29:58.927579+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.927579+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:30.908682+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2535846,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":64003,"num_write":1113,"num_write_kb":46422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1169","reported_seq":2746,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.807102+0000","last_change":"2024-09-12T19:30:10.807102+0000","last_active":"2024-09-12T19:30:10.807102+0000","last_peered":"2024-09-12T19:30:10.807102+0000","last_clean":"2024-09-12T19:30:10.807102+0000","last_became_active":"2024-09-12T17:36:36.888829+0000","last_became_peered":"2024-09-12T17:36:36.888829+0000","last_unstale":"2024-09-12T19:30:10.807102+0000","last_undegraded":"2024-09-12T19:30:10.807102+0000","last_fullsized":"2024-09-12T19:30:10.807102+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1169","last_scrub_stamp":"2024-09-12T19:30:10.806912+0000","last_deep_scrub":"265'1169","last_deep_scrub_stamp":"2024-09-12T19:30:10.806912+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.806912+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":1100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:19.923756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5211,"num_read_kb":4613,"num_write":1589,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'496","reported_seq":2231,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.149795+0000","last_change":"2024-09-12T19:30:12.149795+0000","last_active":"2024-09-12T19:30:12.149795+0000","last_peered":"2024-09-12T19:30:12.149795+0000","last_clean":"2024-09-12T19:30:12.149795+0000","last_became_active":"2024-09-12T17:36:36.904820+0000","last_became_peered":"2024-09-12T17:36:36.904820+0000","last_unstale":"2024-09-12T19:30:12.149795+0000","last_undegraded":"2024-09-12T19:30:12.149795+0000","last_fullsized":"2024-09-12T19:30:12.149795+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'496","last_scrub_stamp":"2024-09-12T19:30:12.149611+0000","last_deep_scrub":"265'496","last_deep_scrub_stamp":"2024-09-12T19:30:12.149611+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.149611+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:58.293186+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2913,"num_read_kb":2753,"num_write":585,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'374","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.902145+0000","last_change":"2024-09-12T19:29:51.902000+0000","last_active":"2024-09-12T19:29:51.902145+0000","last_peered":"2024-09-12T19:29:51.902145+0000","last_clean":"2024-09-12T19:29:51.902145+0000","last_became_active":"2024-09-12T17:36:34.866283+0000","last_became_peered":"2024-09-12T17:36:34.866283+0000","last_unstale":"2024-09-12T19:29:51.902145+0000","last_undegraded":"2024-09-12T19:29:51.902145+0000","last_fullsized":"2024-09-12T19:29:51.902145+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T19:29:51.901740+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T19:29:51.901740+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.901740+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:07.400270+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":73276,"num_write":1099,"num_write_kb":24135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'481","reported_seq":2104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.336855+0000","last_change":"2024-09-12T19:29:58.336855+0000","last_active":"2024-09-12T19:29:58.336855+0000","last_peered":"2024-09-12T19:29:58.336855+0000","last_clean":"2024-09-12T19:29:58.336855+0000","last_became_active":"2024-09-12T17:36:36.911310+0000","last_became_peered":"2024-09-12T17:36:36.911310+0000","last_unstale":"2024-09-12T19:29:58.336855+0000","last_undegraded":"2024-09-12T19:29:58.336855+0000","last_fullsized":"2024-09-12T19:29:58.336855+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'481","last_scrub_stamp":"2024-09-12T19:29:58.336665+0000","last_deep_scrub":"265'481","last_deep_scrub_stamp":"2024-09-12T19:29:58.336665+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.336665+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:39.578088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2526,"num_read_kb":2384,"num_write":531,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'354","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.369482+0000","last_change":"2024-09-12T19:29:50.369352+0000","last_active":"2024-09-12T19:29:50.369482+0000","last_peered":"2024-09-12T19:29:50.369482+0000","last_clean":"2024-09-12T19:29:50.369482+0000","last_became_active":"2024-09-12T17:36:34.865119+0000","last_became_peered":"2024-09-12T17:36:34.865119+0000","last_unstale":"2024-09-12T19:29:50.369482+0000","last_undegraded":"2024-09-12T19:29:50.369482+0000","last_fullsized":"2024-09-12T19:29:50.369482+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T19:29:50.369148+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T19:29:50.369148+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.369148+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:22.772611+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109517,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":573,"num_read_kb":7316,"num_write":1055,"num_write_kb":28671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'739","reported_seq":2238,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.837232+0000","last_change":"2024-09-12T19:29:57.837232+0000","last_active":"2024-09-12T19:29:57.837232+0000","last_peered":"2024-09-12T19:29:57.837232+0000","last_clean":"2024-09-12T19:29:57.837232+0000","last_became_active":"2024-09-12T17:36:36.885876+0000","last_became_peered":"2024-09-12T17:36:36.885876+0000","last_unstale":"2024-09-12T19:29:57.837232+0000","last_undegraded":"2024-09-12T19:29:57.837232+0000","last_fullsized":"2024-09-12T19:29:57.837232+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'739","last_scrub_stamp":"2024-09-12T19:29:57.837032+0000","last_deep_scrub":"265'739","last_deep_scrub_stamp":"2024-09-12T19:29:57.837032+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.837032+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:40.240565+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3432,"num_read_kb":3117,"num_write":958,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1010,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'391","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.371378+0000","last_change":"2024-09-12T19:29:54.371239+0000","last_active":"2024-09-12T19:29:54.371378+0000","last_peered":"2024-09-12T19:29:54.371378+0000","last_clean":"2024-09-12T19:29:54.371378+0000","last_became_active":"2024-09-12T17:36:34.873456+0000","last_became_peered":"2024-09-12T17:36:34.873456+0000","last_unstale":"2024-09-12T19:29:54.371378+0000","last_undegraded":"2024-09-12T19:29:54.371378+0000","last_fullsized":"2024-09-12T19:29:54.371378+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:29:54.371023+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:29:54.371023+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.371023+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:54.568742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":11973,"num_write":1244,"num_write_kb":23205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'621","reported_seq":2316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.478518+0000","last_change":"2024-09-12T19:29:59.478221+0000","last_active":"2024-09-12T19:29:59.478518+0000","last_peered":"2024-09-12T19:29:59.478518+0000","last_clean":"2024-09-12T19:29:59.478518+0000","last_became_active":"2024-09-12T17:36:36.899850+0000","last_became_peered":"2024-09-12T17:36:36.899850+0000","last_unstale":"2024-09-12T19:29:59.478518+0000","last_undegraded":"2024-09-12T19:29:59.478518+0000","last_fullsized":"2024-09-12T19:29:59.478518+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'621","last_scrub_stamp":"2024-09-12T19:29:59.477997+0000","last_deep_scrub":"265'621","last_deep_scrub_stamp":"2024-09-12T19:29:59.477997+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.477997+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":600,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:01.602724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3224,"num_read_kb":2959,"num_write":847,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'342","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.452941+0000","last_change":"2024-09-12T19:29:48.452837+0000","last_active":"2024-09-12T19:29:48.452941+0000","last_peered":"2024-09-12T19:29:48.452941+0000","last_clean":"2024-09-12T19:29:48.452941+0000","last_became_active":"2024-09-12T17:36:34.864547+0000","last_became_peered":"2024-09-12T17:36:34.864547+0000","last_unstale":"2024-09-12T19:29:48.452941+0000","last_undegraded":"2024-09-12T19:29:48.452941+0000","last_fullsized":"2024-09-12T19:29:48.452941+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:48.452700+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:48.452700+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.452700+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:14.375143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":555,"num_read_kb":20889,"num_write":1050,"num_write_kb":32386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'302","reported_seq":1687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.873251+0000","last_change":"2024-09-12T19:30:07.873070+0000","last_active":"2024-09-12T19:30:07.873251+0000","last_peered":"2024-09-12T19:30:07.873251+0000","last_clean":"2024-09-12T19:30:07.873251+0000","last_became_active":"2024-09-12T17:36:36.873937+0000","last_became_peered":"2024-09-12T17:36:36.873937+0000","last_unstale":"2024-09-12T19:30:07.873251+0000","last_undegraded":"2024-09-12T19:30:07.873251+0000","last_fullsized":"2024-09-12T19:30:07.873251+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-12T19:30:07.872893+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-12T19:30:07.872893+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.872893+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:39.605056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1689,"num_read_kb":1636,"num_write":323,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'377","reported_seq":1149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.359265+0000","last_change":"2024-09-12T19:29:54.358988+0000","last_active":"2024-09-12T19:29:54.359265+0000","last_peered":"2024-09-12T19:29:54.359265+0000","last_clean":"2024-09-12T19:29:54.359265+0000","last_became_active":"2024-09-12T17:36:34.880986+0000","last_became_peered":"2024-09-12T17:36:34.880986+0000","last_unstale":"2024-09-12T19:29:54.359265+0000","last_undegraded":"2024-09-12T19:29:54.359265+0000","last_fullsized":"2024-09-12T19:29:54.359265+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:29:54.358664+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:29:54.358664+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.358664+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:38.007979+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1802093,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":10570,"num_write":1059,"num_write_kb":33432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'405","reported_seq":1902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.869969+0000","last_change":"2024-09-12T19:29:58.869837+0000","last_active":"2024-09-12T19:29:58.869969+0000","last_peered":"2024-09-12T19:29:58.869969+0000","last_clean":"2024-09-12T19:29:58.869969+0000","last_became_active":"2024-09-12T17:36:36.881228+0000","last_became_peered":"2024-09-12T17:36:36.881228+0000","last_unstale":"2024-09-12T19:29:58.869969+0000","last_undegraded":"2024-09-12T19:29:58.869969+0000","last_fullsized":"2024-09-12T19:29:58.869969+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T19:29:58.869637+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T19:29:58.869637+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.869637+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.969680+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2076,"num_read_kb":1970,"num_write":455,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'419","reported_seq":1188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.348394+0000","last_change":"2024-09-12T19:29:52.348394+0000","last_active":"2024-09-12T19:29:52.348394+0000","last_peered":"2024-09-12T19:29:52.348394+0000","last_clean":"2024-09-12T19:29:52.348394+0000","last_became_active":"2024-09-12T17:36:34.878377+0000","last_became_peered":"2024-09-12T17:36:34.878377+0000","last_unstale":"2024-09-12T19:29:52.348394+0000","last_undegraded":"2024-09-12T19:29:52.348394+0000","last_fullsized":"2024-09-12T19:29:52.348394+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'419","last_scrub_stamp":"2024-09-12T19:29:52.348210+0000","last_deep_scrub":"265'419","last_deep_scrub_stamp":"2024-09-12T19:29:52.348210+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.348210+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:42.321093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":879,"num_read_kb":13596,"num_write":1342,"num_write_kb":22678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'110","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.513285+0000","last_change":"2024-09-12T19:30:10.513033+0000","last_active":"2024-09-12T19:30:10.513285+0000","last_peered":"2024-09-12T19:30:10.513285+0000","last_clean":"2024-09-12T19:30:10.513285+0000","last_became_active":"2024-09-12T17:36:44.934662+0000","last_became_peered":"2024-09-12T17:36:44.934662+0000","last_unstale":"2024-09-12T19:30:10.513285+0000","last_undegraded":"2024-09-12T19:30:10.513285+0000","last_fullsized":"2024-09-12T19:30:10.513285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T19:30:10.512819+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T19:30:10.512819+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.512819+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:38.028024+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'641","reported_seq":2298,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.452960+0000","last_change":"2024-09-12T19:30:00.452960+0000","last_active":"2024-09-12T19:30:00.452960+0000","last_peered":"2024-09-12T19:30:00.452960+0000","last_clean":"2024-09-12T19:30:00.452960+0000","last_became_active":"2024-09-12T17:36:36.913372+0000","last_became_peered":"2024-09-12T17:36:36.913372+0000","last_unstale":"2024-09-12T19:30:00.452960+0000","last_undegraded":"2024-09-12T19:30:00.452960+0000","last_fullsized":"2024-09-12T19:30:00.452960+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'641","last_scrub_stamp":"2024-09-12T19:30:00.452763+0000","last_deep_scrub":"265'641","last_deep_scrub_stamp":"2024-09-12T19:30:00.452763+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.452763+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:12.971289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3256,"num_read_kb":2969,"num_write":868,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'399","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.175382+0000","last_change":"2024-09-12T19:29:57.175382+0000","last_active":"2024-09-12T19:29:57.175382+0000","last_peered":"2024-09-12T19:29:57.175382+0000","last_clean":"2024-09-12T19:29:57.175382+0000","last_became_active":"2024-09-12T17:36:34.865894+0000","last_became_peered":"2024-09-12T17:36:34.865894+0000","last_unstale":"2024-09-12T19:29:57.175382+0000","last_undegraded":"2024-09-12T19:29:57.175382+0000","last_fullsized":"2024-09-12T19:29:57.175382+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'399","last_scrub_stamp":"2024-09-12T19:29:57.175150+0000","last_deep_scrub":"265'399","last_deep_scrub_stamp":"2024-09-12T19:29:57.175150+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.175150+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:47.227408+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661307,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":35668,"num_write":1342,"num_write_kb":51737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.213863+0000","last_change":"2024-09-12T19:30:14.213708+0000","last_active":"2024-09-12T19:30:14.213863+0000","last_peered":"2024-09-12T19:30:14.213863+0000","last_clean":"2024-09-12T19:30:14.213863+0000","last_became_active":"2024-09-12T17:36:38.881044+0000","last_became_peered":"2024-09-12T17:36:38.881044+0000","last_unstale":"2024-09-12T19:30:14.213863+0000","last_undegraded":"2024-09-12T19:30:14.213863+0000","last_fullsized":"2024-09-12T19:30:14.213863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:14.213524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:14.213524+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.213524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:07.524096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'390","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.122619+0000","last_change":"2024-09-12T19:30:17.122619+0000","last_active":"2024-09-12T19:30:17.122619+0000","last_peered":"2024-09-12T19:30:17.122619+0000","last_clean":"2024-09-12T19:30:17.122619+0000","last_became_active":"2024-09-12T17:36:40.906825+0000","last_became_peered":"2024-09-12T17:36:40.906825+0000","last_unstale":"2024-09-12T19:30:17.122619+0000","last_undegraded":"2024-09-12T19:30:17.122619+0000","last_fullsized":"2024-09-12T19:30:17.122619+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'390","last_scrub_stamp":"2024-09-12T19:30:17.122329+0000","last_deep_scrub":"265'390","last_deep_scrub_stamp":"2024-09-12T19:30:17.122329+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.122329+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:56.303295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":626,"num_read_kb":1284,"num_write":492,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.821522+0000","last_change":"2024-09-12T19:30:10.821380+0000","last_active":"2024-09-12T19:30:10.821522+0000","last_peered":"2024-09-12T19:30:10.821522+0000","last_clean":"2024-09-12T19:30:10.821522+0000","last_became_active":"2024-09-12T17:36:42.928794+0000","last_became_peered":"2024-09-12T17:36:42.928794+0000","last_unstale":"2024-09-12T19:30:10.821522+0000","last_undegraded":"2024-09-12T19:30:10.821522+0000","last_fullsized":"2024-09-12T19:30:10.821522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:10.821184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:10.821184+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.821184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:24.400244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'171","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.716331+0000","last_change":"2024-09-12T19:30:16.716331+0000","last_active":"2024-09-12T19:30:16.716331+0000","last_peered":"2024-09-12T19:30:16.716331+0000","last_clean":"2024-09-12T19:30:16.716331+0000","last_became_active":"2024-09-12T17:36:44.939447+0000","last_became_peered":"2024-09-12T17:36:44.939447+0000","last_unstale":"2024-09-12T19:30:16.716331+0000","last_undegraded":"2024-09-12T19:30:16.716331+0000","last_fullsized":"2024-09-12T19:30:16.716331+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'171","last_scrub_stamp":"2024-09-12T19:30:16.716131+0000","last_deep_scrub":"265'171","last_deep_scrub_stamp":"2024-09-12T19:30:16.716131+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.716131+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:44.650347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":297,"num_read_kb":283,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'452","reported_seq":1955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.174336+0000","last_change":"2024-09-12T19:30:08.174162+0000","last_active":"2024-09-12T19:30:08.174336+0000","last_peered":"2024-09-12T19:30:08.174336+0000","last_clean":"2024-09-12T19:30:08.174336+0000","last_became_active":"2024-09-12T17:36:36.875459+0000","last_became_peered":"2024-09-12T17:36:36.875459+0000","last_unstale":"2024-09-12T19:30:08.174336+0000","last_undegraded":"2024-09-12T19:30:08.174336+0000","last_fullsized":"2024-09-12T19:30:08.174336+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'452","last_scrub_stamp":"2024-09-12T19:30:08.173978+0000","last_deep_scrub":"265'452","last_deep_scrub_stamp":"2024-09-12T19:30:08.173978+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.173978+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:35.958234+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2269,"num_read_kb":2126,"num_write":529,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'324","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.310812+0000","last_change":"2024-09-12T19:29:51.310812+0000","last_active":"2024-09-12T19:29:51.310812+0000","last_peered":"2024-09-12T19:29:51.310812+0000","last_clean":"2024-09-12T19:29:51.310812+0000","last_became_active":"2024-09-12T17:36:34.880644+0000","last_became_peered":"2024-09-12T17:36:34.880644+0000","last_unstale":"2024-09-12T19:29:51.310812+0000","last_undegraded":"2024-09-12T19:29:51.310812+0000","last_fullsized":"2024-09-12T19:29:51.310812+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T19:29:51.310611+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T19:29:51.310611+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.310611+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:42.392409+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174790,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":12215,"num_write":1010,"num_write_kb":18682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.016740+0000","last_change":"2024-09-12T19:30:09.016740+0000","last_active":"2024-09-12T19:30:09.016740+0000","last_peered":"2024-09-12T19:30:09.016740+0000","last_clean":"2024-09-12T19:30:09.016740+0000","last_became_active":"2024-09-12T17:36:38.900684+0000","last_became_peered":"2024-09-12T17:36:38.900684+0000","last_unstale":"2024-09-12T19:30:09.016740+0000","last_undegraded":"2024-09-12T19:30:09.016740+0000","last_fullsized":"2024-09-12T19:30:09.016740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.016556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.016556+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.016556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:47.119691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'129","reported_seq":708,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.854416+0000","last_change":"2024-09-12T19:30:07.854249+0000","last_active":"2024-09-12T19:30:07.854416+0000","last_peered":"2024-09-12T19:30:07.854416+0000","last_clean":"2024-09-12T19:30:07.854416+0000","last_became_active":"2024-09-12T17:36:40.899340+0000","last_became_peered":"2024-09-12T17:36:40.899340+0000","last_unstale":"2024-09-12T19:30:07.854416+0000","last_undegraded":"2024-09-12T19:30:07.854416+0000","last_fullsized":"2024-09-12T19:30:07.854416+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T19:30:07.854053+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T19:30:07.854053+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.854053+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:09.119113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.796542+0000","last_change":"2024-09-12T19:30:13.796389+0000","last_active":"2024-09-12T19:30:13.796542+0000","last_peered":"2024-09-12T19:30:13.796542+0000","last_clean":"2024-09-12T19:30:13.796542+0000","last_became_active":"2024-09-12T17:36:42.932100+0000","last_became_peered":"2024-09-12T17:36:42.932100+0000","last_unstale":"2024-09-12T19:30:13.796542+0000","last_undegraded":"2024-09-12T19:30:13.796542+0000","last_fullsized":"2024-09-12T19:30:13.796542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:13.796195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:13.796195+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.796195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:33.303127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'126","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.388821+0000","last_change":"2024-09-12T19:30:16.388821+0000","last_active":"2024-09-12T19:30:16.388821+0000","last_peered":"2024-09-12T19:30:16.388821+0000","last_clean":"2024-09-12T19:30:16.388821+0000","last_became_active":"2024-09-12T17:36:44.965913+0000","last_became_peered":"2024-09-12T17:36:44.965913+0000","last_unstale":"2024-09-12T19:30:16.388821+0000","last_undegraded":"2024-09-12T19:30:16.388821+0000","last_fullsized":"2024-09-12T19:30:16.388821+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T19:30:16.388633+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T19:30:16.388633+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.388633+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:37.822244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":210,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.952195+0000","last_change":"2024-09-12T19:30:03.952062+0000","last_active":"2024-09-12T19:30:03.952195+0000","last_peered":"2024-09-12T19:30:03.952195+0000","last_clean":"2024-09-12T19:30:03.952195+0000","last_became_active":"2024-09-12T17:36:36.904639+0000","last_became_peered":"2024-09-12T17:36:36.904639+0000","last_unstale":"2024-09-12T19:30:03.952195+0000","last_undegraded":"2024-09-12T19:30:03.952195+0000","last_fullsized":"2024-09-12T19:30:03.952195+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'401","last_scrub_stamp":"2024-09-12T19:30:03.951878+0000","last_deep_scrub":"265'401","last_deep_scrub_stamp":"2024-09-12T19:30:03.951878+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.951878+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:56.567132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2242,"num_read_kb":2124,"num_write":448,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'318","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.174934+0000","last_change":"2024-09-12T19:29:56.174934+0000","last_active":"2024-09-12T19:29:56.174934+0000","last_peered":"2024-09-12T19:29:56.174934+0000","last_clean":"2024-09-12T19:29:56.174934+0000","last_became_active":"2024-09-12T17:36:34.879098+0000","last_became_peered":"2024-09-12T17:36:34.879098+0000","last_unstale":"2024-09-12T19:29:56.174934+0000","last_undegraded":"2024-09-12T19:29:56.174934+0000","last_fullsized":"2024-09-12T19:29:56.174934+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T19:29:56.174676+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T19:29:56.174676+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.174676+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:55.215925+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763036,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":388,"num_read_kb":4507,"num_write":999,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.042906+0000","last_change":"2024-09-12T19:30:10.042772+0000","last_active":"2024-09-12T19:30:10.042906+0000","last_peered":"2024-09-12T19:30:10.042906+0000","last_clean":"2024-09-12T19:30:10.042906+0000","last_became_active":"2024-09-12T17:36:38.883758+0000","last_became_peered":"2024-09-12T17:36:38.883758+0000","last_unstale":"2024-09-12T19:30:10.042906+0000","last_undegraded":"2024-09-12T19:30:10.042906+0000","last_fullsized":"2024-09-12T19:30:10.042906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:10.042594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:10.042594+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.042594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:36.648238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'191","reported_seq":799,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.117856+0000","last_change":"2024-09-12T19:30:16.117856+0000","last_active":"2024-09-12T19:30:16.117856+0000","last_peered":"2024-09-12T19:30:16.117856+0000","last_clean":"2024-09-12T19:30:16.117856+0000","last_became_active":"2024-09-12T17:36:40.907410+0000","last_became_peered":"2024-09-12T17:36:40.907410+0000","last_unstale":"2024-09-12T19:30:16.117856+0000","last_undegraded":"2024-09-12T19:30:16.117856+0000","last_fullsized":"2024-09-12T19:30:16.117856+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-12T19:30:16.117678+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-12T19:30:16.117678+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.117678+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:41.966948+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'806","reported_seq":7130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.120006+0000","last_change":"2024-09-12T19:30:26.120006+0000","last_active":"2024-09-12T19:30:26.120006+0000","last_peered":"2024-09-12T19:30:26.120006+0000","last_clean":"2024-09-12T19:30:26.120006+0000","last_became_active":"2024-09-12T17:36:42.916847+0000","last_became_peered":"2024-09-12T17:36:42.916847+0000","last_unstale":"2024-09-12T19:30:26.120006+0000","last_undegraded":"2024-09-12T19:30:26.120006+0000","last_fullsized":"2024-09-12T19:30:26.120006+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T19:30:26.119806+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T19:30:26.119806+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.119806+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:23.909366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'226","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.455780+0000","last_change":"2024-09-12T19:30:12.455780+0000","last_active":"2024-09-12T19:30:12.455780+0000","last_peered":"2024-09-12T19:30:12.455780+0000","last_clean":"2024-09-12T19:30:12.455780+0000","last_became_active":"2024-09-12T17:36:44.954183+0000","last_became_peered":"2024-09-12T17:36:44.954183+0000","last_unstale":"2024-09-12T19:30:12.455780+0000","last_undegraded":"2024-09-12T19:30:12.455780+0000","last_fullsized":"2024-09-12T19:30:12.455780+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-12T19:30:12.455578+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-12T19:30:12.455578+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.455578+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:03.513982+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":505,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'460","reported_seq":2151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.958826+0000","last_change":"2024-09-12T19:30:04.958687+0000","last_active":"2024-09-12T19:30:04.958826+0000","last_peered":"2024-09-12T19:30:04.958826+0000","last_clean":"2024-09-12T19:30:04.958826+0000","last_became_active":"2024-09-12T17:36:36.877420+0000","last_became_peered":"2024-09-12T17:36:36.877420+0000","last_unstale":"2024-09-12T19:30:04.958826+0000","last_undegraded":"2024-09-12T19:30:04.958826+0000","last_fullsized":"2024-09-12T19:30:04.958826+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'460","last_scrub_stamp":"2024-09-12T19:30:04.958508+0000","last_deep_scrub":"265'460","last_deep_scrub_stamp":"2024-09-12T19:30:04.958508+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.958508+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:30.786563+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2635,"num_read_kb":2492,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2773,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'364","reported_seq":1082,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.902122+0000","last_change":"2024-09-12T19:29:48.902122+0000","last_active":"2024-09-12T19:29:48.902122+0000","last_peered":"2024-09-12T19:29:48.902122+0000","last_clean":"2024-09-12T19:29:48.902122+0000","last_became_active":"2024-09-12T17:36:34.882902+0000","last_became_peered":"2024-09-12T17:36:34.882902+0000","last_unstale":"2024-09-12T19:29:48.902122+0000","last_undegraded":"2024-09-12T19:29:48.902122+0000","last_fullsized":"2024-09-12T19:29:48.902122+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T19:29:48.902025+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T19:29:48.902025+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.902025+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:07.220628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":587,"num_read_kb":75125,"num_write":1046,"num_write_kb":28457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.186640+0000","last_change":"2024-09-12T19:30:19.186640+0000","last_active":"2024-09-12T19:30:19.186640+0000","last_peered":"2024-09-12T19:30:19.186640+0000","last_clean":"2024-09-12T19:30:19.186640+0000","last_became_active":"2024-09-12T17:36:38.899405+0000","last_became_peered":"2024-09-12T17:36:38.899405+0000","last_unstale":"2024-09-12T19:30:19.186640+0000","last_undegraded":"2024-09-12T19:30:19.186640+0000","last_fullsized":"2024-09-12T19:30:19.186640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:19.186463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:19.186463+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.186463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:31.132651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'342","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.397532+0000","last_change":"2024-09-12T19:30:05.397397+0000","last_active":"2024-09-12T19:30:05.397532+0000","last_peered":"2024-09-12T19:30:05.397532+0000","last_clean":"2024-09-12T19:30:05.397532+0000","last_became_active":"2024-09-12T17:36:40.910700+0000","last_became_peered":"2024-09-12T17:36:40.910700+0000","last_unstale":"2024-09-12T19:30:05.397532+0000","last_undegraded":"2024-09-12T19:30:05.397532+0000","last_fullsized":"2024-09-12T19:30:05.397532+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:30:05.397149+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:30:05.397149+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.397149+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:25.803180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54278,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":1174,"num_write":438,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'800","reported_seq":3165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.823937+0000","last_change":"2024-09-12T19:30:20.823937+0000","last_active":"2024-09-12T19:30:20.823937+0000","last_peered":"2024-09-12T19:30:20.823937+0000","last_clean":"2024-09-12T19:30:20.823937+0000","last_became_active":"2024-09-12T17:36:42.939966+0000","last_became_peered":"2024-09-12T17:36:42.939966+0000","last_unstale":"2024-09-12T19:30:20.823937+0000","last_undegraded":"2024-09-12T19:30:20.823937+0000","last_fullsized":"2024-09-12T19:30:20.823937+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'800","last_scrub_stamp":"2024-09-12T19:30:20.823742+0000","last_deep_scrub":"265'800","last_deep_scrub_stamp":"2024-09-12T19:30:20.823742+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.823742+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:53.933093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'1127","reported_seq":2740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.113469+0000","last_change":"2024-09-12T19:30:06.113469+0000","last_active":"2024-09-12T19:30:06.113469+0000","last_peered":"2024-09-12T19:30:06.113469+0000","last_clean":"2024-09-12T19:30:06.113469+0000","last_became_active":"2024-09-12T17:36:36.886244+0000","last_became_peered":"2024-09-12T17:36:36.886244+0000","last_unstale":"2024-09-12T19:30:06.113469+0000","last_undegraded":"2024-09-12T19:30:06.113469+0000","last_fullsized":"2024-09-12T19:30:06.113469+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1127","last_scrub_stamp":"2024-09-12T19:30:06.113240+0000","last_deep_scrub":"265'1127","last_deep_scrub_stamp":"2024-09-12T19:30:06.113240+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.113240+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":1100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:06.097619+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5270,"num_read_kb":4695,"num_write":1548,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'297","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:46.414341+0000","last_change":"2024-09-12T19:29:46.414341+0000","last_active":"2024-09-12T19:29:46.414341+0000","last_peered":"2024-09-12T19:29:46.414341+0000","last_clean":"2024-09-12T19:29:46.414341+0000","last_became_active":"2024-09-12T17:36:34.865417+0000","last_became_peered":"2024-09-12T17:36:34.865417+0000","last_unstale":"2024-09-12T19:29:46.414341+0000","last_undegraded":"2024-09-12T19:29:46.414341+0000","last_fullsized":"2024-09-12T19:29:46.414341+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'297","last_scrub_stamp":"2024-09-12T19:29:46.414141+0000","last_deep_scrub":"265'297","last_deep_scrub_stamp":"2024-09-12T19:29:46.414141+0000","last_clean_scrub_stamp":"2024-09-12T19:29:46.414141+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.995894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":517,"num_read_kb":1839,"num_write":970,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.875044+0000","last_change":"2024-09-12T19:30:00.875044+0000","last_active":"2024-09-12T19:30:00.875044+0000","last_peered":"2024-09-12T19:30:00.875044+0000","last_clean":"2024-09-12T19:30:00.875044+0000","last_became_active":"2024-09-12T17:36:38.887444+0000","last_became_peered":"2024-09-12T17:36:38.887444+0000","last_unstale":"2024-09-12T19:30:00.875044+0000","last_undegraded":"2024-09-12T19:30:00.875044+0000","last_fullsized":"2024-09-12T19:30:00.875044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:00.874795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:00.874795+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.874795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:17.895761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'456","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.562005+0000","last_change":"2024-09-12T19:30:11.562005+0000","last_active":"2024-09-12T19:30:11.562005+0000","last_peered":"2024-09-12T19:30:11.562005+0000","last_clean":"2024-09-12T19:30:11.562005+0000","last_became_active":"2024-09-12T17:36:40.911095+0000","last_became_peered":"2024-09-12T17:36:40.911095+0000","last_unstale":"2024-09-12T19:30:11.562005+0000","last_undegraded":"2024-09-12T19:30:11.562005+0000","last_fullsized":"2024-09-12T19:30:11.562005+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'456","last_scrub_stamp":"2024-09-12T19:30:11.561804+0000","last_deep_scrub":"265'456","last_deep_scrub_stamp":"2024-09-12T19:30:11.561804+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.561804+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:55.236202+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":738,"num_read_kb":1351,"num_write":556,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.475388+0000","last_change":"2024-09-12T19:30:13.475388+0000","last_active":"2024-09-12T19:30:13.475388+0000","last_peered":"2024-09-12T19:30:13.475388+0000","last_clean":"2024-09-12T19:30:13.475388+0000","last_became_active":"2024-09-12T17:36:42.927582+0000","last_became_peered":"2024-09-12T17:36:42.927582+0000","last_unstale":"2024-09-12T19:30:13.475388+0000","last_undegraded":"2024-09-12T19:30:13.475388+0000","last_fullsized":"2024-09-12T19:30:13.475388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:13.475191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:13.475191+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.475191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:50.478250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'557","reported_seq":1410,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.488049+0000","last_change":"2024-09-12T19:30:16.488049+0000","last_active":"2024-09-12T19:30:16.488049+0000","last_peered":"2024-09-12T19:30:16.488049+0000","last_clean":"2024-09-12T19:30:16.488049+0000","last_became_active":"2024-09-12T17:36:44.953926+0000","last_became_peered":"2024-09-12T17:36:44.953926+0000","last_unstale":"2024-09-12T19:30:16.488049+0000","last_undegraded":"2024-09-12T19:30:16.488049+0000","last_fullsized":"2024-09-12T19:30:16.488049+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'557","last_scrub_stamp":"2024-09-12T19:30:16.487864+0000","last_deep_scrub":"265'557","last_deep_scrub_stamp":"2024-09-12T19:30:16.487864+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.487864+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:14.423016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":1310,"num_write":1167,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'842","reported_seq":2553,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.908148+0000","last_change":"2024-09-12T19:29:52.908148+0000","last_active":"2024-09-12T19:29:52.908148+0000","last_peered":"2024-09-12T19:29:52.908148+0000","last_clean":"2024-09-12T19:29:52.908148+0000","last_became_active":"2024-09-12T17:36:36.886395+0000","last_became_peered":"2024-09-12T17:36:36.886395+0000","last_unstale":"2024-09-12T19:29:52.908148+0000","last_undegraded":"2024-09-12T19:29:52.908148+0000","last_fullsized":"2024-09-12T19:29:52.908148+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'842","last_scrub_stamp":"2024-09-12T19:29:52.907905+0000","last_deep_scrub":"265'842","last_deep_scrub_stamp":"2024-09-12T19:29:52.907905+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.907905+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.987128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4184,"num_read_kb":3783,"num_write":1092,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3245,"num_omap_keys":13,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'376","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.389093+0000","last_change":"2024-09-12T19:29:49.389093+0000","last_active":"2024-09-12T19:29:49.389093+0000","last_peered":"2024-09-12T19:29:49.389093+0000","last_clean":"2024-09-12T19:29:49.389093+0000","last_became_active":"2024-09-12T17:36:34.868465+0000","last_became_peered":"2024-09-12T17:36:34.868465+0000","last_unstale":"2024-09-12T19:29:49.389093+0000","last_undegraded":"2024-09-12T19:29:49.389093+0000","last_fullsized":"2024-09-12T19:29:49.389093+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:29:49.389019+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:29:49.389019+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.389019+0000","objects_scrubbed":8,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:59.981113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109619,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":2937,"num_write":1162,"num_write_kb":21558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"265'4","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.492624+0000","last_change":"2024-09-12T19:30:03.492624+0000","last_active":"2024-09-12T19:30:03.492624+0000","last_peered":"2024-09-12T19:30:03.492624+0000","last_clean":"2024-09-12T19:30:03.492624+0000","last_became_active":"2024-09-12T17:36:38.907007+0000","last_became_peered":"2024-09-12T17:36:38.907007+0000","last_unstale":"2024-09-12T19:30:03.492624+0000","last_undegraded":"2024-09-12T19:30:03.492624+0000","last_fullsized":"2024-09-12T19:30:03.492624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:03.492431+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:03.492431+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.492431+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:04.343424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'332","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.048831+0000","last_change":"2024-09-12T19:30:13.048831+0000","last_active":"2024-09-12T19:30:13.048831+0000","last_peered":"2024-09-12T19:30:13.048831+0000","last_clean":"2024-09-12T19:30:13.048831+0000","last_became_active":"2024-09-12T17:36:40.911092+0000","last_became_peered":"2024-09-12T17:36:40.911092+0000","last_unstale":"2024-09-12T19:30:13.048831+0000","last_undegraded":"2024-09-12T19:30:13.048831+0000","last_fullsized":"2024-09-12T19:30:13.048831+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T19:30:13.048566+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T19:30:13.048566+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.048566+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.100240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1173,"num_write":436,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.012312+0000","last_change":"2024-09-12T19:30:22.012312+0000","last_active":"2024-09-12T19:30:22.012312+0000","last_peered":"2024-09-12T19:30:22.012312+0000","last_clean":"2024-09-12T19:30:22.012312+0000","last_became_active":"2024-09-12T17:36:42.933808+0000","last_became_peered":"2024-09-12T17:36:42.933808+0000","last_unstale":"2024-09-12T19:30:22.012312+0000","last_undegraded":"2024-09-12T19:30:22.012312+0000","last_fullsized":"2024-09-12T19:30:22.012312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.012112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.012112+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.012112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:50.128460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'2434","reported_seq":4304,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.829330+0000","last_change":"2024-09-12T19:30:12.829330+0000","last_active":"2024-09-12T19:30:12.829330+0000","last_peered":"2024-09-12T19:30:12.829330+0000","last_clean":"2024-09-12T19:30:12.829330+0000","last_became_active":"2024-09-12T17:36:44.962630+0000","last_became_peered":"2024-09-12T17:36:44.962630+0000","last_unstale":"2024-09-12T19:30:12.829330+0000","last_undegraded":"2024-09-12T19:30:12.829330+0000","last_fullsized":"2024-09-12T19:30:12.829330+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2434","last_scrub_stamp":"2024-09-12T19:30:12.829115+0000","last_deep_scrub":"265'2434","last_deep_scrub_stamp":"2024-09-12T19:30:12.829115+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.829115+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":2400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:26.992758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6095,"num_read_kb":6091,"num_write":4930,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'435","reported_seq":2069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.391391+0000","last_change":"2024-09-12T19:29:56.391391+0000","last_active":"2024-09-12T19:29:56.391391+0000","last_peered":"2024-09-12T19:29:56.391391+0000","last_clean":"2024-09-12T19:29:56.391391+0000","last_became_active":"2024-09-12T17:36:36.880296+0000","last_became_peered":"2024-09-12T17:36:36.880296+0000","last_unstale":"2024-09-12T19:29:56.391391+0000","last_undegraded":"2024-09-12T19:29:56.391391+0000","last_fullsized":"2024-09-12T19:29:56.391391+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'435","last_scrub_stamp":"2024-09-12T19:29:56.391216+0000","last_deep_scrub":"265'435","last_deep_scrub_stamp":"2024-09-12T19:29:56.391216+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.391216+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:02.997123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2387,"num_read_kb":2259,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'355","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.142105+0000","last_change":"2024-09-12T19:29:55.142105+0000","last_active":"2024-09-12T19:29:55.142105+0000","last_peered":"2024-09-12T19:29:55.142105+0000","last_clean":"2024-09-12T19:29:55.142105+0000","last_became_active":"2024-09-12T17:36:34.868243+0000","last_became_peered":"2024-09-12T17:36:34.868243+0000","last_unstale":"2024-09-12T19:29:55.142105+0000","last_undegraded":"2024-09-12T19:29:55.142105+0000","last_fullsized":"2024-09-12T19:29:55.142105+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T19:29:55.141865+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T19:29:55.141865+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.141865+0000","objects_scrubbed":10,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:28.760677+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":550,"num_read_kb":48255,"num_write":1188,"num_write_kb":33494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.823386+0000","last_change":"2024-09-12T19:30:09.823386+0000","last_active":"2024-09-12T19:30:09.823386+0000","last_peered":"2024-09-12T19:30:09.823386+0000","last_clean":"2024-09-12T19:30:09.823386+0000","last_became_active":"2024-09-12T17:36:38.892804+0000","last_became_peered":"2024-09-12T17:36:38.892804+0000","last_unstale":"2024-09-12T19:30:09.823386+0000","last_undegraded":"2024-09-12T19:30:09.823386+0000","last_fullsized":"2024-09-12T19:30:09.823386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.823197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.823197+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.823197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:59.559731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'408","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.200255+0000","last_change":"2024-09-12T19:30:29.200255+0000","last_active":"2024-09-12T19:30:29.200255+0000","last_peered":"2024-09-12T19:30:29.200255+0000","last_clean":"2024-09-12T19:30:29.200255+0000","last_became_active":"2024-09-12T17:36:40.888974+0000","last_became_peered":"2024-09-12T17:36:40.888974+0000","last_unstale":"2024-09-12T19:30:29.200255+0000","last_undegraded":"2024-09-12T19:30:29.200255+0000","last_fullsized":"2024-09-12T19:30:29.200255+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'408","last_scrub_stamp":"2024-09-12T19:30:29.200010+0000","last_deep_scrub":"265'408","last_deep_scrub_stamp":"2024-09-12T19:30:29.200010+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.200010+0000","objects_scrubbed":9,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:57.438618+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45462,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":644,"num_read_kb":1295,"num_write":508,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'799","reported_seq":3053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.854490+0000","last_change":"2024-09-12T19:30:16.854490+0000","last_active":"2024-09-12T19:30:16.854490+0000","last_peered":"2024-09-12T19:30:16.854490+0000","last_clean":"2024-09-12T19:30:16.854490+0000","last_became_active":"2024-09-12T17:36:42.935529+0000","last_became_peered":"2024-09-12T17:36:42.935529+0000","last_unstale":"2024-09-12T19:30:16.854490+0000","last_undegraded":"2024-09-12T19:30:16.854490+0000","last_fullsized":"2024-09-12T19:30:16.854490+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'799","last_scrub_stamp":"2024-09-12T19:30:16.854280+0000","last_deep_scrub":"265'799","last_deep_scrub_stamp":"2024-09-12T19:30:16.854280+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.854280+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:29.036304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'113","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.423550+0000","last_change":"2024-09-12T19:30:15.423550+0000","last_active":"2024-09-12T19:30:15.423550+0000","last_peered":"2024-09-12T19:30:15.423550+0000","last_clean":"2024-09-12T19:30:15.423550+0000","last_became_active":"2024-09-12T17:36:44.965763+0000","last_became_peered":"2024-09-12T17:36:44.965763+0000","last_unstale":"2024-09-12T19:30:15.423550+0000","last_undegraded":"2024-09-12T19:30:15.423550+0000","last_fullsized":"2024-09-12T19:30:15.423550+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'113","last_scrub_stamp":"2024-09-12T19:30:15.423367+0000","last_deep_scrub":"265'113","last_deep_scrub_stamp":"2024-09-12T19:30:15.423367+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.423367+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:46.072716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":137,"num_write":264,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'415","reported_seq":1907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.921903+0000","last_change":"2024-09-12T19:30:01.921903+0000","last_active":"2024-09-12T19:30:01.921903+0000","last_peered":"2024-09-12T19:30:01.921903+0000","last_clean":"2024-09-12T19:30:01.921903+0000","last_became_active":"2024-09-12T17:36:36.905958+0000","last_became_peered":"2024-09-12T17:36:36.905958+0000","last_unstale":"2024-09-12T19:30:01.921903+0000","last_undegraded":"2024-09-12T19:30:01.921903+0000","last_fullsized":"2024-09-12T19:30:01.921903+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:30:01.921717+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:30:01.921717+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.921717+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:06.661883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":964,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'344","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.405949+0000","last_change":"2024-09-12T19:29:49.405949+0000","last_active":"2024-09-12T19:29:49.405949+0000","last_peered":"2024-09-12T19:29:49.405949+0000","last_clean":"2024-09-12T19:29:49.405949+0000","last_became_active":"2024-09-12T17:36:34.860828+0000","last_became_peered":"2024-09-12T17:36:34.860828+0000","last_unstale":"2024-09-12T19:29:49.405949+0000","last_undegraded":"2024-09-12T19:29:49.405949+0000","last_fullsized":"2024-09-12T19:29:49.405949+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T19:29:49.405847+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T19:29:49.405847+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.405847+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:37.116130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399137,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":452,"num_read_kb":18690,"num_write":1073,"num_write_kb":31228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.499917+0000","last_change":"2024-09-12T19:30:04.499917+0000","last_active":"2024-09-12T19:30:04.499917+0000","last_peered":"2024-09-12T19:30:04.499917+0000","last_clean":"2024-09-12T19:30:04.499917+0000","last_became_active":"2024-09-12T17:36:38.897189+0000","last_became_peered":"2024-09-12T17:36:38.897189+0000","last_unstale":"2024-09-12T19:30:04.499917+0000","last_undegraded":"2024-09-12T19:30:04.499917+0000","last_fullsized":"2024-09-12T19:30:04.499917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.499746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.499746+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.499746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:20.326081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'514","reported_seq":1210,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.076417+0000","last_change":"2024-09-12T19:30:12.076417+0000","last_active":"2024-09-12T19:30:12.076417+0000","last_peered":"2024-09-12T19:30:12.076417+0000","last_clean":"2024-09-12T19:30:12.076417+0000","last_became_active":"2024-09-12T17:36:40.906903+0000","last_became_peered":"2024-09-12T17:36:40.906903+0000","last_unstale":"2024-09-12T19:30:12.076417+0000","last_undegraded":"2024-09-12T19:30:12.076417+0000","last_fullsized":"2024-09-12T19:30:12.076417+0000","mapping_epoch":30,"log_start":"265'501","ondisk_log_start":"265'501","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'514","last_scrub_stamp":"2024-09-12T19:30:12.076220+0000","last_deep_scrub":"265'514","last_deep_scrub_stamp":"2024-09-12T19:30:12.076220+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.076220+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":501,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:39.976350+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96745,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":901,"num_read_kb":2079,"num_write":726,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.871490+0000","last_change":"2024-09-12T19:30:15.871490+0000","last_active":"2024-09-12T19:30:15.871490+0000","last_peered":"2024-09-12T19:30:15.871490+0000","last_clean":"2024-09-12T19:30:15.871490+0000","last_became_active":"2024-09-12T17:36:42.933168+0000","last_became_peered":"2024-09-12T17:36:42.933168+0000","last_unstale":"2024-09-12T19:30:15.871490+0000","last_undegraded":"2024-09-12T19:30:15.871490+0000","last_fullsized":"2024-09-12T19:30:15.871490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:15.871307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:15.871307+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.871307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:18.870421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'162","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.197938+0000","last_change":"2024-09-12T19:30:14.197938+0000","last_active":"2024-09-12T19:30:14.197938+0000","last_peered":"2024-09-12T19:30:14.197938+0000","last_clean":"2024-09-12T19:30:14.197938+0000","last_became_active":"2024-09-12T17:36:44.960935+0000","last_became_peered":"2024-09-12T17:36:44.960935+0000","last_unstale":"2024-09-12T19:30:14.197938+0000","last_undegraded":"2024-09-12T19:30:14.197938+0000","last_fullsized":"2024-09-12T19:30:14.197938+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T19:30:14.197639+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T19:30:14.197639+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.197639+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:56.070755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1322,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":195,"num_write":366,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1243","reported_seq":2932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.364754+0000","last_change":"2024-09-12T19:29:56.364754+0000","last_active":"2024-09-12T19:29:56.364754+0000","last_peered":"2024-09-12T19:29:56.364754+0000","last_clean":"2024-09-12T19:29:56.364754+0000","last_became_active":"2024-09-12T17:36:36.914518+0000","last_became_peered":"2024-09-12T17:36:36.914518+0000","last_unstale":"2024-09-12T19:29:56.364754+0000","last_undegraded":"2024-09-12T19:29:56.364754+0000","last_fullsized":"2024-09-12T19:29:56.364754+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1243","last_scrub_stamp":"2024-09-12T19:29:56.364560+0000","last_deep_scrub":"265'1243","last_deep_scrub_stamp":"2024-09-12T19:29:56.364560+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.364560+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:54.124223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5692,"num_read_kb":5056,"num_write":1732,"num_write_kb":743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'326","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.160320+0000","last_change":"2024-09-12T19:29:52.160320+0000","last_active":"2024-09-12T19:29:52.160320+0000","last_peered":"2024-09-12T19:29:52.160320+0000","last_clean":"2024-09-12T19:29:52.160320+0000","last_became_active":"2024-09-12T17:36:34.878896+0000","last_became_peered":"2024-09-12T17:36:34.878896+0000","last_unstale":"2024-09-12T19:29:52.160320+0000","last_undegraded":"2024-09-12T19:29:52.160320+0000","last_fullsized":"2024-09-12T19:29:52.160320+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'326","last_scrub_stamp":"2024-09-12T19:29:52.160042+0000","last_deep_scrub":"265'326","last_deep_scrub_stamp":"2024-09-12T19:29:52.160042+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.160042+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:02.198272+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":17715,"num_write":1042,"num_write_kb":23877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.101607+0000","last_change":"2024-09-12T19:30:04.101607+0000","last_active":"2024-09-12T19:30:04.101607+0000","last_peered":"2024-09-12T19:30:04.101607+0000","last_clean":"2024-09-12T19:30:04.101607+0000","last_became_active":"2024-09-12T17:36:38.907609+0000","last_became_peered":"2024-09-12T17:36:38.907609+0000","last_unstale":"2024-09-12T19:30:04.101607+0000","last_undegraded":"2024-09-12T19:30:04.101607+0000","last_fullsized":"2024-09-12T19:30:04.101607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.101422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.101422+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.101422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:43.456527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'366","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.856226+0000","last_change":"2024-09-12T19:30:06.856226+0000","last_active":"2024-09-12T19:30:06.856226+0000","last_peered":"2024-09-12T19:30:06.856226+0000","last_clean":"2024-09-12T19:30:06.856226+0000","last_became_active":"2024-09-12T17:36:40.893702+0000","last_became_peered":"2024-09-12T17:36:40.893702+0000","last_unstale":"2024-09-12T19:30:06.856226+0000","last_undegraded":"2024-09-12T19:30:06.856226+0000","last_fullsized":"2024-09-12T19:30:06.856226+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T19:30:06.855976+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T19:30:06.855976+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.855976+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:59.315491+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47801,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":608,"num_read_kb":1248,"num_write":530,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.189730+0000","last_change":"2024-09-12T19:30:09.189730+0000","last_active":"2024-09-12T19:30:09.189730+0000","last_peered":"2024-09-12T19:30:09.189730+0000","last_clean":"2024-09-12T19:30:09.189730+0000","last_became_active":"2024-09-12T17:36:42.938437+0000","last_became_peered":"2024-09-12T17:36:42.938437+0000","last_unstale":"2024-09-12T19:30:09.189730+0000","last_undegraded":"2024-09-12T19:30:09.189730+0000","last_fullsized":"2024-09-12T19:30:09.189730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.189503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.189503+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.189503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:16.188315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'151","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.830517+0000","last_change":"2024-09-12T19:30:18.830517+0000","last_active":"2024-09-12T19:30:18.830517+0000","last_peered":"2024-09-12T19:30:18.830517+0000","last_clean":"2024-09-12T19:30:18.830517+0000","last_became_active":"2024-09-12T17:36:44.956645+0000","last_became_peered":"2024-09-12T17:36:44.956645+0000","last_unstale":"2024-09-12T19:30:18.830517+0000","last_undegraded":"2024-09-12T19:30:18.830517+0000","last_fullsized":"2024-09-12T19:30:18.830517+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T19:30:18.830311+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T19:30:18.830311+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.830311+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:17.214413+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":356,"num_read_kb":303,"num_write":346,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'503","reported_seq":2127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.145687+0000","last_change":"2024-09-12T19:30:07.145687+0000","last_active":"2024-09-12T19:30:07.145687+0000","last_peered":"2024-09-12T19:30:07.145687+0000","last_clean":"2024-09-12T19:30:07.145687+0000","last_became_active":"2024-09-12T17:36:36.881882+0000","last_became_peered":"2024-09-12T17:36:36.881882+0000","last_unstale":"2024-09-12T19:30:07.145687+0000","last_undegraded":"2024-09-12T19:30:07.145687+0000","last_fullsized":"2024-09-12T19:30:07.145687+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'503","last_scrub_stamp":"2024-09-12T19:30:07.145481+0000","last_deep_scrub":"265'503","last_deep_scrub_stamp":"2024-09-12T19:30:07.145481+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.145481+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:18.068459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2445,"num_write":630,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1768,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'360","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.147330+0000","last_change":"2024-09-12T19:29:54.147330+0000","last_active":"2024-09-12T19:29:54.147330+0000","last_peered":"2024-09-12T19:29:54.147330+0000","last_clean":"2024-09-12T19:29:54.147330+0000","last_became_active":"2024-09-12T17:36:34.870021+0000","last_became_peered":"2024-09-12T17:36:34.870021+0000","last_unstale":"2024-09-12T19:29:54.147330+0000","last_undegraded":"2024-09-12T19:29:54.147330+0000","last_fullsized":"2024-09-12T19:29:54.147330+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T19:29:54.147094+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T19:29:54.147094+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.147094+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:37.219375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":14188,"num_write":1189,"num_write_kb":25082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.885812+0000","last_change":"2024-09-12T19:30:22.885812+0000","last_active":"2024-09-12T19:30:22.885812+0000","last_peered":"2024-09-12T19:30:22.885812+0000","last_clean":"2024-09-12T19:30:22.885812+0000","last_became_active":"2024-09-12T17:36:38.892885+0000","last_became_peered":"2024-09-12T17:36:38.892885+0000","last_unstale":"2024-09-12T19:30:22.885812+0000","last_undegraded":"2024-09-12T19:30:22.885812+0000","last_fullsized":"2024-09-12T19:30:22.885812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.885627+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:32.386425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'386","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.852949+0000","last_change":"2024-09-12T19:30:12.852949+0000","last_active":"2024-09-12T19:30:12.852949+0000","last_peered":"2024-09-12T19:30:12.852949+0000","last_clean":"2024-09-12T19:30:12.852949+0000","last_became_active":"2024-09-12T17:36:40.896733+0000","last_became_peered":"2024-09-12T17:36:40.896733+0000","last_unstale":"2024-09-12T19:30:12.852949+0000","last_undegraded":"2024-09-12T19:30:12.852949+0000","last_fullsized":"2024-09-12T19:30:12.852949+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T19:30:12.852690+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T19:30:12.852690+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.852690+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:33.164610+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60156,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1227,"num_write":470,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'770","reported_seq":3244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.198293+0000","last_change":"2024-09-12T19:30:07.198293+0000","last_active":"2024-09-12T19:30:07.198293+0000","last_peered":"2024-09-12T19:30:07.198293+0000","last_clean":"2024-09-12T19:30:07.198293+0000","last_became_active":"2024-09-12T17:36:42.934582+0000","last_became_peered":"2024-09-12T17:36:42.934582+0000","last_unstale":"2024-09-12T19:30:07.198293+0000","last_undegraded":"2024-09-12T19:30:07.198293+0000","last_fullsized":"2024-09-12T19:30:07.198293+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'770","last_scrub_stamp":"2024-09-12T19:30:07.198104+0000","last_deep_scrub":"265'770","last_deep_scrub_stamp":"2024-09-12T19:30:07.198104+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.198104+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:23.704998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'104","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.440516+0000","last_change":"2024-09-12T19:30:14.440516+0000","last_active":"2024-09-12T19:30:14.440516+0000","last_peered":"2024-09-12T19:30:14.440516+0000","last_clean":"2024-09-12T19:30:14.440516+0000","last_became_active":"2024-09-12T17:36:44.937368+0000","last_became_peered":"2024-09-12T17:36:44.937368+0000","last_unstale":"2024-09-12T19:30:14.440516+0000","last_undegraded":"2024-09-12T19:30:14.440516+0000","last_fullsized":"2024-09-12T19:30:14.440516+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T19:30:14.440277+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T19:30:14.440277+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.440277+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:13.019102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":224,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'655","reported_seq":2169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.360525+0000","last_change":"2024-09-12T19:29:55.360525+0000","last_active":"2024-09-12T19:29:55.360525+0000","last_peered":"2024-09-12T19:29:55.360525+0000","last_clean":"2024-09-12T19:29:55.360525+0000","last_became_active":"2024-09-12T17:36:36.883043+0000","last_became_peered":"2024-09-12T17:36:36.883043+0000","last_unstale":"2024-09-12T19:29:55.360525+0000","last_undegraded":"2024-09-12T19:29:55.360525+0000","last_fullsized":"2024-09-12T19:29:55.360525+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'655","last_scrub_stamp":"2024-09-12T19:29:55.360342+0000","last_deep_scrub":"265'655","last_deep_scrub_stamp":"2024-09-12T19:29:55.360342+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.360342+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:36.568704+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3181,"num_read_kb":2856,"num_write":918,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'393","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.103440+0000","last_change":"2024-09-12T19:29:53.103440+0000","last_active":"2024-09-12T19:29:53.103440+0000","last_peered":"2024-09-12T19:29:53.103440+0000","last_clean":"2024-09-12T19:29:53.103440+0000","last_became_active":"2024-09-12T17:36:34.873263+0000","last_became_peered":"2024-09-12T17:36:34.873263+0000","last_unstale":"2024-09-12T19:29:53.103440+0000","last_undegraded":"2024-09-12T19:29:53.103440+0000","last_fullsized":"2024-09-12T19:29:53.103440+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T19:29:53.103209+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T19:29:53.103209+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.103209+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:42.148875+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194346,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":21339,"num_write":1076,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.888492+0000","last_change":"2024-09-12T19:30:02.888492+0000","last_active":"2024-09-12T19:30:02.888492+0000","last_peered":"2024-09-12T19:30:02.888492+0000","last_clean":"2024-09-12T19:30:02.888492+0000","last_became_active":"2024-09-12T17:36:38.888795+0000","last_became_peered":"2024-09-12T17:36:38.888795+0000","last_unstale":"2024-09-12T19:30:02.888492+0000","last_undegraded":"2024-09-12T19:30:02.888492+0000","last_fullsized":"2024-09-12T19:30:02.888492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:02.888300+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:02.888300+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.888300+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:29.619911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'155","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.485137+0000","last_change":"2024-09-12T19:30:09.485137+0000","last_active":"2024-09-12T19:30:09.485137+0000","last_peered":"2024-09-12T19:30:09.485137+0000","last_clean":"2024-09-12T19:30:09.485137+0000","last_became_active":"2024-09-12T17:36:40.893090+0000","last_became_peered":"2024-09-12T17:36:40.893090+0000","last_unstale":"2024-09-12T19:30:09.485137+0000","last_undegraded":"2024-09-12T19:30:09.485137+0000","last_fullsized":"2024-09-12T19:30:09.485137+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'155","last_scrub_stamp":"2024-09-12T19:30:09.484944+0000","last_deep_scrub":"265'155","last_deep_scrub_stamp":"2024-09-12T19:30:09.484944+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.484944+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:12.960615+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'806","reported_seq":3164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.813116+0000","last_change":"2024-09-12T19:30:08.813116+0000","last_active":"2024-09-12T19:30:08.813116+0000","last_peered":"2024-09-12T19:30:08.813116+0000","last_clean":"2024-09-12T19:30:08.813116+0000","last_became_active":"2024-09-12T17:36:42.937195+0000","last_became_peered":"2024-09-12T17:36:42.937195+0000","last_unstale":"2024-09-12T19:30:08.813116+0000","last_undegraded":"2024-09-12T19:30:08.813116+0000","last_fullsized":"2024-09-12T19:30:08.813116+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T19:30:08.812938+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T19:30:08.812938+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.812938+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:24.074921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'109","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.379760+0000","last_change":"2024-09-12T19:30:10.379760+0000","last_active":"2024-09-12T19:30:10.379760+0000","last_peered":"2024-09-12T19:30:10.379760+0000","last_clean":"2024-09-12T19:30:10.379760+0000","last_became_active":"2024-09-12T17:36:44.960042+0000","last_became_peered":"2024-09-12T17:36:44.960042+0000","last_unstale":"2024-09-12T19:30:10.379760+0000","last_undegraded":"2024-09-12T19:30:10.379760+0000","last_fullsized":"2024-09-12T19:30:10.379760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T19:30:10.379634+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T19:30:10.379634+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.379634+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:19.555620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'988","reported_seq":2652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.143275+0000","last_change":"2024-09-12T19:29:55.143275+0000","last_active":"2024-09-12T19:29:55.143275+0000","last_peered":"2024-09-12T19:29:55.143275+0000","last_clean":"2024-09-12T19:29:55.143275+0000","last_became_active":"2024-09-12T17:36:36.913566+0000","last_became_peered":"2024-09-12T17:36:36.913566+0000","last_unstale":"2024-09-12T19:29:55.143275+0000","last_undegraded":"2024-09-12T19:29:55.143275+0000","last_fullsized":"2024-09-12T19:29:55.143275+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'988","last_scrub_stamp":"2024-09-12T19:29:55.143081+0000","last_deep_scrub":"265'988","last_deep_scrub_stamp":"2024-09-12T19:29:55.143081+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.143081+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":900,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:53.114918+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4811,"num_read_kb":4293,"num_write":1402,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'301","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.964599+0000","last_change":"2024-09-12T19:29:51.964599+0000","last_active":"2024-09-12T19:29:51.964599+0000","last_peered":"2024-09-12T19:29:51.964599+0000","last_clean":"2024-09-12T19:29:51.964599+0000","last_became_active":"2024-09-12T17:36:34.862534+0000","last_became_peered":"2024-09-12T17:36:34.862534+0000","last_unstale":"2024-09-12T19:29:51.964599+0000","last_undegraded":"2024-09-12T19:29:51.964599+0000","last_fullsized":"2024-09-12T19:29:51.964599+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T19:29:51.964386+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T19:29:51.964386+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.964386+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:56.102480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":22960,"num_write":940,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.244922+0000","last_change":"2024-09-12T19:30:16.244922+0000","last_active":"2024-09-12T19:30:16.244922+0000","last_peered":"2024-09-12T19:30:16.244922+0000","last_clean":"2024-09-12T19:30:16.244922+0000","last_became_active":"2024-09-12T17:36:38.885678+0000","last_became_peered":"2024-09-12T17:36:38.885678+0000","last_unstale":"2024-09-12T19:30:16.244922+0000","last_undegraded":"2024-09-12T19:30:16.244922+0000","last_fullsized":"2024-09-12T19:30:16.244922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:16.244724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:16.244724+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.244724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:32.116672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'421","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.848360+0000","last_change":"2024-09-12T19:30:05.848360+0000","last_active":"2024-09-12T19:30:05.848360+0000","last_peered":"2024-09-12T19:30:05.848360+0000","last_clean":"2024-09-12T19:30:05.848360+0000","last_became_active":"2024-09-12T17:36:40.900295+0000","last_became_peered":"2024-09-12T17:36:40.900295+0000","last_unstale":"2024-09-12T19:30:05.848360+0000","last_undegraded":"2024-09-12T19:30:05.848360+0000","last_fullsized":"2024-09-12T19:30:05.848360+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T19:30:05.848067+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T19:30:05.848067+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.848067+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:04.379582+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41300,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":664,"num_read_kb":1187,"num_write":496,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.479258+0000","last_change":"2024-09-12T19:30:07.479258+0000","last_active":"2024-09-12T19:30:07.479258+0000","last_peered":"2024-09-12T19:30:07.479258+0000","last_clean":"2024-09-12T19:30:07.479258+0000","last_became_active":"2024-09-12T17:36:42.927716+0000","last_became_peered":"2024-09-12T17:36:42.927716+0000","last_unstale":"2024-09-12T19:30:07.479258+0000","last_undegraded":"2024-09-12T19:30:07.479258+0000","last_fullsized":"2024-09-12T19:30:07.479258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:07.478981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:07.478981+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.478981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:54.816352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'116","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.188295+0000","last_change":"2024-09-12T19:30:13.188295+0000","last_active":"2024-09-12T19:30:13.188295+0000","last_peered":"2024-09-12T19:30:13.188295+0000","last_clean":"2024-09-12T19:30:13.188295+0000","last_became_active":"2024-09-12T17:36:44.942505+0000","last_became_peered":"2024-09-12T17:36:44.942505+0000","last_unstale":"2024-09-12T19:30:13.188295+0000","last_undegraded":"2024-09-12T19:30:13.188295+0000","last_fullsized":"2024-09-12T19:30:13.188295+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T19:30:13.188101+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T19:30:13.188101+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.188101+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:41.920035+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":134,"num_write":256,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'735","reported_seq":2211,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.116820+0000","last_change":"2024-09-12T19:30:05.116820+0000","last_active":"2024-09-12T19:30:05.116820+0000","last_peered":"2024-09-12T19:30:05.116820+0000","last_clean":"2024-09-12T19:30:05.116820+0000","last_became_active":"2024-09-12T17:36:36.881456+0000","last_became_peered":"2024-09-12T17:36:36.881456+0000","last_unstale":"2024-09-12T19:30:05.116820+0000","last_undegraded":"2024-09-12T19:30:05.116820+0000","last_fullsized":"2024-09-12T19:30:05.116820+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'735","last_scrub_stamp":"2024-09-12T19:30:05.116645+0000","last_deep_scrub":"265'735","last_deep_scrub_stamp":"2024-09-12T19:30:05.116645+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.116645+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:47.794091+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3432,"num_read_kb":3120,"num_write":969,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.898417+0000","last_change":"2024-09-12T19:29:49.898417+0000","last_active":"2024-09-12T19:29:49.898417+0000","last_peered":"2024-09-12T19:29:49.898417+0000","last_clean":"2024-09-12T19:29:49.898417+0000","last_became_active":"2024-09-12T17:36:16.722334+0000","last_became_peered":"2024-09-12T17:36:16.722334+0000","last_unstale":"2024-09-12T19:29:49.898417+0000","last_undegraded":"2024-09-12T19:29:49.898417+0000","last_fullsized":"2024-09-12T19:29:49.898417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T19:29:49.898324+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T19:29:49.898324+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.898324+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:33.245609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":560,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.125545+0000","last_change":"2024-09-12T19:29:51.125545+0000","last_active":"2024-09-12T19:29:51.125545+0000","last_peered":"2024-09-12T19:29:51.125545+0000","last_clean":"2024-09-12T19:29:51.125545+0000","last_became_active":"2024-09-12T17:36:21.777852+0000","last_became_peered":"2024-09-12T17:36:21.777852+0000","last_unstale":"2024-09-12T19:29:51.125545+0000","last_undegraded":"2024-09-12T19:29:51.125545+0000","last_fullsized":"2024-09-12T19:29:51.125545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:29:51.125363+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:29:51.125363+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.125363+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.353553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0019340550000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'392","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.973395+0000","last_change":"2024-09-12T19:29:49.973395+0000","last_active":"2024-09-12T19:29:49.973395+0000","last_peered":"2024-09-12T19:29:49.973395+0000","last_clean":"2024-09-12T19:29:49.973395+0000","last_became_active":"2024-09-12T17:36:34.865550+0000","last_became_peered":"2024-09-12T17:36:34.865550+0000","last_unstale":"2024-09-12T19:29:49.973395+0000","last_undegraded":"2024-09-12T19:29:49.973395+0000","last_fullsized":"2024-09-12T19:29:49.973395+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'392","last_scrub_stamp":"2024-09-12T19:29:49.973066+0000","last_deep_scrub":"265'392","last_deep_scrub_stamp":"2024-09-12T19:29:49.973066+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.973066+0000","objects_scrubbed":10,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:01.163698+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":672,"num_read_kb":15438,"num_write":1473,"num_write_kb":31533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.410837+0000","last_change":"2024-09-12T19:30:02.410837+0000","last_active":"2024-09-12T19:30:02.410837+0000","last_peered":"2024-09-12T19:30:02.410837+0000","last_clean":"2024-09-12T19:30:02.410837+0000","last_became_active":"2024-09-12T17:36:38.891774+0000","last_became_peered":"2024-09-12T17:36:38.891774+0000","last_unstale":"2024-09-12T19:30:02.410837+0000","last_undegraded":"2024-09-12T19:30:02.410837+0000","last_fullsized":"2024-09-12T19:30:02.410837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:02.410659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:02.410659+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.410659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:06.637766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'753","reported_seq":1508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.147491+0000","last_change":"2024-09-12T19:30:23.147491+0000","last_active":"2024-09-12T19:30:23.147491+0000","last_peered":"2024-09-12T19:30:23.147491+0000","last_clean":"2024-09-12T19:30:23.147491+0000","last_became_active":"2024-09-12T17:36:40.885684+0000","last_became_peered":"2024-09-12T17:36:40.885684+0000","last_unstale":"2024-09-12T19:30:23.147491+0000","last_undegraded":"2024-09-12T19:30:23.147491+0000","last_fullsized":"2024-09-12T19:30:23.147491+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'753","last_scrub_stamp":"2024-09-12T19:30:23.147238+0000","last_deep_scrub":"265'753","last_deep_scrub_stamp":"2024-09-12T19:30:23.147238+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.147238+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:22.325464+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144787,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1444,"num_read_kb":3163,"num_write":1370,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89364,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.874487+0000","last_change":"2024-09-12T19:30:14.874487+0000","last_active":"2024-09-12T19:30:14.874487+0000","last_peered":"2024-09-12T19:30:14.874487+0000","last_clean":"2024-09-12T19:30:14.874487+0000","last_became_active":"2024-09-12T17:36:42.919204+0000","last_became_peered":"2024-09-12T17:36:42.919204+0000","last_unstale":"2024-09-12T19:30:14.874487+0000","last_undegraded":"2024-09-12T19:30:14.874487+0000","last_fullsized":"2024-09-12T19:30:14.874487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:14.874285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:14.874285+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.874285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:05.726412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'188","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.437887+0000","last_change":"2024-09-12T19:30:06.437887+0000","last_active":"2024-09-12T19:30:06.437887+0000","last_peered":"2024-09-12T19:30:06.437887+0000","last_clean":"2024-09-12T19:30:06.437887+0000","last_became_active":"2024-09-12T17:36:44.954321+0000","last_became_peered":"2024-09-12T17:36:44.954321+0000","last_unstale":"2024-09-12T19:30:06.437887+0000","last_undegraded":"2024-09-12T19:30:06.437887+0000","last_fullsized":"2024-09-12T19:30:06.437887+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T19:30:06.437713+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T19:30:06.437713+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.437713+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:02.954841+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":488,"num_write":378,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'505","reported_seq":2094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.910531+0000","last_change":"2024-09-12T19:30:02.910531+0000","last_active":"2024-09-12T19:30:02.910531+0000","last_peered":"2024-09-12T19:30:02.910531+0000","last_clean":"2024-09-12T19:30:02.910531+0000","last_became_active":"2024-09-12T17:36:36.906789+0000","last_became_peered":"2024-09-12T17:36:36.906789+0000","last_unstale":"2024-09-12T19:30:02.910531+0000","last_undegraded":"2024-09-12T19:30:02.910531+0000","last_fullsized":"2024-09-12T19:30:02.910531+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:30:02.910308+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:30:02.910308+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.910308+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:02.545989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2691,"num_read_kb":2505,"num_write":636,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":560,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.034793+0000","last_change":"2024-09-12T19:29:49.034793+0000","last_active":"2024-09-12T19:29:49.034793+0000","last_peered":"2024-09-12T19:29:49.034793+0000","last_clean":"2024-09-12T19:29:49.034793+0000","last_became_active":"2024-09-12T17:36:21.785026+0000","last_became_peered":"2024-09-12T17:36:21.785026+0000","last_unstale":"2024-09-12T19:29:49.034793+0000","last_undegraded":"2024-09-12T19:29:49.034793+0000","last_fullsized":"2024-09-12T19:29:49.034793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:49.034625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:49.034625+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.034625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:04.032231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184601,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'384","reported_seq":1094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.337277+0000","last_change":"2024-09-12T19:29:49.337277+0000","last_active":"2024-09-12T19:29:49.337277+0000","last_peered":"2024-09-12T19:29:49.337277+0000","last_clean":"2024-09-12T19:29:49.337277+0000","last_became_active":"2024-09-12T17:36:34.882818+0000","last_became_peered":"2024-09-12T17:36:34.882818+0000","last_unstale":"2024-09-12T19:29:49.337277+0000","last_undegraded":"2024-09-12T19:29:49.337277+0000","last_fullsized":"2024-09-12T19:29:49.337277+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T19:29:49.337016+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T19:29:49.337016+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.337016+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:42.148166+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263289,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":609,"num_read_kb":22197,"num_write":1318,"num_write_kb":15503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.207386+0000","last_change":"2024-09-12T19:30:17.207386+0000","last_active":"2024-09-12T19:30:17.207386+0000","last_peered":"2024-09-12T19:30:17.207386+0000","last_clean":"2024-09-12T19:30:17.207386+0000","last_became_active":"2024-09-12T17:36:38.895378+0000","last_became_peered":"2024-09-12T17:36:38.895378+0000","last_unstale":"2024-09-12T19:30:17.207386+0000","last_undegraded":"2024-09-12T19:30:17.207386+0000","last_fullsized":"2024-09-12T19:30:17.207386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:17.207209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:17.207209+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.207209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:15.388414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1459","reported_seq":3821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.186738+0000","last_change":"2024-09-12T19:30:08.186738+0000","last_active":"2024-09-12T19:30:08.186738+0000","last_peered":"2024-09-12T19:30:08.186738+0000","last_clean":"2024-09-12T19:30:08.186738+0000","last_became_active":"2024-09-12T17:36:40.908721+0000","last_became_peered":"2024-09-12T17:36:40.908721+0000","last_unstale":"2024-09-12T19:30:08.186738+0000","last_undegraded":"2024-09-12T19:30:08.186738+0000","last_fullsized":"2024-09-12T19:30:08.186738+0000","mapping_epoch":30,"log_start":"265'1400","ondisk_log_start":"265'1400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1459","last_scrub_stamp":"2024-09-12T19:30:08.186556+0000","last_deep_scrub":"265'1459","last_deep_scrub_stamp":"2024-09-12T19:30:08.186556+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.186556+0000","objects_scrubbed":11,"log_size":59,"log_dups_size":1400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:47.270094+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146546,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2270,"num_read_kb":4170,"num_write":1382,"num_write_kb":1134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.167515+0000","last_change":"2024-09-12T19:30:22.167515+0000","last_active":"2024-09-12T19:30:22.167515+0000","last_peered":"2024-09-12T19:30:22.167515+0000","last_clean":"2024-09-12T19:30:22.167515+0000","last_became_active":"2024-09-12T17:36:42.917432+0000","last_became_peered":"2024-09-12T17:36:42.917432+0000","last_unstale":"2024-09-12T19:30:22.167515+0000","last_undegraded":"2024-09-12T19:30:22.167515+0000","last_fullsized":"2024-09-12T19:30:22.167515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.167254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.167254+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.167254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:19.411131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'254","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.833332+0000","last_change":"2024-09-12T19:30:19.833332+0000","last_active":"2024-09-12T19:30:19.833332+0000","last_peered":"2024-09-12T19:30:19.833332+0000","last_clean":"2024-09-12T19:30:19.833332+0000","last_became_active":"2024-09-12T17:36:44.956687+0000","last_became_peered":"2024-09-12T17:36:44.956687+0000","last_unstale":"2024-09-12T19:30:19.833332+0000","last_undegraded":"2024-09-12T19:30:19.833332+0000","last_fullsized":"2024-09-12T19:30:19.833332+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-12T19:30:19.833141+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-12T19:30:19.833141+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.833141+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:20.668124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":419,"num_write":569,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'459","reported_seq":1919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.431161+0000","last_change":"2024-09-12T19:29:57.431161+0000","last_active":"2024-09-12T19:29:57.431161+0000","last_peered":"2024-09-12T19:29:57.431161+0000","last_clean":"2024-09-12T19:29:57.431161+0000","last_became_active":"2024-09-12T17:36:36.876424+0000","last_became_peered":"2024-09-12T17:36:36.876424+0000","last_unstale":"2024-09-12T19:29:57.431161+0000","last_undegraded":"2024-09-12T19:29:57.431161+0000","last_fullsized":"2024-09-12T19:29:57.431161+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'459","last_scrub_stamp":"2024-09-12T19:29:57.430975+0000","last_deep_scrub":"265'459","last_deep_scrub_stamp":"2024-09-12T19:29:57.430975+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.430975+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:09.526597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2313,"num_read_kb":2138,"num_write":582,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":559,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.154192+0000","last_change":"2024-09-12T19:29:50.154192+0000","last_active":"2024-09-12T19:29:50.154192+0000","last_peered":"2024-09-12T19:29:50.154192+0000","last_clean":"2024-09-12T19:29:50.154192+0000","last_became_active":"2024-09-12T17:36:21.786793+0000","last_became_peered":"2024-09-12T17:36:21.786793+0000","last_unstale":"2024-09-12T19:29:50.154192+0000","last_undegraded":"2024-09-12T19:29:50.154192+0000","last_fullsized":"2024-09-12T19:29:50.154192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:50.154015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:50.154015+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.154015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:03.469572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011925740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'325","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.914352+0000","last_change":"2024-09-12T19:29:49.914352+0000","last_active":"2024-09-12T19:29:49.914352+0000","last_peered":"2024-09-12T19:29:49.914352+0000","last_clean":"2024-09-12T19:29:49.914352+0000","last_became_active":"2024-09-12T17:36:34.878944+0000","last_became_peered":"2024-09-12T17:36:34.878944+0000","last_unstale":"2024-09-12T19:29:49.914352+0000","last_undegraded":"2024-09-12T19:29:49.914352+0000","last_fullsized":"2024-09-12T19:29:49.914352+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'325","last_scrub_stamp":"2024-09-12T19:29:49.914119+0000","last_deep_scrub":"265'325","last_deep_scrub_stamp":"2024-09-12T19:29:49.914119+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.914119+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:49.927843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526370,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":517,"num_read_kb":44432,"num_write":1109,"num_write_kb":34964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.067399+0000","last_change":"2024-09-12T19:30:03.067399+0000","last_active":"2024-09-12T19:30:03.067399+0000","last_peered":"2024-09-12T19:30:03.067399+0000","last_clean":"2024-09-12T19:30:03.067399+0000","last_became_active":"2024-09-12T17:36:38.907685+0000","last_became_peered":"2024-09-12T17:36:38.907685+0000","last_unstale":"2024-09-12T19:30:03.067399+0000","last_undegraded":"2024-09-12T19:30:03.067399+0000","last_fullsized":"2024-09-12T19:30:03.067399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:03.067178+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:03.067178+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.067178+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:13.152392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'394","reported_seq":2363,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.492938+0000","last_change":"2024-09-12T19:30:07.492938+0000","last_active":"2024-09-12T19:30:07.492938+0000","last_peered":"2024-09-12T19:30:07.492938+0000","last_clean":"2024-09-12T19:30:07.492938+0000","last_became_active":"2024-09-12T17:36:40.907340+0000","last_became_peered":"2024-09-12T17:36:40.907340+0000","last_unstale":"2024-09-12T19:30:07.492938+0000","last_undegraded":"2024-09-12T19:30:07.492938+0000","last_fullsized":"2024-09-12T19:30:07.492938+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T19:30:07.492731+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T19:30:07.492731+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.492731+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:01.941637+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":374,"num_read_kb":364,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.047061+0000","last_change":"2024-09-12T19:30:20.047061+0000","last_active":"2024-09-12T19:30:20.047061+0000","last_peered":"2024-09-12T19:30:20.047061+0000","last_clean":"2024-09-12T19:30:20.047061+0000","last_became_active":"2024-09-12T17:36:42.931884+0000","last_became_peered":"2024-09-12T17:36:42.931884+0000","last_unstale":"2024-09-12T19:30:20.047061+0000","last_undegraded":"2024-09-12T19:30:20.047061+0000","last_fullsized":"2024-09-12T19:30:20.047061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:20.046878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:20.046878+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.046878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:37.970477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'260","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.041036+0000","last_change":"2024-09-12T19:30:24.041036+0000","last_active":"2024-09-12T19:30:24.041036+0000","last_peered":"2024-09-12T19:30:24.041036+0000","last_clean":"2024-09-12T19:30:24.041036+0000","last_became_active":"2024-09-12T17:36:44.940041+0000","last_became_peered":"2024-09-12T17:36:44.940041+0000","last_unstale":"2024-09-12T19:30:24.041036+0000","last_undegraded":"2024-09-12T19:30:24.041036+0000","last_fullsized":"2024-09-12T19:30:24.041036+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T19:30:24.040859+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T19:30:24.040859+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.040859+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:12.153683+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":565,"num_write":575,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'751","reported_seq":2229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.430540+0000","last_change":"2024-09-12T19:29:58.430540+0000","last_active":"2024-09-12T19:29:58.430540+0000","last_peered":"2024-09-12T19:29:58.430540+0000","last_clean":"2024-09-12T19:29:58.430540+0000","last_became_active":"2024-09-12T17:36:36.896152+0000","last_became_peered":"2024-09-12T17:36:36.896152+0000","last_unstale":"2024-09-12T19:29:58.430540+0000","last_undegraded":"2024-09-12T19:29:58.430540+0000","last_fullsized":"2024-09-12T19:29:58.430540+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'751","last_scrub_stamp":"2024-09-12T19:29:58.430337+0000","last_deep_scrub":"265'751","last_deep_scrub_stamp":"2024-09-12T19:29:58.430337+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.430337+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:51.087393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3496,"num_read_kb":3152,"num_write":986,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":561,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.061350+0000","last_change":"2024-09-12T19:29:48.061350+0000","last_active":"2024-09-12T19:29:48.061350+0000","last_peered":"2024-09-12T19:29:48.061350+0000","last_clean":"2024-09-12T19:29:48.061350+0000","last_became_active":"2024-09-12T17:36:21.777173+0000","last_became_peered":"2024-09-12T17:36:21.777173+0000","last_unstale":"2024-09-12T19:29:48.061350+0000","last_undegraded":"2024-09-12T19:29:48.061350+0000","last_fullsized":"2024-09-12T19:29:48.061350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T19:29:48.061179+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T19:29:48.061179+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.061179+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:31.413285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001776889,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'361","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.180093+0000","last_change":"2024-09-12T19:29:51.180093+0000","last_active":"2024-09-12T19:29:51.180093+0000","last_peered":"2024-09-12T19:29:51.180093+0000","last_clean":"2024-09-12T19:29:51.180093+0000","last_became_active":"2024-09-12T17:37:07.867652+0000","last_became_peered":"2024-09-12T17:37:07.867652+0000","last_unstale":"2024-09-12T19:29:51.180093+0000","last_undegraded":"2024-09-12T19:29:51.180093+0000","last_fullsized":"2024-09-12T19:29:51.180093+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:29:51.179910+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:29:51.179910+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.179910+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:46.705185+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":639,"num_read_kb":7400,"num_write":1137,"num_write_kb":18590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.125119+0000","last_change":"2024-09-12T19:30:01.125119+0000","last_active":"2024-09-12T19:30:01.125119+0000","last_peered":"2024-09-12T19:30:01.125119+0000","last_clean":"2024-09-12T19:30:01.125119+0000","last_became_active":"2024-09-12T17:36:38.912059+0000","last_became_peered":"2024-09-12T17:36:38.912059+0000","last_unstale":"2024-09-12T19:30:01.125119+0000","last_undegraded":"2024-09-12T19:30:01.125119+0000","last_fullsized":"2024-09-12T19:30:01.125119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:01.124924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:01.124924+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.124924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:24.544303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'223","reported_seq":845,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.842299+0000","last_change":"2024-09-12T19:30:11.842299+0000","last_active":"2024-09-12T19:30:11.842299+0000","last_peered":"2024-09-12T19:30:11.842299+0000","last_clean":"2024-09-12T19:30:11.842299+0000","last_became_active":"2024-09-12T17:36:40.884794+0000","last_became_peered":"2024-09-12T17:36:40.884794+0000","last_unstale":"2024-09-12T19:30:11.842299+0000","last_undegraded":"2024-09-12T19:30:11.842299+0000","last_fullsized":"2024-09-12T19:30:11.842299+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'223","last_scrub_stamp":"2024-09-12T19:30:11.842122+0000","last_deep_scrub":"265'223","last_deep_scrub_stamp":"2024-09-12T19:30:11.842122+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.842122+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:00.405422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":278,"num_read_kb":269,"num_write":202,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.126363+0000","last_change":"2024-09-12T19:30:27.126363+0000","last_active":"2024-09-12T19:30:27.126363+0000","last_peered":"2024-09-12T19:30:27.126363+0000","last_clean":"2024-09-12T19:30:27.126363+0000","last_became_active":"2024-09-12T17:36:42.920887+0000","last_became_peered":"2024-09-12T17:36:42.920887+0000","last_unstale":"2024-09-12T19:30:27.126363+0000","last_undegraded":"2024-09-12T19:30:27.126363+0000","last_fullsized":"2024-09-12T19:30:27.126363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:27.126185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:27.126185+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.126185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:03.775134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'127","reported_seq":721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.753785+0000","last_change":"2024-09-12T19:30:15.753785+0000","last_active":"2024-09-12T19:30:15.753785+0000","last_peered":"2024-09-12T19:30:15.753785+0000","last_clean":"2024-09-12T19:30:15.753785+0000","last_became_active":"2024-09-12T17:36:44.937666+0000","last_became_peered":"2024-09-12T17:36:44.937666+0000","last_unstale":"2024-09-12T19:30:15.753785+0000","last_undegraded":"2024-09-12T19:30:15.753785+0000","last_fullsized":"2024-09-12T19:30:15.753785+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T19:30:15.753598+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T19:30:15.753598+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.753598+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.724999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":289,"num_read_kb":276,"num_write":312,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'531","reported_seq":2150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.379702+0000","last_change":"2024-09-12T19:29:55.379702+0000","last_active":"2024-09-12T19:29:55.379702+0000","last_peered":"2024-09-12T19:29:55.379702+0000","last_clean":"2024-09-12T19:29:55.379702+0000","last_became_active":"2024-09-12T17:36:36.880335+0000","last_became_peered":"2024-09-12T17:36:36.880335+0000","last_unstale":"2024-09-12T19:29:55.379702+0000","last_undegraded":"2024-09-12T19:29:55.379702+0000","last_fullsized":"2024-09-12T19:29:55.379702+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'531","last_scrub_stamp":"2024-09-12T19:29:55.379515+0000","last_deep_scrub":"265'531","last_deep_scrub_stamp":"2024-09-12T19:29:55.379515+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.379515+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:12.812873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2654,"num_read_kb":2484,"num_write":644,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'379","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.385447+0000","last_change":"2024-09-12T19:29:47.385447+0000","last_active":"2024-09-12T19:29:47.385447+0000","last_peered":"2024-09-12T19:29:47.385447+0000","last_clean":"2024-09-12T19:29:47.385447+0000","last_became_active":"2024-09-12T17:36:34.877412+0000","last_became_peered":"2024-09-12T17:36:34.877412+0000","last_unstale":"2024-09-12T19:29:47.385447+0000","last_undegraded":"2024-09-12T19:29:47.385447+0000","last_fullsized":"2024-09-12T19:29:47.385447+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'379","last_scrub_stamp":"2024-09-12T19:29:47.385337+0000","last_deep_scrub":"265'379","last_deep_scrub_stamp":"2024-09-12T19:29:47.385337+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.385337+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:45.645372+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6755987,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":26720,"num_write":1165,"num_write_kb":36792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.889621+0000","last_change":"2024-09-12T19:29:48.889621+0000","last_active":"2024-09-12T19:29:48.889621+0000","last_peered":"2024-09-12T19:29:48.889621+0000","last_clean":"2024-09-12T19:29:48.889621+0000","last_became_active":"2024-09-12T17:36:21.786429+0000","last_became_peered":"2024-09-12T17:36:21.786429+0000","last_unstale":"2024-09-12T19:29:48.889621+0000","last_undegraded":"2024-09-12T19:29:48.889621+0000","last_fullsized":"2024-09-12T19:29:48.889621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:48.889441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:48.889441+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.889441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:45.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011387680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"265'6","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.935990+0000","last_change":"2024-09-12T19:30:06.935990+0000","last_active":"2024-09-12T19:30:06.935990+0000","last_peered":"2024-09-12T19:30:06.935990+0000","last_clean":"2024-09-12T19:30:06.935990+0000","last_became_active":"2024-09-12T17:36:38.902432+0000","last_became_peered":"2024-09-12T17:36:38.902432+0000","last_unstale":"2024-09-12T19:30:06.935990+0000","last_undegraded":"2024-09-12T19:30:06.935990+0000","last_fullsized":"2024-09-12T19:30:06.935990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:30:06.935793+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:30:06.935793+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.935793+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:24:01.944572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":1196,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'762","reported_seq":1508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.173560+0000","last_change":"2024-09-12T19:30:05.173560+0000","last_active":"2024-09-12T19:30:05.173560+0000","last_peered":"2024-09-12T19:30:05.173560+0000","last_clean":"2024-09-12T19:30:05.173560+0000","last_became_active":"2024-09-12T17:36:40.902488+0000","last_became_peered":"2024-09-12T17:36:40.902488+0000","last_unstale":"2024-09-12T19:30:05.173560+0000","last_undegraded":"2024-09-12T19:30:05.173560+0000","last_fullsized":"2024-09-12T19:30:05.173560+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'762","last_scrub_stamp":"2024-09-12T19:30:05.173334+0000","last_deep_scrub":"265'762","last_deep_scrub_stamp":"2024-09-12T19:30:05.173334+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.173334+0000","objects_scrubbed":10,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:35.044431+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98161,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1955,"num_read_kb":3163,"num_write":2614,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508704,"num_omap_keys":1156,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.432752+0000","last_change":"2024-09-12T19:30:06.432752+0000","last_active":"2024-09-12T19:30:06.432752+0000","last_peered":"2024-09-12T19:30:06.432752+0000","last_clean":"2024-09-12T19:30:06.432752+0000","last_became_active":"2024-09-12T17:36:42.931746+0000","last_became_peered":"2024-09-12T17:36:42.931746+0000","last_unstale":"2024-09-12T19:30:06.432752+0000","last_undegraded":"2024-09-12T19:30:06.432752+0000","last_fullsized":"2024-09-12T19:30:06.432752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:06.432573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:06.432573+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.432573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:42.589039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'140","reported_seq":688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.862755+0000","last_change":"2024-09-12T19:30:21.862755+0000","last_active":"2024-09-12T19:30:21.862755+0000","last_peered":"2024-09-12T19:30:21.862755+0000","last_clean":"2024-09-12T19:30:21.862755+0000","last_became_active":"2024-09-12T17:36:44.959109+0000","last_became_peered":"2024-09-12T17:36:44.959109+0000","last_unstale":"2024-09-12T19:30:21.862755+0000","last_undegraded":"2024-09-12T19:30:21.862755+0000","last_fullsized":"2024-09-12T19:30:21.862755+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T19:30:21.862544+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T19:30:21.862544+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.862544+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:06.313478+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'606","reported_seq":2154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.417555+0000","last_change":"2024-09-12T19:29:56.417555+0000","last_active":"2024-09-12T19:29:56.417555+0000","last_peered":"2024-09-12T19:29:56.417555+0000","last_clean":"2024-09-12T19:29:56.417555+0000","last_became_active":"2024-09-12T17:36:36.883397+0000","last_became_peered":"2024-09-12T17:36:36.883397+0000","last_unstale":"2024-09-12T19:29:56.417555+0000","last_undegraded":"2024-09-12T19:29:56.417555+0000","last_fullsized":"2024-09-12T19:29:56.417555+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'606","last_scrub_stamp":"2024-09-12T19:29:56.417345+0000","last_deep_scrub":"265'606","last_deep_scrub_stamp":"2024-09-12T19:29:56.417345+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.417345+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:40.538277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3050,"num_read_kb":2738,"num_write":793,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'373","reported_seq":1105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.305851+0000","last_change":"2024-09-12T19:29:50.305851+0000","last_active":"2024-09-12T19:29:50.305851+0000","last_peered":"2024-09-12T19:29:50.305851+0000","last_clean":"2024-09-12T19:29:50.305851+0000","last_became_active":"2024-09-12T17:36:34.892255+0000","last_became_peered":"2024-09-12T17:36:34.892255+0000","last_unstale":"2024-09-12T19:29:50.305851+0000","last_undegraded":"2024-09-12T19:29:50.305851+0000","last_fullsized":"2024-09-12T19:29:50.305851+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:29:50.305656+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:29:50.305656+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.305656+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:22.178790+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400040,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":627,"num_read_kb":68904,"num_write":1058,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.074460+0000","last_change":"2024-09-12T19:29:52.074460+0000","last_active":"2024-09-12T19:29:52.074460+0000","last_peered":"2024-09-12T19:29:52.074460+0000","last_clean":"2024-09-12T19:29:52.074460+0000","last_became_active":"2024-09-12T17:36:21.783069+0000","last_became_peered":"2024-09-12T17:36:21.783069+0000","last_unstale":"2024-09-12T19:29:52.074460+0000","last_undegraded":"2024-09-12T19:29:52.074460+0000","last_fullsized":"2024-09-12T19:29:52.074460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:52.074270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:52.074270+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.074270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:39.027678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001135285,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.463533+0000","last_change":"2024-09-12T19:30:04.463533+0000","last_active":"2024-09-12T19:30:04.463533+0000","last_peered":"2024-09-12T19:30:04.463533+0000","last_clean":"2024-09-12T19:30:04.463533+0000","last_became_active":"2024-09-12T17:36:38.900433+0000","last_became_peered":"2024-09-12T17:36:38.900433+0000","last_unstale":"2024-09-12T19:30:04.463533+0000","last_undegraded":"2024-09-12T19:30:04.463533+0000","last_fullsized":"2024-09-12T19:30:04.463533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.463348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.463348+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.463348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:22.114565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'254","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.539472+0000","last_change":"2024-09-12T19:30:07.539472+0000","last_active":"2024-09-12T19:30:07.539472+0000","last_peered":"2024-09-12T19:30:07.539472+0000","last_clean":"2024-09-12T19:30:07.539472+0000","last_became_active":"2024-09-12T17:36:40.886345+0000","last_became_peered":"2024-09-12T17:36:40.886345+0000","last_unstale":"2024-09-12T19:30:07.539472+0000","last_undegraded":"2024-09-12T19:30:07.539472+0000","last_fullsized":"2024-09-12T19:30:07.539472+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-12T19:30:07.539275+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-12T19:30:07.539275+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.539275+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:20.151842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'805","reported_seq":3509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.776206+0000","last_change":"2024-09-12T19:30:11.776206+0000","last_active":"2024-09-12T19:30:11.776206+0000","last_peered":"2024-09-12T19:30:11.776206+0000","last_clean":"2024-09-12T19:30:11.776206+0000","last_became_active":"2024-09-12T17:36:42.931598+0000","last_became_peered":"2024-09-12T17:36:42.931598+0000","last_unstale":"2024-09-12T19:30:11.776206+0000","last_undegraded":"2024-09-12T19:30:11.776206+0000","last_fullsized":"2024-09-12T19:30:11.776206+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'805","last_scrub_stamp":"2024-09-12T19:30:11.776004+0000","last_deep_scrub":"265'805","last_deep_scrub_stamp":"2024-09-12T19:30:11.776004+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.776004+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:37.485165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'140","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.127004+0000","last_change":"2024-09-12T19:30:17.127004+0000","last_active":"2024-09-12T19:30:17.127004+0000","last_peered":"2024-09-12T19:30:17.127004+0000","last_clean":"2024-09-12T19:30:17.127004+0000","last_became_active":"2024-09-12T17:36:44.951849+0000","last_became_peered":"2024-09-12T17:36:44.951849+0000","last_unstale":"2024-09-12T19:30:17.127004+0000","last_undegraded":"2024-09-12T19:30:17.127004+0000","last_fullsized":"2024-09-12T19:30:17.127004+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T19:30:17.126798+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T19:30:17.126798+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.126798+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:37.952052+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'744","reported_seq":2385,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.897523+0000","last_change":"2024-09-12T19:29:57.897523+0000","last_active":"2024-09-12T19:29:57.897523+0000","last_peered":"2024-09-12T19:29:57.897523+0000","last_clean":"2024-09-12T19:29:57.897523+0000","last_became_active":"2024-09-12T17:36:36.892861+0000","last_became_peered":"2024-09-12T17:36:36.892861+0000","last_unstale":"2024-09-12T19:29:57.897523+0000","last_undegraded":"2024-09-12T19:29:57.897523+0000","last_fullsized":"2024-09-12T19:29:57.897523+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'744","last_scrub_stamp":"2024-09-12T19:29:57.897218+0000","last_deep_scrub":"265'744","last_deep_scrub_stamp":"2024-09-12T19:29:57.897218+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.897218+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:49.749434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3560,"num_read_kb":3257,"num_write":956,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'351","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.000072+0000","last_change":"2024-09-12T19:29:53.000072+0000","last_active":"2024-09-12T19:29:53.000072+0000","last_peered":"2024-09-12T19:29:53.000072+0000","last_clean":"2024-09-12T19:29:53.000072+0000","last_became_active":"2024-09-12T17:36:34.883331+0000","last_became_peered":"2024-09-12T17:36:34.883331+0000","last_unstale":"2024-09-12T19:29:53.000072+0000","last_undegraded":"2024-09-12T19:29:53.000072+0000","last_fullsized":"2024-09-12T19:29:53.000072+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-12T19:29:52.999859+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-12T19:29:52.999859+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.999859+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:19.508145+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":26132,"num_write":1177,"num_write_kb":40752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.922514+0000","last_change":"2024-09-12T19:29:48.922514+0000","last_active":"2024-09-12T19:29:48.922514+0000","last_peered":"2024-09-12T19:29:48.922514+0000","last_clean":"2024-09-12T19:29:48.922514+0000","last_became_active":"2024-09-12T17:36:22.059379+0000","last_became_peered":"2024-09-12T17:36:22.059379+0000","last_unstale":"2024-09-12T19:29:48.922514+0000","last_undegraded":"2024-09-12T19:29:48.922514+0000","last_fullsized":"2024-09-12T19:29:48.922514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:48.922319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:48.922319+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.922319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:36.603470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012087210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.245644+0000","last_change":"2024-09-12T19:30:15.245644+0000","last_active":"2024-09-12T19:30:15.245644+0000","last_peered":"2024-09-12T19:30:15.245644+0000","last_clean":"2024-09-12T19:30:15.245644+0000","last_became_active":"2024-09-12T17:36:38.891807+0000","last_became_peered":"2024-09-12T17:36:38.891807+0000","last_unstale":"2024-09-12T19:30:15.245644+0000","last_undegraded":"2024-09-12T19:30:15.245644+0000","last_fullsized":"2024-09-12T19:30:15.245644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:15.245464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:15.245464+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.245464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:53.751956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'179","reported_seq":786,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.181626+0000","last_change":"2024-09-12T19:30:20.181626+0000","last_active":"2024-09-12T19:30:20.181626+0000","last_peered":"2024-09-12T19:30:20.181626+0000","last_clean":"2024-09-12T19:30:20.181626+0000","last_became_active":"2024-09-12T17:36:40.897763+0000","last_became_peered":"2024-09-12T17:36:40.897763+0000","last_unstale":"2024-09-12T19:30:20.181626+0000","last_undegraded":"2024-09-12T19:30:20.181626+0000","last_fullsized":"2024-09-12T19:30:20.181626+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'179","last_scrub_stamp":"2024-09-12T19:30:20.181421+0000","last_deep_scrub":"265'179","last_deep_scrub_stamp":"2024-09-12T19:30:20.181421+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.181421+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:55.791206+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'802","reported_seq":3157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.827708+0000","last_change":"2024-09-12T19:30:13.827708+0000","last_active":"2024-09-12T19:30:13.827708+0000","last_peered":"2024-09-12T19:30:13.827708+0000","last_clean":"2024-09-12T19:30:13.827708+0000","last_became_active":"2024-09-12T17:36:42.928978+0000","last_became_peered":"2024-09-12T17:36:42.928978+0000","last_unstale":"2024-09-12T19:30:13.827708+0000","last_undegraded":"2024-09-12T19:30:13.827708+0000","last_fullsized":"2024-09-12T19:30:13.827708+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'802","last_scrub_stamp":"2024-09-12T19:30:13.827491+0000","last_deep_scrub":"265'802","last_deep_scrub_stamp":"2024-09-12T19:30:13.827491+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.827491+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:15.050072+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'238","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.812676+0000","last_change":"2024-09-12T19:30:26.812676+0000","last_active":"2024-09-12T19:30:26.812676+0000","last_peered":"2024-09-12T19:30:26.812676+0000","last_clean":"2024-09-12T19:30:26.812676+0000","last_became_active":"2024-09-12T17:36:44.956784+0000","last_became_peered":"2024-09-12T17:36:44.956784+0000","last_unstale":"2024-09-12T19:30:26.812676+0000","last_undegraded":"2024-09-12T19:30:26.812676+0000","last_fullsized":"2024-09-12T19:30:26.812676+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'238","last_scrub_stamp":"2024-09-12T19:30:26.812495+0000","last_deep_scrub":"265'238","last_deep_scrub_stamp":"2024-09-12T19:30:26.812495+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.812495+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:43.651565+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":233,"num_read_kb":216,"num_write":428,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'374","reported_seq":2048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.351332+0000","last_change":"2024-09-12T19:29:53.351332+0000","last_active":"2024-09-12T19:29:53.351332+0000","last_peered":"2024-09-12T19:29:53.351332+0000","last_clean":"2024-09-12T19:29:53.351332+0000","last_became_active":"2024-09-12T17:36:36.883862+0000","last_became_peered":"2024-09-12T17:36:36.883862+0000","last_unstale":"2024-09-12T19:29:53.351332+0000","last_undegraded":"2024-09-12T19:29:53.351332+0000","last_fullsized":"2024-09-12T19:29:53.351332+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T19:29:53.351161+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T19:29:53.351161+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.351161+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:18.340873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2422,"num_read_kb":2340,"num_write":416,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'355","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.004315+0000","last_change":"2024-09-12T19:29:51.004315+0000","last_active":"2024-09-12T19:29:51.004315+0000","last_peered":"2024-09-12T19:29:51.004315+0000","last_clean":"2024-09-12T19:29:51.004315+0000","last_became_active":"2024-09-12T17:36:34.868641+0000","last_became_peered":"2024-09-12T17:36:34.868641+0000","last_unstale":"2024-09-12T19:29:51.004315+0000","last_undegraded":"2024-09-12T19:29:51.004315+0000","last_fullsized":"2024-09-12T19:29:51.004315+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T19:29:51.004074+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T19:29:51.004074+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.004074+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:19.751431+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1398988,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":547,"num_read_kb":35743,"num_write":1181,"num_write_kb":32710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":556,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.075936+0000","last_change":"2024-09-12T19:29:50.075936+0000","last_active":"2024-09-12T19:29:50.075936+0000","last_peered":"2024-09-12T19:29:50.075936+0000","last_clean":"2024-09-12T19:29:50.075936+0000","last_became_active":"2024-09-12T17:36:22.058794+0000","last_became_peered":"2024-09-12T17:36:22.058794+0000","last_unstale":"2024-09-12T19:29:50.075936+0000","last_undegraded":"2024-09-12T19:29:50.075936+0000","last_fullsized":"2024-09-12T19:29:50.075936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:50.075752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:50.075752+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.075752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:54.554291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":544,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.900228+0000","last_change":"2024-09-12T19:30:04.900228+0000","last_active":"2024-09-12T19:30:04.900228+0000","last_peered":"2024-09-12T19:30:04.900228+0000","last_clean":"2024-09-12T19:30:04.900228+0000","last_became_active":"2024-09-12T17:36:38.901418+0000","last_became_peered":"2024-09-12T17:36:38.901418+0000","last_unstale":"2024-09-12T19:30:04.900228+0000","last_undegraded":"2024-09-12T19:30:04.900228+0000","last_fullsized":"2024-09-12T19:30:04.900228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.900053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.900053+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.900053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:11.827647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'816","reported_seq":1613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.433089+0000","last_change":"2024-09-12T19:30:03.433089+0000","last_active":"2024-09-12T19:30:03.433089+0000","last_peered":"2024-09-12T19:30:03.433089+0000","last_clean":"2024-09-12T19:30:03.433089+0000","last_became_active":"2024-09-12T17:36:40.908231+0000","last_became_peered":"2024-09-12T17:36:40.908231+0000","last_unstale":"2024-09-12T19:30:03.433089+0000","last_undegraded":"2024-09-12T19:30:03.433089+0000","last_fullsized":"2024-09-12T19:30:03.433089+0000","mapping_epoch":30,"log_start":"265'800","ondisk_log_start":"265'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'816","last_scrub_stamp":"2024-09-12T19:30:03.432954+0000","last_deep_scrub":"265'816","last_deep_scrub_stamp":"2024-09-12T19:30:03.432954+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.432954+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:15.981426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146317,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3243,"num_write":1152,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.036553+0000","last_change":"2024-09-12T19:30:19.036553+0000","last_active":"2024-09-12T19:30:19.036553+0000","last_peered":"2024-09-12T19:30:19.036553+0000","last_clean":"2024-09-12T19:30:19.036553+0000","last_became_active":"2024-09-12T17:36:42.932086+0000","last_became_peered":"2024-09-12T17:36:42.932086+0000","last_unstale":"2024-09-12T19:30:19.036553+0000","last_undegraded":"2024-09-12T19:30:19.036553+0000","last_fullsized":"2024-09-12T19:30:19.036553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:19.036334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:19.036334+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.036334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:52.784984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'128","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.459855+0000","last_change":"2024-09-12T19:30:17.459855+0000","last_active":"2024-09-12T19:30:17.459855+0000","last_peered":"2024-09-12T19:30:17.459855+0000","last_clean":"2024-09-12T19:30:17.459855+0000","last_became_active":"2024-09-12T17:36:44.960744+0000","last_became_peered":"2024-09-12T17:36:44.960744+0000","last_unstale":"2024-09-12T19:30:17.459855+0000","last_undegraded":"2024-09-12T19:30:17.459855+0000","last_fullsized":"2024-09-12T19:30:17.459855+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T19:30:17.459640+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T19:30:17.459640+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.459640+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:43.927040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":186,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'136","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.019914+0000","last_change":"2024-09-12T19:30:25.019914+0000","last_active":"2024-09-12T19:30:25.019914+0000","last_peered":"2024-09-12T19:30:25.019914+0000","last_clean":"2024-09-12T19:30:25.019914+0000","last_became_active":"2024-09-12T17:36:44.939820+0000","last_became_peered":"2024-09-12T17:36:44.939820+0000","last_unstale":"2024-09-12T19:30:25.019914+0000","last_undegraded":"2024-09-12T19:30:25.019914+0000","last_fullsized":"2024-09-12T19:30:25.019914+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T19:30:25.019723+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T19:30:25.019723+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.019723+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:30.905979+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":235,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'802","reported_seq":2469,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.382818+0000","last_change":"2024-09-12T19:29:58.382818+0000","last_active":"2024-09-12T19:29:58.382818+0000","last_peered":"2024-09-12T19:29:58.382818+0000","last_clean":"2024-09-12T19:29:58.382818+0000","last_became_active":"2024-09-12T17:36:36.883481+0000","last_became_peered":"2024-09-12T17:36:36.883481+0000","last_unstale":"2024-09-12T19:29:58.382818+0000","last_undegraded":"2024-09-12T19:29:58.382818+0000","last_fullsized":"2024-09-12T19:29:58.382818+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'802","last_scrub_stamp":"2024-09-12T19:29:58.382629+0000","last_deep_scrub":"265'802","last_deep_scrub_stamp":"2024-09-12T19:29:58.382629+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.382629+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:14.006063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3831,"num_read_kb":3485,"num_write":1040,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'319","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.227016+0000","last_change":"2024-09-12T19:29:58.227016+0000","last_active":"2024-09-12T19:29:58.227016+0000","last_peered":"2024-09-12T19:29:58.227016+0000","last_clean":"2024-09-12T19:29:58.227016+0000","last_became_active":"2024-09-12T17:36:34.861702+0000","last_became_peered":"2024-09-12T17:36:34.861702+0000","last_unstale":"2024-09-12T19:29:58.227016+0000","last_undegraded":"2024-09-12T19:29:58.227016+0000","last_fullsized":"2024-09-12T19:29:58.227016+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T19:29:58.226750+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T19:29:58.226750+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.226750+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:18.778525+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273696,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":464,"num_read_kb":26224,"num_write":1045,"num_write_kb":25793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.536076+0000","last_change":"2024-09-12T19:30:05.536076+0000","last_active":"2024-09-12T19:30:05.536076+0000","last_peered":"2024-09-12T19:30:05.536076+0000","last_clean":"2024-09-12T19:30:05.536076+0000","last_became_active":"2024-09-12T17:36:38.894742+0000","last_became_peered":"2024-09-12T17:36:38.894742+0000","last_unstale":"2024-09-12T19:30:05.536076+0000","last_undegraded":"2024-09-12T19:30:05.536076+0000","last_fullsized":"2024-09-12T19:30:05.536076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:05.535904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:05.535904+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.535904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:41.432968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'332","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.532627+0000","last_change":"2024-09-12T19:30:08.532627+0000","last_active":"2024-09-12T19:30:08.532627+0000","last_peered":"2024-09-12T19:30:08.532627+0000","last_clean":"2024-09-12T19:30:08.532627+0000","last_became_active":"2024-09-12T17:36:40.892710+0000","last_became_peered":"2024-09-12T17:36:40.892710+0000","last_unstale":"2024-09-12T19:30:08.532627+0000","last_undegraded":"2024-09-12T19:30:08.532627+0000","last_fullsized":"2024-09-12T19:30:08.532627+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T19:30:08.532361+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T19:30:08.532361+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.532361+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:49.724335+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49819,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":1091,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.235756+0000","last_change":"2024-09-12T19:30:10.235756+0000","last_active":"2024-09-12T19:30:10.235756+0000","last_peered":"2024-09-12T19:30:10.235756+0000","last_clean":"2024-09-12T19:30:10.235756+0000","last_became_active":"2024-09-12T17:36:42.938834+0000","last_became_peered":"2024-09-12T17:36:42.938834+0000","last_unstale":"2024-09-12T19:30:10.235756+0000","last_undegraded":"2024-09-12T19:30:10.235756+0000","last_fullsized":"2024-09-12T19:30:10.235756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:10.235565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:10.235565+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.235565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:24.663063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'141","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.174915+0000","last_change":"2024-09-12T19:30:15.174915+0000","last_active":"2024-09-12T19:30:15.174915+0000","last_peered":"2024-09-12T19:30:15.174915+0000","last_clean":"2024-09-12T19:30:15.174915+0000","last_became_active":"2024-09-12T17:36:44.953117+0000","last_became_peered":"2024-09-12T17:36:44.953117+0000","last_unstale":"2024-09-12T19:30:15.174915+0000","last_undegraded":"2024-09-12T19:30:15.174915+0000","last_fullsized":"2024-09-12T19:30:15.174915+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'141","last_scrub_stamp":"2024-09-12T19:30:15.174732+0000","last_deep_scrub":"265'141","last_deep_scrub_stamp":"2024-09-12T19:30:15.174732+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.174732+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:21.174795+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":202,"num_write":357,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'472","reported_seq":2085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.921083+0000","last_change":"2024-09-12T19:29:56.921083+0000","last_active":"2024-09-12T19:29:56.921083+0000","last_peered":"2024-09-12T19:29:56.921083+0000","last_clean":"2024-09-12T19:29:56.921083+0000","last_became_active":"2024-09-12T17:36:36.900955+0000","last_became_peered":"2024-09-12T17:36:36.900955+0000","last_unstale":"2024-09-12T19:29:56.921083+0000","last_undegraded":"2024-09-12T19:29:56.921083+0000","last_fullsized":"2024-09-12T19:29:56.921083+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'472","last_scrub_stamp":"2024-09-12T19:29:56.920906+0000","last_deep_scrub":"265'472","last_deep_scrub_stamp":"2024-09-12T19:29:56.920906+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.920906+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:13.700998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2490,"num_read_kb":2331,"num_write":571,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'352","reported_seq":1131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.412441+0000","last_change":"2024-09-12T19:29:51.412206+0000","last_active":"2024-09-12T19:29:51.412441+0000","last_peered":"2024-09-12T19:29:51.412441+0000","last_clean":"2024-09-12T19:29:51.412441+0000","last_became_active":"2024-09-12T17:36:34.878069+0000","last_became_peered":"2024-09-12T17:36:34.878069+0000","last_unstale":"2024-09-12T19:29:51.412441+0000","last_undegraded":"2024-09-12T19:29:51.412441+0000","last_fullsized":"2024-09-12T19:29:51.412441+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:29:51.411936+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:29:51.411936+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.411936+0000","objects_scrubbed":11,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:28.683406+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097855,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":782,"num_read_kb":26278,"num_write":971,"num_write_kb":31119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.980372+0000","last_change":"2024-09-12T19:30:07.980372+0000","last_active":"2024-09-12T19:30:07.980372+0000","last_peered":"2024-09-12T19:30:07.980372+0000","last_clean":"2024-09-12T19:30:07.980372+0000","last_became_active":"2024-09-12T17:36:38.894800+0000","last_became_peered":"2024-09-12T17:36:38.894800+0000","last_unstale":"2024-09-12T19:30:07.980372+0000","last_undegraded":"2024-09-12T19:30:07.980372+0000","last_fullsized":"2024-09-12T19:30:07.980372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:07.980191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:07.980191+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.980191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:19.605106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'84","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.092824+0000","last_change":"2024-09-12T19:30:14.092824+0000","last_active":"2024-09-12T19:30:14.092824+0000","last_peered":"2024-09-12T19:30:14.092824+0000","last_clean":"2024-09-12T19:30:14.092824+0000","last_became_active":"2024-09-12T17:36:40.909470+0000","last_became_peered":"2024-09-12T17:36:40.909470+0000","last_unstale":"2024-09-12T19:30:14.092824+0000","last_undegraded":"2024-09-12T19:30:14.092824+0000","last_fullsized":"2024-09-12T19:30:14.092824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'84","last_scrub_stamp":"2024-09-12T19:30:14.092640+0000","last_deep_scrub":"265'84","last_deep_scrub_stamp":"2024-09-12T19:30:14.092640+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.092640+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:43.847026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.444242+0000","last_change":"2024-09-12T19:30:08.444242+0000","last_active":"2024-09-12T19:30:08.444242+0000","last_peered":"2024-09-12T19:30:08.444242+0000","last_clean":"2024-09-12T19:30:08.444242+0000","last_became_active":"2024-09-12T17:36:42.922352+0000","last_became_peered":"2024-09-12T17:36:42.922352+0000","last_unstale":"2024-09-12T19:30:08.444242+0000","last_undegraded":"2024-09-12T19:30:08.444242+0000","last_fullsized":"2024-09-12T19:30:08.444242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:08.444006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:08.444006+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.444006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:28.356175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'239","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.407464+0000","last_change":"2024-09-12T19:30:17.407464+0000","last_active":"2024-09-12T19:30:17.407464+0000","last_peered":"2024-09-12T19:30:17.407464+0000","last_clean":"2024-09-12T19:30:17.407464+0000","last_became_active":"2024-09-12T17:36:44.945429+0000","last_became_peered":"2024-09-12T17:36:44.945429+0000","last_unstale":"2024-09-12T19:30:17.407464+0000","last_undegraded":"2024-09-12T19:30:17.407464+0000","last_fullsized":"2024-09-12T19:30:17.407464+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-12T19:30:17.407256+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-12T19:30:17.407256+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.407256+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:50.565386+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":307,"num_read_kb":303,"num_write":509,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'828","reported_seq":2367,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.946318+0000","last_change":"2024-09-12T19:29:55.946318+0000","last_active":"2024-09-12T19:29:55.946318+0000","last_peered":"2024-09-12T19:29:55.946318+0000","last_clean":"2024-09-12T19:29:55.946318+0000","last_became_active":"2024-09-12T17:36:36.901053+0000","last_became_peered":"2024-09-12T17:36:36.901053+0000","last_unstale":"2024-09-12T19:29:55.946318+0000","last_undegraded":"2024-09-12T19:29:55.946318+0000","last_fullsized":"2024-09-12T19:29:55.946318+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'828","last_scrub_stamp":"2024-09-12T19:29:55.946101+0000","last_deep_scrub":"265'828","last_deep_scrub_stamp":"2024-09-12T19:29:55.946101+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.946101+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:53.712277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3878,"num_read_kb":3474,"num_write":1082,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'361","reported_seq":1044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.358167+0000","last_change":"2024-09-12T19:29:50.357889+0000","last_active":"2024-09-12T19:29:50.358167+0000","last_peered":"2024-09-12T19:29:50.358167+0000","last_clean":"2024-09-12T19:29:50.358167+0000","last_became_active":"2024-09-12T17:36:34.877620+0000","last_became_peered":"2024-09-12T17:36:34.877620+0000","last_unstale":"2024-09-12T19:29:50.358167+0000","last_undegraded":"2024-09-12T19:29:50.358167+0000","last_fullsized":"2024-09-12T19:29:50.358167+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:29:50.357552+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:29:50.357552+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.357552+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:17.243177+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048740,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":51733,"num_write":1081,"num_write_kb":38676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":538,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.416021+0000","last_change":"2024-09-12T19:30:02.416021+0000","last_active":"2024-09-12T19:30:02.416021+0000","last_peered":"2024-09-12T19:30:02.416021+0000","last_clean":"2024-09-12T19:30:02.416021+0000","last_became_active":"2024-09-12T17:36:38.902188+0000","last_became_peered":"2024-09-12T17:36:38.902188+0000","last_unstale":"2024-09-12T19:30:02.416021+0000","last_undegraded":"2024-09-12T19:30:02.416021+0000","last_fullsized":"2024-09-12T19:30:02.416021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:02.415808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:02.415808+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.415808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:35.156107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'381","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.185252+0000","last_change":"2024-09-12T19:30:06.185252+0000","last_active":"2024-09-12T19:30:06.185252+0000","last_peered":"2024-09-12T19:30:06.185252+0000","last_clean":"2024-09-12T19:30:06.185252+0000","last_became_active":"2024-09-12T17:36:40.899201+0000","last_became_peered":"2024-09-12T17:36:40.899201+0000","last_unstale":"2024-09-12T19:30:06.185252+0000","last_undegraded":"2024-09-12T19:30:06.185252+0000","last_fullsized":"2024-09-12T19:30:06.185252+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'381","last_scrub_stamp":"2024-09-12T19:30:06.185067+0000","last_deep_scrub":"265'381","last_deep_scrub_stamp":"2024-09-12T19:30:06.185067+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.185067+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:12.745822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51900,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":1290,"num_write":486,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.860673+0000","last_change":"2024-09-12T19:30:09.860673+0000","last_active":"2024-09-12T19:30:09.860673+0000","last_peered":"2024-09-12T19:30:09.860673+0000","last_clean":"2024-09-12T19:30:09.860673+0000","last_became_active":"2024-09-12T17:36:42.928596+0000","last_became_peered":"2024-09-12T17:36:42.928596+0000","last_unstale":"2024-09-12T19:30:09.860673+0000","last_undegraded":"2024-09-12T19:30:09.860673+0000","last_fullsized":"2024-09-12T19:30:09.860673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.860483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.860483+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.860483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:14.215226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'145","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:38.285573+0000","last_change":"2024-09-12T19:30:38.285573+0000","last_active":"2024-09-12T19:30:38.285573+0000","last_peered":"2024-09-12T19:30:38.285573+0000","last_clean":"2024-09-12T19:30:38.285573+0000","last_became_active":"2024-09-12T17:36:44.962445+0000","last_became_peered":"2024-09-12T17:36:44.962445+0000","last_unstale":"2024-09-12T19:30:38.285573+0000","last_undegraded":"2024-09-12T19:30:38.285573+0000","last_fullsized":"2024-09-12T19:30:38.285573+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'145","last_scrub_stamp":"2024-09-12T19:30:38.285354+0000","last_deep_scrub":"265'145","last_deep_scrub_stamp":"2024-09-12T19:30:38.285354+0000","last_clean_scrub_stamp":"2024-09-12T19:30:38.285354+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:16.125354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":234,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'603","reported_seq":2256,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.115050+0000","last_change":"2024-09-12T19:29:56.115050+0000","last_active":"2024-09-12T19:29:56.115050+0000","last_peered":"2024-09-12T19:29:56.115050+0000","last_clean":"2024-09-12T19:29:56.115050+0000","last_became_active":"2024-09-12T17:36:36.903813+0000","last_became_peered":"2024-09-12T17:36:36.903813+0000","last_unstale":"2024-09-12T19:29:56.115050+0000","last_undegraded":"2024-09-12T19:29:56.115050+0000","last_fullsized":"2024-09-12T19:29:56.115050+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'603","last_scrub_stamp":"2024-09-12T19:29:56.114858+0000","last_deep_scrub":"265'603","last_deep_scrub_stamp":"2024-09-12T19:29:56.114858+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.114858+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:39.417617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3115,"num_read_kb":2836,"num_write":758,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'307","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.974498+0000","last_change":"2024-09-12T19:29:50.974381+0000","last_active":"2024-09-12T19:29:50.974498+0000","last_peered":"2024-09-12T19:29:50.974498+0000","last_clean":"2024-09-12T19:29:50.974498+0000","last_became_active":"2024-09-12T17:36:34.886741+0000","last_became_peered":"2024-09-12T17:36:34.886741+0000","last_unstale":"2024-09-12T19:29:50.974498+0000","last_undegraded":"2024-09-12T19:29:50.974498+0000","last_fullsized":"2024-09-12T19:29:50.974498+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'307","last_scrub_stamp":"2024-09-12T19:29:50.974228+0000","last_deep_scrub":"265'307","last_deep_scrub_stamp":"2024-09-12T19:29:50.974228+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.974228+0000","objects_scrubbed":13,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:10.453984+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1961495,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":454,"num_read_kb":24643,"num_write":1003,"num_write_kb":38417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.211733+0000","last_change":"2024-09-12T19:30:18.211733+0000","last_active":"2024-09-12T19:30:18.211733+0000","last_peered":"2024-09-12T19:30:18.211733+0000","last_clean":"2024-09-12T19:30:18.211733+0000","last_became_active":"2024-09-12T17:36:38.903210+0000","last_became_peered":"2024-09-12T17:36:38.903210+0000","last_unstale":"2024-09-12T19:30:18.211733+0000","last_undegraded":"2024-09-12T19:30:18.211733+0000","last_fullsized":"2024-09-12T19:30:18.211733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:18.211558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:18.211558+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.211558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:05.683729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'312","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.496664+0000","last_change":"2024-09-12T19:30:14.496664+0000","last_active":"2024-09-12T19:30:14.496664+0000","last_peered":"2024-09-12T19:30:14.496664+0000","last_clean":"2024-09-12T19:30:14.496664+0000","last_became_active":"2024-09-12T17:36:40.912283+0000","last_became_peered":"2024-09-12T17:36:40.912283+0000","last_unstale":"2024-09-12T19:30:14.496664+0000","last_undegraded":"2024-09-12T19:30:14.496664+0000","last_fullsized":"2024-09-12T19:30:14.496664+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T19:30:14.496480+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T19:30:14.496480+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.496480+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:49.759859+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1100,"num_write":404,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.212929+0000","last_change":"2024-09-12T19:30:11.212929+0000","last_active":"2024-09-12T19:30:11.212929+0000","last_peered":"2024-09-12T19:30:11.212929+0000","last_clean":"2024-09-12T19:30:11.212929+0000","last_became_active":"2024-09-12T17:36:42.927724+0000","last_became_peered":"2024-09-12T17:36:42.927724+0000","last_unstale":"2024-09-12T19:30:11.212929+0000","last_undegraded":"2024-09-12T19:30:11.212929+0000","last_fullsized":"2024-09-12T19:30:11.212929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:11.212728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:11.212728+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.212728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:09.091627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'722","reported_seq":2257,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.151555+0000","last_change":"2024-09-12T19:30:09.151555+0000","last_active":"2024-09-12T19:30:09.151555+0000","last_peered":"2024-09-12T19:30:09.151555+0000","last_clean":"2024-09-12T19:30:09.151555+0000","last_became_active":"2024-09-12T17:36:36.885820+0000","last_became_peered":"2024-09-12T17:36:36.885820+0000","last_unstale":"2024-09-12T19:30:09.151555+0000","last_undegraded":"2024-09-12T19:30:09.151555+0000","last_fullsized":"2024-09-12T19:30:09.151555+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'722","last_scrub_stamp":"2024-09-12T19:30:09.151370+0000","last_deep_scrub":"265'722","last_deep_scrub_stamp":"2024-09-12T19:30:09.151370+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.151370+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:56.519425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3501,"num_read_kb":3197,"num_write":936,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'342","reported_seq":1027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.955549+0000","last_change":"2024-09-12T19:29:51.955269+0000","last_active":"2024-09-12T19:29:51.955549+0000","last_peered":"2024-09-12T19:29:51.955549+0000","last_clean":"2024-09-12T19:29:51.955549+0000","last_became_active":"2024-09-12T17:36:34.887018+0000","last_became_peered":"2024-09-12T17:36:34.887018+0000","last_unstale":"2024-09-12T19:29:51.955549+0000","last_undegraded":"2024-09-12T19:29:51.955549+0000","last_fullsized":"2024-09-12T19:29:51.955549+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:51.955017+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:51.955017+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.955017+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:13.242565+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":38393,"num_write":1072,"num_write_kb":34235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.520319+0000","last_change":"2024-09-12T19:30:06.520319+0000","last_active":"2024-09-12T19:30:06.520319+0000","last_peered":"2024-09-12T19:30:06.520319+0000","last_clean":"2024-09-12T19:30:06.520319+0000","last_became_active":"2024-09-12T17:36:38.894452+0000","last_became_peered":"2024-09-12T17:36:38.894452+0000","last_unstale":"2024-09-12T19:30:06.520319+0000","last_undegraded":"2024-09-12T19:30:06.520319+0000","last_fullsized":"2024-09-12T19:30:06.520319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:06.520134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:06.520134+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.520134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:45.097198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'519","reported_seq":1200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.437202+0000","last_change":"2024-09-12T19:30:11.437202+0000","last_active":"2024-09-12T19:30:11.437202+0000","last_peered":"2024-09-12T19:30:11.437202+0000","last_clean":"2024-09-12T19:30:11.437202+0000","last_became_active":"2024-09-12T17:36:40.909552+0000","last_became_peered":"2024-09-12T17:36:40.909552+0000","last_unstale":"2024-09-12T19:30:11.437202+0000","last_undegraded":"2024-09-12T19:30:11.437202+0000","last_fullsized":"2024-09-12T19:30:11.437202+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'519","last_scrub_stamp":"2024-09-12T19:30:11.437001+0000","last_deep_scrub":"265'519","last_deep_scrub_stamp":"2024-09-12T19:30:11.437001+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.437001+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:21.401609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105771,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":904,"num_read_kb":2059,"num_write":766,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.411302+0000","last_change":"2024-09-12T19:30:11.411302+0000","last_active":"2024-09-12T19:30:11.411302+0000","last_peered":"2024-09-12T19:30:11.411302+0000","last_clean":"2024-09-12T19:30:11.411302+0000","last_became_active":"2024-09-12T17:36:42.942627+0000","last_became_peered":"2024-09-12T17:36:42.942627+0000","last_unstale":"2024-09-12T19:30:11.411302+0000","last_undegraded":"2024-09-12T19:30:11.411302+0000","last_fullsized":"2024-09-12T19:30:11.411302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:11.411122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:11.411122+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.411122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:16.566570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'171","reported_seq":708,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.863127+0000","last_change":"2024-09-12T19:30:23.863127+0000","last_active":"2024-09-12T19:30:23.863127+0000","last_peered":"2024-09-12T19:30:23.863127+0000","last_clean":"2024-09-12T19:30:23.863127+0000","last_became_active":"2024-09-12T17:36:44.956655+0000","last_became_peered":"2024-09-12T17:36:44.956655+0000","last_unstale":"2024-09-12T19:30:23.863127+0000","last_undegraded":"2024-09-12T19:30:23.863127+0000","last_fullsized":"2024-09-12T19:30:23.863127+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'171","last_scrub_stamp":"2024-09-12T19:30:23.862897+0000","last_deep_scrub":"265'171","last_deep_scrub_stamp":"2024-09-12T19:30:23.862897+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.862897+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:40.667263+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":241,"num_write":385,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'358","reported_seq":1947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.903872+0000","last_change":"2024-09-12T19:30:00.903872+0000","last_active":"2024-09-12T19:30:00.903872+0000","last_peered":"2024-09-12T19:30:00.903872+0000","last_clean":"2024-09-12T19:30:00.903872+0000","last_became_active":"2024-09-12T17:36:36.911889+0000","last_became_peered":"2024-09-12T17:36:36.911889+0000","last_unstale":"2024-09-12T19:30:00.903872+0000","last_undegraded":"2024-09-12T19:30:00.903872+0000","last_fullsized":"2024-09-12T19:30:00.903872+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T19:30:00.903644+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T19:30:00.903644+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.903644+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:48.670244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2021,"num_read_kb":1969,"num_write":390,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'360","reported_seq":1142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.982460+0000","last_change":"2024-09-12T19:29:53.982295+0000","last_active":"2024-09-12T19:29:53.982460+0000","last_peered":"2024-09-12T19:29:53.982460+0000","last_clean":"2024-09-12T19:29:53.982460+0000","last_became_active":"2024-09-12T17:36:34.851161+0000","last_became_peered":"2024-09-12T17:36:34.851161+0000","last_unstale":"2024-09-12T19:29:53.982460+0000","last_undegraded":"2024-09-12T19:29:53.982460+0000","last_fullsized":"2024-09-12T19:29:53.982460+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T19:29:53.982102+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T19:29:53.982102+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.982102+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:47.944166+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273705,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":731,"num_read_kb":47360,"num_write":1100,"num_write_kb":33375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":544,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.398459+0000","last_change":"2024-09-12T19:30:09.398459+0000","last_active":"2024-09-12T19:30:09.398459+0000","last_peered":"2024-09-12T19:30:09.398459+0000","last_clean":"2024-09-12T19:30:09.398459+0000","last_became_active":"2024-09-12T17:36:38.904409+0000","last_became_peered":"2024-09-12T17:36:38.904409+0000","last_unstale":"2024-09-12T19:30:09.398459+0000","last_undegraded":"2024-09-12T19:30:09.398459+0000","last_fullsized":"2024-09-12T19:30:09.398459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.398271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.398271+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.398271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:53.976519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'412","reported_seq":1068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.169259+0000","last_change":"2024-09-12T19:30:28.169259+0000","last_active":"2024-09-12T19:30:28.169259+0000","last_peered":"2024-09-12T19:30:28.169259+0000","last_clean":"2024-09-12T19:30:28.169259+0000","last_became_active":"2024-09-12T17:36:40.902718+0000","last_became_peered":"2024-09-12T17:36:40.902718+0000","last_unstale":"2024-09-12T19:30:28.169259+0000","last_undegraded":"2024-09-12T19:30:28.169259+0000","last_fullsized":"2024-09-12T19:30:28.169259+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'412","last_scrub_stamp":"2024-09-12T19:30:28.169031+0000","last_deep_scrub":"265'412","last_deep_scrub_stamp":"2024-09-12T19:30:28.169031+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.169031+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:35.955503+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54769,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":679,"num_read_kb":1358,"num_write":564,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12744,"num_omap_keys":28,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.866861+0000","last_change":"2024-09-12T19:30:17.866861+0000","last_active":"2024-09-12T19:30:17.866861+0000","last_peered":"2024-09-12T19:30:17.866861+0000","last_clean":"2024-09-12T19:30:17.866861+0000","last_became_active":"2024-09-12T17:36:42.920352+0000","last_became_peered":"2024-09-12T17:36:42.920352+0000","last_unstale":"2024-09-12T19:30:17.866861+0000","last_undegraded":"2024-09-12T19:30:17.866861+0000","last_fullsized":"2024-09-12T19:30:17.866861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:17.866677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:17.866677+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.866677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:41.980247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'185","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:34.322156+0000","last_change":"2024-09-12T19:30:34.322156+0000","last_active":"2024-09-12T19:30:34.322156+0000","last_peered":"2024-09-12T19:30:34.322156+0000","last_clean":"2024-09-12T19:30:34.322156+0000","last_became_active":"2024-09-12T17:36:44.945753+0000","last_became_peered":"2024-09-12T17:36:44.945753+0000","last_unstale":"2024-09-12T19:30:34.322156+0000","last_undegraded":"2024-09-12T19:30:34.322156+0000","last_fullsized":"2024-09-12T19:30:34.322156+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'185","last_scrub_stamp":"2024-09-12T19:30:34.321953+0000","last_deep_scrub":"265'185","last_deep_scrub_stamp":"2024-09-12T19:30:34.321953+0000","last_clean_scrub_stamp":"2024-09-12T19:30:34.321953+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:54.174944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":278,"num_read_kb":268,"num_write":526,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'525","reported_seq":2263,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.085497+0000","last_change":"2024-09-12T19:29:58.085497+0000","last_active":"2024-09-12T19:29:58.085497+0000","last_peered":"2024-09-12T19:29:58.085497+0000","last_clean":"2024-09-12T19:29:58.085497+0000","last_became_active":"2024-09-12T17:36:36.909488+0000","last_became_peered":"2024-09-12T17:36:36.909488+0000","last_unstale":"2024-09-12T19:29:58.085497+0000","last_undegraded":"2024-09-12T19:29:58.085497+0000","last_fullsized":"2024-09-12T19:29:58.085497+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'525","last_scrub_stamp":"2024-09-12T19:29:58.085322+0000","last_deep_scrub":"265'525","last_deep_scrub_stamp":"2024-09-12T19:29:58.085322+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.085322+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:33.573152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2968,"num_read_kb":2777,"num_write":639,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'391","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:46.957992+0000","last_change":"2024-09-12T19:29:46.957992+0000","last_active":"2024-09-12T19:29:46.957992+0000","last_peered":"2024-09-12T19:29:46.957992+0000","last_clean":"2024-09-12T19:29:46.957992+0000","last_became_active":"2024-09-12T17:36:34.857645+0000","last_became_peered":"2024-09-12T17:36:34.857645+0000","last_unstale":"2024-09-12T19:29:46.957992+0000","last_undegraded":"2024-09-12T19:29:46.957992+0000","last_fullsized":"2024-09-12T19:29:46.957992+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:29:46.957895+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:29:46.957895+0000","last_clean_scrub_stamp":"2024-09-12T19:29:46.957895+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:29.114514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287556,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":605,"num_read_kb":13478,"num_write":1299,"num_write_kb":33813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.381026+0000","last_change":"2024-09-12T19:30:04.381026+0000","last_active":"2024-09-12T19:30:04.381026+0000","last_peered":"2024-09-12T19:30:04.381026+0000","last_clean":"2024-09-12T19:30:04.381026+0000","last_became_active":"2024-09-12T17:36:38.904619+0000","last_became_peered":"2024-09-12T17:36:38.904619+0000","last_unstale":"2024-09-12T19:30:04.381026+0000","last_undegraded":"2024-09-12T19:30:04.381026+0000","last_fullsized":"2024-09-12T19:30:04.381026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.380854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.380854+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.380854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:16.162425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'321","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.471095+0000","last_change":"2024-09-12T19:30:12.471095+0000","last_active":"2024-09-12T19:30:12.471095+0000","last_peered":"2024-09-12T19:30:12.471095+0000","last_clean":"2024-09-12T19:30:12.471095+0000","last_became_active":"2024-09-12T17:36:40.909189+0000","last_became_peered":"2024-09-12T17:36:40.909189+0000","last_unstale":"2024-09-12T19:30:12.471095+0000","last_undegraded":"2024-09-12T19:30:12.471095+0000","last_fullsized":"2024-09-12T19:30:12.471095+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T19:30:12.470910+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T19:30:12.470910+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.470910+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:23.997786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":521,"num_read_kb":1073,"num_write":404,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.167636+0000","last_change":"2024-09-12T19:30:12.167636+0000","last_active":"2024-09-12T19:30:12.167636+0000","last_peered":"2024-09-12T19:30:12.167636+0000","last_clean":"2024-09-12T19:30:12.167636+0000","last_became_active":"2024-09-12T17:36:42.938451+0000","last_became_peered":"2024-09-12T17:36:42.938451+0000","last_unstale":"2024-09-12T19:30:12.167636+0000","last_undegraded":"2024-09-12T19:30:12.167636+0000","last_fullsized":"2024-09-12T19:30:12.167636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:12.167461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:12.167461+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.167461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:34.992368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'113","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:32.235519+0000","last_change":"2024-09-12T19:30:32.235519+0000","last_active":"2024-09-12T19:30:32.235519+0000","last_peered":"2024-09-12T19:30:32.235519+0000","last_clean":"2024-09-12T19:30:32.235519+0000","last_became_active":"2024-09-12T17:36:44.949351+0000","last_became_peered":"2024-09-12T17:36:44.949351+0000","last_unstale":"2024-09-12T19:30:32.235519+0000","last_undegraded":"2024-09-12T19:30:32.235519+0000","last_fullsized":"2024-09-12T19:30:32.235519+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'113","last_scrub_stamp":"2024-09-12T19:30:32.235303+0000","last_deep_scrub":"265'113","last_deep_scrub_stamp":"2024-09-12T19:30:32.235303+0000","last_clean_scrub_stamp":"2024-09-12T19:30:32.235303+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:01.325061+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":161,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'477","reported_seq":2161,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.916554+0000","last_change":"2024-09-12T19:29:58.916554+0000","last_active":"2024-09-12T19:29:58.916554+0000","last_peered":"2024-09-12T19:29:58.916554+0000","last_clean":"2024-09-12T19:29:58.916554+0000","last_became_active":"2024-09-12T17:36:36.902998+0000","last_became_peered":"2024-09-12T17:36:36.902998+0000","last_unstale":"2024-09-12T19:29:58.916554+0000","last_undegraded":"2024-09-12T19:29:58.916554+0000","last_fullsized":"2024-09-12T19:29:58.916554+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'477","last_scrub_stamp":"2024-09-12T19:29:58.916239+0000","last_deep_scrub":"265'477","last_deep_scrub_stamp":"2024-09-12T19:29:58.916239+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.916239+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:11.138862+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2683,"num_read_kb":2531,"num_write":585,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2003,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'409","reported_seq":1145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.984339+0000","last_change":"2024-09-12T19:29:54.984339+0000","last_active":"2024-09-12T19:29:54.984339+0000","last_peered":"2024-09-12T19:29:54.984339+0000","last_clean":"2024-09-12T19:29:54.984339+0000","last_became_active":"2024-09-12T17:36:34.867987+0000","last_became_peered":"2024-09-12T17:36:34.867987+0000","last_unstale":"2024-09-12T19:29:54.984339+0000","last_undegraded":"2024-09-12T19:29:54.984339+0000","last_fullsized":"2024-09-12T19:29:54.984339+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T19:29:54.984140+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T19:29:54.984140+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.984140+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:32.375716+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062574,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":616,"num_read_kb":94353,"num_write":1270,"num_write_kb":45131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.064541+0000","last_change":"2024-09-12T19:30:15.064541+0000","last_active":"2024-09-12T19:30:15.064541+0000","last_peered":"2024-09-12T19:30:15.064541+0000","last_clean":"2024-09-12T19:30:15.064541+0000","last_became_active":"2024-09-12T17:36:38.900687+0000","last_became_peered":"2024-09-12T17:36:38.900687+0000","last_unstale":"2024-09-12T19:30:15.064541+0000","last_undegraded":"2024-09-12T19:30:15.064541+0000","last_fullsized":"2024-09-12T19:30:15.064541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:15.064365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:15.064365+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.064365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:33.955110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'164","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.180360+0000","last_change":"2024-09-12T19:30:24.180360+0000","last_active":"2024-09-12T19:30:24.180360+0000","last_peered":"2024-09-12T19:30:24.180360+0000","last_clean":"2024-09-12T19:30:24.180360+0000","last_became_active":"2024-09-12T17:36:40.904671+0000","last_became_peered":"2024-09-12T17:36:40.904671+0000","last_unstale":"2024-09-12T19:30:24.180360+0000","last_undegraded":"2024-09-12T19:30:24.180360+0000","last_fullsized":"2024-09-12T19:30:24.180360+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'164","last_scrub_stamp":"2024-09-12T19:30:24.180057+0000","last_deep_scrub":"265'164","last_deep_scrub_stamp":"2024-09-12T19:30:24.180057+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.180057+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:43.035312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":202,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'770","reported_seq":3485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.536601+0000","last_change":"2024-09-12T19:30:09.536601+0000","last_active":"2024-09-12T19:30:09.536601+0000","last_peered":"2024-09-12T19:30:09.536601+0000","last_clean":"2024-09-12T19:30:09.536601+0000","last_became_active":"2024-09-12T17:36:42.929232+0000","last_became_peered":"2024-09-12T17:36:42.929232+0000","last_unstale":"2024-09-12T19:30:09.536601+0000","last_undegraded":"2024-09-12T19:30:09.536601+0000","last_fullsized":"2024-09-12T19:30:09.536601+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'770","last_scrub_stamp":"2024-09-12T19:30:09.536408+0000","last_deep_scrub":"265'770","last_deep_scrub_stamp":"2024-09-12T19:30:09.536408+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.536408+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:48.491520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'132","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.184007+0000","last_change":"2024-09-12T19:30:31.184007+0000","last_active":"2024-09-12T19:30:31.184007+0000","last_peered":"2024-09-12T19:30:31.184007+0000","last_clean":"2024-09-12T19:30:31.184007+0000","last_became_active":"2024-09-12T17:36:44.945777+0000","last_became_peered":"2024-09-12T17:36:44.945777+0000","last_unstale":"2024-09-12T19:30:31.184007+0000","last_undegraded":"2024-09-12T19:30:31.184007+0000","last_fullsized":"2024-09-12T19:30:31.184007+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T19:30:31.183783+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T19:30:31.183783+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.183783+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:28.378192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":212,"num_write":329,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'432","reported_seq":1993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.395163+0000","last_change":"2024-09-12T19:30:00.395163+0000","last_active":"2024-09-12T19:30:00.395163+0000","last_peered":"2024-09-12T19:30:00.395163+0000","last_clean":"2024-09-12T19:30:00.395163+0000","last_became_active":"2024-09-12T17:36:36.896871+0000","last_became_peered":"2024-09-12T17:36:36.896871+0000","last_unstale":"2024-09-12T19:30:00.395163+0000","last_undegraded":"2024-09-12T19:30:00.395163+0000","last_fullsized":"2024-09-12T19:30:00.395163+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'432","last_scrub_stamp":"2024-09-12T19:30:00.394970+0000","last_deep_scrub":"265'432","last_deep_scrub_stamp":"2024-09-12T19:30:00.394970+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.394970+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:25.462640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2316,"num_read_kb":2187,"num_write":500,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'403","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.911598+0000","last_change":"2024-09-12T19:29:50.911598+0000","last_active":"2024-09-12T19:29:50.911598+0000","last_peered":"2024-09-12T19:29:50.911598+0000","last_clean":"2024-09-12T19:29:50.911598+0000","last_became_active":"2024-09-12T17:36:34.868685+0000","last_became_peered":"2024-09-12T17:36:34.868685+0000","last_unstale":"2024-09-12T19:29:50.911598+0000","last_undegraded":"2024-09-12T19:29:50.911598+0000","last_fullsized":"2024-09-12T19:29:50.911598+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T19:29:50.911321+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T19:29:50.911321+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.911321+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:21:19.555113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":585,"num_read_kb":59989,"num_write":1252,"num_write_kb":34100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.878634+0000","last_change":"2024-09-12T19:30:04.878634+0000","last_active":"2024-09-12T19:30:04.878634+0000","last_peered":"2024-09-12T19:30:04.878634+0000","last_clean":"2024-09-12T19:30:04.878634+0000","last_became_active":"2024-09-12T17:36:38.885092+0000","last_became_peered":"2024-09-12T17:36:38.885092+0000","last_unstale":"2024-09-12T19:30:04.878634+0000","last_undegraded":"2024-09-12T19:30:04.878634+0000","last_fullsized":"2024-09-12T19:30:04.878634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.878450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.878450+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.878450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:40.745336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'417","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.443193+0000","last_change":"2024-09-12T19:30:05.443046+0000","last_active":"2024-09-12T19:30:05.443193+0000","last_peered":"2024-09-12T19:30:05.443193+0000","last_clean":"2024-09-12T19:30:05.443193+0000","last_became_active":"2024-09-12T17:36:40.902484+0000","last_became_peered":"2024-09-12T17:36:40.902484+0000","last_unstale":"2024-09-12T19:30:05.443193+0000","last_undegraded":"2024-09-12T19:30:05.443193+0000","last_fullsized":"2024-09-12T19:30:05.443193+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'417","last_scrub_stamp":"2024-09-12T19:30:05.442825+0000","last_deep_scrub":"265'417","last_deep_scrub_stamp":"2024-09-12T19:30:05.442825+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.442825+0000","objects_scrubbed":9,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:44.363304+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48470,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":642,"num_read_kb":1267,"num_write":506,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.999926+0000","last_change":"2024-09-12T19:30:20.999926+0000","last_active":"2024-09-12T19:30:20.999926+0000","last_peered":"2024-09-12T19:30:20.999926+0000","last_clean":"2024-09-12T19:30:20.999926+0000","last_became_active":"2024-09-12T17:36:42.932462+0000","last_became_peered":"2024-09-12T17:36:42.932462+0000","last_unstale":"2024-09-12T19:30:20.999926+0000","last_undegraded":"2024-09-12T19:30:20.999926+0000","last_fullsized":"2024-09-12T19:30:20.999926+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:20.999654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:20.999654+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.999654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:28.887032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'130","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.797651+0000","last_change":"2024-09-12T19:30:14.797485+0000","last_active":"2024-09-12T19:30:14.797651+0000","last_peered":"2024-09-12T19:30:14.797651+0000","last_clean":"2024-09-12T19:30:14.797651+0000","last_became_active":"2024-09-12T17:36:44.943948+0000","last_became_peered":"2024-09-12T17:36:44.943948+0000","last_unstale":"2024-09-12T19:30:14.797651+0000","last_undegraded":"2024-09-12T19:30:14.797651+0000","last_fullsized":"2024-09-12T19:30:14.797651+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T19:30:14.797299+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T19:30:14.797299+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.797299+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:46.063265+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":170,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'824","reported_seq":2527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.363162+0000","last_change":"2024-09-12T19:29:59.363162+0000","last_active":"2024-09-12T19:29:59.363162+0000","last_peered":"2024-09-12T19:29:59.363162+0000","last_clean":"2024-09-12T19:29:59.363162+0000","last_became_active":"2024-09-12T17:36:36.888747+0000","last_became_peered":"2024-09-12T17:36:36.888747+0000","last_unstale":"2024-09-12T19:29:59.363162+0000","last_undegraded":"2024-09-12T19:29:59.363162+0000","last_fullsized":"2024-09-12T19:29:59.363162+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'824","last_scrub_stamp":"2024-09-12T19:29:59.362904+0000","last_deep_scrub":"265'824","last_deep_scrub_stamp":"2024-09-12T19:29:59.362904+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.362904+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:35.395617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3583,"num_write":1069,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'489","reported_seq":1186,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.227514+0000","last_change":"2024-09-12T19:29:59.227514+0000","last_active":"2024-09-12T19:29:59.227514+0000","last_peered":"2024-09-12T19:29:59.227514+0000","last_clean":"2024-09-12T19:29:59.227514+0000","last_became_active":"2024-09-12T17:36:34.876487+0000","last_became_peered":"2024-09-12T17:36:34.876487+0000","last_unstale":"2024-09-12T19:29:59.227514+0000","last_undegraded":"2024-09-12T19:29:59.227514+0000","last_fullsized":"2024-09-12T19:29:59.227514+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'489","last_scrub_stamp":"2024-09-12T19:29:59.227288+0000","last_deep_scrub":"265'489","last_deep_scrub_stamp":"2024-09-12T19:29:59.227288+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.227288+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:02.444470+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":839,"num_read_kb":5903,"num_write":1394,"num_write_kb":31714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.374675+0000","last_change":"2024-09-12T19:30:03.374675+0000","last_active":"2024-09-12T19:30:03.374675+0000","last_peered":"2024-09-12T19:30:03.374675+0000","last_clean":"2024-09-12T19:30:03.374675+0000","last_became_active":"2024-09-12T17:36:38.901575+0000","last_became_peered":"2024-09-12T17:36:38.901575+0000","last_unstale":"2024-09-12T19:30:03.374675+0000","last_undegraded":"2024-09-12T19:30:03.374675+0000","last_fullsized":"2024-09-12T19:30:03.374675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:03.374500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:03.374500+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.374500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:13.146288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'330","reported_seq":959,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.086301+0000","last_change":"2024-09-12T19:30:18.086301+0000","last_active":"2024-09-12T19:30:18.086301+0000","last_peered":"2024-09-12T19:30:18.086301+0000","last_clean":"2024-09-12T19:30:18.086301+0000","last_became_active":"2024-09-12T17:36:40.900739+0000","last_became_peered":"2024-09-12T17:36:40.900739+0000","last_unstale":"2024-09-12T19:30:18.086301+0000","last_undegraded":"2024-09-12T19:30:18.086301+0000","last_fullsized":"2024-09-12T19:30:18.086301+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T19:30:18.086117+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T19:30:18.086117+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.086117+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:36.835105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":1258,"num_write":448,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.128013+0000","last_change":"2024-09-12T19:30:25.128013+0000","last_active":"2024-09-12T19:30:25.128013+0000","last_peered":"2024-09-12T19:30:25.128013+0000","last_clean":"2024-09-12T19:30:25.128013+0000","last_became_active":"2024-09-12T17:36:42.920767+0000","last_became_peered":"2024-09-12T17:36:42.920767+0000","last_unstale":"2024-09-12T19:30:25.128013+0000","last_undegraded":"2024-09-12T19:30:25.128013+0000","last_fullsized":"2024-09-12T19:30:25.128013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:25.127761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:25.127761+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.127761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:07.524400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'125","reported_seq":688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.814798+0000","last_change":"2024-09-12T19:30:24.814798+0000","last_active":"2024-09-12T19:30:24.814798+0000","last_peered":"2024-09-12T19:30:24.814798+0000","last_clean":"2024-09-12T19:30:24.814798+0000","last_became_active":"2024-09-12T17:36:44.959535+0000","last_became_peered":"2024-09-12T17:36:44.959535+0000","last_unstale":"2024-09-12T19:30:24.814798+0000","last_undegraded":"2024-09-12T19:30:24.814798+0000","last_fullsized":"2024-09-12T19:30:24.814798+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-12T19:30:24.814575+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-12T19:30:24.814575+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.814575+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:41.099809+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":231,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'447","reported_seq":1841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.076335+0000","last_change":"2024-09-12T19:29:57.076173+0000","last_active":"2024-09-12T19:29:57.076335+0000","last_peered":"2024-09-12T19:29:57.076335+0000","last_clean":"2024-09-12T19:29:57.076335+0000","last_became_active":"2024-09-12T17:36:36.895126+0000","last_became_peered":"2024-09-12T17:36:36.895126+0000","last_unstale":"2024-09-12T19:29:57.076335+0000","last_undegraded":"2024-09-12T19:29:57.076335+0000","last_fullsized":"2024-09-12T19:29:57.076335+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'447","last_scrub_stamp":"2024-09-12T19:29:57.075990+0000","last_deep_scrub":"265'447","last_deep_scrub_stamp":"2024-09-12T19:29:57.075990+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.075990+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:34.706291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2194,"num_read_kb":2018,"num_write":546,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'364","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.905415+0000","last_change":"2024-09-12T19:29:56.905415+0000","last_active":"2024-09-12T19:29:56.905415+0000","last_peered":"2024-09-12T19:29:56.905415+0000","last_clean":"2024-09-12T19:29:56.905415+0000","last_became_active":"2024-09-12T17:36:34.878381+0000","last_became_peered":"2024-09-12T17:36:34.878381+0000","last_unstale":"2024-09-12T19:29:56.905415+0000","last_undegraded":"2024-09-12T19:29:56.905415+0000","last_fullsized":"2024-09-12T19:29:56.905415+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T19:29:56.905139+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T19:29:56.905139+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.905139+0000","objects_scrubbed":8,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:09.937198+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":568,"num_read_kb":62029,"num_write":1071,"num_write_kb":23225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.906627+0000","last_change":"2024-09-12T19:30:03.906485+0000","last_active":"2024-09-12T19:30:03.906627+0000","last_peered":"2024-09-12T19:30:03.906627+0000","last_clean":"2024-09-12T19:30:03.906627+0000","last_became_active":"2024-09-12T17:36:38.887476+0000","last_became_peered":"2024-09-12T17:36:38.887476+0000","last_unstale":"2024-09-12T19:30:03.906627+0000","last_undegraded":"2024-09-12T19:30:03.906627+0000","last_fullsized":"2024-09-12T19:30:03.906627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:03.906304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:03.906304+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.906304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:42.519260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'247","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.473177+0000","last_change":"2024-09-12T19:30:10.473177+0000","last_active":"2024-09-12T19:30:10.473177+0000","last_peered":"2024-09-12T19:30:10.473177+0000","last_clean":"2024-09-12T19:30:10.473177+0000","last_became_active":"2024-09-12T17:36:40.904126+0000","last_became_peered":"2024-09-12T17:36:40.904126+0000","last_unstale":"2024-09-12T19:30:10.473177+0000","last_undegraded":"2024-09-12T19:30:10.473177+0000","last_fullsized":"2024-09-12T19:30:10.473177+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'247","last_scrub_stamp":"2024-09-12T19:30:10.472993+0000","last_deep_scrub":"265'247","last_deep_scrub_stamp":"2024-09-12T19:30:10.472993+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.472993+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:39.731251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52700,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":960,"num_write":326,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.152234+0000","last_change":"2024-09-12T19:30:30.152234+0000","last_active":"2024-09-12T19:30:30.152234+0000","last_peered":"2024-09-12T19:30:30.152234+0000","last_clean":"2024-09-12T19:30:30.152234+0000","last_became_active":"2024-09-12T17:36:42.934140+0000","last_became_peered":"2024-09-12T17:36:42.934140+0000","last_unstale":"2024-09-12T19:30:30.152234+0000","last_undegraded":"2024-09-12T19:30:30.152234+0000","last_fullsized":"2024-09-12T19:30:30.152234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:30.152030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:30.152030+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.152030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:43.850534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'164","reported_seq":1664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:33.277000+0000","last_change":"2024-09-12T19:30:33.277000+0000","last_active":"2024-09-12T19:30:33.277000+0000","last_peered":"2024-09-12T19:30:33.277000+0000","last_clean":"2024-09-12T19:30:33.277000+0000","last_became_active":"2024-09-12T17:36:44.965427+0000","last_became_peered":"2024-09-12T17:36:44.965427+0000","last_unstale":"2024-09-12T19:30:33.277000+0000","last_undegraded":"2024-09-12T19:30:33.277000+0000","last_fullsized":"2024-09-12T19:30:33.277000+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'164","last_scrub_stamp":"2024-09-12T19:30:33.276752+0000","last_deep_scrub":"265'164","last_deep_scrub_stamp":"2024-09-12T19:30:33.276752+0000","last_clean_scrub_stamp":"2024-09-12T19:30:33.276752+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:52.372462+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1232,"num_read_kb":1221,"num_write":362,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'996","reported_seq":2731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.364090+0000","last_change":"2024-09-12T19:29:57.363859+0000","last_active":"2024-09-12T19:29:57.364090+0000","last_peered":"2024-09-12T19:29:57.364090+0000","last_clean":"2024-09-12T19:29:57.364090+0000","last_became_active":"2024-09-12T17:36:36.914315+0000","last_became_peered":"2024-09-12T17:36:36.914315+0000","last_unstale":"2024-09-12T19:29:57.364090+0000","last_undegraded":"2024-09-12T19:29:57.364090+0000","last_fullsized":"2024-09-12T19:29:57.364090+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'996","last_scrub_stamp":"2024-09-12T19:29:57.363633+0000","last_deep_scrub":"265'996","last_deep_scrub_stamp":"2024-09-12T19:29:57.363633+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.363633+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":900,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:14.785338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4811,"num_read_kb":4330,"num_write":1385,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'343","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.949861+0000","last_change":"2024-09-12T19:29:53.949861+0000","last_active":"2024-09-12T19:29:53.949861+0000","last_peered":"2024-09-12T19:29:53.949861+0000","last_clean":"2024-09-12T19:29:53.949861+0000","last_became_active":"2024-09-12T17:36:34.871889+0000","last_became_peered":"2024-09-12T17:36:34.871889+0000","last_unstale":"2024-09-12T19:29:53.949861+0000","last_undegraded":"2024-09-12T19:29:53.949861+0000","last_fullsized":"2024-09-12T19:29:53.949861+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:29:53.949641+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:29:53.949641+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.949641+0000","objects_scrubbed":10,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:44.653793+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526421,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":468,"num_read_kb":13877,"num_write":1131,"num_write_kb":46739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.056244+0000","last_change":"2024-09-12T19:30:11.056083+0000","last_active":"2024-09-12T19:30:11.056244+0000","last_peered":"2024-09-12T19:30:11.056244+0000","last_clean":"2024-09-12T19:30:11.056244+0000","last_became_active":"2024-09-12T17:36:38.882018+0000","last_became_peered":"2024-09-12T17:36:38.882018+0000","last_unstale":"2024-09-12T19:30:11.056244+0000","last_undegraded":"2024-09-12T19:30:11.056244+0000","last_fullsized":"2024-09-12T19:30:11.056244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:11.055899+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:11.055899+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.055899+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:12.704129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'331","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.222919+0000","last_change":"2024-09-12T19:30:21.222919+0000","last_active":"2024-09-12T19:30:21.222919+0000","last_peered":"2024-09-12T19:30:21.222919+0000","last_clean":"2024-09-12T19:30:21.222919+0000","last_became_active":"2024-09-12T17:36:40.908611+0000","last_became_peered":"2024-09-12T17:36:40.908611+0000","last_unstale":"2024-09-12T19:30:21.222919+0000","last_undegraded":"2024-09-12T19:30:21.222919+0000","last_fullsized":"2024-09-12T19:30:21.222919+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T19:30:21.222706+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T19:30:21.222706+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.222706+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:56.630835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53448,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":560,"num_read_kb":1204,"num_write":440,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.993841+0000","last_change":"2024-09-12T19:30:22.993841+0000","last_active":"2024-09-12T19:30:22.993841+0000","last_peered":"2024-09-12T19:30:22.993841+0000","last_clean":"2024-09-12T19:30:22.993841+0000","last_became_active":"2024-09-12T17:36:42.933510+0000","last_became_peered":"2024-09-12T17:36:42.933510+0000","last_unstale":"2024-09-12T19:30:22.993841+0000","last_undegraded":"2024-09-12T19:30:22.993841+0000","last_fullsized":"2024-09-12T19:30:22.993841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.993659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.993659+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.993659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:19.000151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'129","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.498377+0000","last_change":"2024-09-12T19:30:08.498377+0000","last_active":"2024-09-12T19:30:08.498377+0000","last_peered":"2024-09-12T19:30:08.498377+0000","last_clean":"2024-09-12T19:30:08.498377+0000","last_became_active":"2024-09-12T17:36:44.960641+0000","last_became_peered":"2024-09-12T17:36:44.960641+0000","last_unstale":"2024-09-12T19:30:08.498377+0000","last_undegraded":"2024-09-12T19:30:08.498377+0000","last_fullsized":"2024-09-12T19:30:08.498377+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T19:30:08.498183+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T19:30:08.498183+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.498183+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:18.321995+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":181,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'933","reported_seq":2739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.902416+0000","last_change":"2024-09-12T19:30:01.902416+0000","last_active":"2024-09-12T19:30:01.902416+0000","last_peered":"2024-09-12T19:30:01.902416+0000","last_clean":"2024-09-12T19:30:01.902416+0000","last_became_active":"2024-09-12T17:36:36.901046+0000","last_became_peered":"2024-09-12T17:36:36.901046+0000","last_unstale":"2024-09-12T19:30:01.902416+0000","last_undegraded":"2024-09-12T19:30:01.902416+0000","last_fullsized":"2024-09-12T19:30:01.902416+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'933","last_scrub_stamp":"2024-09-12T19:30:01.902200+0000","last_deep_scrub":"265'933","last_deep_scrub_stamp":"2024-09-12T19:30:01.902200+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.902200+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:50.473986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4712,"num_read_kb":4247,"num_write":1250,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4079,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'415","reported_seq":1135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.380197+0000","last_change":"2024-09-12T19:29:48.380197+0000","last_active":"2024-09-12T19:29:48.380197+0000","last_peered":"2024-09-12T19:29:48.380197+0000","last_clean":"2024-09-12T19:29:48.380197+0000","last_became_active":"2024-09-12T17:36:34.884112+0000","last_became_peered":"2024-09-12T17:36:34.884112+0000","last_unstale":"2024-09-12T19:29:48.380197+0000","last_undegraded":"2024-09-12T19:29:48.380197+0000","last_fullsized":"2024-09-12T19:29:48.380197+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:29:48.380120+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:29:48.380120+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.380120+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:19.901040+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":11450,"num_write":1282,"num_write_kb":27380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'656","reported_seq":2325,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.057909+0000","last_change":"2024-09-12T19:29:59.057909+0000","last_active":"2024-09-12T19:29:59.057909+0000","last_peered":"2024-09-12T19:29:59.057909+0000","last_clean":"2024-09-12T19:29:59.057909+0000","last_became_active":"2024-09-12T17:36:36.916477+0000","last_became_peered":"2024-09-12T17:36:36.916477+0000","last_unstale":"2024-09-12T19:29:59.057909+0000","last_undegraded":"2024-09-12T19:29:59.057909+0000","last_fullsized":"2024-09-12T19:29:59.057909+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'656","last_scrub_stamp":"2024-09-12T19:29:59.057726+0000","last_deep_scrub":"265'656","last_deep_scrub_stamp":"2024-09-12T19:29:59.057726+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.057726+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:13.858705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3261,"num_read_kb":2946,"num_write":856,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'371","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.125878+0000","last_change":"2024-09-12T19:29:53.125878+0000","last_active":"2024-09-12T19:29:53.125878+0000","last_peered":"2024-09-12T19:29:53.125878+0000","last_clean":"2024-09-12T19:29:53.125878+0000","last_became_active":"2024-09-12T17:36:34.862008+0000","last_became_peered":"2024-09-12T17:36:34.862008+0000","last_unstale":"2024-09-12T19:29:53.125878+0000","last_undegraded":"2024-09-12T19:29:53.125878+0000","last_fullsized":"2024-09-12T19:29:53.125878+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T19:29:53.125690+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T19:29:53.125690+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.125690+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:00.140459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648670,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":45708,"num_write":1154,"num_write_kb":41141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'444","reported_seq":2016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.196846+0000","last_change":"2024-09-12T19:30:10.196846+0000","last_active":"2024-09-12T19:30:10.196846+0000","last_peered":"2024-09-12T19:30:10.196846+0000","last_clean":"2024-09-12T19:30:10.196846+0000","last_became_active":"2024-09-12T17:36:36.875947+0000","last_became_peered":"2024-09-12T17:36:36.875947+0000","last_unstale":"2024-09-12T19:30:10.196846+0000","last_undegraded":"2024-09-12T19:30:10.196846+0000","last_fullsized":"2024-09-12T19:30:10.196846+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'444","last_scrub_stamp":"2024-09-12T19:30:10.196736+0000","last_deep_scrub":"265'444","last_deep_scrub_stamp":"2024-09-12T19:30:10.196736+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.196736+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:21.092717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2143,"num_write":507,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'350","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.197660+0000","last_change":"2024-09-12T19:30:00.197660+0000","last_active":"2024-09-12T19:30:00.197660+0000","last_peered":"2024-09-12T19:30:00.197660+0000","last_clean":"2024-09-12T19:30:00.197660+0000","last_became_active":"2024-09-12T17:36:34.892664+0000","last_became_peered":"2024-09-12T17:36:34.892664+0000","last_unstale":"2024-09-12T19:30:00.197660+0000","last_undegraded":"2024-09-12T19:30:00.197660+0000","last_fullsized":"2024-09-12T19:30:00.197660+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-12T19:30:00.197372+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-12T19:30:00.197372+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.197372+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:40.921623+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4719915,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":523,"num_read_kb":15114,"num_write":1089,"num_write_kb":33687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'453","reported_seq":2063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.901219+0000","last_change":"2024-09-12T19:30:06.901219+0000","last_active":"2024-09-12T19:30:06.901219+0000","last_peered":"2024-09-12T19:30:06.901219+0000","last_clean":"2024-09-12T19:30:06.901219+0000","last_became_active":"2024-09-12T17:36:36.886646+0000","last_became_peered":"2024-09-12T17:36:36.886646+0000","last_unstale":"2024-09-12T19:30:06.901219+0000","last_undegraded":"2024-09-12T19:30:06.901219+0000","last_fullsized":"2024-09-12T19:30:06.901219+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'453","last_scrub_stamp":"2024-09-12T19:30:06.901026+0000","last_deep_scrub":"265'453","last_deep_scrub_stamp":"2024-09-12T19:30:06.901026+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.901026+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:17.596822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2431,"num_read_kb":2290,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'322","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.891849+0000","last_change":"2024-09-12T19:29:54.891849+0000","last_active":"2024-09-12T19:29:54.891849+0000","last_peered":"2024-09-12T19:29:54.891849+0000","last_clean":"2024-09-12T19:29:54.891849+0000","last_became_active":"2024-09-12T17:36:34.875514+0000","last_became_peered":"2024-09-12T17:36:34.875514+0000","last_unstale":"2024-09-12T19:29:54.891849+0000","last_undegraded":"2024-09-12T19:29:54.891849+0000","last_fullsized":"2024-09-12T19:29:54.891849+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:29:54.891644+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:29:54.891644+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.891644+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:20.204730+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515054,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":12724,"num_write":938,"num_write_kb":21079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'472","reported_seq":2087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.917918+0000","last_change":"2024-09-12T19:30:05.917918+0000","last_active":"2024-09-12T19:30:05.917918+0000","last_peered":"2024-09-12T19:30:05.917918+0000","last_clean":"2024-09-12T19:30:05.917918+0000","last_became_active":"2024-09-12T17:36:36.895580+0000","last_became_peered":"2024-09-12T17:36:36.895580+0000","last_unstale":"2024-09-12T19:30:05.917918+0000","last_undegraded":"2024-09-12T19:30:05.917918+0000","last_fullsized":"2024-09-12T19:30:05.917918+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'472","last_scrub_stamp":"2024-09-12T19:30:05.917613+0000","last_deep_scrub":"265'472","last_deep_scrub_stamp":"2024-09-12T19:30:05.917613+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.917613+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:46.828526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2410,"num_read_kb":2268,"num_write":522,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'383","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.377960+0000","last_change":"2024-09-12T19:29:53.377960+0000","last_active":"2024-09-12T19:29:53.377960+0000","last_peered":"2024-09-12T19:29:53.377960+0000","last_clean":"2024-09-12T19:29:53.377960+0000","last_became_active":"2024-09-12T17:36:34.875282+0000","last_became_peered":"2024-09-12T17:36:34.875282+0000","last_unstale":"2024-09-12T19:29:53.377960+0000","last_undegraded":"2024-09-12T19:29:53.377960+0000","last_fullsized":"2024-09-12T19:29:53.377960+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T19:29:53.377757+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T19:29:53.377757+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.377757+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:35.803143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568489,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":16784,"num_write":1071,"num_write_kb":43648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'874","reported_seq":2689,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.367917+0000","last_change":"2024-09-12T19:29:59.367917+0000","last_active":"2024-09-12T19:29:59.367917+0000","last_peered":"2024-09-12T19:29:59.367917+0000","last_clean":"2024-09-12T19:29:59.367917+0000","last_became_active":"2024-09-12T17:36:36.879875+0000","last_became_peered":"2024-09-12T17:36:36.879875+0000","last_unstale":"2024-09-12T19:29:59.367917+0000","last_undegraded":"2024-09-12T19:29:59.367917+0000","last_fullsized":"2024-09-12T19:29:59.367917+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'874","last_scrub_stamp":"2024-09-12T19:29:59.367728+0000","last_deep_scrub":"265'874","last_deep_scrub_stamp":"2024-09-12T19:29:59.367728+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.367728+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:32.664577+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4378,"num_read_kb":3985,"num_write":1124,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1318,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'322","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.516329+0000","last_change":"2024-09-12T19:30:02.516329+0000","last_active":"2024-09-12T19:30:02.516329+0000","last_peered":"2024-09-12T19:30:02.516329+0000","last_clean":"2024-09-12T19:30:02.516329+0000","last_became_active":"2024-09-12T17:36:34.880893+0000","last_became_peered":"2024-09-12T17:36:34.880893+0000","last_unstale":"2024-09-12T19:30:02.516329+0000","last_undegraded":"2024-09-12T19:30:02.516329+0000","last_fullsized":"2024-09-12T19:30:02.516329+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:30:02.516130+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:30:02.516130+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.516130+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.498669+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":34772,"num_write":1049,"num_write_kb":43573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'1179","reported_seq":2773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.482459+0000","last_change":"2024-09-12T19:30:01.482459+0000","last_active":"2024-09-12T19:30:01.482459+0000","last_peered":"2024-09-12T19:30:01.482459+0000","last_clean":"2024-09-12T19:30:01.482459+0000","last_became_active":"2024-09-12T17:36:36.897985+0000","last_became_peered":"2024-09-12T17:36:36.897985+0000","last_unstale":"2024-09-12T19:30:01.482459+0000","last_undegraded":"2024-09-12T19:30:01.482459+0000","last_fullsized":"2024-09-12T19:30:01.482459+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1179","last_scrub_stamp":"2024-09-12T19:30:01.482241+0000","last_deep_scrub":"265'1179","last_deep_scrub_stamp":"2024-09-12T19:30:01.482241+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.482241+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:27.270588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5405,"num_read_kb":4772,"num_write":1628,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1111,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'394","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.321112+0000","last_change":"2024-09-12T19:29:52.321112+0000","last_active":"2024-09-12T19:29:52.321112+0000","last_peered":"2024-09-12T19:29:52.321112+0000","last_clean":"2024-09-12T19:29:52.321112+0000","last_became_active":"2024-09-12T17:36:34.876834+0000","last_became_peered":"2024-09-12T17:36:34.876834+0000","last_unstale":"2024-09-12T19:29:52.321112+0000","last_undegraded":"2024-09-12T19:29:52.321112+0000","last_fullsized":"2024-09-12T19:29:52.321112+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T19:29:52.320936+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T19:29:52.320936+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.320936+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:16.090065+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":595,"num_read_kb":4635,"num_write":1236,"num_write_kb":22932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'773","reported_seq":2370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.859989+0000","last_change":"2024-09-12T19:29:53.859989+0000","last_active":"2024-09-12T19:29:53.859989+0000","last_peered":"2024-09-12T19:29:53.859989+0000","last_clean":"2024-09-12T19:29:53.859989+0000","last_became_active":"2024-09-12T17:36:36.901293+0000","last_became_peered":"2024-09-12T17:36:36.901293+0000","last_unstale":"2024-09-12T19:29:53.859989+0000","last_undegraded":"2024-09-12T19:29:53.859989+0000","last_fullsized":"2024-09-12T19:29:53.859989+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T19:29:53.859804+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T19:29:53.859804+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.859804+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:29.780177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3323,"num_write":979,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'347","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.926866+0000","last_change":"2024-09-12T19:29:52.926866+0000","last_active":"2024-09-12T19:29:52.926866+0000","last_peered":"2024-09-12T19:29:52.926866+0000","last_clean":"2024-09-12T19:29:52.926866+0000","last_became_active":"2024-09-12T17:36:34.872999+0000","last_became_peered":"2024-09-12T17:36:34.872999+0000","last_unstale":"2024-09-12T19:29:52.926866+0000","last_undegraded":"2024-09-12T19:29:52.926866+0000","last_fullsized":"2024-09-12T19:29:52.926866+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:29:52.926633+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:29:52.926633+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.926633+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:12.827832+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":667,"num_read_kb":7832,"num_write":1127,"num_write_kb":31819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'779","reported_seq":2255,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.088334+0000","last_change":"2024-09-12T19:30:02.088334+0000","last_active":"2024-09-12T19:30:02.088334+0000","last_peered":"2024-09-12T19:30:02.088334+0000","last_clean":"2024-09-12T19:30:02.088334+0000","last_became_active":"2024-09-12T17:36:36.903948+0000","last_became_peered":"2024-09-12T17:36:36.903948+0000","last_unstale":"2024-09-12T19:30:02.088334+0000","last_undegraded":"2024-09-12T19:30:02.088334+0000","last_fullsized":"2024-09-12T19:30:02.088334+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'779","last_scrub_stamp":"2024-09-12T19:30:02.088151+0000","last_deep_scrub":"265'779","last_deep_scrub_stamp":"2024-09-12T19:30:02.088151+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.088151+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:31.427535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3650,"num_read_kb":3275,"num_write":1024,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'413","reported_seq":1181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.145594+0000","last_change":"2024-09-12T19:30:04.145594+0000","last_active":"2024-09-12T19:30:04.145594+0000","last_peered":"2024-09-12T19:30:04.145594+0000","last_clean":"2024-09-12T19:30:04.145594+0000","last_became_active":"2024-09-12T17:36:34.891638+0000","last_became_peered":"2024-09-12T17:36:34.891638+0000","last_unstale":"2024-09-12T19:30:04.145594+0000","last_undegraded":"2024-09-12T19:30:04.145594+0000","last_fullsized":"2024-09-12T19:30:04.145594+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'413","last_scrub_stamp":"2024-09-12T19:30:04.145362+0000","last_deep_scrub":"265'413","last_deep_scrub_stamp":"2024-09-12T19:30:04.145362+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.145362+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:20.894452+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":824,"num_read_kb":23553,"num_write":1317,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'1233","reported_seq":2991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.364430+0000","last_change":"2024-09-12T19:29:57.364430+0000","last_active":"2024-09-12T19:29:57.364430+0000","last_peered":"2024-09-12T19:29:57.364430+0000","last_clean":"2024-09-12T19:29:57.364430+0000","last_became_active":"2024-09-12T17:36:36.906463+0000","last_became_peered":"2024-09-12T17:36:36.906463+0000","last_unstale":"2024-09-12T19:29:57.364430+0000","last_undegraded":"2024-09-12T19:29:57.364430+0000","last_fullsized":"2024-09-12T19:29:57.364430+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1233","last_scrub_stamp":"2024-09-12T19:29:57.364153+0000","last_deep_scrub":"265'1233","last_deep_scrub_stamp":"2024-09-12T19:29:57.364153+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.364153+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":1200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:42.031824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5684,"num_read_kb":5045,"num_write":1688,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'343","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.902923+0000","last_change":"2024-09-12T19:29:55.902923+0000","last_active":"2024-09-12T19:29:55.902923+0000","last_peered":"2024-09-12T19:29:55.902923+0000","last_clean":"2024-09-12T19:29:55.902923+0000","last_became_active":"2024-09-12T17:36:34.873189+0000","last_became_peered":"2024-09-12T17:36:34.873189+0000","last_unstale":"2024-09-12T19:29:55.902923+0000","last_undegraded":"2024-09-12T19:29:55.902923+0000","last_fullsized":"2024-09-12T19:29:55.902923+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:29:55.902646+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:29:55.902646+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.902646+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:22.918198+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284213,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":39048,"num_write":958,"num_write_kb":38605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'1002","reported_seq":2715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.836395+0000","last_change":"2024-09-12T19:30:08.836395+0000","last_active":"2024-09-12T19:30:08.836395+0000","last_peered":"2024-09-12T19:30:08.836395+0000","last_clean":"2024-09-12T19:30:08.836395+0000","last_became_active":"2024-09-12T17:36:36.875791+0000","last_became_peered":"2024-09-12T17:36:36.875791+0000","last_unstale":"2024-09-12T19:30:08.836395+0000","last_undegraded":"2024-09-12T19:30:08.836395+0000","last_fullsized":"2024-09-12T19:30:08.836395+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1002","last_scrub_stamp":"2024-09-12T19:30:08.836221+0000","last_deep_scrub":"265'1002","last_deep_scrub_stamp":"2024-09-12T19:30:08.836221+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.836221+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":900,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:17.299248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4962,"num_read_kb":4419,"num_write":1465,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":724,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'253","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.905945+0000","last_change":"2024-09-12T19:29:47.905945+0000","last_active":"2024-09-12T19:29:47.905945+0000","last_peered":"2024-09-12T19:29:47.905945+0000","last_clean":"2024-09-12T19:29:47.905945+0000","last_became_active":"2024-09-12T17:36:34.866719+0000","last_became_peered":"2024-09-12T17:36:34.866719+0000","last_unstale":"2024-09-12T19:29:47.905945+0000","last_undegraded":"2024-09-12T19:29:47.905945+0000","last_fullsized":"2024-09-12T19:29:47.905945+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-12T19:29:47.905866+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-12T19:29:47.905866+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.905866+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:35.987815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":13747,"num_write":787,"num_write_kb":14866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'511","reported_seq":2137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.833711+0000","last_change":"2024-09-12T19:29:55.833711+0000","last_active":"2024-09-12T19:29:55.833711+0000","last_peered":"2024-09-12T19:29:55.833711+0000","last_clean":"2024-09-12T19:29:55.833711+0000","last_became_active":"2024-09-12T17:36:36.914327+0000","last_became_peered":"2024-09-12T17:36:36.914327+0000","last_unstale":"2024-09-12T19:29:55.833711+0000","last_undegraded":"2024-09-12T19:29:55.833711+0000","last_fullsized":"2024-09-12T19:29:55.833711+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'511","last_scrub_stamp":"2024-09-12T19:29:55.833505+0000","last_deep_scrub":"265'511","last_deep_scrub_stamp":"2024-09-12T19:29:55.833505+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.833505+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:26.792835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2629,"num_read_kb":2439,"num_write":603,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'303","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.909782+0000","last_change":"2024-09-12T19:29:59.909782+0000","last_active":"2024-09-12T19:29:59.909782+0000","last_peered":"2024-09-12T19:29:59.909782+0000","last_clean":"2024-09-12T19:29:59.909782+0000","last_became_active":"2024-09-12T17:36:34.864682+0000","last_became_peered":"2024-09-12T17:36:34.864682+0000","last_unstale":"2024-09-12T19:29:59.909782+0000","last_undegraded":"2024-09-12T19:29:59.909782+0000","last_fullsized":"2024-09-12T19:29:59.909782+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T19:29:59.909589+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T19:29:59.909589+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.909589+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:21:13.619686+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":386,"num_read_kb":10447,"num_write":906,"num_write_kb":22906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'846","reported_seq":2476,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.841442+0000","last_change":"2024-09-12T19:29:54.841442+0000","last_active":"2024-09-12T19:29:54.841442+0000","last_peered":"2024-09-12T19:29:54.841442+0000","last_clean":"2024-09-12T19:29:54.841442+0000","last_became_active":"2024-09-12T17:36:36.885956+0000","last_became_peered":"2024-09-12T17:36:36.885956+0000","last_unstale":"2024-09-12T19:29:54.841442+0000","last_undegraded":"2024-09-12T19:29:54.841442+0000","last_fullsized":"2024-09-12T19:29:54.841442+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'846","last_scrub_stamp":"2024-09-12T19:29:54.841249+0000","last_deep_scrub":"265'846","last_deep_scrub_stamp":"2024-09-12T19:29:54.841249+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.841249+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:55.821229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3814,"num_read_kb":3459,"num_write":1078,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'375","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.405081+0000","last_change":"2024-09-12T19:29:47.405081+0000","last_active":"2024-09-12T19:29:47.405081+0000","last_peered":"2024-09-12T19:29:47.405081+0000","last_clean":"2024-09-12T19:29:47.405081+0000","last_became_active":"2024-09-12T17:36:34.865344+0000","last_became_peered":"2024-09-12T17:36:34.865344+0000","last_unstale":"2024-09-12T19:29:47.405081+0000","last_undegraded":"2024-09-12T19:29:47.405081+0000","last_fullsized":"2024-09-12T19:29:47.405081+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:29:47.404998+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:29:47.404998+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.404998+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:12.580297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":55805,"num_write":1199,"num_write_kb":26331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'725","reported_seq":2145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.086920+0000","last_change":"2024-09-12T19:30:00.086920+0000","last_active":"2024-09-12T19:30:00.086920+0000","last_peered":"2024-09-12T19:30:00.086920+0000","last_clean":"2024-09-12T19:30:00.086920+0000","last_became_active":"2024-09-12T17:36:36.916289+0000","last_became_peered":"2024-09-12T17:36:36.916289+0000","last_unstale":"2024-09-12T19:30:00.086920+0000","last_undegraded":"2024-09-12T19:30:00.086920+0000","last_fullsized":"2024-09-12T19:30:00.086920+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'725","last_scrub_stamp":"2024-09-12T19:30:00.086735+0000","last_deep_scrub":"265'725","last_deep_scrub_stamp":"2024-09-12T19:30:00.086735+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.086735+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:01.389997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3361,"num_read_kb":3032,"num_write":954,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'378","reported_seq":1272,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.209603+0000","last_change":"2024-09-12T19:30:01.209603+0000","last_active":"2024-09-12T19:30:01.209603+0000","last_peered":"2024-09-12T19:30:01.209603+0000","last_clean":"2024-09-12T19:30:01.209603+0000","last_became_active":"2024-09-12T17:36:34.875748+0000","last_became_peered":"2024-09-12T17:36:34.875748+0000","last_unstale":"2024-09-12T19:30:01.209603+0000","last_undegraded":"2024-09-12T19:30:01.209603+0000","last_fullsized":"2024-09-12T19:30:01.209603+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:30:01.209395+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:30:01.209395+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.209395+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:15.055583+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311597,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":946,"num_read_kb":75770,"num_write":1026,"num_write_kb":38932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'578","reported_seq":2198,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.899816+0000","last_change":"2024-09-12T19:30:03.899816+0000","last_active":"2024-09-12T19:30:03.899816+0000","last_peered":"2024-09-12T19:30:03.899816+0000","last_clean":"2024-09-12T19:30:03.899816+0000","last_became_active":"2024-09-12T17:36:36.902941+0000","last_became_peered":"2024-09-12T17:36:36.902941+0000","last_unstale":"2024-09-12T19:30:03.899816+0000","last_undegraded":"2024-09-12T19:30:03.899816+0000","last_fullsized":"2024-09-12T19:30:03.899816+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'578","last_scrub_stamp":"2024-09-12T19:30:03.899626+0000","last_deep_scrub":"265'578","last_deep_scrub_stamp":"2024-09-12T19:30:03.899626+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.899626+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:57.866591+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2851,"num_read_kb":2607,"num_write":694,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1263,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'382","reported_seq":1068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.108963+0000","last_change":"2024-09-12T19:29:54.108963+0000","last_active":"2024-09-12T19:29:54.108963+0000","last_peered":"2024-09-12T19:29:54.108963+0000","last_clean":"2024-09-12T19:29:54.108963+0000","last_became_active":"2024-09-12T17:36:34.868083+0000","last_became_peered":"2024-09-12T17:36:34.868083+0000","last_unstale":"2024-09-12T19:29:54.108963+0000","last_undegraded":"2024-09-12T19:29:54.108963+0000","last_fullsized":"2024-09-12T19:29:54.108963+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T19:29:54.108756+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T19:29:54.108756+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.108756+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:42.132817+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526437,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":549,"num_read_kb":53048,"num_write":1215,"num_write_kb":26068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'579","reported_seq":2527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.868550+0000","last_change":"2024-09-12T19:29:56.868550+0000","last_active":"2024-09-12T19:29:56.868550+0000","last_peered":"2024-09-12T19:29:56.868550+0000","last_clean":"2024-09-12T19:29:56.868550+0000","last_became_active":"2024-09-12T17:36:36.891412+0000","last_became_peered":"2024-09-12T17:36:36.891412+0000","last_unstale":"2024-09-12T19:29:56.868550+0000","last_undegraded":"2024-09-12T19:29:56.868550+0000","last_fullsized":"2024-09-12T19:29:56.868550+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'579","last_scrub_stamp":"2024-09-12T19:29:56.868376+0000","last_deep_scrub":"265'579","last_deep_scrub_stamp":"2024-09-12T19:29:56.868376+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.868376+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:06.248111+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3296,"num_read_kb":3095,"num_write":679,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'406","reported_seq":1099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.173896+0000","last_change":"2024-09-12T19:30:02.173896+0000","last_active":"2024-09-12T19:30:02.173896+0000","last_peered":"2024-09-12T19:30:02.173896+0000","last_clean":"2024-09-12T19:30:02.173896+0000","last_became_active":"2024-09-12T17:36:34.872242+0000","last_became_peered":"2024-09-12T17:36:34.872242+0000","last_unstale":"2024-09-12T19:30:02.173896+0000","last_undegraded":"2024-09-12T19:30:02.173896+0000","last_fullsized":"2024-09-12T19:30:02.173896+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'406","last_scrub_stamp":"2024-09-12T19:30:02.173660+0000","last_deep_scrub":"265'406","last_deep_scrub_stamp":"2024-09-12T19:30:02.173660+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.173660+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:33.109697+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2448269,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":538,"num_read_kb":8811,"num_write":1195,"num_write_kb":19313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'376","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.178506+0000","last_change":"2024-09-12T19:30:03.178506+0000","last_active":"2024-09-12T19:30:03.178506+0000","last_peered":"2024-09-12T19:30:03.178506+0000","last_clean":"2024-09-12T19:30:03.178506+0000","last_became_active":"2024-09-12T17:36:34.861821+0000","last_became_peered":"2024-09-12T17:36:34.861821+0000","last_unstale":"2024-09-12T19:30:03.178506+0000","last_undegraded":"2024-09-12T19:30:03.178506+0000","last_fullsized":"2024-09-12T19:30:03.178506+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:30:03.178293+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:30:03.178293+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.178293+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:36.494496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":100665,"num_write":1084,"num_write_kb":41422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'575","reported_seq":2183,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.918403+0000","last_change":"2024-09-12T19:30:05.918153+0000","last_active":"2024-09-12T19:30:05.918403+0000","last_peered":"2024-09-12T19:30:05.918403+0000","last_clean":"2024-09-12T19:30:05.918403+0000","last_became_active":"2024-09-12T17:36:36.911855+0000","last_became_peered":"2024-09-12T17:36:36.911855+0000","last_unstale":"2024-09-12T19:30:05.918403+0000","last_undegraded":"2024-09-12T19:30:05.918403+0000","last_fullsized":"2024-09-12T19:30:05.918403+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'575","last_scrub_stamp":"2024-09-12T19:30:05.917870+0000","last_deep_scrub":"265'575","last_deep_scrub_stamp":"2024-09-12T19:30:05.917870+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.917870+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:40.019170+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2849,"num_read_kb":2620,"num_write":728,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'342","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.897450+0000","last_change":"2024-09-12T19:29:57.897450+0000","last_active":"2024-09-12T19:29:57.897450+0000","last_peered":"2024-09-12T19:29:57.897450+0000","last_clean":"2024-09-12T19:29:57.897450+0000","last_became_active":"2024-09-12T17:36:34.881262+0000","last_became_peered":"2024-09-12T17:36:34.881262+0000","last_unstale":"2024-09-12T19:29:57.897450+0000","last_undegraded":"2024-09-12T19:29:57.897450+0000","last_fullsized":"2024-09-12T19:29:57.897450+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:57.897247+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:57.897247+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.897247+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:58.010163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":969137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":479,"num_read_kb":5153,"num_write":1034,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'505","reported_seq":2118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.887751+0000","last_change":"2024-09-12T19:30:01.887588+0000","last_active":"2024-09-12T19:30:01.887751+0000","last_peered":"2024-09-12T19:30:01.887751+0000","last_clean":"2024-09-12T19:30:01.887751+0000","last_became_active":"2024-09-12T17:36:36.901857+0000","last_became_peered":"2024-09-12T17:36:36.901857+0000","last_unstale":"2024-09-12T19:30:01.887751+0000","last_undegraded":"2024-09-12T19:30:01.887751+0000","last_fullsized":"2024-09-12T19:30:01.887751+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:30:01.887410+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:30:01.887410+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.887410+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:36.054880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2642,"num_read_kb":2459,"num_write":621,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5957,"num_read_kb":4161,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1108,"ondisk_log_size":1108,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16299,"num_read_kb":15966,"num_write":16741,"num_write_kb":4895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1564,"ondisk_log_size":1564,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1604320,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":20976,"num_read_kb":40444,"num_write":17515,"num_write_kb":12474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685912,"num_omap_keys":1576,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1579,"ondisk_log_size":1579,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194467,"num_write":55293,"num_write_kb":18855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43794,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3877,"ondisk_log_size":3877,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":67082726,"num_objects":379,"num_object_clones":0,"num_object_copies":758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":36361,"num_read_kb":1891027,"num_write":71889,"num_write_kb":2051812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135487488,"data_stored":134165452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4005,"ondisk_log_size":4005,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":193786,"num_write":186,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":184511,"num_write":186,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510821,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217412,"kb_used_data":9972,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94154428,"statfs":{"total":96636764160,"available":96414134272,"internally_reserved":0,"allocated":10211328,"data_stored":8566552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510818,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258688,"kb_used_data":24816,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94113152,"statfs":{"total":96636764160,"available":96371867648,"internally_reserved":0,"allocated":25411584,"data_stored":23641054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510822,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191112,"kb_used_data":15608,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94180728,"statfs":{"total":96636764160,"available":96441065472,"internally_reserved":0,"allocated":15982592,"data_stored":14328646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510818,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":222896,"kb_used_data":29280,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94148944,"statfs":{"total":96636764160,"available":96408518656,"internally_reserved":0,"allocated":29982720,"data_stored":28233002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510821,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131872,"kb_used_data":24336,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94239968,"statfs":{"total":96636764160,"available":96501727232,"internally_reserved":0,"allocated":24920064,"data_stored":23230965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510818,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276332,"kb_used_data":10524,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94095508,"statfs":{"total":96636764160,"available":96353800192,"internally_reserved":0,"allocated":10776576,"data_stored":9102273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510819,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106204,"kb_used_data":20940,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94265636,"statfs":{"total":96636764160,"available":96528011264,"internally_reserved":0,"allocated":21442560,"data_stored":19672532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543524,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116012,"kb_used_data":26588,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94255828,"statfs":{"total":96636764160,"available":96517967872,"internally_reserved":0,"allocated":27226112,"data_stored":25491082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17780736,"data_stored":17557812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6524928,"data_stored":6398837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21286912,"data_stored":21117656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26320896,"data_stored":26118766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12324864,"data_stored":12211453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21143552,"data_stored":20934570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23552000,"data_stored":23375118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6553600,"data_stored":6451240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:30:51.315 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.315 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.315 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.316 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.316 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.316 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.317 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.317 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:58:39.137040+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.317 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.317 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.318 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:58:46.186423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.318 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:25:51.559134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=25, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=29, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:30:51.321 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:31:11.322 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:31:11.687 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T19:31:11.699 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-12T19:31:11.706 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":3705,"stamp":"2024-09-12T19:31:11.281005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69294871,"num_objects":850,"num_object_clones":0,"num_object_copies":1700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":850,"num_whiteouts":0,"num_read":295267,"num_read_kb":2527306,"num_write":163888,"num_write_kb":2342783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":204,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740555,"num_omap_keys":1796,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13252,"ondisk_log_size":13252,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1520528,"kb_used_data":162064,"kb_used_omap":12,"kb_used_meta":1358323,"kb_avail":753454192,"statfs":{"total":773094113280,"available":771537092608,"internally_reserved":0,"allocated":165953536,"data_stored":152266106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1390923312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008263"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.566046+0000","last_change":"2024-09-12T19:30:25.565814+0000","last_active":"2024-09-12T19:30:25.566046+0000","last_peered":"2024-09-12T19:30:25.566046+0000","last_clean":"2024-09-12T19:30:25.566046+0000","last_became_active":"2024-09-12T18:25:52.621735+0000","last_became_peered":"2024-09-12T18:25:52.621735+0000","last_unstale":"2024-09-12T19:30:25.566046+0000","last_undegraded":"2024-09-12T19:30:25.566046+0000","last_fullsized":"2024-09-12T19:30:25.566046+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:25.565549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:25.565549+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.565549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:49.025300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.761152+0000","last_change":"2024-09-12T19:30:23.761152+0000","last_active":"2024-09-12T19:30:23.761152+0000","last_peered":"2024-09-12T19:30:23.761152+0000","last_clean":"2024-09-12T19:30:23.761152+0000","last_became_active":"2024-09-12T17:58:47.223202+0000","last_became_peered":"2024-09-12T17:58:47.223202+0000","last_unstale":"2024-09-12T19:30:23.761152+0000","last_undegraded":"2024-09-12T19:30:23.761152+0000","last_fullsized":"2024-09-12T19:30:23.761152+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:23.760965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:23.760965+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.760965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:37.841242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'5","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.197067+0000","last_change":"2024-09-12T19:30:26.196933+0000","last_active":"2024-09-12T19:30:26.197067+0000","last_peered":"2024-09-12T19:30:26.197067+0000","last_clean":"2024-09-12T19:30:26.197067+0000","last_became_active":"2024-09-12T17:58:40.206469+0000","last_became_peered":"2024-09-12T17:58:40.206469+0000","last_unstale":"2024-09-12T19:30:26.197067+0000","last_undegraded":"2024-09-12T19:30:26.197067+0000","last_fullsized":"2024-09-12T19:30:26.197067+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:30:26.196759+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:30:26.196759+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.196759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:01.302999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'13","reported_seq":122,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.882317+0000","last_change":"2024-09-12T19:30:29.882146+0000","last_active":"2024-09-12T19:30:29.882317+0000","last_peered":"2024-09-12T19:30:29.882317+0000","last_clean":"2024-09-12T19:30:29.882317+0000","last_became_active":"2024-09-12T17:52:39.872356+0000","last_became_peered":"2024-09-12T17:52:39.872356+0000","last_unstale":"2024-09-12T19:30:29.882317+0000","last_undegraded":"2024-09-12T19:30:29.882317+0000","last_fullsized":"2024-09-12T19:30:29.882317+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'13","last_scrub_stamp":"2024-09-12T19:30:29.881965+0000","last_deep_scrub":"265'13","last_deep_scrub_stamp":"2024-09-12T19:30:29.881965+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.881965+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:55.275431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":49,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.646925+0000","last_change":"2024-09-12T19:30:31.646791+0000","last_active":"2024-09-12T19:30:31.646925+0000","last_peered":"2024-09-12T19:30:31.646925+0000","last_clean":"2024-09-12T19:30:31.646925+0000","last_became_active":"2024-09-12T18:25:52.624565+0000","last_became_peered":"2024-09-12T18:25:52.624565+0000","last_unstale":"2024-09-12T19:30:31.646925+0000","last_undegraded":"2024-09-12T19:30:31.646925+0000","last_fullsized":"2024-09-12T19:30:31.646925+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:31.646615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:31.646615+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.646615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:31.930803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'4","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.555418+0000","last_change":"2024-09-12T19:30:27.555418+0000","last_active":"2024-09-12T19:30:27.555418+0000","last_peered":"2024-09-12T19:30:27.555418+0000","last_clean":"2024-09-12T19:30:27.555418+0000","last_became_active":"2024-09-12T17:58:47.249050+0000","last_became_peered":"2024-09-12T17:58:47.249050+0000","last_unstale":"2024-09-12T19:30:27.555418+0000","last_undegraded":"2024-09-12T19:30:27.555418+0000","last_fullsized":"2024-09-12T19:30:27.555418+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T19:30:27.555229+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T19:30:27.555229+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.555229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:06.279321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.839972+0000","last_change":"2024-09-12T19:30:30.839795+0000","last_active":"2024-09-12T19:30:30.839972+0000","last_peered":"2024-09-12T19:30:30.839972+0000","last_clean":"2024-09-12T19:30:30.839972+0000","last_became_active":"2024-09-12T17:58:40.209447+0000","last_became_peered":"2024-09-12T17:58:40.209447+0000","last_unstale":"2024-09-12T19:30:30.839972+0000","last_undegraded":"2024-09-12T19:30:30.839972+0000","last_fullsized":"2024-09-12T19:30:30.839972+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:30.839613+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:30.839613+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.839613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:17.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'14","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.916662+0000","last_change":"2024-09-12T19:30:28.916413+0000","last_active":"2024-09-12T19:30:28.916662+0000","last_peered":"2024-09-12T19:30:28.916662+0000","last_clean":"2024-09-12T19:30:28.916662+0000","last_became_active":"2024-09-12T17:52:39.884327+0000","last_became_peered":"2024-09-12T17:52:39.884327+0000","last_unstale":"2024-09-12T19:30:28.916662+0000","last_undegraded":"2024-09-12T19:30:28.916662+0000","last_fullsized":"2024-09-12T19:30:28.916662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T19:30:28.916194+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T19:30:28.916194+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.916194+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:45.731774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.810544+0000","last_change":"2024-09-12T19:30:26.810340+0000","last_active":"2024-09-12T19:30:26.810544+0000","last_peered":"2024-09-12T19:30:26.810544+0000","last_clean":"2024-09-12T19:30:26.810544+0000","last_became_active":"2024-09-12T18:25:52.621796+0000","last_became_peered":"2024-09-12T18:25:52.621796+0000","last_unstale":"2024-09-12T19:30:26.810544+0000","last_undegraded":"2024-09-12T19:30:26.810544+0000","last_fullsized":"2024-09-12T19:30:26.810544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:26.810151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:26.810151+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.810151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:05.298957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'7","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:38.759035+0000","last_change":"2024-09-12T19:30:38.759035+0000","last_active":"2024-09-12T19:30:38.759035+0000","last_peered":"2024-09-12T19:30:38.759035+0000","last_clean":"2024-09-12T19:30:38.759035+0000","last_became_active":"2024-09-12T17:58:47.239390+0000","last_became_peered":"2024-09-12T17:58:47.239390+0000","last_unstale":"2024-09-12T19:30:38.759035+0000","last_undegraded":"2024-09-12T19:30:38.759035+0000","last_fullsized":"2024-09-12T19:30:38.759035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:38.758835+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:38.758835+0000","last_clean_scrub_stamp":"2024-09-12T19:30:38.758835+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:42.706716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'4","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.193486+0000","last_change":"2024-09-12T19:30:28.193265+0000","last_active":"2024-09-12T19:30:28.193486+0000","last_peered":"2024-09-12T19:30:28.193486+0000","last_clean":"2024-09-12T19:30:28.193486+0000","last_became_active":"2024-09-12T17:58:40.193462+0000","last_became_peered":"2024-09-12T17:58:40.193462+0000","last_unstale":"2024-09-12T19:30:28.193486+0000","last_undegraded":"2024-09-12T19:30:28.193486+0000","last_fullsized":"2024-09-12T19:30:28.193486+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:28.193054+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:28.193054+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.193054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.875107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1083,"num_write":4,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'6","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.502458+0000","last_change":"2024-09-12T19:30:23.502458+0000","last_active":"2024-09-12T19:30:23.502458+0000","last_peered":"2024-09-12T19:30:23.502458+0000","last_clean":"2024-09-12T19:30:23.502458+0000","last_became_active":"2024-09-12T17:52:39.871998+0000","last_became_peered":"2024-09-12T17:52:39.871998+0000","last_unstale":"2024-09-12T19:30:23.502458+0000","last_undegraded":"2024-09-12T19:30:23.502458+0000","last_fullsized":"2024-09-12T19:30:23.502458+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:30:23.502250+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:30:23.502250+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.502250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:58.693969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:46.882680+0000","last_change":"2024-09-12T19:30:46.882680+0000","last_active":"2024-09-12T19:30:46.882680+0000","last_peered":"2024-09-12T19:30:46.882680+0000","last_clean":"2024-09-12T19:30:46.882680+0000","last_became_active":"2024-09-12T18:25:52.612472+0000","last_became_peered":"2024-09-12T18:25:52.612472+0000","last_unstale":"2024-09-12T19:30:46.882680+0000","last_undegraded":"2024-09-12T19:30:46.882680+0000","last_fullsized":"2024-09-12T19:30:46.882680+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:46.882497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:46.882497+0000","last_clean_scrub_stamp":"2024-09-12T19:30:46.882497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:16.543409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"262'5","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:39.797434+0000","last_change":"2024-09-12T19:30:39.797434+0000","last_active":"2024-09-12T19:30:39.797434+0000","last_peered":"2024-09-12T19:30:39.797434+0000","last_clean":"2024-09-12T19:30:39.797434+0000","last_became_active":"2024-09-12T17:58:47.247496+0000","last_became_peered":"2024-09-12T17:58:47.247496+0000","last_unstale":"2024-09-12T19:30:39.797434+0000","last_undegraded":"2024-09-12T19:30:39.797434+0000","last_fullsized":"2024-09-12T19:30:39.797434+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T19:30:39.797244+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T19:30:39.797244+0000","last_clean_scrub_stamp":"2024-09-12T19:30:39.797244+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:29.956519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'12","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.772048+0000","last_change":"2024-09-12T19:30:22.772048+0000","last_active":"2024-09-12T19:30:22.772048+0000","last_peered":"2024-09-12T19:30:22.772048+0000","last_clean":"2024-09-12T19:30:22.772048+0000","last_became_active":"2024-09-12T17:58:40.207945+0000","last_became_peered":"2024-09-12T17:58:40.207945+0000","last_unstale":"2024-09-12T19:30:22.772048+0000","last_undegraded":"2024-09-12T19:30:22.772048+0000","last_fullsized":"2024-09-12T19:30:22.772048+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T19:30:22.771869+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T19:30:22.771869+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.771869+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:15.066816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8196,"num_write":22,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'37","reported_seq":178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.517183+0000","last_change":"2024-09-12T19:30:22.517183+0000","last_active":"2024-09-12T19:30:22.517183+0000","last_peered":"2024-09-12T19:30:22.517183+0000","last_clean":"2024-09-12T19:30:22.517183+0000","last_became_active":"2024-09-12T17:52:39.871148+0000","last_became_peered":"2024-09-12T17:52:39.871148+0000","last_unstale":"2024-09-12T19:30:22.517183+0000","last_undegraded":"2024-09-12T19:30:22.517183+0000","last_fullsized":"2024-09-12T19:30:22.517183+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'37","last_scrub_stamp":"2024-09-12T19:30:22.516972+0000","last_deep_scrub":"265'37","last_deep_scrub_stamp":"2024-09-12T19:30:22.516972+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.516972+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:14.364994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":131,"num_write":69,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:38.171409+0000","last_change":"2024-09-12T19:30:38.171409+0000","last_active":"2024-09-12T19:30:38.171409+0000","last_peered":"2024-09-12T19:30:38.171409+0000","last_clean":"2024-09-12T19:30:38.171409+0000","last_became_active":"2024-09-12T18:25:52.604589+0000","last_became_peered":"2024-09-12T18:25:52.604589+0000","last_unstale":"2024-09-12T19:30:38.171409+0000","last_undegraded":"2024-09-12T19:30:38.171409+0000","last_fullsized":"2024-09-12T19:30:38.171409+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:38.171196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:38.171196+0000","last_clean_scrub_stamp":"2024-09-12T19:30:38.171196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:50.341907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"265'8","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.497638+0000","last_change":"2024-09-12T19:30:18.497357+0000","last_active":"2024-09-12T19:30:18.497638+0000","last_peered":"2024-09-12T19:30:18.497638+0000","last_clean":"2024-09-12T19:30:18.497638+0000","last_became_active":"2024-09-12T17:58:47.242756+0000","last_became_peered":"2024-09-12T17:58:47.242756+0000","last_unstale":"2024-09-12T19:30:18.497638+0000","last_undegraded":"2024-09-12T19:30:18.497638+0000","last_fullsized":"2024-09-12T19:30:18.497638+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:30:18.497092+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:30:18.497092+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.497092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:30.626986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":7170,"num_write":8,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"262'4","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.816110+0000","last_change":"2024-09-12T19:30:31.816110+0000","last_active":"2024-09-12T19:30:31.816110+0000","last_peered":"2024-09-12T19:30:31.816110+0000","last_clean":"2024-09-12T19:30:31.816110+0000","last_became_active":"2024-09-12T17:58:40.202787+0000","last_became_peered":"2024-09-12T17:58:40.202787+0000","last_unstale":"2024-09-12T19:30:31.816110+0000","last_undegraded":"2024-09-12T19:30:31.816110+0000","last_fullsized":"2024-09-12T19:30:31.816110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T19:30:31.815913+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T19:30:31.815913+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.815913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:48.761075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'30","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.505490+0000","last_change":"2024-09-12T19:30:21.505490+0000","last_active":"2024-09-12T19:30:21.505490+0000","last_peered":"2024-09-12T19:30:21.505490+0000","last_clean":"2024-09-12T19:30:21.505490+0000","last_became_active":"2024-09-12T17:52:39.888092+0000","last_became_peered":"2024-09-12T17:52:39.888092+0000","last_unstale":"2024-09-12T19:30:21.505490+0000","last_undegraded":"2024-09-12T19:30:21.505490+0000","last_fullsized":"2024-09-12T19:30:21.505490+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:30:21.505315+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:30:21.505315+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.505315+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:41.185814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:34.901890+0000","last_change":"2024-09-12T19:30:34.901890+0000","last_active":"2024-09-12T19:30:34.901890+0000","last_peered":"2024-09-12T19:30:34.901890+0000","last_clean":"2024-09-12T19:30:34.901890+0000","last_became_active":"2024-09-12T18:25:52.614862+0000","last_became_peered":"2024-09-12T18:25:52.614862+0000","last_unstale":"2024-09-12T19:30:34.901890+0000","last_undegraded":"2024-09-12T19:30:34.901890+0000","last_fullsized":"2024-09-12T19:30:34.901890+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:34.901697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:34.901697+0000","last_clean_scrub_stamp":"2024-09-12T19:30:34.901697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:58.572801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:50.228266+0000","last_change":"2024-09-12T19:30:50.228266+0000","last_active":"2024-09-12T19:30:50.228266+0000","last_peered":"2024-09-12T19:30:50.228266+0000","last_clean":"2024-09-12T19:30:50.228266+0000","last_became_active":"2024-09-12T17:58:47.246322+0000","last_became_peered":"2024-09-12T17:58:47.246322+0000","last_unstale":"2024-09-12T19:30:50.228266+0000","last_undegraded":"2024-09-12T19:30:50.228266+0000","last_fullsized":"2024-09-12T19:30:50.228266+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T19:30:50.227992+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T19:30:50.227992+0000","last_clean_scrub_stamp":"2024-09-12T19:30:50.227992+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:16.900287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'4","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:45.251790+0000","last_change":"2024-09-12T19:30:45.251599+0000","last_active":"2024-09-12T19:30:45.251790+0000","last_peered":"2024-09-12T19:30:45.251790+0000","last_clean":"2024-09-12T19:30:45.251790+0000","last_became_active":"2024-09-12T17:58:40.207064+0000","last_became_peered":"2024-09-12T17:58:40.207064+0000","last_unstale":"2024-09-12T19:30:45.251790+0000","last_undegraded":"2024-09-12T19:30:45.251790+0000","last_fullsized":"2024-09-12T19:30:45.251790+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:45.251413+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:45.251413+0000","last_clean_scrub_stamp":"2024-09-12T19:30:45.251413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:20.485560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'12","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.507171+0000","last_change":"2024-09-12T19:30:15.507171+0000","last_active":"2024-09-12T19:30:15.507171+0000","last_peered":"2024-09-12T19:30:15.507171+0000","last_clean":"2024-09-12T19:30:15.507171+0000","last_became_active":"2024-09-12T17:52:39.883689+0000","last_became_peered":"2024-09-12T17:52:39.883689+0000","last_unstale":"2024-09-12T19:30:15.507171+0000","last_undegraded":"2024-09-12T19:30:15.507171+0000","last_fullsized":"2024-09-12T19:30:15.507171+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T19:30:15.506984+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T19:30:15.506984+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.506984+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:49.043767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.561277+0000","last_change":"2024-09-12T19:30:30.561180+0000","last_active":"2024-09-12T19:30:30.561277+0000","last_peered":"2024-09-12T19:30:30.561277+0000","last_clean":"2024-09-12T19:30:30.561277+0000","last_became_active":"2024-09-12T18:25:52.598221+0000","last_became_peered":"2024-09-12T18:25:52.598221+0000","last_unstale":"2024-09-12T19:30:30.561277+0000","last_undegraded":"2024-09-12T19:30:30.561277+0000","last_fullsized":"2024-09-12T19:30:30.561277+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:30.561068+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:30.561068+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.561068+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:37.139155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.531772+0000","last_change":"2024-09-12T19:30:31.531772+0000","last_active":"2024-09-12T19:30:31.531772+0000","last_peered":"2024-09-12T19:30:31.531772+0000","last_clean":"2024-09-12T19:30:31.531772+0000","last_became_active":"2024-09-12T17:58:47.238781+0000","last_became_peered":"2024-09-12T17:58:47.238781+0000","last_unstale":"2024-09-12T19:30:31.531772+0000","last_undegraded":"2024-09-12T19:30:31.531772+0000","last_fullsized":"2024-09-12T19:30:31.531772+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:31.531560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:31.531560+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.531560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:21.599091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.489122+0000","last_change":"2024-09-12T19:30:17.488936+0000","last_active":"2024-09-12T19:30:17.489122+0000","last_peered":"2024-09-12T19:30:17.489122+0000","last_clean":"2024-09-12T19:30:17.489122+0000","last_became_active":"2024-09-12T17:58:40.187973+0000","last_became_peered":"2024-09-12T17:58:40.187973+0000","last_unstale":"2024-09-12T19:30:17.489122+0000","last_undegraded":"2024-09-12T19:30:17.489122+0000","last_fullsized":"2024-09-12T19:30:17.489122+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T19:30:17.488744+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T19:30:17.488744+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.488744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:15.360529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'31","reported_seq":166,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.139881+0000","last_change":"2024-09-12T19:30:21.139881+0000","last_active":"2024-09-12T19:30:21.139881+0000","last_peered":"2024-09-12T19:30:21.139881+0000","last_clean":"2024-09-12T19:30:21.139881+0000","last_became_active":"2024-09-12T17:52:39.891830+0000","last_became_peered":"2024-09-12T17:52:39.891830+0000","last_unstale":"2024-09-12T19:30:21.139881+0000","last_undegraded":"2024-09-12T19:30:21.139881+0000","last_fullsized":"2024-09-12T19:30:21.139881+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:30:21.139662+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:30:21.139662+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.139662+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:10.758873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.597393+0000","last_change":"2024-09-12T19:30:24.597150+0000","last_active":"2024-09-12T19:30:24.597393+0000","last_peered":"2024-09-12T19:30:24.597393+0000","last_clean":"2024-09-12T19:30:24.597393+0000","last_became_active":"2024-09-12T18:25:52.606714+0000","last_became_peered":"2024-09-12T18:25:52.606714+0000","last_unstale":"2024-09-12T19:30:24.597393+0000","last_undegraded":"2024-09-12T19:30:24.597393+0000","last_fullsized":"2024-09-12T19:30:24.597393+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:24.596947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:24.596947+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.596947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:51.381270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'4","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:35.176909+0000","last_change":"2024-09-12T19:30:35.176909+0000","last_active":"2024-09-12T19:30:35.176909+0000","last_peered":"2024-09-12T19:30:35.176909+0000","last_clean":"2024-09-12T19:30:35.176909+0000","last_became_active":"2024-09-12T17:58:47.250364+0000","last_became_peered":"2024-09-12T17:58:47.250364+0000","last_unstale":"2024-09-12T19:30:35.176909+0000","last_undegraded":"2024-09-12T19:30:35.176909+0000","last_fullsized":"2024-09-12T19:30:35.176909+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:35.176723+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:35.176723+0000","last_clean_scrub_stamp":"2024-09-12T19:30:35.176723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:18.652063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.593274+0000","last_change":"2024-09-12T19:30:26.593137+0000","last_active":"2024-09-12T19:30:26.593274+0000","last_peered":"2024-09-12T19:30:26.593274+0000","last_clean":"2024-09-12T19:30:26.593274+0000","last_became_active":"2024-09-12T17:58:40.212280+0000","last_became_peered":"2024-09-12T17:58:40.212280+0000","last_unstale":"2024-09-12T19:30:26.593274+0000","last_undegraded":"2024-09-12T19:30:26.593274+0000","last_fullsized":"2024-09-12T19:30:26.593274+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:26.592949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:26.592949+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.592949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.408090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'30","reported_seq":160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.501810+0000","last_change":"2024-09-12T19:30:20.501810+0000","last_active":"2024-09-12T19:30:20.501810+0000","last_peered":"2024-09-12T19:30:20.501810+0000","last_clean":"2024-09-12T19:30:20.501810+0000","last_became_active":"2024-09-12T17:52:39.870304+0000","last_became_peered":"2024-09-12T17:52:39.870304+0000","last_unstale":"2024-09-12T19:30:20.501810+0000","last_undegraded":"2024-09-12T19:30:20.501810+0000","last_fullsized":"2024-09-12T19:30:20.501810+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:30:20.501593+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:30:20.501593+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.501593+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:29.819395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":59,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:44.865569+0000","last_change":"2024-09-12T19:30:44.865569+0000","last_active":"2024-09-12T19:30:44.865569+0000","last_peered":"2024-09-12T19:30:44.865569+0000","last_clean":"2024-09-12T19:30:44.865569+0000","last_became_active":"2024-09-12T18:25:52.622842+0000","last_became_peered":"2024-09-12T18:25:52.622842+0000","last_unstale":"2024-09-12T19:30:44.865569+0000","last_undegraded":"2024-09-12T19:30:44.865569+0000","last_fullsized":"2024-09-12T19:30:44.865569+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:44.865342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:44.865342+0000","last_clean_scrub_stamp":"2024-09-12T19:30:44.865342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:40.545971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'4","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:36.176010+0000","last_change":"2024-09-12T19:30:36.175874+0000","last_active":"2024-09-12T19:30:36.176010+0000","last_peered":"2024-09-12T19:30:36.176010+0000","last_clean":"2024-09-12T19:30:36.176010+0000","last_became_active":"2024-09-12T17:58:47.255379+0000","last_became_peered":"2024-09-12T17:58:47.255379+0000","last_unstale":"2024-09-12T19:30:36.176010+0000","last_undegraded":"2024-09-12T19:30:36.176010+0000","last_fullsized":"2024-09-12T19:30:36.176010+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:36.175697+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:36.175697+0000","last_clean_scrub_stamp":"2024-09-12T19:30:36.175697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:45.701012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:52.203321+0000","last_change":"2024-09-12T19:30:52.203321+0000","last_active":"2024-09-12T19:30:52.203321+0000","last_peered":"2024-09-12T19:30:52.203321+0000","last_clean":"2024-09-12T19:30:52.203321+0000","last_became_active":"2024-09-12T17:58:40.193471+0000","last_became_peered":"2024-09-12T17:58:40.193471+0000","last_unstale":"2024-09-12T19:30:52.203321+0000","last_undegraded":"2024-09-12T19:30:52.203321+0000","last_fullsized":"2024-09-12T19:30:52.203321+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:52.203133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:52.203133+0000","last_clean_scrub_stamp":"2024-09-12T19:30:52.203133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:33.925823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'46","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.946456+0000","last_change":"2024-09-12T19:30:27.946456+0000","last_active":"2024-09-12T19:30:27.946456+0000","last_peered":"2024-09-12T19:30:27.946456+0000","last_clean":"2024-09-12T19:30:27.946456+0000","last_became_active":"2024-09-12T17:52:39.883248+0000","last_became_peered":"2024-09-12T17:52:39.883248+0000","last_unstale":"2024-09-12T19:30:27.946456+0000","last_undegraded":"2024-09-12T19:30:27.946456+0000","last_fullsized":"2024-09-12T19:30:27.946456+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'46","last_scrub_stamp":"2024-09-12T19:30:27.946256+0000","last_deep_scrub":"265'46","last_deep_scrub_stamp":"2024-09-12T19:30:27.946256+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.946256+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:52.487534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":156,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.660257+0000","last_change":"2024-09-12T19:30:28.660257+0000","last_active":"2024-09-12T19:30:28.660257+0000","last_peered":"2024-09-12T19:30:28.660257+0000","last_clean":"2024-09-12T19:30:28.660257+0000","last_became_active":"2024-09-12T18:25:52.611620+0000","last_became_peered":"2024-09-12T18:25:52.611620+0000","last_unstale":"2024-09-12T19:30:28.660257+0000","last_undegraded":"2024-09-12T19:30:28.660257+0000","last_fullsized":"2024-09-12T19:30:28.660257+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:28.660072+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:28.660072+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.660072+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:33.213545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'7","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:36.798251+0000","last_change":"2024-09-12T19:30:36.798251+0000","last_active":"2024-09-12T19:30:36.798251+0000","last_peered":"2024-09-12T19:30:36.798251+0000","last_clean":"2024-09-12T19:30:36.798251+0000","last_became_active":"2024-09-12T17:58:47.249833+0000","last_became_peered":"2024-09-12T17:58:47.249833+0000","last_unstale":"2024-09-12T19:30:36.798251+0000","last_undegraded":"2024-09-12T19:30:36.798251+0000","last_fullsized":"2024-09-12T19:30:36.798251+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:36.797967+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:36.797967+0000","last_clean_scrub_stamp":"2024-09-12T19:30:36.797967+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:44.588825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.515242+0000","last_change":"2024-09-12T19:30:12.515110+0000","last_active":"2024-09-12T19:30:12.515242+0000","last_peered":"2024-09-12T19:30:12.515242+0000","last_clean":"2024-09-12T19:30:12.515242+0000","last_became_active":"2024-09-12T17:58:40.203917+0000","last_became_peered":"2024-09-12T17:58:40.203917+0000","last_unstale":"2024-09-12T19:30:12.515242+0000","last_undegraded":"2024-09-12T19:30:12.515242+0000","last_fullsized":"2024-09-12T19:30:12.515242+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:12.514935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:12.514935+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.514935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:32.269384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.964887+0000","last_change":"2024-09-12T19:30:26.964887+0000","last_active":"2024-09-12T19:30:26.964887+0000","last_peered":"2024-09-12T19:30:26.964887+0000","last_clean":"2024-09-12T19:30:26.964887+0000","last_became_active":"2024-09-12T17:52:39.884285+0000","last_became_peered":"2024-09-12T17:52:39.884285+0000","last_unstale":"2024-09-12T19:30:26.964887+0000","last_undegraded":"2024-09-12T19:30:26.964887+0000","last_fullsized":"2024-09-12T19:30:26.964887+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T19:30:26.964706+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T19:30:26.964706+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.964706+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:47.546323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.595080+0000","last_change":"2024-09-12T19:30:28.595080+0000","last_active":"2024-09-12T19:30:28.595080+0000","last_peered":"2024-09-12T19:30:28.595080+0000","last_clean":"2024-09-12T19:30:28.595080+0000","last_became_active":"2024-09-12T18:25:52.623502+0000","last_became_peered":"2024-09-12T18:25:52.623502+0000","last_unstale":"2024-09-12T19:30:28.595080+0000","last_undegraded":"2024-09-12T19:30:28.595080+0000","last_fullsized":"2024-09-12T19:30:28.595080+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:28.594903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:28.594903+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.594903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:26.161731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'7","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:34.185787+0000","last_change":"2024-09-12T19:30:34.185622+0000","last_active":"2024-09-12T19:30:34.185787+0000","last_peered":"2024-09-12T19:30:34.185787+0000","last_clean":"2024-09-12T19:30:34.185787+0000","last_became_active":"2024-09-12T17:58:47.256721+0000","last_became_peered":"2024-09-12T17:58:47.256721+0000","last_unstale":"2024-09-12T19:30:34.185787+0000","last_undegraded":"2024-09-12T19:30:34.185787+0000","last_fullsized":"2024-09-12T19:30:34.185787+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:34.185441+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:34.185441+0000","last_clean_scrub_stamp":"2024-09-12T19:30:34.185441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:35.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16424,"num_write":12,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.151097+0000","last_change":"2024-09-12T19:30:25.150955+0000","last_active":"2024-09-12T19:30:25.151097+0000","last_peered":"2024-09-12T19:30:25.151097+0000","last_clean":"2024-09-12T19:30:25.151097+0000","last_became_active":"2024-09-12T17:58:40.198765+0000","last_became_peered":"2024-09-12T17:58:40.198765+0000","last_unstale":"2024-09-12T19:30:25.151097+0000","last_undegraded":"2024-09-12T19:30:25.151097+0000","last_fullsized":"2024-09-12T19:30:25.151097+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:25.150777+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:25.150777+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.150777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:35.360638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'58","reported_seq":232,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.136126+0000","last_change":"2024-09-12T19:30:20.136126+0000","last_active":"2024-09-12T19:30:20.136126+0000","last_peered":"2024-09-12T19:30:20.136126+0000","last_clean":"2024-09-12T19:30:20.136126+0000","last_became_active":"2024-09-12T17:52:39.885875+0000","last_became_peered":"2024-09-12T17:52:39.885875+0000","last_unstale":"2024-09-12T19:30:20.136126+0000","last_undegraded":"2024-09-12T19:30:20.136126+0000","last_fullsized":"2024-09-12T19:30:20.136126+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'58","last_scrub_stamp":"2024-09-12T19:30:20.135932+0000","last_deep_scrub":"265'58","last_deep_scrub_stamp":"2024-09-12T19:30:20.135932+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.135932+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:38.194208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":205,"num_write":103,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.548430+0000","last_change":"2024-09-12T19:30:23.548430+0000","last_active":"2024-09-12T19:30:23.548430+0000","last_peered":"2024-09-12T19:30:23.548430+0000","last_clean":"2024-09-12T19:30:23.548430+0000","last_became_active":"2024-09-12T18:25:52.617665+0000","last_became_peered":"2024-09-12T18:25:52.617665+0000","last_unstale":"2024-09-12T19:30:23.548430+0000","last_undegraded":"2024-09-12T19:30:23.548430+0000","last_fullsized":"2024-09-12T19:30:23.548430+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:23.548235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:23.548235+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.548235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:56.734201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'5","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.507942+0000","last_change":"2024-09-12T19:30:16.507812+0000","last_active":"2024-09-12T19:30:16.507942+0000","last_peered":"2024-09-12T19:30:16.507942+0000","last_clean":"2024-09-12T19:30:16.507942+0000","last_became_active":"2024-09-12T17:58:47.253819+0000","last_became_peered":"2024-09-12T17:58:47.253819+0000","last_unstale":"2024-09-12T19:30:16.507942+0000","last_undegraded":"2024-09-12T19:30:16.507942+0000","last_fullsized":"2024-09-12T19:30:16.507942+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T19:30:16.507623+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T19:30:16.507623+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.507623+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:51.873967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.803872+0000","last_change":"2024-09-12T19:30:28.803706+0000","last_active":"2024-09-12T19:30:28.803872+0000","last_peered":"2024-09-12T19:30:28.803872+0000","last_clean":"2024-09-12T19:30:28.803872+0000","last_became_active":"2024-09-12T17:58:40.202790+0000","last_became_peered":"2024-09-12T17:58:40.202790+0000","last_unstale":"2024-09-12T19:30:28.803872+0000","last_undegraded":"2024-09-12T19:30:28.803872+0000","last_fullsized":"2024-09-12T19:30:28.803872+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:28.803523+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:28.803523+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.803523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:40.616987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'30","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:42.248432+0000","last_change":"2024-09-12T19:30:42.248224+0000","last_active":"2024-09-12T19:30:42.248432+0000","last_peered":"2024-09-12T19:30:42.248432+0000","last_clean":"2024-09-12T19:30:42.248432+0000","last_became_active":"2024-09-12T17:52:39.871009+0000","last_became_peered":"2024-09-12T17:52:39.871009+0000","last_unstale":"2024-09-12T19:30:42.248432+0000","last_undegraded":"2024-09-12T19:30:42.248432+0000","last_fullsized":"2024-09-12T19:30:42.248432+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:30:42.248000+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:30:42.248000+0000","last_clean_scrub_stamp":"2024-09-12T19:30:42.248000+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:06.477785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:45.853204+0000","last_change":"2024-09-12T19:30:45.853074+0000","last_active":"2024-09-12T19:30:45.853204+0000","last_peered":"2024-09-12T19:30:45.853204+0000","last_clean":"2024-09-12T19:30:45.853204+0000","last_became_active":"2024-09-12T18:25:52.617863+0000","last_became_peered":"2024-09-12T18:25:52.617863+0000","last_unstale":"2024-09-12T19:30:45.853204+0000","last_undegraded":"2024-09-12T19:30:45.853204+0000","last_fullsized":"2024-09-12T19:30:45.853204+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:45.852892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:45.852892+0000","last_clean_scrub_stamp":"2024-09-12T19:30:45.852892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:22.728727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"262'2","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:37.776900+0000","last_change":"2024-09-12T19:30:37.776900+0000","last_active":"2024-09-12T19:30:37.776900+0000","last_peered":"2024-09-12T19:30:37.776900+0000","last_clean":"2024-09-12T19:30:37.776900+0000","last_became_active":"2024-09-12T17:58:47.247475+0000","last_became_peered":"2024-09-12T17:58:47.247475+0000","last_unstale":"2024-09-12T19:30:37.776900+0000","last_undegraded":"2024-09-12T19:30:37.776900+0000","last_fullsized":"2024-09-12T19:30:37.776900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:30:37.776699+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:30:37.776699+0000","last_clean_scrub_stamp":"2024-09-12T19:30:37.776699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.223683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"265'5","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.800883+0000","last_change":"2024-09-12T19:30:21.800883+0000","last_active":"2024-09-12T19:30:21.800883+0000","last_peered":"2024-09-12T19:30:21.800883+0000","last_clean":"2024-09-12T19:30:21.800883+0000","last_became_active":"2024-09-12T17:58:40.202141+0000","last_became_peered":"2024-09-12T17:58:40.202141+0000","last_unstale":"2024-09-12T19:30:21.800883+0000","last_undegraded":"2024-09-12T19:30:21.800883+0000","last_fullsized":"2024-09-12T19:30:21.800883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:30:21.800695+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:30:21.800695+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.800695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:09.542151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"265'22","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:40.229444+0000","last_change":"2024-09-12T19:30:40.229308+0000","last_active":"2024-09-12T19:30:40.229444+0000","last_peered":"2024-09-12T19:30:40.229444+0000","last_clean":"2024-09-12T19:30:40.229444+0000","last_became_active":"2024-09-12T17:52:39.884686+0000","last_became_peered":"2024-09-12T17:52:39.884686+0000","last_unstale":"2024-09-12T19:30:40.229444+0000","last_undegraded":"2024-09-12T19:30:40.229444+0000","last_fullsized":"2024-09-12T19:30:40.229444+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'22","last_scrub_stamp":"2024-09-12T19:30:40.229124+0000","last_deep_scrub":"265'22","last_deep_scrub_stamp":"2024-09-12T19:30:40.229124+0000","last_clean_scrub_stamp":"2024-09-12T19:30:40.229124+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:07.610654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.647819+0000","last_change":"2024-09-12T19:30:30.647588+0000","last_active":"2024-09-12T19:30:30.647819+0000","last_peered":"2024-09-12T19:30:30.647819+0000","last_clean":"2024-09-12T19:30:30.647819+0000","last_became_active":"2024-09-12T18:25:52.611450+0000","last_became_peered":"2024-09-12T18:25:52.611450+0000","last_unstale":"2024-09-12T19:30:30.647819+0000","last_undegraded":"2024-09-12T19:30:30.647819+0000","last_fullsized":"2024-09-12T19:30:30.647819+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:30.647384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:30.647384+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.647384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:46.507582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"265'4","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:34.850807+0000","last_change":"2024-09-12T19:30:34.850807+0000","last_active":"2024-09-12T19:30:34.850807+0000","last_peered":"2024-09-12T19:30:34.850807+0000","last_clean":"2024-09-12T19:30:34.850807+0000","last_became_active":"2024-09-12T17:58:47.254061+0000","last_became_peered":"2024-09-12T17:58:47.254061+0000","last_unstale":"2024-09-12T19:30:34.850807+0000","last_undegraded":"2024-09-12T19:30:34.850807+0000","last_fullsized":"2024-09-12T19:30:34.850807+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:34.850620+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:34.850620+0000","last_clean_scrub_stamp":"2024-09-12T19:30:34.850620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:24.069233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"265'2","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.829303+0000","last_change":"2024-09-12T19:30:27.829303+0000","last_active":"2024-09-12T19:30:27.829303+0000","last_peered":"2024-09-12T19:30:27.829303+0000","last_clean":"2024-09-12T19:30:27.829303+0000","last_became_active":"2024-09-12T17:58:40.203144+0000","last_became_peered":"2024-09-12T17:58:40.203144+0000","last_unstale":"2024-09-12T19:30:27.829303+0000","last_undegraded":"2024-09-12T19:30:27.829303+0000","last_fullsized":"2024-09-12T19:30:27.829303+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:27.829119+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:27.829119+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.829119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:56.155590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"262'16","reported_seq":126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.148949+0000","last_change":"2024-09-12T19:30:19.148725+0000","last_active":"2024-09-12T19:30:19.148949+0000","last_peered":"2024-09-12T19:30:19.148949+0000","last_clean":"2024-09-12T19:30:19.148949+0000","last_became_active":"2024-09-12T17:52:39.878797+0000","last_became_peered":"2024-09-12T17:52:39.878797+0000","last_unstale":"2024-09-12T19:30:19.148949+0000","last_undegraded":"2024-09-12T19:30:19.148949+0000","last_fullsized":"2024-09-12T19:30:19.148949+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-12T19:30:19.148445+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-12T19:30:19.148445+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.148445+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:54.941095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:33.898644+0000","last_change":"2024-09-12T19:30:33.898644+0000","last_active":"2024-09-12T19:30:33.898644+0000","last_peered":"2024-09-12T19:30:33.898644+0000","last_clean":"2024-09-12T19:30:33.898644+0000","last_became_active":"2024-09-12T18:25:52.614949+0000","last_became_peered":"2024-09-12T18:25:52.614949+0000","last_unstale":"2024-09-12T19:30:33.898644+0000","last_undegraded":"2024-09-12T19:30:33.898644+0000","last_fullsized":"2024-09-12T19:30:33.898644+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:33.898460+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:33.898460+0000","last_clean_scrub_stamp":"2024-09-12T19:30:33.898460+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:59.103700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:32.137538+0000","last_change":"2024-09-12T19:30:32.137538+0000","last_active":"2024-09-12T19:30:32.137538+0000","last_peered":"2024-09-12T19:30:32.137538+0000","last_clean":"2024-09-12T19:30:32.137538+0000","last_became_active":"2024-09-12T17:58:47.246916+0000","last_became_peered":"2024-09-12T17:58:47.246916+0000","last_unstale":"2024-09-12T19:30:32.137538+0000","last_undegraded":"2024-09-12T19:30:32.137538+0000","last_fullsized":"2024-09-12T19:30:32.137538+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:32.137356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:32.137356+0000","last_clean_scrub_stamp":"2024-09-12T19:30:32.137356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:21.391591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"262'2","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.796126+0000","last_change":"2024-09-12T19:30:19.796126+0000","last_active":"2024-09-12T19:30:19.796126+0000","last_peered":"2024-09-12T19:30:19.796126+0000","last_clean":"2024-09-12T19:30:19.796126+0000","last_became_active":"2024-09-12T17:58:40.207311+0000","last_became_peered":"2024-09-12T17:58:40.207311+0000","last_unstale":"2024-09-12T19:30:19.796126+0000","last_undegraded":"2024-09-12T19:30:19.796126+0000","last_fullsized":"2024-09-12T19:30:19.796126+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:30:19.795842+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:30:19.795842+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.795842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:01.987352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'29","reported_seq":160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.452898+0000","last_change":"2024-09-12T19:30:23.452754+0000","last_active":"2024-09-12T19:30:23.452898+0000","last_peered":"2024-09-12T19:30:23.452898+0000","last_clean":"2024-09-12T19:30:23.452898+0000","last_became_active":"2024-09-12T17:52:39.867179+0000","last_became_peered":"2024-09-12T17:52:39.867179+0000","last_unstale":"2024-09-12T19:30:23.452898+0000","last_undegraded":"2024-09-12T19:30:23.452898+0000","last_fullsized":"2024-09-12T19:30:23.452898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T19:30:23.452558+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T19:30:23.452558+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.452558+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:54.100502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":103,"num_write":56,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.695442+0000","last_change":"2024-09-12T19:30:29.695283+0000","last_active":"2024-09-12T19:30:29.695442+0000","last_peered":"2024-09-12T19:30:29.695442+0000","last_clean":"2024-09-12T19:30:29.695442+0000","last_became_active":"2024-09-12T18:25:52.610587+0000","last_became_peered":"2024-09-12T18:25:52.610587+0000","last_unstale":"2024-09-12T19:30:29.695442+0000","last_undegraded":"2024-09-12T19:30:29.695442+0000","last_fullsized":"2024-09-12T19:30:29.695442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:29.695095+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:29.695095+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.695095+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:11.853621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:49.205539+0000","last_change":"2024-09-12T19:30:49.205539+0000","last_active":"2024-09-12T19:30:49.205539+0000","last_peered":"2024-09-12T19:30:49.205539+0000","last_clean":"2024-09-12T19:30:49.205539+0000","last_became_active":"2024-09-12T17:58:47.245601+0000","last_became_peered":"2024-09-12T17:58:47.245601+0000","last_unstale":"2024-09-12T19:30:49.205539+0000","last_undegraded":"2024-09-12T19:30:49.205539+0000","last_fullsized":"2024-09-12T19:30:49.205539+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:49.205360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:49.205360+0000","last_clean_scrub_stamp":"2024-09-12T19:30:49.205360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:21:18.928328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"262'4","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.763420+0000","last_change":"2024-09-12T19:30:18.763420+0000","last_active":"2024-09-12T19:30:18.763420+0000","last_peered":"2024-09-12T19:30:18.763420+0000","last_clean":"2024-09-12T19:30:18.763420+0000","last_became_active":"2024-09-12T17:58:40.202408+0000","last_became_peered":"2024-09-12T17:58:40.202408+0000","last_unstale":"2024-09-12T19:30:18.763420+0000","last_undegraded":"2024-09-12T19:30:18.763420+0000","last_fullsized":"2024-09-12T19:30:18.763420+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T19:30:18.763226+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T19:30:18.763226+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.763226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:19.391027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":531,"num_write":4,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'109","reported_seq":451,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.106885+0000","last_change":"2024-09-12T19:30:18.106728+0000","last_active":"2024-09-12T19:30:18.106885+0000","last_peered":"2024-09-12T19:30:18.106885+0000","last_clean":"2024-09-12T19:30:18.106885+0000","last_became_active":"2024-09-12T17:52:39.880742+0000","last_became_peered":"2024-09-12T17:52:39.880742+0000","last_unstale":"2024-09-12T19:30:18.106885+0000","last_undegraded":"2024-09-12T19:30:18.106885+0000","last_fullsized":"2024-09-12T19:30:18.106885+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T19:30:18.106534+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T19:30:18.106534+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.106534+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:40.456813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":720,"num_read_kb":486,"num_write":145,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3486,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:42.898408+0000","last_change":"2024-09-12T19:30:42.898408+0000","last_active":"2024-09-12T19:30:42.898408+0000","last_peered":"2024-09-12T19:30:42.898408+0000","last_clean":"2024-09-12T19:30:42.898408+0000","last_became_active":"2024-09-12T18:25:52.605039+0000","last_became_peered":"2024-09-12T18:25:52.605039+0000","last_unstale":"2024-09-12T19:30:42.898408+0000","last_undegraded":"2024-09-12T19:30:42.898408+0000","last_fullsized":"2024-09-12T19:30:42.898408+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:42.898120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:42.898120+0000","last_clean_scrub_stamp":"2024-09-12T19:30:42.898120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:00.312731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'7","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.118570+0000","last_change":"2024-09-12T19:30:30.118254+0000","last_active":"2024-09-12T19:30:30.118570+0000","last_peered":"2024-09-12T19:30:30.118570+0000","last_clean":"2024-09-12T19:30:30.118570+0000","last_became_active":"2024-09-12T17:58:47.241778+0000","last_became_peered":"2024-09-12T17:58:47.241778+0000","last_unstale":"2024-09-12T19:30:30.118570+0000","last_undegraded":"2024-09-12T19:30:30.118570+0000","last_fullsized":"2024-09-12T19:30:30.118570+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:30.118028+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:30.118028+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.118028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:00.813338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3074,"num_write":12,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.452034+0000","last_change":"2024-09-12T19:30:22.451881+0000","last_active":"2024-09-12T19:30:22.452034+0000","last_peered":"2024-09-12T19:30:22.452034+0000","last_clean":"2024-09-12T19:30:22.452034+0000","last_became_active":"2024-09-12T17:58:40.195309+0000","last_became_peered":"2024-09-12T17:58:40.195309+0000","last_unstale":"2024-09-12T19:30:22.452034+0000","last_undegraded":"2024-09-12T19:30:22.452034+0000","last_fullsized":"2024-09-12T19:30:22.452034+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:22.451699+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:22.451699+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.451699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:38.841086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'111","reported_seq":467,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.115973+0000","last_change":"2024-09-12T19:30:31.115973+0000","last_active":"2024-09-12T19:30:31.115973+0000","last_peered":"2024-09-12T19:30:31.115973+0000","last_clean":"2024-09-12T19:30:31.115973+0000","last_became_active":"2024-09-12T17:52:39.886185+0000","last_became_peered":"2024-09-12T17:52:39.886185+0000","last_unstale":"2024-09-12T19:30:31.115973+0000","last_undegraded":"2024-09-12T19:30:31.115973+0000","last_fullsized":"2024-09-12T19:30:31.115973+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'111","last_scrub_stamp":"2024-09-12T19:30:31.115790+0000","last_deep_scrub":"265'111","last_deep_scrub_stamp":"2024-09-12T19:30:31.115790+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.115790+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:27.218809+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":756,"num_read_kb":514,"num_write":140,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3479,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.797758+0000","last_change":"2024-09-12T19:30:25.797595+0000","last_active":"2024-09-12T19:30:25.797758+0000","last_peered":"2024-09-12T19:30:25.797758+0000","last_clean":"2024-09-12T19:30:25.797758+0000","last_became_active":"2024-09-12T18:25:52.623444+0000","last_became_peered":"2024-09-12T18:25:52.623444+0000","last_unstale":"2024-09-12T19:30:25.797758+0000","last_undegraded":"2024-09-12T19:30:25.797758+0000","last_fullsized":"2024-09-12T19:30:25.797758+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:25.797418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:25.797418+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.797418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:34.539442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.157159+0000","last_change":"2024-09-12T19:30:29.156992+0000","last_active":"2024-09-12T19:30:29.157159+0000","last_peered":"2024-09-12T19:30:29.157159+0000","last_clean":"2024-09-12T19:30:29.157159+0000","last_became_active":"2024-09-12T17:58:47.254273+0000","last_became_peered":"2024-09-12T17:58:47.254273+0000","last_unstale":"2024-09-12T19:30:29.157159+0000","last_undegraded":"2024-09-12T19:30:29.157159+0000","last_fullsized":"2024-09-12T19:30:29.157159+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:29.156811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:29.156811+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.156811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:54.104657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"265'2","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.560740+0000","last_change":"2024-09-12T19:30:25.560588+0000","last_active":"2024-09-12T19:30:25.560740+0000","last_peered":"2024-09-12T19:30:25.560740+0000","last_clean":"2024-09-12T19:30:25.560740+0000","last_became_active":"2024-09-12T17:58:40.202027+0000","last_became_peered":"2024-09-12T17:58:40.202027+0000","last_unstale":"2024-09-12T19:30:25.560740+0000","last_undegraded":"2024-09-12T19:30:25.560740+0000","last_fullsized":"2024-09-12T19:30:25.560740+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:25.560411+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:25.560411+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.560411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:21.949121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'31","reported_seq":161,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:39.245886+0000","last_change":"2024-09-12T19:30:39.245886+0000","last_active":"2024-09-12T19:30:39.245886+0000","last_peered":"2024-09-12T19:30:39.245886+0000","last_clean":"2024-09-12T19:30:39.245886+0000","last_became_active":"2024-09-12T17:52:39.877206+0000","last_became_peered":"2024-09-12T17:52:39.877206+0000","last_unstale":"2024-09-12T19:30:39.245886+0000","last_undegraded":"2024-09-12T19:30:39.245886+0000","last_fullsized":"2024-09-12T19:30:39.245886+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:30:39.245705+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:30:39.245705+0000","last_clean_scrub_stamp":"2024-09-12T19:30:39.245705+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:07.946652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":97,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:54.192243+0000","last_change":"2024-09-12T19:30:54.191965+0000","last_active":"2024-09-12T19:30:54.192243+0000","last_peered":"2024-09-12T19:30:54.192243+0000","last_clean":"2024-09-12T19:30:54.192243+0000","last_became_active":"2024-09-12T18:25:52.620045+0000","last_became_peered":"2024-09-12T18:25:52.620045+0000","last_unstale":"2024-09-12T19:30:54.192243+0000","last_undegraded":"2024-09-12T19:30:54.192243+0000","last_fullsized":"2024-09-12T19:30:54.192243+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:54.191694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:54.191694+0000","last_clean_scrub_stamp":"2024-09-12T19:30:54.191694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:50.322246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:33.150190+0000","last_change":"2024-09-12T19:30:33.150190+0000","last_active":"2024-09-12T19:30:33.150190+0000","last_peered":"2024-09-12T19:30:33.150190+0000","last_clean":"2024-09-12T19:30:33.150190+0000","last_became_active":"2024-09-12T17:58:47.252966+0000","last_became_peered":"2024-09-12T17:58:47.252966+0000","last_unstale":"2024-09-12T19:30:33.150190+0000","last_undegraded":"2024-09-12T19:30:33.150190+0000","last_fullsized":"2024-09-12T19:30:33.150190+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:33.150007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:33.150007+0000","last_clean_scrub_stamp":"2024-09-12T19:30:33.150007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:25.151589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"265'9","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.154442+0000","last_change":"2024-09-12T19:30:24.154254+0000","last_active":"2024-09-12T19:30:24.154442+0000","last_peered":"2024-09-12T19:30:24.154442+0000","last_clean":"2024-09-12T19:30:24.154442+0000","last_became_active":"2024-09-12T17:58:40.198161+0000","last_became_peered":"2024-09-12T17:58:40.198161+0000","last_unstale":"2024-09-12T19:30:24.154442+0000","last_undegraded":"2024-09-12T19:30:24.154442+0000","last_fullsized":"2024-09-12T19:30:24.154442+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T19:30:24.154077+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T19:30:24.154077+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.154077+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:21.687233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'31","reported_seq":162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.714425+0000","last_change":"2024-09-12T19:30:17.714425+0000","last_active":"2024-09-12T19:30:17.714425+0000","last_peered":"2024-09-12T19:30:17.714425+0000","last_clean":"2024-09-12T19:30:17.714425+0000","last_became_active":"2024-09-12T17:52:39.866342+0000","last_became_peered":"2024-09-12T17:52:39.866342+0000","last_unstale":"2024-09-12T19:30:17.714425+0000","last_undegraded":"2024-09-12T19:30:17.714425+0000","last_fullsized":"2024-09-12T19:30:17.714425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:30:17.714240+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:30:17.714240+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.714240+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:07.207076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":107,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.792023+0000","last_change":"2024-09-12T19:30:24.791871+0000","last_active":"2024-09-12T19:30:24.792023+0000","last_peered":"2024-09-12T19:30:24.792023+0000","last_clean":"2024-09-12T19:30:24.792023+0000","last_became_active":"2024-09-12T18:25:52.599679+0000","last_became_peered":"2024-09-12T18:25:52.599679+0000","last_unstale":"2024-09-12T19:30:24.792023+0000","last_undegraded":"2024-09-12T19:30:24.792023+0000","last_fullsized":"2024-09-12T19:30:24.792023+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:24.791652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:24.791652+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.791652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:49.255999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"265'2","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:33.844283+0000","last_change":"2024-09-12T19:30:33.844114+0000","last_active":"2024-09-12T19:30:33.844283+0000","last_peered":"2024-09-12T19:30:33.844283+0000","last_clean":"2024-09-12T19:30:33.844283+0000","last_became_active":"2024-09-12T17:58:47.255891+0000","last_became_peered":"2024-09-12T17:58:47.255891+0000","last_unstale":"2024-09-12T19:30:33.844283+0000","last_undegraded":"2024-09-12T19:30:33.844283+0000","last_fullsized":"2024-09-12T19:30:33.844283+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:33.843931+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:33.843931+0000","last_clean_scrub_stamp":"2024-09-12T19:30:33.843931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:40.478941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"262'3","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.242958+0000","last_change":"2024-09-12T19:30:27.242723+0000","last_active":"2024-09-12T19:30:27.242958+0000","last_peered":"2024-09-12T19:30:27.242958+0000","last_clean":"2024-09-12T19:30:27.242958+0000","last_became_active":"2024-09-12T17:58:40.211450+0000","last_became_peered":"2024-09-12T17:58:40.211450+0000","last_unstale":"2024-09-12T19:30:27.242958+0000","last_undegraded":"2024-09-12T19:30:27.242958+0000","last_fullsized":"2024-09-12T19:30:27.242958+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T19:30:27.242460+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T19:30:27.242460+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.242460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:42.454642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'25","reported_seq":152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.448771+0000","last_change":"2024-09-12T19:30:18.448771+0000","last_active":"2024-09-12T19:30:18.448771+0000","last_peered":"2024-09-12T19:30:18.448771+0000","last_clean":"2024-09-12T19:30:18.448771+0000","last_became_active":"2024-09-12T17:52:39.865914+0000","last_became_peered":"2024-09-12T17:52:39.865914+0000","last_unstale":"2024-09-12T19:30:18.448771+0000","last_undegraded":"2024-09-12T19:30:18.448771+0000","last_fullsized":"2024-09-12T19:30:18.448771+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T19:30:18.448582+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T19:30:18.448582+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.448582+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:59.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":89,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:43.896691+0000","last_change":"2024-09-12T19:30:43.896490+0000","last_active":"2024-09-12T19:30:43.896691+0000","last_peered":"2024-09-12T19:30:43.896691+0000","last_clean":"2024-09-12T19:30:43.896691+0000","last_became_active":"2024-09-12T18:25:52.612421+0000","last_became_peered":"2024-09-12T18:25:52.612421+0000","last_unstale":"2024-09-12T19:30:43.896691+0000","last_undegraded":"2024-09-12T19:30:43.896691+0000","last_fullsized":"2024-09-12T19:30:43.896691+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:43.896289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:43.896289+0000","last_clean_scrub_stamp":"2024-09-12T19:30:43.896289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:36.981829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'2","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:51.222303+0000","last_change":"2024-09-12T19:30:51.222303+0000","last_active":"2024-09-12T19:30:51.222303+0000","last_peered":"2024-09-12T19:30:51.222303+0000","last_clean":"2024-09-12T19:30:51.222303+0000","last_became_active":"2024-09-12T17:58:47.238172+0000","last_became_peered":"2024-09-12T17:58:47.238172+0000","last_unstale":"2024-09-12T19:30:51.222303+0000","last_undegraded":"2024-09-12T19:30:51.222303+0000","last_fullsized":"2024-09-12T19:30:51.222303+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:51.222132+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:51.222132+0000","last_clean_scrub_stamp":"2024-09-12T19:30:51.222132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:58.891018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'7","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.122090+0000","last_change":"2024-09-12T19:30:22.122090+0000","last_active":"2024-09-12T19:30:22.122090+0000","last_peered":"2024-09-12T19:30:22.122090+0000","last_clean":"2024-09-12T19:30:22.122090+0000","last_became_active":"2024-09-12T17:58:40.194093+0000","last_became_peered":"2024-09-12T17:58:40.194093+0000","last_unstale":"2024-09-12T19:30:22.122090+0000","last_undegraded":"2024-09-12T19:30:22.122090+0000","last_fullsized":"2024-09-12T19:30:22.122090+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:22.121867+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:22.121867+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.121867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:13.444419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'38","reported_seq":190,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.463274+0000","last_change":"2024-09-12T19:30:19.463274+0000","last_active":"2024-09-12T19:30:19.463274+0000","last_peered":"2024-09-12T19:30:19.463274+0000","last_clean":"2024-09-12T19:30:19.463274+0000","last_became_active":"2024-09-12T17:52:39.887302+0000","last_became_peered":"2024-09-12T17:52:39.887302+0000","last_unstale":"2024-09-12T19:30:19.463274+0000","last_undegraded":"2024-09-12T19:30:19.463274+0000","last_fullsized":"2024-09-12T19:30:19.463274+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T19:30:19.463087+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T19:30:19.463087+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.463087+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:51.782994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":146,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.607715+0000","last_change":"2024-09-12T19:30:29.607715+0000","last_active":"2024-09-12T19:30:29.607715+0000","last_peered":"2024-09-12T19:30:29.607715+0000","last_clean":"2024-09-12T19:30:29.607715+0000","last_became_active":"2024-09-12T18:25:52.611022+0000","last_became_peered":"2024-09-12T18:25:52.611022+0000","last_unstale":"2024-09-12T19:30:29.607715+0000","last_undegraded":"2024-09-12T19:30:29.607715+0000","last_fullsized":"2024-09-12T19:30:29.607715+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:29.607516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:29.607516+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.607516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:23.197838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"262'5","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.518145+0000","last_change":"2024-09-12T19:30:26.518145+0000","last_active":"2024-09-12T19:30:26.518145+0000","last_peered":"2024-09-12T19:30:26.518145+0000","last_clean":"2024-09-12T19:30:26.518145+0000","last_became_active":"2024-09-12T17:58:47.247599+0000","last_became_peered":"2024-09-12T17:58:47.247599+0000","last_unstale":"2024-09-12T19:30:26.518145+0000","last_undegraded":"2024-09-12T19:30:26.518145+0000","last_fullsized":"2024-09-12T19:30:26.518145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T19:30:26.517949+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T19:30:26.517949+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.517949+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:29.143936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'8","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.816842+0000","last_change":"2024-09-12T19:30:29.816842+0000","last_active":"2024-09-12T19:30:29.816842+0000","last_peered":"2024-09-12T19:30:29.816842+0000","last_clean":"2024-09-12T19:30:29.816842+0000","last_became_active":"2024-09-12T17:58:40.203177+0000","last_became_peered":"2024-09-12T17:58:40.203177+0000","last_unstale":"2024-09-12T19:30:29.816842+0000","last_undegraded":"2024-09-12T19:30:29.816842+0000","last_fullsized":"2024-09-12T19:30:29.816842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:30:29.816657+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:30:29.816657+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.816657+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:14.672776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"265'30","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.469858+0000","last_change":"2024-09-12T19:30:14.469599+0000","last_active":"2024-09-12T19:30:14.469858+0000","last_peered":"2024-09-12T19:30:14.469858+0000","last_clean":"2024-09-12T19:30:14.469858+0000","last_became_active":"2024-09-12T17:52:39.877793+0000","last_became_peered":"2024-09-12T17:52:39.877793+0000","last_unstale":"2024-09-12T19:30:14.469858+0000","last_undegraded":"2024-09-12T19:30:14.469858+0000","last_fullsized":"2024-09-12T19:30:14.469858+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:30:14.469391+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:30:14.469391+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.469391+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:09.596072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":89,"num_write":61,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.583473+0000","last_change":"2024-09-12T19:30:21.583339+0000","last_active":"2024-09-12T19:30:21.583473+0000","last_peered":"2024-09-12T19:30:21.583473+0000","last_clean":"2024-09-12T19:30:21.583473+0000","last_became_active":"2024-09-12T18:25:52.617815+0000","last_became_peered":"2024-09-12T18:25:52.617815+0000","last_unstale":"2024-09-12T19:30:21.583473+0000","last_undegraded":"2024-09-12T19:30:21.583473+0000","last_fullsized":"2024-09-12T19:30:21.583473+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:21.583159+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:21.583159+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.583159+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:14.492012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.630315+0000","last_change":"2024-09-12T19:30:27.630190+0000","last_active":"2024-09-12T19:30:27.630315+0000","last_peered":"2024-09-12T19:30:27.630315+0000","last_clean":"2024-09-12T19:30:27.630315+0000","last_became_active":"2024-09-12T17:58:47.256924+0000","last_became_peered":"2024-09-12T17:58:47.256924+0000","last_unstale":"2024-09-12T19:30:27.630315+0000","last_undegraded":"2024-09-12T19:30:27.630315+0000","last_fullsized":"2024-09-12T19:30:27.630315+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:27.630005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:27.630005+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.630005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:00.280135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.137520+0000","last_change":"2024-09-12T19:30:23.137520+0000","last_active":"2024-09-12T19:30:23.137520+0000","last_peered":"2024-09-12T19:30:23.137520+0000","last_clean":"2024-09-12T19:30:23.137520+0000","last_became_active":"2024-09-12T17:58:40.193786+0000","last_became_peered":"2024-09-12T17:58:40.193786+0000","last_unstale":"2024-09-12T19:30:23.137520+0000","last_undegraded":"2024-09-12T19:30:23.137520+0000","last_fullsized":"2024-09-12T19:30:23.137520+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:23.137344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:23.137344+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.137344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:57.159246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'23","reported_seq":147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.775425+0000","last_change":"2024-09-12T19:30:25.775425+0000","last_active":"2024-09-12T19:30:25.775425+0000","last_peered":"2024-09-12T19:30:25.775425+0000","last_clean":"2024-09-12T19:30:25.775425+0000","last_became_active":"2024-09-12T17:52:39.869627+0000","last_became_peered":"2024-09-12T17:52:39.869627+0000","last_unstale":"2024-09-12T19:30:25.775425+0000","last_undegraded":"2024-09-12T19:30:25.775425+0000","last_fullsized":"2024-09-12T19:30:25.775425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'23","last_scrub_stamp":"2024-09-12T19:30:25.775151+0000","last_deep_scrub":"265'23","last_deep_scrub_stamp":"2024-09-12T19:30:25.775151+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.775151+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:26.357018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":43,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:39.144399+0000","last_change":"2024-09-12T19:30:39.144259+0000","last_active":"2024-09-12T19:30:39.144399+0000","last_peered":"2024-09-12T19:30:39.144399+0000","last_clean":"2024-09-12T19:30:39.144399+0000","last_became_active":"2024-09-12T18:25:52.624296+0000","last_became_peered":"2024-09-12T18:25:52.624296+0000","last_unstale":"2024-09-12T19:30:39.144399+0000","last_undegraded":"2024-09-12T19:30:39.144399+0000","last_fullsized":"2024-09-12T19:30:39.144399+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:39.144070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:39.144070+0000","last_clean_scrub_stamp":"2024-09-12T19:30:39.144070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:40.185851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"265'8","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.532548+0000","last_change":"2024-09-12T19:30:19.532548+0000","last_active":"2024-09-12T19:30:19.532548+0000","last_peered":"2024-09-12T19:30:19.532548+0000","last_clean":"2024-09-12T19:30:19.532548+0000","last_became_active":"2024-09-12T17:58:47.242874+0000","last_became_peered":"2024-09-12T17:58:47.242874+0000","last_unstale":"2024-09-12T19:30:19.532548+0000","last_undegraded":"2024-09-12T19:30:19.532548+0000","last_fullsized":"2024-09-12T19:30:19.532548+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:30:19.532362+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:30:19.532362+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.532362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:37.223457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9787,"num_write":8,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"265'5","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:44.235821+0000","last_change":"2024-09-12T19:30:44.235510+0000","last_active":"2024-09-12T19:30:44.235821+0000","last_peered":"2024-09-12T19:30:44.235821+0000","last_clean":"2024-09-12T19:30:44.235821+0000","last_became_active":"2024-09-12T17:58:40.175011+0000","last_became_peered":"2024-09-12T17:58:40.175011+0000","last_unstale":"2024-09-12T19:30:44.235821+0000","last_undegraded":"2024-09-12T19:30:44.235821+0000","last_fullsized":"2024-09-12T19:30:44.235821+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:30:44.235299+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:30:44.235299+0000","last_clean_scrub_stamp":"2024-09-12T19:30:44.235299+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:34.346991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'56","reported_seq":242,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.530629+0000","last_change":"2024-09-12T19:30:13.530629+0000","last_active":"2024-09-12T19:30:13.530629+0000","last_peered":"2024-09-12T19:30:13.530629+0000","last_clean":"2024-09-12T19:30:13.530629+0000","last_became_active":"2024-09-12T17:52:39.884599+0000","last_became_peered":"2024-09-12T17:52:39.884599+0000","last_unstale":"2024-09-12T19:30:13.530629+0000","last_undegraded":"2024-09-12T19:30:13.530629+0000","last_fullsized":"2024-09-12T19:30:13.530629+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'56","last_scrub_stamp":"2024-09-12T19:30:13.530439+0000","last_deep_scrub":"265'56","last_deep_scrub_stamp":"2024-09-12T19:30:13.530439+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.530439+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:08.962809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":231,"num_write":89,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.567749+0000","last_change":"2024-09-12T19:30:22.567612+0000","last_active":"2024-09-12T19:30:22.567749+0000","last_peered":"2024-09-12T19:30:22.567749+0000","last_clean":"2024-09-12T19:30:22.567749+0000","last_became_active":"2024-09-12T18:25:52.602495+0000","last_became_peered":"2024-09-12T18:25:52.602495+0000","last_unstale":"2024-09-12T19:30:22.567749+0000","last_undegraded":"2024-09-12T19:30:22.567749+0000","last_fullsized":"2024-09-12T19:30:22.567749+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.567427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.567427+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.567427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:55.493271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'12","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:35.841295+0000","last_change":"2024-09-12T19:30:35.841077+0000","last_active":"2024-09-12T19:30:35.841295+0000","last_peered":"2024-09-12T19:30:35.841295+0000","last_clean":"2024-09-12T19:30:35.841295+0000","last_became_active":"2024-09-12T17:58:47.254272+0000","last_became_peered":"2024-09-12T17:58:47.254272+0000","last_unstale":"2024-09-12T19:30:35.841295+0000","last_undegraded":"2024-09-12T19:30:35.841295+0000","last_fullsized":"2024-09-12T19:30:35.841295+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T19:30:35.840886+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T19:30:35.840886+0000","last_clean_scrub_stamp":"2024-09-12T19:30:35.840886+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:33.031696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":22,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'6","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:46.271386+0000","last_change":"2024-09-12T19:30:46.271386+0000","last_active":"2024-09-12T19:30:46.271386+0000","last_peered":"2024-09-12T19:30:46.271386+0000","last_clean":"2024-09-12T19:30:46.271386+0000","last_became_active":"2024-09-12T17:58:40.195089+0000","last_became_peered":"2024-09-12T17:58:40.195089+0000","last_unstale":"2024-09-12T19:30:46.271386+0000","last_undegraded":"2024-09-12T19:30:46.271386+0000","last_fullsized":"2024-09-12T19:30:46.271386+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:30:46.271111+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:30:46.271111+0000","last_clean_scrub_stamp":"2024-09-12T19:30:46.271111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:59.204509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7168,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'27","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.974452+0000","last_change":"2024-09-12T19:30:25.974452+0000","last_active":"2024-09-12T19:30:25.974452+0000","last_peered":"2024-09-12T19:30:25.974452+0000","last_clean":"2024-09-12T19:30:25.974452+0000","last_became_active":"2024-09-12T17:52:39.867605+0000","last_became_peered":"2024-09-12T17:52:39.867605+0000","last_unstale":"2024-09-12T19:30:25.974452+0000","last_undegraded":"2024-09-12T19:30:25.974452+0000","last_fullsized":"2024-09-12T19:30:25.974452+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'27","last_scrub_stamp":"2024-09-12T19:30:25.974246+0000","last_deep_scrub":"265'27","last_deep_scrub_stamp":"2024-09-12T19:30:25.974246+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.974246+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:41.321941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":99,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.578467+0000","last_change":"2024-09-12T19:30:20.578328+0000","last_active":"2024-09-12T19:30:20.578467+0000","last_peered":"2024-09-12T19:30:20.578467+0000","last_clean":"2024-09-12T19:30:20.578467+0000","last_became_active":"2024-09-12T18:25:52.614383+0000","last_became_peered":"2024-09-12T18:25:52.614383+0000","last_unstale":"2024-09-12T19:30:20.578467+0000","last_undegraded":"2024-09-12T19:30:20.578467+0000","last_fullsized":"2024-09-12T19:30:20.578467+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:20.578143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:20.578143+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.578143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:29.627919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"265'5","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:32.827111+0000","last_change":"2024-09-12T19:30:32.827111+0000","last_active":"2024-09-12T19:30:32.827111+0000","last_peered":"2024-09-12T19:30:32.827111+0000","last_clean":"2024-09-12T19:30:32.827111+0000","last_became_active":"2024-09-12T17:58:47.248924+0000","last_became_peered":"2024-09-12T17:58:47.248924+0000","last_unstale":"2024-09-12T19:30:32.827111+0000","last_undegraded":"2024-09-12T19:30:32.827111+0000","last_fullsized":"2024-09-12T19:30:32.827111+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:30:32.826919+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:30:32.826919+0000","last_clean_scrub_stamp":"2024-09-12T19:30:32.826919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:46.671251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.919959+0000","last_change":"2024-09-12T19:30:30.919807+0000","last_active":"2024-09-12T19:30:30.919959+0000","last_peered":"2024-09-12T19:30:30.919959+0000","last_clean":"2024-09-12T19:30:30.919959+0000","last_became_active":"2024-09-12T17:58:40.187590+0000","last_became_peered":"2024-09-12T17:58:40.187590+0000","last_unstale":"2024-09-12T19:30:30.919959+0000","last_undegraded":"2024-09-12T19:30:30.919959+0000","last_fullsized":"2024-09-12T19:30:30.919959+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:30.919623+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:30.919623+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.919623+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:16.426133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'13","reported_seq":120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:37.258617+0000","last_change":"2024-09-12T19:30:37.258617+0000","last_active":"2024-09-12T19:30:37.258617+0000","last_peered":"2024-09-12T19:30:37.258617+0000","last_clean":"2024-09-12T19:30:37.258617+0000","last_became_active":"2024-09-12T17:52:39.872599+0000","last_became_peered":"2024-09-12T17:52:39.872599+0000","last_unstale":"2024-09-12T19:30:37.258617+0000","last_undegraded":"2024-09-12T19:30:37.258617+0000","last_fullsized":"2024-09-12T19:30:37.258617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'13","last_scrub_stamp":"2024-09-12T19:30:37.258392+0000","last_deep_scrub":"265'13","last_deep_scrub_stamp":"2024-09-12T19:30:37.258392+0000","last_clean_scrub_stamp":"2024-09-12T19:30:37.258392+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:06.024933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:40.847306+0000","last_change":"2024-09-12T19:30:40.847306+0000","last_active":"2024-09-12T19:30:40.847306+0000","last_peered":"2024-09-12T19:30:40.847306+0000","last_clean":"2024-09-12T19:30:40.847306+0000","last_became_active":"2024-09-12T18:25:52.611377+0000","last_became_peered":"2024-09-12T18:25:52.611377+0000","last_unstale":"2024-09-12T19:30:40.847306+0000","last_undegraded":"2024-09-12T19:30:40.847306+0000","last_fullsized":"2024-09-12T19:30:40.847306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:40.847097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:40.847097+0000","last_clean_scrub_stamp":"2024-09-12T19:30:40.847097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:35.620192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"265'2","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.492975+0000","last_change":"2024-09-12T19:30:15.492975+0000","last_active":"2024-09-12T19:30:15.492975+0000","last_peered":"2024-09-12T19:30:15.492975+0000","last_clean":"2024-09-12T19:30:15.492975+0000","last_became_active":"2024-09-12T17:58:47.242171+0000","last_became_peered":"2024-09-12T17:58:47.242171+0000","last_unstale":"2024-09-12T19:30:15.492975+0000","last_undegraded":"2024-09-12T19:30:15.492975+0000","last_fullsized":"2024-09-12T19:30:15.492975+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:15.492790+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:15.492790+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.492790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:32.038503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.463614+0000","last_change":"2024-09-12T19:30:21.463614+0000","last_active":"2024-09-12T19:30:21.463614+0000","last_peered":"2024-09-12T19:30:21.463614+0000","last_clean":"2024-09-12T19:30:21.463614+0000","last_became_active":"2024-09-12T17:58:40.210485+0000","last_became_peered":"2024-09-12T17:58:40.210485+0000","last_unstale":"2024-09-12T19:30:21.463614+0000","last_undegraded":"2024-09-12T19:30:21.463614+0000","last_fullsized":"2024-09-12T19:30:21.463614+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:21.463437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:21.463437+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.463437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:34.504209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'25","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.476597+0000","last_change":"2024-09-12T19:30:19.476360+0000","last_active":"2024-09-12T19:30:19.476597+0000","last_peered":"2024-09-12T19:30:19.476597+0000","last_clean":"2024-09-12T19:30:19.476597+0000","last_became_active":"2024-09-12T17:52:39.868837+0000","last_became_peered":"2024-09-12T17:52:39.868837+0000","last_unstale":"2024-09-12T19:30:19.476597+0000","last_undegraded":"2024-09-12T19:30:19.476597+0000","last_fullsized":"2024-09-12T19:30:19.476597+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T19:30:19.476149+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T19:30:19.476149+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.476149+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:37.829486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":83,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:55.218466+0000","last_change":"2024-09-12T19:30:55.218466+0000","last_active":"2024-09-12T19:30:55.218466+0000","last_peered":"2024-09-12T19:30:55.218466+0000","last_clean":"2024-09-12T19:30:55.218466+0000","last_became_active":"2024-09-12T18:25:52.611546+0000","last_became_peered":"2024-09-12T18:25:52.611546+0000","last_unstale":"2024-09-12T19:30:55.218466+0000","last_undegraded":"2024-09-12T19:30:55.218466+0000","last_fullsized":"2024-09-12T19:30:55.218466+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:55.218202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:55.218202+0000","last_clean_scrub_stamp":"2024-09-12T19:30:55.218202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:03.459203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"265'7","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:48.248821+0000","last_change":"2024-09-12T19:30:48.248821+0000","last_active":"2024-09-12T19:30:48.248821+0000","last_peered":"2024-09-12T19:30:48.248821+0000","last_clean":"2024-09-12T19:30:48.248821+0000","last_became_active":"2024-09-12T17:58:47.245441+0000","last_became_peered":"2024-09-12T17:58:47.245441+0000","last_unstale":"2024-09-12T19:30:48.248821+0000","last_undegraded":"2024-09-12T19:30:48.248821+0000","last_fullsized":"2024-09-12T19:30:48.248821+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:48.248577+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:48.248577+0000","last_clean_scrub_stamp":"2024-09-12T19:30:48.248577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:23.216197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'7","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:43.267676+0000","last_change":"2024-09-12T19:30:43.267676+0000","last_active":"2024-09-12T19:30:43.267676+0000","last_peered":"2024-09-12T19:30:43.267676+0000","last_clean":"2024-09-12T19:30:43.267676+0000","last_became_active":"2024-09-12T17:58:40.191999+0000","last_became_peered":"2024-09-12T17:58:40.191999+0000","last_unstale":"2024-09-12T19:30:43.267676+0000","last_undegraded":"2024-09-12T19:30:43.267676+0000","last_fullsized":"2024-09-12T19:30:43.267676+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:30:43.267489+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:30:43.267489+0000","last_clean_scrub_stamp":"2024-09-12T19:30:43.267489+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:49.617074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'36","reported_seq":181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.143137+0000","last_change":"2024-09-12T19:30:16.142894+0000","last_active":"2024-09-12T19:30:16.143137+0000","last_peered":"2024-09-12T19:30:16.143137+0000","last_clean":"2024-09-12T19:30:16.143137+0000","last_became_active":"2024-09-12T17:52:39.890678+0000","last_became_peered":"2024-09-12T17:52:39.890678+0000","last_unstale":"2024-09-12T19:30:16.143137+0000","last_undegraded":"2024-09-12T19:30:16.143137+0000","last_fullsized":"2024-09-12T19:30:16.143137+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'36","last_scrub_stamp":"2024-09-12T19:30:16.142621+0000","last_deep_scrub":"265'36","last_deep_scrub_stamp":"2024-09-12T19:30:16.142621+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.142621+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:52.794048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:37.143338+0000","last_change":"2024-09-12T19:30:37.143201+0000","last_active":"2024-09-12T19:30:37.143338+0000","last_peered":"2024-09-12T19:30:37.143338+0000","last_clean":"2024-09-12T19:30:37.143338+0000","last_became_active":"2024-09-12T18:25:52.611397+0000","last_became_peered":"2024-09-12T18:25:52.611397+0000","last_unstale":"2024-09-12T19:30:37.143338+0000","last_undegraded":"2024-09-12T19:30:37.143338+0000","last_fullsized":"2024-09-12T19:30:37.143338+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:37.143014+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:37.143014+0000","last_clean_scrub_stamp":"2024-09-12T19:30:37.143014+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:19.539816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:32.925907+0000","last_change":"2024-09-12T19:30:32.925907+0000","last_active":"2024-09-12T19:30:32.925907+0000","last_peered":"2024-09-12T19:30:32.925907+0000","last_clean":"2024-09-12T19:30:32.925907+0000","last_became_active":"2024-09-12T17:58:47.240951+0000","last_became_peered":"2024-09-12T17:58:47.240951+0000","last_unstale":"2024-09-12T19:30:32.925907+0000","last_undegraded":"2024-09-12T19:30:32.925907+0000","last_fullsized":"2024-09-12T19:30:32.925907+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:32.925725+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:32.925725+0000","last_clean_scrub_stamp":"2024-09-12T19:30:32.925725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:27.896521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.479056+0000","last_change":"2024-09-12T19:30:20.478912+0000","last_active":"2024-09-12T19:30:20.479056+0000","last_peered":"2024-09-12T19:30:20.479056+0000","last_clean":"2024-09-12T19:30:20.479056+0000","last_became_active":"2024-09-12T17:58:40.211891+0000","last_became_peered":"2024-09-12T17:58:40.211891+0000","last_unstale":"2024-09-12T19:30:20.479056+0000","last_undegraded":"2024-09-12T19:30:20.479056+0000","last_fullsized":"2024-09-12T19:30:20.479056+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:20.478718+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:20.478718+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.478718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:47.734936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'53","reported_seq":234,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.479256+0000","last_change":"2024-09-12T19:30:18.479087+0000","last_active":"2024-09-12T19:30:18.479256+0000","last_peered":"2024-09-12T19:30:18.479256+0000","last_clean":"2024-09-12T19:30:18.479256+0000","last_became_active":"2024-09-12T17:52:39.878694+0000","last_became_peered":"2024-09-12T17:52:39.878694+0000","last_unstale":"2024-09-12T19:30:18.479256+0000","last_undegraded":"2024-09-12T19:30:18.479256+0000","last_fullsized":"2024-09-12T19:30:18.479256+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'53","last_scrub_stamp":"2024-09-12T19:30:18.478904+0000","last_deep_scrub":"265'53","last_deep_scrub_stamp":"2024-09-12T19:30:18.478904+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.478904+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:35.429667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":199,"num_write":92,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.905574+0000","last_change":"2024-09-12T19:30:31.905412+0000","last_active":"2024-09-12T19:30:31.905574+0000","last_peered":"2024-09-12T19:30:31.905574+0000","last_clean":"2024-09-12T19:30:31.905574+0000","last_became_active":"2024-09-12T18:25:52.619540+0000","last_became_peered":"2024-09-12T18:25:52.619540+0000","last_unstale":"2024-09-12T19:30:31.905574+0000","last_undegraded":"2024-09-12T19:30:31.905574+0000","last_fullsized":"2024-09-12T19:30:31.905574+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:31.905231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:31.905231+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.905231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:40.276729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:47.267497+0000","last_change":"2024-09-12T19:30:47.267497+0000","last_active":"2024-09-12T19:30:47.267497+0000","last_peered":"2024-09-12T19:30:47.267497+0000","last_clean":"2024-09-12T19:30:47.267497+0000","last_became_active":"2024-09-12T17:58:47.238232+0000","last_became_peered":"2024-09-12T17:58:47.238232+0000","last_unstale":"2024-09-12T19:30:47.267497+0000","last_undegraded":"2024-09-12T19:30:47.267497+0000","last_fullsized":"2024-09-12T19:30:47.267497+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:47.267234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:47.267234+0000","last_clean_scrub_stamp":"2024-09-12T19:30:47.267234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:50.793543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"262'7","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:41.215775+0000","last_change":"2024-09-12T19:30:41.215775+0000","last_active":"2024-09-12T19:30:41.215775+0000","last_peered":"2024-09-12T19:30:41.215775+0000","last_clean":"2024-09-12T19:30:41.215775+0000","last_became_active":"2024-09-12T17:58:40.197815+0000","last_became_peered":"2024-09-12T17:58:40.197815+0000","last_unstale":"2024-09-12T19:30:41.215775+0000","last_undegraded":"2024-09-12T19:30:41.215775+0000","last_fullsized":"2024-09-12T19:30:41.215775+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T19:30:41.215580+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T19:30:41.215580+0000","last_clean_scrub_stamp":"2024-09-12T19:30:41.215580+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:04.960522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'72","reported_seq":282,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:36.304369+0000","last_change":"2024-09-12T19:30:36.304369+0000","last_active":"2024-09-12T19:30:36.304369+0000","last_peered":"2024-09-12T19:30:36.304369+0000","last_clean":"2024-09-12T19:30:36.304369+0000","last_became_active":"2024-09-12T17:52:39.872148+0000","last_became_peered":"2024-09-12T17:52:39.872148+0000","last_unstale":"2024-09-12T19:30:36.304369+0000","last_undegraded":"2024-09-12T19:30:36.304369+0000","last_fullsized":"2024-09-12T19:30:36.304369+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'72","last_scrub_stamp":"2024-09-12T19:30:36.304121+0000","last_deep_scrub":"265'72","last_deep_scrub_stamp":"2024-09-12T19:30:36.304121+0000","last_clean_scrub_stamp":"2024-09-12T19:30:36.304121+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.696522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":261,"num_write":116,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:41.861535+0000","last_change":"2024-09-12T19:30:41.861535+0000","last_active":"2024-09-12T19:30:41.861535+0000","last_peered":"2024-09-12T19:30:41.861535+0000","last_clean":"2024-09-12T19:30:41.861535+0000","last_became_active":"2024-09-12T18:25:52.623635+0000","last_became_peered":"2024-09-12T18:25:52.623635+0000","last_unstale":"2024-09-12T19:30:41.861535+0000","last_undegraded":"2024-09-12T19:30:41.861535+0000","last_fullsized":"2024-09-12T19:30:41.861535+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:41.861339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:41.861339+0000","last_clean_scrub_stamp":"2024-09-12T19:30:41.861339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:56.500759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"265'9","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.469622+0000","last_change":"2024-09-12T19:30:25.469335+0000","last_active":"2024-09-12T19:30:25.469622+0000","last_peered":"2024-09-12T19:30:25.469622+0000","last_clean":"2024-09-12T19:30:25.469622+0000","last_became_active":"2024-09-12T17:58:47.250762+0000","last_became_peered":"2024-09-12T17:58:47.250762+0000","last_unstale":"2024-09-12T19:30:25.469622+0000","last_undegraded":"2024-09-12T19:30:25.469622+0000","last_fullsized":"2024-09-12T19:30:25.469622+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T19:30:25.469089+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T19:30:25.469089+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.469089+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:31.683645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9216,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.511211+0000","last_change":"2024-09-12T19:30:24.511211+0000","last_active":"2024-09-12T19:30:24.511211+0000","last_peered":"2024-09-12T19:30:24.511211+0000","last_clean":"2024-09-12T19:30:24.511211+0000","last_became_active":"2024-09-12T17:58:40.210072+0000","last_became_peered":"2024-09-12T17:58:40.210072+0000","last_unstale":"2024-09-12T19:30:24.511211+0000","last_undegraded":"2024-09-12T19:30:24.511211+0000","last_fullsized":"2024-09-12T19:30:24.511211+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:24.511036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:24.511036+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.511036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:53.909940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'26","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:35.294009+0000","last_change":"2024-09-12T19:30:35.293869+0000","last_active":"2024-09-12T19:30:35.294009+0000","last_peered":"2024-09-12T19:30:35.294009+0000","last_clean":"2024-09-12T19:30:35.294009+0000","last_became_active":"2024-09-12T17:52:39.871247+0000","last_became_peered":"2024-09-12T17:52:39.871247+0000","last_unstale":"2024-09-12T19:30:35.294009+0000","last_undegraded":"2024-09-12T19:30:35.294009+0000","last_fullsized":"2024-09-12T19:30:35.294009+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'26","last_scrub_stamp":"2024-09-12T19:30:35.293683+0000","last_deep_scrub":"265'26","last_deep_scrub_stamp":"2024-09-12T19:30:35.293683+0000","last_clean_scrub_stamp":"2024-09-12T19:30:35.293683+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:25.730685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":94,"num_write":46,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:53.230938+0000","last_change":"2024-09-12T19:30:53.230938+0000","last_active":"2024-09-12T19:30:53.230938+0000","last_peered":"2024-09-12T19:30:53.230938+0000","last_clean":"2024-09-12T19:30:53.230938+0000","last_became_active":"2024-09-12T18:25:52.621808+0000","last_became_peered":"2024-09-12T18:25:52.621808+0000","last_unstale":"2024-09-12T19:30:53.230938+0000","last_undegraded":"2024-09-12T19:30:53.230938+0000","last_fullsized":"2024-09-12T19:30:53.230938+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:53.230752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:53.230752+0000","last_clean_scrub_stamp":"2024-09-12T19:30:53.230752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:41.373986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"265'2","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.477805+0000","last_change":"2024-09-12T19:30:24.477589+0000","last_active":"2024-09-12T19:30:24.477805+0000","last_peered":"2024-09-12T19:30:24.477805+0000","last_clean":"2024-09-12T19:30:24.477805+0000","last_became_active":"2024-09-12T17:58:47.236237+0000","last_became_peered":"2024-09-12T17:58:47.236237+0000","last_unstale":"2024-09-12T19:30:24.477805+0000","last_undegraded":"2024-09-12T19:30:24.477805+0000","last_fullsized":"2024-09-12T19:30:24.477805+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:24.477402+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:24.477402+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.477402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:07.709944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'8","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.783282+0000","last_change":"2024-09-12T19:30:20.783282+0000","last_active":"2024-09-12T19:30:20.783282+0000","last_peered":"2024-09-12T19:30:20.783282+0000","last_clean":"2024-09-12T19:30:20.783282+0000","last_became_active":"2024-09-12T17:58:40.207179+0000","last_became_peered":"2024-09-12T17:58:40.207179+0000","last_unstale":"2024-09-12T19:30:20.783282+0000","last_undegraded":"2024-09-12T19:30:20.783282+0000","last_fullsized":"2024-09-12T19:30:20.783282+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:30:20.783056+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:30:20.783056+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.783056+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:48.399945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'9","reported_seq":110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.423474+0000","last_change":"2024-09-12T19:30:13.423335+0000","last_active":"2024-09-12T19:30:13.423474+0000","last_peered":"2024-09-12T19:30:13.423474+0000","last_clean":"2024-09-12T19:30:13.423474+0000","last_became_active":"2024-09-12T17:52:39.883782+0000","last_became_peered":"2024-09-12T17:52:39.883782+0000","last_unstale":"2024-09-12T19:30:13.423474+0000","last_undegraded":"2024-09-12T19:30:13.423474+0000","last_fullsized":"2024-09-12T19:30:13.423474+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T19:30:13.423150+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T19:30:13.423150+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.423150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:09.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'340","reported_seq":1127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.400263+0000","last_change":"2024-09-12T19:29:55.399985+0000","last_active":"2024-09-12T19:29:55.400263+0000","last_peered":"2024-09-12T19:29:55.400263+0000","last_clean":"2024-09-12T19:29:55.400263+0000","last_became_active":"2024-09-12T17:36:34.874529+0000","last_became_peered":"2024-09-12T17:36:34.874529+0000","last_unstale":"2024-09-12T19:29:55.400263+0000","last_undegraded":"2024-09-12T19:29:55.400263+0000","last_fullsized":"2024-09-12T19:29:55.400263+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T19:29:55.399703+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T19:29:55.399703+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.399703+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:53.827613+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424460,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":579,"num_read_kb":47675,"num_write":1041,"num_write_kb":57869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'949","reported_seq":2628,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.911343+0000","last_change":"2024-09-12T19:29:59.911343+0000","last_active":"2024-09-12T19:29:59.911343+0000","last_peered":"2024-09-12T19:29:59.911343+0000","last_clean":"2024-09-12T19:29:59.911343+0000","last_became_active":"2024-09-12T17:36:36.881586+0000","last_became_peered":"2024-09-12T17:36:36.881586+0000","last_unstale":"2024-09-12T19:29:59.911343+0000","last_undegraded":"2024-09-12T19:29:59.911343+0000","last_fullsized":"2024-09-12T19:29:59.911343+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'949","last_scrub_stamp":"2024-09-12T19:29:59.911151+0000","last_deep_scrub":"265'949","last_deep_scrub_stamp":"2024-09-12T19:29:59.911151+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.911151+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:42.321351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4539,"num_read_kb":4030,"num_write":1302,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'367","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.972155+0000","last_change":"2024-09-12T19:30:00.972021+0000","last_active":"2024-09-12T19:30:00.972155+0000","last_peered":"2024-09-12T19:30:00.972155+0000","last_clean":"2024-09-12T19:30:00.972155+0000","last_became_active":"2024-09-12T17:36:34.886040+0000","last_became_peered":"2024-09-12T17:36:34.886040+0000","last_unstale":"2024-09-12T19:30:00.972155+0000","last_undegraded":"2024-09-12T19:30:00.972155+0000","last_fullsized":"2024-09-12T19:30:00.972155+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T19:30:00.971806+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T19:30:00.971806+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.971806+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:45.651742+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1749425,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":512,"num_read_kb":42124,"num_write":1111,"num_write_kb":49494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'797","reported_seq":2325,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.171881+0000","last_change":"2024-09-12T19:30:13.171881+0000","last_active":"2024-09-12T19:30:13.171881+0000","last_peered":"2024-09-12T19:30:13.171881+0000","last_clean":"2024-09-12T19:30:13.171881+0000","last_became_active":"2024-09-12T17:36:36.875285+0000","last_became_peered":"2024-09-12T17:36:36.875285+0000","last_unstale":"2024-09-12T19:30:13.171881+0000","last_undegraded":"2024-09-12T19:30:13.171881+0000","last_fullsized":"2024-09-12T19:30:13.171881+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'797","last_scrub_stamp":"2024-09-12T19:30:13.171686+0000","last_deep_scrub":"265'797","last_deep_scrub_stamp":"2024-09-12T19:30:13.171686+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.171686+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:53.547645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3836,"num_read_kb":3465,"num_write":1049,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'352","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.962171+0000","last_change":"2024-09-12T19:29:59.961930+0000","last_active":"2024-09-12T19:29:59.962171+0000","last_peered":"2024-09-12T19:29:59.962171+0000","last_clean":"2024-09-12T19:29:59.962171+0000","last_became_active":"2024-09-12T17:36:34.871993+0000","last_became_peered":"2024-09-12T17:36:34.871993+0000","last_unstale":"2024-09-12T19:29:59.962171+0000","last_undegraded":"2024-09-12T19:29:59.962171+0000","last_fullsized":"2024-09-12T19:29:59.962171+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:29:59.961681+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:29:59.961681+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.961681+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:19.644655+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":16153,"num_write":1071,"num_write_kb":33332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'912","reported_seq":2457,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.178935+0000","last_change":"2024-09-12T19:30:11.178935+0000","last_active":"2024-09-12T19:30:11.178935+0000","last_peered":"2024-09-12T19:30:11.178935+0000","last_clean":"2024-09-12T19:30:11.178935+0000","last_became_active":"2024-09-12T17:36:36.883008+0000","last_became_peered":"2024-09-12T17:36:36.883008+0000","last_unstale":"2024-09-12T19:30:11.178935+0000","last_undegraded":"2024-09-12T19:30:11.178935+0000","last_fullsized":"2024-09-12T19:30:11.178935+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'912","last_scrub_stamp":"2024-09-12T19:30:11.178746+0000","last_deep_scrub":"265'912","last_deep_scrub_stamp":"2024-09-12T19:30:11.178746+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.178746+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:42.625052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4392,"num_read_kb":3928,"num_write":1272,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2263,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'362","reported_seq":1058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.324981+0000","last_change":"2024-09-12T19:29:54.324843+0000","last_active":"2024-09-12T19:29:54.324981+0000","last_peered":"2024-09-12T19:29:54.324981+0000","last_clean":"2024-09-12T19:29:54.324981+0000","last_became_active":"2024-09-12T17:36:34.871414+0000","last_became_peered":"2024-09-12T17:36:34.871414+0000","last_unstale":"2024-09-12T19:29:54.324981+0000","last_undegraded":"2024-09-12T19:29:54.324981+0000","last_fullsized":"2024-09-12T19:29:54.324981+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T19:29:54.324634+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T19:29:54.324634+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.324634+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:16.548675+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":504,"num_read_kb":53693,"num_write":1108,"num_write_kb":40210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'837","reported_seq":2351,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.887607+0000","last_change":"2024-09-12T19:30:02.887607+0000","last_active":"2024-09-12T19:30:02.887607+0000","last_peered":"2024-09-12T19:30:02.887607+0000","last_clean":"2024-09-12T19:30:02.887607+0000","last_became_active":"2024-09-12T17:36:36.902241+0000","last_became_peered":"2024-09-12T17:36:36.902241+0000","last_unstale":"2024-09-12T19:30:02.887607+0000","last_undegraded":"2024-09-12T19:30:02.887607+0000","last_fullsized":"2024-09-12T19:30:02.887607+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'837","last_scrub_stamp":"2024-09-12T19:30:02.887424+0000","last_deep_scrub":"265'837","last_deep_scrub_stamp":"2024-09-12T19:30:02.887424+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.887424+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:23.336621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3905,"num_read_kb":3484,"num_write":1127,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'353","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.348805+0000","last_change":"2024-09-12T19:29:53.348805+0000","last_active":"2024-09-12T19:29:53.348805+0000","last_peered":"2024-09-12T19:29:53.348805+0000","last_clean":"2024-09-12T19:29:53.348805+0000","last_became_active":"2024-09-12T17:36:34.890281+0000","last_became_peered":"2024-09-12T17:36:34.890281+0000","last_unstale":"2024-09-12T19:29:53.348805+0000","last_undegraded":"2024-09-12T19:29:53.348805+0000","last_fullsized":"2024-09-12T19:29:53.348805+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T19:29:53.348577+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T19:29:53.348577+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.348577+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:20.759997+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":533,"num_read_kb":3791,"num_write":1159,"num_write_kb":30376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'485","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.382102+0000","last_change":"2024-09-12T19:30:00.381971+0000","last_active":"2024-09-12T19:30:00.382102+0000","last_peered":"2024-09-12T19:30:00.382102+0000","last_clean":"2024-09-12T19:30:00.382102+0000","last_became_active":"2024-09-12T17:36:36.899249+0000","last_became_peered":"2024-09-12T17:36:36.899249+0000","last_unstale":"2024-09-12T19:30:00.382102+0000","last_undegraded":"2024-09-12T19:30:00.382102+0000","last_fullsized":"2024-09-12T19:30:00.382102+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'485","last_scrub_stamp":"2024-09-12T19:30:00.381780+0000","last_deep_scrub":"265'485","last_deep_scrub_stamp":"2024-09-12T19:30:00.381780+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.381780+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:44.920189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2730,"num_read_kb":2583,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":918,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'378","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.372662+0000","last_change":"2024-09-12T19:29:51.372662+0000","last_active":"2024-09-12T19:29:51.372662+0000","last_peered":"2024-09-12T19:29:51.372662+0000","last_clean":"2024-09-12T19:29:51.372662+0000","last_became_active":"2024-09-12T17:36:34.870994+0000","last_became_peered":"2024-09-12T17:36:34.870994+0000","last_unstale":"2024-09-12T19:29:51.372662+0000","last_undegraded":"2024-09-12T19:29:51.372662+0000","last_fullsized":"2024-09-12T19:29:51.372662+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:29:51.372428+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:29:51.372428+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.372428+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:45.220775+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526411,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":2344,"num_write":1206,"num_write_kb":29584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'377","reported_seq":1837,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.408879+0000","last_change":"2024-09-12T19:30:01.408879+0000","last_active":"2024-09-12T19:30:01.408879+0000","last_peered":"2024-09-12T19:30:01.408879+0000","last_clean":"2024-09-12T19:30:01.408879+0000","last_became_active":"2024-09-12T17:36:36.897609+0000","last_became_peered":"2024-09-12T17:36:36.897609+0000","last_unstale":"2024-09-12T19:30:01.408879+0000","last_undegraded":"2024-09-12T19:30:01.408879+0000","last_fullsized":"2024-09-12T19:30:01.408879+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:30:01.408689+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:30:01.408689+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.408689+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:12.740346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2010,"num_read_kb":1904,"num_write":440,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'357","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.390280+0000","last_change":"2024-09-12T19:29:52.390280+0000","last_active":"2024-09-12T19:29:52.390280+0000","last_peered":"2024-09-12T19:29:52.390280+0000","last_clean":"2024-09-12T19:29:52.390280+0000","last_became_active":"2024-09-12T17:36:34.859023+0000","last_became_peered":"2024-09-12T17:36:34.859023+0000","last_unstale":"2024-09-12T19:29:52.390280+0000","last_undegraded":"2024-09-12T19:29:52.390280+0000","last_fullsized":"2024-09-12T19:29:52.390280+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'357","last_scrub_stamp":"2024-09-12T19:29:52.390106+0000","last_deep_scrub":"265'357","last_deep_scrub_stamp":"2024-09-12T19:29:52.390106+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.390106+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:22.736379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136901,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1894,"num_write":1220,"num_write_kb":19389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"265'837","reported_seq":2386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.416629+0000","last_change":"2024-09-12T19:30:01.416629+0000","last_active":"2024-09-12T19:30:01.416629+0000","last_peered":"2024-09-12T19:30:01.416629+0000","last_clean":"2024-09-12T19:30:01.416629+0000","last_became_active":"2024-09-12T17:36:36.914366+0000","last_became_peered":"2024-09-12T17:36:36.914366+0000","last_unstale":"2024-09-12T19:30:01.416629+0000","last_undegraded":"2024-09-12T19:30:01.416629+0000","last_fullsized":"2024-09-12T19:30:01.416629+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'837","last_scrub_stamp":"2024-09-12T19:30:01.416434+0000","last_deep_scrub":"265'837","last_deep_scrub_stamp":"2024-09-12T19:30:01.416434+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.416434+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:32.496350+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4038,"num_read_kb":3626,"num_write":1143,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'347","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.927870+0000","last_change":"2024-09-12T19:29:58.927870+0000","last_active":"2024-09-12T19:29:58.927870+0000","last_peered":"2024-09-12T19:29:58.927870+0000","last_clean":"2024-09-12T19:29:58.927870+0000","last_became_active":"2024-09-12T17:36:34.882704+0000","last_became_peered":"2024-09-12T17:36:34.882704+0000","last_unstale":"2024-09-12T19:29:58.927870+0000","last_undegraded":"2024-09-12T19:29:58.927870+0000","last_fullsized":"2024-09-12T19:29:58.927870+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:29:58.927579+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:29:58.927579+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.927579+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:30.908682+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2535846,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":64003,"num_write":1113,"num_write_kb":46422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'1169","reported_seq":2746,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.807102+0000","last_change":"2024-09-12T19:30:10.807102+0000","last_active":"2024-09-12T19:30:10.807102+0000","last_peered":"2024-09-12T19:30:10.807102+0000","last_clean":"2024-09-12T19:30:10.807102+0000","last_became_active":"2024-09-12T17:36:36.888829+0000","last_became_peered":"2024-09-12T17:36:36.888829+0000","last_unstale":"2024-09-12T19:30:10.807102+0000","last_undegraded":"2024-09-12T19:30:10.807102+0000","last_fullsized":"2024-09-12T19:30:10.807102+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1169","last_scrub_stamp":"2024-09-12T19:30:10.806912+0000","last_deep_scrub":"265'1169","last_deep_scrub_stamp":"2024-09-12T19:30:10.806912+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.806912+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":1100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:19.923756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5211,"num_read_kb":4613,"num_write":1589,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'496","reported_seq":2232,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.149928+0000","last_change":"2024-09-12T19:30:12.149795+0000","last_active":"2024-09-12T19:30:12.149928+0000","last_peered":"2024-09-12T19:30:12.149928+0000","last_clean":"2024-09-12T19:30:12.149928+0000","last_became_active":"2024-09-12T17:36:36.904820+0000","last_became_peered":"2024-09-12T17:36:36.904820+0000","last_unstale":"2024-09-12T19:30:12.149928+0000","last_undegraded":"2024-09-12T19:30:12.149928+0000","last_fullsized":"2024-09-12T19:30:12.149928+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'496","last_scrub_stamp":"2024-09-12T19:30:12.149611+0000","last_deep_scrub":"265'496","last_deep_scrub_stamp":"2024-09-12T19:30:12.149611+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.149611+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:58.293186+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2913,"num_read_kb":2753,"num_write":585,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'374","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.902145+0000","last_change":"2024-09-12T19:29:51.902000+0000","last_active":"2024-09-12T19:29:51.902145+0000","last_peered":"2024-09-12T19:29:51.902145+0000","last_clean":"2024-09-12T19:29:51.902145+0000","last_became_active":"2024-09-12T17:36:34.866283+0000","last_became_peered":"2024-09-12T17:36:34.866283+0000","last_unstale":"2024-09-12T19:29:51.902145+0000","last_undegraded":"2024-09-12T19:29:51.902145+0000","last_fullsized":"2024-09-12T19:29:51.902145+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T19:29:51.901740+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T19:29:51.901740+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.901740+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:07.400270+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":73276,"num_write":1099,"num_write_kb":24135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'481","reported_seq":2105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.336997+0000","last_change":"2024-09-12T19:29:58.336855+0000","last_active":"2024-09-12T19:29:58.336997+0000","last_peered":"2024-09-12T19:29:58.336997+0000","last_clean":"2024-09-12T19:29:58.336997+0000","last_became_active":"2024-09-12T17:36:36.911310+0000","last_became_peered":"2024-09-12T17:36:36.911310+0000","last_unstale":"2024-09-12T19:29:58.336997+0000","last_undegraded":"2024-09-12T19:29:58.336997+0000","last_fullsized":"2024-09-12T19:29:58.336997+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'481","last_scrub_stamp":"2024-09-12T19:29:58.336665+0000","last_deep_scrub":"265'481","last_deep_scrub_stamp":"2024-09-12T19:29:58.336665+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.336665+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:39.578088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2526,"num_read_kb":2384,"num_write":531,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'354","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.369482+0000","last_change":"2024-09-12T19:29:50.369352+0000","last_active":"2024-09-12T19:29:50.369482+0000","last_peered":"2024-09-12T19:29:50.369482+0000","last_clean":"2024-09-12T19:29:50.369482+0000","last_became_active":"2024-09-12T17:36:34.865119+0000","last_became_peered":"2024-09-12T17:36:34.865119+0000","last_unstale":"2024-09-12T19:29:50.369482+0000","last_undegraded":"2024-09-12T19:29:50.369482+0000","last_fullsized":"2024-09-12T19:29:50.369482+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T19:29:50.369148+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T19:29:50.369148+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.369148+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:22.772611+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109517,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":573,"num_read_kb":7316,"num_write":1055,"num_write_kb":28671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'739","reported_seq":2238,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.837232+0000","last_change":"2024-09-12T19:29:57.837232+0000","last_active":"2024-09-12T19:29:57.837232+0000","last_peered":"2024-09-12T19:29:57.837232+0000","last_clean":"2024-09-12T19:29:57.837232+0000","last_became_active":"2024-09-12T17:36:36.885876+0000","last_became_peered":"2024-09-12T17:36:36.885876+0000","last_unstale":"2024-09-12T19:29:57.837232+0000","last_undegraded":"2024-09-12T19:29:57.837232+0000","last_fullsized":"2024-09-12T19:29:57.837232+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'739","last_scrub_stamp":"2024-09-12T19:29:57.837032+0000","last_deep_scrub":"265'739","last_deep_scrub_stamp":"2024-09-12T19:29:57.837032+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.837032+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:40.240565+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3432,"num_read_kb":3117,"num_write":958,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1010,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'391","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.371378+0000","last_change":"2024-09-12T19:29:54.371239+0000","last_active":"2024-09-12T19:29:54.371378+0000","last_peered":"2024-09-12T19:29:54.371378+0000","last_clean":"2024-09-12T19:29:54.371378+0000","last_became_active":"2024-09-12T17:36:34.873456+0000","last_became_peered":"2024-09-12T17:36:34.873456+0000","last_unstale":"2024-09-12T19:29:54.371378+0000","last_undegraded":"2024-09-12T19:29:54.371378+0000","last_fullsized":"2024-09-12T19:29:54.371378+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:29:54.371023+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:29:54.371023+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.371023+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:54.568742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":11973,"num_write":1244,"num_write_kb":23205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'621","reported_seq":2316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.478518+0000","last_change":"2024-09-12T19:29:59.478221+0000","last_active":"2024-09-12T19:29:59.478518+0000","last_peered":"2024-09-12T19:29:59.478518+0000","last_clean":"2024-09-12T19:29:59.478518+0000","last_became_active":"2024-09-12T17:36:36.899850+0000","last_became_peered":"2024-09-12T17:36:36.899850+0000","last_unstale":"2024-09-12T19:29:59.478518+0000","last_undegraded":"2024-09-12T19:29:59.478518+0000","last_fullsized":"2024-09-12T19:29:59.478518+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'621","last_scrub_stamp":"2024-09-12T19:29:59.477997+0000","last_deep_scrub":"265'621","last_deep_scrub_stamp":"2024-09-12T19:29:59.477997+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.477997+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":600,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:01.602724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3224,"num_read_kb":2959,"num_write":847,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'342","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.452941+0000","last_change":"2024-09-12T19:29:48.452837+0000","last_active":"2024-09-12T19:29:48.452941+0000","last_peered":"2024-09-12T19:29:48.452941+0000","last_clean":"2024-09-12T19:29:48.452941+0000","last_became_active":"2024-09-12T17:36:34.864547+0000","last_became_peered":"2024-09-12T17:36:34.864547+0000","last_unstale":"2024-09-12T19:29:48.452941+0000","last_undegraded":"2024-09-12T19:29:48.452941+0000","last_fullsized":"2024-09-12T19:29:48.452941+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:48.452700+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:48.452700+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.452700+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:14.375143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":555,"num_read_kb":20889,"num_write":1050,"num_write_kb":32386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'302","reported_seq":1687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.873251+0000","last_change":"2024-09-12T19:30:07.873070+0000","last_active":"2024-09-12T19:30:07.873251+0000","last_peered":"2024-09-12T19:30:07.873251+0000","last_clean":"2024-09-12T19:30:07.873251+0000","last_became_active":"2024-09-12T17:36:36.873937+0000","last_became_peered":"2024-09-12T17:36:36.873937+0000","last_unstale":"2024-09-12T19:30:07.873251+0000","last_undegraded":"2024-09-12T19:30:07.873251+0000","last_fullsized":"2024-09-12T19:30:07.873251+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-12T19:30:07.872893+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-12T19:30:07.872893+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.872893+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:39.605056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1689,"num_read_kb":1636,"num_write":323,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'377","reported_seq":1149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.359265+0000","last_change":"2024-09-12T19:29:54.358988+0000","last_active":"2024-09-12T19:29:54.359265+0000","last_peered":"2024-09-12T19:29:54.359265+0000","last_clean":"2024-09-12T19:29:54.359265+0000","last_became_active":"2024-09-12T17:36:34.880986+0000","last_became_peered":"2024-09-12T17:36:34.880986+0000","last_unstale":"2024-09-12T19:29:54.359265+0000","last_undegraded":"2024-09-12T19:29:54.359265+0000","last_fullsized":"2024-09-12T19:29:54.359265+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:29:54.358664+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:29:54.358664+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.358664+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:38.007979+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1802093,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":10570,"num_write":1059,"num_write_kb":33432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'405","reported_seq":1902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.869969+0000","last_change":"2024-09-12T19:29:58.869837+0000","last_active":"2024-09-12T19:29:58.869969+0000","last_peered":"2024-09-12T19:29:58.869969+0000","last_clean":"2024-09-12T19:29:58.869969+0000","last_became_active":"2024-09-12T17:36:36.881228+0000","last_became_peered":"2024-09-12T17:36:36.881228+0000","last_unstale":"2024-09-12T19:29:58.869969+0000","last_undegraded":"2024-09-12T19:29:58.869969+0000","last_fullsized":"2024-09-12T19:29:58.869969+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T19:29:58.869637+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T19:29:58.869637+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.869637+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:33.969680+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2076,"num_read_kb":1970,"num_write":455,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'419","reported_seq":1188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.348394+0000","last_change":"2024-09-12T19:29:52.348394+0000","last_active":"2024-09-12T19:29:52.348394+0000","last_peered":"2024-09-12T19:29:52.348394+0000","last_clean":"2024-09-12T19:29:52.348394+0000","last_became_active":"2024-09-12T17:36:34.878377+0000","last_became_peered":"2024-09-12T17:36:34.878377+0000","last_unstale":"2024-09-12T19:29:52.348394+0000","last_undegraded":"2024-09-12T19:29:52.348394+0000","last_fullsized":"2024-09-12T19:29:52.348394+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'419","last_scrub_stamp":"2024-09-12T19:29:52.348210+0000","last_deep_scrub":"265'419","last_deep_scrub_stamp":"2024-09-12T19:29:52.348210+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.348210+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:42.321093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":879,"num_read_kb":13596,"num_write":1342,"num_write_kb":22678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'110","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.513285+0000","last_change":"2024-09-12T19:30:10.513033+0000","last_active":"2024-09-12T19:30:10.513285+0000","last_peered":"2024-09-12T19:30:10.513285+0000","last_clean":"2024-09-12T19:30:10.513285+0000","last_became_active":"2024-09-12T17:36:44.934662+0000","last_became_peered":"2024-09-12T17:36:44.934662+0000","last_unstale":"2024-09-12T19:30:10.513285+0000","last_undegraded":"2024-09-12T19:30:10.513285+0000","last_fullsized":"2024-09-12T19:30:10.513285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T19:30:10.512819+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T19:30:10.512819+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.512819+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:38.028024+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":221,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'641","reported_seq":2298,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.452960+0000","last_change":"2024-09-12T19:30:00.452960+0000","last_active":"2024-09-12T19:30:00.452960+0000","last_peered":"2024-09-12T19:30:00.452960+0000","last_clean":"2024-09-12T19:30:00.452960+0000","last_became_active":"2024-09-12T17:36:36.913372+0000","last_became_peered":"2024-09-12T17:36:36.913372+0000","last_unstale":"2024-09-12T19:30:00.452960+0000","last_undegraded":"2024-09-12T19:30:00.452960+0000","last_fullsized":"2024-09-12T19:30:00.452960+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'641","last_scrub_stamp":"2024-09-12T19:30:00.452763+0000","last_deep_scrub":"265'641","last_deep_scrub_stamp":"2024-09-12T19:30:00.452763+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.452763+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:12.971289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3256,"num_read_kb":2969,"num_write":868,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'399","reported_seq":1086,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.175529+0000","last_change":"2024-09-12T19:29:57.175382+0000","last_active":"2024-09-12T19:29:57.175529+0000","last_peered":"2024-09-12T19:29:57.175529+0000","last_clean":"2024-09-12T19:29:57.175529+0000","last_became_active":"2024-09-12T17:36:34.865894+0000","last_became_peered":"2024-09-12T17:36:34.865894+0000","last_unstale":"2024-09-12T19:29:57.175529+0000","last_undegraded":"2024-09-12T19:29:57.175529+0000","last_fullsized":"2024-09-12T19:29:57.175529+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'399","last_scrub_stamp":"2024-09-12T19:29:57.175150+0000","last_deep_scrub":"265'399","last_deep_scrub_stamp":"2024-09-12T19:29:57.175150+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.175150+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:47.227408+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661307,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":35668,"num_write":1342,"num_write_kb":51737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.213863+0000","last_change":"2024-09-12T19:30:14.213708+0000","last_active":"2024-09-12T19:30:14.213863+0000","last_peered":"2024-09-12T19:30:14.213863+0000","last_clean":"2024-09-12T19:30:14.213863+0000","last_became_active":"2024-09-12T17:36:38.881044+0000","last_became_peered":"2024-09-12T17:36:38.881044+0000","last_unstale":"2024-09-12T19:30:14.213863+0000","last_undegraded":"2024-09-12T19:30:14.213863+0000","last_fullsized":"2024-09-12T19:30:14.213863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:14.213524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:14.213524+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.213524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:07.524096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'390","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.122619+0000","last_change":"2024-09-12T19:30:17.122619+0000","last_active":"2024-09-12T19:30:17.122619+0000","last_peered":"2024-09-12T19:30:17.122619+0000","last_clean":"2024-09-12T19:30:17.122619+0000","last_became_active":"2024-09-12T17:36:40.906825+0000","last_became_peered":"2024-09-12T17:36:40.906825+0000","last_unstale":"2024-09-12T19:30:17.122619+0000","last_undegraded":"2024-09-12T19:30:17.122619+0000","last_fullsized":"2024-09-12T19:30:17.122619+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'390","last_scrub_stamp":"2024-09-12T19:30:17.122329+0000","last_deep_scrub":"265'390","last_deep_scrub_stamp":"2024-09-12T19:30:17.122329+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.122329+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:56.303295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":626,"num_read_kb":1284,"num_write":492,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.821522+0000","last_change":"2024-09-12T19:30:10.821380+0000","last_active":"2024-09-12T19:30:10.821522+0000","last_peered":"2024-09-12T19:30:10.821522+0000","last_clean":"2024-09-12T19:30:10.821522+0000","last_became_active":"2024-09-12T17:36:42.928794+0000","last_became_peered":"2024-09-12T17:36:42.928794+0000","last_unstale":"2024-09-12T19:30:10.821522+0000","last_undegraded":"2024-09-12T19:30:10.821522+0000","last_fullsized":"2024-09-12T19:30:10.821522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:10.821184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:10.821184+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.821184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:24.400244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'171","reported_seq":769,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.716472+0000","last_change":"2024-09-12T19:30:16.716331+0000","last_active":"2024-09-12T19:30:16.716472+0000","last_peered":"2024-09-12T19:30:16.716472+0000","last_clean":"2024-09-12T19:30:16.716472+0000","last_became_active":"2024-09-12T17:36:44.939447+0000","last_became_peered":"2024-09-12T17:36:44.939447+0000","last_unstale":"2024-09-12T19:30:16.716472+0000","last_undegraded":"2024-09-12T19:30:16.716472+0000","last_fullsized":"2024-09-12T19:30:16.716472+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'171","last_scrub_stamp":"2024-09-12T19:30:16.716131+0000","last_deep_scrub":"265'171","last_deep_scrub_stamp":"2024-09-12T19:30:16.716131+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.716131+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:44.650347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":297,"num_read_kb":283,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'452","reported_seq":1955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.174336+0000","last_change":"2024-09-12T19:30:08.174162+0000","last_active":"2024-09-12T19:30:08.174336+0000","last_peered":"2024-09-12T19:30:08.174336+0000","last_clean":"2024-09-12T19:30:08.174336+0000","last_became_active":"2024-09-12T17:36:36.875459+0000","last_became_peered":"2024-09-12T17:36:36.875459+0000","last_unstale":"2024-09-12T19:30:08.174336+0000","last_undegraded":"2024-09-12T19:30:08.174336+0000","last_fullsized":"2024-09-12T19:30:08.174336+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'452","last_scrub_stamp":"2024-09-12T19:30:08.173978+0000","last_deep_scrub":"265'452","last_deep_scrub_stamp":"2024-09-12T19:30:08.173978+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.173978+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:35.958234+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2269,"num_read_kb":2126,"num_write":529,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'324","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.310965+0000","last_change":"2024-09-12T19:29:51.310812+0000","last_active":"2024-09-12T19:29:51.310965+0000","last_peered":"2024-09-12T19:29:51.310965+0000","last_clean":"2024-09-12T19:29:51.310965+0000","last_became_active":"2024-09-12T17:36:34.880644+0000","last_became_peered":"2024-09-12T17:36:34.880644+0000","last_unstale":"2024-09-12T19:29:51.310965+0000","last_undegraded":"2024-09-12T19:29:51.310965+0000","last_fullsized":"2024-09-12T19:29:51.310965+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T19:29:51.310611+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T19:29:51.310611+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.310611+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:42.392409+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174790,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":12215,"num_write":1010,"num_write_kb":18682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.016740+0000","last_change":"2024-09-12T19:30:09.016740+0000","last_active":"2024-09-12T19:30:09.016740+0000","last_peered":"2024-09-12T19:30:09.016740+0000","last_clean":"2024-09-12T19:30:09.016740+0000","last_became_active":"2024-09-12T17:36:38.900684+0000","last_became_peered":"2024-09-12T17:36:38.900684+0000","last_unstale":"2024-09-12T19:30:09.016740+0000","last_undegraded":"2024-09-12T19:30:09.016740+0000","last_fullsized":"2024-09-12T19:30:09.016740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.016556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.016556+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.016556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:47.119691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'129","reported_seq":708,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.854416+0000","last_change":"2024-09-12T19:30:07.854249+0000","last_active":"2024-09-12T19:30:07.854416+0000","last_peered":"2024-09-12T19:30:07.854416+0000","last_clean":"2024-09-12T19:30:07.854416+0000","last_became_active":"2024-09-12T17:36:40.899340+0000","last_became_peered":"2024-09-12T17:36:40.899340+0000","last_unstale":"2024-09-12T19:30:07.854416+0000","last_undegraded":"2024-09-12T19:30:07.854416+0000","last_fullsized":"2024-09-12T19:30:07.854416+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T19:30:07.854053+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T19:30:07.854053+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.854053+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:09.119113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.796542+0000","last_change":"2024-09-12T19:30:13.796389+0000","last_active":"2024-09-12T19:30:13.796542+0000","last_peered":"2024-09-12T19:30:13.796542+0000","last_clean":"2024-09-12T19:30:13.796542+0000","last_became_active":"2024-09-12T17:36:42.932100+0000","last_became_peered":"2024-09-12T17:36:42.932100+0000","last_unstale":"2024-09-12T19:30:13.796542+0000","last_undegraded":"2024-09-12T19:30:13.796542+0000","last_fullsized":"2024-09-12T19:30:13.796542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:13.796195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:13.796195+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.796195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:33.303127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'126","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.388821+0000","last_change":"2024-09-12T19:30:16.388821+0000","last_active":"2024-09-12T19:30:16.388821+0000","last_peered":"2024-09-12T19:30:16.388821+0000","last_clean":"2024-09-12T19:30:16.388821+0000","last_became_active":"2024-09-12T17:36:44.965913+0000","last_became_peered":"2024-09-12T17:36:44.965913+0000","last_unstale":"2024-09-12T19:30:16.388821+0000","last_undegraded":"2024-09-12T19:30:16.388821+0000","last_fullsized":"2024-09-12T19:30:16.388821+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T19:30:16.388633+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T19:30:16.388633+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.388633+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:37.822244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":210,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.952195+0000","last_change":"2024-09-12T19:30:03.952062+0000","last_active":"2024-09-12T19:30:03.952195+0000","last_peered":"2024-09-12T19:30:03.952195+0000","last_clean":"2024-09-12T19:30:03.952195+0000","last_became_active":"2024-09-12T17:36:36.904639+0000","last_became_peered":"2024-09-12T17:36:36.904639+0000","last_unstale":"2024-09-12T19:30:03.952195+0000","last_undegraded":"2024-09-12T19:30:03.952195+0000","last_fullsized":"2024-09-12T19:30:03.952195+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'401","last_scrub_stamp":"2024-09-12T19:30:03.951878+0000","last_deep_scrub":"265'401","last_deep_scrub_stamp":"2024-09-12T19:30:03.951878+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.951878+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:56.567132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2242,"num_read_kb":2124,"num_write":448,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'318","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.175079+0000","last_change":"2024-09-12T19:29:56.174934+0000","last_active":"2024-09-12T19:29:56.175079+0000","last_peered":"2024-09-12T19:29:56.175079+0000","last_clean":"2024-09-12T19:29:56.175079+0000","last_became_active":"2024-09-12T17:36:34.879098+0000","last_became_peered":"2024-09-12T17:36:34.879098+0000","last_unstale":"2024-09-12T19:29:56.175079+0000","last_undegraded":"2024-09-12T19:29:56.175079+0000","last_fullsized":"2024-09-12T19:29:56.175079+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T19:29:56.174676+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T19:29:56.174676+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.174676+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:55.215925+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763036,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":388,"num_read_kb":4507,"num_write":999,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.042906+0000","last_change":"2024-09-12T19:30:10.042772+0000","last_active":"2024-09-12T19:30:10.042906+0000","last_peered":"2024-09-12T19:30:10.042906+0000","last_clean":"2024-09-12T19:30:10.042906+0000","last_became_active":"2024-09-12T17:36:38.883758+0000","last_became_peered":"2024-09-12T17:36:38.883758+0000","last_unstale":"2024-09-12T19:30:10.042906+0000","last_undegraded":"2024-09-12T19:30:10.042906+0000","last_fullsized":"2024-09-12T19:30:10.042906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:10.042594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:10.042594+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.042594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:36.648238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'191","reported_seq":799,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.117856+0000","last_change":"2024-09-12T19:30:16.117856+0000","last_active":"2024-09-12T19:30:16.117856+0000","last_peered":"2024-09-12T19:30:16.117856+0000","last_clean":"2024-09-12T19:30:16.117856+0000","last_became_active":"2024-09-12T17:36:40.907410+0000","last_became_peered":"2024-09-12T17:36:40.907410+0000","last_unstale":"2024-09-12T19:30:16.117856+0000","last_undegraded":"2024-09-12T19:30:16.117856+0000","last_fullsized":"2024-09-12T19:30:16.117856+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-12T19:30:16.117678+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-12T19:30:16.117678+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.117678+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:41.966948+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'806","reported_seq":7130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.120006+0000","last_change":"2024-09-12T19:30:26.120006+0000","last_active":"2024-09-12T19:30:26.120006+0000","last_peered":"2024-09-12T19:30:26.120006+0000","last_clean":"2024-09-12T19:30:26.120006+0000","last_became_active":"2024-09-12T17:36:42.916847+0000","last_became_peered":"2024-09-12T17:36:42.916847+0000","last_unstale":"2024-09-12T19:30:26.120006+0000","last_undegraded":"2024-09-12T19:30:26.120006+0000","last_fullsized":"2024-09-12T19:30:26.120006+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T19:30:26.119806+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T19:30:26.119806+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.119806+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:23.909366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'226","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.455780+0000","last_change":"2024-09-12T19:30:12.455780+0000","last_active":"2024-09-12T19:30:12.455780+0000","last_peered":"2024-09-12T19:30:12.455780+0000","last_clean":"2024-09-12T19:30:12.455780+0000","last_became_active":"2024-09-12T17:36:44.954183+0000","last_became_peered":"2024-09-12T17:36:44.954183+0000","last_unstale":"2024-09-12T19:30:12.455780+0000","last_undegraded":"2024-09-12T19:30:12.455780+0000","last_fullsized":"2024-09-12T19:30:12.455780+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-12T19:30:12.455578+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-12T19:30:12.455578+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.455578+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:03.513982+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":677,"num_write":505,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'460","reported_seq":2151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.958826+0000","last_change":"2024-09-12T19:30:04.958687+0000","last_active":"2024-09-12T19:30:04.958826+0000","last_peered":"2024-09-12T19:30:04.958826+0000","last_clean":"2024-09-12T19:30:04.958826+0000","last_became_active":"2024-09-12T17:36:36.877420+0000","last_became_peered":"2024-09-12T17:36:36.877420+0000","last_unstale":"2024-09-12T19:30:04.958826+0000","last_undegraded":"2024-09-12T19:30:04.958826+0000","last_fullsized":"2024-09-12T19:30:04.958826+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'460","last_scrub_stamp":"2024-09-12T19:30:04.958508+0000","last_deep_scrub":"265'460","last_deep_scrub_stamp":"2024-09-12T19:30:04.958508+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.958508+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:30.786563+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2635,"num_read_kb":2492,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2773,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'364","reported_seq":1083,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.902176+0000","last_change":"2024-09-12T19:29:48.902122+0000","last_active":"2024-09-12T19:29:48.902176+0000","last_peered":"2024-09-12T19:29:48.902176+0000","last_clean":"2024-09-12T19:29:48.902176+0000","last_became_active":"2024-09-12T17:36:34.882902+0000","last_became_peered":"2024-09-12T17:36:34.882902+0000","last_unstale":"2024-09-12T19:29:48.902176+0000","last_undegraded":"2024-09-12T19:29:48.902176+0000","last_fullsized":"2024-09-12T19:29:48.902176+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T19:29:48.902025+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T19:29:48.902025+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.902025+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:07.220628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":587,"num_read_kb":75125,"num_write":1046,"num_write_kb":28457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.186640+0000","last_change":"2024-09-12T19:30:19.186640+0000","last_active":"2024-09-12T19:30:19.186640+0000","last_peered":"2024-09-12T19:30:19.186640+0000","last_clean":"2024-09-12T19:30:19.186640+0000","last_became_active":"2024-09-12T17:36:38.899405+0000","last_became_peered":"2024-09-12T17:36:38.899405+0000","last_unstale":"2024-09-12T19:30:19.186640+0000","last_undegraded":"2024-09-12T19:30:19.186640+0000","last_fullsized":"2024-09-12T19:30:19.186640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:19.186463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:19.186463+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.186463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:31.132651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'342","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.397532+0000","last_change":"2024-09-12T19:30:05.397397+0000","last_active":"2024-09-12T19:30:05.397532+0000","last_peered":"2024-09-12T19:30:05.397532+0000","last_clean":"2024-09-12T19:30:05.397532+0000","last_became_active":"2024-09-12T17:36:40.910700+0000","last_became_peered":"2024-09-12T17:36:40.910700+0000","last_unstale":"2024-09-12T19:30:05.397532+0000","last_undegraded":"2024-09-12T19:30:05.397532+0000","last_fullsized":"2024-09-12T19:30:05.397532+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:30:05.397149+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:30:05.397149+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.397149+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:25.803180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54278,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":1174,"num_write":438,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'800","reported_seq":3165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.823937+0000","last_change":"2024-09-12T19:30:20.823937+0000","last_active":"2024-09-12T19:30:20.823937+0000","last_peered":"2024-09-12T19:30:20.823937+0000","last_clean":"2024-09-12T19:30:20.823937+0000","last_became_active":"2024-09-12T17:36:42.939966+0000","last_became_peered":"2024-09-12T17:36:42.939966+0000","last_unstale":"2024-09-12T19:30:20.823937+0000","last_undegraded":"2024-09-12T19:30:20.823937+0000","last_fullsized":"2024-09-12T19:30:20.823937+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'800","last_scrub_stamp":"2024-09-12T19:30:20.823742+0000","last_deep_scrub":"265'800","last_deep_scrub_stamp":"2024-09-12T19:30:20.823742+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.823742+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:53.933093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'1127","reported_seq":2740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.113469+0000","last_change":"2024-09-12T19:30:06.113469+0000","last_active":"2024-09-12T19:30:06.113469+0000","last_peered":"2024-09-12T19:30:06.113469+0000","last_clean":"2024-09-12T19:30:06.113469+0000","last_became_active":"2024-09-12T17:36:36.886244+0000","last_became_peered":"2024-09-12T17:36:36.886244+0000","last_unstale":"2024-09-12T19:30:06.113469+0000","last_undegraded":"2024-09-12T19:30:06.113469+0000","last_fullsized":"2024-09-12T19:30:06.113469+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1127","last_scrub_stamp":"2024-09-12T19:30:06.113240+0000","last_deep_scrub":"265'1127","last_deep_scrub_stamp":"2024-09-12T19:30:06.113240+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.113240+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":1100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:06.097619+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5270,"num_read_kb":4695,"num_write":1548,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'297","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:46.414341+0000","last_change":"2024-09-12T19:29:46.414341+0000","last_active":"2024-09-12T19:29:46.414341+0000","last_peered":"2024-09-12T19:29:46.414341+0000","last_clean":"2024-09-12T19:29:46.414341+0000","last_became_active":"2024-09-12T17:36:34.865417+0000","last_became_peered":"2024-09-12T17:36:34.865417+0000","last_unstale":"2024-09-12T19:29:46.414341+0000","last_undegraded":"2024-09-12T19:29:46.414341+0000","last_fullsized":"2024-09-12T19:29:46.414341+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'297","last_scrub_stamp":"2024-09-12T19:29:46.414141+0000","last_deep_scrub":"265'297","last_deep_scrub_stamp":"2024-09-12T19:29:46.414141+0000","last_clean_scrub_stamp":"2024-09-12T19:29:46.414141+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.995894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":517,"num_read_kb":1839,"num_write":970,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.875044+0000","last_change":"2024-09-12T19:30:00.875044+0000","last_active":"2024-09-12T19:30:00.875044+0000","last_peered":"2024-09-12T19:30:00.875044+0000","last_clean":"2024-09-12T19:30:00.875044+0000","last_became_active":"2024-09-12T17:36:38.887444+0000","last_became_peered":"2024-09-12T17:36:38.887444+0000","last_unstale":"2024-09-12T19:30:00.875044+0000","last_undegraded":"2024-09-12T19:30:00.875044+0000","last_fullsized":"2024-09-12T19:30:00.875044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:00.874795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:00.874795+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.874795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:17.895761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'456","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.562005+0000","last_change":"2024-09-12T19:30:11.562005+0000","last_active":"2024-09-12T19:30:11.562005+0000","last_peered":"2024-09-12T19:30:11.562005+0000","last_clean":"2024-09-12T19:30:11.562005+0000","last_became_active":"2024-09-12T17:36:40.911095+0000","last_became_peered":"2024-09-12T17:36:40.911095+0000","last_unstale":"2024-09-12T19:30:11.562005+0000","last_undegraded":"2024-09-12T19:30:11.562005+0000","last_fullsized":"2024-09-12T19:30:11.562005+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'456","last_scrub_stamp":"2024-09-12T19:30:11.561804+0000","last_deep_scrub":"265'456","last_deep_scrub_stamp":"2024-09-12T19:30:11.561804+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.561804+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:55.236202+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":738,"num_read_kb":1351,"num_write":556,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.475388+0000","last_change":"2024-09-12T19:30:13.475388+0000","last_active":"2024-09-12T19:30:13.475388+0000","last_peered":"2024-09-12T19:30:13.475388+0000","last_clean":"2024-09-12T19:30:13.475388+0000","last_became_active":"2024-09-12T17:36:42.927582+0000","last_became_peered":"2024-09-12T17:36:42.927582+0000","last_unstale":"2024-09-12T19:30:13.475388+0000","last_undegraded":"2024-09-12T19:30:13.475388+0000","last_fullsized":"2024-09-12T19:30:13.475388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:13.475191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:13.475191+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.475191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:50.478250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'557","reported_seq":1410,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.488049+0000","last_change":"2024-09-12T19:30:16.488049+0000","last_active":"2024-09-12T19:30:16.488049+0000","last_peered":"2024-09-12T19:30:16.488049+0000","last_clean":"2024-09-12T19:30:16.488049+0000","last_became_active":"2024-09-12T17:36:44.953926+0000","last_became_peered":"2024-09-12T17:36:44.953926+0000","last_unstale":"2024-09-12T19:30:16.488049+0000","last_undegraded":"2024-09-12T19:30:16.488049+0000","last_fullsized":"2024-09-12T19:30:16.488049+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'557","last_scrub_stamp":"2024-09-12T19:30:16.487864+0000","last_deep_scrub":"265'557","last_deep_scrub_stamp":"2024-09-12T19:30:16.487864+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.487864+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:14.423016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":1310,"num_write":1167,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'842","reported_seq":2553,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.908148+0000","last_change":"2024-09-12T19:29:52.908148+0000","last_active":"2024-09-12T19:29:52.908148+0000","last_peered":"2024-09-12T19:29:52.908148+0000","last_clean":"2024-09-12T19:29:52.908148+0000","last_became_active":"2024-09-12T17:36:36.886395+0000","last_became_peered":"2024-09-12T17:36:36.886395+0000","last_unstale":"2024-09-12T19:29:52.908148+0000","last_undegraded":"2024-09-12T19:29:52.908148+0000","last_fullsized":"2024-09-12T19:29:52.908148+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'842","last_scrub_stamp":"2024-09-12T19:29:52.907905+0000","last_deep_scrub":"265'842","last_deep_scrub_stamp":"2024-09-12T19:29:52.907905+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.907905+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.987128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4184,"num_read_kb":3783,"num_write":1092,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3245,"num_omap_keys":13,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'376","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.389093+0000","last_change":"2024-09-12T19:29:49.389093+0000","last_active":"2024-09-12T19:29:49.389093+0000","last_peered":"2024-09-12T19:29:49.389093+0000","last_clean":"2024-09-12T19:29:49.389093+0000","last_became_active":"2024-09-12T17:36:34.868465+0000","last_became_peered":"2024-09-12T17:36:34.868465+0000","last_unstale":"2024-09-12T19:29:49.389093+0000","last_undegraded":"2024-09-12T19:29:49.389093+0000","last_fullsized":"2024-09-12T19:29:49.389093+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:29:49.389019+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:29:49.389019+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.389019+0000","objects_scrubbed":8,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:59.981113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109619,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":2937,"num_write":1162,"num_write_kb":21558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"265'4","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.492624+0000","last_change":"2024-09-12T19:30:03.492624+0000","last_active":"2024-09-12T19:30:03.492624+0000","last_peered":"2024-09-12T19:30:03.492624+0000","last_clean":"2024-09-12T19:30:03.492624+0000","last_became_active":"2024-09-12T17:36:38.907007+0000","last_became_peered":"2024-09-12T17:36:38.907007+0000","last_unstale":"2024-09-12T19:30:03.492624+0000","last_undegraded":"2024-09-12T19:30:03.492624+0000","last_fullsized":"2024-09-12T19:30:03.492624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:03.492431+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:03.492431+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.492431+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:04.343424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'332","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.048831+0000","last_change":"2024-09-12T19:30:13.048831+0000","last_active":"2024-09-12T19:30:13.048831+0000","last_peered":"2024-09-12T19:30:13.048831+0000","last_clean":"2024-09-12T19:30:13.048831+0000","last_became_active":"2024-09-12T17:36:40.911092+0000","last_became_peered":"2024-09-12T17:36:40.911092+0000","last_unstale":"2024-09-12T19:30:13.048831+0000","last_undegraded":"2024-09-12T19:30:13.048831+0000","last_fullsized":"2024-09-12T19:30:13.048831+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T19:30:13.048566+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T19:30:13.048566+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.048566+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.100240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1173,"num_write":436,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.012312+0000","last_change":"2024-09-12T19:30:22.012312+0000","last_active":"2024-09-12T19:30:22.012312+0000","last_peered":"2024-09-12T19:30:22.012312+0000","last_clean":"2024-09-12T19:30:22.012312+0000","last_became_active":"2024-09-12T17:36:42.933808+0000","last_became_peered":"2024-09-12T17:36:42.933808+0000","last_unstale":"2024-09-12T19:30:22.012312+0000","last_undegraded":"2024-09-12T19:30:22.012312+0000","last_fullsized":"2024-09-12T19:30:22.012312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.012112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.012112+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.012112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:50.128460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'2434","reported_seq":4304,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.829330+0000","last_change":"2024-09-12T19:30:12.829330+0000","last_active":"2024-09-12T19:30:12.829330+0000","last_peered":"2024-09-12T19:30:12.829330+0000","last_clean":"2024-09-12T19:30:12.829330+0000","last_became_active":"2024-09-12T17:36:44.962630+0000","last_became_peered":"2024-09-12T17:36:44.962630+0000","last_unstale":"2024-09-12T19:30:12.829330+0000","last_undegraded":"2024-09-12T19:30:12.829330+0000","last_fullsized":"2024-09-12T19:30:12.829330+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2434","last_scrub_stamp":"2024-09-12T19:30:12.829115+0000","last_deep_scrub":"265'2434","last_deep_scrub_stamp":"2024-09-12T19:30:12.829115+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.829115+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":2400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:26.992758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6095,"num_read_kb":6091,"num_write":4930,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'435","reported_seq":2069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.391391+0000","last_change":"2024-09-12T19:29:56.391391+0000","last_active":"2024-09-12T19:29:56.391391+0000","last_peered":"2024-09-12T19:29:56.391391+0000","last_clean":"2024-09-12T19:29:56.391391+0000","last_became_active":"2024-09-12T17:36:36.880296+0000","last_became_peered":"2024-09-12T17:36:36.880296+0000","last_unstale":"2024-09-12T19:29:56.391391+0000","last_undegraded":"2024-09-12T19:29:56.391391+0000","last_fullsized":"2024-09-12T19:29:56.391391+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'435","last_scrub_stamp":"2024-09-12T19:29:56.391216+0000","last_deep_scrub":"265'435","last_deep_scrub_stamp":"2024-09-12T19:29:56.391216+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.391216+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:02.997123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2387,"num_read_kb":2259,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'355","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.142105+0000","last_change":"2024-09-12T19:29:55.142105+0000","last_active":"2024-09-12T19:29:55.142105+0000","last_peered":"2024-09-12T19:29:55.142105+0000","last_clean":"2024-09-12T19:29:55.142105+0000","last_became_active":"2024-09-12T17:36:34.868243+0000","last_became_peered":"2024-09-12T17:36:34.868243+0000","last_unstale":"2024-09-12T19:29:55.142105+0000","last_undegraded":"2024-09-12T19:29:55.142105+0000","last_fullsized":"2024-09-12T19:29:55.142105+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T19:29:55.141865+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T19:29:55.141865+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.141865+0000","objects_scrubbed":10,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:28.760677+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":550,"num_read_kb":48255,"num_write":1188,"num_write_kb":33494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.823386+0000","last_change":"2024-09-12T19:30:09.823386+0000","last_active":"2024-09-12T19:30:09.823386+0000","last_peered":"2024-09-12T19:30:09.823386+0000","last_clean":"2024-09-12T19:30:09.823386+0000","last_became_active":"2024-09-12T17:36:38.892804+0000","last_became_peered":"2024-09-12T17:36:38.892804+0000","last_unstale":"2024-09-12T19:30:09.823386+0000","last_undegraded":"2024-09-12T19:30:09.823386+0000","last_fullsized":"2024-09-12T19:30:09.823386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.823197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.823197+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.823197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:59.559731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'408","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:29.200255+0000","last_change":"2024-09-12T19:30:29.200255+0000","last_active":"2024-09-12T19:30:29.200255+0000","last_peered":"2024-09-12T19:30:29.200255+0000","last_clean":"2024-09-12T19:30:29.200255+0000","last_became_active":"2024-09-12T17:36:40.888974+0000","last_became_peered":"2024-09-12T17:36:40.888974+0000","last_unstale":"2024-09-12T19:30:29.200255+0000","last_undegraded":"2024-09-12T19:30:29.200255+0000","last_fullsized":"2024-09-12T19:30:29.200255+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'408","last_scrub_stamp":"2024-09-12T19:30:29.200010+0000","last_deep_scrub":"265'408","last_deep_scrub_stamp":"2024-09-12T19:30:29.200010+0000","last_clean_scrub_stamp":"2024-09-12T19:30:29.200010+0000","objects_scrubbed":9,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:57.438618+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45462,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":644,"num_read_kb":1295,"num_write":508,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'799","reported_seq":3053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.854490+0000","last_change":"2024-09-12T19:30:16.854490+0000","last_active":"2024-09-12T19:30:16.854490+0000","last_peered":"2024-09-12T19:30:16.854490+0000","last_clean":"2024-09-12T19:30:16.854490+0000","last_became_active":"2024-09-12T17:36:42.935529+0000","last_became_peered":"2024-09-12T17:36:42.935529+0000","last_unstale":"2024-09-12T19:30:16.854490+0000","last_undegraded":"2024-09-12T19:30:16.854490+0000","last_fullsized":"2024-09-12T19:30:16.854490+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'799","last_scrub_stamp":"2024-09-12T19:30:16.854280+0000","last_deep_scrub":"265'799","last_deep_scrub_stamp":"2024-09-12T19:30:16.854280+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.854280+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:29.036304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'113","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.423550+0000","last_change":"2024-09-12T19:30:15.423550+0000","last_active":"2024-09-12T19:30:15.423550+0000","last_peered":"2024-09-12T19:30:15.423550+0000","last_clean":"2024-09-12T19:30:15.423550+0000","last_became_active":"2024-09-12T17:36:44.965763+0000","last_became_peered":"2024-09-12T17:36:44.965763+0000","last_unstale":"2024-09-12T19:30:15.423550+0000","last_undegraded":"2024-09-12T19:30:15.423550+0000","last_fullsized":"2024-09-12T19:30:15.423550+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'113","last_scrub_stamp":"2024-09-12T19:30:15.423367+0000","last_deep_scrub":"265'113","last_deep_scrub_stamp":"2024-09-12T19:30:15.423367+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.423367+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:46.072716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":137,"num_write":264,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'415","reported_seq":1907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.921903+0000","last_change":"2024-09-12T19:30:01.921903+0000","last_active":"2024-09-12T19:30:01.921903+0000","last_peered":"2024-09-12T19:30:01.921903+0000","last_clean":"2024-09-12T19:30:01.921903+0000","last_became_active":"2024-09-12T17:36:36.905958+0000","last_became_peered":"2024-09-12T17:36:36.905958+0000","last_unstale":"2024-09-12T19:30:01.921903+0000","last_undegraded":"2024-09-12T19:30:01.921903+0000","last_fullsized":"2024-09-12T19:30:01.921903+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:30:01.921717+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:30:01.921717+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.921717+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:06.661883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":964,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'344","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.405949+0000","last_change":"2024-09-12T19:29:49.405949+0000","last_active":"2024-09-12T19:29:49.405949+0000","last_peered":"2024-09-12T19:29:49.405949+0000","last_clean":"2024-09-12T19:29:49.405949+0000","last_became_active":"2024-09-12T17:36:34.860828+0000","last_became_peered":"2024-09-12T17:36:34.860828+0000","last_unstale":"2024-09-12T19:29:49.405949+0000","last_undegraded":"2024-09-12T19:29:49.405949+0000","last_fullsized":"2024-09-12T19:29:49.405949+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T19:29:49.405847+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T19:29:49.405847+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.405847+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:37.116130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399137,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":452,"num_read_kb":18690,"num_write":1073,"num_write_kb":31228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.499917+0000","last_change":"2024-09-12T19:30:04.499917+0000","last_active":"2024-09-12T19:30:04.499917+0000","last_peered":"2024-09-12T19:30:04.499917+0000","last_clean":"2024-09-12T19:30:04.499917+0000","last_became_active":"2024-09-12T17:36:38.897189+0000","last_became_peered":"2024-09-12T17:36:38.897189+0000","last_unstale":"2024-09-12T19:30:04.499917+0000","last_undegraded":"2024-09-12T19:30:04.499917+0000","last_fullsized":"2024-09-12T19:30:04.499917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.499746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.499746+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.499746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:20.326081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'514","reported_seq":1210,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.076417+0000","last_change":"2024-09-12T19:30:12.076417+0000","last_active":"2024-09-12T19:30:12.076417+0000","last_peered":"2024-09-12T19:30:12.076417+0000","last_clean":"2024-09-12T19:30:12.076417+0000","last_became_active":"2024-09-12T17:36:40.906903+0000","last_became_peered":"2024-09-12T17:36:40.906903+0000","last_unstale":"2024-09-12T19:30:12.076417+0000","last_undegraded":"2024-09-12T19:30:12.076417+0000","last_fullsized":"2024-09-12T19:30:12.076417+0000","mapping_epoch":30,"log_start":"265'501","ondisk_log_start":"265'501","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'514","last_scrub_stamp":"2024-09-12T19:30:12.076220+0000","last_deep_scrub":"265'514","last_deep_scrub_stamp":"2024-09-12T19:30:12.076220+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.076220+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":501,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:39.976350+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96745,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":901,"num_read_kb":2079,"num_write":726,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.871490+0000","last_change":"2024-09-12T19:30:15.871490+0000","last_active":"2024-09-12T19:30:15.871490+0000","last_peered":"2024-09-12T19:30:15.871490+0000","last_clean":"2024-09-12T19:30:15.871490+0000","last_became_active":"2024-09-12T17:36:42.933168+0000","last_became_peered":"2024-09-12T17:36:42.933168+0000","last_unstale":"2024-09-12T19:30:15.871490+0000","last_undegraded":"2024-09-12T19:30:15.871490+0000","last_fullsized":"2024-09-12T19:30:15.871490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:15.871307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:15.871307+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.871307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:18.870421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'162","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.197938+0000","last_change":"2024-09-12T19:30:14.197938+0000","last_active":"2024-09-12T19:30:14.197938+0000","last_peered":"2024-09-12T19:30:14.197938+0000","last_clean":"2024-09-12T19:30:14.197938+0000","last_became_active":"2024-09-12T17:36:44.960935+0000","last_became_peered":"2024-09-12T17:36:44.960935+0000","last_unstale":"2024-09-12T19:30:14.197938+0000","last_undegraded":"2024-09-12T19:30:14.197938+0000","last_fullsized":"2024-09-12T19:30:14.197938+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T19:30:14.197639+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T19:30:14.197639+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.197639+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:56.070755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1322,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":195,"num_write":366,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'1243","reported_seq":2932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.364754+0000","last_change":"2024-09-12T19:29:56.364754+0000","last_active":"2024-09-12T19:29:56.364754+0000","last_peered":"2024-09-12T19:29:56.364754+0000","last_clean":"2024-09-12T19:29:56.364754+0000","last_became_active":"2024-09-12T17:36:36.914518+0000","last_became_peered":"2024-09-12T17:36:36.914518+0000","last_unstale":"2024-09-12T19:29:56.364754+0000","last_undegraded":"2024-09-12T19:29:56.364754+0000","last_fullsized":"2024-09-12T19:29:56.364754+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1243","last_scrub_stamp":"2024-09-12T19:29:56.364560+0000","last_deep_scrub":"265'1243","last_deep_scrub_stamp":"2024-09-12T19:29:56.364560+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.364560+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:54.124223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5692,"num_read_kb":5056,"num_write":1732,"num_write_kb":743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'326","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.160320+0000","last_change":"2024-09-12T19:29:52.160320+0000","last_active":"2024-09-12T19:29:52.160320+0000","last_peered":"2024-09-12T19:29:52.160320+0000","last_clean":"2024-09-12T19:29:52.160320+0000","last_became_active":"2024-09-12T17:36:34.878896+0000","last_became_peered":"2024-09-12T17:36:34.878896+0000","last_unstale":"2024-09-12T19:29:52.160320+0000","last_undegraded":"2024-09-12T19:29:52.160320+0000","last_fullsized":"2024-09-12T19:29:52.160320+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'326","last_scrub_stamp":"2024-09-12T19:29:52.160042+0000","last_deep_scrub":"265'326","last_deep_scrub_stamp":"2024-09-12T19:29:52.160042+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.160042+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:02.198272+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":17715,"num_write":1042,"num_write_kb":23877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.101607+0000","last_change":"2024-09-12T19:30:04.101607+0000","last_active":"2024-09-12T19:30:04.101607+0000","last_peered":"2024-09-12T19:30:04.101607+0000","last_clean":"2024-09-12T19:30:04.101607+0000","last_became_active":"2024-09-12T17:36:38.907609+0000","last_became_peered":"2024-09-12T17:36:38.907609+0000","last_unstale":"2024-09-12T19:30:04.101607+0000","last_undegraded":"2024-09-12T19:30:04.101607+0000","last_fullsized":"2024-09-12T19:30:04.101607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.101422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.101422+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.101422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:43.456527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'366","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.856226+0000","last_change":"2024-09-12T19:30:06.856226+0000","last_active":"2024-09-12T19:30:06.856226+0000","last_peered":"2024-09-12T19:30:06.856226+0000","last_clean":"2024-09-12T19:30:06.856226+0000","last_became_active":"2024-09-12T17:36:40.893702+0000","last_became_peered":"2024-09-12T17:36:40.893702+0000","last_unstale":"2024-09-12T19:30:06.856226+0000","last_undegraded":"2024-09-12T19:30:06.856226+0000","last_fullsized":"2024-09-12T19:30:06.856226+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T19:30:06.855976+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T19:30:06.855976+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.855976+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:59.315491+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47801,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":608,"num_read_kb":1248,"num_write":530,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.189730+0000","last_change":"2024-09-12T19:30:09.189730+0000","last_active":"2024-09-12T19:30:09.189730+0000","last_peered":"2024-09-12T19:30:09.189730+0000","last_clean":"2024-09-12T19:30:09.189730+0000","last_became_active":"2024-09-12T17:36:42.938437+0000","last_became_peered":"2024-09-12T17:36:42.938437+0000","last_unstale":"2024-09-12T19:30:09.189730+0000","last_undegraded":"2024-09-12T19:30:09.189730+0000","last_fullsized":"2024-09-12T19:30:09.189730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.189503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.189503+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.189503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:16.188315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'151","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.830517+0000","last_change":"2024-09-12T19:30:18.830517+0000","last_active":"2024-09-12T19:30:18.830517+0000","last_peered":"2024-09-12T19:30:18.830517+0000","last_clean":"2024-09-12T19:30:18.830517+0000","last_became_active":"2024-09-12T17:36:44.956645+0000","last_became_peered":"2024-09-12T17:36:44.956645+0000","last_unstale":"2024-09-12T19:30:18.830517+0000","last_undegraded":"2024-09-12T19:30:18.830517+0000","last_fullsized":"2024-09-12T19:30:18.830517+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T19:30:18.830311+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T19:30:18.830311+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.830311+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:17.214413+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":356,"num_read_kb":303,"num_write":346,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'503","reported_seq":2127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.145687+0000","last_change":"2024-09-12T19:30:07.145687+0000","last_active":"2024-09-12T19:30:07.145687+0000","last_peered":"2024-09-12T19:30:07.145687+0000","last_clean":"2024-09-12T19:30:07.145687+0000","last_became_active":"2024-09-12T17:36:36.881882+0000","last_became_peered":"2024-09-12T17:36:36.881882+0000","last_unstale":"2024-09-12T19:30:07.145687+0000","last_undegraded":"2024-09-12T19:30:07.145687+0000","last_fullsized":"2024-09-12T19:30:07.145687+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'503","last_scrub_stamp":"2024-09-12T19:30:07.145481+0000","last_deep_scrub":"265'503","last_deep_scrub_stamp":"2024-09-12T19:30:07.145481+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.145481+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:18.068459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2445,"num_write":630,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1768,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'360","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.147330+0000","last_change":"2024-09-12T19:29:54.147330+0000","last_active":"2024-09-12T19:29:54.147330+0000","last_peered":"2024-09-12T19:29:54.147330+0000","last_clean":"2024-09-12T19:29:54.147330+0000","last_became_active":"2024-09-12T17:36:34.870021+0000","last_became_peered":"2024-09-12T17:36:34.870021+0000","last_unstale":"2024-09-12T19:29:54.147330+0000","last_undegraded":"2024-09-12T19:29:54.147330+0000","last_fullsized":"2024-09-12T19:29:54.147330+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T19:29:54.147094+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T19:29:54.147094+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.147094+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:37.219375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":14188,"num_write":1189,"num_write_kb":25082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.885812+0000","last_change":"2024-09-12T19:30:22.885812+0000","last_active":"2024-09-12T19:30:22.885812+0000","last_peered":"2024-09-12T19:30:22.885812+0000","last_clean":"2024-09-12T19:30:22.885812+0000","last_became_active":"2024-09-12T17:36:38.892885+0000","last_became_peered":"2024-09-12T17:36:38.892885+0000","last_unstale":"2024-09-12T19:30:22.885812+0000","last_undegraded":"2024-09-12T19:30:22.885812+0000","last_fullsized":"2024-09-12T19:30:22.885812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.885627+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:32.386425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'386","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.852949+0000","last_change":"2024-09-12T19:30:12.852949+0000","last_active":"2024-09-12T19:30:12.852949+0000","last_peered":"2024-09-12T19:30:12.852949+0000","last_clean":"2024-09-12T19:30:12.852949+0000","last_became_active":"2024-09-12T17:36:40.896733+0000","last_became_peered":"2024-09-12T17:36:40.896733+0000","last_unstale":"2024-09-12T19:30:12.852949+0000","last_undegraded":"2024-09-12T19:30:12.852949+0000","last_fullsized":"2024-09-12T19:30:12.852949+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T19:30:12.852690+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T19:30:12.852690+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.852690+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:33.164610+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60156,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1227,"num_write":470,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'770","reported_seq":3244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.198293+0000","last_change":"2024-09-12T19:30:07.198293+0000","last_active":"2024-09-12T19:30:07.198293+0000","last_peered":"2024-09-12T19:30:07.198293+0000","last_clean":"2024-09-12T19:30:07.198293+0000","last_became_active":"2024-09-12T17:36:42.934582+0000","last_became_peered":"2024-09-12T17:36:42.934582+0000","last_unstale":"2024-09-12T19:30:07.198293+0000","last_undegraded":"2024-09-12T19:30:07.198293+0000","last_fullsized":"2024-09-12T19:30:07.198293+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'770","last_scrub_stamp":"2024-09-12T19:30:07.198104+0000","last_deep_scrub":"265'770","last_deep_scrub_stamp":"2024-09-12T19:30:07.198104+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.198104+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:23.704998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'104","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.440516+0000","last_change":"2024-09-12T19:30:14.440516+0000","last_active":"2024-09-12T19:30:14.440516+0000","last_peered":"2024-09-12T19:30:14.440516+0000","last_clean":"2024-09-12T19:30:14.440516+0000","last_became_active":"2024-09-12T17:36:44.937368+0000","last_became_peered":"2024-09-12T17:36:44.937368+0000","last_unstale":"2024-09-12T19:30:14.440516+0000","last_undegraded":"2024-09-12T19:30:14.440516+0000","last_fullsized":"2024-09-12T19:30:14.440516+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T19:30:14.440277+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T19:30:14.440277+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.440277+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:13.019102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":224,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'655","reported_seq":2169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.360525+0000","last_change":"2024-09-12T19:29:55.360525+0000","last_active":"2024-09-12T19:29:55.360525+0000","last_peered":"2024-09-12T19:29:55.360525+0000","last_clean":"2024-09-12T19:29:55.360525+0000","last_became_active":"2024-09-12T17:36:36.883043+0000","last_became_peered":"2024-09-12T17:36:36.883043+0000","last_unstale":"2024-09-12T19:29:55.360525+0000","last_undegraded":"2024-09-12T19:29:55.360525+0000","last_fullsized":"2024-09-12T19:29:55.360525+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'655","last_scrub_stamp":"2024-09-12T19:29:55.360342+0000","last_deep_scrub":"265'655","last_deep_scrub_stamp":"2024-09-12T19:29:55.360342+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.360342+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:36.568704+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3181,"num_read_kb":2856,"num_write":918,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'393","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.103440+0000","last_change":"2024-09-12T19:29:53.103440+0000","last_active":"2024-09-12T19:29:53.103440+0000","last_peered":"2024-09-12T19:29:53.103440+0000","last_clean":"2024-09-12T19:29:53.103440+0000","last_became_active":"2024-09-12T17:36:34.873263+0000","last_became_peered":"2024-09-12T17:36:34.873263+0000","last_unstale":"2024-09-12T19:29:53.103440+0000","last_undegraded":"2024-09-12T19:29:53.103440+0000","last_fullsized":"2024-09-12T19:29:53.103440+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T19:29:53.103209+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T19:29:53.103209+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.103209+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:42.148875+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194346,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":21339,"num_write":1076,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.888492+0000","last_change":"2024-09-12T19:30:02.888492+0000","last_active":"2024-09-12T19:30:02.888492+0000","last_peered":"2024-09-12T19:30:02.888492+0000","last_clean":"2024-09-12T19:30:02.888492+0000","last_became_active":"2024-09-12T17:36:38.888795+0000","last_became_peered":"2024-09-12T17:36:38.888795+0000","last_unstale":"2024-09-12T19:30:02.888492+0000","last_undegraded":"2024-09-12T19:30:02.888492+0000","last_fullsized":"2024-09-12T19:30:02.888492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:30:02.888300+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:30:02.888300+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.888300+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:29.619911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'155","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.485137+0000","last_change":"2024-09-12T19:30:09.485137+0000","last_active":"2024-09-12T19:30:09.485137+0000","last_peered":"2024-09-12T19:30:09.485137+0000","last_clean":"2024-09-12T19:30:09.485137+0000","last_became_active":"2024-09-12T17:36:40.893090+0000","last_became_peered":"2024-09-12T17:36:40.893090+0000","last_unstale":"2024-09-12T19:30:09.485137+0000","last_undegraded":"2024-09-12T19:30:09.485137+0000","last_fullsized":"2024-09-12T19:30:09.485137+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'155","last_scrub_stamp":"2024-09-12T19:30:09.484944+0000","last_deep_scrub":"265'155","last_deep_scrub_stamp":"2024-09-12T19:30:09.484944+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.484944+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:12.960615+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'806","reported_seq":3164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.813116+0000","last_change":"2024-09-12T19:30:08.813116+0000","last_active":"2024-09-12T19:30:08.813116+0000","last_peered":"2024-09-12T19:30:08.813116+0000","last_clean":"2024-09-12T19:30:08.813116+0000","last_became_active":"2024-09-12T17:36:42.937195+0000","last_became_peered":"2024-09-12T17:36:42.937195+0000","last_unstale":"2024-09-12T19:30:08.813116+0000","last_undegraded":"2024-09-12T19:30:08.813116+0000","last_fullsized":"2024-09-12T19:30:08.813116+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T19:30:08.812938+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T19:30:08.812938+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.812938+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:24.074921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'109","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.379760+0000","last_change":"2024-09-12T19:30:10.379760+0000","last_active":"2024-09-12T19:30:10.379760+0000","last_peered":"2024-09-12T19:30:10.379760+0000","last_clean":"2024-09-12T19:30:10.379760+0000","last_became_active":"2024-09-12T17:36:44.960042+0000","last_became_peered":"2024-09-12T17:36:44.960042+0000","last_unstale":"2024-09-12T19:30:10.379760+0000","last_undegraded":"2024-09-12T19:30:10.379760+0000","last_fullsized":"2024-09-12T19:30:10.379760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T19:30:10.379634+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T19:30:10.379634+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.379634+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:19.555620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":249,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'988","reported_seq":2652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.143275+0000","last_change":"2024-09-12T19:29:55.143275+0000","last_active":"2024-09-12T19:29:55.143275+0000","last_peered":"2024-09-12T19:29:55.143275+0000","last_clean":"2024-09-12T19:29:55.143275+0000","last_became_active":"2024-09-12T17:36:36.913566+0000","last_became_peered":"2024-09-12T17:36:36.913566+0000","last_unstale":"2024-09-12T19:29:55.143275+0000","last_undegraded":"2024-09-12T19:29:55.143275+0000","last_fullsized":"2024-09-12T19:29:55.143275+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'988","last_scrub_stamp":"2024-09-12T19:29:55.143081+0000","last_deep_scrub":"265'988","last_deep_scrub_stamp":"2024-09-12T19:29:55.143081+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.143081+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":900,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:53.114918+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4811,"num_read_kb":4293,"num_write":1402,"num_write_kb":559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'301","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.964599+0000","last_change":"2024-09-12T19:29:51.964599+0000","last_active":"2024-09-12T19:29:51.964599+0000","last_peered":"2024-09-12T19:29:51.964599+0000","last_clean":"2024-09-12T19:29:51.964599+0000","last_became_active":"2024-09-12T17:36:34.862534+0000","last_became_peered":"2024-09-12T17:36:34.862534+0000","last_unstale":"2024-09-12T19:29:51.964599+0000","last_undegraded":"2024-09-12T19:29:51.964599+0000","last_fullsized":"2024-09-12T19:29:51.964599+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T19:29:51.964386+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T19:29:51.964386+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.964386+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:56.102480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":22960,"num_write":940,"num_write_kb":34116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:16.244922+0000","last_change":"2024-09-12T19:30:16.244922+0000","last_active":"2024-09-12T19:30:16.244922+0000","last_peered":"2024-09-12T19:30:16.244922+0000","last_clean":"2024-09-12T19:30:16.244922+0000","last_became_active":"2024-09-12T17:36:38.885678+0000","last_became_peered":"2024-09-12T17:36:38.885678+0000","last_unstale":"2024-09-12T19:30:16.244922+0000","last_undegraded":"2024-09-12T19:30:16.244922+0000","last_fullsized":"2024-09-12T19:30:16.244922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:16.244724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:16.244724+0000","last_clean_scrub_stamp":"2024-09-12T19:30:16.244724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:32.116672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'421","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.848360+0000","last_change":"2024-09-12T19:30:05.848360+0000","last_active":"2024-09-12T19:30:05.848360+0000","last_peered":"2024-09-12T19:30:05.848360+0000","last_clean":"2024-09-12T19:30:05.848360+0000","last_became_active":"2024-09-12T17:36:40.900295+0000","last_became_peered":"2024-09-12T17:36:40.900295+0000","last_unstale":"2024-09-12T19:30:05.848360+0000","last_undegraded":"2024-09-12T19:30:05.848360+0000","last_fullsized":"2024-09-12T19:30:05.848360+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T19:30:05.848067+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T19:30:05.848067+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.848067+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:04.379582+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41300,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":664,"num_read_kb":1187,"num_write":496,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.479258+0000","last_change":"2024-09-12T19:30:07.479258+0000","last_active":"2024-09-12T19:30:07.479258+0000","last_peered":"2024-09-12T19:30:07.479258+0000","last_clean":"2024-09-12T19:30:07.479258+0000","last_became_active":"2024-09-12T17:36:42.927716+0000","last_became_peered":"2024-09-12T17:36:42.927716+0000","last_unstale":"2024-09-12T19:30:07.479258+0000","last_undegraded":"2024-09-12T19:30:07.479258+0000","last_fullsized":"2024-09-12T19:30:07.479258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:07.478981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:07.478981+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.478981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:54.816352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'116","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.188295+0000","last_change":"2024-09-12T19:30:13.188295+0000","last_active":"2024-09-12T19:30:13.188295+0000","last_peered":"2024-09-12T19:30:13.188295+0000","last_clean":"2024-09-12T19:30:13.188295+0000","last_became_active":"2024-09-12T17:36:44.942505+0000","last_became_peered":"2024-09-12T17:36:44.942505+0000","last_unstale":"2024-09-12T19:30:13.188295+0000","last_undegraded":"2024-09-12T19:30:13.188295+0000","last_fullsized":"2024-09-12T19:30:13.188295+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T19:30:13.188101+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T19:30:13.188101+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.188101+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:41.920035+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":134,"num_write":256,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'735","reported_seq":2211,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.116820+0000","last_change":"2024-09-12T19:30:05.116820+0000","last_active":"2024-09-12T19:30:05.116820+0000","last_peered":"2024-09-12T19:30:05.116820+0000","last_clean":"2024-09-12T19:30:05.116820+0000","last_became_active":"2024-09-12T17:36:36.881456+0000","last_became_peered":"2024-09-12T17:36:36.881456+0000","last_unstale":"2024-09-12T19:30:05.116820+0000","last_undegraded":"2024-09-12T19:30:05.116820+0000","last_fullsized":"2024-09-12T19:30:05.116820+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'735","last_scrub_stamp":"2024-09-12T19:30:05.116645+0000","last_deep_scrub":"265'735","last_deep_scrub_stamp":"2024-09-12T19:30:05.116645+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.116645+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:47.794091+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3432,"num_read_kb":3120,"num_write":969,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.898493+0000","last_change":"2024-09-12T19:29:49.898417+0000","last_active":"2024-09-12T19:29:49.898493+0000","last_peered":"2024-09-12T19:29:49.898493+0000","last_clean":"2024-09-12T19:29:49.898493+0000","last_became_active":"2024-09-12T17:36:16.722334+0000","last_became_peered":"2024-09-12T17:36:16.722334+0000","last_unstale":"2024-09-12T19:29:49.898493+0000","last_undegraded":"2024-09-12T19:29:49.898493+0000","last_fullsized":"2024-09-12T19:29:49.898493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T19:29:49.898324+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T19:29:49.898324+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.898324+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:33.245609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":561,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.125721+0000","last_change":"2024-09-12T19:29:51.125545+0000","last_active":"2024-09-12T19:29:51.125721+0000","last_peered":"2024-09-12T19:29:51.125721+0000","last_clean":"2024-09-12T19:29:51.125721+0000","last_became_active":"2024-09-12T17:36:21.777852+0000","last_became_peered":"2024-09-12T17:36:21.777852+0000","last_unstale":"2024-09-12T19:29:51.125721+0000","last_undegraded":"2024-09-12T19:29:51.125721+0000","last_fullsized":"2024-09-12T19:29:51.125721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:29:51.125363+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:29:51.125363+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.125363+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.353553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0019340550000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'392","reported_seq":1142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.973649+0000","last_change":"2024-09-12T19:29:49.973395+0000","last_active":"2024-09-12T19:29:49.973649+0000","last_peered":"2024-09-12T19:29:49.973649+0000","last_clean":"2024-09-12T19:29:49.973649+0000","last_became_active":"2024-09-12T17:36:34.865550+0000","last_became_peered":"2024-09-12T17:36:34.865550+0000","last_unstale":"2024-09-12T19:29:49.973649+0000","last_undegraded":"2024-09-12T19:29:49.973649+0000","last_fullsized":"2024-09-12T19:29:49.973649+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'392","last_scrub_stamp":"2024-09-12T19:29:49.973066+0000","last_deep_scrub":"265'392","last_deep_scrub_stamp":"2024-09-12T19:29:49.973066+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.973066+0000","objects_scrubbed":10,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:01.163698+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":672,"num_read_kb":15438,"num_write":1473,"num_write_kb":31533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.410837+0000","last_change":"2024-09-12T19:30:02.410837+0000","last_active":"2024-09-12T19:30:02.410837+0000","last_peered":"2024-09-12T19:30:02.410837+0000","last_clean":"2024-09-12T19:30:02.410837+0000","last_became_active":"2024-09-12T17:36:38.891774+0000","last_became_peered":"2024-09-12T17:36:38.891774+0000","last_unstale":"2024-09-12T19:30:02.410837+0000","last_undegraded":"2024-09-12T19:30:02.410837+0000","last_fullsized":"2024-09-12T19:30:02.410837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:02.410659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:02.410659+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.410659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:06.637766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'753","reported_seq":1508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.147491+0000","last_change":"2024-09-12T19:30:23.147491+0000","last_active":"2024-09-12T19:30:23.147491+0000","last_peered":"2024-09-12T19:30:23.147491+0000","last_clean":"2024-09-12T19:30:23.147491+0000","last_became_active":"2024-09-12T17:36:40.885684+0000","last_became_peered":"2024-09-12T17:36:40.885684+0000","last_unstale":"2024-09-12T19:30:23.147491+0000","last_undegraded":"2024-09-12T19:30:23.147491+0000","last_fullsized":"2024-09-12T19:30:23.147491+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'753","last_scrub_stamp":"2024-09-12T19:30:23.147238+0000","last_deep_scrub":"265'753","last_deep_scrub_stamp":"2024-09-12T19:30:23.147238+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.147238+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:22.325464+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144787,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1444,"num_read_kb":3163,"num_write":1370,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89364,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.874487+0000","last_change":"2024-09-12T19:30:14.874487+0000","last_active":"2024-09-12T19:30:14.874487+0000","last_peered":"2024-09-12T19:30:14.874487+0000","last_clean":"2024-09-12T19:30:14.874487+0000","last_became_active":"2024-09-12T17:36:42.919204+0000","last_became_peered":"2024-09-12T17:36:42.919204+0000","last_unstale":"2024-09-12T19:30:14.874487+0000","last_undegraded":"2024-09-12T19:30:14.874487+0000","last_fullsized":"2024-09-12T19:30:14.874487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:14.874285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:14.874285+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.874285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:05.726412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'188","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.437887+0000","last_change":"2024-09-12T19:30:06.437887+0000","last_active":"2024-09-12T19:30:06.437887+0000","last_peered":"2024-09-12T19:30:06.437887+0000","last_clean":"2024-09-12T19:30:06.437887+0000","last_became_active":"2024-09-12T17:36:44.954321+0000","last_became_peered":"2024-09-12T17:36:44.954321+0000","last_unstale":"2024-09-12T19:30:06.437887+0000","last_undegraded":"2024-09-12T19:30:06.437887+0000","last_fullsized":"2024-09-12T19:30:06.437887+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T19:30:06.437713+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T19:30:06.437713+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.437713+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:02.954841+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":488,"num_write":378,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'505","reported_seq":2094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.910531+0000","last_change":"2024-09-12T19:30:02.910531+0000","last_active":"2024-09-12T19:30:02.910531+0000","last_peered":"2024-09-12T19:30:02.910531+0000","last_clean":"2024-09-12T19:30:02.910531+0000","last_became_active":"2024-09-12T17:36:36.906789+0000","last_became_peered":"2024-09-12T17:36:36.906789+0000","last_unstale":"2024-09-12T19:30:02.910531+0000","last_undegraded":"2024-09-12T19:30:02.910531+0000","last_fullsized":"2024-09-12T19:30:02.910531+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:30:02.910308+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:30:02.910308+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.910308+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:02.545989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2691,"num_read_kb":2505,"num_write":636,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":561,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.034928+0000","last_change":"2024-09-12T19:29:49.034793+0000","last_active":"2024-09-12T19:29:49.034928+0000","last_peered":"2024-09-12T19:29:49.034928+0000","last_clean":"2024-09-12T19:29:49.034928+0000","last_became_active":"2024-09-12T17:36:21.785026+0000","last_became_peered":"2024-09-12T17:36:21.785026+0000","last_unstale":"2024-09-12T19:29:49.034928+0000","last_undegraded":"2024-09-12T19:29:49.034928+0000","last_fullsized":"2024-09-12T19:29:49.034928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:49.034625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:49.034625+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.034625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:04.032231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184601,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'384","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.337511+0000","last_change":"2024-09-12T19:29:49.337277+0000","last_active":"2024-09-12T19:29:49.337511+0000","last_peered":"2024-09-12T19:29:49.337511+0000","last_clean":"2024-09-12T19:29:49.337511+0000","last_became_active":"2024-09-12T17:36:34.882818+0000","last_became_peered":"2024-09-12T17:36:34.882818+0000","last_unstale":"2024-09-12T19:29:49.337511+0000","last_undegraded":"2024-09-12T19:29:49.337511+0000","last_fullsized":"2024-09-12T19:29:49.337511+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T19:29:49.337016+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T19:29:49.337016+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.337016+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:42.148166+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263289,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":609,"num_read_kb":22197,"num_write":1318,"num_write_kb":15503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.207386+0000","last_change":"2024-09-12T19:30:17.207386+0000","last_active":"2024-09-12T19:30:17.207386+0000","last_peered":"2024-09-12T19:30:17.207386+0000","last_clean":"2024-09-12T19:30:17.207386+0000","last_became_active":"2024-09-12T17:36:38.895378+0000","last_became_peered":"2024-09-12T17:36:38.895378+0000","last_unstale":"2024-09-12T19:30:17.207386+0000","last_undegraded":"2024-09-12T19:30:17.207386+0000","last_fullsized":"2024-09-12T19:30:17.207386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:17.207209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:17.207209+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.207209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:15.388414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1459","reported_seq":3821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.186738+0000","last_change":"2024-09-12T19:30:08.186738+0000","last_active":"2024-09-12T19:30:08.186738+0000","last_peered":"2024-09-12T19:30:08.186738+0000","last_clean":"2024-09-12T19:30:08.186738+0000","last_became_active":"2024-09-12T17:36:40.908721+0000","last_became_peered":"2024-09-12T17:36:40.908721+0000","last_unstale":"2024-09-12T19:30:08.186738+0000","last_undegraded":"2024-09-12T19:30:08.186738+0000","last_fullsized":"2024-09-12T19:30:08.186738+0000","mapping_epoch":30,"log_start":"265'1400","ondisk_log_start":"265'1400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1459","last_scrub_stamp":"2024-09-12T19:30:08.186556+0000","last_deep_scrub":"265'1459","last_deep_scrub_stamp":"2024-09-12T19:30:08.186556+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.186556+0000","objects_scrubbed":11,"log_size":59,"log_dups_size":1400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:47.270094+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146546,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2270,"num_read_kb":4170,"num_write":1382,"num_write_kb":1134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.167515+0000","last_change":"2024-09-12T19:30:22.167515+0000","last_active":"2024-09-12T19:30:22.167515+0000","last_peered":"2024-09-12T19:30:22.167515+0000","last_clean":"2024-09-12T19:30:22.167515+0000","last_became_active":"2024-09-12T17:36:42.917432+0000","last_became_peered":"2024-09-12T17:36:42.917432+0000","last_unstale":"2024-09-12T19:30:22.167515+0000","last_undegraded":"2024-09-12T19:30:22.167515+0000","last_fullsized":"2024-09-12T19:30:22.167515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.167254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.167254+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.167254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:19.411131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'254","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.833332+0000","last_change":"2024-09-12T19:30:19.833332+0000","last_active":"2024-09-12T19:30:19.833332+0000","last_peered":"2024-09-12T19:30:19.833332+0000","last_clean":"2024-09-12T19:30:19.833332+0000","last_became_active":"2024-09-12T17:36:44.956687+0000","last_became_peered":"2024-09-12T17:36:44.956687+0000","last_unstale":"2024-09-12T19:30:19.833332+0000","last_undegraded":"2024-09-12T19:30:19.833332+0000","last_fullsized":"2024-09-12T19:30:19.833332+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-12T19:30:19.833141+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-12T19:30:19.833141+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.833141+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:20.668124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":419,"num_write":569,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'459","reported_seq":1919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.431161+0000","last_change":"2024-09-12T19:29:57.431161+0000","last_active":"2024-09-12T19:29:57.431161+0000","last_peered":"2024-09-12T19:29:57.431161+0000","last_clean":"2024-09-12T19:29:57.431161+0000","last_became_active":"2024-09-12T17:36:36.876424+0000","last_became_peered":"2024-09-12T17:36:36.876424+0000","last_unstale":"2024-09-12T19:29:57.431161+0000","last_undegraded":"2024-09-12T19:29:57.431161+0000","last_fullsized":"2024-09-12T19:29:57.431161+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'459","last_scrub_stamp":"2024-09-12T19:29:57.430975+0000","last_deep_scrub":"265'459","last_deep_scrub_stamp":"2024-09-12T19:29:57.430975+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.430975+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:09.526597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2313,"num_read_kb":2138,"num_write":582,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":560,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.154375+0000","last_change":"2024-09-12T19:29:50.154192+0000","last_active":"2024-09-12T19:29:50.154375+0000","last_peered":"2024-09-12T19:29:50.154375+0000","last_clean":"2024-09-12T19:29:50.154375+0000","last_became_active":"2024-09-12T17:36:21.786793+0000","last_became_peered":"2024-09-12T17:36:21.786793+0000","last_unstale":"2024-09-12T19:29:50.154375+0000","last_undegraded":"2024-09-12T19:29:50.154375+0000","last_fullsized":"2024-09-12T19:29:50.154375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:50.154015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:50.154015+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.154015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:03.469572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011925740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'325","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:49.914511+0000","last_change":"2024-09-12T19:29:49.914352+0000","last_active":"2024-09-12T19:29:49.914511+0000","last_peered":"2024-09-12T19:29:49.914511+0000","last_clean":"2024-09-12T19:29:49.914511+0000","last_became_active":"2024-09-12T17:36:34.878944+0000","last_became_peered":"2024-09-12T17:36:34.878944+0000","last_unstale":"2024-09-12T19:29:49.914511+0000","last_undegraded":"2024-09-12T19:29:49.914511+0000","last_fullsized":"2024-09-12T19:29:49.914511+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'325","last_scrub_stamp":"2024-09-12T19:29:49.914119+0000","last_deep_scrub":"265'325","last_deep_scrub_stamp":"2024-09-12T19:29:49.914119+0000","last_clean_scrub_stamp":"2024-09-12T19:29:49.914119+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:49.927843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526370,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":517,"num_read_kb":44432,"num_write":1109,"num_write_kb":34964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.067399+0000","last_change":"2024-09-12T19:30:03.067399+0000","last_active":"2024-09-12T19:30:03.067399+0000","last_peered":"2024-09-12T19:30:03.067399+0000","last_clean":"2024-09-12T19:30:03.067399+0000","last_became_active":"2024-09-12T17:36:38.907685+0000","last_became_peered":"2024-09-12T17:36:38.907685+0000","last_unstale":"2024-09-12T19:30:03.067399+0000","last_undegraded":"2024-09-12T19:30:03.067399+0000","last_fullsized":"2024-09-12T19:30:03.067399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:03.067178+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:03.067178+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.067178+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:13.152392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'394","reported_seq":2363,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.492938+0000","last_change":"2024-09-12T19:30:07.492938+0000","last_active":"2024-09-12T19:30:07.492938+0000","last_peered":"2024-09-12T19:30:07.492938+0000","last_clean":"2024-09-12T19:30:07.492938+0000","last_became_active":"2024-09-12T17:36:40.907340+0000","last_became_peered":"2024-09-12T17:36:40.907340+0000","last_unstale":"2024-09-12T19:30:07.492938+0000","last_undegraded":"2024-09-12T19:30:07.492938+0000","last_fullsized":"2024-09-12T19:30:07.492938+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T19:30:07.492731+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T19:30:07.492731+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.492731+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:01.941637+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":374,"num_read_kb":364,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.047061+0000","last_change":"2024-09-12T19:30:20.047061+0000","last_active":"2024-09-12T19:30:20.047061+0000","last_peered":"2024-09-12T19:30:20.047061+0000","last_clean":"2024-09-12T19:30:20.047061+0000","last_became_active":"2024-09-12T17:36:42.931884+0000","last_became_peered":"2024-09-12T17:36:42.931884+0000","last_unstale":"2024-09-12T19:30:20.047061+0000","last_undegraded":"2024-09-12T19:30:20.047061+0000","last_fullsized":"2024-09-12T19:30:20.047061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:20.046878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:20.046878+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.046878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:37.970477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'260","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.041036+0000","last_change":"2024-09-12T19:30:24.041036+0000","last_active":"2024-09-12T19:30:24.041036+0000","last_peered":"2024-09-12T19:30:24.041036+0000","last_clean":"2024-09-12T19:30:24.041036+0000","last_became_active":"2024-09-12T17:36:44.940041+0000","last_became_peered":"2024-09-12T17:36:44.940041+0000","last_unstale":"2024-09-12T19:30:24.041036+0000","last_undegraded":"2024-09-12T19:30:24.041036+0000","last_fullsized":"2024-09-12T19:30:24.041036+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T19:30:24.040859+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T19:30:24.040859+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.040859+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:12.153683+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":565,"num_write":575,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'751","reported_seq":2229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.430540+0000","last_change":"2024-09-12T19:29:58.430540+0000","last_active":"2024-09-12T19:29:58.430540+0000","last_peered":"2024-09-12T19:29:58.430540+0000","last_clean":"2024-09-12T19:29:58.430540+0000","last_became_active":"2024-09-12T17:36:36.896152+0000","last_became_peered":"2024-09-12T17:36:36.896152+0000","last_unstale":"2024-09-12T19:29:58.430540+0000","last_undegraded":"2024-09-12T19:29:58.430540+0000","last_fullsized":"2024-09-12T19:29:58.430540+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'751","last_scrub_stamp":"2024-09-12T19:29:58.430337+0000","last_deep_scrub":"265'751","last_deep_scrub_stamp":"2024-09-12T19:29:58.430337+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.430337+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:51.087393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3496,"num_read_kb":3152,"num_write":986,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":562,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.061538+0000","last_change":"2024-09-12T19:29:48.061350+0000","last_active":"2024-09-12T19:29:48.061538+0000","last_peered":"2024-09-12T19:29:48.061538+0000","last_clean":"2024-09-12T19:29:48.061538+0000","last_became_active":"2024-09-12T17:36:21.777173+0000","last_became_peered":"2024-09-12T17:36:21.777173+0000","last_unstale":"2024-09-12T19:29:48.061538+0000","last_undegraded":"2024-09-12T19:29:48.061538+0000","last_fullsized":"2024-09-12T19:29:48.061538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T19:29:48.061179+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T19:29:48.061179+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.061179+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:31.413285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001776889,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'361","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.180093+0000","last_change":"2024-09-12T19:29:51.180093+0000","last_active":"2024-09-12T19:29:51.180093+0000","last_peered":"2024-09-12T19:29:51.180093+0000","last_clean":"2024-09-12T19:29:51.180093+0000","last_became_active":"2024-09-12T17:37:07.867652+0000","last_became_peered":"2024-09-12T17:37:07.867652+0000","last_unstale":"2024-09-12T19:29:51.180093+0000","last_undegraded":"2024-09-12T19:29:51.180093+0000","last_fullsized":"2024-09-12T19:29:51.180093+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:29:51.179910+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:29:51.179910+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.179910+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:46.705185+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":639,"num_read_kb":7400,"num_write":1137,"num_write_kb":18590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.125119+0000","last_change":"2024-09-12T19:30:01.125119+0000","last_active":"2024-09-12T19:30:01.125119+0000","last_peered":"2024-09-12T19:30:01.125119+0000","last_clean":"2024-09-12T19:30:01.125119+0000","last_became_active":"2024-09-12T17:36:38.912059+0000","last_became_peered":"2024-09-12T17:36:38.912059+0000","last_unstale":"2024-09-12T19:30:01.125119+0000","last_undegraded":"2024-09-12T19:30:01.125119+0000","last_fullsized":"2024-09-12T19:30:01.125119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:01.124924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:01.124924+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.124924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:24.544303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'223","reported_seq":845,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.842299+0000","last_change":"2024-09-12T19:30:11.842299+0000","last_active":"2024-09-12T19:30:11.842299+0000","last_peered":"2024-09-12T19:30:11.842299+0000","last_clean":"2024-09-12T19:30:11.842299+0000","last_became_active":"2024-09-12T17:36:40.884794+0000","last_became_peered":"2024-09-12T17:36:40.884794+0000","last_unstale":"2024-09-12T19:30:11.842299+0000","last_undegraded":"2024-09-12T19:30:11.842299+0000","last_fullsized":"2024-09-12T19:30:11.842299+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'223","last_scrub_stamp":"2024-09-12T19:30:11.842122+0000","last_deep_scrub":"265'223","last_deep_scrub_stamp":"2024-09-12T19:30:11.842122+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.842122+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:00.405422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":278,"num_read_kb":269,"num_write":202,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:27.126363+0000","last_change":"2024-09-12T19:30:27.126363+0000","last_active":"2024-09-12T19:30:27.126363+0000","last_peered":"2024-09-12T19:30:27.126363+0000","last_clean":"2024-09-12T19:30:27.126363+0000","last_became_active":"2024-09-12T17:36:42.920887+0000","last_became_peered":"2024-09-12T17:36:42.920887+0000","last_unstale":"2024-09-12T19:30:27.126363+0000","last_undegraded":"2024-09-12T19:30:27.126363+0000","last_fullsized":"2024-09-12T19:30:27.126363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:27.126185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:27.126185+0000","last_clean_scrub_stamp":"2024-09-12T19:30:27.126185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:03.775134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'127","reported_seq":721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.753785+0000","last_change":"2024-09-12T19:30:15.753785+0000","last_active":"2024-09-12T19:30:15.753785+0000","last_peered":"2024-09-12T19:30:15.753785+0000","last_clean":"2024-09-12T19:30:15.753785+0000","last_became_active":"2024-09-12T17:36:44.937666+0000","last_became_peered":"2024-09-12T17:36:44.937666+0000","last_unstale":"2024-09-12T19:30:15.753785+0000","last_undegraded":"2024-09-12T19:30:15.753785+0000","last_fullsized":"2024-09-12T19:30:15.753785+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T19:30:15.753598+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T19:30:15.753598+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.753598+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.724999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":289,"num_read_kb":276,"num_write":312,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'531","reported_seq":2150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.379702+0000","last_change":"2024-09-12T19:29:55.379702+0000","last_active":"2024-09-12T19:29:55.379702+0000","last_peered":"2024-09-12T19:29:55.379702+0000","last_clean":"2024-09-12T19:29:55.379702+0000","last_became_active":"2024-09-12T17:36:36.880335+0000","last_became_peered":"2024-09-12T17:36:36.880335+0000","last_unstale":"2024-09-12T19:29:55.379702+0000","last_undegraded":"2024-09-12T19:29:55.379702+0000","last_fullsized":"2024-09-12T19:29:55.379702+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'531","last_scrub_stamp":"2024-09-12T19:29:55.379515+0000","last_deep_scrub":"265'531","last_deep_scrub_stamp":"2024-09-12T19:29:55.379515+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.379515+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:12.812873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2654,"num_read_kb":2484,"num_write":644,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'379","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.385447+0000","last_change":"2024-09-12T19:29:47.385447+0000","last_active":"2024-09-12T19:29:47.385447+0000","last_peered":"2024-09-12T19:29:47.385447+0000","last_clean":"2024-09-12T19:29:47.385447+0000","last_became_active":"2024-09-12T17:36:34.877412+0000","last_became_peered":"2024-09-12T17:36:34.877412+0000","last_unstale":"2024-09-12T19:29:47.385447+0000","last_undegraded":"2024-09-12T19:29:47.385447+0000","last_fullsized":"2024-09-12T19:29:47.385447+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'379","last_scrub_stamp":"2024-09-12T19:29:47.385337+0000","last_deep_scrub":"265'379","last_deep_scrub_stamp":"2024-09-12T19:29:47.385337+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.385337+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:45.645372+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6755987,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":26720,"num_write":1165,"num_write_kb":36792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":564,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.889808+0000","last_change":"2024-09-12T19:29:48.889621+0000","last_active":"2024-09-12T19:29:48.889808+0000","last_peered":"2024-09-12T19:29:48.889808+0000","last_clean":"2024-09-12T19:29:48.889808+0000","last_became_active":"2024-09-12T17:36:21.786429+0000","last_became_peered":"2024-09-12T17:36:21.786429+0000","last_unstale":"2024-09-12T19:29:48.889808+0000","last_undegraded":"2024-09-12T19:29:48.889808+0000","last_fullsized":"2024-09-12T19:29:48.889808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:48.889441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:48.889441+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.889441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:45.334877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011387680000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"265'6","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.935990+0000","last_change":"2024-09-12T19:30:06.935990+0000","last_active":"2024-09-12T19:30:06.935990+0000","last_peered":"2024-09-12T19:30:06.935990+0000","last_clean":"2024-09-12T19:30:06.935990+0000","last_became_active":"2024-09-12T17:36:38.902432+0000","last_became_peered":"2024-09-12T17:36:38.902432+0000","last_unstale":"2024-09-12T19:30:06.935990+0000","last_undegraded":"2024-09-12T19:30:06.935990+0000","last_fullsized":"2024-09-12T19:30:06.935990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:30:06.935793+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:30:06.935793+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.935793+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:24:01.944572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":1196,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'762","reported_seq":1509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.173706+0000","last_change":"2024-09-12T19:30:05.173560+0000","last_active":"2024-09-12T19:30:05.173706+0000","last_peered":"2024-09-12T19:30:05.173706+0000","last_clean":"2024-09-12T19:30:05.173706+0000","last_became_active":"2024-09-12T17:36:40.902488+0000","last_became_peered":"2024-09-12T17:36:40.902488+0000","last_unstale":"2024-09-12T19:30:05.173706+0000","last_undegraded":"2024-09-12T19:30:05.173706+0000","last_fullsized":"2024-09-12T19:30:05.173706+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'762","last_scrub_stamp":"2024-09-12T19:30:05.173334+0000","last_deep_scrub":"265'762","last_deep_scrub_stamp":"2024-09-12T19:30:05.173334+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.173334+0000","objects_scrubbed":10,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:35.044431+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98161,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1955,"num_read_kb":3163,"num_write":2614,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508704,"num_omap_keys":1156,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.432752+0000","last_change":"2024-09-12T19:30:06.432752+0000","last_active":"2024-09-12T19:30:06.432752+0000","last_peered":"2024-09-12T19:30:06.432752+0000","last_clean":"2024-09-12T19:30:06.432752+0000","last_became_active":"2024-09-12T17:36:42.931746+0000","last_became_peered":"2024-09-12T17:36:42.931746+0000","last_unstale":"2024-09-12T19:30:06.432752+0000","last_undegraded":"2024-09-12T19:30:06.432752+0000","last_fullsized":"2024-09-12T19:30:06.432752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:06.432573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:06.432573+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.432573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:42.589039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'140","reported_seq":688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.862755+0000","last_change":"2024-09-12T19:30:21.862755+0000","last_active":"2024-09-12T19:30:21.862755+0000","last_peered":"2024-09-12T19:30:21.862755+0000","last_clean":"2024-09-12T19:30:21.862755+0000","last_became_active":"2024-09-12T17:36:44.959109+0000","last_became_peered":"2024-09-12T17:36:44.959109+0000","last_unstale":"2024-09-12T19:30:21.862755+0000","last_undegraded":"2024-09-12T19:30:21.862755+0000","last_fullsized":"2024-09-12T19:30:21.862755+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T19:30:21.862544+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T19:30:21.862544+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.862544+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:06.313478+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'606","reported_seq":2154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.417555+0000","last_change":"2024-09-12T19:29:56.417555+0000","last_active":"2024-09-12T19:29:56.417555+0000","last_peered":"2024-09-12T19:29:56.417555+0000","last_clean":"2024-09-12T19:29:56.417555+0000","last_became_active":"2024-09-12T17:36:36.883397+0000","last_became_peered":"2024-09-12T17:36:36.883397+0000","last_unstale":"2024-09-12T19:29:56.417555+0000","last_undegraded":"2024-09-12T19:29:56.417555+0000","last_fullsized":"2024-09-12T19:29:56.417555+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'606","last_scrub_stamp":"2024-09-12T19:29:56.417345+0000","last_deep_scrub":"265'606","last_deep_scrub_stamp":"2024-09-12T19:29:56.417345+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.417345+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:40.538277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3050,"num_read_kb":2738,"num_write":793,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'373","reported_seq":1106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.305986+0000","last_change":"2024-09-12T19:29:50.305851+0000","last_active":"2024-09-12T19:29:50.305986+0000","last_peered":"2024-09-12T19:29:50.305986+0000","last_clean":"2024-09-12T19:29:50.305986+0000","last_became_active":"2024-09-12T17:36:34.892255+0000","last_became_peered":"2024-09-12T17:36:34.892255+0000","last_unstale":"2024-09-12T19:29:50.305986+0000","last_undegraded":"2024-09-12T19:29:50.305986+0000","last_fullsized":"2024-09-12T19:29:50.305986+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:29:50.305656+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:29:50.305656+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.305656+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:22.178790+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400040,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":627,"num_read_kb":68904,"num_write":1058,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.074460+0000","last_change":"2024-09-12T19:29:52.074460+0000","last_active":"2024-09-12T19:29:52.074460+0000","last_peered":"2024-09-12T19:29:52.074460+0000","last_clean":"2024-09-12T19:29:52.074460+0000","last_became_active":"2024-09-12T17:36:21.783069+0000","last_became_peered":"2024-09-12T17:36:21.783069+0000","last_unstale":"2024-09-12T19:29:52.074460+0000","last_undegraded":"2024-09-12T19:29:52.074460+0000","last_fullsized":"2024-09-12T19:29:52.074460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:52.074270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:52.074270+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.074270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:39.027678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001135285,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.463533+0000","last_change":"2024-09-12T19:30:04.463533+0000","last_active":"2024-09-12T19:30:04.463533+0000","last_peered":"2024-09-12T19:30:04.463533+0000","last_clean":"2024-09-12T19:30:04.463533+0000","last_became_active":"2024-09-12T17:36:38.900433+0000","last_became_peered":"2024-09-12T17:36:38.900433+0000","last_unstale":"2024-09-12T19:30:04.463533+0000","last_undegraded":"2024-09-12T19:30:04.463533+0000","last_fullsized":"2024-09-12T19:30:04.463533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.463348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.463348+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.463348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:22.114565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'254","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.539472+0000","last_change":"2024-09-12T19:30:07.539472+0000","last_active":"2024-09-12T19:30:07.539472+0000","last_peered":"2024-09-12T19:30:07.539472+0000","last_clean":"2024-09-12T19:30:07.539472+0000","last_became_active":"2024-09-12T17:36:40.886345+0000","last_became_peered":"2024-09-12T17:36:40.886345+0000","last_unstale":"2024-09-12T19:30:07.539472+0000","last_undegraded":"2024-09-12T19:30:07.539472+0000","last_fullsized":"2024-09-12T19:30:07.539472+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-12T19:30:07.539275+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-12T19:30:07.539275+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.539275+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:20.151842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'805","reported_seq":3509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.776206+0000","last_change":"2024-09-12T19:30:11.776206+0000","last_active":"2024-09-12T19:30:11.776206+0000","last_peered":"2024-09-12T19:30:11.776206+0000","last_clean":"2024-09-12T19:30:11.776206+0000","last_became_active":"2024-09-12T17:36:42.931598+0000","last_became_peered":"2024-09-12T17:36:42.931598+0000","last_unstale":"2024-09-12T19:30:11.776206+0000","last_undegraded":"2024-09-12T19:30:11.776206+0000","last_fullsized":"2024-09-12T19:30:11.776206+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'805","last_scrub_stamp":"2024-09-12T19:30:11.776004+0000","last_deep_scrub":"265'805","last_deep_scrub_stamp":"2024-09-12T19:30:11.776004+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.776004+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:37.485165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'140","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.127004+0000","last_change":"2024-09-12T19:30:17.127004+0000","last_active":"2024-09-12T19:30:17.127004+0000","last_peered":"2024-09-12T19:30:17.127004+0000","last_clean":"2024-09-12T19:30:17.127004+0000","last_became_active":"2024-09-12T17:36:44.951849+0000","last_became_peered":"2024-09-12T17:36:44.951849+0000","last_unstale":"2024-09-12T19:30:17.127004+0000","last_undegraded":"2024-09-12T19:30:17.127004+0000","last_fullsized":"2024-09-12T19:30:17.127004+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T19:30:17.126798+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T19:30:17.126798+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.126798+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:37.952052+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":170,"num_read_kb":163,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'744","reported_seq":2386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.897755+0000","last_change":"2024-09-12T19:29:57.897523+0000","last_active":"2024-09-12T19:29:57.897755+0000","last_peered":"2024-09-12T19:29:57.897755+0000","last_clean":"2024-09-12T19:29:57.897755+0000","last_became_active":"2024-09-12T17:36:36.892861+0000","last_became_peered":"2024-09-12T17:36:36.892861+0000","last_unstale":"2024-09-12T19:29:57.897755+0000","last_undegraded":"2024-09-12T19:29:57.897755+0000","last_fullsized":"2024-09-12T19:29:57.897755+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'744","last_scrub_stamp":"2024-09-12T19:29:57.897218+0000","last_deep_scrub":"265'744","last_deep_scrub_stamp":"2024-09-12T19:29:57.897218+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.897218+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:49.749434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3560,"num_read_kb":3257,"num_write":956,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'351","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.000072+0000","last_change":"2024-09-12T19:29:53.000072+0000","last_active":"2024-09-12T19:29:53.000072+0000","last_peered":"2024-09-12T19:29:53.000072+0000","last_clean":"2024-09-12T19:29:53.000072+0000","last_became_active":"2024-09-12T17:36:34.883331+0000","last_became_peered":"2024-09-12T17:36:34.883331+0000","last_unstale":"2024-09-12T19:29:53.000072+0000","last_undegraded":"2024-09-12T19:29:53.000072+0000","last_fullsized":"2024-09-12T19:29:53.000072+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-12T19:29:52.999859+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-12T19:29:52.999859+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.999859+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:19.508145+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":26132,"num_write":1177,"num_write_kb":40752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.922514+0000","last_change":"2024-09-12T19:29:48.922514+0000","last_active":"2024-09-12T19:29:48.922514+0000","last_peered":"2024-09-12T19:29:48.922514+0000","last_clean":"2024-09-12T19:29:48.922514+0000","last_became_active":"2024-09-12T17:36:22.059379+0000","last_became_peered":"2024-09-12T17:36:22.059379+0000","last_unstale":"2024-09-12T19:29:48.922514+0000","last_undegraded":"2024-09-12T19:29:48.922514+0000","last_fullsized":"2024-09-12T19:29:48.922514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:48.922319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:48.922319+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.922319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:36.603470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012087210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.245644+0000","last_change":"2024-09-12T19:30:15.245644+0000","last_active":"2024-09-12T19:30:15.245644+0000","last_peered":"2024-09-12T19:30:15.245644+0000","last_clean":"2024-09-12T19:30:15.245644+0000","last_became_active":"2024-09-12T17:36:38.891807+0000","last_became_peered":"2024-09-12T17:36:38.891807+0000","last_unstale":"2024-09-12T19:30:15.245644+0000","last_undegraded":"2024-09-12T19:30:15.245644+0000","last_fullsized":"2024-09-12T19:30:15.245644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:15.245464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:15.245464+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.245464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:53.751956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'179","reported_seq":786,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.181626+0000","last_change":"2024-09-12T19:30:20.181626+0000","last_active":"2024-09-12T19:30:20.181626+0000","last_peered":"2024-09-12T19:30:20.181626+0000","last_clean":"2024-09-12T19:30:20.181626+0000","last_became_active":"2024-09-12T17:36:40.897763+0000","last_became_peered":"2024-09-12T17:36:40.897763+0000","last_unstale":"2024-09-12T19:30:20.181626+0000","last_undegraded":"2024-09-12T19:30:20.181626+0000","last_fullsized":"2024-09-12T19:30:20.181626+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'179","last_scrub_stamp":"2024-09-12T19:30:20.181421+0000","last_deep_scrub":"265'179","last_deep_scrub_stamp":"2024-09-12T19:30:20.181421+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.181421+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:55.791206+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'802","reported_seq":3157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:13.827708+0000","last_change":"2024-09-12T19:30:13.827708+0000","last_active":"2024-09-12T19:30:13.827708+0000","last_peered":"2024-09-12T19:30:13.827708+0000","last_clean":"2024-09-12T19:30:13.827708+0000","last_became_active":"2024-09-12T17:36:42.928978+0000","last_became_peered":"2024-09-12T17:36:42.928978+0000","last_unstale":"2024-09-12T19:30:13.827708+0000","last_undegraded":"2024-09-12T19:30:13.827708+0000","last_fullsized":"2024-09-12T19:30:13.827708+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'802","last_scrub_stamp":"2024-09-12T19:30:13.827491+0000","last_deep_scrub":"265'802","last_deep_scrub_stamp":"2024-09-12T19:30:13.827491+0000","last_clean_scrub_stamp":"2024-09-12T19:30:13.827491+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:15.050072+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'238","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:26.812676+0000","last_change":"2024-09-12T19:30:26.812676+0000","last_active":"2024-09-12T19:30:26.812676+0000","last_peered":"2024-09-12T19:30:26.812676+0000","last_clean":"2024-09-12T19:30:26.812676+0000","last_became_active":"2024-09-12T17:36:44.956784+0000","last_became_peered":"2024-09-12T17:36:44.956784+0000","last_unstale":"2024-09-12T19:30:26.812676+0000","last_undegraded":"2024-09-12T19:30:26.812676+0000","last_fullsized":"2024-09-12T19:30:26.812676+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'238","last_scrub_stamp":"2024-09-12T19:30:26.812495+0000","last_deep_scrub":"265'238","last_deep_scrub_stamp":"2024-09-12T19:30:26.812495+0000","last_clean_scrub_stamp":"2024-09-12T19:30:26.812495+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:43.651565+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":233,"num_read_kb":216,"num_write":428,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'374","reported_seq":2048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.351332+0000","last_change":"2024-09-12T19:29:53.351332+0000","last_active":"2024-09-12T19:29:53.351332+0000","last_peered":"2024-09-12T19:29:53.351332+0000","last_clean":"2024-09-12T19:29:53.351332+0000","last_became_active":"2024-09-12T17:36:36.883862+0000","last_became_peered":"2024-09-12T17:36:36.883862+0000","last_unstale":"2024-09-12T19:29:53.351332+0000","last_undegraded":"2024-09-12T19:29:53.351332+0000","last_fullsized":"2024-09-12T19:29:53.351332+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T19:29:53.351161+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T19:29:53.351161+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.351161+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:18.340873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2422,"num_read_kb":2340,"num_write":416,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'355","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.004315+0000","last_change":"2024-09-12T19:29:51.004315+0000","last_active":"2024-09-12T19:29:51.004315+0000","last_peered":"2024-09-12T19:29:51.004315+0000","last_clean":"2024-09-12T19:29:51.004315+0000","last_became_active":"2024-09-12T17:36:34.868641+0000","last_became_peered":"2024-09-12T17:36:34.868641+0000","last_unstale":"2024-09-12T19:29:51.004315+0000","last_undegraded":"2024-09-12T19:29:51.004315+0000","last_fullsized":"2024-09-12T19:29:51.004315+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T19:29:51.004074+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T19:29:51.004074+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.004074+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:19.751431+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1398988,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":547,"num_read_kb":35743,"num_write":1181,"num_write_kb":32710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":556,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.075936+0000","last_change":"2024-09-12T19:29:50.075936+0000","last_active":"2024-09-12T19:29:50.075936+0000","last_peered":"2024-09-12T19:29:50.075936+0000","last_clean":"2024-09-12T19:29:50.075936+0000","last_became_active":"2024-09-12T17:36:22.058794+0000","last_became_peered":"2024-09-12T17:36:22.058794+0000","last_unstale":"2024-09-12T19:29:50.075936+0000","last_undegraded":"2024-09-12T19:29:50.075936+0000","last_fullsized":"2024-09-12T19:29:50.075936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:29:50.075752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:29:50.075752+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.075752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:54.554291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":545,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.900409+0000","last_change":"2024-09-12T19:30:04.900228+0000","last_active":"2024-09-12T19:30:04.900409+0000","last_peered":"2024-09-12T19:30:04.900409+0000","last_clean":"2024-09-12T19:30:04.900409+0000","last_became_active":"2024-09-12T17:36:38.901418+0000","last_became_peered":"2024-09-12T17:36:38.901418+0000","last_unstale":"2024-09-12T19:30:04.900409+0000","last_undegraded":"2024-09-12T19:30:04.900409+0000","last_fullsized":"2024-09-12T19:30:04.900409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.900053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.900053+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.900053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:11.827647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'816","reported_seq":1613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.433089+0000","last_change":"2024-09-12T19:30:03.433089+0000","last_active":"2024-09-12T19:30:03.433089+0000","last_peered":"2024-09-12T19:30:03.433089+0000","last_clean":"2024-09-12T19:30:03.433089+0000","last_became_active":"2024-09-12T17:36:40.908231+0000","last_became_peered":"2024-09-12T17:36:40.908231+0000","last_unstale":"2024-09-12T19:30:03.433089+0000","last_undegraded":"2024-09-12T19:30:03.433089+0000","last_fullsized":"2024-09-12T19:30:03.433089+0000","mapping_epoch":30,"log_start":"265'800","ondisk_log_start":"265'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'816","last_scrub_stamp":"2024-09-12T19:30:03.432954+0000","last_deep_scrub":"265'816","last_deep_scrub_stamp":"2024-09-12T19:30:03.432954+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.432954+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:15.981426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146317,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3243,"num_write":1152,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:19.036553+0000","last_change":"2024-09-12T19:30:19.036553+0000","last_active":"2024-09-12T19:30:19.036553+0000","last_peered":"2024-09-12T19:30:19.036553+0000","last_clean":"2024-09-12T19:30:19.036553+0000","last_became_active":"2024-09-12T17:36:42.932086+0000","last_became_peered":"2024-09-12T17:36:42.932086+0000","last_unstale":"2024-09-12T19:30:19.036553+0000","last_undegraded":"2024-09-12T19:30:19.036553+0000","last_fullsized":"2024-09-12T19:30:19.036553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:19.036334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:19.036334+0000","last_clean_scrub_stamp":"2024-09-12T19:30:19.036334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:52.784984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'128","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.459855+0000","last_change":"2024-09-12T19:30:17.459855+0000","last_active":"2024-09-12T19:30:17.459855+0000","last_peered":"2024-09-12T19:30:17.459855+0000","last_clean":"2024-09-12T19:30:17.459855+0000","last_became_active":"2024-09-12T17:36:44.960744+0000","last_became_peered":"2024-09-12T17:36:44.960744+0000","last_unstale":"2024-09-12T19:30:17.459855+0000","last_undegraded":"2024-09-12T19:30:17.459855+0000","last_fullsized":"2024-09-12T19:30:17.459855+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T19:30:17.459640+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T19:30:17.459640+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.459640+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:43.927040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":186,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'136","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.019914+0000","last_change":"2024-09-12T19:30:25.019914+0000","last_active":"2024-09-12T19:30:25.019914+0000","last_peered":"2024-09-12T19:30:25.019914+0000","last_clean":"2024-09-12T19:30:25.019914+0000","last_became_active":"2024-09-12T17:36:44.939820+0000","last_became_peered":"2024-09-12T17:36:44.939820+0000","last_unstale":"2024-09-12T19:30:25.019914+0000","last_undegraded":"2024-09-12T19:30:25.019914+0000","last_fullsized":"2024-09-12T19:30:25.019914+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T19:30:25.019723+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T19:30:25.019723+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.019723+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:30.905979+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":235,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'802","reported_seq":2470,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.382972+0000","last_change":"2024-09-12T19:29:58.382818+0000","last_active":"2024-09-12T19:29:58.382972+0000","last_peered":"2024-09-12T19:29:58.382972+0000","last_clean":"2024-09-12T19:29:58.382972+0000","last_became_active":"2024-09-12T17:36:36.883481+0000","last_became_peered":"2024-09-12T17:36:36.883481+0000","last_unstale":"2024-09-12T19:29:58.382972+0000","last_undegraded":"2024-09-12T19:29:58.382972+0000","last_fullsized":"2024-09-12T19:29:58.382972+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'802","last_scrub_stamp":"2024-09-12T19:29:58.382629+0000","last_deep_scrub":"265'802","last_deep_scrub_stamp":"2024-09-12T19:29:58.382629+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.382629+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:14.006063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3831,"num_read_kb":3485,"num_write":1040,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'319","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.227016+0000","last_change":"2024-09-12T19:29:58.227016+0000","last_active":"2024-09-12T19:29:58.227016+0000","last_peered":"2024-09-12T19:29:58.227016+0000","last_clean":"2024-09-12T19:29:58.227016+0000","last_became_active":"2024-09-12T17:36:34.861702+0000","last_became_peered":"2024-09-12T17:36:34.861702+0000","last_unstale":"2024-09-12T19:29:58.227016+0000","last_undegraded":"2024-09-12T19:29:58.227016+0000","last_fullsized":"2024-09-12T19:29:58.227016+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T19:29:58.226750+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T19:29:58.226750+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.226750+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:18.778525+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273696,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":464,"num_read_kb":26224,"num_write":1045,"num_write_kb":25793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.536225+0000","last_change":"2024-09-12T19:30:05.536076+0000","last_active":"2024-09-12T19:30:05.536225+0000","last_peered":"2024-09-12T19:30:05.536225+0000","last_clean":"2024-09-12T19:30:05.536225+0000","last_became_active":"2024-09-12T17:36:38.894742+0000","last_became_peered":"2024-09-12T17:36:38.894742+0000","last_unstale":"2024-09-12T19:30:05.536225+0000","last_undegraded":"2024-09-12T19:30:05.536225+0000","last_fullsized":"2024-09-12T19:30:05.536225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:05.535904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:05.535904+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.535904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:41.432968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'332","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.532770+0000","last_change":"2024-09-12T19:30:08.532627+0000","last_active":"2024-09-12T19:30:08.532770+0000","last_peered":"2024-09-12T19:30:08.532770+0000","last_clean":"2024-09-12T19:30:08.532770+0000","last_became_active":"2024-09-12T17:36:40.892710+0000","last_became_peered":"2024-09-12T17:36:40.892710+0000","last_unstale":"2024-09-12T19:30:08.532770+0000","last_undegraded":"2024-09-12T19:30:08.532770+0000","last_fullsized":"2024-09-12T19:30:08.532770+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T19:30:08.532361+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T19:30:08.532361+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.532361+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:49.724335+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49819,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":1091,"num_write":418,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.235902+0000","last_change":"2024-09-12T19:30:10.235756+0000","last_active":"2024-09-12T19:30:10.235902+0000","last_peered":"2024-09-12T19:30:10.235902+0000","last_clean":"2024-09-12T19:30:10.235902+0000","last_became_active":"2024-09-12T17:36:42.938834+0000","last_became_peered":"2024-09-12T17:36:42.938834+0000","last_unstale":"2024-09-12T19:30:10.235902+0000","last_undegraded":"2024-09-12T19:30:10.235902+0000","last_fullsized":"2024-09-12T19:30:10.235902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:10.235565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:10.235565+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.235565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:24.663063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'141","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.175056+0000","last_change":"2024-09-12T19:30:15.174915+0000","last_active":"2024-09-12T19:30:15.175056+0000","last_peered":"2024-09-12T19:30:15.175056+0000","last_clean":"2024-09-12T19:30:15.175056+0000","last_became_active":"2024-09-12T17:36:44.953117+0000","last_became_peered":"2024-09-12T17:36:44.953117+0000","last_unstale":"2024-09-12T19:30:15.175056+0000","last_undegraded":"2024-09-12T19:30:15.175056+0000","last_fullsized":"2024-09-12T19:30:15.175056+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'141","last_scrub_stamp":"2024-09-12T19:30:15.174732+0000","last_deep_scrub":"265'141","last_deep_scrub_stamp":"2024-09-12T19:30:15.174732+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.174732+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:21.174795+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":202,"num_write":357,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'472","reported_seq":2086,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.921241+0000","last_change":"2024-09-12T19:29:56.921083+0000","last_active":"2024-09-12T19:29:56.921241+0000","last_peered":"2024-09-12T19:29:56.921241+0000","last_clean":"2024-09-12T19:29:56.921241+0000","last_became_active":"2024-09-12T17:36:36.900955+0000","last_became_peered":"2024-09-12T17:36:36.900955+0000","last_unstale":"2024-09-12T19:29:56.921241+0000","last_undegraded":"2024-09-12T19:29:56.921241+0000","last_fullsized":"2024-09-12T19:29:56.921241+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'472","last_scrub_stamp":"2024-09-12T19:29:56.920906+0000","last_deep_scrub":"265'472","last_deep_scrub_stamp":"2024-09-12T19:29:56.920906+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.920906+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:13.700998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2490,"num_read_kb":2331,"num_write":571,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'352","reported_seq":1131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.412441+0000","last_change":"2024-09-12T19:29:51.412206+0000","last_active":"2024-09-12T19:29:51.412441+0000","last_peered":"2024-09-12T19:29:51.412441+0000","last_clean":"2024-09-12T19:29:51.412441+0000","last_became_active":"2024-09-12T17:36:34.878069+0000","last_became_peered":"2024-09-12T17:36:34.878069+0000","last_unstale":"2024-09-12T19:29:51.412441+0000","last_undegraded":"2024-09-12T19:29:51.412441+0000","last_fullsized":"2024-09-12T19:29:51.412441+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:29:51.411936+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:29:51.411936+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.411936+0000","objects_scrubbed":11,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:28.683406+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097855,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":782,"num_read_kb":26278,"num_write":971,"num_write_kb":31119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:07.980512+0000","last_change":"2024-09-12T19:30:07.980372+0000","last_active":"2024-09-12T19:30:07.980512+0000","last_peered":"2024-09-12T19:30:07.980512+0000","last_clean":"2024-09-12T19:30:07.980512+0000","last_became_active":"2024-09-12T17:36:38.894800+0000","last_became_peered":"2024-09-12T17:36:38.894800+0000","last_unstale":"2024-09-12T19:30:07.980512+0000","last_undegraded":"2024-09-12T19:30:07.980512+0000","last_fullsized":"2024-09-12T19:30:07.980512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:07.980191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:07.980191+0000","last_clean_scrub_stamp":"2024-09-12T19:30:07.980191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:19.605106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'84","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.092985+0000","last_change":"2024-09-12T19:30:14.092824+0000","last_active":"2024-09-12T19:30:14.092985+0000","last_peered":"2024-09-12T19:30:14.092985+0000","last_clean":"2024-09-12T19:30:14.092985+0000","last_became_active":"2024-09-12T17:36:40.909470+0000","last_became_peered":"2024-09-12T17:36:40.909470+0000","last_unstale":"2024-09-12T19:30:14.092985+0000","last_undegraded":"2024-09-12T19:30:14.092985+0000","last_fullsized":"2024-09-12T19:30:14.092985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'84","last_scrub_stamp":"2024-09-12T19:30:14.092640+0000","last_deep_scrub":"265'84","last_deep_scrub_stamp":"2024-09-12T19:30:14.092640+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.092640+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:43.847026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.444397+0000","last_change":"2024-09-12T19:30:08.444242+0000","last_active":"2024-09-12T19:30:08.444397+0000","last_peered":"2024-09-12T19:30:08.444397+0000","last_clean":"2024-09-12T19:30:08.444397+0000","last_became_active":"2024-09-12T17:36:42.922352+0000","last_became_peered":"2024-09-12T17:36:42.922352+0000","last_unstale":"2024-09-12T19:30:08.444397+0000","last_undegraded":"2024-09-12T19:30:08.444397+0000","last_fullsized":"2024-09-12T19:30:08.444397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:08.444006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:08.444006+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.444006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:28.356175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'239","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.407464+0000","last_change":"2024-09-12T19:30:17.407464+0000","last_active":"2024-09-12T19:30:17.407464+0000","last_peered":"2024-09-12T19:30:17.407464+0000","last_clean":"2024-09-12T19:30:17.407464+0000","last_became_active":"2024-09-12T17:36:44.945429+0000","last_became_peered":"2024-09-12T17:36:44.945429+0000","last_unstale":"2024-09-12T19:30:17.407464+0000","last_undegraded":"2024-09-12T19:30:17.407464+0000","last_fullsized":"2024-09-12T19:30:17.407464+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-12T19:30:17.407256+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-12T19:30:17.407256+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.407256+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:50.565386+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":307,"num_read_kb":303,"num_write":509,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'828","reported_seq":2368,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.946466+0000","last_change":"2024-09-12T19:29:55.946318+0000","last_active":"2024-09-12T19:29:55.946466+0000","last_peered":"2024-09-12T19:29:55.946466+0000","last_clean":"2024-09-12T19:29:55.946466+0000","last_became_active":"2024-09-12T17:36:36.901053+0000","last_became_peered":"2024-09-12T17:36:36.901053+0000","last_unstale":"2024-09-12T19:29:55.946466+0000","last_undegraded":"2024-09-12T19:29:55.946466+0000","last_fullsized":"2024-09-12T19:29:55.946466+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'828","last_scrub_stamp":"2024-09-12T19:29:55.946101+0000","last_deep_scrub":"265'828","last_deep_scrub_stamp":"2024-09-12T19:29:55.946101+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.946101+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:53.712277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3878,"num_read_kb":3474,"num_write":1082,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'361","reported_seq":1044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.358167+0000","last_change":"2024-09-12T19:29:50.357889+0000","last_active":"2024-09-12T19:29:50.358167+0000","last_peered":"2024-09-12T19:29:50.358167+0000","last_clean":"2024-09-12T19:29:50.358167+0000","last_became_active":"2024-09-12T17:36:34.877620+0000","last_became_peered":"2024-09-12T17:36:34.877620+0000","last_unstale":"2024-09-12T19:29:50.358167+0000","last_undegraded":"2024-09-12T19:29:50.358167+0000","last_fullsized":"2024-09-12T19:29:50.358167+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:29:50.357552+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:29:50.357552+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.357552+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:17.243177+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048740,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":51733,"num_write":1081,"num_write_kb":38676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.416273+0000","last_change":"2024-09-12T19:30:02.416021+0000","last_active":"2024-09-12T19:30:02.416273+0000","last_peered":"2024-09-12T19:30:02.416273+0000","last_clean":"2024-09-12T19:30:02.416273+0000","last_became_active":"2024-09-12T17:36:38.902188+0000","last_became_peered":"2024-09-12T17:36:38.902188+0000","last_unstale":"2024-09-12T19:30:02.416273+0000","last_undegraded":"2024-09-12T19:30:02.416273+0000","last_fullsized":"2024-09-12T19:30:02.416273+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:02.415808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:02.415808+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.415808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:35.156107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'381","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.185385+0000","last_change":"2024-09-12T19:30:06.185252+0000","last_active":"2024-09-12T19:30:06.185385+0000","last_peered":"2024-09-12T19:30:06.185385+0000","last_clean":"2024-09-12T19:30:06.185385+0000","last_became_active":"2024-09-12T17:36:40.899201+0000","last_became_peered":"2024-09-12T17:36:40.899201+0000","last_unstale":"2024-09-12T19:30:06.185385+0000","last_undegraded":"2024-09-12T19:30:06.185385+0000","last_fullsized":"2024-09-12T19:30:06.185385+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'381","last_scrub_stamp":"2024-09-12T19:30:06.185067+0000","last_deep_scrub":"265'381","last_deep_scrub_stamp":"2024-09-12T19:30:06.185067+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.185067+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:12.745822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51900,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":1290,"num_write":486,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.860829+0000","last_change":"2024-09-12T19:30:09.860673+0000","last_active":"2024-09-12T19:30:09.860829+0000","last_peered":"2024-09-12T19:30:09.860829+0000","last_clean":"2024-09-12T19:30:09.860829+0000","last_became_active":"2024-09-12T17:36:42.928596+0000","last_became_peered":"2024-09-12T17:36:42.928596+0000","last_unstale":"2024-09-12T19:30:09.860829+0000","last_undegraded":"2024-09-12T19:30:09.860829+0000","last_fullsized":"2024-09-12T19:30:09.860829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.860483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.860483+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.860483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:14.215226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'145","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:38.285573+0000","last_change":"2024-09-12T19:30:38.285573+0000","last_active":"2024-09-12T19:30:38.285573+0000","last_peered":"2024-09-12T19:30:38.285573+0000","last_clean":"2024-09-12T19:30:38.285573+0000","last_became_active":"2024-09-12T17:36:44.962445+0000","last_became_peered":"2024-09-12T17:36:44.962445+0000","last_unstale":"2024-09-12T19:30:38.285573+0000","last_undegraded":"2024-09-12T19:30:38.285573+0000","last_fullsized":"2024-09-12T19:30:38.285573+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'145","last_scrub_stamp":"2024-09-12T19:30:38.285354+0000","last_deep_scrub":"265'145","last_deep_scrub_stamp":"2024-09-12T19:30:38.285354+0000","last_clean_scrub_stamp":"2024-09-12T19:30:38.285354+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:16.125354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":234,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'603","reported_seq":2257,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.115207+0000","last_change":"2024-09-12T19:29:56.115050+0000","last_active":"2024-09-12T19:29:56.115207+0000","last_peered":"2024-09-12T19:29:56.115207+0000","last_clean":"2024-09-12T19:29:56.115207+0000","last_became_active":"2024-09-12T17:36:36.903813+0000","last_became_peered":"2024-09-12T17:36:36.903813+0000","last_unstale":"2024-09-12T19:29:56.115207+0000","last_undegraded":"2024-09-12T19:29:56.115207+0000","last_fullsized":"2024-09-12T19:29:56.115207+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'603","last_scrub_stamp":"2024-09-12T19:29:56.114858+0000","last_deep_scrub":"265'603","last_deep_scrub_stamp":"2024-09-12T19:29:56.114858+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.114858+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:39.417617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3115,"num_read_kb":2836,"num_write":758,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'307","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.974498+0000","last_change":"2024-09-12T19:29:50.974381+0000","last_active":"2024-09-12T19:29:50.974498+0000","last_peered":"2024-09-12T19:29:50.974498+0000","last_clean":"2024-09-12T19:29:50.974498+0000","last_became_active":"2024-09-12T17:36:34.886741+0000","last_became_peered":"2024-09-12T17:36:34.886741+0000","last_unstale":"2024-09-12T19:29:50.974498+0000","last_undegraded":"2024-09-12T19:29:50.974498+0000","last_fullsized":"2024-09-12T19:29:50.974498+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'307","last_scrub_stamp":"2024-09-12T19:29:50.974228+0000","last_deep_scrub":"265'307","last_deep_scrub_stamp":"2024-09-12T19:29:50.974228+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.974228+0000","objects_scrubbed":13,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:10.453984+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1961495,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":454,"num_read_kb":24643,"num_write":1003,"num_write_kb":38417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.211877+0000","last_change":"2024-09-12T19:30:18.211733+0000","last_active":"2024-09-12T19:30:18.211877+0000","last_peered":"2024-09-12T19:30:18.211877+0000","last_clean":"2024-09-12T19:30:18.211877+0000","last_became_active":"2024-09-12T17:36:38.903210+0000","last_became_peered":"2024-09-12T17:36:38.903210+0000","last_unstale":"2024-09-12T19:30:18.211877+0000","last_undegraded":"2024-09-12T19:30:18.211877+0000","last_fullsized":"2024-09-12T19:30:18.211877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:18.211558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:18.211558+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.211558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:05.683729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'312","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.496798+0000","last_change":"2024-09-12T19:30:14.496664+0000","last_active":"2024-09-12T19:30:14.496798+0000","last_peered":"2024-09-12T19:30:14.496798+0000","last_clean":"2024-09-12T19:30:14.496798+0000","last_became_active":"2024-09-12T17:36:40.912283+0000","last_became_peered":"2024-09-12T17:36:40.912283+0000","last_unstale":"2024-09-12T19:30:14.496798+0000","last_undegraded":"2024-09-12T19:30:14.496798+0000","last_fullsized":"2024-09-12T19:30:14.496798+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T19:30:14.496480+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T19:30:14.496480+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.496480+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:49.759859+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1100,"num_write":404,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.213158+0000","last_change":"2024-09-12T19:30:11.212929+0000","last_active":"2024-09-12T19:30:11.213158+0000","last_peered":"2024-09-12T19:30:11.213158+0000","last_clean":"2024-09-12T19:30:11.213158+0000","last_became_active":"2024-09-12T17:36:42.927724+0000","last_became_peered":"2024-09-12T17:36:42.927724+0000","last_unstale":"2024-09-12T19:30:11.213158+0000","last_undegraded":"2024-09-12T19:30:11.213158+0000","last_fullsized":"2024-09-12T19:30:11.213158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:11.212728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:11.212728+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.212728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:09.091627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'722","reported_seq":2257,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.151555+0000","last_change":"2024-09-12T19:30:09.151555+0000","last_active":"2024-09-12T19:30:09.151555+0000","last_peered":"2024-09-12T19:30:09.151555+0000","last_clean":"2024-09-12T19:30:09.151555+0000","last_became_active":"2024-09-12T17:36:36.885820+0000","last_became_peered":"2024-09-12T17:36:36.885820+0000","last_unstale":"2024-09-12T19:30:09.151555+0000","last_undegraded":"2024-09-12T19:30:09.151555+0000","last_fullsized":"2024-09-12T19:30:09.151555+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'722","last_scrub_stamp":"2024-09-12T19:30:09.151370+0000","last_deep_scrub":"265'722","last_deep_scrub_stamp":"2024-09-12T19:30:09.151370+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.151370+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:56.519425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3501,"num_read_kb":3197,"num_write":936,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'342","reported_seq":1027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:51.955549+0000","last_change":"2024-09-12T19:29:51.955269+0000","last_active":"2024-09-12T19:29:51.955549+0000","last_peered":"2024-09-12T19:29:51.955549+0000","last_clean":"2024-09-12T19:29:51.955549+0000","last_became_active":"2024-09-12T17:36:34.887018+0000","last_became_peered":"2024-09-12T17:36:34.887018+0000","last_unstale":"2024-09-12T19:29:51.955549+0000","last_undegraded":"2024-09-12T19:29:51.955549+0000","last_fullsized":"2024-09-12T19:29:51.955549+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:51.955017+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:51.955017+0000","last_clean_scrub_stamp":"2024-09-12T19:29:51.955017+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:13.242565+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":38393,"num_write":1072,"num_write_kb":34235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.520485+0000","last_change":"2024-09-12T19:30:06.520319+0000","last_active":"2024-09-12T19:30:06.520485+0000","last_peered":"2024-09-12T19:30:06.520485+0000","last_clean":"2024-09-12T19:30:06.520485+0000","last_became_active":"2024-09-12T17:36:38.894452+0000","last_became_peered":"2024-09-12T17:36:38.894452+0000","last_unstale":"2024-09-12T19:30:06.520485+0000","last_undegraded":"2024-09-12T19:30:06.520485+0000","last_fullsized":"2024-09-12T19:30:06.520485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:06.520134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:06.520134+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.520134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:45.097198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'519","reported_seq":1200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.437202+0000","last_change":"2024-09-12T19:30:11.437202+0000","last_active":"2024-09-12T19:30:11.437202+0000","last_peered":"2024-09-12T19:30:11.437202+0000","last_clean":"2024-09-12T19:30:11.437202+0000","last_became_active":"2024-09-12T17:36:40.909552+0000","last_became_peered":"2024-09-12T17:36:40.909552+0000","last_unstale":"2024-09-12T19:30:11.437202+0000","last_undegraded":"2024-09-12T19:30:11.437202+0000","last_fullsized":"2024-09-12T19:30:11.437202+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'519","last_scrub_stamp":"2024-09-12T19:30:11.437001+0000","last_deep_scrub":"265'519","last_deep_scrub_stamp":"2024-09-12T19:30:11.437001+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.437001+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:21.401609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105771,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":904,"num_read_kb":2059,"num_write":766,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.411302+0000","last_change":"2024-09-12T19:30:11.411302+0000","last_active":"2024-09-12T19:30:11.411302+0000","last_peered":"2024-09-12T19:30:11.411302+0000","last_clean":"2024-09-12T19:30:11.411302+0000","last_became_active":"2024-09-12T17:36:42.942627+0000","last_became_peered":"2024-09-12T17:36:42.942627+0000","last_unstale":"2024-09-12T19:30:11.411302+0000","last_undegraded":"2024-09-12T19:30:11.411302+0000","last_fullsized":"2024-09-12T19:30:11.411302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:11.411122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:11.411122+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.411122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:16.566570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'171","reported_seq":709,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:23.863348+0000","last_change":"2024-09-12T19:30:23.863127+0000","last_active":"2024-09-12T19:30:23.863348+0000","last_peered":"2024-09-12T19:30:23.863348+0000","last_clean":"2024-09-12T19:30:23.863348+0000","last_became_active":"2024-09-12T17:36:44.956655+0000","last_became_peered":"2024-09-12T17:36:44.956655+0000","last_unstale":"2024-09-12T19:30:23.863348+0000","last_undegraded":"2024-09-12T19:30:23.863348+0000","last_fullsized":"2024-09-12T19:30:23.863348+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'171","last_scrub_stamp":"2024-09-12T19:30:23.862897+0000","last_deep_scrub":"265'171","last_deep_scrub_stamp":"2024-09-12T19:30:23.862897+0000","last_clean_scrub_stamp":"2024-09-12T19:30:23.862897+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:40.667263+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":241,"num_write":385,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'358","reported_seq":1948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.904156+0000","last_change":"2024-09-12T19:30:00.903872+0000","last_active":"2024-09-12T19:30:00.904156+0000","last_peered":"2024-09-12T19:30:00.904156+0000","last_clean":"2024-09-12T19:30:00.904156+0000","last_became_active":"2024-09-12T17:36:36.911889+0000","last_became_peered":"2024-09-12T17:36:36.911889+0000","last_unstale":"2024-09-12T19:30:00.904156+0000","last_undegraded":"2024-09-12T19:30:00.904156+0000","last_fullsized":"2024-09-12T19:30:00.904156+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T19:30:00.903644+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T19:30:00.903644+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.903644+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:48.670244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2021,"num_read_kb":1969,"num_write":390,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'360","reported_seq":1142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.982460+0000","last_change":"2024-09-12T19:29:53.982295+0000","last_active":"2024-09-12T19:29:53.982460+0000","last_peered":"2024-09-12T19:29:53.982460+0000","last_clean":"2024-09-12T19:29:53.982460+0000","last_became_active":"2024-09-12T17:36:34.851161+0000","last_became_peered":"2024-09-12T17:36:34.851161+0000","last_unstale":"2024-09-12T19:29:53.982460+0000","last_undegraded":"2024-09-12T19:29:53.982460+0000","last_fullsized":"2024-09-12T19:29:53.982460+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T19:29:53.982102+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T19:29:53.982102+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.982102+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:47.944166+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273705,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":731,"num_read_kb":47360,"num_write":1100,"num_write_kb":33375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":544,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.398459+0000","last_change":"2024-09-12T19:30:09.398459+0000","last_active":"2024-09-12T19:30:09.398459+0000","last_peered":"2024-09-12T19:30:09.398459+0000","last_clean":"2024-09-12T19:30:09.398459+0000","last_became_active":"2024-09-12T17:36:38.904409+0000","last_became_peered":"2024-09-12T17:36:38.904409+0000","last_unstale":"2024-09-12T19:30:09.398459+0000","last_undegraded":"2024-09-12T19:30:09.398459+0000","last_fullsized":"2024-09-12T19:30:09.398459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:09.398271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:09.398271+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.398271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:53.976519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'412","reported_seq":1068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:28.169259+0000","last_change":"2024-09-12T19:30:28.169259+0000","last_active":"2024-09-12T19:30:28.169259+0000","last_peered":"2024-09-12T19:30:28.169259+0000","last_clean":"2024-09-12T19:30:28.169259+0000","last_became_active":"2024-09-12T17:36:40.902718+0000","last_became_peered":"2024-09-12T17:36:40.902718+0000","last_unstale":"2024-09-12T19:30:28.169259+0000","last_undegraded":"2024-09-12T19:30:28.169259+0000","last_fullsized":"2024-09-12T19:30:28.169259+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'412","last_scrub_stamp":"2024-09-12T19:30:28.169031+0000","last_deep_scrub":"265'412","last_deep_scrub_stamp":"2024-09-12T19:30:28.169031+0000","last_clean_scrub_stamp":"2024-09-12T19:30:28.169031+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:35.955503+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54769,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":679,"num_read_kb":1358,"num_write":564,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12744,"num_omap_keys":28,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:17.866861+0000","last_change":"2024-09-12T19:30:17.866861+0000","last_active":"2024-09-12T19:30:17.866861+0000","last_peered":"2024-09-12T19:30:17.866861+0000","last_clean":"2024-09-12T19:30:17.866861+0000","last_became_active":"2024-09-12T17:36:42.920352+0000","last_became_peered":"2024-09-12T17:36:42.920352+0000","last_unstale":"2024-09-12T19:30:17.866861+0000","last_undegraded":"2024-09-12T19:30:17.866861+0000","last_fullsized":"2024-09-12T19:30:17.866861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:17.866677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:17.866677+0000","last_clean_scrub_stamp":"2024-09-12T19:30:17.866677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:41.980247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'185","reported_seq":732,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:34.322336+0000","last_change":"2024-09-12T19:30:34.322156+0000","last_active":"2024-09-12T19:30:34.322336+0000","last_peered":"2024-09-12T19:30:34.322336+0000","last_clean":"2024-09-12T19:30:34.322336+0000","last_became_active":"2024-09-12T17:36:44.945753+0000","last_became_peered":"2024-09-12T17:36:44.945753+0000","last_unstale":"2024-09-12T19:30:34.322336+0000","last_undegraded":"2024-09-12T19:30:34.322336+0000","last_fullsized":"2024-09-12T19:30:34.322336+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'185","last_scrub_stamp":"2024-09-12T19:30:34.321953+0000","last_deep_scrub":"265'185","last_deep_scrub_stamp":"2024-09-12T19:30:34.321953+0000","last_clean_scrub_stamp":"2024-09-12T19:30:34.321953+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:54.174944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":278,"num_read_kb":268,"num_write":526,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'525","reported_seq":2263,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.085497+0000","last_change":"2024-09-12T19:29:58.085497+0000","last_active":"2024-09-12T19:29:58.085497+0000","last_peered":"2024-09-12T19:29:58.085497+0000","last_clean":"2024-09-12T19:29:58.085497+0000","last_became_active":"2024-09-12T17:36:36.909488+0000","last_became_peered":"2024-09-12T17:36:36.909488+0000","last_unstale":"2024-09-12T19:29:58.085497+0000","last_undegraded":"2024-09-12T19:29:58.085497+0000","last_fullsized":"2024-09-12T19:29:58.085497+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'525","last_scrub_stamp":"2024-09-12T19:29:58.085322+0000","last_deep_scrub":"265'525","last_deep_scrub_stamp":"2024-09-12T19:29:58.085322+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.085322+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:33.573152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2968,"num_read_kb":2777,"num_write":639,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'391","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:46.957992+0000","last_change":"2024-09-12T19:29:46.957992+0000","last_active":"2024-09-12T19:29:46.957992+0000","last_peered":"2024-09-12T19:29:46.957992+0000","last_clean":"2024-09-12T19:29:46.957992+0000","last_became_active":"2024-09-12T17:36:34.857645+0000","last_became_peered":"2024-09-12T17:36:34.857645+0000","last_unstale":"2024-09-12T19:29:46.957992+0000","last_undegraded":"2024-09-12T19:29:46.957992+0000","last_fullsized":"2024-09-12T19:29:46.957992+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:29:46.957895+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:29:46.957895+0000","last_clean_scrub_stamp":"2024-09-12T19:29:46.957895+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:29.114514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287556,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":605,"num_read_kb":13478,"num_write":1299,"num_write_kb":33813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.381026+0000","last_change":"2024-09-12T19:30:04.381026+0000","last_active":"2024-09-12T19:30:04.381026+0000","last_peered":"2024-09-12T19:30:04.381026+0000","last_clean":"2024-09-12T19:30:04.381026+0000","last_became_active":"2024-09-12T17:36:38.904619+0000","last_became_peered":"2024-09-12T17:36:38.904619+0000","last_unstale":"2024-09-12T19:30:04.381026+0000","last_undegraded":"2024-09-12T19:30:04.381026+0000","last_fullsized":"2024-09-12T19:30:04.381026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.380854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.380854+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.380854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:16.162425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'321","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.471095+0000","last_change":"2024-09-12T19:30:12.471095+0000","last_active":"2024-09-12T19:30:12.471095+0000","last_peered":"2024-09-12T19:30:12.471095+0000","last_clean":"2024-09-12T19:30:12.471095+0000","last_became_active":"2024-09-12T17:36:40.909189+0000","last_became_peered":"2024-09-12T17:36:40.909189+0000","last_unstale":"2024-09-12T19:30:12.471095+0000","last_undegraded":"2024-09-12T19:30:12.471095+0000","last_fullsized":"2024-09-12T19:30:12.471095+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T19:30:12.470910+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T19:30:12.470910+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.470910+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:23.997786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51077,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":521,"num_read_kb":1073,"num_write":404,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:12.167774+0000","last_change":"2024-09-12T19:30:12.167636+0000","last_active":"2024-09-12T19:30:12.167774+0000","last_peered":"2024-09-12T19:30:12.167774+0000","last_clean":"2024-09-12T19:30:12.167774+0000","last_became_active":"2024-09-12T17:36:42.938451+0000","last_became_peered":"2024-09-12T17:36:42.938451+0000","last_unstale":"2024-09-12T19:30:12.167774+0000","last_undegraded":"2024-09-12T19:30:12.167774+0000","last_fullsized":"2024-09-12T19:30:12.167774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:12.167461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:12.167461+0000","last_clean_scrub_stamp":"2024-09-12T19:30:12.167461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:34.992368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'113","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:32.235743+0000","last_change":"2024-09-12T19:30:32.235519+0000","last_active":"2024-09-12T19:30:32.235743+0000","last_peered":"2024-09-12T19:30:32.235743+0000","last_clean":"2024-09-12T19:30:32.235743+0000","last_became_active":"2024-09-12T17:36:44.949351+0000","last_became_peered":"2024-09-12T17:36:44.949351+0000","last_unstale":"2024-09-12T19:30:32.235743+0000","last_undegraded":"2024-09-12T19:30:32.235743+0000","last_fullsized":"2024-09-12T19:30:32.235743+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'113","last_scrub_stamp":"2024-09-12T19:30:32.235303+0000","last_deep_scrub":"265'113","last_deep_scrub_stamp":"2024-09-12T19:30:32.235303+0000","last_clean_scrub_stamp":"2024-09-12T19:30:32.235303+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:01.325061+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":161,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'477","reported_seq":2161,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:58.916554+0000","last_change":"2024-09-12T19:29:58.916554+0000","last_active":"2024-09-12T19:29:58.916554+0000","last_peered":"2024-09-12T19:29:58.916554+0000","last_clean":"2024-09-12T19:29:58.916554+0000","last_became_active":"2024-09-12T17:36:36.902998+0000","last_became_peered":"2024-09-12T17:36:36.902998+0000","last_unstale":"2024-09-12T19:29:58.916554+0000","last_undegraded":"2024-09-12T19:29:58.916554+0000","last_fullsized":"2024-09-12T19:29:58.916554+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'477","last_scrub_stamp":"2024-09-12T19:29:58.916239+0000","last_deep_scrub":"265'477","last_deep_scrub_stamp":"2024-09-12T19:29:58.916239+0000","last_clean_scrub_stamp":"2024-09-12T19:29:58.916239+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:11.138862+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2683,"num_read_kb":2531,"num_write":585,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2003,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'409","reported_seq":1145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.984339+0000","last_change":"2024-09-12T19:29:54.984339+0000","last_active":"2024-09-12T19:29:54.984339+0000","last_peered":"2024-09-12T19:29:54.984339+0000","last_clean":"2024-09-12T19:29:54.984339+0000","last_became_active":"2024-09-12T17:36:34.867987+0000","last_became_peered":"2024-09-12T17:36:34.867987+0000","last_unstale":"2024-09-12T19:29:54.984339+0000","last_undegraded":"2024-09-12T19:29:54.984339+0000","last_fullsized":"2024-09-12T19:29:54.984339+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T19:29:54.984140+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T19:29:54.984140+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.984140+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:32.375716+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062574,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":616,"num_read_kb":94353,"num_write":1270,"num_write_kb":45131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:15.064541+0000","last_change":"2024-09-12T19:30:15.064541+0000","last_active":"2024-09-12T19:30:15.064541+0000","last_peered":"2024-09-12T19:30:15.064541+0000","last_clean":"2024-09-12T19:30:15.064541+0000","last_became_active":"2024-09-12T17:36:38.900687+0000","last_became_peered":"2024-09-12T17:36:38.900687+0000","last_unstale":"2024-09-12T19:30:15.064541+0000","last_undegraded":"2024-09-12T19:30:15.064541+0000","last_fullsized":"2024-09-12T19:30:15.064541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:15.064365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:15.064365+0000","last_clean_scrub_stamp":"2024-09-12T19:30:15.064365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:33.955110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'164","reported_seq":758,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.180581+0000","last_change":"2024-09-12T19:30:24.180360+0000","last_active":"2024-09-12T19:30:24.180581+0000","last_peered":"2024-09-12T19:30:24.180581+0000","last_clean":"2024-09-12T19:30:24.180581+0000","last_became_active":"2024-09-12T17:36:40.904671+0000","last_became_peered":"2024-09-12T17:36:40.904671+0000","last_unstale":"2024-09-12T19:30:24.180581+0000","last_undegraded":"2024-09-12T19:30:24.180581+0000","last_fullsized":"2024-09-12T19:30:24.180581+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'164","last_scrub_stamp":"2024-09-12T19:30:24.180057+0000","last_deep_scrub":"265'164","last_deep_scrub_stamp":"2024-09-12T19:30:24.180057+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.180057+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:43.035312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":216,"num_write":202,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'770","reported_seq":3485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:09.536601+0000","last_change":"2024-09-12T19:30:09.536601+0000","last_active":"2024-09-12T19:30:09.536601+0000","last_peered":"2024-09-12T19:30:09.536601+0000","last_clean":"2024-09-12T19:30:09.536601+0000","last_became_active":"2024-09-12T17:36:42.929232+0000","last_became_peered":"2024-09-12T17:36:42.929232+0000","last_unstale":"2024-09-12T19:30:09.536601+0000","last_undegraded":"2024-09-12T19:30:09.536601+0000","last_fullsized":"2024-09-12T19:30:09.536601+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'770","last_scrub_stamp":"2024-09-12T19:30:09.536408+0000","last_deep_scrub":"265'770","last_deep_scrub_stamp":"2024-09-12T19:30:09.536408+0000","last_clean_scrub_stamp":"2024-09-12T19:30:09.536408+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:48.491520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'132","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:31.184264+0000","last_change":"2024-09-12T19:30:31.184007+0000","last_active":"2024-09-12T19:30:31.184264+0000","last_peered":"2024-09-12T19:30:31.184264+0000","last_clean":"2024-09-12T19:30:31.184264+0000","last_became_active":"2024-09-12T17:36:44.945777+0000","last_became_peered":"2024-09-12T17:36:44.945777+0000","last_unstale":"2024-09-12T19:30:31.184264+0000","last_undegraded":"2024-09-12T19:30:31.184264+0000","last_fullsized":"2024-09-12T19:30:31.184264+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T19:30:31.183783+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T19:30:31.183783+0000","last_clean_scrub_stamp":"2024-09-12T19:30:31.183783+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:28.378192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":212,"num_write":329,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'432","reported_seq":1993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.395163+0000","last_change":"2024-09-12T19:30:00.395163+0000","last_active":"2024-09-12T19:30:00.395163+0000","last_peered":"2024-09-12T19:30:00.395163+0000","last_clean":"2024-09-12T19:30:00.395163+0000","last_became_active":"2024-09-12T17:36:36.896871+0000","last_became_peered":"2024-09-12T17:36:36.896871+0000","last_unstale":"2024-09-12T19:30:00.395163+0000","last_undegraded":"2024-09-12T19:30:00.395163+0000","last_fullsized":"2024-09-12T19:30:00.395163+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'432","last_scrub_stamp":"2024-09-12T19:30:00.394970+0000","last_deep_scrub":"265'432","last_deep_scrub_stamp":"2024-09-12T19:30:00.394970+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.394970+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:25.462640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2316,"num_read_kb":2187,"num_write":500,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'403","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:50.911598+0000","last_change":"2024-09-12T19:29:50.911598+0000","last_active":"2024-09-12T19:29:50.911598+0000","last_peered":"2024-09-12T19:29:50.911598+0000","last_clean":"2024-09-12T19:29:50.911598+0000","last_became_active":"2024-09-12T17:36:34.868685+0000","last_became_peered":"2024-09-12T17:36:34.868685+0000","last_unstale":"2024-09-12T19:29:50.911598+0000","last_undegraded":"2024-09-12T19:29:50.911598+0000","last_fullsized":"2024-09-12T19:29:50.911598+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T19:29:50.911321+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T19:29:50.911321+0000","last_clean_scrub_stamp":"2024-09-12T19:29:50.911321+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:21:19.555113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":585,"num_read_kb":59989,"num_write":1252,"num_write_kb":34100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.878634+0000","last_change":"2024-09-12T19:30:04.878634+0000","last_active":"2024-09-12T19:30:04.878634+0000","last_peered":"2024-09-12T19:30:04.878634+0000","last_clean":"2024-09-12T19:30:04.878634+0000","last_became_active":"2024-09-12T17:36:38.885092+0000","last_became_peered":"2024-09-12T17:36:38.885092+0000","last_unstale":"2024-09-12T19:30:04.878634+0000","last_undegraded":"2024-09-12T19:30:04.878634+0000","last_fullsized":"2024-09-12T19:30:04.878634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:04.878450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:04.878450+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.878450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:40.745336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'417","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.443193+0000","last_change":"2024-09-12T19:30:05.443046+0000","last_active":"2024-09-12T19:30:05.443193+0000","last_peered":"2024-09-12T19:30:05.443193+0000","last_clean":"2024-09-12T19:30:05.443193+0000","last_became_active":"2024-09-12T17:36:40.902484+0000","last_became_peered":"2024-09-12T17:36:40.902484+0000","last_unstale":"2024-09-12T19:30:05.443193+0000","last_undegraded":"2024-09-12T19:30:05.443193+0000","last_fullsized":"2024-09-12T19:30:05.443193+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'417","last_scrub_stamp":"2024-09-12T19:30:05.442825+0000","last_deep_scrub":"265'417","last_deep_scrub_stamp":"2024-09-12T19:30:05.442825+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.442825+0000","objects_scrubbed":9,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:44.363304+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48470,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":642,"num_read_kb":1267,"num_write":506,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:20.999926+0000","last_change":"2024-09-12T19:30:20.999926+0000","last_active":"2024-09-12T19:30:20.999926+0000","last_peered":"2024-09-12T19:30:20.999926+0000","last_clean":"2024-09-12T19:30:20.999926+0000","last_became_active":"2024-09-12T17:36:42.932462+0000","last_became_peered":"2024-09-12T17:36:42.932462+0000","last_unstale":"2024-09-12T19:30:20.999926+0000","last_undegraded":"2024-09-12T19:30:20.999926+0000","last_fullsized":"2024-09-12T19:30:20.999926+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:20.999654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:20.999654+0000","last_clean_scrub_stamp":"2024-09-12T19:30:20.999654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:28.887032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'130","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:14.797651+0000","last_change":"2024-09-12T19:30:14.797485+0000","last_active":"2024-09-12T19:30:14.797651+0000","last_peered":"2024-09-12T19:30:14.797651+0000","last_clean":"2024-09-12T19:30:14.797651+0000","last_became_active":"2024-09-12T17:36:44.943948+0000","last_became_peered":"2024-09-12T17:36:44.943948+0000","last_unstale":"2024-09-12T19:30:14.797651+0000","last_undegraded":"2024-09-12T19:30:14.797651+0000","last_fullsized":"2024-09-12T19:30:14.797651+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T19:30:14.797299+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T19:30:14.797299+0000","last_clean_scrub_stamp":"2024-09-12T19:30:14.797299+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:46.063265+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":170,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'824","reported_seq":2527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.363162+0000","last_change":"2024-09-12T19:29:59.363162+0000","last_active":"2024-09-12T19:29:59.363162+0000","last_peered":"2024-09-12T19:29:59.363162+0000","last_clean":"2024-09-12T19:29:59.363162+0000","last_became_active":"2024-09-12T17:36:36.888747+0000","last_became_peered":"2024-09-12T17:36:36.888747+0000","last_unstale":"2024-09-12T19:29:59.363162+0000","last_undegraded":"2024-09-12T19:29:59.363162+0000","last_fullsized":"2024-09-12T19:29:59.363162+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'824","last_scrub_stamp":"2024-09-12T19:29:59.362904+0000","last_deep_scrub":"265'824","last_deep_scrub_stamp":"2024-09-12T19:29:59.362904+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.362904+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:35.395617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3583,"num_write":1069,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'489","reported_seq":1186,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.227514+0000","last_change":"2024-09-12T19:29:59.227514+0000","last_active":"2024-09-12T19:29:59.227514+0000","last_peered":"2024-09-12T19:29:59.227514+0000","last_clean":"2024-09-12T19:29:59.227514+0000","last_became_active":"2024-09-12T17:36:34.876487+0000","last_became_peered":"2024-09-12T17:36:34.876487+0000","last_unstale":"2024-09-12T19:29:59.227514+0000","last_undegraded":"2024-09-12T19:29:59.227514+0000","last_fullsized":"2024-09-12T19:29:59.227514+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'489","last_scrub_stamp":"2024-09-12T19:29:59.227288+0000","last_deep_scrub":"265'489","last_deep_scrub_stamp":"2024-09-12T19:29:59.227288+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.227288+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:02.444470+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":839,"num_read_kb":5903,"num_write":1394,"num_write_kb":31714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.374675+0000","last_change":"2024-09-12T19:30:03.374675+0000","last_active":"2024-09-12T19:30:03.374675+0000","last_peered":"2024-09-12T19:30:03.374675+0000","last_clean":"2024-09-12T19:30:03.374675+0000","last_became_active":"2024-09-12T17:36:38.901575+0000","last_became_peered":"2024-09-12T17:36:38.901575+0000","last_unstale":"2024-09-12T19:30:03.374675+0000","last_undegraded":"2024-09-12T19:30:03.374675+0000","last_fullsized":"2024-09-12T19:30:03.374675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:03.374500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:03.374500+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.374500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:13.146288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'330","reported_seq":959,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:18.086301+0000","last_change":"2024-09-12T19:30:18.086301+0000","last_active":"2024-09-12T19:30:18.086301+0000","last_peered":"2024-09-12T19:30:18.086301+0000","last_clean":"2024-09-12T19:30:18.086301+0000","last_became_active":"2024-09-12T17:36:40.900739+0000","last_became_peered":"2024-09-12T17:36:40.900739+0000","last_unstale":"2024-09-12T19:30:18.086301+0000","last_undegraded":"2024-09-12T19:30:18.086301+0000","last_fullsized":"2024-09-12T19:30:18.086301+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T19:30:18.086117+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T19:30:18.086117+0000","last_clean_scrub_stamp":"2024-09-12T19:30:18.086117+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:36.835105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53836,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":1258,"num_write":448,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:25.128252+0000","last_change":"2024-09-12T19:30:25.128013+0000","last_active":"2024-09-12T19:30:25.128252+0000","last_peered":"2024-09-12T19:30:25.128252+0000","last_clean":"2024-09-12T19:30:25.128252+0000","last_became_active":"2024-09-12T17:36:42.920767+0000","last_became_peered":"2024-09-12T17:36:42.920767+0000","last_unstale":"2024-09-12T19:30:25.128252+0000","last_undegraded":"2024-09-12T19:30:25.128252+0000","last_fullsized":"2024-09-12T19:30:25.128252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:25.127761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:25.127761+0000","last_clean_scrub_stamp":"2024-09-12T19:30:25.127761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:07.524400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'125","reported_seq":688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:24.814798+0000","last_change":"2024-09-12T19:30:24.814798+0000","last_active":"2024-09-12T19:30:24.814798+0000","last_peered":"2024-09-12T19:30:24.814798+0000","last_clean":"2024-09-12T19:30:24.814798+0000","last_became_active":"2024-09-12T17:36:44.959535+0000","last_became_peered":"2024-09-12T17:36:44.959535+0000","last_unstale":"2024-09-12T19:30:24.814798+0000","last_undegraded":"2024-09-12T19:30:24.814798+0000","last_fullsized":"2024-09-12T19:30:24.814798+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-12T19:30:24.814575+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-12T19:30:24.814575+0000","last_clean_scrub_stamp":"2024-09-12T19:30:24.814575+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:41.099809+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":243,"num_read_kb":231,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'447","reported_seq":1841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.076335+0000","last_change":"2024-09-12T19:29:57.076173+0000","last_active":"2024-09-12T19:29:57.076335+0000","last_peered":"2024-09-12T19:29:57.076335+0000","last_clean":"2024-09-12T19:29:57.076335+0000","last_became_active":"2024-09-12T17:36:36.895126+0000","last_became_peered":"2024-09-12T17:36:36.895126+0000","last_unstale":"2024-09-12T19:29:57.076335+0000","last_undegraded":"2024-09-12T19:29:57.076335+0000","last_fullsized":"2024-09-12T19:29:57.076335+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'447","last_scrub_stamp":"2024-09-12T19:29:57.075990+0000","last_deep_scrub":"265'447","last_deep_scrub_stamp":"2024-09-12T19:29:57.075990+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.075990+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:34.706291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2194,"num_read_kb":2018,"num_write":546,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'364","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.905686+0000","last_change":"2024-09-12T19:29:56.905415+0000","last_active":"2024-09-12T19:29:56.905686+0000","last_peered":"2024-09-12T19:29:56.905686+0000","last_clean":"2024-09-12T19:29:56.905686+0000","last_became_active":"2024-09-12T17:36:34.878381+0000","last_became_peered":"2024-09-12T17:36:34.878381+0000","last_unstale":"2024-09-12T19:29:56.905686+0000","last_undegraded":"2024-09-12T19:29:56.905686+0000","last_fullsized":"2024-09-12T19:29:56.905686+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T19:29:56.905139+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T19:29:56.905139+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.905139+0000","objects_scrubbed":8,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:09.937198+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":568,"num_read_kb":62029,"num_write":1071,"num_write_kb":23225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.906627+0000","last_change":"2024-09-12T19:30:03.906485+0000","last_active":"2024-09-12T19:30:03.906627+0000","last_peered":"2024-09-12T19:30:03.906627+0000","last_clean":"2024-09-12T19:30:03.906627+0000","last_became_active":"2024-09-12T17:36:38.887476+0000","last_became_peered":"2024-09-12T17:36:38.887476+0000","last_unstale":"2024-09-12T19:30:03.906627+0000","last_undegraded":"2024-09-12T19:30:03.906627+0000","last_fullsized":"2024-09-12T19:30:03.906627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:03.906304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:03.906304+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.906304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:42.519260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'247","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.473177+0000","last_change":"2024-09-12T19:30:10.473177+0000","last_active":"2024-09-12T19:30:10.473177+0000","last_peered":"2024-09-12T19:30:10.473177+0000","last_clean":"2024-09-12T19:30:10.473177+0000","last_became_active":"2024-09-12T17:36:40.904126+0000","last_became_peered":"2024-09-12T17:36:40.904126+0000","last_unstale":"2024-09-12T19:30:10.473177+0000","last_undegraded":"2024-09-12T19:30:10.473177+0000","last_fullsized":"2024-09-12T19:30:10.473177+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'247","last_scrub_stamp":"2024-09-12T19:30:10.472993+0000","last_deep_scrub":"265'247","last_deep_scrub_stamp":"2024-09-12T19:30:10.472993+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.472993+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:39.731251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52700,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":960,"num_write":326,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:30.152234+0000","last_change":"2024-09-12T19:30:30.152234+0000","last_active":"2024-09-12T19:30:30.152234+0000","last_peered":"2024-09-12T19:30:30.152234+0000","last_clean":"2024-09-12T19:30:30.152234+0000","last_became_active":"2024-09-12T17:36:42.934140+0000","last_became_peered":"2024-09-12T17:36:42.934140+0000","last_unstale":"2024-09-12T19:30:30.152234+0000","last_undegraded":"2024-09-12T19:30:30.152234+0000","last_fullsized":"2024-09-12T19:30:30.152234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:30.152030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:30.152030+0000","last_clean_scrub_stamp":"2024-09-12T19:30:30.152030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:43.850534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'164","reported_seq":1664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:33.277000+0000","last_change":"2024-09-12T19:30:33.277000+0000","last_active":"2024-09-12T19:30:33.277000+0000","last_peered":"2024-09-12T19:30:33.277000+0000","last_clean":"2024-09-12T19:30:33.277000+0000","last_became_active":"2024-09-12T17:36:44.965427+0000","last_became_peered":"2024-09-12T17:36:44.965427+0000","last_unstale":"2024-09-12T19:30:33.277000+0000","last_undegraded":"2024-09-12T19:30:33.277000+0000","last_fullsized":"2024-09-12T19:30:33.277000+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'164","last_scrub_stamp":"2024-09-12T19:30:33.276752+0000","last_deep_scrub":"265'164","last_deep_scrub_stamp":"2024-09-12T19:30:33.276752+0000","last_clean_scrub_stamp":"2024-09-12T19:30:33.276752+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:52.372462+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1232,"num_read_kb":1221,"num_write":362,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'996","reported_seq":2731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.364090+0000","last_change":"2024-09-12T19:29:57.363859+0000","last_active":"2024-09-12T19:29:57.364090+0000","last_peered":"2024-09-12T19:29:57.364090+0000","last_clean":"2024-09-12T19:29:57.364090+0000","last_became_active":"2024-09-12T17:36:36.914315+0000","last_became_peered":"2024-09-12T17:36:36.914315+0000","last_unstale":"2024-09-12T19:29:57.364090+0000","last_undegraded":"2024-09-12T19:29:57.364090+0000","last_fullsized":"2024-09-12T19:29:57.364090+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'996","last_scrub_stamp":"2024-09-12T19:29:57.363633+0000","last_deep_scrub":"265'996","last_deep_scrub_stamp":"2024-09-12T19:29:57.363633+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.363633+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":900,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:14.785338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4811,"num_read_kb":4330,"num_write":1385,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'343","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.950021+0000","last_change":"2024-09-12T19:29:53.949861+0000","last_active":"2024-09-12T19:29:53.950021+0000","last_peered":"2024-09-12T19:29:53.950021+0000","last_clean":"2024-09-12T19:29:53.950021+0000","last_became_active":"2024-09-12T17:36:34.871889+0000","last_became_peered":"2024-09-12T17:36:34.871889+0000","last_unstale":"2024-09-12T19:29:53.950021+0000","last_undegraded":"2024-09-12T19:29:53.950021+0000","last_fullsized":"2024-09-12T19:29:53.950021+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:29:53.949641+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:29:53.949641+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.949641+0000","objects_scrubbed":10,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:44.653793+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526421,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":468,"num_read_kb":13877,"num_write":1131,"num_write_kb":46739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:11.056244+0000","last_change":"2024-09-12T19:30:11.056083+0000","last_active":"2024-09-12T19:30:11.056244+0000","last_peered":"2024-09-12T19:30:11.056244+0000","last_clean":"2024-09-12T19:30:11.056244+0000","last_became_active":"2024-09-12T17:36:38.882018+0000","last_became_peered":"2024-09-12T17:36:38.882018+0000","last_unstale":"2024-09-12T19:30:11.056244+0000","last_undegraded":"2024-09-12T19:30:11.056244+0000","last_fullsized":"2024-09-12T19:30:11.056244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:30:11.055899+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:30:11.055899+0000","last_clean_scrub_stamp":"2024-09-12T19:30:11.055899+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:12.704129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'331","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:21.222919+0000","last_change":"2024-09-12T19:30:21.222919+0000","last_active":"2024-09-12T19:30:21.222919+0000","last_peered":"2024-09-12T19:30:21.222919+0000","last_clean":"2024-09-12T19:30:21.222919+0000","last_became_active":"2024-09-12T17:36:40.908611+0000","last_became_peered":"2024-09-12T17:36:40.908611+0000","last_unstale":"2024-09-12T19:30:21.222919+0000","last_undegraded":"2024-09-12T19:30:21.222919+0000","last_fullsized":"2024-09-12T19:30:21.222919+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T19:30:21.222706+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T19:30:21.222706+0000","last_clean_scrub_stamp":"2024-09-12T19:30:21.222706+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:56.630835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53448,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":560,"num_read_kb":1204,"num_write":440,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:22.993841+0000","last_change":"2024-09-12T19:30:22.993841+0000","last_active":"2024-09-12T19:30:22.993841+0000","last_peered":"2024-09-12T19:30:22.993841+0000","last_clean":"2024-09-12T19:30:22.993841+0000","last_became_active":"2024-09-12T17:36:42.933510+0000","last_became_peered":"2024-09-12T17:36:42.933510+0000","last_unstale":"2024-09-12T19:30:22.993841+0000","last_undegraded":"2024-09-12T19:30:22.993841+0000","last_fullsized":"2024-09-12T19:30:22.993841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:30:22.993659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:30:22.993659+0000","last_clean_scrub_stamp":"2024-09-12T19:30:22.993659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:19.000151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'129","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.498377+0000","last_change":"2024-09-12T19:30:08.498377+0000","last_active":"2024-09-12T19:30:08.498377+0000","last_peered":"2024-09-12T19:30:08.498377+0000","last_clean":"2024-09-12T19:30:08.498377+0000","last_became_active":"2024-09-12T17:36:44.960641+0000","last_became_peered":"2024-09-12T17:36:44.960641+0000","last_unstale":"2024-09-12T19:30:08.498377+0000","last_undegraded":"2024-09-12T19:30:08.498377+0000","last_fullsized":"2024-09-12T19:30:08.498377+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T19:30:08.498183+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T19:30:08.498183+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.498183+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:18.321995+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":181,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'933","reported_seq":2739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.902416+0000","last_change":"2024-09-12T19:30:01.902416+0000","last_active":"2024-09-12T19:30:01.902416+0000","last_peered":"2024-09-12T19:30:01.902416+0000","last_clean":"2024-09-12T19:30:01.902416+0000","last_became_active":"2024-09-12T17:36:36.901046+0000","last_became_peered":"2024-09-12T17:36:36.901046+0000","last_unstale":"2024-09-12T19:30:01.902416+0000","last_undegraded":"2024-09-12T19:30:01.902416+0000","last_fullsized":"2024-09-12T19:30:01.902416+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'933","last_scrub_stamp":"2024-09-12T19:30:01.902200+0000","last_deep_scrub":"265'933","last_deep_scrub_stamp":"2024-09-12T19:30:01.902200+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.902200+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:50.473986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4712,"num_read_kb":4247,"num_write":1250,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4079,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'415","reported_seq":1136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:48.380260+0000","last_change":"2024-09-12T19:29:48.380197+0000","last_active":"2024-09-12T19:29:48.380260+0000","last_peered":"2024-09-12T19:29:48.380260+0000","last_clean":"2024-09-12T19:29:48.380260+0000","last_became_active":"2024-09-12T17:36:34.884112+0000","last_became_peered":"2024-09-12T17:36:34.884112+0000","last_unstale":"2024-09-12T19:29:48.380260+0000","last_undegraded":"2024-09-12T19:29:48.380260+0000","last_fullsized":"2024-09-12T19:29:48.380260+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:29:48.380120+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:29:48.380120+0000","last_clean_scrub_stamp":"2024-09-12T19:29:48.380120+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:19.901040+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":11450,"num_write":1282,"num_write_kb":27380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'656","reported_seq":2325,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.057909+0000","last_change":"2024-09-12T19:29:59.057909+0000","last_active":"2024-09-12T19:29:59.057909+0000","last_peered":"2024-09-12T19:29:59.057909+0000","last_clean":"2024-09-12T19:29:59.057909+0000","last_became_active":"2024-09-12T17:36:36.916477+0000","last_became_peered":"2024-09-12T17:36:36.916477+0000","last_unstale":"2024-09-12T19:29:59.057909+0000","last_undegraded":"2024-09-12T19:29:59.057909+0000","last_fullsized":"2024-09-12T19:29:59.057909+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'656","last_scrub_stamp":"2024-09-12T19:29:59.057726+0000","last_deep_scrub":"265'656","last_deep_scrub_stamp":"2024-09-12T19:29:59.057726+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.057726+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:13.858705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3261,"num_read_kb":2946,"num_write":856,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'371","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.126039+0000","last_change":"2024-09-12T19:29:53.125878+0000","last_active":"2024-09-12T19:29:53.126039+0000","last_peered":"2024-09-12T19:29:53.126039+0000","last_clean":"2024-09-12T19:29:53.126039+0000","last_became_active":"2024-09-12T17:36:34.862008+0000","last_became_peered":"2024-09-12T17:36:34.862008+0000","last_unstale":"2024-09-12T19:29:53.126039+0000","last_undegraded":"2024-09-12T19:29:53.126039+0000","last_fullsized":"2024-09-12T19:29:53.126039+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T19:29:53.125690+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T19:29:53.125690+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.125690+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:00.140459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648670,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":45708,"num_write":1154,"num_write_kb":41141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'444","reported_seq":2016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:10.196846+0000","last_change":"2024-09-12T19:30:10.196846+0000","last_active":"2024-09-12T19:30:10.196846+0000","last_peered":"2024-09-12T19:30:10.196846+0000","last_clean":"2024-09-12T19:30:10.196846+0000","last_became_active":"2024-09-12T17:36:36.875947+0000","last_became_peered":"2024-09-12T17:36:36.875947+0000","last_unstale":"2024-09-12T19:30:10.196846+0000","last_undegraded":"2024-09-12T19:30:10.196846+0000","last_fullsized":"2024-09-12T19:30:10.196846+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'444","last_scrub_stamp":"2024-09-12T19:30:10.196736+0000","last_deep_scrub":"265'444","last_deep_scrub_stamp":"2024-09-12T19:30:10.196736+0000","last_clean_scrub_stamp":"2024-09-12T19:30:10.196736+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:21.092717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2143,"num_write":507,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'350","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.197803+0000","last_change":"2024-09-12T19:30:00.197660+0000","last_active":"2024-09-12T19:30:00.197803+0000","last_peered":"2024-09-12T19:30:00.197803+0000","last_clean":"2024-09-12T19:30:00.197803+0000","last_became_active":"2024-09-12T17:36:34.892664+0000","last_became_peered":"2024-09-12T17:36:34.892664+0000","last_unstale":"2024-09-12T19:30:00.197803+0000","last_undegraded":"2024-09-12T19:30:00.197803+0000","last_fullsized":"2024-09-12T19:30:00.197803+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-12T19:30:00.197372+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-12T19:30:00.197372+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.197372+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:40.921623+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4719915,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":523,"num_read_kb":15114,"num_write":1089,"num_write_kb":33687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'453","reported_seq":2063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:06.901219+0000","last_change":"2024-09-12T19:30:06.901219+0000","last_active":"2024-09-12T19:30:06.901219+0000","last_peered":"2024-09-12T19:30:06.901219+0000","last_clean":"2024-09-12T19:30:06.901219+0000","last_became_active":"2024-09-12T17:36:36.886646+0000","last_became_peered":"2024-09-12T17:36:36.886646+0000","last_unstale":"2024-09-12T19:30:06.901219+0000","last_undegraded":"2024-09-12T19:30:06.901219+0000","last_fullsized":"2024-09-12T19:30:06.901219+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'453","last_scrub_stamp":"2024-09-12T19:30:06.901026+0000","last_deep_scrub":"265'453","last_deep_scrub_stamp":"2024-09-12T19:30:06.901026+0000","last_clean_scrub_stamp":"2024-09-12T19:30:06.901026+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:17.596822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2431,"num_read_kb":2290,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'322","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.891849+0000","last_change":"2024-09-12T19:29:54.891849+0000","last_active":"2024-09-12T19:29:54.891849+0000","last_peered":"2024-09-12T19:29:54.891849+0000","last_clean":"2024-09-12T19:29:54.891849+0000","last_became_active":"2024-09-12T17:36:34.875514+0000","last_became_peered":"2024-09-12T17:36:34.875514+0000","last_unstale":"2024-09-12T19:29:54.891849+0000","last_undegraded":"2024-09-12T19:29:54.891849+0000","last_fullsized":"2024-09-12T19:29:54.891849+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:29:54.891644+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:29:54.891644+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.891644+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:20.204730+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515054,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":12724,"num_write":938,"num_write_kb":21079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'472","reported_seq":2087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.917918+0000","last_change":"2024-09-12T19:30:05.917918+0000","last_active":"2024-09-12T19:30:05.917918+0000","last_peered":"2024-09-12T19:30:05.917918+0000","last_clean":"2024-09-12T19:30:05.917918+0000","last_became_active":"2024-09-12T17:36:36.895580+0000","last_became_peered":"2024-09-12T17:36:36.895580+0000","last_unstale":"2024-09-12T19:30:05.917918+0000","last_undegraded":"2024-09-12T19:30:05.917918+0000","last_fullsized":"2024-09-12T19:30:05.917918+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'472","last_scrub_stamp":"2024-09-12T19:30:05.917613+0000","last_deep_scrub":"265'472","last_deep_scrub_stamp":"2024-09-12T19:30:05.917613+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.917613+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:46.828526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2410,"num_read_kb":2268,"num_write":522,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'383","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.377960+0000","last_change":"2024-09-12T19:29:53.377960+0000","last_active":"2024-09-12T19:29:53.377960+0000","last_peered":"2024-09-12T19:29:53.377960+0000","last_clean":"2024-09-12T19:29:53.377960+0000","last_became_active":"2024-09-12T17:36:34.875282+0000","last_became_peered":"2024-09-12T17:36:34.875282+0000","last_unstale":"2024-09-12T19:29:53.377960+0000","last_undegraded":"2024-09-12T19:29:53.377960+0000","last_fullsized":"2024-09-12T19:29:53.377960+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T19:29:53.377757+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T19:29:53.377757+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.377757+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:35.803143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568489,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":16784,"num_write":1071,"num_write_kb":43648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'874","reported_seq":2689,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.367917+0000","last_change":"2024-09-12T19:29:59.367917+0000","last_active":"2024-09-12T19:29:59.367917+0000","last_peered":"2024-09-12T19:29:59.367917+0000","last_clean":"2024-09-12T19:29:59.367917+0000","last_became_active":"2024-09-12T17:36:36.879875+0000","last_became_peered":"2024-09-12T17:36:36.879875+0000","last_unstale":"2024-09-12T19:29:59.367917+0000","last_undegraded":"2024-09-12T19:29:59.367917+0000","last_fullsized":"2024-09-12T19:29:59.367917+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'874","last_scrub_stamp":"2024-09-12T19:29:59.367728+0000","last_deep_scrub":"265'874","last_deep_scrub_stamp":"2024-09-12T19:29:59.367728+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.367728+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:32.664577+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4378,"num_read_kb":3985,"num_write":1124,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1318,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'322","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.516329+0000","last_change":"2024-09-12T19:30:02.516329+0000","last_active":"2024-09-12T19:30:02.516329+0000","last_peered":"2024-09-12T19:30:02.516329+0000","last_clean":"2024-09-12T19:30:02.516329+0000","last_became_active":"2024-09-12T17:36:34.880893+0000","last_became_peered":"2024-09-12T17:36:34.880893+0000","last_unstale":"2024-09-12T19:30:02.516329+0000","last_undegraded":"2024-09-12T19:30:02.516329+0000","last_fullsized":"2024-09-12T19:30:02.516329+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:30:02.516130+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:30:02.516130+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.516130+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.498669+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":34772,"num_write":1049,"num_write_kb":43573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'1179","reported_seq":2773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.482459+0000","last_change":"2024-09-12T19:30:01.482459+0000","last_active":"2024-09-12T19:30:01.482459+0000","last_peered":"2024-09-12T19:30:01.482459+0000","last_clean":"2024-09-12T19:30:01.482459+0000","last_became_active":"2024-09-12T17:36:36.897985+0000","last_became_peered":"2024-09-12T17:36:36.897985+0000","last_unstale":"2024-09-12T19:30:01.482459+0000","last_undegraded":"2024-09-12T19:30:01.482459+0000","last_fullsized":"2024-09-12T19:30:01.482459+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1179","last_scrub_stamp":"2024-09-12T19:30:01.482241+0000","last_deep_scrub":"265'1179","last_deep_scrub_stamp":"2024-09-12T19:30:01.482241+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.482241+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:27.270588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5405,"num_read_kb":4772,"num_write":1628,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1111,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'394","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.321112+0000","last_change":"2024-09-12T19:29:52.321112+0000","last_active":"2024-09-12T19:29:52.321112+0000","last_peered":"2024-09-12T19:29:52.321112+0000","last_clean":"2024-09-12T19:29:52.321112+0000","last_became_active":"2024-09-12T17:36:34.876834+0000","last_became_peered":"2024-09-12T17:36:34.876834+0000","last_unstale":"2024-09-12T19:29:52.321112+0000","last_undegraded":"2024-09-12T19:29:52.321112+0000","last_fullsized":"2024-09-12T19:29:52.321112+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T19:29:52.320936+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T19:29:52.320936+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.320936+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:16.090065+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":595,"num_read_kb":4635,"num_write":1236,"num_write_kb":22932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'773","reported_seq":2370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:53.859989+0000","last_change":"2024-09-12T19:29:53.859989+0000","last_active":"2024-09-12T19:29:53.859989+0000","last_peered":"2024-09-12T19:29:53.859989+0000","last_clean":"2024-09-12T19:29:53.859989+0000","last_became_active":"2024-09-12T17:36:36.901293+0000","last_became_peered":"2024-09-12T17:36:36.901293+0000","last_unstale":"2024-09-12T19:29:53.859989+0000","last_undegraded":"2024-09-12T19:29:53.859989+0000","last_fullsized":"2024-09-12T19:29:53.859989+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T19:29:53.859804+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T19:29:53.859804+0000","last_clean_scrub_stamp":"2024-09-12T19:29:53.859804+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:29.780177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3323,"num_write":979,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'347","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:52.926866+0000","last_change":"2024-09-12T19:29:52.926866+0000","last_active":"2024-09-12T19:29:52.926866+0000","last_peered":"2024-09-12T19:29:52.926866+0000","last_clean":"2024-09-12T19:29:52.926866+0000","last_became_active":"2024-09-12T17:36:34.872999+0000","last_became_peered":"2024-09-12T17:36:34.872999+0000","last_unstale":"2024-09-12T19:29:52.926866+0000","last_undegraded":"2024-09-12T19:29:52.926866+0000","last_fullsized":"2024-09-12T19:29:52.926866+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:29:52.926633+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:29:52.926633+0000","last_clean_scrub_stamp":"2024-09-12T19:29:52.926633+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:12.827832+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":667,"num_read_kb":7832,"num_write":1127,"num_write_kb":31819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'779","reported_seq":2256,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.088478+0000","last_change":"2024-09-12T19:30:02.088334+0000","last_active":"2024-09-12T19:30:02.088478+0000","last_peered":"2024-09-12T19:30:02.088478+0000","last_clean":"2024-09-12T19:30:02.088478+0000","last_became_active":"2024-09-12T17:36:36.903948+0000","last_became_peered":"2024-09-12T17:36:36.903948+0000","last_unstale":"2024-09-12T19:30:02.088478+0000","last_undegraded":"2024-09-12T19:30:02.088478+0000","last_fullsized":"2024-09-12T19:30:02.088478+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'779","last_scrub_stamp":"2024-09-12T19:30:02.088151+0000","last_deep_scrub":"265'779","last_deep_scrub_stamp":"2024-09-12T19:30:02.088151+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.088151+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:31.427535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3650,"num_read_kb":3275,"num_write":1024,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'413","reported_seq":1181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:04.145594+0000","last_change":"2024-09-12T19:30:04.145594+0000","last_active":"2024-09-12T19:30:04.145594+0000","last_peered":"2024-09-12T19:30:04.145594+0000","last_clean":"2024-09-12T19:30:04.145594+0000","last_became_active":"2024-09-12T17:36:34.891638+0000","last_became_peered":"2024-09-12T17:36:34.891638+0000","last_unstale":"2024-09-12T19:30:04.145594+0000","last_undegraded":"2024-09-12T19:30:04.145594+0000","last_fullsized":"2024-09-12T19:30:04.145594+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'413","last_scrub_stamp":"2024-09-12T19:30:04.145362+0000","last_deep_scrub":"265'413","last_deep_scrub_stamp":"2024-09-12T19:30:04.145362+0000","last_clean_scrub_stamp":"2024-09-12T19:30:04.145362+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:20.894452+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":824,"num_read_kb":23553,"num_write":1317,"num_write_kb":41342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'1233","reported_seq":2992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.364624+0000","last_change":"2024-09-12T19:29:57.364430+0000","last_active":"2024-09-12T19:29:57.364624+0000","last_peered":"2024-09-12T19:29:57.364624+0000","last_clean":"2024-09-12T19:29:57.364624+0000","last_became_active":"2024-09-12T17:36:36.906463+0000","last_became_peered":"2024-09-12T17:36:36.906463+0000","last_unstale":"2024-09-12T19:29:57.364624+0000","last_undegraded":"2024-09-12T19:29:57.364624+0000","last_fullsized":"2024-09-12T19:29:57.364624+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1233","last_scrub_stamp":"2024-09-12T19:29:57.364153+0000","last_deep_scrub":"265'1233","last_deep_scrub_stamp":"2024-09-12T19:29:57.364153+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.364153+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":1200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:42.031824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5684,"num_read_kb":5045,"num_write":1688,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'343","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.902923+0000","last_change":"2024-09-12T19:29:55.902923+0000","last_active":"2024-09-12T19:29:55.902923+0000","last_peered":"2024-09-12T19:29:55.902923+0000","last_clean":"2024-09-12T19:29:55.902923+0000","last_became_active":"2024-09-12T17:36:34.873189+0000","last_became_peered":"2024-09-12T17:36:34.873189+0000","last_unstale":"2024-09-12T19:29:55.902923+0000","last_undegraded":"2024-09-12T19:29:55.902923+0000","last_fullsized":"2024-09-12T19:29:55.902923+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:29:55.902646+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:29:55.902646+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.902646+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:22.918198+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284213,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":39048,"num_write":958,"num_write_kb":38605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'1002","reported_seq":2715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:08.836395+0000","last_change":"2024-09-12T19:30:08.836395+0000","last_active":"2024-09-12T19:30:08.836395+0000","last_peered":"2024-09-12T19:30:08.836395+0000","last_clean":"2024-09-12T19:30:08.836395+0000","last_became_active":"2024-09-12T17:36:36.875791+0000","last_became_peered":"2024-09-12T17:36:36.875791+0000","last_unstale":"2024-09-12T19:30:08.836395+0000","last_undegraded":"2024-09-12T19:30:08.836395+0000","last_fullsized":"2024-09-12T19:30:08.836395+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1002","last_scrub_stamp":"2024-09-12T19:30:08.836221+0000","last_deep_scrub":"265'1002","last_deep_scrub_stamp":"2024-09-12T19:30:08.836221+0000","last_clean_scrub_stamp":"2024-09-12T19:30:08.836221+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":900,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:17.299248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4962,"num_read_kb":4419,"num_write":1465,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":724,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'253","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.905945+0000","last_change":"2024-09-12T19:29:47.905945+0000","last_active":"2024-09-12T19:29:47.905945+0000","last_peered":"2024-09-12T19:29:47.905945+0000","last_clean":"2024-09-12T19:29:47.905945+0000","last_became_active":"2024-09-12T17:36:34.866719+0000","last_became_peered":"2024-09-12T17:36:34.866719+0000","last_unstale":"2024-09-12T19:29:47.905945+0000","last_undegraded":"2024-09-12T19:29:47.905945+0000","last_fullsized":"2024-09-12T19:29:47.905945+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-12T19:29:47.905866+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-12T19:29:47.905866+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.905866+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:35.987815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":13747,"num_write":787,"num_write_kb":14866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'511","reported_seq":2137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:55.833711+0000","last_change":"2024-09-12T19:29:55.833711+0000","last_active":"2024-09-12T19:29:55.833711+0000","last_peered":"2024-09-12T19:29:55.833711+0000","last_clean":"2024-09-12T19:29:55.833711+0000","last_became_active":"2024-09-12T17:36:36.914327+0000","last_became_peered":"2024-09-12T17:36:36.914327+0000","last_unstale":"2024-09-12T19:29:55.833711+0000","last_undegraded":"2024-09-12T19:29:55.833711+0000","last_fullsized":"2024-09-12T19:29:55.833711+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'511","last_scrub_stamp":"2024-09-12T19:29:55.833505+0000","last_deep_scrub":"265'511","last_deep_scrub_stamp":"2024-09-12T19:29:55.833505+0000","last_clean_scrub_stamp":"2024-09-12T19:29:55.833505+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:26.792835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2629,"num_read_kb":2439,"num_write":603,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'303","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:59.909782+0000","last_change":"2024-09-12T19:29:59.909782+0000","last_active":"2024-09-12T19:29:59.909782+0000","last_peered":"2024-09-12T19:29:59.909782+0000","last_clean":"2024-09-12T19:29:59.909782+0000","last_became_active":"2024-09-12T17:36:34.864682+0000","last_became_peered":"2024-09-12T17:36:34.864682+0000","last_unstale":"2024-09-12T19:29:59.909782+0000","last_undegraded":"2024-09-12T19:29:59.909782+0000","last_fullsized":"2024-09-12T19:29:59.909782+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T19:29:59.909589+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T19:29:59.909589+0000","last_clean_scrub_stamp":"2024-09-12T19:29:59.909589+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:21:13.619686+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":386,"num_read_kb":10447,"num_write":906,"num_write_kb":22906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'846","reported_seq":2476,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.841442+0000","last_change":"2024-09-12T19:29:54.841442+0000","last_active":"2024-09-12T19:29:54.841442+0000","last_peered":"2024-09-12T19:29:54.841442+0000","last_clean":"2024-09-12T19:29:54.841442+0000","last_became_active":"2024-09-12T17:36:36.885956+0000","last_became_peered":"2024-09-12T17:36:36.885956+0000","last_unstale":"2024-09-12T19:29:54.841442+0000","last_undegraded":"2024-09-12T19:29:54.841442+0000","last_fullsized":"2024-09-12T19:29:54.841442+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'846","last_scrub_stamp":"2024-09-12T19:29:54.841249+0000","last_deep_scrub":"265'846","last_deep_scrub_stamp":"2024-09-12T19:29:54.841249+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.841249+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:55.821229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3814,"num_read_kb":3459,"num_write":1078,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'375","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:47.405081+0000","last_change":"2024-09-12T19:29:47.405081+0000","last_active":"2024-09-12T19:29:47.405081+0000","last_peered":"2024-09-12T19:29:47.405081+0000","last_clean":"2024-09-12T19:29:47.405081+0000","last_became_active":"2024-09-12T17:36:34.865344+0000","last_became_peered":"2024-09-12T17:36:34.865344+0000","last_unstale":"2024-09-12T19:29:47.405081+0000","last_undegraded":"2024-09-12T19:29:47.405081+0000","last_fullsized":"2024-09-12T19:29:47.405081+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:29:47.404998+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:29:47.404998+0000","last_clean_scrub_stamp":"2024-09-12T19:29:47.404998+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:12.580297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":55805,"num_write":1199,"num_write_kb":26331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'725","reported_seq":2145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:00.086920+0000","last_change":"2024-09-12T19:30:00.086920+0000","last_active":"2024-09-12T19:30:00.086920+0000","last_peered":"2024-09-12T19:30:00.086920+0000","last_clean":"2024-09-12T19:30:00.086920+0000","last_became_active":"2024-09-12T17:36:36.916289+0000","last_became_peered":"2024-09-12T17:36:36.916289+0000","last_unstale":"2024-09-12T19:30:00.086920+0000","last_undegraded":"2024-09-12T19:30:00.086920+0000","last_fullsized":"2024-09-12T19:30:00.086920+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'725","last_scrub_stamp":"2024-09-12T19:30:00.086735+0000","last_deep_scrub":"265'725","last_deep_scrub_stamp":"2024-09-12T19:30:00.086735+0000","last_clean_scrub_stamp":"2024-09-12T19:30:00.086735+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:01.389997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3361,"num_read_kb":3032,"num_write":954,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'378","reported_seq":1272,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.209603+0000","last_change":"2024-09-12T19:30:01.209603+0000","last_active":"2024-09-12T19:30:01.209603+0000","last_peered":"2024-09-12T19:30:01.209603+0000","last_clean":"2024-09-12T19:30:01.209603+0000","last_became_active":"2024-09-12T17:36:34.875748+0000","last_became_peered":"2024-09-12T17:36:34.875748+0000","last_unstale":"2024-09-12T19:30:01.209603+0000","last_undegraded":"2024-09-12T19:30:01.209603+0000","last_fullsized":"2024-09-12T19:30:01.209603+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:30:01.209395+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:30:01.209395+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.209395+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:15.055583+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311597,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":946,"num_read_kb":75770,"num_write":1026,"num_write_kb":38932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'578","reported_seq":2198,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.899816+0000","last_change":"2024-09-12T19:30:03.899816+0000","last_active":"2024-09-12T19:30:03.899816+0000","last_peered":"2024-09-12T19:30:03.899816+0000","last_clean":"2024-09-12T19:30:03.899816+0000","last_became_active":"2024-09-12T17:36:36.902941+0000","last_became_peered":"2024-09-12T17:36:36.902941+0000","last_unstale":"2024-09-12T19:30:03.899816+0000","last_undegraded":"2024-09-12T19:30:03.899816+0000","last_fullsized":"2024-09-12T19:30:03.899816+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'578","last_scrub_stamp":"2024-09-12T19:30:03.899626+0000","last_deep_scrub":"265'578","last_deep_scrub_stamp":"2024-09-12T19:30:03.899626+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.899626+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:57.866591+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2851,"num_read_kb":2607,"num_write":694,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1263,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'382","reported_seq":1069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:54.109138+0000","last_change":"2024-09-12T19:29:54.108963+0000","last_active":"2024-09-12T19:29:54.109138+0000","last_peered":"2024-09-12T19:29:54.109138+0000","last_clean":"2024-09-12T19:29:54.109138+0000","last_became_active":"2024-09-12T17:36:34.868083+0000","last_became_peered":"2024-09-12T17:36:34.868083+0000","last_unstale":"2024-09-12T19:29:54.109138+0000","last_undegraded":"2024-09-12T19:29:54.109138+0000","last_fullsized":"2024-09-12T19:29:54.109138+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T19:29:54.108756+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T19:29:54.108756+0000","last_clean_scrub_stamp":"2024-09-12T19:29:54.108756+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:42.132817+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526437,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":549,"num_read_kb":53048,"num_write":1215,"num_write_kb":26068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'579","reported_seq":2527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:56.868550+0000","last_change":"2024-09-12T19:29:56.868550+0000","last_active":"2024-09-12T19:29:56.868550+0000","last_peered":"2024-09-12T19:29:56.868550+0000","last_clean":"2024-09-12T19:29:56.868550+0000","last_became_active":"2024-09-12T17:36:36.891412+0000","last_became_peered":"2024-09-12T17:36:36.891412+0000","last_unstale":"2024-09-12T19:29:56.868550+0000","last_undegraded":"2024-09-12T19:29:56.868550+0000","last_fullsized":"2024-09-12T19:29:56.868550+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'579","last_scrub_stamp":"2024-09-12T19:29:56.868376+0000","last_deep_scrub":"265'579","last_deep_scrub_stamp":"2024-09-12T19:29:56.868376+0000","last_clean_scrub_stamp":"2024-09-12T19:29:56.868376+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:06.248111+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3296,"num_read_kb":3095,"num_write":679,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'406","reported_seq":1100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:02.174044+0000","last_change":"2024-09-12T19:30:02.173896+0000","last_active":"2024-09-12T19:30:02.174044+0000","last_peered":"2024-09-12T19:30:02.174044+0000","last_clean":"2024-09-12T19:30:02.174044+0000","last_became_active":"2024-09-12T17:36:34.872242+0000","last_became_peered":"2024-09-12T17:36:34.872242+0000","last_unstale":"2024-09-12T19:30:02.174044+0000","last_undegraded":"2024-09-12T19:30:02.174044+0000","last_fullsized":"2024-09-12T19:30:02.174044+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'406","last_scrub_stamp":"2024-09-12T19:30:02.173660+0000","last_deep_scrub":"265'406","last_deep_scrub_stamp":"2024-09-12T19:30:02.173660+0000","last_clean_scrub_stamp":"2024-09-12T19:30:02.173660+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:33.109697+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2448269,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":538,"num_read_kb":8811,"num_write":1195,"num_write_kb":19313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"265'376","reported_seq":1086,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:03.178647+0000","last_change":"2024-09-12T19:30:03.178506+0000","last_active":"2024-09-12T19:30:03.178647+0000","last_peered":"2024-09-12T19:30:03.178647+0000","last_clean":"2024-09-12T19:30:03.178647+0000","last_became_active":"2024-09-12T17:36:34.861821+0000","last_became_peered":"2024-09-12T17:36:34.861821+0000","last_unstale":"2024-09-12T19:30:03.178647+0000","last_undegraded":"2024-09-12T19:30:03.178647+0000","last_fullsized":"2024-09-12T19:30:03.178647+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:30:03.178293+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:30:03.178293+0000","last_clean_scrub_stamp":"2024-09-12T19:30:03.178293+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:36.494496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":100665,"num_write":1084,"num_write_kb":41422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'575","reported_seq":2183,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:05.918403+0000","last_change":"2024-09-12T19:30:05.918153+0000","last_active":"2024-09-12T19:30:05.918403+0000","last_peered":"2024-09-12T19:30:05.918403+0000","last_clean":"2024-09-12T19:30:05.918403+0000","last_became_active":"2024-09-12T17:36:36.911855+0000","last_became_peered":"2024-09-12T17:36:36.911855+0000","last_unstale":"2024-09-12T19:30:05.918403+0000","last_undegraded":"2024-09-12T19:30:05.918403+0000","last_fullsized":"2024-09-12T19:30:05.918403+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'575","last_scrub_stamp":"2024-09-12T19:30:05.917870+0000","last_deep_scrub":"265'575","last_deep_scrub_stamp":"2024-09-12T19:30:05.917870+0000","last_clean_scrub_stamp":"2024-09-12T19:30:05.917870+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:40.019170+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2849,"num_read_kb":2620,"num_write":728,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'342","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:29:57.897611+0000","last_change":"2024-09-12T19:29:57.897450+0000","last_active":"2024-09-12T19:29:57.897611+0000","last_peered":"2024-09-12T19:29:57.897611+0000","last_clean":"2024-09-12T19:29:57.897611+0000","last_became_active":"2024-09-12T17:36:34.881262+0000","last_became_peered":"2024-09-12T17:36:34.881262+0000","last_unstale":"2024-09-12T19:29:57.897611+0000","last_undegraded":"2024-09-12T19:29:57.897611+0000","last_fullsized":"2024-09-12T19:29:57.897611+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T19:29:57.897247+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T19:29:57.897247+0000","last_clean_scrub_stamp":"2024-09-12T19:29:57.897247+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:58.010163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":969137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":479,"num_read_kb":5153,"num_write":1034,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'505","reported_seq":2118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:30:01.887751+0000","last_change":"2024-09-12T19:30:01.887588+0000","last_active":"2024-09-12T19:30:01.887751+0000","last_peered":"2024-09-12T19:30:01.887751+0000","last_clean":"2024-09-12T19:30:01.887751+0000","last_became_active":"2024-09-12T17:36:36.901857+0000","last_became_peered":"2024-09-12T17:36:36.901857+0000","last_unstale":"2024-09-12T19:30:01.887751+0000","last_undegraded":"2024-09-12T19:30:01.887751+0000","last_fullsized":"2024-09-12T19:30:01.887751+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:30:01.887410+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:30:01.887410+0000","last_clean_scrub_stamp":"2024-09-12T19:30:01.887410+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:36.054880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2642,"num_read_kb":2459,"num_write":621,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5957,"num_read_kb":4161,"num_write":1935,"num_write_kb":833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6965,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1108,"ondisk_log_size":1108,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16299,"num_read_kb":15966,"num_write":16741,"num_write_kb":4895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1564,"ondisk_log_size":1564,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1604320,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":20976,"num_read_kb":40444,"num_write":17515,"num_write_kb":12474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685912,"num_omap_keys":1576,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1579,"ondisk_log_size":1579,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194467,"num_write":55293,"num_write_kb":18855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43794,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3877,"ondisk_log_size":3877,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":67082726,"num_objects":379,"num_object_clones":0,"num_object_copies":758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":36361,"num_read_kb":1891027,"num_write":71889,"num_write_kb":2051812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135487488,"data_stored":134165452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4005,"ondisk_log_size":4005,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":193786,"num_write":186,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":184511,"num_write":186,"num_write_kb":126129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510826,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217412,"kb_used_data":9972,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94154428,"statfs":{"total":96636764160,"available":96414134272,"internally_reserved":0,"allocated":10211328,"data_stored":8566552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510823,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258688,"kb_used_data":24816,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94113152,"statfs":{"total":96636764160,"available":96371867648,"internally_reserved":0,"allocated":25411584,"data_stored":23641054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510827,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191112,"kb_used_data":15608,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94180728,"statfs":{"total":96636764160,"available":96441065472,"internally_reserved":0,"allocated":15982592,"data_stored":14328646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510823,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":222896,"kb_used_data":29280,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94148944,"statfs":{"total":96636764160,"available":96408518656,"internally_reserved":0,"allocated":29982720,"data_stored":28233002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510826,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131872,"kb_used_data":24336,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94239968,"statfs":{"total":96636764160,"available":96501727232,"internally_reserved":0,"allocated":24920064,"data_stored":23230965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510823,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276332,"kb_used_data":10524,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94095508,"statfs":{"total":96636764160,"available":96353800192,"internally_reserved":0,"allocated":10776576,"data_stored":9102273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510824,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106204,"kb_used_data":20940,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94265636,"statfs":{"total":96636764160,"available":96528011264,"internally_reserved":0,"allocated":21442560,"data_stored":19672532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543528,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116012,"kb_used_data":26588,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94255828,"statfs":{"total":96636764160,"available":96517967872,"internally_reserved":0,"allocated":27226112,"data_stored":25491082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17780736,"data_stored":17557812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6524928,"data_stored":6398837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21286912,"data_stored":21117656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26320896,"data_stored":26118766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12324864,"data_stored":12211453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21143552,"data_stored":20934570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23552000,"data_stored":23375118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6553600,"data_stored":6451240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:31:11.729 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T19:31:12.082 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T19:31:12.082 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T19:31:12.082 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T19:31:12.082 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.163 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T19:31:12.163 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T19:31:12.163 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.254 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T19:31:12.255 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T19:31:12.255 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.332 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T19:31:12.332 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T19:31:12.333 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.412 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T19:31:12.413 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T19:31:12.413 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.496 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T19:31:12.496 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T19:31:12.497 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.585 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T19:31:12.585 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T19:31:12.585 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.677 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T19:31:12.677 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T19:31:12.677 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.756 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T19:31:12.756 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T19:31:12.756 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T19:31:12.756 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.788 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T19:31:12.788 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T19:31:12.788 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.817 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T19:31:12.817 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T19:31:12.817 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T19:31:12.817 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.854 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T19:31:12.855 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T19:31:12.855 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.926 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T19:31:12.926 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T19:31:12.926 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:31:12.957 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T19:31:12.957 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T19:31:12.958 DEBUG:teuthology.orchestra.run.smithi097:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T19:31:12.983 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T19:31:12.984 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T19:31:13.402 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T19:31:13.403 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T19:31:13.664 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T19:31:13.664 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T19:31:13.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T19:31:13.848 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T19:31:14.019 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T19:31:14.019 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T19:31:14.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T19:31:14.366 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T19:31:14.557 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T19:31:14.557 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T19:31:14.748 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T19:31:14.749 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T19:31:14.938 INFO:tasks.ceph:Archiving mon data... 2024-09-12T19:31:14.940 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732/data/mon.a.tgz 2024-09-12T19:31:14.940 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-12T19:31:14.946 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.grGEtzNI8G 2024-09-12T19:31:14.946 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.grGEtzNI8G 2024-09-12T19:31:15.129 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.grGEtzNI8G 2024-09-12T19:31:15.192 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.grGEtzNI8G is 530KB 2024-09-12T19:31:15.294 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.grGEtzNI8G 2024-09-12T19:31:15.299 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732/data/mon.c.tgz 2024-09-12T19:31:15.299 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-12T19:31:15.349 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.FXNTbpWeFF 2024-09-12T19:31:15.350 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.FXNTbpWeFF 2024-09-12T19:31:15.539 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.FXNTbpWeFF 2024-09-12T19:31:15.603 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.FXNTbpWeFF is 551KB 2024-09-12T19:31:15.666 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.FXNTbpWeFF 2024-09-12T19:31:15.672 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732/data/mon.b.tgz 2024-09-12T19:31:15.672 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-12T19:31:15.678 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.9vk5CMHtGO 2024-09-12T19:31:15.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9vk5CMHtGO 2024-09-12T19:31:15.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.9vk5CMHtGO 2024-09-12T19:31:15.924 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.9vk5CMHtGO is 553KB 2024-09-12T19:31:15.986 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.9vk5CMHtGO 2024-09-12T19:31:15.994 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T19:31:15.994 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T19:31:15.997 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T19:31:16.110 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T19:31:16.116 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T19:31:16.116 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T19:31:16.118 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732/remote/smithi097/crash 2024-09-12T19:31:16.119 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T19:31:16.131 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732/remote/smithi154/crash 2024-09-12T19:31:16.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T19:31:16.172 INFO:tasks.ceph:Compressing logs... 2024-09-12T19:31:16.173 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T19:31:16.178 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T19:31:16.203 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139382.log 2024-09-12T19:31:16.203 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155977.log 2024-09-12T19:31:16.204 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.139382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56684.log 2024-09-12T19:31:16.204 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.155977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33193.log 2024-09-12T19:31:16.206 INFO:teuthology.orchestra.run.smithi097.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.155977.log.gz 2024-09-12T19:31:16.206 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120502.log 2024-09-12T19:31:16.206 INFO:teuthology.orchestra.run.smithi097.stderr: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.56684.log.gz 2024-09-12T19:31:16.206 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164824.log 2024-09-12T19:31:16.206 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33193.log.gz 2024-09-12T19:31:16.206 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.120502.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.139382.log.gz 2024-09-12T19:31:16.206 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122862.log 2024-09-12T19:31:16.206 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.164824.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T19:31:16.209 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.122862.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.164824.log.gz 2024-09-12T19:31:16.209 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140562.log 2024-09-12T19:31:16.209 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.122862.log.gz 2024-09-12T19:31:16.209 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183923.log 2024-09-12T19:31:16.209 INFO:teuthology.orchestra.run.smithi097.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.120502.log.gz 2024-09-12T19:31:16.210 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.140562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130532.log 2024-09-12T19:31:16.210 INFO:teuthology.orchestra.run.smithi097.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.140562.log.gz 2024-09-12T19:31:16.210 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.183923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133482.log 2024-09-12T19:31:16.210 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183923.log.gz 2024-09-12T19:31:16.210 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.130532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34485.log 2024-09-12T19:31:16.210 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.133482.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.130532.log.gz 2024-09-12T19:31:16.210 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56115.log 2024-09-12T19:31:16.210 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.133482.log.gz 2024-09-12T19:31:16.210 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119912.log 2024-09-12T19:31:16.210 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34485.log.gz 2024-09-12T19:31:16.221 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65083.log 2024-09-12T19:31:16.221 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56115.log.gz 2024-09-12T19:31:16.221 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.119912.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T19:31:16.221 INFO:teuthology.orchestra.run.smithi097.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.119912.log.gz 2024-09-12T19:31:16.222 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.65083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72115.log 2024-09-12T19:31:16.222 INFO:teuthology.orchestra.run.smithi097.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.65083.log.gz 2024-09-12T19:31:16.222 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184261.log 2024-09-12T19:31:16.222 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.72115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74475.log 2024-09-12T19:31:16.222 INFO:teuthology.orchestra.run.smithi097.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.72115.log.gz 2024-09-12T19:31:16.222 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184261.log.gz 2024-09-12T19:31:16.222 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173196.log 2024-09-12T19:31:16.222 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.74475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180606.log 2024-09-12T19:31:16.222 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.74475.log.gz 2024-09-12T19:31:16.222 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.173196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98669.log 2024-09-12T19:31:16.222 INFO:teuthology.orchestra.run.smithi097.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.0.173196.log.gz 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.180606.log: 25.2% -- replaced with /var/log/ceph/ceph-client.admin.180606.log.gz 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85687.log 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81555.log 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98669.log: /var/log/ceph/ceph-client.admin.85687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135842.log 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.98669.log.gz 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.85687.log.gz 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.81555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157157.log 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81555.log.gz 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.135842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45987.log 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.135842.log.gz 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.157157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118142.log 2024-09-12T19:31:16.223 INFO:teuthology.orchestra.run.smithi097.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.157157.log.gz 2024-09-12T19:31:16.224 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75065.log 2024-09-12T19:31:16.224 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.118142.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.45987.log.gz 2024-09-12T19:31:16.224 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158387.log 2024-09-12T19:31:16.225 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.118142.log.gz 2024-09-12T19:31:16.225 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165413.log 2024-09-12T19:31:16.225 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.75065.log: /var/log/ceph/ceph-client.admin.158387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50117.log 2024-09-12T19:31:16.225 INFO:teuthology.orchestra.run.smithi097.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.75065.log.gz 2024-09-12T19:31:16.225 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.165413.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.158387.log.gz 2024-09-12T19:31:16.225 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86867.log 2024-09-12T19:31:16.225 INFO:teuthology.orchestra.run.smithi097.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.165413.log.gz 2024-09-12T19:31:16.225 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156567.log 2024-09-12T19:31:16.225 INFO:teuthology.orchestra.run.smithi097.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.50117.log.gz 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.86867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32298.log 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.86867.log.gz 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.156567.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.32947.log -- replaced with /var/log/ceph/ceph-client.admin.156567.log.gz 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32298.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.32298.log.gz /var/log/ceph/ceph-client.admin.68924.log 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32947.log.gz 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137612.log 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.68924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142332.log 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr: 25.2% -- replaced with /var/log/ceph/ceph-client.admin.68924.log.gz 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.137612.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.137612.log.gz 2024-09-12T19:31:16.226 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89227.log 2024-09-12T19:31:16.227 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.142332.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T19:31:16.227 INFO:teuthology.orchestra.run.smithi097.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.142332.log.gz 2024-09-12T19:31:16.227 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.89227.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.89227.log.gz 2024-09-12T19:31:16.227 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150594.log 2024-09-12T19:31:16.227 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33158.log 2024-09-12T19:31:16.241 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.150594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32680.log 2024-09-12T19:31:16.242 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.150594.log.gz 2024-09-12T19:31:16.242 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34461.log 2024-09-12T19:31:16.242 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33158.log.gz 2024-09-12T19:31:16.242 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32585.log 2024-09-12T19:31:16.242 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32680.log.gz 2024-09-12T19:31:16.242 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34461.log.gz 2024-09-12T19:31:16.242 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138792.log 2024-09-12T19:31:16.242 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183949.log 2024-09-12T19:31:16.242 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32585.log.gz 2024-09-12T19:31:16.242 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.138792.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.138792.log.gz 2024-09-12T19:31:16.242 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61851.log 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147054.log 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.183949.log: /var/log/ceph/ceph-client.admin.61851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183949.log.gz 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52527.log 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.147054.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26943.log 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106339.log 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.52527.log.gz 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.26943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137022.log 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26943.log.gz 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.106339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183897.log 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.137022.log: 86.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78015.log 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.147054.log.gz 2024-09-12T19:31:16.243 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.137022.log.gz 2024-09-12T19:31:16.244 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.183897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58624.log 2024-09-12T19:31:16.244 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183897.log.gz 2024-09-12T19:31:16.244 INFO:teuthology.orchestra.run.smithi097.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106339.log.gz 2024-09-12T19:31:16.244 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.78015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181269.log 2024-09-12T19:31:16.244 INFO:teuthology.orchestra.run.smithi097.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.78015.log.gz 2024-09-12T19:31:16.244 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36272.log 2024-09-12T19:31:16.244 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58624.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.181269.log: /var/log/ceph/ceph-client.admin.112242.log 2024-09-12T19:31:16.244 INFO:teuthology.orchestra.run.smithi097.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.181269.log.gz 2024-09-12T19:31:16.245 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.36272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53707.log 2024-09-12T19:31:16.245 INFO:teuthology.orchestra.run.smithi097.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.36272.log.gz 2024-09-12T19:31:16.245 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99849.log 2024-09-12T19:31:16.245 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.112242.log: /var/log/ceph/ceph-client.admin.53707.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91587.log 2024-09-12T19:31:16.245 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53707.log.gz 2024-09-12T19:31:16.245 INFO:teuthology.orchestra.run.smithi097.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.112242.log.gz 2024-09-12T19:31:16.245 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42987.log 2024-09-12T19:31:16.245 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.91587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151184.log 2024-09-12T19:31:16.245 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.42987.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.42987.log.gz 2024-09-12T19:31:16.245 INFO:teuthology.orchestra.run.smithi097.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.99849.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142922.log 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.91587.log.gz 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.151184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32758.log 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.151184.log.gz 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.142922.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.142922.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42347.log 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32758.log: /var/log/ceph/ceph-osd.2.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32758.log.gz 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32654.log 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.42347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157772.log 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.58624.log.gz 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.42347.log.gz 2024-09-12T19:31:16.246 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32654.log.gz 2024-09-12T19:31:16.247 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64432.log 2024-09-12T19:31:16.247 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.157772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33382.log 2024-09-12T19:31:16.247 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157772.log.gz 2024-09-12T19:31:16.247 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.64432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109882.log 2024-09-12T19:31:16.247 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124632.log 2024-09-12T19:31:16.247 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33382.log.gz 2024-09-12T19:31:16.247 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.109882.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109882.log.gz 2024-09-12T19:31:16.247 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70238.log 2024-09-12T19:31:16.247 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.124632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135252.log 2024-09-12T19:31:16.247 INFO:teuthology.orchestra.run.smithi097.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.124632.log.gz 2024-09-12T19:31:16.247 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.70238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174966.log 2024-09-12T19:31:16.248 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.135252.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.64432.log.gz 2024-09-12T19:31:16.260 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26750.log 2024-09-12T19:31:16.260 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26750.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26750.log.gz 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26702.log 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26870.log 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26702.log.gz 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26846.log 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26870.log: /var/log/ceph/ceph-mgr.x.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26870.log.gz 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26822.log 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26846.log.gz 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T19:31:16.261 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26822.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T19:31:16.262 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26822.log.gz 2024-09-12T19:31:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26726.log 2024-09-12T19:31:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T19:31:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26726.log.gz 2024-09-12T19:31:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T19:31:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26798.log 2024-09-12T19:31:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 90.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T19:31:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26774.log 2024-09-12T19:31:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26798.log.gz 2024-09-12T19:31:16.262 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26774.log.gz 2024-09-12T19:31:16.265 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T19:31:16.284 INFO:teuthology.orchestra.run.smithi097.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.135252.log.gz 2024-09-12T19:31:16.284 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101619.log 2024-09-12T19:31:16.284 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.174966.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T19:31:16.284 INFO:teuthology.orchestra.run.smithi097.stderr: 91.9% 80.6% -- replaced with /var/log/ceph/ceph-client.0.174966.log.gz 2024-09-12T19:31:16.284 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.0.70238.log.gz 2024-09-12T19:31:16.284 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78605.log 2024-09-12T19:31:16.284 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101619.log.gz 2024-09-12T19:31:16.284 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32560.log 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.78605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83915.log 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.78605.log.gz 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32560.log.gz 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184027.log 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.83915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102799.log 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.83915.log.gz 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184027.log.gz 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181368.log 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77425.log 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.102799.log.gz 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.181368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181368.log.gz 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76835.log 2024-09-12T19:31:16.285 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55908.log 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.77425.log: /var/log/ceph/ceph-client.admin.76835.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.77425.log.gz 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.61851.log.gz 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82145.log 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.76835.log.gz 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93359.log 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr: 49.5% -- replaced with /var/log/ceph/ceph-client.admin.55908.log.gz 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.82145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170836.log 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.82145.log.gz 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26693.log 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41167.log 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93359.log.gz 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.170836.log: /var/log/ceph/ceph-client.admin.26693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33356.log 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr: 59.6% -- replaced with /var/log/ceph/ceph-client.admin.26693.log.gz 2024-09-12T19:31:16.286 INFO:teuthology.orchestra.run.smithi097.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.170836.log.gz 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.41167.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.41167.log.gz 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61206.log 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145873.log 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33356.log: /var/log/ceph/ceph-client.admin.61206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80965.log 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33356.log.gz 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.145873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73885.log 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.145873.log.gz 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.80965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111062.log 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr: 82.1%/var/log/ceph/ceph-client.admin.73885.log: -- replaced with /var/log/ceph/ceph-client.admin.80965.log.gz 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61206.log.gz 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76245.log 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73885.log.gz 2024-09-12T19:31:16.287 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34437.log 2024-09-12T19:31:16.288 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.111062.log: /var/log/ceph/ceph-client.admin.76245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33148.log 2024-09-12T19:31:16.288 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111062.log.gz 2024-09-12T19:31:16.288 INFO:teuthology.orchestra.run.smithi097.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.76245.log.gz 2024-09-12T19:31:16.288 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34437.log.gz 2024-09-12T19:31:16.288 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65969.log 2024-09-12T19:31:16.288 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33148.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183975.log 2024-09-12T19:31:16.288 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33148.log.gz 2024-09-12T19:31:16.288 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.65969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45347.log 2024-09-12T19:31:16.288 INFO:teuthology.orchestra.run.smithi097.stderr: 81.5%/var/log/ceph/ceph-client.admin.183975.log: -- replaced with /var/log/ceph/ceph-client.admin.65969.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51347.log 2024-09-12T19:31:16.288 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T19:31:16.289 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183975.log.gz 2024-09-12T19:31:16.289 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45347.log.gz 2024-09-12T19:31:16.289 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33202.log 2024-09-12T19:31:16.289 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106929.log 2024-09-12T19:31:16.289 INFO:teuthology.orchestra.run.smithi097.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.51347.log.gz 2024-09-12T19:31:16.289 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33202.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94539.log 2024-09-12T19:31:16.289 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33202.log.gz 2024-09-12T19:31:16.289 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.106929.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.106929.log.gz 2024-09-12T19:31:16.289 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176146.log 2024-09-12T19:31:16.290 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32968.log 2024-09-12T19:31:16.290 INFO:teuthology.orchestra.run.smithi097.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94539.log.gz 2024-09-12T19:31:16.290 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.176146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56164.log 2024-09-12T19:31:16.290 INFO:teuthology.orchestra.run.smithi097.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.176146.log.gz 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107519.log 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32968.log.gz 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56164.log: 54.3% -- replaced with /var/log/ceph/ceph-client.admin.56164.log.gz 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104569.log 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.107519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100439.log 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.107519.log.gz 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108112.log 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100439.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104569.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184183.log 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.100439.log.gz 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.108112.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108112.log.gz 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32757.log 2024-09-12T19:31:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184183.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85097.log 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.184183.log.gz 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127582.log 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32757.log.gz 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.85097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32706.log 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132892.log 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3%/var/log/ceph/ceph-client.admin.127582.log: -- replaced with /var/log/ceph/ceph-client.admin.85097.log.gz 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32706.log.gz 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.127582.log.gz 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40577.log 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.132892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184131.log 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.132892.log.gz/var/log/ceph/ceph-client.admin.40577.log: 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172016.log 2024-09-12T19:31:16.292 INFO:teuthology.orchestra.run.smithi097.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.40577.log.gz 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96309.log 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184131.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87457.log 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.172016.log: /var/log/ceph/ceph-client.admin.96309.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.172016.log.gz 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145283.log 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96309.log.gz 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.87457.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.87457.log.gz 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162328.log 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.145283.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144102.log 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.145283.log.gz 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.162328.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.162328.log.gz 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32756.log 2024-09-12T19:31:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.144102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131712.log 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.144102.log.gz 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32756.log.gz 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176736.log 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.131712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68333.log 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.176736.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.131712.log.gz 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.176736.log.gz 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67152.log 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.68333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96899.log 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.68333.log.gz/var/log/ceph/ceph-client.admin.67152.log: 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.67152.log.gz 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184548.log 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26847.log 2024-09-12T19:31:16.294 INFO:teuthology.orchestra.run.smithi097.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.96899.log.gz 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184548.log.gz 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37446.log 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.26847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169656.log 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26847.log.gz 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.37446.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37446.log.gz 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105159.log 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.169656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132302.log 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.169656.log.gz/var/log/ceph/ceph-client.admin.105159.log: 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.105159.log.gz 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32956.log 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.132302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33408.log 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.132302.log.gz 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32956.log.gz 2024-09-12T19:31:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48347.log 2024-09-12T19:31:16.296 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33408.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116962.log 2024-09-12T19:31:16.296 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33408.log.gz 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48347.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.48347.log.gz 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72705.log 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.116962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68976.log 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.116962.log.gz 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.72705.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.72705.log.gz 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122272.log 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.68976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32750.log 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.0.68976.log.gz/var/log/ceph/ceph-client.admin.122272.log: 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122272.log.gz 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92767.log 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125222.log 2024-09-12T19:31:16.305 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32750.log.gz 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.92767.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.92767.log.gz 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62496.log 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.125222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105749.log 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.62496.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.125222.log.gz 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.62496.log.gz 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115192.log 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.105749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170246.log 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.105749.log.gz 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.115192.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.115192.log.gz 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141152.log 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.170246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184417.log 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.170246.log.gz 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.141152.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.141152.log.gz 2024-09-12T19:31:16.306 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33160.log 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33159.log 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184417.log.gz 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33160.log.gz 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53757.log 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67742.log 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33159.log.gz 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53757.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.53757.log.gz 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169066.log 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.67742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101029.log 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.67742.log.gz 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.169066.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.169066.log.gz 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41757.log 2024-09-12T19:31:16.307 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115782.log 2024-09-12T19:31:16.308 INFO:teuthology.orchestra.run.smithi097.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101029.log.gz 2024-09-12T19:31:16.308 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.41757.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.41757.log.gz 2024-09-12T19:31:16.308 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T19:31:16.308 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.115782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181292.log 2024-09-12T19:31:16.308 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115782.log.gz/var/log/ceph/ops-log-ceph-client.admin.log: 2024-09-12T19:31:16.308 INFO:teuthology.orchestra.run.smithi097.stderr: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T19:31:16.308 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45372.log 2024-09-12T19:31:16.308 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.181292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141742.log 2024-09-12T19:31:16.308 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181292.log.gz 2024-09-12T19:31:16.308 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45372.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T19:31:16.308 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T19:31:16.311 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.141742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79785.log 2024-09-12T19:31:16.311 INFO:teuthology.orchestra.run.smithi097.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.141742.log.gz 2024-09-12T19:31:16.311 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152954.log 2024-09-12T19:31:16.311 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.79785.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79785.log.gz 2024-09-12T19:31:16.311 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124042.log 2024-09-12T19:31:16.311 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.152954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152954.log.gz 2024-09-12T19:31:16.311 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57334.log 2024-09-12T19:31:16.311 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.124042.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.124042.log.gz 2024-09-12T19:31:16.311 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32938.log 2024-09-12T19:31:16.320 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184471.log 2024-09-12T19:31:16.320 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32938.log.gz 2024-09-12T19:31:16.323 INFO:teuthology.orchestra.run.smithi154.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T19:31:16.325 INFO:teuthology.orchestra.run.smithi097.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.57334.log.gz 2024-09-12T19:31:16.325 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73295.log 2024-09-12T19:31:16.327 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184471.log.gz 2024-09-12T19:31:16.327 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54347.log 2024-09-12T19:31:16.327 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.73295.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.73295.log.gz 2024-09-12T19:31:16.328 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143512.log 2024-09-12T19:31:16.329 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54347.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.54347.log.gz 2024-09-12T19:31:16.329 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103389.log 2024-09-12T19:31:16.331 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.143512.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.143512.log.gz 2024-09-12T19:31:16.331 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39198.log 2024-09-12T19:31:16.332 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103389.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103389.log.gz 2024-09-12T19:31:16.332 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33192.log 2024-09-12T19:31:16.333 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.39198.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.39198.log.gz 2024-09-12T19:31:16.333 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114602.log 2024-09-12T19:31:16.334 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33192.log.gz 2024-09-12T19:31:16.334 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184001.log 2024-09-12T19:31:16.337 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.114602.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114602.log.gz 2024-09-12T19:31:16.337 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173786.log 2024-09-12T19:31:16.338 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184001.log.gz 2024-09-12T19:31:16.338 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70828.log 2024-09-12T19:31:16.339 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.173786.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.173786.log.gz 2024-09-12T19:31:16.339 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51297.log 2024-09-12T19:31:16.340 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.70828.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.70828.log.gz 2024-09-12T19:31:16.340 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134072.log 2024-09-12T19:31:16.341 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51297.log.gz 2024-09-12T19:31:16.341 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180629.log 2024-09-12T19:31:16.342 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.134072.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.134072.log.gz 2024-09-12T19:31:16.343 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56709.log 2024-09-12T19:31:16.343 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.180629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180629.log.gz 2024-09-12T19:31:16.344 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59916.log 2024-09-12T19:31:16.344 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56709.log: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.56709.log.gz 2024-09-12T19:31:16.345 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146464.log 2024-09-12T19:31:16.351 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59916.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.59916.log.gz 2024-09-12T19:31:16.351 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38614.log 2024-09-12T19:31:16.352 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.146464.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.146464.log.gz 2024-09-12T19:31:16.352 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126402.log 2024-09-12T19:31:16.353 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.38614.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.38614.log.gz 2024-09-12T19:31:16.353 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32628.log 2024-09-12T19:31:16.354 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.126402.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.126402.log.gz 2024-09-12T19:31:16.354 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T19:31:16.355 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32628.log.gz 2024-09-12T19:31:16.355 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166002.log 2024-09-12T19:31:16.372 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56138.log 2024-09-12T19:31:16.373 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.166002.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.166002.log.gz 2024-09-12T19:31:16.373 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79195.log 2024-09-12T19:31:16.386 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56138.log: 93.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59271.log 2024-09-12T19:31:16.386 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.79195.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.79195.log.gz 2024-09-12T19:31:16.397 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55622.log 2024-09-12T19:31:16.397 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T19:31:16.397 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59271.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56138.log.gz 2024-09-12T19:31:16.398 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32966.log 2024-09-12T19:31:16.398 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55622.log: 60.5% -- replaced with /var/log/ceph/ceph-client.admin.55622.log.gz 2024-09-12T19:31:16.399 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32746.log 2024-09-12T19:31:16.399 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32966.log.gz 2024-09-12T19:31:16.400 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152364.log 2024-09-12T19:31:16.400 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32746.log.gz 2024-09-12T19:31:16.401 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110472.log 2024-09-12T19:31:16.401 INFO:teuthology.orchestra.run.smithi097.stderr: 93.2%/var/log/ceph/ceph-client.admin.152364.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.152364.log.gz 2024-09-12T19:31:16.402 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184235.log 2024-09-12T19:31:16.403 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.110472.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.110472.log.gz 2024-09-12T19:31:16.403 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184287.log 2024-09-12T19:31:16.404 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184235.log.gz 2024-09-12T19:31:16.404 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168465.log 2024-09-12T19:31:16.405 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184287.log.gz 2024-09-12T19:31:16.405 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89817.log 2024-09-12T19:31:16.406 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.168465.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.168465.log.gz 2024-09-12T19:31:16.406 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56745.log 2024-09-12T19:31:16.407 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.89817.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89817.log.gz 2024-09-12T19:31:16.408 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180654.log 2024-09-12T19:31:16.409 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56745.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.56745.log.gz 2024-09-12T19:31:16.409 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184391.log 2024-09-12T19:31:16.410 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.180654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180654.log.gz 2024-09-12T19:31:16.410 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129942.log 2024-09-12T19:31:16.411 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184391.log.gz 2024-09-12T19:31:16.411 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117552.log 2024-09-12T19:31:16.412 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.129942.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.129942.log.gz 2024-09-12T19:31:16.412 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172606.log 2024-09-12T19:31:16.413 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.117552.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.117552.log.gz 2024-09-12T19:31:16.413 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35682.log 2024-09-12T19:31:16.414 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.172606.log: 84.7% -- replaced with /var/log/ceph/ceph-client.0.172606.log.gz 2024-09-12T19:31:16.415 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154156.log 2024-09-12T19:31:16.416 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.35682.log: -- replaced with /var/log/ceph/ceph-client.admin.59271.log.gz 2024-09-12T19:31:16.416 INFO:teuthology.orchestra.run.smithi097.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.0.35682.log.gz 2024-09-12T19:31:16.416 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155336.log 2024-09-12T19:31:16.417 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.154156.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.154156.log.gz 2024-09-12T19:31:16.417 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149414.log 2024-09-12T19:31:16.418 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.155336.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.155336.log.gz 2024-09-12T19:31:16.418 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32967.log 2024-09-12T19:31:16.419 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.149414.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.149414.log.gz 2024-09-12T19:31:16.420 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63141.log 2024-09-12T19:31:16.420 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32967.log.gz 2024-09-12T19:31:16.421 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53732.log 2024-09-12T19:31:16.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.63141.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63141.log.gz 2024-09-12T19:31:16.426 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147644.log 2024-09-12T19:31:16.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53732.log.gz 2024-09-12T19:31:16.426 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44167.log 2024-09-12T19:31:16.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.147644.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.147644.log.gz 2024-09-12T19:31:16.426 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109292.log 2024-09-12T19:31:16.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44167.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.44167.log.gz 2024-09-12T19:31:16.428 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42937.log 2024-09-12T19:31:16.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.109292.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.109292.log.gz 2024-09-12T19:31:16.429 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98079.log 2024-09-12T19:31:16.429 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.42937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42937.log.gz 2024-09-12T19:31:16.430 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35098.log 2024-09-12T19:31:16.430 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98079.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98079.log.gz 2024-09-12T19:31:16.430 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T19:31:16.431 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.35098.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35098.log.gz 2024-09-12T19:31:16.431 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161056.log 2024-09-12T19:31:16.452 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56187.log 2024-09-12T19:31:16.453 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.161056.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.161056.log.gz 2024-09-12T19:31:16.468 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128762.log 2024-09-12T19:31:16.468 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56187.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.56187.log.gz 2024-09-12T19:31:16.469 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50707.log 2024-09-12T19:31:16.470 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.128762.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128762.log.gz 2024-09-12T19:31:16.483 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69566.log 2024-09-12T19:31:16.484 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50707.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.50707.log.gz 2024-09-12T19:31:16.496 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84505.log 2024-09-12T19:31:16.496 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.69566.log: 84.7% -- replaced with /var/log/ceph/ceph-client.0.69566.log.gz 2024-09-12T19:31:16.516 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160467.log 2024-09-12T19:31:16.516 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.84505.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.84505.log.gz 2024-09-12T19:31:16.523 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32953.log 2024-09-12T19:31:16.527 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.160467.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.160467.log.gz 2024-09-12T19:31:16.532 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155927.log 2024-09-12T19:31:16.532 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32953.log.gz 2024-09-12T19:31:16.544 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155952.log 2024-09-12T19:31:16.544 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.155927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155927.log.gz 2024-09-12T19:31:16.551 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154746.log 2024-09-12T19:31:16.551 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.155952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155952.log.gz 2024-09-12T19:31:16.568 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90407.log 2024-09-12T19:31:16.568 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.154746.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.154746.log.gz 2024-09-12T19:31:16.580 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86277.log 2024-09-12T19:31:16.580 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.90407.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.90407.log.gz 2024-09-12T19:31:16.592 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184079.log 2024-09-12T19:31:16.593 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.86277.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.86277.log.gz 2024-09-12T19:31:16.600 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54937.log 2024-09-12T19:31:16.600 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184079.log.gz 2024-09-12T19:31:16.608 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121682.log 2024-09-12T19:31:16.608 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54937.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.54937.log.gz 2024-09-12T19:31:16.616 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49527.log 2024-09-12T19:31:16.616 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.121682.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.121682.log.gz 2024-09-12T19:31:16.624 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184053.log 2024-09-12T19:31:16.624 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49527.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.49527.log.gz 2024-09-12T19:31:16.632 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32608.log 2024-09-12T19:31:16.632 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184053.log.gz 2024-09-12T19:31:16.640 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125812.log 2024-09-12T19:31:16.640 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32608.log.gz 2024-09-12T19:31:16.648 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113422.log 2024-09-12T19:31:16.648 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.125812.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.125812.log.gz 2024-09-12T19:31:16.656 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T19:31:16.656 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.113422.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.113422.log.gz 2024-09-12T19:31:16.664 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95129.log 2024-09-12T19:31:16.672 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184157.log 2024-09-12T19:31:16.672 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95129.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.95129.log.gz 2024-09-12T19:31:16.680 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33164.log 2024-09-12T19:31:16.680 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184157.log.gz 2024-09-12T19:31:16.688 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108702.log 2024-09-12T19:31:16.688 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33164.log.gz 2024-09-12T19:31:16.696 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126992.log 2024-09-12T19:31:16.696 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.108702.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.108702.log.gz 2024-09-12T19:31:16.704 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184524.log 2024-09-12T19:31:16.705 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.126992.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.126992.log.gz 2024-09-12T19:31:16.712 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45397.log 2024-09-12T19:31:16.712 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184524.log.gz 2024-09-12T19:31:16.720 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144692.log 2024-09-12T19:31:16.720 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45397.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.45397.log.gz 2024-09-12T19:31:16.736 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184209.log 2024-09-12T19:31:16.736 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.144692.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.144692.log.gz 2024-09-12T19:31:16.744 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2024-09-12T19:31:16.744 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184209.log.gz 2024-09-12T19:31:16.752 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T19:31:16.752 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.42962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2024-09-12T19:31:16.760 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138202.log 2024-09-12T19:31:16.763 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T19:31:16.768 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99259.log 2024-09-12T19:31:16.768 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.138202.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.138202.log.gz 2024-09-12T19:31:16.784 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148824.log 2024-09-12T19:31:16.784 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99259.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.99259.log.gz 2024-09-12T19:31:16.792 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150004.log 2024-09-12T19:31:16.792 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.148824.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.148824.log.gz 2024-09-12T19:31:16.808 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128172.log 2024-09-12T19:31:16.809 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.150004.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.150004.log.gz 2024-09-12T19:31:16.824 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53117.log 2024-09-12T19:31:16.824 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.128172.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.128172.log.gz 2024-09-12T19:31:16.840 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70204.log 2024-09-12T19:31:16.841 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53117.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.53117.log.gz 2024-09-12T19:31:16.848 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164095.log 2024-09-12T19:31:16.848 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.70204.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.70204.log.gz 2024-09-12T19:31:16.851 INFO:teuthology.orchestra.run.smithi097.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T19:31:16.867 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32760.log 2024-09-12T19:31:16.869 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.164095.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.164095.log.gz 2024-09-12T19:31:16.876 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162917.log 2024-09-12T19:31:16.876 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32760.log.gz 2024-09-12T19:31:16.884 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174376.log 2024-09-12T19:31:16.884 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.162917.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.162917.log.gz 2024-09-12T19:31:16.896 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179426.log 2024-09-12T19:31:16.896 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.174376.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.174376.log.gz 2024-09-12T19:31:16.904 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34413.log 2024-09-12T19:31:16.904 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.179426.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.179426.log.gz 2024-09-12T19:31:16.912 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46577.log 2024-09-12T19:31:16.912 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34413.log.gz 2024-09-12T19:31:16.920 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177916.log 2024-09-12T19:31:16.920 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46577.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.46577.log.gz 2024-09-12T19:31:16.928 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184365.log 2024-09-12T19:31:16.928 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.177916.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.177916.log.gz 2024-09-12T19:31:16.936 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123452.log 2024-09-12T19:31:16.936 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184365.log.gz 2024-09-12T19:31:16.944 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55837.log 2024-09-12T19:31:16.944 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.123452.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.123452.log.gz 2024-09-12T19:31:16.952 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134662.log 2024-09-12T19:31:16.952 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55837.log: 55.3% -- replaced with /var/log/ceph/ceph-client.admin.55837.log.gz 2024-09-12T19:31:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47757.log 2024-09-12T19:31:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.134662.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.134662.log.gz 2024-09-12T19:31:16.968 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163506.log 2024-09-12T19:31:16.968 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47757.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.47757.log.gz 2024-09-12T19:31:16.976 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184445.log 2024-09-12T19:31:16.976 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.163506.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.163506.log.gz 2024-09-12T19:31:16.984 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184339.log 2024-09-12T19:31:16.984 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184445.log.gz 2024-09-12T19:31:16.992 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151774.log 2024-09-12T19:31:16.992 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184339.log.gz 2024-09-12T19:31:17.000 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T19:31:17.000 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.151774.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.151774.log.gz 2024-09-12T19:31:17.008 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181393.log 2024-09-12T19:31:17.008 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 63.0% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T19:31:17.016 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177326.log 2024-09-12T19:31:17.016 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.181393.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.181393.log.gz 2024-09-12T19:31:17.024 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32759.log 2024-09-12T19:31:17.024 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.177326.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.177326.log.gz 2024-09-12T19:31:17.032 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48937.log 2024-09-12T19:31:17.032 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32759.log.gz 2024-09-12T19:31:17.040 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21901.log 2024-09-12T19:31:17.040 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48937.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.48937.log.gz 2024-09-12T19:31:17.048 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95719.log 2024-09-12T19:31:17.048 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.tmp-client.admin.21901.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21901.log.gz 2024-09-12T19:31:17.056 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184313.log 2024-09-12T19:31:17.057 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95719.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.95719.log.gz 2024-09-12T19:31:17.064 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75655.log 2024-09-12T19:31:17.064 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184313.log.gz 2024-09-12T19:31:17.072 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158977.log 2024-09-12T19:31:17.072 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.75655.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.75655.log.gz 2024-09-12T19:31:17.080 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44757.log 2024-09-12T19:31:17.080 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.158977.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.158977.log.gz 2024-09-12T19:31:17.088 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57979.log 2024-09-12T19:31:17.088 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44757.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.44757.log.gz 2024-09-12T19:31:17.096 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.159875.log 2024-09-12T19:31:17.096 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57979.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.57979.log.gz 2024-09-12T19:31:17.112 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71525.log 2024-09-12T19:31:17.112 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.159875.log: 83.5% -- replaced with /var/log/ceph/ceph-client.0.159875.log.gz 2024-09-12T19:31:17.120 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153566.log 2024-09-12T19:31:17.120 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.71525.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.71525.log.gz 2024-09-12T19:31:17.128 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47167.log 2024-09-12T19:31:17.128 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.153566.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153566.log.gz 2024-09-12T19:31:17.148 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103979.log 2024-09-12T19:31:17.148 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47167.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.47167.log.gz 2024-09-12T19:31:17.164 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83325.log 2024-09-12T19:31:17.164 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103979.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.103979.log.gz 2024-09-12T19:31:17.172 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118732.log 2024-09-12T19:31:17.173 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.83325.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.83325.log.gz 2024-09-12T19:31:17.180 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112832.log 2024-09-12T19:31:17.180 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.118732.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.118732.log.gz 2024-09-12T19:31:17.192 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102209.log 2024-09-12T19:31:17.192 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.112832.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112832.log.gz 2024-09-12T19:31:17.200 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139972.log 2024-09-12T19:31:17.200 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102209.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.102209.log.gz 2024-09-12T19:31:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181317.log 2024-09-12T19:31:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.139972.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.139972.log.gz 2024-09-12T19:31:17.216 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60561.log 2024-09-12T19:31:17.216 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.181317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181317.log.gz 2024-09-12T19:31:17.232 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90997.log 2024-09-12T19:31:17.234 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.60561.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.60561.log.gz 2024-09-12T19:31:17.240 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121092.log 2024-09-12T19:31:17.240 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.90997.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.90997.log.gz 2024-09-12T19:31:17.248 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167876.log 2024-09-12T19:31:17.248 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.121092.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.121092.log.gz 2024-09-12T19:31:17.256 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119322.log 2024-09-12T19:31:17.258 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.167876.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.167876.log.gz 2024-09-12T19:31:17.264 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34508.log 2024-09-12T19:31:17.264 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.119322.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.119322.log.gz 2024-09-12T19:31:17.272 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43577.log 2024-09-12T19:31:17.273 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.34508.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.34508.log.gz 2024-09-12T19:31:17.280 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178506.log 2024-09-12T19:31:17.280 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.43577.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2024-09-12T19:31:17.288 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66558.log 2024-09-12T19:31:17.288 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.178506.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.178506.log.gz 2024-09-12T19:31:17.291 INFO:teuthology.orchestra.run.smithi097.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T19:31:17.292 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82735.log 2024-09-12T19:31:17.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.66558.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.66558.log.gz 2024-09-12T19:31:17.293 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184497.log 2024-09-12T19:31:17.294 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.82735.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.82735.log.gz 2024-09-12T19:31:17.294 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157747.log 2024-09-12T19:31:17.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184497.log.gz 2024-09-12T19:31:17.295 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116372.log 2024-09-12T19:31:17.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.157747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157747.log.gz 2024-09-12T19:31:17.296 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51937.log 2024-09-12T19:31:17.297 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.116372.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.116372.log.gz 2024-09-12T19:31:17.297 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152976.log 2024-09-12T19:31:17.298 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51937.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.51937.log.gz 2024-09-12T19:31:17.298 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131122.log 2024-09-12T19:31:17.299 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.152976.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.152976.log.gz 2024-09-12T19:31:17.299 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136432.log 2024-09-12T19:31:17.300 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.131122.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.131122.log.gz 2024-09-12T19:31:17.300 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80375.log 2024-09-12T19:31:17.301 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.136432.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.136432.log.gz 2024-09-12T19:31:17.301 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175556.log 2024-09-12T19:31:17.302 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.80375.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.80375.log.gz 2024-09-12T19:31:17.302 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180679.log 2024-09-12T19:31:17.303 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.175556.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.175556.log.gz 2024-09-12T19:31:17.304 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32754.log 2024-09-12T19:31:17.304 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.180679.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.180679.log.gz 2024-09-12T19:31:17.305 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36856.log 2024-09-12T19:31:17.305 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32754.log.gz 2024-09-12T19:31:17.305 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184105.log 2024-09-12T19:31:17.306 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.36856.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.36856.log.gz 2024-09-12T19:31:17.306 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180016.log 2024-09-12T19:31:17.307 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.184105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184105.log.gz 2024-09-12T19:31:17.307 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129352.log 2024-09-12T19:31:17.308 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.180016.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.180016.log.gz 2024-09-12T19:31:17.308 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171426.log 2024-09-12T19:31:17.309 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.129352.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.129352.log.gz 2024-09-12T19:31:17.309 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166591.log 2024-09-12T19:31:17.310 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.171426.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.171426.log.gz 2024-09-12T19:31:17.310 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181342.log 2024-09-12T19:31:17.311 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.166591.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.166591.log.gz 2024-09-12T19:31:17.312 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182586.log 2024-09-12T19:31:17.312 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.181342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181342.log.gz 2024-09-12T19:31:17.312 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93949.log 2024-09-12T19:31:17.328 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.182586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97489.log 2024-09-12T19:31:17.328 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93949.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.93949.log.gz 2024-09-12T19:31:17.342 INFO:teuthology.orchestra.run.smithi097.stderr: 87.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38030.log 2024-09-12T19:31:17.343 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97489.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.97489.log.gz 2024-09-12T19:31:17.343 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92177.log 2024-09-12T19:31:17.344 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.38030.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.38030.log.gz 2024-09-12T19:31:17.344 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.0.182586.log.gz 2024-09-12T19:31:17.345 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88047.log 2024-09-12T19:31:17.345 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.92177.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.92177.log.gz 2024-09-12T19:31:17.346 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51322.log 2024-09-12T19:31:17.346 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.88047.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.88047.log.gz 2024-09-12T19:31:17.347 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114012.log 2024-09-12T19:31:17.347 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51322.log.gz 2024-09-12T19:31:17.348 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181990.log 2024-09-12T19:31:17.348 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.114012.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.114012.log.gz 2024-09-12T19:31:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63787.log 2024-09-12T19:31:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.181990.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.181990.log.gz 2024-09-12T19:31:17.350 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56075.log 2024-09-12T19:31:17.351 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.63787.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63787.log.gz 2024-09-12T19:31:17.352 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157797.log 2024-09-12T19:31:17.352 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56075.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.56075.log.gz 2024-09-12T19:31:17.353 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32948.log 2024-09-12T19:31:17.354 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.157797.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.157797.log.gz 2024-09-12T19:31:17.354 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148234.log 2024-09-12T19:31:17.355 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32948.log.gz 2024-09-12T19:31:17.355 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88637.log 2024-09-12T19:31:17.356 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.148234.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.148234.log.gz 2024-09-12T19:31:17.356 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111652.log 2024-09-12T19:31:17.357 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.88637.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.88637.log.gz 2024-09-12T19:31:17.358 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.111652.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.111652.log.gz 2024-09-12T19:31:17.453 INFO:teuthology.orchestra.run.smithi154.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T19:31:18.574 INFO:teuthology.orchestra.run.smithi097.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T19:31:19.990 INFO:teuthology.orchestra.run.smithi097.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T19:31:20.243 INFO:teuthology.orchestra.run.smithi097.stderr: 92.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T19:31:25.279 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T19:31:25.461 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T19:31:26.557 INFO:teuthology.orchestra.run.smithi097.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T19:31:26.780 INFO:teuthology.orchestra.run.smithi097.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T19:31:28.911 INFO:teuthology.orchestra.run.smithi097.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T19:31:29.648 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T19:31:34.218 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T19:31:34.219 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-12T19:31:34.219 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m18.000s 2024-09-12T19:31:34.219 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m49.224s 2024-09-12T19:31:34.219 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m1.743s 2024-09-12T19:31:34.523 INFO:teuthology.orchestra.run.smithi097.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T19:31:34.524 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T19:31:34.524 INFO:teuthology.orchestra.run.smithi097.stderr:real 0m18.345s 2024-09-12T19:31:34.524 INFO:teuthology.orchestra.run.smithi097.stderr:user 1m0.951s 2024-09-12T19:31:34.524 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m2.188s 2024-09-12T19:31:34.525 INFO:tasks.ceph:Archiving logs... 2024-09-12T19:31:34.526 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732/remote/smithi097/log 2024-09-12T19:31:34.527 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T19:31:41.650 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732/remote/smithi154/log 2024-09-12T19:31:41.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T19:31:47.788 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T19:31:47.820 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T19:31:47.820 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T19:31:47.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T19:31:47.876 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T19:31:47.887 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T19:31:47.888 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T19:31:47.890 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T19:31:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T19:31:47.905 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-09-12T19:31:47.905 INFO:teuthology.orchestra.run.smithi097.stdout:*hv01.front.sepi 67.205.162.81 3 u 230 256 377 0.185 -1.259 0.257 2024-09-12T19:31:47.905 INFO:teuthology.orchestra.run.smithi097.stdout:+hv02.front.sepi 96.245.170.99 3 u 223 256 377 0.132 -3.126 0.571 2024-09-12T19:31:47.905 INFO:teuthology.orchestra.run.smithi097.stdout:+hv03.front.sepi 74.6.168.72 3 u 95 256 377 0.168 -0.786 0.784 2024-09-12T19:31:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T19:31:47.907 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T19:31:47.907 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-09-12T19:31:47.907 INFO:teuthology.orchestra.run.smithi154.stdout:*hv01.front.sepi 67.205.162.81 3 u 104 128 377 0.162 +0.003 0.445 2024-09-12T19:31:47.907 INFO:teuthology.orchestra.run.smithi154.stdout:+hv02.front.sepi 96.245.170.99 3 u 15 128 377 0.192 -2.484 0.204 2024-09-12T19:31:47.907 INFO:teuthology.orchestra.run.smithi154.stdout:+hv03.front.sepi 74.6.168.72 3 u 125 128 377 0.165 +1.275 0.218 2024-09-12T19:31:47.907 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T19:31:47.908 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T19:31:47.918 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T19:31:47.918 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T19:31:47.968 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T19:31:48.018 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T19:31:48.069 INFO:teuthology.task.internal:Duration was 7573.234614 seconds 2024-09-12T19:31:48.070 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T19:31:48.120 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T19:31:48.120 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T19:31:48.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T19:31:48.162 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T19:31:48.162 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T19:31:48.162 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T19:31:48.217 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-12T19:31:48.217 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T19:31:48.227 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T19:31:48.228 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T19:31:48.265 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T19:31:48.297 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T19:31:48.298 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T19:31:48.337 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T19:31:48.396 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T19:31:48.408 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T19:31:48.408 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T19:31:48.420 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T19:31:48.432 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T19:31:48.444 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:31:48.465 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:31:48.472 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2024-09-12T19:31:48.488 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-12T19:31:48.511 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:31:48.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:31:48.527 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:31:48.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:31:48.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T19:31:48.567 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T19:31:48.568 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732/remote/smithi097 2024-09-12T19:31:48.568 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T19:31:48.590 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902732/remote/smithi154 2024-09-12T19:31:48.590 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T19:31:48.620 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T19:31:48.620 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T19:31:48.629 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T19:31:48.668 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T19:31:48.680 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T19:31:48.680 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T19:31:48.711 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T19:31:48.711 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T19:31:48.714 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T19:31:48.717 INFO:teuthology.orchestra.run.smithi097.stdout: 658633 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 19:31 /home/ubuntu/cephtest 2024-09-12T19:31:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: 658464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 19:31 /home/ubuntu/cephtest 2024-09-12T19:31:48.721 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T19:31:48.762 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T19:31:48.867 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 7573.234614372253 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T19:31:48.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T19:31:48.960 INFO:teuthology.run:pass